Testing the suitability of geologic frameworks for extrapolating hydraulic properties across regional scales

USGS Publications Warehouse

Mirus, Benjamin B.; Halford, Keith J.; Sweetkind, Donald; Fenelon, Joseph M.

2016-01-01

The suitability of geologic frameworks for extrapolating hydraulic conductivity (K) to length scales commensurate with hydraulic data is difficult to assess. A novel method is presented for evaluating assumed relations between K and geologic interpretations for regional-scale groundwater modeling. The approach relies on simultaneous interpretation of multiple aquifer tests using alternative geologic frameworks of variable complexity, where each framework is incorporated as prior information that assumes homogeneous K within each model unit. This approach is tested at Pahute Mesa within the Nevada National Security Site (USA), where observed drawdowns from eight aquifer tests in complex, highly faulted volcanic rocks provide the necessary hydraulic constraints. The investigated volume encompasses 40 mi3 (167 km3) where drawdowns traversed major fault structures and were detected more than 2 mi (3.2 km) from pumping wells. Complexity of the five frameworks assessed ranges from an undifferentiated mass of rock with a single unit to 14 distinct geologic units. Results show that only four geologic units can be justified as hydraulically unique for this location. The approach qualitatively evaluates the consistency of hydraulic property estimates within extents of investigation and effects of geologic frameworks on extrapolation. Distributions of transmissivity are similar within the investigated extents irrespective of the geologic framework. In contrast, the extrapolation of hydraulic properties beyond the volume investigated with interfering aquifer tests is strongly affected by the complexity of a given framework. Testing at Pahute Mesa illustrates how this method can be employed to determine the appropriate level of geologic complexity for large-scale groundwater modeling.

Testing the suitability of geologic frameworks for extrapolating hydraulic properties across regional scales

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mirus, Benjamin B.; Halford, Keith J.; Sweetkind, Donald

The suitability of geologic frameworks for extrapolating hydraulic conductivity (K) to length scales commensurate with hydraulic data is difficult to assess. A novel method is presented for evaluating assumed relations between K and geologic interpretations for regional-scale groundwater modeling. The approach relies on simultaneous interpretation of multiple aquifer tests using alternative geologic frameworks of variable complexity, where each framework is incorporated as prior information that assumes homogeneous K within each model unit. This approach is tested at Pahute Mesa within the Nevada National Security Site (USA), where observed drawdowns from eight aquifer tests in complex, highly faulted volcanic rocks providemore » the necessary hydraulic constraints. The investigated volume encompasses 40 mi3 (167 km3) where drawdowns traversed major fault structures and were detected more than 2 mi (3.2 km) from pumping wells. Complexity of the five frameworks assessed ranges from an undifferentiated mass of rock with a single unit to 14 distinct geologic units. Results show that only four geologic units can be justified as hydraulically unique for this location. The approach qualitatively evaluates the consistency of hydraulic property estimates within extents of investigation and effects of geologic frameworks on extrapolation. Distributions of transmissivity are similar within the investigated extents irrespective of the geologic framework. In contrast, the extrapolation of hydraulic properties beyond the volume investigated with interfering aquifer tests is strongly affected by the complexity of a given framework. As a result, testing at Pahute Mesa illustrates how this method can be employed to determine the appropriate level of geologic complexity for large-scale groundwater modeling.« less

A software framework for developing measurement applications under variable requirements.

PubMed

Arpaia, Pasquale; Buzio, Marco; Fiscarelli, Lucio; Inglese, Vitaliano

2012-11-01

A framework for easily developing software for measurement and test applications under highly and fast-varying requirements is proposed. The framework allows the software quality, in terms of flexibility, usability, and maintainability, to be maximized. Furthermore, the development effort is reduced and finalized, by relieving the test engineer of development details. The framework can be configured for satisfying a large set of measurement applications in a generic field for an industrial test division, a test laboratory, or a research center. As an experimental case study, the design, the implementation, and the assessment inside the application to a measurement scenario of magnet testing at the European Organization for Nuclear Research is reported.

USING SEDIMENT QUALITY GUIDELINES IN DREDGED MATERIAL ASSESSMENTS

EPA Science Inventory

Sediment quality guidelines (SQGs) are not formally included in the frameworks described in the Inland Testing manual and the Green Book because these frameworks are biologically based. The SQGs are often used informally, however, to help put the results of biological testing in ...

Conceptualizing and assessing improvement capability: a review

PubMed Central

Boaden, Ruth; Walshe, Kieran

2017-01-01

Abstract Purpose The literature is reviewed to examine how ‘improvement capability’ is conceptualized and assessed and to identify future areas for research. Data sources An iterative and systematic search of the literature was carried out across all sectors including healthcare. The search was limited to literature written in English. Data extraction The study identifies and analyses 70 instruments and frameworks for assessing or measuring improvement capability. Information about the source of the instruments, the sectors in which they were developed or used, the measurement constructs or domains they employ, and how they were tested was extracted. Results of data synthesis The instruments and framework constructs are very heterogeneous, demonstrating the ambiguity of improvement capability as a concept, and the difficulties involved in its operationalisation. Two-thirds of the instruments and frameworks have been subject to tests of reliability and half to tests of validity. Many instruments have little apparent theoretical basis and do not seem to have been used widely. Conclusion The assessment and development of improvement capability needs clearer and more consistent conceptual and terminological definition, used consistently across disciplines and sectors. There is scope to learn from existing instruments and frameworks, and this study proposes a synthetic framework of eight dimensions of improvement capability. Future instruments need robust testing for reliability and validity. This study contributes to practice and research by presenting the first review of the literature on improvement capability across all sectors including healthcare. PMID:28992146

A process dissociation approach to objective-projective test score interrelationships.

PubMed

Bornstein, Robert F

2002-02-01

Even when self-report and projective measures of a given trait or motive both predict theoretically related features of behavior, scores on the 2 tests correlate modestly with each other. This article describes a process dissociation framework for personality assessment, derived from research on implicit memory and learning, which can resolve these ostensibly conflicting results. Research on interpersonal dependency is used to illustrate 3 key steps in the process dissociation approach: (a) converging behavioral predictions, (b) modest test score intercorrelations, and (c) delineation of variables that differentially affect self-report and projective test scores. Implications of the process dissociation framework for personality assessment and test development are discussed.

Health risk assessment procedures for endocrine disrupting compounds within different regulatory frameworks in the European Union.

PubMed

Beronius, Anna; Rudén, Christina; Hanberg, Annika; Håkansson, Helen

2009-11-01

In this study we have investigated how different regulatory frameworks in Europe cope with identification and risk assessment of endocrine disrupting compounds (EDCs). Four regulatory groups were selected for the investigation: existing industrial chemicals, environmental pollutants in food, pharmaceuticals and plant protection products. The legislation and guidelines for each of these groups were scrutinized and compared in detail. In addition, one recent European risk assessment document each for three identified EDCs, i.e. bisphenol A, dioxins and vinclozolin, were reviewed and compared. We found that the requirements for toxicity testing and availability and scope of risk assessment guidelines varied between the four regulatory frameworks. Also, the general principles regarding the human relevance of the mode of action identified in animal tests differed in the different risk assessments. In conclusion, there is little conformity in the risk assessment processes between these groups of chemicals. Because of the complicated nature of endocrine disruption, test methods, principles and criteria for data interpretation traditionally used might not be directly applicable to EDCs and further development of a transparent and reliable risk assessment process for this type of substances is needed.

Patient-perceived hospital service quality: an empirical assessment.

PubMed

Pai, Yogesh P; Chary, Satyanarayana T; Pai, Rashmi Yogesh

2018-02-12

Purpose The purpose of this paper is to appraise Pai and Chary's (2016) conceptual framework for measuring patient-perceived hospital service quality (HSQ). Design/methodology/approach A structured questionnaire was used to obtain data from teaching, public and corporate hospital patients. Several tests were conducted to assess the instrument's reliability and validity. Pai and Chary's (2016) nine dimensions for measuring HSQ were examined in this paper. Findings The tests confirm that Pai and Chary's (2016) conceptual framework is reliable and valid. The study also establishes that the nine dimensions measure HSQ. Practical implications The framework empowers managers to assess service quality in any hospital settings, corporate, public and teaching, using an approach that is superior to the existing HSQ scales. Originality/value This paper helps researchers and practitioners to assess HSQ from patient perspectives in any hospital setting.

Demonstration of the Military Ecological Risk Assessment Framework (MERAF): Apache Longbow - Hell Missile Test at Yuma Proving Ground

DOE Office of Scientific and Technical Information (OSTI.GOV)

Efroymson, R.A.

2002-05-09

This ecological risk assessment for a testing program at Yuma Proving Ground, Arizona, is a demonstration of the Military Ecological Risk Assessment Framework (MERAF; Suter et al. 2001). The demonstration is intended to illustrate how risk assessment guidance concerning-generic military training and testing activities and guidance concerning a specific type of activity (e.g., low-altitude aircraft overflights) may be implemented at a military installation. MERAF was developed with funding from the Strategic Research and Development Program (SERDP) of the Department of Defense. Novel aspects of MERAF include: (1) the assessment of risks from physical stressors using an ecological risk assessment framework,more » (2) the consideration of contingent or indirect effects of stressors (e.g., population-level effects that are derived from habitat or hydrological changes), (3) the integration of risks associated with different component activities or stressors, (4) the emphasis on quantitative risk estimates and estimates of uncertainty, and (5) the modularity of design, permitting components of the framework to be used in various military risk assessments that include similar activities. The particular subject of this report is the assessment of ecological risks associated with a testing program at Cibola Range of Yuma Proving Ground, Arizona. The program involves an Apache Longbow helicopter firing Hellfire missiles at moving targets, i.e., M60-A1 tanks. Thus, the three component activities of the Apache-Hellfire test were: (1) helicopter overflight, (2) missile firing, and (3) tracked vehicle movement. The demonstration was limited, to two ecological endpoint entities (i.e., potentially susceptible and valued populations or communities): woody desert wash communities and mule deer populations. The core assessment area is composed of about 126 km{sup 2} between the Chocolate and Middle Mountains. The core time of the program is a three-week period, including fourteen days of activity in August of 2000.« less

Integration of chemical-specific exposure and pharmacokinetic information with the chemical-agnostic AOP framework to support high throughput risk assessment

EPA Science Inventory

Application of the Adverse Outcome Pathway (AOP) framework and high throughput toxicity testing in chemical-specific risk assessment requires reconciliation of chemical concentrations sufficient to trigger a molecular initiating event measured in vitro and at the relevant target ...

Leaching Environmental Assessment Framework (LEAF) How-To Guide - Understanding the LEAF Approach and How and When to Use It

EPA Science Inventory

This document is intended to present the reader with important technical and decision-making information in a user-friendly format for implementation of the Leaching Environmental Assessment Framework (LEAF)test methods 1313, 1314, 1315, and 1316 for inorganic constituents. The ...

Framework for Assessing the ICT Competency in Teachers up to the Requirements of "Teacher" Occupational Standard

ERIC Educational Resources Information Center

Avdeeva, Svetlana; Zaichkina, Olga; Nikulicheva, Nataliya; Khapaeva, Svetlana

2016-01-01

The paper deals with problems of working out a test framework for the assessment of teachers' ICT competency in line with the requirements of "Teacher" occupational standard. The authors have analyzed the known approaches to assessing teachers' ICT competency--ISTE Standards and UNESCO ICT CFT and have suggested their own approach to…

A novel framework for assessing metadata quality in epidemiological and public health research settings

PubMed Central

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly. PMID:27570670

A novel framework for assessing metadata quality in epidemiological and public health research settings.

PubMed

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly.

A contemporary approach to validity arguments: a practical guide to Kane's framework.

PubMed

Cook, David A; Brydges, Ryan; Ginsburg, Shiphra; Hatala, Rose

2015-06-01

Assessment is central to medical education and the validation of assessments is vital to their use. Earlier validity frameworks suffer from a multiplicity of types of validity or failure to prioritise among sources of validity evidence. Kane's framework addresses both concerns by emphasising key inferences as the assessment progresses from a single observation to a final decision. Evidence evaluating these inferences is planned and presented as a validity argument. We aim to offer a practical introduction to the key concepts of Kane's framework that educators will find accessible and applicable to a wide range of assessment tools and activities. All assessments are ultimately intended to facilitate a defensible decision about the person being assessed. Validation is the process of collecting and interpreting evidence to support that decision. Rigorous validation involves articulating the claims and assumptions associated with the proposed decision (the interpretation/use argument), empirically testing these assumptions, and organising evidence into a coherent validity argument. Kane identifies four inferences in the validity argument: Scoring (translating an observation into one or more scores); Generalisation (using the score[s] as a reflection of performance in a test setting); Extrapolation (using the score[s] as a reflection of real-world performance), and Implications (applying the score[s] to inform a decision or action). Evidence should be collected to support each of these inferences and should focus on the most questionable assumptions in the chain of inference. Key assumptions (and needed evidence) vary depending on the assessment's intended use or associated decision. Kane's framework applies to quantitative and qualitative assessments, and to individual tests and programmes of assessment. Validation focuses on evaluating the key claims, assumptions and inferences that link assessment scores with their intended interpretations and uses. The Implications and associated decisions are the most important inferences in the validity argument. © 2015 John Wiley & Sons Ltd.

Peer Review of Assessment Network: Supporting Comparability of Standards

ERIC Educational Resources Information Center

Booth, Sara; Beckett, Jeff; Saunders, Cassandra

2016-01-01

Purpose: This paper aims to test the need in the Australian higher education (HE) sector for a national network for the peer review of assessment in response to the proposed HE standards framework and propose a sector-wide framework for calibrating and assuring achievement standards, both within and across disciplines, through the establishment of…

Nutrition-Related Cancer Prevention Cognitions and Behavioral Intentions: Testing the Risk Perception Attitude Framework

ERIC Educational Resources Information Center

Sullivan, Helen W.; Beckjord, Ellen Burke; Finney Rutten, Lila J.; Hesse, Bradford W.

2008-01-01

This study tested whether the risk perception attitude framework predicted nutrition-related cancer prevention cognitions and behavioral intentions. Data from the 2003 Health Information National Trends Survey were analyzed to assess respondents' reported likelihood of developing cancer (risk) and perceptions of whether they could lower their…

Using Multigroup Confirmatory Factor Analysis to Test Measurement Invariance in Raters: A Clinical Skills Examination Application

ERIC Educational Resources Information Center

Kahraman, Nilufer; Brown, Crystal B.

2015-01-01

Psychometric models based on structural equation modeling framework are commonly used in many multiple-choice test settings to assess measurement invariance of test items across examinee subpopulations. The premise of the current article is that they may also be useful in the context of performance assessment tests to test measurement invariance…

ECITE: A Testbed for Assessment of Technology Interoperability and Integration wiht Architecture Components

NASA Astrophysics Data System (ADS)

Graves, S. J.; Keiser, K.; Law, E.; Yang, C. P.; Djorgovski, S. G.

2016-12-01

ECITE (EarthCube Integration and Testing Environment) is providing both cloud-based computational testing resources and an Assessment Framework for Technology Interoperability and Integration. NSF's EarthCube program is funding the development of cyberinfrastructure building block components as technologies to address Earth science research problems. These EarthCube building blocks need to support integration and interoperability objectives to work towards a coherent cyberinfrastructure architecture for the program. ECITE is being developed to provide capabilities to test and assess the interoperability and integration across funded EarthCube technology projects. EarthCube defined criteria for interoperability and integration are applied to use cases coordinating science problems with technology solutions. The Assessment Framework facilitates planning, execution and documentation of the technology assessments for review by the EarthCube community. This presentation will describe the components of ECITE and examine the methodology of cross walking between science and technology use cases.

A Framework for Designing and Developing Multimedia-Based Performance Assessment in Vocational Education

ERIC Educational Resources Information Center

de Klerk, Sebastiaan; Veldkamp, Bernard P.; Eggen, Theo J. H. M.

2018-01-01

The development of any assessment should be an iterative and careful process. Ideally, this process is guided by a well-defined framework (see for example Downing in: Downing and Haladyna (eds) "Handbook of test development," Lawrence Erlbaum Associates, Mahwah, 2006; Mislevy et al. in "On the roles of task model variables in…

Linking English-Language Test Scores onto the Common European Framework of Reference: An Application of Standard-Setting Methodology. TOEFL iBT Research Report TOEFL iBt-06. ETS RR-08-34

ERIC Educational Resources Information Center

Tannenbaum, Richard J.; Wylie, E. Caroline

2008-01-01

The Common European Framework of Reference (CEFR) describes language proficiency in reading, writing, speaking, and listening on a 6-level scale. In this study, English-language experts from across Europe linked CEFR levels to scores on three tests: the TOEFL® iBT test, the TOEIC® assessment, and the TOEIC "Bridge"™ test.…

A weight of evidence framework for environmental assessments: Inferring Qualities

EPA Science Inventory

The weighing of heterogeneous evidence such as conventional laboratory toxicity tests, field tests, biomarkers, and community surveys is essential to environmental assessments. Evidence synthesis and weighing is needed to determine causes of observed effects, hazards posed by ch...

E-health readiness assessment framework in iran.

PubMed

Rezai-Rad, M; Vaezi, R; Nattagh, F

2012-01-01

Concept of e-readiness is used in many areas such as e-business, e-commerce, e-government, and e-banking. In terms of healthcare, e-readiness is a rather new concept, and is propounded under the title of E-healthcare. E-health readiness refers to the readiness of communities and healthcare institutions for the expected changes brought by programs related to Information and Communications Technology (lCT). The present research is conducted aiming at designing E-health Readiness Assessment Framework (EHRAF) in Iran. The e-health readiness assessment framework was designed based on reviewing literature on e-readiness assessment models and opinions of ICT and health experts. In the next step, Delphi method was used to develop and test the designed framework. Three questionnaires developed to test and modify the model while determining weights of the indices; afterward they were either sent to experts through email or delivered to them in face. The designed framework approved with 4 dimensions, 11 constituents and 58 indices. Technical readiness had the highest importance coefficient (0.256099), and the other dimensions were of the next levels of coefficient importance: core readiness (0.25520), social communication readiness (0.244658), and engagement readiness (0.244039). The framework presents the movement route and investment priorities in e-health in Iran. The proposed framework is a good instrument for measuring the e-readiness in health centers in Iran, and for identifying strengths and weaknesses of these centers to access ICT and its implementation for more effectiveness and for analyzing digital divide between them, as well.

E-Health Readiness Assessment Framework in Iran

PubMed Central

Rezai-Rad, M; Vaezi, R; Nattagh, F

2012-01-01

Background: Concept of e-readiness is used in many areas such as e-business, e-commerce, e-government, and e-banking. In terms of healthcare, e-readiness is a rather new concept, and is propounded under the title of E-healthcare. E-health readiness refers to the readiness of communities and healthcare institutions for the expected changes brought by programs related to Information and Communications Technology (lCT). The present research is conducted aiming at designing E-health Readiness Assessment Framework (EHRAF) in Iran. Methods: The e-health readiness assessment framework was designed based on reviewing literature on e-readiness assessment models and opinions of ICT and health experts. In the next step, Delphi method was used to develop and test the designed framework. Three questionnaires developed to test and modify the model while determining weights of the indices; afterward they were either sent to experts through email or delivered to them in face. Results: The designed framework approved with 4 dimensions, 11 constituents and 58 indices. Technical readiness had the highest importance coefficient (0.256099), and the other dimensions were of the next levels of coefficient importance: core readiness (0.25520), social communication readiness (0.244658), and engagement readiness (0.244039). Conclusion: The framework presents the movement route and investment priorities in e-health in Iran. The proposed framework is a good instrument for measuring the e-readiness in health centers in Iran, and for identifying strengths and weaknesses of these centers to access ICT and its implementation for more effectiveness and for analyzing digital divide between them, as well. PMID:23304661

Hierarchical Marginal Land Assessment for Land Use Planning

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kang, Shujiang; Post, Wilfred M; Wang, Dali

2013-01-01

Marginal land provides an alternative potential for food and bioenergy production in the face of limited land resources; however, effective assessment of marginal lands is not well addressed. Concerns over environmental risks, ecosystem services and sustainability for marginal land have been widely raised. The objective of this study was to develop a hierarchical marginal land assessment framework for land use planning and management. We first identified major land functions linking production, environment, ecosystem services and economics, and then classified land resources into four categories of marginal land using suitability and limitations associated with major management goals, including physically marginal land,more » biologically marginal land, environmental-ecological marginal land, and economically marginal land. We tested this assessment framework in south-western Michigan, USA. Our results indicated that this marginal land assessment framework can be potentially feasible on land use planning for food and bioenergy production, and balancing multiple goals of land use management. We also compared our results with marginal land assessment from the Conservation Reserve Program (CRP) and land capability classes (LCC) that are used in the US. The hierarchical assessment framework has advantages of quantitatively reflecting land functions and multiple concerns. This provides a foundation upon which focused studies can be identified in order to improve the assessment framework by quantifying high-resolution land functions associated with environment and ecosystem services as well as their criteria are needed to improve the assessment framework.« less

Risk Assessment in the 21st Century | Science Inventory | US ...

EPA Pesticide Factsheets

For the past ~50 years, risk assessment depended almost exclusively on animal testing for hazard identification and dose-response assessment. Originally sound and effective, with increasing dependence on chemical tools and the number of chemicals in commerce, this traditional approach is no longer adequate. This presentation provides an update on current progress in achieving the goals outlined in the NAS report on Toxicology Testing in the 21st Century, highlighting many of the advances lead by the EPA. Topics covered include the evolution of the mode of action framework into a chemically agnostic, adverse outcome pathway (AOP), a systems-based data framework that facilitates integration of modifiable factors (e.g., genetic variation, life stages), and an understanding of networks, and mixtures. Further, the EDSP pivot is used to illustrate how AOPs drive development of predictive models for risk assessment based on assembly of high throughput assays representing AOP key elements. The birth of computational exposure science, capable of large-scale predictive exposure models, is reviewed. Although still in its infancy, development of non-targeted analysis to begin addressing exposome also is presented. Finally, the systems-based AEP is described that integrates exposure, toxicokinetics and AOPs into a comprehensive framework. For the past ~50 years, risk assessment depended almost exclusively on animal testing for hazard identification and dose-response as

Assessing research activity and capacity of community-based organizations: development and pilot testing of an instrument.

PubMed

Humphries, Debbie L; Carroll-Scott, Amy; Mitchell, Leif; Tian, Terry; Choudhury, Shonali; Fiellin, David A

2014-01-01

Although awareness of the importance of the research capacity of community-based organizations (CBOs) is growing, a uniform framework of the research capacity domains within CBOs has not yet been developed. To develop a framework and instrument (the Community REsearch Activity assessment Tool [CREAT]) for assessing the research activity and capacity of CBOs that incorporates awareness of the different data collection and analysis priorities of CBOs. We conducted a review of existing tools for assessing research capacity to identify key capacity domains. Instrument items were developed through an iterative process with CBO representatives and community researchers. The CREAT was then pilot tested with 30 CBOs. The four primary domains of the CREAT framework include 1) organizational support for research, 2) generalizable experiences, 3) research specific experiences, and 4) funding. Organizations reported a high prevalence of activities in the research-specific experiences domain, including conducting literature reviews (70%), use of research terminology (83%), and primary data collection (100%). Respondents see research findings as important to improve program and service delivery, and to seek funds for new programs and services. Funders, board members, and policymakers are the most important dissemination audiences. The work reported herein advances the field of CBO research capacity by developing a systematic framework for assessing research activity and capacity relevant to the work of CBOs, and by developing and piloting an instrument to assess activity in these domains.

The combination of an Environmental Management System and Life Cycle Assessment at the territorial level

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mazzi, Anna; Toniolo, Sara; Catto, Stella

A framework to include a Life Cycle Assessment in the significance evaluation of the environmental aspects of an Environmental Management System has been studied for some industrial sectors, but there is a literature gap at the territorial level, where the indirect impact assessment is crucial. To overcome this criticality, our research proposes the Life Cycle Assessment as a framework to assess environmental aspects of public administration within an Environmental Management System applied at the territorial level. This research is structured in two parts: the design of a new methodological framework and the pilot application for an Italian municipality. The methodologicalmore » framework designed supports Initial Environmental Analysis at the territorial level thanks to the results derived from the impact assessment phase. The pilot application in an Italian municipality EMAS registered demonstrates the applicability of the framework and its effectiveness in evaluating the environmental impact assessment for direct and indirect aspects. Through the discussion of the results, we underline the growing knowledge derived by this research in terms of the reproducibility and consistency of the criteria to define the significance of the direct and indirect environmental aspects for a local public administration. - Highlights: • The combination between Environmental Management System and LCA is studied. • A methodological framework is elaborated and tested at the territorial level. • Life Cycle Impact Assessment supports the evaluation of aspects significance. • The framework assures consistency of evaluation criteria on the studied territory.« less

A Health Impact Assessment Framework for Assessing Vulnerability and Adaptation Planning for Climate Change

PubMed Central

Brown, Helen; Spickett, Jeffery; Katscherian, Dianne

2014-01-01

This paper presents a detailed description of an approach designed to investigate the application of the Health Impact Assessment (HIA) framework to assess the potential health impacts of climate change. A HIA framework has been combined with key climate change terminology and concepts. The fundamental premise of this framework is an understanding of the interactions between people, the environment and climate. The diversity and complexity of these interactions can hinder much needed action on the critical health issue of climate change. The objectives of the framework are to improve the methodology for understanding and assessing the risks associated with potential health impacts of climate change, and to provide decision-makers with information that can facilitate the development of effective adaptation plans. While the process presented here provides guidance with respect to this task it is not intended to be prescriptive. As such, aspects of the process can be amended to suit the scope and available resources of each project. A series of working tables has been developed to assist in the collation of evidence throughout the process. The framework has been tested in a number of locations including Western Australia, Solomon Islands, Vanuatu and Nauru. PMID:25514146

A health impact assessment framework for assessing vulnerability and adaptation planning for climate change.

PubMed

Brown, Helen; Spickett, Jeffery; Katscherian, Dianne

2014-12-01

This paper presents a detailed description of an approach designed to investigate the application of the Health Impact Assessment (HIA) framework to assess the potential health impacts of climate change. A HIA framework has been combined with key climate change terminology and concepts. The fundamental premise of this framework is an understanding of the interactions between people, the environment and climate. The diversity and complexity of these interactions can hinder much needed action on the critical health issue of climate change. The objectives of the framework are to improve the methodology for understanding and assessing the risks associated with potential health impacts of climate change, and to provide decision-makers with information that can facilitate the development of effective adaptation plans. While the process presented here provides guidance with respect to this task it is not intended to be prescriptive. As such, aspects of the process can be amended to suit the scope and available resources of each project. A series of working tables has been developed to assist in the collation of evidence throughout the process. The framework has been tested in a number of locations including Western Australia, Solomon Islands, Vanuatu and Nauru.

A Knowledge-Structure-Based Adaptive Dynamic Assessment System for Calculus Learning

ERIC Educational Resources Information Center

Ting, M.-Y.; Kuo, B.-C.

2016-01-01

The purpose of this study was to investigate the effect of a calculus system that was designed using an adaptive dynamic assessment (DA) framework on performance in the "finding an area using an integral". In this study, adaptive testing and dynamic assessment were combined to provide different test items depending on students'…

Equity-focused health impact assessment: A tool to assist policy makers in addressing health inequalities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Simpson, Sarah; Mahoney, Mary; Harris, Elizabeth

2005-10-15

In Australasia (Australia and New Zealand) the use of health impact assessment (HIA) as a tool for improved policy development is comparatively new. The public health workforce do not routinely assess the potential health and equity impacts of proposed policies or programs. The Australasian Collaboration for Health Equity Impact Assessment was funded to develop a strategic framework for equity-focused HIA (EFHIA) with the intent of strengthening the ways in which equity is addressed in each step of HIA. The collaboration developed a draft framework for EFHIA that mirrored, but modified the commonly accepted steps of HIA; tested the draft frameworkmore » in six different health service delivery settings; analysed the feedback about application of the draft EFHIA framework and modified it accordingly. The strategic framework shows promise in providing a systematic process for identifying potential differential health impacts and assessing the extent to which these are avoidable and unfair. This paper presents the EFHIA framework and discusses some of the issues that arose in the case study sites undertaking equity-focused HIA.« less

Multistage Complexity in Language Proficiency Assessment: A Framework for Aligning Theoretical Perspectives, Test Development, and Psychometrics

ERIC Educational Resources Information Center

Luecht, Richard M.

2003-01-01

This article contends that the necessary links between constructs and test scores/decisions in language assessment must be established through principled design procedures that align three models: (1) a theoretical construct model; (2) a test development model; and (3) a psychometric scoring model. The theoretical construct model articulates the…

Sediment Toxicity Testing

EPA Science Inventory

Sediment toxicity testing has become a fundamental component of regulatory frameworks for assessing the risks posed by contaminated sediments and for development of chemical sediment quality guidelines. Over the past two decades, sediment toxicity testing methods have advanced co...

Towards an evaluation framework for Laboratory Information Systems.

PubMed

Yusof, Maryati M; Arifin, Azila

Laboratory testing and reporting are error-prone and redundant due to repeated, unnecessary requests and delayed or missed reactions to laboratory reports. Occurring errors may negatively affect the patient treatment process and clinical decision making. Evaluation on laboratory testing and Laboratory Information System (LIS) may explain the root cause to improve the testing process and enhance LIS in supporting the process. This paper discusses a new evaluation framework for LIS that encompasses the laboratory testing cycle and the socio-technical part of LIS. Literature review on discourses, dimensions and evaluation methods of laboratory testing and LIS. A critical appraisal of the Total Testing Process (TTP) and the human, organization, technology-fit factors (HOT-fit) evaluation frameworks was undertaken in order to identify error incident, its contributing factors and preventive action pertinent to laboratory testing process and LIS. A new evaluation framework for LIS using a comprehensive and socio-technical approach is outlined. Positive relationship between laboratory and clinical staff resulted in a smooth laboratory testing process, reduced errors and increased process efficiency whilst effective use of LIS streamlined the testing processes. The TTP-LIS framework could serve as an assessment as well as a problem-solving tool for the laboratory testing process and system. Copyright © 2016 King Saud Bin Abdulaziz University for Health Sciences. Published by Elsevier Ltd. All rights reserved.

Generation of Alternative Assessment Scores using TEST and online data sources

EPA Science Inventory

Alternatives assessment frameworks such as DfE (Design for the Environment) evaluate chemical alternatives in terms of human health effects, ecotoxicity, and fate. T.E.S.T. (Toxicity Estimation Software Tool) can be utilized to evaluate human health in terms of acute oral rat tox...

75 FR 43515 - National Assessment Governing Board; Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-26

... frameworks, developing appropriate student achievement levels for each grade and subject tested, developing... 12 economics, grades 4 and 8 reading, and grades 4 and 8 writing. The writing items are for the 2011 operational assessment; the reading items are for the 2013 pilot test; and the economics items are for the...

Promoting the 3Rs to enhance the OECD fish toxicity testing framework.

PubMed

Hutchinson, Thomas H; Wheeler, James R; Gourmelon, Anne; Burden, Natalie

2016-04-01

Fish toxicity testing has been conducted since the 1860's in order to help define safe levels of chemical contaminants in lakes, rivers and coastal waters. The historical emphasis on acute lethality testing of chemicals has more recently focussed on long term sublethal effects of chemicals on fish and their prey species. Fish toxicity testing is now embedded in much environment legislation on chemical safety while it is recognized that animal use should be Replaced, Reduced and Refined (the 3Rs) where possible. The OECD Fish Toxicity Testing Framework provides a useful structure with which to address the needs of environmental safety assessment whilst implementing the 3Rs. This commentary aims to promote the implementation of the recommendations of the OECD Fish Toxicity Testing Framework. Copyright © 2016 Elsevier Inc. All rights reserved.

Developing a pressure ulcer risk factor minimum data set and risk assessment framework.

PubMed

Coleman, Susanne; Nelson, E Andrea; Keen, Justin; Wilson, Lyn; McGinnis, Elizabeth; Dealey, Carol; Stubbs, Nikki; Muir, Delia; Farrin, Amanda; Dowding, Dawn; Schols, Jos M G A; Cuddigan, Janet; Berlowitz, Dan; Jude, Edward; Vowden, Peter; Bader, Dan L; Gefen, Amit; Oomens, Cees W J; Schoonhoven, Lisette; Nixon, Jane

2014-10-01

To agree a draft pressure ulcer risk factor Minimum Data Set to underpin the development of a new evidenced-based Risk Assessment Framework. A recent systematic review identified the need for a pressure ulcer risk factor Minimum Data Set and development and validation of an evidenced-based pressure ulcer Risk Assessment Framework. This was undertaken through the Pressure UlceR Programme Of reSEarch (RP-PG-0407-10056), funded by the National Institute for Health Research and incorporates five phases. This article reports phase two, a consensus study. Consensus study. A modified nominal group technique based on the Research and Development/University of California at Los Angeles appropriateness method. This incorporated an expert group, review of the evidence and the views of a Patient and Public Involvement service user group. Data were collected December 2010-December 2011. The risk factors and assessment items of the Minimum Data Set (including immobility, pressure ulcer and skin status, perfusion, diabetes, skin moisture, sensory perception and nutrition) were agreed. In addition, a draft Risk Assessment Framework incorporating all Minimum Data Set items was developed, comprising a two stage assessment process (screening and detailed full assessment) and decision pathways. The draft Risk Assessment Framework will undergo further design and pre-testing with clinical nurses to assess and improve its usability. It will then be evaluated in clinical practice to assess its validity and reliability. The Minimum Data Set could be used in future for large scale risk factor studies informing refinement of the Risk Assessment Framework. © 2014 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Integrating Formal Methods and Testing 2002

NASA Technical Reports Server (NTRS)

Cukic, Bojan

2002-01-01

Traditionally, qualitative program verification methodologies and program testing are studied in separate research communities. None of them alone is powerful and practical enough to provide sufficient confidence in ultra-high reliability assessment when used exclusively. Significant advances can be made by accounting not only tho formal verification and program testing. but also the impact of many other standard V&V techniques, in a unified software reliability assessment framework. The first year of this research resulted in the statistical framework that, given the assumptions on the success of the qualitative V&V and QA procedures, significantly reduces the amount of testing needed to confidently assess reliability at so-called high and ultra-high levels (10-4 or higher). The coming years shall address the methodologies to realistically estimate the impacts of various V&V techniques to system reliability and include the impact of operational risk to reliability assessment. Combine formal correctness verification, process and product metrics, and other standard qualitative software assurance methods with statistical testing with the aim of gaining higher confidence in software reliability assessment for high-assurance applications. B) Quantify the impact of these methods on software reliability. C) Demonstrate that accounting for the effectiveness of these methods reduces the number of tests needed to attain certain confidence level. D) Quantify and justify the reliability estimate for systems developed using various methods.

Assessing Cultural Competence in Graduating Students

ERIC Educational Resources Information Center

Kohli, Hermeet K.; Kohli, Amarpreet S.; Huber, Ruth; Faul, Anna C.

2010-01-01

Twofold purpose of this study was to develop a framework to understand cultural competence in graduating social work students, and test that framework for appropriateness and predictability using multivariate statistics. Scale and predictor variables were collected using an online instrument from a nationwide convenience sample of graduating…

Systematic evaluation of non-animal test methods for skin sensitisation safety assessment.

PubMed

Reisinger, Kerstin; Hoffmann, Sebastian; Alépée, Nathalie; Ashikaga, Takao; Barroso, Joao; Elcombe, Cliff; Gellatly, Nicola; Galbiati, Valentina; Gibbs, Susan; Groux, Hervé; Hibatallah, Jalila; Keller, Donald; Kern, Petra; Klaric, Martina; Kolle, Susanne; Kuehnl, Jochen; Lambrechts, Nathalie; Lindstedt, Malin; Millet, Marion; Martinozzi-Teissier, Silvia; Natsch, Andreas; Petersohn, Dirk; Pike, Ian; Sakaguchi, Hitoshi; Schepky, Andreas; Tailhardat, Magalie; Templier, Marie; van Vliet, Erwin; Maxwell, Gavin

2015-02-01

The need for non-animal data to assess skin sensitisation properties of substances, especially cosmetics ingredients, has spawned the development of many in vitro methods. As it is widely believed that no single method can provide a solution, the Cosmetics Europe Skin Tolerance Task Force has defined a three-phase framework for the development of a non-animal testing strategy for skin sensitization potency prediction. The results of the first phase – systematic evaluation of 16 test methods – are presented here. This evaluation involved generation of data on a common set of ten substances in all methods and systematic collation of information including the level of standardisation, existing test data,potential for throughput, transferability and accessibility in cooperation with the test method developers.A workshop was held with the test method developers to review the outcome of this evaluation and to discuss the results. The evaluation informed the prioritisation of test methods for the next phase of the non-animal testing strategy development framework. Ultimately, the testing strategy – combined with bioavailability and skin metabolism data and exposure consideration – is envisaged to allow establishment of a data integration approach for skin sensitisation safety assessment of cosmetic ingredients.

NIST biometric evaluations and developments

NASA Astrophysics Data System (ADS)

Garris, Michael D.; Wilson, Charles L.

2005-05-01

This paper presents an R&D framework used by the National Institute of Standards and Technology (NIST) for biometric technology testing and evaluation. The focus of this paper is on fingerprint-based verification and identification. Since 9-11 the NIST Image Group has been mandated by Congress to run a program for biometric technology assessment and biometric systems certification. Four essential areas of activity are discussed: 1) developing test datasets, 2) conducting performance assessment; 3) technology development; and 4) standards participation. A description of activities and accomplishments are provided for each of these areas. In the process, methods of performance testing are described and results from specific biometric technology evaluations are presented. This framework is anticipated to have broad applicability to other technology and application domains.

AN INTEGRATED COASTAL-WATERSHED MONITORING FRAMEWORK FOR ASSESSMENT

EPA Science Inventory

An approach for watershed classification in support of assessments, disgnosis of biological impairment, and prioritization of watershed restorations has been tested in coastal watersheds surrounding the western arm of Lake Superior and is currently being assessed for a series of ...

The training for health equity network evaluation framework: a pilot study at five health professional schools.

PubMed

Ross, Simone J; Preston, Robyn; Lindemann, Iris C; Matte, Marie C; Samson, Rex; Tandinco, Filedito D; Larkins, Sarah L; Palsdottir, Bjorg; Neusy, Andre-Jacques

2014-01-01

The Training for Health Equity Network (THEnet), a group of diverse health professional schools aspiring toward social accountability, developed and pilot tested a comprehensive evaluation framework to assess progress toward socially accountable health professions education. The evaluation framework provides criteria for schools to assess their level of social accountability within their organization and planning; education, research and service delivery; and the direct and indirect impacts of the school and its graduates, on the community and health system. This paper describes the pilot implementation of testing the evaluation framework across five THEnet schools, and examines whether the evaluation framework was practical and feasible across contexts for the purposes of critical reflection and continuous improvement in terms of progress towards social accountability. In this pilot study, schools utilized the evaluation framework using a mixed method approach of data collection comprising of workshops, qualitative interviews and focus group discussions, document review and collation and analysis of existing quantitative data. The evaluation framework allowed each school to contextually gather evidence on how it was meeting the aspirational goals of social accountability across a range of school activities, and to identify strengths and areas for improvement and development. The evaluation framework pilot study demonstrated how social accountability can be assessed through a critically reflective and comprehensive process. As social accountability focuses on the relationship between health professions schools and health system and health population outcomes, each school was able to demonstrate to students, health professionals, governments, accrediting bodies, communities and other stakeholders how current and future health care needs of populations are addressed in terms of education, research, and service learning.

[Development of the theoretical framework and the item pool of the peri-operative recovery scale for integrative medicine].

PubMed

Su, Bi-ying; Liu, Shao-nan; Li, Xiao-yan

2011-11-01

To study the train of thoughts and procedures for developing the theoretical framework and the item pool of the peri-operative recovery scale for integrative medicine, thus making preparation for the development of this scale and psychometric testing. Under the guidance for Chinese medicine theories and the guidance for developing psychometric scale, the theoretical framework and the item pool of the scale were initially laid out by literature retrieval, and expert consultation, etc. The scale covered the domains of physical function, mental function, activity function, pain, and general assessment. Besides, social function is involved, which is suitable for pre-operative testing and long-term therapeutic efficacy testing after discharge from hospital. Each domain should cover correlated Zang-Fu organs, qi, blood, and the patient-reported outcomes. Totally 122 items were initially covered in the item pool according to theoretical framework of the scale. The peri-operative recovery scale of integrative medicine was the embodiment of the combination of Chinese medicine theories and patient-reported outcome concepts. The scale could reasonably assess the peri-operative recovery outcomes of patients treated by integrative medicine.

Exploring the Validity of a Second Language Intercultural Pragmatics Assessment Tool

ERIC Educational Resources Information Center

Timpe-Laughlin, Veronika; Choi, Ikkyu

2017-01-01

Pragmatics has been a key component of language competence frameworks. While the majority of second/foreign language (L2) pragmatics tests have targeted productive skills, the assessment of receptive pragmatic skills remains a developing field. This study explores validation evidence for a test of receptive L2 pragmatic ability called the American…

Visual Habituation Paradigm with Adults with Profound Intellectual and Multiple Disabilities: A New Way for Cognitive Assessment?

ERIC Educational Resources Information Center

Chard, Melissa; Roulin, Jean-Luc; Bouvard, Martine

2014-01-01

Background: The use of common psychological assessment tools is invalidated with persons with PIMD. The aim of this study was to test the feasibility of using a visual habituation procedure with a group of adults with PIMD, to develop a new theoretical and practical framework for the assessment of cognitive abilities. Methods: To test the…

Sensei: A Multi-Modal Framework for Assessing Stress Resiliency

DTIC Science & Technology

2013-04-01

interest for the second subject is the upturn in the GSR response before the start of the Stroop test, possibly indicating some anticipatory stress ...Framework for Assessing Stress Resiliency (March 1-31, 2013) From: Ajay Divakaran, Technical Leader Jeffrey Lubin, Senior Research Scientist Joe...Period 15 (March 2013): Task 3.1: Capture Behavioral Stress Markers in Real-Time in Lab Environment with graded exposure to ICT’s scenarios MAC 1-6

Frequency Spectrum Neutrality Tests: One for All and All for One

PubMed Central

Achaz, Guillaume

2009-01-01

Neutrality tests based on the frequency spectrum (e.g., Tajima's D or Fu and Li's F) are commonly used by population geneticists as routine tests to assess the goodness-of-fit of the standard neutral model on their data sets. Here, I show that these neutrality tests are specific instances of a general model that encompasses them all. I illustrate how this general framework can be taken advantage of to devise new more powerful tests that better detect deviations from the standard model. Finally, I exemplify the usefulness of the framework on SNP data by showing how it supports the selection hypothesis in the lactase human gene by overcoming the ascertainment bias. The framework presented here paves the way for constructing novel tests optimized for specific violations of the standard model that ultimately will help to unravel scenarios of evolution. PMID:19546320

Trial Implementation of a Multihazard Risk Assessment Framework for High-Impact Low-Frequency Power Grid Events

DOE Office of Scientific and Technical Information (OSTI.GOV)

Veeramany, Arun; Coles, Garill A.; Unwin, Stephen D.

The Pacific Northwest National Laboratory developed a risk framework for modeling high-impact, low-frequency power grid events to support risk-informed decisions. In this paper, we briefly recap the framework and demonstrate its implementation for seismic and geomagnetic hazards using a benchmark reliability test system. We describe integration of a collection of models implemented to perform hazard analysis, fragility evaluation, consequence estimation, and postevent restoration. We demonstrate the value of the framework as a multihazard power grid risk assessment and management tool. As a result, the research will benefit transmission planners and emergency planners by improving their ability to maintain a resilientmore » grid infrastructure against impacts from major events.« less

Trial Implementation of a Multihazard Risk Assessment Framework for High-Impact Low-Frequency Power Grid Events

DOE PAGES

Veeramany, Arun; Coles, Garill A.; Unwin, Stephen D.; ...

2017-08-25

The Pacific Northwest National Laboratory developed a risk framework for modeling high-impact, low-frequency power grid events to support risk-informed decisions. In this paper, we briefly recap the framework and demonstrate its implementation for seismic and geomagnetic hazards using a benchmark reliability test system. We describe integration of a collection of models implemented to perform hazard analysis, fragility evaluation, consequence estimation, and postevent restoration. We demonstrate the value of the framework as a multihazard power grid risk assessment and management tool. As a result, the research will benefit transmission planners and emergency planners by improving their ability to maintain a resilientmore » grid infrastructure against impacts from major events.« less

Introduction to the special section on mixture modeling in personality assessment.

PubMed

Wright, Aidan G C; Hallquist, Michael N

2014-01-01

Latent variable models offer a conceptual and statistical framework for evaluating the underlying structure of psychological constructs, including personality and psychopathology. Complex structures that combine or compare categorical and dimensional latent variables can be accommodated using mixture modeling approaches, which provide a powerful framework for testing nuanced theories about psychological structure. This special series includes introductory primers on cross-sectional and longitudinal mixture modeling, in addition to empirical examples applying these techniques to real-world data collected in clinical settings. This group of articles is designed to introduce personality assessment scientists and practitioners to a general latent variable framework that we hope will stimulate new research and application of mixture models to the assessment of personality and its pathology.

Impact assessment: Eroding benefits through streamlining?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bond, Alan, E-mail: alan.bond@uea.ac.uk; School of Geo and Spatial Sciences, North-West University; Pope, Jenny, E-mail: jenny@integral-sustainability.net

This paper argues that Governments have sought to streamline impact assessment in recent years (defined as the last five years) to counter concerns over the costs and potential for delays to economic development. We hypothesise that this has had some adverse consequences on the benefits that subsequently accrue from the assessments. This hypothesis is tested using a framework developed from arguments for the benefits brought by Environmental Impact Assessment made in 1982 in the face of the UK Government opposition to its implementation in a time of economic recession. The particular benefits investigated are ‘consistency and fairness’, ‘early warning’, ‘environmentmore » and development’, and ‘public involvement’. Canada, South Africa, the United Kingdom and Western Australia are the jurisdictions tested using this framework. The conclusions indicate that significant streamlining has been undertaken which has had direct adverse effects on some of the benefits that impact assessment should deliver, particularly in Canada and the UK. The research has not examined whether streamlining has had implications for the effectiveness of impact assessment, but the causal link between streamlining and benefits does sound warning bells that merit further investigation. -- Highlights: • Investigation of the extent to which government has streamlined IA. • Evaluation framework was developed based on benefits of impact assessment. • Canada, South Africa, the United Kingdom, and Western Australia were examined. • Trajectory in last five years is attrition of benefits of impact assessment.« less

Co-Certification: A New Direction for External Assessment?

ERIC Educational Resources Information Center

Newbold, David

2009-01-01

The major European testing agencies have calibrated their exams to the levels of language proficiency described in the Common European Framework (CEFR). In Italy, where the Framework has been enthusiastically embraced, external exams are now frequently used within the state education system as they are believed to provide reliable, widely…

Assessing Student Understanding: A Framework or Testing and Teaching

ERIC Educational Resources Information Center

Brendefur, Jonathan L.; Strother, Sam; Rich, Kelli; Appleton, Sarah

2016-01-01

Teachers use the word assessment to describe any method of gathering information about student learning. Whether it be formative assessment (intended to guide instructional decisions) or summative assessment (a reflection on the entirety of student learning from prior instruction), teachers are constantly working to identify what their students…

Assuring consumer safety without animal testing: a feasibility case study for skin sensitisation.

PubMed

Maxwell, Gavin; Aleksic, Maja; Aptula, Aynur; Carmichael, Paul; Fentem, Julia; Gilmour, Nicola; Mackay, Cameron; Pease, Camilla; Pendlington, Ruth; Reynolds, Fiona; Scott, Daniel; Warner, Guy; Westmoreland, Carl

2008-11-01

Allergic Contact Dermatitis (ACD; chemical-induced skin sensitisation) represents a key consumer safety endpoint for the cosmetics industry. At present, animal tests (predominantly the mouse Local Lymph Node Assay) are used to generate skin sensitisation hazard data for use in consumer safety risk assessments. An animal testing ban on chemicals to be used in cosmetics will come into effect in the European Union (EU) from March 2009. This animal testing ban is also linked to an EU marketing ban on products containing any ingredients that have been subsequently tested in animals, from March 2009 or March 2013, depending on the toxicological endpoint of concern. Consequently, the testing of cosmetic ingredients in animals for their potential to induce skin sensitisation will be subject to an EU marketing ban, from March 2013 onwards. Our conceptual framework and strategy to deliver a non-animal approach to consumer safety risk assessment can be summarised as an evaluation of new technologies (e.g. 'omics', informatics), leading to the development of new non-animal (in silico and in vitro) predictive models for the generation and interpretation of new forms of hazard characterisation data, followed by the development of new risk assessment approaches to integrate these new forms of data and information in the context of human exposure. Following the principles of the conceptual framework, we have been investigating existing and developing new technologies, models and approaches, in order to explore the feasibility of delivering consumer safety risk assessment decisions in the absence of new animal data. We present here our progress in implementing this conceptual framework, with the skin sensitisation endpoint used as a case study. 2008 FRAME.

Preliminary Validation of a Parent-Child Relational Framework for Teaching Developmental Assessment to Pediatric Residents.

PubMed

Regalado, Michael; Schneiderman, Janet U; Duan, Lei; Ragusa, Gisele

A parent-child relational framework was used as a method to train pediatric residents in basic knowledge and observation skills for the assessment of child development. Components of the training framework and its preliminary validation as an alternative to milestone-based approaches are described. Pediatric residents were trained during a 4-week clinical rotation to use a semistructured interview and observe parent-child behavior during health visits using clinical criteria for historical information and observed behavior that reflect developmental change in the parent-child relationship. Clinical impressions of concern versus no concern for developmental delay were derived from parent-child relational criteria and the physical examination. A chart review yielded 330 preterm infants evaluated using this methodology at 4 and 15 months corrected age who also had standardized developmental testing at 6 and 18 months corrected age. Sensitivities and specificities were computed to examine the validity of the clinical assessment compared with standardized testing. A subset of residents who completed 50 or more assessments during the rotation was timed at the end of 4 weeks. Parent-child behavioral markers elicited from the history and/or observed during the health visit correlated highly with standardized developmental assessment. Sensitivities and specificities were 0.72/0.98 and 0.87/0.96 at 4 to 6 and 15 to 18 months, respectively. Residents completed their assessments <1 minute on average if they had completed at least 50 supervised assessments. A parent-child relational framework is a potentially efficient and effective approach to training residents in the clinical knowledge and skills of child development assessment. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Application of ''Earl's Assessment "as", Assessment "for", and Assessment "of" Learning Model'' with Orthopaedic Assessment Clinical Competence

ERIC Educational Resources Information Center

Lafave, Mark R.; Katz, Larry; Vaughn, Norman

2013-01-01

Context: In order to study the efficacy of assessment methods, a theoretical framework of Earl's model of assessment was introduced. Objective: (1) Introduce the predictive learning assessment model (PLAM) as an application of Earl's model of learning; (2) test Earl's model of learning through the use of the Standardized Orthopedic Assessment Tool…

Framework for managing mycotoxin risks in the food industry.

PubMed

Baker, Robert C; Ford, Randall M; Helander, Mary E; Marecki, Janusz; Natarajan, Ramesh; Ray, Bonnie

2014-12-01

We propose a methodological framework for managing mycotoxin risks in the food processing industry. Mycotoxin contamination is a well-known threat to public health that has economic significance for the food processing industry; it is imperative to address mycotoxin risks holistically, at all points in the procurement, processing, and distribution pipeline, by tracking the relevant data, adopting best practices, and providing suitable adaptive controls. The proposed framework includes (i) an information and data repository, (ii) a collaborative infrastructure with analysis and simulation tools, (iii) standardized testing and acceptance sampling procedures, and (iv) processes that link the risk assessments and testing results to the sourcing, production, and product release steps. The implementation of suitable acceptance sampling protocols for mycotoxin testing is considered in some detail.

Principles Underlying the Use of Multiple Informants’ Reports

PubMed Central

De Los Reyes, Andres; Thomas, Sarah A.; Goodman, Kimberly L.; Kundey, Shannon M.A.

2014-01-01

Researchers use multiple informants’ reports to assess and examine behavior. However, informants’ reports commonly disagree. Informants’ reports often disagree in their perceived levels of a behavior (“low” vs. “elevated” mood), and examining multiple reports in a single study often results in inconsistent findings. Although researchers often espouse taking a multi-informant assessment approach, they frequently address informant discrepancies using techniques that treat discrepancies as measurement error. Yet, recent work indicates that researchers in a variety of fields often may be unable to justify treating informant discrepancies as measurement error. In this paper, the authors advance a framework (Operations Triad Model) outlining general principles for using and interpreting informants’ reports. Using the framework, researchers can test whether or not they can extract meaningful information about behavior from discrepancies among multiple informants’ reports. The authors provide supportive evidence for this framework and discuss its implications for hypothesis testing, study design, and quantitative review. PMID:23140332

Career Goals in Young Adults: Personal Resources, Goal Appraisals, Attitudes, and Goal Management Strategies

ERIC Educational Resources Information Center

Haratsis, Jessica M.; Hood, Michelle; Creed, Peter A.

2015-01-01

We tested a model based on the dual-process framework that assessed the relationships among personal resources, career goal appraisals, career attitudes, and career goal management, which have not been previously assessed together. The model (tested on a sample of 486 young adults: 74% female, M[subscript]age = 22 years) proposed that personal…

Technical skills assessment toolbox: a review using the unitary framework of validity.

PubMed

Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

2015-02-01

The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

Preparing for the Speaking Tasks of the "TOEFL iBT"® Test: An Investigation of the Journeys of Chinese Test Takers. "TOEFL iBT"® Research Report. TOEFL iBT-28. ETS Research Report. RR-17-19

ERIC Educational Resources Information Center

Yu, Guoxing; He, Lianzhen; Rea-Dickins, Pauline; Kiely, Richard; Lu, Yanbin; Zhang, Jing; Zhang, Yan; Xu, Shasha; Fang, Lin

2017-01-01

Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the "TOEFL iBT"® test represents a significant development and innovation in assessing speaking ability in academic…

Development of a technical assistance framework for building organizational capacity of health programs in resource-limited settings.

PubMed

Reyes, E Michael; Sharma, Anjali; Thomas, Kate K; Kuehn, Chuck; Morales, José Rafael

2014-09-17

Little information exists on the technical assistance needs of local indigenous organizations charged with managing HIV care and treatment programs funded by the US President's Emergency Plan for AIDS Relief (PEPFAR). This paper describes the methods used to adapt the Primary Care Assessment Tool (PCAT) framework, which has successfully strengthened HIV primary care services in the US, into one that could strengthen the capacity of local partners to deliver priority health programs in resource-constrained settings by identifying their specific technical assistance needs. Qualitative methods and inductive reasoning approaches were used to conceptualize and adapt the new Clinical Assessment for Systems Strengthening (ClASS) framework. Stakeholder interviews, comparisons of existing assessment tools, and a pilot test helped determine the overall ClASS framework for use in low-resource settings. The framework was further refined one year post-ClASS implementation. Stakeholder interviews, assessment of existing tools, a pilot process and the one-year post- implementation assessment informed the adaptation of the ClASS framework for assessing and strengthening technical and managerial capacities of health programs at three levels: international partner, local indigenous partner, and local partner treatment facility. The PCAT focus on organizational strengths and systems strengthening was retained and implemented in the ClASS framework and approach. A modular format was chosen to allow the use of administrative, fiscal and clinical modules in any combination and to insert new modules as needed by programs. The pilot led to refined pre-visit planning, informed review team composition, increased visit duration, and restructured modules. A web-based toolkit was developed to capture three years of experiential learning; this kit can also be used for independent implementation of the ClASS framework. A systematic adaptation process has produced a qualitative framework that can inform implementation strategies in support of country led HIV care and treatment programs. The framework, as a well-received iterative process focused on technical assistance, may have broader utility in other global programs.

A comprehensive test of clinical reasoning for medical students: An olympiad experience in Iran.

PubMed

Monajemi, Alireza; Arabshahi, Kamran Soltani; Soltani, Akbar; Arbabi, Farshid; Akbari, Roghieh; Custers, Eugene; Hadadgar, Arash; Hadizadeh, Fatemeh; Changiz, Tahereh; Adibi, Peyman

2012-01-01

Although some tests for clinical reasoning assessment are now available, the theories of medical expertise have not played a major role in this filed. In this paper, illness script theory was chose as a theoretical framework and contemporary clinical reasoning tests were put together based on this theoretical model. This paper is a qualitative study performed with an action research approach. This style of research is performed in a context where authorities focus on promoting their organizations' performance and is carried out in the form of teamwork called participatory research. Results are presented in four parts as basic concepts, clinical reasoning assessment, test framework, and scoring. we concluded that no single test could thoroughly assess clinical reasoning competency, and therefore a battery of clinical reasoning tests is needed. This battery should cover all three parts of clinical reasoning process: script activation, selection and verification. In addition, not only both analytical and non-analytical reasoning, but also both diagnostic and management reasoning should evenly take into consideration in this battery. This paper explains the process of designing and implementing the battery of clinical reasoning in the Olympiad for medical sciences students through an action research.

Conceptual Framework To Extend Life Cycle Assessment ...

EPA Pesticide Factsheets

Life Cycle Assessment (LCA) is a decision-making tool that accounts for multiple impacts across the life cycle of a product or service. This paper presents a conceptual framework to integrate human health impact assessment with risk screening approaches to extend LCA to include near-field chemical sources (e.g., those originating from consumer products and building materials) that have traditionally been excluded from LCA. A new generation of rapid human exposure modeling and high-throughput toxicity testing is transforming chemical risk prioritization and provides an opportunity for integration of screening-level risk assessment (RA) with LCA. The combined LCA and RA approach considers environmental impacts of products alongside risks to human health, which is consistent with regulatory frameworks addressing RA within a sustainability mindset. A case study is presented to juxtapose LCA and risk screening approaches for a chemical used in a consumer product. The case study demonstrates how these new risk screening tools can be used to inform toxicity impact estimates in LCA and highlights needs for future research. The framework provides a basis for developing tools and methods to support decision making on the use of chemicals in products. This paper presents a conceptual framework for including near-field exposures into Life Cycle Assessment using advanced human exposure modeling and high-throughput tools

Multidimensional Assessment of Spirituality/Religion in Patients with HIV: Conceptual Framework and Empirical Refinement

PubMed Central

Kudel, Ian; Cotton, Sian; Leonard, Anthony C.; Tsevat, Joel; Ritchey, P. Neal

2011-01-01

A decade ago, an expert panel developed a framework for measuring spirituality/religion in health research (Brief Multidimensional Measure of Religiousness/Spirituality), but empirical testing of this framework has been limited. The purpose of this study was to determine whether responses to items across multiple measures assessing spirituality/religion by 450 patients with HIV replicate this model. We hypothesized a six-factor model underlying a collective of 56 items, but results of confirmatory factor analyses suggested eight dimensions: Meaning/Peace, Tangible Connection to the Divine, Positive Religious Coping, Love/Appreciation, Negative Religious Coping, Positive Congregational Support, Negative Congregational Support, and Cultural Practices. This study corroborates parts of the factor structure underlying the Brief Multidimensional Measure of Religiousness/Spirituality and some recent refinements of the original framework. PMID:21136166

Multidimensional assessment of spirituality/religion in patients with HIV: conceptual framework and empirical refinement.

PubMed

Szaflarski, Magdalena; Kudel, Ian; Cotton, Sian; Leonard, Anthony C; Tsevat, Joel; Ritchey, P Neal

2012-12-01

A decade ago, an expert panel developed a framework for measuring spirituality/religion in health research (Brief Multidimensional Measure of Religiousness/Spirituality), but empirical testing of this framework has been limited. The purpose of this study was to determine whether responses to items across multiple measures assessing spirituality/religion by 450 patients with HIV replicate this model. We hypothesized a six-factor model underlying a collective of 56 items, but results of confirmatory factor analyses suggested eight dimensions: Meaning/Peace, Tangible Connection to the Divine, Positive Religious Coping, Love/Appreciation, Negative Religious Coping, Positive Congregational Support, Negative Congregational Support, and Cultural Practices. This study corroborates parts of the factor structure underlying the Brief Multidimensional Measure of Religiousness/Spirituality and some recent refinements of the original framework.

Theoretical Models, Assessment Frameworks and Test Construction.

ERIC Educational Resources Information Center

Chalhoub-Deville, Micheline

1997-01-01

Reviews the usefulness of proficiency models influencing second language testing. Findings indicate that several factors contribute to the lack of congruence between models and test construction and make a case for distinguishing between theoretical models. Underscores the significance of an empirical, contextualized and structured approach to the…

An open-source framework for testing tracking devices using Lego Mindstorms

NASA Astrophysics Data System (ADS)

Jomier, Julien; Ibanez, Luis; Enquobahrie, Andinet; Pace, Danielle; Cleary, Kevin

2009-02-01

In this paper, we present an open-source framework for testing tracking devices in surgical navigation applications. At the core of image-guided intervention systems is the tracking interface that handles communication with the tracking device and gathers tracking information. Given that the correctness of tracking information is critical for protecting patient safety and for ensuring the successful execution of an intervention, the tracking software component needs to be thoroughly tested on a regular basis. Furthermore, with widespread use of extreme programming methodology that emphasizes continuous and incremental testing of application components, testing design becomes critical. While it is easy to automate most of the testing process, it is often more difficult to test components that require manual intervention such as tracking device. Our framework consists of a robotic arm built from a set of Lego Mindstorms and an open-source toolkit written in C++ to control the robot movements and assess the accuracy of the tracking devices. The application program interface (API) is cross-platform and runs on Windows, Linux and MacOS. We applied this framework for the continuous testing of the Image-Guided Surgery Toolkit (IGSTK), an open-source toolkit for image-guided surgery and shown that regression testing on tracking devices can be performed at low cost and improve significantly the quality of the software.

Econometric Assessment of "One Minute" Paper as a Pedagogic Tool

ERIC Educational Resources Information Center

Das, Amaresh

2010-01-01

This paper makes an econometric testing of one-minute paper used as a tool to manage and assess instruction in my statistics class. One of our findings is that the one minute paper when I have tested it by using an OLS estimate in a controlled Vs experimental design framework is found to statistically significant and effective in enhancing…

Validation of the theoretical domains framework for use in behaviour change and implementation research.

PubMed

Cane, James; O'Connor, Denise; Michie, Susan

2012-04-24

An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework. Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis. There was good support for a refinement of the framework comprising 14 domains of theoretical constructs (average silhouette value 0.29): 'Knowledge', 'Skills', 'Social/Professional Role and Identity', 'Beliefs about Capabilities', 'Optimism', 'Beliefs about Consequences', 'Reinforcement', 'Intentions', 'Goals', 'Memory, Attention and Decision Processes', 'Environmental Context and Resources', 'Social Influences', 'Emotions', and 'Behavioural Regulation'. The refined Theoretical Domains Framework has a strengthened empirical base and provides a method for theoretically assessing implementation problems, as well as professional and other health-related behaviours as a basis for intervention development.

Computer-Based Working Memory Training in Children with Mild Intellectual Disability

ERIC Educational Resources Information Center

Delavarian, Mona; Bokharaeian, Behrouz; Towhidkhah, Farzad; Gharibzadeh, Shahriar

2015-01-01

We designed a working memory (WM) training programme in game framework for mild intellectually disabled students. Twenty-four students participated as test and control groups. The auditory and visual-spatial WM were assessed by primary test, which included computerised Wechsler numerical forward and backward sub-tests and secondary tests, which…

New Assessments, New Rigor

ERIC Educational Resources Information Center

Joan Herman; Robert Linn

2014-01-01

Researching. Synthesizing. Reasoning with evidence. The PARCC and Smarter Balanced assessments are clearly setting their sights on complex thinking skills. Researchers Joan Herman and Robert Linn look at the new assessments to see how they stack up against Norman Webb's depth of knowledge framework as well as against current state tests. The…

Trajectory tracking control for a nonholonomic mobile robot under ROS

NASA Astrophysics Data System (ADS)

Lakhdar Besseghieur, Khadir; Trębiński, Radosław; Kaczmarek, Wojciech; Panasiuk, Jarosław

2018-05-01

In this paper, the implementation of the trajectory tracking control strategy on a ROS-based mobile robot is considered. Our test-bench is the nonholonomic mobile robot ‘TURTLEBOT’. ROS facilitates considerably setting-up a suitable environment to test the designed controller. Our aim is to develop a framework using ROS concepts so that a trajectory tracking controller can be implemented on any ROS-enabled mobile robot. Practical experiments with ‘TURTLEBOT’ are conducted to assess the framework reliability.

The GRADE Evidence to Decision (EtD) framework for health system and public health decisions.

PubMed

Moberg, Jenny; Oxman, Andrew D; Rosenbaum, Sarah; Schünemann, Holger J; Guyatt, Gordon; Flottorp, Signe; Glenton, Claire; Lewin, Simon; Morelli, Angela; Rada, Gabriel; Alonso-Coello, Pablo

2018-05-29

To describe a framework for people making and using evidence-informed health system and public health recommendations and decisions. We developed the GRADE Evidence to Decision (EtD) framework for health system and public health decisions as part of the DECIDE project, in which we simultaneously developed frameworks for these and other types of healthcare decisions, including clinical recommendations, coverage decisions and decisions about diagnostic tests. Building on GRADE EtD tables, we used an iterative approach, including brainstorming, consultation of the literature and with stakeholders, and an international survey of policy-makers. We applied the framework to diverse examples, conducted workshops and user testing with health system and public health guideline developers and policy-makers, and observed and tested its use in real-life guideline panels. All the GRADE EtD frameworks share the same basic structure, including sections for formulating the question, making an assessment and drawing conclusions. Criteria listed in the assessment section of the health system and public health framework cover the important factors for making these types of decisions; in addition to the effects and economic impact of an option, the priority of the problem, the impact of the option on equity, and its acceptability and feasibility are important considerations that can inform both whether and how to implement an option. Because health system and public health interventions are often complex, detailed implementation considerations should be made when making a decision. The certainty of the evidence is often low or very low, but decision-makers must still act. Monitoring and evaluation are therefore often important considerations for these types of decisions. We illustrate the different components of the EtD framework for health system and public health decisions by presenting their application in a framework adapted from a real-life guideline. This framework provides a structured and transparent approach to support policy-making informed by the best available research evidence, while making the basis for decisions accessible to those whom they will affect. The health system and public health EtD framework can also be used to facilitate dissemination of recommendations and enable decision-makers to adopt, and adapt, recommendations or decisions.

Implementation of the Leaching Environmental Assessment ...

EPA Pesticide Factsheets

LEAF provides a uniform and integrated approach for evaluating leaching from solid materials (e.g., waste, treated wastes such as by solidification/stabilization, secondary materials such as blast furnace slags, energy residuals such as coal fly ash, soil, sediments, mining and mineral processing wastes). Assessment using LEAF applies a stepwise approach that considers the leaching behavior of COPCs in response to chemical and physical factors that control and material properties across a range of plausible field conditions (US EPA, 2010). The framework provides the flexibility to tailor testing to site conditions and select the extent of testing based on assessment objectives and the level of detailed information needed to support decision-making. The main focus will be to discuss the implementation of LEAF in the US and the How to Guide that has recently been completed. To present the How To Guide for the implementation of the leaching environmental assessment framework to an international audience already familiar with comparable leaching tests in use in Europe. Will be meeting with European colleagues on their interest in expanding methods to include organics.

How is genetic testing evaluated? A systematic review of the literature.

PubMed

Pitini, Erica; De Vito, Corrado; Marzuillo, Carolina; D'Andrea, Elvira; Rosso, Annalisa; Federici, Antonio; Di Maria, Emilio; Villari, Paolo

2018-05-01

Given the rapid development of genetic tests, an assessment of their benefits, risks, and limitations is crucial for public health practice. We performed a systematic review aimed at identifying and comparing the existing evaluation frameworks for genetic tests. We searched PUBMED, SCOPUS, ISI Web of Knowledge, Google Scholar, Google, and gray literature sources for any documents describing such frameworks. We identified 29 evaluation frameworks published between 2000 and 2017, mostly based on the ACCE Framework (n = 13 models), or on the HTA process (n = 6), or both (n = 2). Others refer to the Wilson and Jungner screening criteria (n = 3) or to a mixture of different criteria (n = 5). Due to the widespread use of the ACCE Framework, the most frequently used evaluation criteria are analytic and clinical validity, clinical utility and ethical, legal and social implications. Less attention is given to the context of implementation. An economic dimension is always considered, but not in great detail. Consideration of delivery models, organizational aspects, and consumer viewpoint is often lacking. A deeper analysis of such context-related evaluation dimensions may strengthen a comprehensive evaluation of genetic tests and support the decision-making process.

A framework provided an outline toward the proper evaluation of potential screening strategies.

PubMed

Adriaensen, Wim J; Matheï, Cathy; Buntinx, Frank J; Arbyn, Marc

2013-06-01

Screening tests are often introduced into clinical practice without proper evaluation, despite the increasing awareness that screening is a double-edged sword that can lead to either net benefits or harms. Our objective was to develop a comprehensive framework for the evaluation of new screening strategies. Elaborating on the existing concepts proposed by experts, a stepwise framework is proposed to evaluate whether a potential screening test can be introduced as a screening strategy into clinical practice. The principle of screening strategy evaluation is illustrated for cervical cancer, which is a template for screening because of the existence of an easily detectable and treatable precursor lesion. The evaluation procedure consists of six consecutive steps. In steps 1-4, the technical accuracy, place of the test in the screening pathway, diagnostic accuracy, and longitudinal sensitivity and specificity of the screening test are assessed. In steps 5 and 6, the impact of the screening strategy on the patient and population levels, respectively, is evaluated. The framework incorporates a harm and benefit trade-off and cost-effectiveness analysis. Our framework provides an outline toward the proper evaluation of potential screening strategies before considering implementation. Copyright © 2013 Elsevier Inc. All rights reserved.

Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?

NASA Astrophysics Data System (ADS)

Beggrow, Elizabeth P.; Ha, Minsu; Nehm, Ross H.; Pearl, Dennis; Boone, William J.

2014-02-01

The landscape of science education is being transformed by the new Framework for Science Education (National Research Council, A framework for K-12 science education: practices, crosscutting concepts, and core ideas. The National Academies Press, Washington, DC, 2012), which emphasizes the centrality of scientific practices—such as explanation, argumentation, and communication—in science teaching, learning, and assessment. A major challenge facing the field of science education is developing assessment tools that are capable of validly and efficiently evaluating these practices. Our study examined the efficacy of a free, open-source machine-learning tool for evaluating the quality of students' written explanations of the causes of evolutionary change relative to three other approaches: (1) human-scored written explanations, (2) a multiple-choice test, and (3) clinical oral interviews. A large sample of undergraduates (n = 104) exposed to varying amounts of evolution content completed all three assessments: a clinical oral interview, a written open-response assessment, and a multiple-choice test. Rasch analysis was used to compute linear person measures and linear item measures on a single logit scale. We found that the multiple-choice test displayed poor person and item fit (mean square outfit >1.3), while both oral interview measures and computer-generated written response measures exhibited acceptable fit (average mean square outfit for interview: person 0.97, item 0.97; computer: person 1.03, item 1.06). Multiple-choice test measures were more weakly associated with interview measures (r = 0.35) than the computer-scored explanation measures (r = 0.63). Overall, Rasch analysis indicated that computer-scored written explanation measures (1) have the strongest correspondence to oral interview measures; (2) are capable of capturing students' normative scientific and naive ideas as accurately as human-scored explanations, and (3) more validly detect understanding than the multiple-choice assessment. These findings demonstrate the great potential of machine-learning tools for assessing key scientific practices highlighted in the new Framework for Science Education.

Including Pupils with Special Educational Needs and Disability in National Assessment: Comparison of Three Country Case Studies through an Inclusive Assessment Framework

ERIC Educational Resources Information Center

Douglas, Graeme; McLinden, Mike; Robertson, Christopher; Travers, Joseph; Smith, Emma

2016-01-01

The assessment of educational progress and outcomes of pupils is important to all concerned with education. This includes testing which is undertaken for accountability and award bearing purposes. This article examines how students with special educational needs and disability (SEND) are included in assessment. An "inclusive assessment"…

Framework for e-learning assessment in dental education: a global model for the future.

PubMed

Arevalo, Carolina R; Bayne, Stephen C; Beeley, Josie A; Brayshaw, Christine J; Cox, Margaret J; Donaldson, Nora H; Elson, Bruce S; Grayden, Sharon K; Hatzipanagos, Stylianos; Johnson, Lynn A; Reynolds, Patricia A; Schönwetter, Dieter J

2013-05-01

The framework presented in this article demonstrates strategies for a global approach to e-curricula in dental education by considering a collection of outcome assessment tools. By combining the outcomes for overall assessment, a global model for a pilot project that applies e-assessment tools to virtual learning environments (VLE), including haptics, is presented. Assessment strategies from two projects, HapTEL (Haptics in Technology Enhanced Learning) and UDENTE (Universal Dental E-learning), act as case-user studies that have helped develop the proposed global framework. They incorporate additional assessment tools and include evaluations from questionnaires and stakeholders' focus groups. These measure each of the factors affecting the classical teaching/learning theory framework as defined by Entwistle in a standardized manner. A mathematical combinatorial approach is proposed to join these results together as a global assessment. With the use of haptic-based simulation learning, exercises for tooth preparation assessing enamel and dentine were compared to plastic teeth in manikins. Equivalence for student performance for haptic versus traditional preparation methods was established, thus establishing the validity of the haptic solution for performing these exercises. Further data collected from HapTEL are still being analyzed, and pilots are being conducted to validate the proposed test measures. Initial results have been encouraging, but clearly the need persists to develop additional e-assessment methods for new learning domains.

Measuring implementation behaviour of menu guidelines in the childcare setting: confirmatory factor analysis of a theoretical domains framework questionnaire (TDFQ).

PubMed

Seward, Kirsty; Wolfenden, Luke; Wiggers, John; Finch, Meghan; Wyse, Rebecca; Oldmeadow, Christopher; Presseau, Justin; Clinton-McHarg, Tara; Yoong, Sze Lin

2017-04-04

While there are number of frameworks which focus on supporting the implementation of evidence based approaches, few psychometrically valid measures exist to assess constructs within these frameworks. This study aimed to develop and psychometrically assess a scale measuring each domain of the Theoretical Domains Framework for use in assessing the implementation of dietary guidelines within a non-health care setting (childcare services). A 75 item 14-domain Theoretical Domains Framework Questionnaire (TDFQ) was developed and administered via telephone interview to 202 centre based childcare service cooks who had a role in planning the service menu. Confirmatory factor analysis (CFA) was undertaken to assess the reliability, discriminant validity and goodness of fit of the 14-domain theoretical domain framework measure. For the CFA, five iterative processes of adjustment were undertaken where 14 items were removed, resulting in a final measure consisting of 14 domains and 61 items. For the final measure: the Chi-Square goodness of fit statistic was 3447.19; the Standardized Root Mean Square Residual (SRMR) was 0.070; the Root Mean Square Error of Approximation (RMSEA) was 0.072; and the Comparative Fit Index (CFI) had a value of 0.78. While only one of the three indices support goodness of fit of the measurement model tested, a 14-domain model with 61 items showed good discriminant validity and internally consistent items. Future research should aim to assess the psychometric properties of the developed TDFQ in other community-based settings.

Analysing task design and students' responses to context-based problems through different analytical frameworks

NASA Astrophysics Data System (ADS)

Broman, Karolina; Bernholt, Sascha; Parchmann, Ilka

2015-05-01

Background:Context-based learning approaches are used to enhance students' interest in, and knowledge about, science. According to different empirical studies, students' interest is improved by applying these more non-conventional approaches, while effects on learning outcomes are less coherent. Hence, further insights are needed into the structure of context-based problems in comparison to traditional problems, and into students' problem-solving strategies. Therefore, a suitable framework is necessary, both for the analysis of tasks and strategies. Purpose:The aim of this paper is to explore traditional and context-based tasks as well as students' responses to exemplary tasks to identify a suitable framework for future design and analyses of context-based problems. The paper discusses different established frameworks and applies the Higher-Order Cognitive Skills/Lower-Order Cognitive Skills (HOCS/LOCS) taxonomy and the Model of Hierarchical Complexity in Chemistry (MHC-C) to analyse traditional tasks and students' responses. Sample:Upper secondary students (n=236) at the Natural Science Programme, i.e. possible future scientists, are investigated to explore learning outcomes when they solve chemistry tasks, both more conventional as well as context-based chemistry problems. Design and methods:A typical chemistry examination test has been analysed, first the test items in themselves (n=36), and thereafter 236 students' responses to one representative context-based problem. Content analysis using HOCS/LOCS and MHC-C frameworks has been applied to analyse both quantitative and qualitative data, allowing us to describe different problem-solving strategies. Results:The empirical results show that both frameworks are suitable to identify students' strategies, mainly focusing on recall of memorized facts when solving chemistry test items. Almost all test items were also assessing lower order thinking. The combination of frameworks with the chemistry syllabus has been found successful to analyse both the test items as well as students' responses in a systematic way. The framework can therefore be applied in the design of new tasks, the analysis and assessment of students' responses, and as a tool for teachers to scaffold students in their problem-solving process. Conclusions:This paper gives implications for practice and for future research to both develop new context-based problems in a structured way, as well as providing analytical tools for investigating students' higher order thinking in their responses to these tasks.

Assessing Enquiry-Based Learning: Developing Objective Criteria from Personal Knowledge

ERIC Educational Resources Information Center

Small, Tim

2009-01-01

This article takes as its starting point the idea that policies of "personalising learning" and promoting "creativity" raise issues for assessment which the present framework for assessment and testing in schools in England and Wales does little to address. It explores the notion, also touched on elsewhere in this issue, of a…

Assessment-Based Curriculum: Globalising and Enterprising Culture, Human Capital and Teacher-Technicians in Aotearoa New Zealand

ERIC Educational Resources Information Center

O'Neill, Anne-Marie

2016-01-01

This policy chronology traces the institution of globalised school curriculum and assessment discourses, as a vernacular and specific form of public rationalisation and educational governmentality in Aotearoa New Zealand. Without functional national standards or national testing, official discourses constructed an assessment-driven framework as a…

Framework for Building an Effective Student Assessment System: READ/SABER Working Paper

ERIC Educational Resources Information Center

Clarke, Marguerite

2011-01-01

The purpose of this paper is to help countries understand some of the "key principles and characteristics of an effective student assessment system". The focus is on assessment of student learning and achievement at the K-12 level. The paper extracts principles and guidelines from countries' experiences, professional testing standards,…

Using Model-Tracing to Conduct Performance Assessment of Students' Inquiry Skills within a Microworld

ERIC Educational Resources Information Center

Gobert, Janice D.; Koedinger, Kenneth R.

2011-01-01

The National frameworks for science emphasize inquiry skills (NRC, 1996), however, in typical classroom practice, science learning often focuses on rote learning in part because science process skills are difficult to assess (Fadel, Honey, & Pasnick, 2007) and rote knowledge is prioritized on high-stakes tests. Short answer assessments of…

New developments in the evolution and application of the WHO/IPCS framework on mode of action/species concordance analysis.

PubMed

Meek, M E; Boobis, A; Cote, I; Dellarco, V; Fotakis, G; Munn, S; Seed, J; Vickers, C

2014-01-01

The World Health Organization/International Programme on Chemical Safety mode of action/human relevance framework has been updated to reflect the experience acquired in its application and extend its utility to emerging areas in toxicity testing and non-testing methods. The underlying principles have not changed, but the framework's scope has been extended to enable integration of information at different levels of biological organization and reflect evolving experience in a much broader range of potential applications. Mode of action/species concordance analysis can also inform hypothesis-based data generation and research priorities in support of risk assessment. The modified framework is incorporated within a roadmap, with feedback loops encouraging continuous refinement of fit-for-purpose testing strategies and risk assessment. Important in this construct is consideration of dose-response relationships and species concordance analysis in weight of evidence. The modified Bradford Hill considerations have been updated and additionally articulated to reflect increasing experience in application for cases where the toxicological outcome of chemical exposure is known. The modified framework can be used as originally intended, where the toxicological effects of chemical exposure are known, or in hypothesizing effects resulting from chemical exposure, using information on putative key events in established modes of action from appropriate in vitro or in silico systems and other lines of evidence. This modified mode of action framework and accompanying roadmap and case examples are expected to contribute to improving transparency in explicitly addressing weight of evidence considerations in mode of action/species concordance analysis based on both conventional data sources and evolving methods. Copyright © 2013 John Wiley & Sons, Ltd. The World Health Organization retains copyright and all other rights in the manuscript of this article as submitted for publication.

Initial Multidisciplinary Design and Analysis Framework

NASA Technical Reports Server (NTRS)

Ozoroski, L. P.; Geiselhart, K. A.; Padula, S. L.; Li, W.; Olson, E. D.; Campbell, R. L.; Shields, E. W.; Berton, J. J.; Gray, J. S.; Jones, S. M.;

From individual to population level effects of toxicants in the tubicifid Branchiura sowerbyi using threshold effect models in a Bayesian framework.

PubMed

Ducrot, Virginie; Billoir, Elise; Péry, Alexandre R R; Garric, Jeanne; Charles, Sandrine

2010-05-01

Effects of zinc were studied in the freshwater worm Branchiura sowerbyi using partial and full life-cycle tests. Only newborn and juveniles were sensitive to zinc, displaying effects on survival, growth, and age at first brood at environmentally relevant concentrations. Threshold effect models were proposed to assess toxic effects on individuals. They were fitted to life-cycle test data using Bayesian inference and adequately described life-history trait data in exposed organisms. The daily asymptotic growth rate of theoretical populations was then simulated with a matrix population model, based upon individual-level outputs. Population-level outputs were in accordance with existing literature for controls. Working in a Bayesian framework allowed incorporating parameter uncertainty in the simulation of the population-level response to zinc exposure, thus increasing the relevance of test results in the context of ecological risk assessment.

A comprehensive test of clinical reasoning for medical students: An olympiad experience in Iran

PubMed Central

Monajemi, Alireza; Arabshahi, Kamran Soltani; Soltani, Akbar; Arbabi, Farshid; Akbari, Roghieh; Custers, Eugene; Hadadgar, Arash; Hadizadeh, Fatemeh; Changiz, Tahereh; Adibi, Peyman

2012-01-01

Background: Although some tests for clinical reasoning assessment are now available, the theories of medical expertise have not played a major role in this filed. In this paper, illness script theory was chose as a theoretical framework and contemporary clinical reasoning tests were put together based on this theoretical model. Materials and Methods: This paper is a qualitative study performed with an action research approach. This style of research is performed in a context where authorities focus on promoting their organizations’ performance and is carried out in the form of teamwork called participatory research. Results: Results are presented in four parts as basic concepts, clinical reasoning assessment, test framework, and scoring. Conclusion: we concluded that no single test could thoroughly assess clinical reasoning competency, and therefore a battery of clinical reasoning tests is needed. This battery should cover all three parts of clinical reasoning process: script activation, selection and verification. In addition, not only both analytical and non-analytical reasoning, but also both diagnostic and management reasoning should evenly take into consideration in this battery. This paper explains the process of designing and implementing the battery of clinical reasoning in the Olympiad for medical sciences students through an action research. PMID:23555113

Why is Coal Ash of Concern and How to Assess Potential Impacts?

EPA Science Inventory

EPA's new test methods - the leaching environmental assessment framework (LEAF) are discussed including how they have been used to evaluate fly ash and scrubber residues. Work to evaluate high-volume encapsulated use of fly ash in cementitious material is also described.

The Neglected Situation: Assessment Performance and Interaction in Context

ERIC Educational Resources Information Center

Maddox, Bryan

2015-01-01

Informed by Goffman's influential essay on "The neglected situation" this paper examines the contextual and interactive dimensions of performance in large-scale educational assessments. The paper applies Goffman's participation framework and associated theory in linguistic anthropology to examine how testing situations are framed and…

Development of family and dietary habits questionnaires: the assessment of family processes, dietary habits and adolescents' impulsiveness in Norwegian adolescents and their parents.

PubMed

Bjelland, Mona; Hausken, Solveig E S; Sleddens, Ester F C; Andersen, Lene F; Lie, Hanne C; Finset, Arnstein; Maes, Lea; Melbye, Elisabeth L; Glavin, Kari; Hanssen-Bauer, Merete W; Lien, Nanna

2014-10-15

There is a need for valid and comprehensive measures of parental influence on children's energy balance-related behaviours (EBRB). Such measures should be based on a theoretical framework, acknowledging the dynamic and complex nature of interactions occurring within a family. The aim of the Family & Dietary habits (F&D) project was to develop a conceptual framework identifying important and changeable family processes influencing dietary behaviours of 13-15 year olds. A second aim was to develop valid and reliable questionnaires for adolescents and their parents (both mothers and fathers) measuring these processes. A stepwise approach was used; (1) preparation of scope and structure, (2) development of the F&D questionnaires, (3) the conducting of pilot studies and (4) the conducting of validation studies (assessing internal reliability, test-retest reliability and confirmatory factor analysis) using data from a cross-sectional study. The conceptual framework includes psychosocial concepts such as family functioning, cohesion, conflicts, communication, work-family stress, parental practices and parental style. The physical characteristics of the home environment include accessibility and availability of different food items, while family meals are the sociocultural setting included. Individual characteristics measured are dietary intake (vegetables and sugar-sweetened beverages) and adolescents' impulsivity. The F&D questionnaires developed were tested in a test-retest (54 adolescents and 44 of their parents) and in a cross-sectional survey including 440 adolescents (13-15 year olds), 242 mothers and 155 fathers. The samples appear to be relatively representative for Norwegian adolescents and parents. For adolescents, mothers and fathers, the test-retest reliability of the dietary intake, frequencies of (family) meals, work-family stress and communication variables was satisfactory (ICC: 0.53-0.99). Barratt Impulsiveness Scale-Brief (BIS-Brief) was included, assessing adolescent's impulsivity. The internal reliability (Cronbach's alphas: 0.77/0.82) and test-retest reliability values (ICC: 0.74/0.77) of BIS-Brief were good. The conceptual framework developed may be a useful tool in guiding measurement and assessment of the home food environment and family processes related to adolescents' dietary habits, in particular and for EBRBs more generally. The results support the use of the F&D questionnaires as psychometrically sound tools to assess family characteristics and adolescent's impulsivity.

Developing and Piloting a Framework for Studying the Alignment of Mathematics Examinations with the Curriculum: The Case of Lebanon

ERIC Educational Resources Information Center

Osta, Iman

2007-01-01

This research aimed at developing a methodological framework to investigate the alignment of the Lebanese national math exam tests with the curriculum at the middle school level, during the transitory period of a major curricular reform. The focus is on exploring the characteristics of an "assessment culture" set by the national exams…

The Influence of Properties of the Test and Their Interactions with Reader Characteristics on Reading Comprehension: An Explanatory Item Response Study

ERIC Educational Resources Information Center

Kulesz, Paulina A.; Francis, David J.; Barnes, Marcia A.; Fletcher, Jack M.

2016-01-01

Component skills and discourse frameworks of reading have identified characteristics of readers and texts that influence comprehension. However, these 2 frameworks have not previously been integrated in a comprehensive and systematic way to explain performance on any standardized assessment of reading comprehension that is in widespread use across…

Adverse outcome pathways (AOPs) to enhance EDC ...

EPA Pesticide Factsheets

Screening and testing for endocrine active chemicals was mandated under 1996 amendments to the Safe Drinking Water Act and Food Quality Protection Act. Efficiencies can be gained in the endocrine disruptor screening program by using available biological and toxicological knowledge to facilitate greater use of high throughput screening data and other data sources to inform endocrine disruptor assessments. Likewise, existing knowledge, when properly organized, can help aid interpretation of test results. The adverse outcome pathway (AOP) framework, which organizes information concerning measureable changes that link initial biological interactions with a chemical to adverse effects that are meaningful to risk assessment and management, can aid this process. This presentation outlines the ways in which the AOP framework has already been employed to support EDSP and how it may further enhance endocrine disruptor assessments in the future. Screening and testing for endocrine active chemicals was mandated under 1996 amendments to the Safe Drinking Water Act and Food Quality Protection Act. Efficiencies can be gained in the endocrine disruptor screening program by using available biological and toxicological knowledge to facilitate greater use of high throughput screening data and other data sources to inform endocrine disruptor assessments. Likewise, existing knowledge, when properly organized, can help aid interpretation of test results. The adverse outcome pathway

Extending LMS to Support IRT-Based Assessment Test Calibration

NASA Astrophysics Data System (ADS)

Fotaris, Panagiotis; Mastoras, Theodoros; Mavridis, Ioannis; Manitsaris, Athanasios

Developing unambiguous and challenging assessment material for measuring educational attainment is a time-consuming, labor-intensive process. As a result Computer Aided Assessment (CAA) tools are becoming widely adopted in academic environments in an effort to improve the assessment quality and deliver reliable results of examinee performance. This paper introduces a methodological and architectural framework which embeds a CAA tool in a Learning Management System (LMS) so as to assist test developers in refining items to constitute assessment tests. An Item Response Theory (IRT) based analysis is applied to a dynamic assessment profile provided by the LMS. Test developers define a set of validity rules for the statistical indices given by the IRT analysis. By applying those rules, the LMS can detect items with various discrepancies which are then flagged for review of their content. Repeatedly executing the aforementioned procedure can improve the overall efficiency of the testing process.

Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework.

PubMed

Pfadenhauer, Lisa M; Gerhardus, Ansgar; Mozygemba, Kati; Lysdahl, Kristin Bakke; Booth, Andrew; Hofmann, Bjørn; Wahlster, Philip; Polus, Stephanie; Burns, Jacob; Brereton, Louise; Rehfuess, Eva

2017-02-15

The effectiveness of complex interventions, as well as their success in reaching relevant populations, is critically influenced by their implementation in a given context. Current conceptual frameworks often fail to address context and implementation in an integrated way and, where addressed, they tend to focus on organisational context and are mostly concerned with specific health fields. Our objective was to develop a framework to facilitate the structured and comprehensive conceptualisation and assessment of context and implementation of complex interventions. The Context and Implementation of Complex Interventions (CICI) framework was developed in an iterative manner and underwent extensive application. An initial framework based on a scoping review was tested in rapid assessments, revealing inconsistencies with respect to the underlying concepts. Thus, pragmatic utility concept analysis was undertaken to advance the concepts of context and implementation. Based on these findings, the framework was revised and applied in several systematic reviews, one health technology assessment (HTA) and one applicability assessment of very different complex interventions. Lessons learnt from these applications and from peer review were incorporated, resulting in the CICI framework. The CICI framework comprises three dimensions-context, implementation and setting-which interact with one another and with the intervention dimension. Context comprises seven domains (i.e., geographical, epidemiological, socio-cultural, socio-economic, ethical, legal, political); implementation consists of five domains (i.e., implementation theory, process, strategies, agents and outcomes); setting refers to the specific physical location, in which the intervention is put into practise. The intervention and the way it is implemented in a given setting and context can occur on a micro, meso and macro level. Tools to operationalise the framework comprise a checklist, data extraction tools for qualitative and quantitative reviews and a consultation guide for applicability assessments. The CICI framework addresses and graphically presents context, implementation and setting in an integrated way. It aims at simplifying and structuring complexity in order to advance our understanding of whether and how interventions work. The framework can be applied in systematic reviews and HTA as well as primary research and facilitate communication among teams of researchers and with various stakeholders.

Evolving Frameworks for Different Communities of Scientists and End Users

NASA Astrophysics Data System (ADS)

Graves, S. J.; Keiser, K.

2016-12-01

Two evolving frameworks for interdisciplinary science will be described in the context of the Common Data Framework for Earth-Observation Data and the importance of standards and protocols. The Event Data Driven Delivery (ED3) Framework, funded by NASA Applied Sciences, provides the delivery of data based on predetermined subscriptions and associated workflows to various communities of end users. ED3's capabilities are used by scientists, as well as policy and resource managers, when event alerts are triggered to respond to their needs. The EarthCube Integration and Testing Environment (ECITE) Assessment Framework for Technology Interoperability and Integration is being developed to facilitate the EarthCube community's assessment of NSF funded technologies addressing Earth science problems. ECITE is addressing the translation of geoscience researchers' use cases into technology use case that apply EarthCube-funded building block technologies (and other existing technologies) for solving science problems. EarthCube criteria for technology assessment include the use of data, metadata and service standards to improve interoperability and integration across program components. The long-range benefit will be the growth of a cyberinfrastructure with technology components that have been shown to work together to solve known science objectives.

An Assessment of Adolescent Comprehension of Some Geographical Concepts Using Peel's Theoretical Framework.

ERIC Educational Resources Information Center

Ghuman, Paul A. S.; Davis, R.

1981-01-01

This inquiry had two aims: to assess children's ability to interpret maps in geography; to relate the assessed ability to maturity of thought as proposed by Peel, general intelligence, and age. It was found that performance on four tests depended more on intelligence than on maturity of thought or age. (Author/SJL)

Building Valued-Added Assessment into Michigan's Accountability System: Lessons from Other States. Research Report 1

ERIC Educational Resources Information Center

Lee, Kwangyhuyn; Weimer, Debbi

2002-01-01

Michigan is designing a new accountability system that combines high standards and statewide testing within a school accreditation framework. Sound assessment techniques are critical if the accountability system is to provide relevant information to schools and policymakers. One important component of a sound assessment system is measurement of…

Utilizing Concrete Manipulatives in Contextually Distinct Situations to Assess Middle School Students' Meanings of Force

ERIC Educational Resources Information Center

Ozdemir, Gokhan

2017-01-01

Students' alternative conceptions of force are one of the most studied topics, important for both science assessment and instruction. Previous studies often described students' alternative conceptions of force with a small number of well-known frameworks by utilizing interviews and paper-pencil tests in their assessments. This study aims to…

Development and application of the adverse outcome pathway framework for understanding and predicting chronic toxicity: I. Challenges and research needs in ecotoxicology.

PubMed

Groh, Ksenia J; Carvalho, Raquel N; Chipman, James K; Denslow, Nancy D; Halder, Marlies; Murphy, Cheryl A; Roelofs, Dick; Rolaki, Alexandra; Schirmer, Kristin; Watanabe, Karen H

2015-02-01

To elucidate the effects of chemicals on populations of different species in the environment, efficient testing and modeling approaches are needed that consider multiple stressors and allow reliable extrapolation of responses across species. An adverse outcome pathway (AOP) is a concept that provides a framework for organizing knowledge about the progression of toxicity events across scales of biological organization that lead to adverse outcomes relevant for risk assessment. In this paper, we focus on exploring how the AOP concept can be used to guide research aimed at improving both our understanding of chronic toxicity, including delayed toxicity as well as epigenetic and transgenerational effects of chemicals, and our ability to predict adverse outcomes. A better understanding of the influence of subtle toxicity on individual and population fitness would support a broader integration of sublethal endpoints into risk assessment frameworks. Detailed mechanistic knowledge would facilitate the development of alternative testing methods as well as help prioritize higher tier toxicity testing. We argue that targeted development of AOPs supports both of these aspects by promoting the elucidation of molecular mechanisms and their contribution to relevant toxicity outcomes across biological scales. We further discuss information requirements and challenges in application of AOPs for chemical- and site-specific risk assessment and for extrapolation across species. We provide recommendations for potential extension of the AOP framework to incorporate information on exposure, toxicokinetics and situation-specific ecological contexts, and discuss common interfaces that can be employed to couple AOPs with computational modeling approaches and with evolutionary life history theory. The extended AOP framework can serve as a venue for integration of knowledge derived from various sources, including empirical data as well as molecular, quantitative and evolutionary-based models describing species responses to toxicants. This will allow a more efficient application of AOP knowledge for quantitative chemical- and site-specific risk assessment as well as for extrapolation across species in the future. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

A framework for assessing health system resilience in an economic crisis: Ireland as a test case

PubMed Central

2013-01-01

Background The financial crisis that hit the global economy in 2007 was unprecedented in the post war era. In general the crisis has created a difficult environment for health systems globally. The purpose of this paper is to develop a framework for assessing the resilience of health systems in terms of how they have adjusted to economic crisis. Resilience can be understood as the capacity of a system to absorb change but continue to retain essentially the same identity and function. The Irish health system is used as a case study to assess the usefulness of this framework. Methods The authors identify three forms of resilience: financial, adaptive and transformatory. Indicators of performance are presented to allow for testing of the framework and measurement of system performance. Both quantitative and qualitative methods were used to yield data for the Irish case study. Quantitative data were collected from government documents and sources to understand the depth of the recession and the different dimensions of the response. Semi-structured interviews were conducted with key decision makers to understand the reasons for decisions made. Results In the Irish case there is mixed evidence on resilience. Health funding was initially protected but was then followed by deep cuts as the crisis deepened. There is strong evidence for adaptive resilience, with the health system showing efficiency gains from the recession. Nevertheless, easy efficiencies have been made and continued austerity will mean cuts in entitlements and services. The prospects for building and maintaining transformatory resilience are unsure. While the direction of reform is clear, and has been preserved to date, it is not certain whether it will remain manageable given continued austerity, some loss of sovereignty and capacity limitations. Conclusions The three aspects of resilience proved a useful categorisation of performance measurement though there is overlap between them. Transformatory resilience may be more difficult to assess precisely. It would be useful to test out the framework against other country experiences and refine the measures and indicators. Further research on both the comparative resilience of different health systems and building resilience in preparation for crises is encouraged. PMID:24171814

A framework for assessing health system resilience in an economic crisis: Ireland as a test case.

PubMed

Thomas, Steve; Keegan, Conor; Barry, Sarah; Layte, Richard; Jowett, Matt; Normand, Charles

2013-10-30

The financial crisis that hit the global economy in 2007 was unprecedented in the post war era. In general the crisis has created a difficult environment for health systems globally. The purpose of this paper is to develop a framework for assessing the resilience of health systems in terms of how they have adjusted to economic crisis. Resilience can be understood as the capacity of a system to absorb change but continue to retain essentially the same identity and function. The Irish health system is used as a case study to assess the usefulness of this framework. The authors identify three forms of resilience: financial, adaptive and transformatory. Indicators of performance are presented to allow for testing of the framework and measurement of system performance. Both quantitative and qualitative methods were used to yield data for the Irish case study. Quantitative data were collected from government documents and sources to understand the depth of the recession and the different dimensions of the response. Semi-structured interviews were conducted with key decision makers to understand the reasons for decisions made. In the Irish case there is mixed evidence on resilience. Health funding was initially protected but was then followed by deep cuts as the crisis deepened. There is strong evidence for adaptive resilience, with the health system showing efficiency gains from the recession. Nevertheless, easy efficiencies have been made and continued austerity will mean cuts in entitlements and services. The prospects for building and maintaining transformatory resilience are unsure. While the direction of reform is clear, and has been preserved to date, it is not certain whether it will remain manageable given continued austerity, some loss of sovereignty and capacity limitations. The three aspects of resilience proved a useful categorisation of performance measurement though there is overlap between them. Transformatory resilience may be more difficult to assess precisely. It would be useful to test out the framework against other country experiences and refine the measures and indicators. Further research on both the comparative resilience of different health systems and building resilience in preparation for crises is encouraged.

Background information for the Leaching environmental Assessment Framework (LEAF) test methods

EPA Science Inventory

The U.S. Environmental Protection Agency Office of Resource Conservation and Recovery has initiated the review and validation process for four leaching tests under consideration for inclusion into SW-846: Method 1313 "Liquid-Solid Partitioning as a Function of Extract pH for Co...

Generation of GHS Scores from TEST and online sources

EPA Science Inventory

Alternatives assessment frameworks such as DfE (Design for the Environment) evaluate chemical alternatives in terms of human health effects, ecotoxicity, and fate. T.E.S.T. (Toxicity Estimation Software Tool) can be utilized to evaluate human health in terms of acute oral rat tox...

Conceptual Framework To Extend Life Cycle Assessment Using Near-Field Human Exposure Modeling and High-Throughput Tools for Chemicals.

PubMed

Csiszar, Susan A; Meyer, David E; Dionisio, Kathie L; Egeghy, Peter; Isaacs, Kristin K; Price, Paul S; Scanlon, Kelly A; Tan, Yu-Mei; Thomas, Kent; Vallero, Daniel; Bare, Jane C

2016-11-01

Life Cycle Assessment (LCA) is a decision-making tool that accounts for multiple impacts across the life cycle of a product or service. This paper presents a conceptual framework to integrate human health impact assessment with risk screening approaches to extend LCA to include near-field chemical sources (e.g., those originating from consumer products and building materials) that have traditionally been excluded from LCA. A new generation of rapid human exposure modeling and high-throughput toxicity testing is transforming chemical risk prioritization and provides an opportunity for integration of screening-level risk assessment (RA) with LCA. The combined LCA and RA approach considers environmental impacts of products alongside risks to human health, which is consistent with regulatory frameworks addressing RA within a sustainability mindset. A case study is presented to juxtapose LCA and risk screening approaches for a chemical used in a consumer product. The case study demonstrates how these new risk screening tools can be used to inform toxicity impact estimates in LCA and highlights needs for future research. The framework provides a basis for developing tools and methods to support decision making on the use of chemicals in products.

Case studies putting the decision-making framework for the grouping and testing of nanomaterials (DF4nanoGrouping) into practice.

PubMed

Arts, Josje H E; Irfan, Muhammad-Adeel; Keene, Athena M; Kreiling, Reinhard; Lyon, Delina; Maier, Monika; Michel, Karin; Neubauer, Nicole; Petry, Thomas; Sauer, Ursula G; Warheit, David; Wiench, Karin; Wohlleben, Wendel; Landsiedel, Robert

2016-04-01

Case studies covering carbonaceous nanomaterials, metal oxide and metal sulphate nanomaterials, amorphous silica and organic pigments were performed to assess the Decision-making framework for the grouping and testing of nanomaterials (DF4nanoGrouping). The usefulness of the DF4nanoGrouping for nanomaterial hazard assessment was confirmed. In two tiers that rely exclusively on non-animal test methods followed by a third tier, if necessary, in which data from rat short-term inhalation studies are evaluated, nanomaterials are assigned to one of four main groups (MGs). The DF4nanoGrouping proved efficient in sorting out nanomaterials that could undergo hazard assessment without further testing. These are soluble nanomaterials (MG1) whose further hazard assessment should rely on read-across to the dissolved materials, high aspect-ratio nanomaterials (MG2) which could be assessed according to their potential fibre toxicity and passive nanomaterials (MG3) that only elicit effects under pulmonary overload conditions. Thereby, the DF4nanoGrouping allows identifying active nanomaterials (MG4) that merit in-depth investigations, and it provides a solid rationale for their sub-grouping to specify the further information needs. Finally, the evaluated case study materials may be used as source nanomaterials in future read-across applications. Overall, the DF4nanoGrouping is a hazard assessment strategy that strictly uses animals as a last resort. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Are sectioning and soldering of short-span implant-supported prostheses necessary procedures?

PubMed

Bianchini, Marco A; Souza, João G O; Souza, Dircilene C; Magini, Ricardo S; Benfatti, Cesar A M; Cardoso, Antonio C

2011-01-01

The aim of this study was to evaluate the fit between dental abutments and the metal framework of a 3-unit fixed prosthesis screwed to two implants to determine whether sectioning and soldering of the framework are in fact necessary procedures. The study was based on a model of a metal framework of a 3-unit prosthesis screwed to two implants. A total of 18 metal frameworks were constructed and divided into 3 groups: (1) NS group - each framework was cast in one piece and not sectioned; (2) CS group - the components of each sectioned framework were joined by conventional soldering; and (3) LW group - the components of each sectioned framework were joined by laser welding. The control group consisted of six silver-palladium alloy copings that were not cast together. Two analyses were mperformed: in the first analysis, the framework was screwed only to the first abutment, and in the second analysis, the framework was screwed to both abutments. The prosthetic fit was assessed at a single point using a measuring microscope (Measurescope, Nikon, Japan) and the marginal gap was measured in micrometers. Statistical analysis was performed using analysis of variance (ANOVA), Scheffe's test, Student's t-test, and Mann-Whitney U test. The NS group had larger marginal gaps than the other groups (p<0.01), while the CS and LW groups had a similar degree of misfit with no significant difference between them. The results revealed that, in the case of short-span 3-unit fixed prostheses, the framework should be sectioned and soldered or welded to prevent or reduce marginal gaps between the metal framework and dental abutments.

Correction for Guessing in the Framework of the 3PL Item Response Theory

ERIC Educational Resources Information Center

Chiu, Ting-Wei

2010-01-01

Guessing behavior is an important topic with regard to assessing proficiency on multiple choice tests, particularly for examinees at lower levels of proficiency due to greater the potential for systematic error or bias which that inflates observed test scores. Methods that incorporate a correction for guessing on high-stakes tests generally rely…

Does the Test Work? Evaluating a Web-Based Language Placement Test

ERIC Educational Resources Information Center

Long, Avizia Y.; Shin, Sun-Young; Geeslin, Kimberly; Willis, Erik W.

2018-01-01

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman's (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language…

Quantitative assessment of computational models for retinotopic map formation

PubMed Central

Sterratt, David C; Cutts, Catherine S; Willshaw, David J; Eglen, Stephen J

2014-01-01

ABSTRACT Molecular and activity‐based cues acting together are thought to guide retinal axons to their terminal sites in vertebrate optic tectum or superior colliculus (SC) to form an ordered map of connections. The details of mechanisms involved, and the degree to which they might interact, are still not well understood. We have developed a framework within which existing computational models can be assessed in an unbiased and quantitative manner against a set of experimental data curated from the mouse retinocollicular system. Our framework facilitates comparison between models, testing new models against known phenotypes and simulating new phenotypes in existing models. We have used this framework to assess four representative models that combine Eph/ephrin gradients and/or activity‐based mechanisms and competition. Two of the models were updated from their original form to fit into our framework. The models were tested against five different phenotypes: wild type, Isl2‐EphA3 ki/ki, Isl2‐EphA3 ki/+, ephrin‐A2,A3,A5 triple knock‐out (TKO), and Math5 −/− (Atoh7). Two models successfully reproduced the extent of the Math5 −/− anteromedial projection, but only one of those could account for the collapse point in Isl2‐EphA3 ki/+. The models needed a weak anteroposterior gradient in the SC to reproduce the residual order in the ephrin‐A2,A3,A5 TKO phenotype, suggesting either an incomplete knock‐out or the presence of another guidance molecule. Our article demonstrates the importance of testing retinotopic models against as full a range of phenotypes as possible, and we have made available MATLAB software, we wrote to facilitate this process. © 2014 Wiley Periodicals, Inc. Develop Neurobiol 75: 641–666, 2015 PMID:25367067

Using Electronic Portfolios for Second Language Assessment

ERIC Educational Resources Information Center

Cummins, Patricia W.; Davesne, Celine

2009-01-01

Portfolio assessment as developed in Europe presents a learner-empowering alternative to computer-based testing. The authors present the European Language Portfolio (ELP) and its American adaptations, LinguaFolio and the Global Language Portfolio, as tools to be used with the Common European Framework of Reference for languages and the American…

Assessing Place Location Knowledge Using a Virtual Globe

ERIC Educational Resources Information Center

Zhu, Liangfeng; Pan, Xin; Gao, Gongcheng

2016-01-01

Advances in the Google Earth virtual globe and the concomitant Keyhole Markup Language (KML) are providing educators with a convenient platform to cultivate and assess one's place location knowledge (PLK). This article presents a general framework and associated implementation methods for the online testing of PLK using Google Earth. The proposed…

Validity: Applying Current Concepts and Standards to Gynecologic Surgery Performance Assessments

ERIC Educational Resources Information Center

LeClaire, Edgar L.; Nihira, Mikio A.; Hardré, Patricia L.

2015-01-01

Validity is critical for meaningful assessment of surgical competency. According to the Standards for Educational and Psychological Testing, validation involves the integration of data from well-defined classifications of evidence. In the authoritative framework, data from all classifications support construct validity claims. The two aims of this…

Does social marketing provide a framework for changing healthcare practice?

PubMed

Morris, Zoë Slote; Clarkson, Peter John

2009-07-01

We argue that social marketing can be used as a generic framework for analysing barriers to the take-up of clinical guidelines, and planning interventions which seek to enable this change. We reviewed the literature on take-up of clinical guidelines, in particular barriers and enablers to change; social marketing principles and social marketing applied to healthcare. We then applied the social marketing framework to analyse the literature and to consider implications for future guideline policy to assess its feasibility and accessibility. There is sizeable extant literature on healthcare practitioners' non-compliance with clinical guidelines. This is an international problem common to a number of settings. The reasons for poor levels of take up appear to be well understood, but not addressed adequately in practice. Applying a social marketing framework brings new insights to the problem." We show that a social marketing framework provides a useful solution-focused framework for systematically understanding barriers to individual behaviour change and designing interventions accordingly. Whether the social marketing framework provides an effective means of bringing about behaviour change remains an empirical question which has still to be tested in practice. The analysis presented here provides strong motivation to begin such testing.

A Framework to Assess the Cumulative Hydrological Impacts of Dams on flow Regime

NASA Astrophysics Data System (ADS)

Wang, Y.; Wang, D.

2016-12-01

In this study we proposed a framework to assess the cumulative impact of dams on hydrological regime, and the impacts of the Three Gorges Dam on flow regime in Yangtze River were investigated with the framework. We reconstructed the unregulated flow series to compare with the regulated flow series in the same period. Eco-surplus and eco-deficit and the Indicators of Hydrologic Alteration parameters were used to examine the hydrological regime change. Among IHA parameters, Wilcoxon signed-rank test and Principal Components Analysis identified the representative indicators of hydrological alterations. Eco-surplus and eco-deficit showed that the reservoir also changed the seasonal regime of the flows in autumn and winter. Annual extreme flows and October flows changes lead to negative ecological implications downstream from the Three Gorges Dam. Ecological operation for the Three Gorges Dam is necessary to mitigate the negative effects on the river ecosystem in the middle reach of Yangtze River. The framework proposed here could be a robust method to assess the cumulative impacts of reservoir operation.

Carbon fibre versus metal framework in full-arch immediate loading rehabilitations of the maxilla - a cohort clinical study.

PubMed

Pera, F; Pesce, P; Solimano, F; Tealdo, T; Pera, P; Menini, M

2017-05-01

Frameworks made of carbon fibre-reinforced composites (CFRC) seem to be a viable alternative to traditional metal frameworks in implant prosthodontics. CFRC provide stiffness, rigidity and optimal biocompatibility. The aim of the present prospective study was to compare carbon fibre frameworks versus metal frameworks used to rigidly splint implants in full-arch immediate loading rehabilitations. Forty-two patients (test group) were rehabilitated with full-arch immediate loading rehabilitations of the upper jaw (total: 170 implants) following the Columbus Bridge Protocol with four to six implants with distal tilted implants. All patients were treated with resin screw-retained full-arch prostheses endowed with carbon fibre frameworks. The mean follow-up was 22 months (range: 18-24). Differences in the absolute change of bone resorption over time between the two implant sides (mesial and distal) were assessed performing a Mann-Whitney U-test. The outcomes were statistically compared with those of patients rehabilitated following the same protocol but using metal frameworks (control group: 34 patients with 163 implants - data reported in Tealdo, Menini, Bevilacqua, Pera, Pesce, Signori, Pera, Int J Prosthodont, 27, 2014, 207). Ten implants failed in the control group (6·1%); none failed in the test group (P = 0·002). A statistically significant difference in the absolute change of bone resorption around the implants was found between the two groups (P = 0·004), with greater mean peri-implant bone resorption in the control group (1 mm) compared to the test group (0·8 mm). Carbon fibre frameworks may be considered as a viable alternative to the metal ones and showed less marginal bone loss around implants and a greater implant survival rate during the observation period. © 2017 John Wiley & Sons Ltd.

Sustainable materials management using the Leaching Environmental Assessment Framework test methods

EPA Science Inventory

The need for improved leach tests became a priority due to adoption of more stringent air pollution control at U.S. coal-fired power plants resulting in the preferential partitioning of mercury (Hg) and other pollutants to fly ash and other air pollution control residues. Fly ash...

Leaching Environmental Assessment Framework to Evaluate Beneficial Use and Disposal Decisions

EPA Science Inventory

LEAF test methods are available for use to characterize the leaching potential over a range of conditions (i.e., pH, liquid-to-solid ratio, and waste form). LEAF characterization tests can be used to evaluate a range of materials to identify leaching behavior across a range of ...

Testing Requirements Discussion

DOT National Transportation Integrated Search

2015-03-12

Background : The Adjacent Band Compatibility assessment aims at developing a framework, to determine adjacent-band aggregate transmitter power limits for assumed new applications necessary for the protection of GPS and other space-based GNSS signals....

Developing a water market readiness assessment framework

NASA Astrophysics Data System (ADS)

Wheeler, Sarah Ann; Loch, Adam; Crase, Lin; Young, Mike; Grafton, R. Quentin

2017-09-01

Water markets are increasingly proposed as a demand-management strategy to deal with water scarcity. Water trading arrangements, on their own, are not about setting bio-physical limits to water-use. Nevertheless, water trading that mitigates scarcity constraints can assist regulators of water resources to keep water-use within limits at the lowest possible cost, and may reduce the cost of restoring water system health. While theoretically attractive, many practitioners have, at best, only a limited understanding of the practical usefulness of markets and how they might be most appropriately deployed. Using lessons learned from jurisdictions around the world where water markets have been implemented, this study attempts to fill the existing water market development gap and provide an initial framework (the water market readiness assessment (WMRA)) to describe the policy and administrative conditions/reforms necessary to enable governments/jurisdictions to develop water trading arrangements that are efficient, equitable and within sustainable limits. Our proposed framework consists of three key steps: 1) an assessment of hydrological and institutional needs; 2) a market evaluation, including assessment of development and implementation issues; and 3) the monitoring, continuous/review and assessment of future needs; with a variety of questions needing assessment at each stage. We apply the framework to three examples: regions in Australia, the United States and Spain. These applications indicate that WMRA can provide key information for water planners to consider on the usefulness of water trading processes to better manage water scarcity; but further practical applications and tests of the framework are required to fully evaluate its effectiveness.

Identifying Key Features of Student Performance in Educational Video Games and Simulations through Cluster Analysis

ERIC Educational Resources Information Center

Kerr, Deirdre; Chung, Gregory K. W. K.

2012-01-01

The assessment cycle of "evidence-centered design" (ECD) provides a framework for treating an educational video game or simulation as an assessment. One of the main steps in the assessment cycle of ECD is the identification of the key features of student performance. While this process is relatively simple for multiple choice tests, when…

A framework to assess landscape structural capacity to provide regulating ecosystem services in West Africa.

PubMed

Inkoom, Justice Nana; Frank, Susanne; Greve, Klaus; Fürst, Christine

2018-03-01

The Sudanian savanna landscapes of West Africa are amongst the world's most vulnerable areas to climate change impacts. Inappropriate land use and agriculture management practices continuously impede the capacity of agricultural landscapes to provide ecosystem services (ES). Given the absence of practical assessment techniques to evaluate the landscape's capacity to provide regulating ES in this region, the goal of this paper is to propose an integrative assessment framework which combines remote sensing, geographic information systems, expert weighting and landscape metrics-based assessment. We utilized Analytical Hierarchical Process and Likert scale for the expert weighting of landscape capacity. In total, 56 experts from several land use and landscape management related departments participated in the assessment. Further, we adapted the hemeroby concept to define areas of naturalness while landscape metrics including Patch Density, Shannon's Diversity, and Shape Index were utilized for structural assessment. Lastly, we tested the reliability of expert weighting using certainty measurement rated by experts themselves. Our study focused on four regulating ES including flood control, pest and disease control, climate control, and wind erosion control. Our assessment framework was tested on four selected sites in the Vea catchment area of Ghana. The outcome of our study revealed that highly heterogeneous landscapes have a higher capacity to provide pest and disease control, while less heterogeneous landscapes have a higher potential to provide climate control. Further, we could show that the potential capacities to provide ecosystem services are underestimated by 15% if landscape structural aspects assessed through landscape metrics are not considered. We conclude that the combination of adapted land use and an optimized land use pattern could contribute considerably to lower climate change impacts in West African agricultural landscapes. Copyright © 2017 Elsevier Ltd. All rights reserved.

DRUG EVALUATION AND DECISION MAKING IN CATALONIA: DEVELOPMENT AND VALIDATION OF A METHODOLOGICAL FRAMEWORK BASED ON MULTI-CRITERIA DECISION ANALYSIS (MCDA) FOR ORPHAN DRUGS.

PubMed

Gilabert-Perramon, Antoni; Torrent-Farnell, Josep; Catalan, Arancha; Prat, Alba; Fontanet, Manel; Puig-Peiró, Ruth; Merino-Montero, Sandra; Khoury, Hanane; Goetghebeur, Mireille M; Badia, Xavier

2017-01-01

The aim of this study was to adapt and assess the value of a Multi-Criteria Decision Analysis (MCDA) framework (EVIDEM) for the evaluation of Orphan drugs in Catalonia (Catalan Health Service). The standard evaluation and decision-making procedures of CatSalut were compared with the EVIDEM methodology and contents. The EVIDEM framework was adapted to the Catalan context, focusing on the evaluation of Orphan drugs (PASFTAC program), during a Workshop with sixteen PASFTAC members. The criteria weighting was done using two different techniques (nonhierarchical and hierarchical). Reliability was assessed by re-test. The EVIDEM framework and methodology was found useful and feasible for Orphan drugs evaluation and decision making in Catalonia. All the criteria considered for the development of the CatSalut Technical Reports and decision making were considered in the framework. Nevertheless, the framework could improve the reporting of some of these criteria (i.e., "unmet needs" or "nonmedical costs"). Some Contextual criteria were removed (i.e., "Mandate and scope of healthcare system", "Environmental impact") or adapted ("population priorities and access") for CatSalut purposes. Independently of the weighting technique considered, the most important evaluation criteria identified for orphan drugs were: "disease severity", "unmet needs" and "comparative effectiveness", while the "size of the population" had the lowest relevance for decision making. Test-retest analysis showed weight consistency among techniques, supporting reliability overtime. MCDA (EVIDEM framework) could be a useful tool to complement the current evaluation methods of CatSalut, contributing to standardization and pragmatism, providing a method to tackle ethical dilemmas and facilitating discussions related to decision making.

Probability judgments under ambiguity and conflict

PubMed Central

Smithson, Michael

2015-01-01

Whether conflict and ambiguity are distinct kinds of uncertainty remains an open question, as does their joint impact on judgments of overall uncertainty. This paper reviews recent advances in our understanding of human judgment and decision making when both ambiguity and conflict are present, and presents two types of testable models of judgments under conflict and ambiguity. The first type concerns estimate-pooling to arrive at “best” probability estimates. The second type is models of subjective assessments of conflict and ambiguity. These models are developed for dealing with both described and experienced information. A framework for testing these models in the described-information setting is presented, including a reanalysis of a multi-nation data-set to test best-estimate models, and a study of participants' assessments of conflict, ambiguity, and overall uncertainty reported by Smithson (2013). A framework for research in the experienced-information setting is then developed, that differs substantially from extant paradigms in the literature. This framework yields new models of “best” estimates and perceived conflict. The paper concludes with specific suggestions for future research on judgment and decision making under conflict and ambiguity. PMID:26042081

Probability judgments under ambiguity and conflict.

PubMed

Smithson, Michael

2015-01-01

Whether conflict and ambiguity are distinct kinds of uncertainty remains an open question, as does their joint impact on judgments of overall uncertainty. This paper reviews recent advances in our understanding of human judgment and decision making when both ambiguity and conflict are present, and presents two types of testable models of judgments under conflict and ambiguity. The first type concerns estimate-pooling to arrive at "best" probability estimates. The second type is models of subjective assessments of conflict and ambiguity. These models are developed for dealing with both described and experienced information. A framework for testing these models in the described-information setting is presented, including a reanalysis of a multi-nation data-set to test best-estimate models, and a study of participants' assessments of conflict, ambiguity, and overall uncertainty reported by Smithson (2013). A framework for research in the experienced-information setting is then developed, that differs substantially from extant paradigms in the literature. This framework yields new models of "best" estimates and perceived conflict. The paper concludes with specific suggestions for future research on judgment and decision making under conflict and ambiguity.

Development of an Interdisciplinary Team Communication Framework and Quality Metrics for Home-Based Medical Care Practices.

PubMed

Fathi, Roya; Sheehan, Orla C; Garrigues, Sarah K; Saliba, Debra; Leff, Bruce; Ritchie, Christine S

2016-08-01

The unique needs of homebound adults receiving home-based medical care (HBMC) (ie, home-based primary care and home-based palliative care services) are ideally provided by interdisciplinary care teams (IDTs) that provide coordinated care. The composition of team members from an array of organizations and the unique dimension of providing care in the home present specific challenges to timely access and communication of patient care information. The objective of this work was to develop a conceptual framework and corresponding quality indicators (QIs) that assess how IDT members for HBMC practices access and communicate key patient information with each other. A systematic review of peer-reviewed and gray literature was performed to inform a framework for care coordination in the home and the development of candidate QIs to assess processes by which all IDT members optimally access and use patient information. A technical expert panel (TEP) participated in a modified Delphi process to assess the validity and feasibility of each QI and to identify which would be most suitable for testing in the field. Thematic analysis of literature revealed 4 process themes for how HBMC practices might engage in high-quality care coordination: using electronic medical records, conducting interdisciplinary team meetings, sharing standardized patient assessments, and communicating via secure e-messaging. Based on these themes, 9 candidate QIs were developed to reflect these processes. Three candidate QIs were assessed by the TEP as valid and feasible to measure in an HBMC practice setting. These indicators focused on use of IDT meetings, standardized patient assessments, and secure e-messaging. Translating the complex issue of care coordination into QIs will improve care delivered to vulnerable home-limited adults who receive HBMC. Guided by the literature, we developed a framework to reflect optimal care coordination in the home setting and identified 3 candidate QIs to field-test in HBMC practices. Published by Elsevier Inc.

Earthquake Early Warning ShakeAlert System: Testing and certification platform

USGS Publications Warehouse

Cochran, Elizabeth S.; Kohler, Monica D.; Given, Douglas; Guiwits, Stephen; Andrews, Jennifer; Meier, Men-Andrin; Ahmad, Mohammad; Henson, Ivan; Hartog, Renate; Smith, Deborah

2017-01-01

Earthquake early warning systems provide warnings to end users of incoming moderate to strong ground shaking from earthquakes. An earthquake early warning system, ShakeAlert, is providing alerts to beta end users in the western United States, specifically California, Oregon, and Washington. An essential aspect of the earthquake early warning system is the development of a framework to test modifications to code to ensure functionality and assess performance. In 2016, a Testing and Certification Platform (TCP) was included in the development of the Production Prototype version of ShakeAlert. The purpose of the TCP is to evaluate the robustness of candidate code that is proposed for deployment on ShakeAlert Production Prototype servers. TCP consists of two main components: a real‐time in situ test that replicates the real‐time production system and an offline playback system to replay test suites. The real‐time tests of system performance assess code optimization and stability. The offline tests comprise a stress test of candidate code to assess if the code is production ready. The test suite includes over 120 events including local, regional, and teleseismic historic earthquakes, recentering and calibration events, and other anomalous and potentially problematic signals. Two assessments of alert performance are conducted. First, point‐source assessments are undertaken to compare magnitude, epicentral location, and origin time with the Advanced National Seismic System Comprehensive Catalog, as well as to evaluate alert latency. Second, we describe assessment of the quality of ground‐motion predictions at end‐user sites by comparing predicted shaking intensities to ShakeMaps for historic events and implement a threshold‐based approach that assesses how often end users initiate the appropriate action, based on their ground‐shaking threshold. TCP has been developed to be a convenient streamlined procedure for objectively testing algorithms, and it has been designed with flexibility to accommodate significant changes in development of new or modified system code. It is expected that the TCP will continue to evolve along with the ShakeAlert system, and the framework we describe here provides one example of how earthquake early warning systems can be evaluated.

The eClinical Care Pathway Framework: a novel structure for creation of online complex clinical care pathways and its application in the management of sexually transmitted infections.

PubMed

Gibbs, Jo; Sutcliffe, Lorna J; Gkatzidou, Voula; Hone, Kate; Ashcroft, Richard E; Harding-Esch, Emma M; Lowndes, Catherine M; Sadiq, S Tariq; Sonnenberg, Pam; Estcourt, Claudia S

2016-07-22

Despite considerable international eHealth impetus, there is no guidance on the development of online clinical care pathways. Advances in diagnostics now enable self-testing with home diagnosis, to which comprehensive online clinical care could be linked, facilitating completely self-directed, remote care. We describe a new framework for developing complex online clinical care pathways and its application to clinical management of people with genital chlamydia infection, the commonest sexually transmitted infection (STI) in England. Using the existing evidence-base, guidelines and examples from contemporary clinical practice, we developed the eClinical Care Pathway Framework, a nine-step iterative process. Step 1: define the aims of the online pathway; Step 2: define the functional units; Step 3: draft the clinical consultation; Step 4: expert review; Step 5: cognitive testing; Step 6: user-centred interface testing; Step 7: specification development; Step 8: software testing, usability testing and further comprehension testing; Step 9: piloting. We then applied the Framework to create a chlamydia online clinical care pathway (Online Chlamydia Pathway). Use of the Framework elucidated content and structure of the care pathway and identified the need for significant changes in sequences of care (Traditional: history, diagnosis, information versus Online: diagnosis, information, history) and prescribing safety assessment. The Framework met the needs of complex STI management and enabled development of a multi-faceted, fully-automated consultation. The Framework provides a comprehensive structure on which complex online care pathways such as those needed for STI management, which involve clinical services, public health surveillance functions and third party (sexual partner) management, can be developed to meet national clinical and public health standards. The Online Chlamydia Pathway's standardised method of collecting data on demographics and sexual behaviour, with potential for interoperability with surveillance systems, could be a powerful tool for public health and clinical management.

Damage Tolerance of Composites

NASA Technical Reports Server (NTRS)

Hodge, Andy

2007-01-01

Fracture control requirements have been developed to address damage tolerance of composites for manned space flight hardware. The requirements provide the framework for critical and noncritical hardware assessment and testing. The need for damage threat assessments, impact damage protection plans, and nondestructive evaluation are also addressed. Hardware intended to be damage tolerant have extensive coupon, sub-element, and full-scale testing requirements in-line with the Building Block Approach concept from the MIL-HDBK-17, Department of Defense Composite Materials Handbook.

Implementation of the Leaching Environmental Assessment ...

EPA Pesticide Factsheets

New leaching tests are available in the U.S. for developing more accurate source terms for use in fate and transport models. For beneficial use or disposal, the use of the leaching environmental assessment framework (LEAF) will provide leaching results that reflect field conditions reflecting either use of disposal of the material or waste. To provide overview of the implementation of new leaching tests for presentation at the MEGA symposium which is for the coal-fired power industry

Assessing Literacy: The Framework for the National Adult Literacy Survey.

ERIC Educational Resources Information Center

Campbell, Anne; And Others

To satisfy federal requirements, the National Center for Education Statistics and the Division of Adult Education and Literacy planned a nationally representative household sample survey to assess the literacy skills of the adult population of the United States, to be conducted by the Educational Testing Service with the assistance of Westat, Inc.…

Diagnostic Efficiency of easyCBM[R] Math: Oregon. Technical Report #1009

ERIC Educational Resources Information Center

Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

The easyCBM[R] assessment system is an online benchmark and progress monitoring assessment system designed for use within a response to intervention framework. Educators using easyCBM[R] are often interested in using the results to predict students' state test performance. In the following technical document, we report diagnostic efficiency…

National Testing of Pupils in Europe: Objectives, Organisation and Use of Results. Greece 2009

ERIC Educational Resources Information Center

Eurydice, 2009

2009-01-01

Pupil assessment procedures and methods in Greece are set and "standardized" externally by the central authorities as defined in the legislative framework, the National Curriculum guidelines and teachers' manuals, while implementation is internal to the schools. The focus of primary schools is on formative assessment, while the lower…

A tiered, integrated biological and chemical monitoring framework for contaminants of emerging concern in aquatic ecosystems.

PubMed

Maruya, Keith A; Dodder, Nathan G; Mehinto, Alvine C; Denslow, Nancy D; Schlenk, Daniel; Snyder, Shane A; Weisberg, Stephen B

2016-07-01

The chemical-specific risk-based paradigm that informs monitoring and assessment of environmental contaminants does not apply well to the many thousands of new chemicals that are being introduced into ambient receiving waters. We propose a tiered framework that incorporates bioanalytical screening tools and diagnostic nontargeted chemical analysis to more effectively monitor for contaminants of emerging concern (CECs). The framework is based on a comprehensive battery of in vitro bioassays to first screen for a broad spectrum of CECs and nontargeted analytical methods to identify bioactive contaminants missed by the currently favored targeted analyses. Water quality managers in California have embraced this strategy with plans to further develop and test this framework in regional and statewide pilot studies on waterbodies that receive discharge from municipal wastewater treatment plants and stormwater runoff. In addition to directly informing decisions, the data obtained using this framework can be used to construct and validate models that better predict CEC occurrence and toxicity. The adaptive interplay among screening results, diagnostic assessment and predictive modeling will allow managers to make decisions based on the most current and relevant information, instead of extrapolating from parameters with questionable linkage to CEC impacts. Integr Environ Assess Manag 2016;12:540-547. © 2015 SETAC. © 2015 SETAC.

Advancing the Adverse Outcome Pathway Framework - an ...

EPA Pesticide Factsheets

The ability of scientists to conduct whole organism toxicity tests to understand chemical safety has been significantly outpaced by the rapid synthesis of new chemicals. Therefore, to increase efficiencies in chemical risk assessment, scientists are turning to mechanistic-based studies, making greater use of in vitro and in silico methods, to screen for potential environmental and human health hazards. A framework that has gained traction for capturing available knowledge describing the linkage between mechanistic data and apical toxicity endpoints, required for regulatory assessments, is the adverse outcome pathway (AOP). A number of international activities have focused on AOP development and plausible applications to regulatory decision-making. These interactions have prompted dialog between research scientists and regulatory communities to consider how best to use the AOP framework in risk assessment. While expert-facilitated discussions have been instrumental in moving the science of AOPs forward, it was recognized that a survey of the broader scientific community would aid in identifying shortcomings and guiding future initiatives for the AOP framework. To that end, a ?‘Horizon Scanning’ exercise was conducted to solicit questions from the global scientific and regulatory communities concerning the challenges or limitations that must be addressed to realize the full potential of the AOP framework in research and regulatory decision making. The m

Current limitations and recommendations to improve testing ...

EPA Pesticide Factsheets

In this paper existing regulatory frameworks and test systems for assessing potential endocrine-active chemicals are described, and associated challenges discussed, along with proposed approaches to address these challenges. Regulatory frameworks vary somewhat across organizations, but all basically evaluate whether a chemical possesses endocrine activity and whether this activity can result in adverse outcomes either to humans or the environment. Current test systems include in silico, in vitro and in vivo techniques focused on detecting potential endocrine activity, and in vivo tests that collect apical data to detect possible adverse effects. These test systems are currently designed to robustly assess endocrine activity and/or adverse effects in the estrogen, androgen, and thyroid hormonal pathways; however, there are some limitations of current test systems for evaluating endocrine hazard and risk. These limitations include a lack of certainty regarding: 1)adequately sensitive species and life-stages, 2) mechanistic endpoints that are diagnostic for endocrine pathways of concern, and 3) the linkage between mechanistic responses and apical, adverse outcomes. Furthermore, some existing test methods are resource intensive in regard to time, cost, and use of animals. However, based on recent experiences, there are opportunities to improve approaches to, and guidance for existing test methods, and to reduce uncertainty. For example, in vitro high throughput

Development and testing of a new framework for rapidly assessing legal and managerial protection afforded by marine protected areas: Mediterranean Sea case study.

PubMed

Rodríguez-Rodríguez, D; Rodríguez, J; Abdul Malak, D

2016-02-01

The Convention on Biological Diversity (CBD) states the need to effectively conserve at least 10% of coastal and marine areas of particular importance for biodiversity by 2020. Here, a new indicator-based methodological framework to assess biodiversity protection afforded by marine protected areas' (MPA) was developed as a quick surrogate for MPAs' potential conservation effectiveness: the Marine Protected Area Protection Assessment Framework (MaPAF). The MaPAF consists of a limited number of headline indicators that are integrated in two indexes: Legal protection and Management effort, which eventually integrate in the overall MPA Protection super-index. The MaPAF was then tested in the Mediterranean MPA network as a case study. Spatial analyses were performed at three meaningful scales: the whole Mediterranean Sea, Mediterranean ecoregions and countries. The results of this study suggest that: 1) The MaPAF can serve as a useful tool for consistent, adaptive, quick and cost-effective MPA effectiveness assessments of MPAs and MPA networks in virtually any marine region, as the headline indicators used are commonly compiled and easy to retrieve; 2) The MaPAF proved usable and potentially relevant in the Mediterranean Sea where most indicators in the framework can be publicly accessed through the MAPAMED database and are planned to be regularly updated; 3) Protection afforded by MPAs is low across the whole Mediterranean, with only few MPAs having relatively high legal and managerial protection; and 4) Most Mediterranean countries need to devote substantially more work to improve MPA effectiveness mainly through increased management effort. Copyright © 2015 Elsevier Ltd. All rights reserved.

Methods, procedures, and contextual characteristics of health technology assessment and health policy decision making: comparison of health technology assessment agencies in Germany, United Kingdom, France, and Sweden.

PubMed

Schwarzer, Ruth; Siebert, Uwe

2009-07-01

The objectives of this study were (i) to develop a systematic framework for describing and comparing different features of health technology assessment (HTA) agencies, (ii) to identify and describe similarities and differences between the agencies, and (iii) to draw conclusions both for producers and users of HTA in research, policy, and practice. We performed a systematic literature search, added information from HTA agencies, and developed a conceptual framework comprising eight main domains: organization, scope, processes, methods, dissemination, decision, implementation, and impact. We grouped relevant items of these domains in an evidence table and chose five HTA agencies to test our framework: DAHTA@DIMDI, HAS, IQWiG, NICE, and SBU. Item and domain similarity was assessed using the percentage of identical characteristics in pairwise comparisons across agencies. RESULTS were interpreted across agencies by demonstrating similarities and differences. Based on 306 included documents, we identified 90 characteristics of eight main domains appropriate for our framework. After applying the framework to the five agencies, we were able to show 40 percent similarities in "dissemination," 38 percent in "scope," 35 percent in "organization," 29 percent in "methods," 26 percent in "processes," 23 percent in "impact," 19 percent in "decision," and 17 percent in "implementation." We found considerably more differences than similarities of HTA features across agencies and countries. Our framework and comparison provides insights and clarification into the need for harmonization. Our findings could serve as descriptive database facilitating communication between producers and users.

Effects of an Intervention on Math Achievement for Students with Learning Disabilities

ERIC Educational Resources Information Center

Kitchens, Vivian D.

2012-01-01

Students with learning disabilities score lower than other at-risk groups on state standardized assessment tests. Educators are searching for intervention strategies to improve math achievement for students with learning disabilities. Using the theoretical framework of behaviorism, the purpose of this quantitative one group pre post test design…

Incorporating New Technologies Into Toxicity Testing and Risk Assessment: Moving From 21st Century Vision to a Data-Driven Framework

PubMed Central

Thomas, Russell S.

2013-01-01

Based on existing data and previous work, a series of studies is proposed as a basis toward a pragmatic early step in transforming toxicity testing. These studies were assembled into a data-driven framework that invokes successive tiers of testing with margin of exposure (MOE) as the primary metric. The first tier of the framework integrates data from high-throughput in vitro assays, in vitro-to-in vivo extrapolation (IVIVE) pharmacokinetic modeling, and exposure modeling. The in vitro assays are used to separate chemicals based on their relative selectivity in interacting with biological targets and identify the concentration at which these interactions occur. The IVIVE modeling converts in vitro concentrations into external dose for calculation of the point of departure (POD) and comparisons to human exposure estimates to yield a MOE. The second tier involves short-term in vivo studies, expanded pharmacokinetic evaluations, and refined human exposure estimates. The results from the second tier studies provide more accurate estimates of the POD and the MOE. The third tier contains the traditional animal studies currently used to assess chemical safety. In each tier, the POD for selective chemicals is based primarily on endpoints associated with a proposed mode of action, whereas the POD for nonselective chemicals is based on potential biological perturbation. Based on the MOE, a significant percentage of chemicals evaluated in the first 2 tiers could be eliminated from further testing. The framework provides a risk-based and animal-sparing approach to evaluate chemical safety, drawing broadly from previous experience but incorporating technological advances to increase efficiency. PMID:23958734

Prospective Environmental Risk Assessment for Sediment-Bound Organic Chemicals: A Proposal for Tiered Effect Assessment.

PubMed

Diepens, Noël J; Koelmans, Albert A; Baveco, Hans; van den Brink, Paul J; van den Heuvel-Greve, Martine J; Brock, Theo C M

A broadly accepted framework for prospective environmental risk assessment (ERA) of sediment-bound organic chemicals is currently lacking. Such a framework requires clear protection goals, evidence-based concepts that link exposure to effects and a transparent tiered-effect assessment. In this paper, we provide a tiered prospective sediment ERA procedure for organic chemicals in sediment, with a focus on the applicable European regulations and the underlying data requirements. Using the ecosystem services concept, we derived specific protection goals for ecosystem service providing units: microorganisms, benthic algae, sediment-rooted macrophytes, benthic invertebrates and benthic vertebrates. Triggers for sediment toxicity testing are discussed.We recommend a tiered approach (Tier 0 through Tier 3). Tier-0 is a cost-effective screening based on chronic water-exposure toxicity data for pelagic species and equilibrium partitioning. Tier-1 is based on spiked sediment laboratory toxicity tests with standard benthic test species and standardised test methods. If comparable chronic toxicity data for both standard and additional benthic test species are available, the Species Sensitivity Distribution (SSD) approach is a more viable Tier-2 option than the geometric mean approach. This paper includes criteria for accepting results of sediment-spiked single species toxicity tests in prospective ERA, and for the application of the SSD approach. We propose micro/mesocosm experiments with spiked sediment, to study colonisation success by benthic organisms, as a Tier-3 option. Ecological effect models can be used to supplement the experimental tiers. A strategy for unifying information from various tiers by experimental work and exposure-and effect modelling is provided.

Validation of the theoretical domains framework for use in behaviour change and implementation research

PubMed Central

2012-01-01

Background An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework. Methods Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis. Results There was good support for a refinement of the framework comprising 14 domains of theoretical constructs (average silhouette value 0.29): ‘Knowledge’, ‘Skills’, ‘Social/Professional Role and Identity’, ‘Beliefs about Capabilities’, ‘Optimism’, ‘Beliefs about Consequences’, ‘Reinforcement’, ‘Intentions’, ‘Goals’, ‘Memory, Attention and Decision Processes’, ‘Environmental Context and Resources’, ‘Social Influences’, ‘Emotions’, and ‘Behavioural Regulation’. Conclusions The refined Theoretical Domains Framework has a strengthened empirical base and provides a method for theoretically assessing implementation problems, as well as professional and other health-related behaviours as a basis for intervention development. PMID:22530986

Comparative analysis on the selection of number of clusters in community detection

NASA Astrophysics Data System (ADS)

Kawamoto, Tatsuro; Kabashima, Yoshiyuki

2018-02-01

We conduct a comparative analysis on various estimates of the number of clusters in community detection. An exhaustive comparison requires testing of all possible combinations of frameworks, algorithms, and assessment criteria. In this paper we focus on the framework based on a stochastic block model, and investigate the performance of greedy algorithms, statistical inference, and spectral methods. For the assessment criteria, we consider modularity, map equation, Bethe free energy, prediction errors, and isolated eigenvalues. From the analysis, the tendency of overfit and underfit that the assessment criteria and algorithms have becomes apparent. In addition, we propose that the alluvial diagram is a suitable tool to visualize statistical inference results and can be useful to determine the number of clusters.

CMAQ Model Evaluation Framework

EPA Pesticide Factsheets

CMAQ is tested to establish the modeling system’s credibility in predicting pollutants such as ozone and particulate matter. Evaluation of CMAQ has been designed to assess the model’s performance for specific time periods and for specific uses.

Evaluation of the scientific underpinnings for identifying ...

EPA Pesticide Factsheets

A major challenge in chemical risk assessment is extrapolation of toxicity data from tested to untested species. Successful cross-species extrapolation involves understanding similarities and differences in toxicokinetic and toxicodynamic processes among species. Herein we consider the toxicodynamic challenge, and propose a hierarchal framework, based on the adverse outcome pathway (AOP) concept, to transparently and systematically assess cross-species conservation of biological pathways that could be perturbed by toxic chemicals. The approach features consideration of computational, in vitro and in vivo evidence to assess molecular initiating and intermediate key events of an AOP in a systematic, comparative manner. To demonstrate practical application of the framework, we consider an assessment question arising from the legislatively-mandated USEPA endocrine disruptor screening program, which involves the degree to which data generated using mammalian systems can be translated to non-mammalian species. Specifically, there is a need to define cross-species conservation of pathways controlled by activation of estrogen receptor-á (ERá), as a basis for using mammalian (primarily human) high-throughput (HTP) in vitro data to prioritize subsequent testing to assess human health and ecological risks of estrogenic chemicals. The initial phase of our analysis revealed good structural conservation the ERá across vertebrate species in terms of amino acid sequence

Is the tier-1 effect assessment for herbicides protective for aquatic algae and vascular plant communities?

PubMed

van Wijngaarden, René P A; Arts, Gertie H P

2018-01-01

In the aquatic tier-1 effect assessment for plant protection products with an herbicidal mode of action in Europe, it is usually algae and/or vascular plants that determine the environmental risks. This tier includes tests with at least 2 algae and 1 macrophyte (Lemna). Although such tests are considered to be of a chronic nature (based on the duration of the test in relation to the life cycle of the organism), the measurement endpoints derived from the laboratory tests with plants (including algae) and used in the first-tier effect assessment for herbicides are acute effect concentrations affecting 50% of the test organisms (EC50 values) and not no-observed-effect concentrations (NOECs) or effect concentrations affecting 10% of the test organisms (EC10) values. Other European legislative frameworks (e.g., the Water Framework Directive) use EC10 values. The present study contributes to a validation of the tiered herbicide risk assessment approach by comparing the standard first-tier effect assessment with results of microcosm and mesocosm studies. We evaluated EC50 and EC10 values for standard test algae and macrophytes based on either the growth rate endpoint (E r C50) or the lowest available endpoint for growth rate or biomass/yield (E r /E y C50). These values were compared with the regulatory acceptable concentrations for the threshold option as derived from microcosm and mesocosm studies. For these studies, protection is maintained if growth rate is taken as the regulatory endpoint instead of the lowest value of either growth rate or biomass/yield in conjunction with the standard assessment factor of 10. Based on a limited data set of 14 herbicides, we did not identify a need to change the current practice. Environ Toxicol Chem 2018;37:175-183. © 2017 SETAC. © 2017 SETAC.

Assessing the capacity of ministries of health to use research in decision-making: conceptual framework and tool.

PubMed

Rodríguez, Daniela C; Hoe, Connie; Dale, Elina M; Rahman, M Hafizur; Akhter, Sadika; Hafeez, Assad; Irava, Wayne; Rajbangshi, Preety; Roman, Tamlyn; Ţîrdea, Marcela; Yamout, Rouham; Peters, David H

2017-08-01

The capacity to demand and use research is critical for governments if they are to develop policies that are informed by evidence. Existing tools designed to assess how government officials use evidence in decision-making have significant limitations for low- and middle-income countries (LMICs); they are rarely tested in LMICs and focus only on individual capacity. This paper introduces an instrument that was developed to assess Ministry of Health (MoH) capacity to demand and use research evidence for decision-making, which was tested for reliability and validity in eight LMICs (Bangladesh, Fiji, India, Lebanon, Moldova, Pakistan, South Africa, Zambia). Instrument development was based on a new conceptual framework that addresses individual, organisational and systems capacities, and items were drawn from existing instruments and a literature review. After initial item development and pre-testing to address face validity and item phrasing, the instrument was reduced to 54 items for further validation and item reduction. In-country study teams interviewed a systematic sample of 203 MoH officials. Exploratory factor analysis was used in addition to standard reliability and validity measures to further assess the items. Thirty items divided between two factors representing organisational and individual capacity constructs were identified. South Africa and Zambia demonstrated the highest level of organisational capacity to use research, whereas Pakistan and Bangladesh were the lowest two. In contrast, individual capacity was highest in Pakistan, followed by South Africa, whereas Bangladesh and Lebanon were the lowest. The framework and related instrument represent a new opportunity for MoHs to identify ways to understand and improve capacities to incorporate research evidence in decision-making, as well as to provide a basis for tracking change.

Self-Reported Pediatric Measures of Physical Activity, Sedentary Behavior and Strength Impact for PROMIS®: Conceptual Framework

PubMed Central

Tucker, Carole A.; Bevans, Katherine B.; Teneralli, Rachel E.; Smith, Ashley Wilder; Bowles, Heather R; Forrest, Christopher B.

2014-01-01

Purpose Children's physical activity (PA) levels are commonly assessed in pediatric clinical research, but rigorous self-report assessment tools for children are scarce, and computer adaptive test implementations are rare. Our objective was to improve pediatric self-report measures of activity using semi-structured interviews with experts and children for conceptualization of a child-informed framework. Methods Semi-structured interviews were conducted to conceptualize physical activity, sedentary behaviors, and strengthening activities. We performed systematic literature reviews to identify item-level concepts used to assess these 3 domains. Results We developed conceptual frameworks for each domain using words and phrases identified by children as relevant. Conclusions Semi-structured interview methods provide valuable information of children's perspectives and the ways children recall previous activities. Conceptualized domains of physical activity are based on the literature and expert views that also reflect children's experiences and understanding providing a basis for pediatric self-report instruments. PMID:25251789

A structured framework improves clinical patient assessment and nontechnical skills of early career emergency nurses: a pre-post study using full immersion simulation.

PubMed

Munroe, Belinda; Curtis, Kate; Murphy, Margaret; Strachan, Luke; Considine, Julie; Hardy, Jennifer; Wilson, Mark; Ruperto, Kate; Fethney, Judith; Buckley, Thomas

2016-08-01

The aim of this study was to evaluate the effect of the new evidence-informed nursing assessment framework HIRAID (History, Identify Red flags, Assessment, Interventions, Diagnostics, reassessment and communication) on the quality of patient assessment and fundamental nontechnical skills including communication, decision making, task management and situational awareness. Assessment is a core component of nursing practice and underpins clinical decisions and the safe delivery of patient care. Yet there is no universal or validated system used to teach emergency nurses how to comprehensively assess and care for patients. A pre-post design was used. The performance of thirty eight emergency nurses from five Australian hospitals was evaluated before and after undertaking education in the application of the HIRAID assessment framework. Video recordings of participant performance in immersive simulations of common presentations to the emergency department were evaluated, as well as participant documentation during the simulations. Paired parametric and nonparametric tests were used to compare changes from pre to postintervention. From pre to postintervention, participant performance increases were observed in the percentage of patient history elements collected, critical indicators of urgency collected and reported to medical officers, and patient reassessments performed. Participants also demonstrated improvement in each of the four nontechnical skills categories: communication, decision making, task management and situational awareness. The HIRAID assessment framework improves clinical patient assessments performed by emergency nurses and has the potential to enhance patient care. HIRAID should be considered for integration into clinical practice to provide nurses with a systematic approach to patient assessment and potentially improve the delivery of safe patient care. © 2016 John Wiley & Sons Ltd.

Automatic information timeliness assessment of diabetes web sites by evidence based medicine.

PubMed

Sağlam, Rahime Belen; Taşkaya Temizel, Tuğba

2014-11-01

Studies on health domain have shown that health websites provide imperfect information and give recommendations which are not up to date with the recent literature even when their last modified dates are quite recent. In this paper, we propose a framework which assesses the timeliness of the content of health websites automatically by evidence based medicine. Our aim is to assess the accordance of website contents with the current literature and information timeliness disregarding the update time stated on the websites. The proposed method is based on automatic term recognition, relevance feedback and information retrieval techniques in order to generate time-aware structured queries. We tested the framework on diabetes health web sites which were archived between 2006 and 2013 by Archive-it using American Diabetes Association's (ADA) guidelines. The results showed that the proposed framework achieves 65% and 77% accuracy in detecting the timeliness of the web content according to years and pre-determined time intervals respectively. Information seekers and web site owners may benefit from the proposed framework in finding relevant and up-to-date diabetes web sites. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Assessing the Development of Educational Research Literacy: The Effect of Courses on Research Methods in Studies of Educational Science

ERIC Educational Resources Information Center

Groß Ophoff, Jana; Schladitz, Sandra; Leuders, Juliane; Leuders, Timo; Wirtz, Markus A.

2015-01-01

The ability to purposefully access, reflect, and use evidence from educational research (Educational Research Literacy) is expected of future professionals in educational practice. Based on the presented conceptual framework, a test instrument was developed to assess the different competency aspects: Information Literacy, Statistical Literacy, and…

Assessments Used to Diagnose Developmental Coordination Disorder: Do Their Underlying Constructs Match the Diagnostic Criteria?

ERIC Educational Resources Information Center

Darsaklis, Vasiliki; Snider, Laurie M.; Majnemer, Annette; Mazer, Barbara

2013-01-01

This study examined the constructs underlying the Movement Assessment Battery for Children-2 (M-ABC-2), Bruninks-Oseretsky Test of Motor Proficiency (BOTMP) and Vineland Adaptive Behavior Scale-2 (VABS-2) using the framework of the International Classification of Functioning Disability and Health--Child Youth version (ICF-CY) and the diagnostic…

Large-Scale Investigation of the Role of Trait Activation Theory for Understanding Assessment Center Convergent and Discriminant Validity

ERIC Educational Resources Information Center

Lievens, Filip; Chasteen, Christopher S.; Day, Eric Anthony; Christiansen, Neil D.

2006-01-01

This study used trait activation theory as a theoretical framework to conduct a large-scale test of the interactionist explanation of the convergent and discriminant validity findings obtained in assessment centers. Trait activation theory specifies the conditions in which cross-situationally consistent and inconsistent candidate performances are…

Cognitive Readiness Assessment and Reporting: An Open Source Mobile Framework for Operational Decision Support and Performance Improvement

ERIC Educational Resources Information Center

Heric, Matthew; Carter, Jenn

2011-01-01

Cognitive readiness (CR) and performance for operational time-critical environments are continuing points of focus for military and academic communities. In response to this need, we designed an open source interactive CR assessment application as a highly adaptive and efficient open source testing administration and analysis tool. It is capable…

Evaluating Frameworks That Provide Value Measures for Health Care Interventions.

PubMed

Mandelblatt, Jeanne S; Ramsey, Scott D; Lieu, Tracy A; Phelps, Charles E

2017-02-01

The recent acceleration of scientific discovery has led to greater choices in health care. New technologies, diagnostic tests, and pharmaceuticals have widely varying impact on patients and populations in terms of benefits, toxicities, and costs, stimulating a resurgence of interest in the creation of frameworks intended to measure value in health. Many of these are offered by providers and/or advocacy organizations with expertise and interest in specific diseases (e.g., cancer and heart disease). To help assess the utility of and the potential biases embedded in these frameworks, we created an evaluation taxonomy with seven basic components: 1) define the purpose; 2) detail the conceptual approach, including perspectives, methods for obtaining preferences of decision makers (e.g., patients), and ability to incorporate multiple dimensions of value; 3) discuss inclusions and exclusions of elements included in the framework, and whether the framework assumes clinical intervention or offers alternatives such as palliative care or watchful waiting; 4) evaluate data sources and their scientific validity; 5) assess the intervention's effect on total costs of treating a defined population; 6) analyze how uncertainty is incorporated; and 7) illuminate possible conflicts of interest among those creating the framework. We apply the taxonomy to four representative value frameworks recently published by professional organizations focused on treatment of cancer and heart disease and on vaccine use. We conclude that each of these efforts has strengths and weaknesses when evaluated using our taxonomy, and suggest pathways to enhance the utility of value-assessing frameworks for policy and clinical decision making. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Next Generation of Leaching Tests

EPA Science Inventory

A corresponding abstract has been cleared for this presentation. The four methods comprising the Leaching Environmental Assessment Framework are described along with the tools to support implementation of the more rigorous and accurate source terms that are developed using LEAF ...

Determining open cluster membership. A Bayesian framework for quantitative member classification

NASA Astrophysics Data System (ADS)

Stott, Jonathan J.

2018-01-01

Aims: My goal is to develop a quantitative algorithm for assessing open cluster membership probabilities. The algorithm is designed to work with single-epoch observations. In its simplest form, only one set of program images and one set of reference images are required. Methods: The algorithm is based on a two-stage joint astrometric and photometric assessment of cluster membership probabilities. The probabilities were computed within a Bayesian framework using any available prior information. Where possible, the algorithm emphasizes simplicity over mathematical sophistication. Results: The algorithm was implemented and tested against three observational fields using published survey data. M 67 and NGC 654 were selected as cluster examples while a third, cluster-free, field was used for the final test data set. The algorithm shows good quantitative agreement with the existing surveys and has a false-positive rate significantly lower than the astrometric or photometric methods used individually.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Efroymson, Rebecca Ann; Peterson, Mark J; Jones, Daniel Steven

An ecological risk assessment was conducted at Yuma Proving Ground, Arizona, as a demonstration of the Military Ecological Risk Assessment Framework (MERAF). The focus of the assessment was a testing program at Cibola Range, which involved an Apache Longbow helicopter firing Hellfire missiles at moving targets, i.e., M60-A1 tanks. The problem formulation for the assessment included conceptual models for three component activities of the test, helicopter overflight, missile firing, and tracked vehicle movement, and two ecological endpoint entities, woody desert wash communities and desert mule deer (Odocoileus hemionus crooki) populations. An activity-specific risk assessment framework was available to provide guidancemore » for assessing risks associated with aircraft overflights. Key environmental features of the study area include barren desert pavement and tree-lined desert washes. The primary stressors associated with helicopter overflights were sound and the view of the aircraft. The primary stressor associated with Hellfire missile firing was sound. The principal stressor associated with tracked vehicle movement was soil disturbance, and a resulting, secondary stressor was hydrological change. Water loss to washes and wash vegetation was expected to result from increased ponding, infiltrationand/or evaporation associated with disturbances to desert pavement. A plan for estimating integrated risks from the three military activities was included in the problem formulation.« less

Automatic Human Movement Assessment With Switching Linear Dynamic System: Motion Segmentation and Motor Performance.

PubMed

de Souza Baptista, Roberto; Bo, Antonio P L; Hayashibe, Mitsuhiro

2017-06-01

Performance assessment of human movement is critical in diagnosis and motor-control rehabilitation. Recent developments in portable sensor technology enable clinicians to measure spatiotemporal aspects to aid in the neurological assessment. However, the extraction of quantitative information from such measurements is usually done manually through visual inspection. This paper presents a novel framework for automatic human movement assessment that executes segmentation and motor performance parameter extraction in time-series of measurements from a sequence of human movements. We use the elements of a Switching Linear Dynamic System model as building blocks to translate formal definitions and procedures from human movement analysis. Our approach provides a method for users with no expertise in signal processing to create models for movements using labeled dataset and later use it for automatic assessment. We validated our framework on preliminary tests involving six healthy adult subjects that executed common movements in functional tests and rehabilitation exercise sessions, such as sit-to-stand and lateral elevation of the arms and five elderly subjects, two of which with limited mobility, that executed the sit-to-stand movement. The proposed method worked on random motion sequences for the dual purpose of movement segmentation (accuracy of 72%-100%) and motor performance assessment (mean error of 0%-12%).

Using the Theory of Successful Intelligence as a Framework for Developing Assessments in AP Physics

ERIC Educational Resources Information Center

Stemler, Steven E.; Sternberg, Robert J.; Grigorenko, Elena L.; Jarvin, Linda; Sharpes, Kirsten

2009-01-01

A new test of Advanced Placement Physics, explicitly designed to balance both content and cognitive-processing skills, was developed using Sternberg's theory of successful intelligence. The test was administered to 281 AP Physics students from 10 schools during the 2006-2007 school year. Six empirically distinguishable profiles of strengths and…

Detecting Different Types of Reading Difficulties: A Comparison of Tests

ERIC Educational Resources Information Center

Moore, Danielle M.; Porter, Melanie A.; Kohnen, Saskia; Castles, Anne

2012-01-01

The focus of this paper is on the assessment of the two main processes that children must acquire at the single word reading level: word recognition (lexical) and decoding (nonlexical) skills. Guided by the framework of the dual route model, this study aimed to (1) investigate the impact of item characteristics on test performance, and (2)…

Alternative Framework in "Body Coordination" Topic: A Progress Report for Interior of Malaysia

ERIC Educational Resources Information Center

Seligin, Davy; Ishak, Mohd. Zaki; Goropos, Jominin

2015-01-01

This preliminary study was conducted in interior of Malaysia. The study employed the Body Coordination Two Tier Concept Test to assess students' understandings of body coordination topic. The test consisted of 14 questions as two tier question style. The students needed to select the answer and write down the justifications of each answer.…

A Unified Framework for Association Analysis with Multiple Related Phenotypes

PubMed Central

Stephens, Matthew

2013-01-01

We consider the problem of assessing associations between multiple related outcome variables, and a single explanatory variable of interest. This problem arises in many settings, including genetic association studies, where the explanatory variable is genotype at a genetic variant. We outline a framework for conducting this type of analysis, based on Bayesian model comparison and model averaging for multivariate regressions. This framework unifies several common approaches to this problem, and includes both standard univariate and standard multivariate association tests as special cases. The framework also unifies the problems of testing for associations and explaining associations – that is, identifying which outcome variables are associated with genotype. This provides an alternative to the usual, but conceptually unsatisfying, approach of resorting to univariate tests when explaining and interpreting significant multivariate findings. The method is computationally tractable genome-wide for modest numbers of phenotypes (e.g. 5–10), and can be applied to summary data, without access to raw genotype and phenotype data. We illustrate the methods on both simulated examples, and to a genome-wide association study of blood lipid traits where we identify 18 potential novel genetic associations that were not identified by univariate analyses of the same data. PMID:23861737

A framework to assess welfare mix and service provision models in health care and social welfare: case studies of two prominent Italian regions.

PubMed

Longo, Francesco; Notarnicola, Elisabetta; Tasselli, Stefano

2015-04-09

The mechanisms through which the relationships among public institutions, private providers and families affect care and service provision systems are puzzling. How can we understand the mechanisms in these contexts? Which elements should we explore to capture the complexity of care provision? The aim of our study is to provide a framework that can help read and reframe these puzzling care provision mechanisms in a welfare mix context. First, we develop a theoretical framework for understanding how service provision occurs in care systems that are characterised by a variety of relationships between multiple actors, using an evidence-based approach that looks at both public and private expenditures and the number of users relative to the level of needs coverage and compared with declared values and political rhetoric. Second, we test this framework in two case studies built on data from two prominent Italian regions, Lombardy and Emilia-Romagna. We argue that service provision models depend on the interplay among six conceptual elements: policy values, governance rules, resources, nature of the providers, service standards and eligibility criteria. Our empirical study shows that beneath the relevant differences in values and political rhetoric between the case studies of the two Italian regions, there is a surprising isomorphism in service standards and the levels of covering the population's needs. The suggested framework appears to be effective and feasible; it fosters interdisciplinary approaches and supports policy-making discussions. This study may contribute to deepening knowledge about public care service provision and institutional arrangements, which can be used to promote more effective reforms and may advance future research. Although the framework was tested on the Italian welfare system, it can be used to assess many different systems.

Validation of educational assessments: a primer for simulation and beyond.

PubMed

Cook, David A; Hatala, Rose

2016-01-01

Simulation plays a vital role in health professions assessment. This review provides a primer on assessment validation for educators and education researchers. We focus on simulation-based assessment of health professionals, but the principles apply broadly to other assessment approaches and topics. Validation refers to the process of collecting validity evidence to evaluate the appropriateness of the interpretations, uses, and decisions based on assessment results. Contemporary frameworks view validity as a hypothesis, and validity evidence is collected to support or refute the validity hypothesis (i.e., that the proposed interpretations and decisions are defensible). In validation, the educator or researcher defines the proposed interpretations and decisions, identifies and prioritizes the most questionable assumptions in making these interpretations and decisions (the "interpretation-use argument"), empirically tests those assumptions using existing or newly-collected evidence, and then summarizes the evidence as a coherent "validity argument." A framework proposed by Messick identifies potential evidence sources: content, response process, internal structure, relationships with other variables, and consequences. Another framework proposed by Kane identifies key inferences in generating useful interpretations: scoring, generalization, extrapolation, and implications/decision. We propose an eight-step approach to validation that applies to either framework: Define the construct and proposed interpretation, make explicit the intended decision(s), define the interpretation-use argument and prioritize needed validity evidence, identify candidate instruments and/or create/adapt a new instrument, appraise existing evidence and collect new evidence as needed, keep track of practical issues, formulate the validity argument, and make a judgment: does the evidence support the intended use? Rigorous validation first prioritizes and then empirically evaluates key assumptions in the interpretation and use of assessment scores. Validation science would be improved by more explicit articulation and prioritization of the interpretation-use argument, greater use of formal validation frameworks, and more evidence informing the consequences and implications of assessment.

Software framework for the upcoming MMT Observatory primary mirror re-aluminization

NASA Astrophysics Data System (ADS)

Gibson, J. Duane; Clark, Dusty; Porter, Dallan

2014-07-01

Details of the software framework for the upcoming in-situ re-aluminization of the 6.5m MMT Observatory (MMTO) primary mirror are presented. This framework includes: 1) a centralized key-value store and data structure server for data exchange between software modules, 2) a newly developed hardware-software interface for faster data sampling and better hardware control, 3) automated control algorithms that are based upon empirical testing, modeling, and simulation of the aluminization process, 4) re-engineered graphical user interfaces (GUI's) that use state-of-the-art web technologies, and 5) redundant relational databases for data logging. Redesign of the software framework has several objectives: 1) automated process control to provide more consistent and uniform mirror coatings, 2) optional manual control of the aluminization process, 3) modular design to allow flexibility in process control and software implementation, 4) faster data sampling and logging rates to better characterize the approximately 100-second aluminization event, and 5) synchronized "real-time" web application GUI's to provide all users with exactly the same data. The framework has been implemented as four modules interconnected by a data store/server. The four modules are integrated into two Linux system services that start automatically at boot-time and remain running at all times. Performance of the software framework is assessed through extensive testing within 2.0 meter and smaller coating chambers at the Sunnyside Test Facility. The redesigned software framework helps ensure that a better performing and longer lasting coating will be achieved during the re-aluminization of the MMTO primary mirror.

Investigating students' academic numeracy in 1st level university courses

NASA Astrophysics Data System (ADS)

Galligan, Linda; Hobohm, Carola

2015-06-01

This paper investigates how an online test (`Self-Test' developed at the University of Southern Queensland) can enrich students' understanding of their academic numeracy, through a purpose-built, self-assessment tool aligned with online modules. Since its creation and evaluation, the tool has been developed and tailored to suit other first year courses based around an academic numeracy framework of competence, confidence and critical awareness (Galligan 2013a). This paper will highlight how the new Self-Test is underpinned by this framework and how students' levels of numeracy can be better understood by the lecturer through Self-Test in a first year nursing for numeracy course and a maths for teachers course. It particularly addresses over- and under-confidence, error analysis and students' reflective comments, and how this understanding can better inform course development and teaching.

Current limitations and recommendations to improve testing for the environmental assessment of endocrine active substances

USGS Publications Warehouse

Coady, Katherine K.; Biever, Ronald C.; Denslow, Nancy D.; Gross, Melanie; Guiney, Patrick D.; Holbech, Henrik; Karouna-Renier, Natalie K.; Katsiadaki, Ioanna; Krueger, Hank; Levine, Steven L.; Maack, Gerd; Williams, Mike; Wolf, Jeffrey C.; Ankley, Gerald T.

2017-01-01

In the present study, existing regulatory frameworks and test systems for assessing potential endocrine active chemicals are described, and associated challenges are discussed, along with proposed approaches to address these challenges. Regulatory frameworks vary somewhat across geographies, but all basically evaluate whether a chemical possesses endocrine activity and whether this activity can result in adverse outcomes either to humans or to the environment. Current test systems include in silico, in vitro, and in vivo techniques focused on detecting potential endocrine activity, and in vivo tests that collect apical data to detect possible adverse effects. These test systems are currently designed to robustly assess endocrine activity and/or adverse effects in the estrogen, androgen, and thyroid hormone signaling pathways; however, there are some limitations of current test systems for evaluating endocrine hazard and risk. These limitations include a lack of certainty regarding: 1) adequately sensitive species and life stages; 2) mechanistic endpoints that are diagnostic for endocrine pathways of concern; and 3) the linkage between mechanistic responses and apical, adverse outcomes. Furthermore, some existing test methods are resource intensive with regard to time, cost, and use of animals. However, based on recent experiences, there are opportunities to improve approaches to and guidance for existing test methods and to reduce uncertainty. For example, in vitro high-throughput screening could be used to prioritize chemicals for testing and provide insights as to the most appropriate assays for characterizing hazard and risk. Other recommendations include adding endpoints for elucidating connections between mechanistic effects and adverse outcomes, identifying potentially sensitive taxa for which test methods currently do not exist, and addressing key endocrine pathways of possible concern in addition to those associated with estrogen, androgen, and thyroid signaling. 

Evaluating impact of clinical guidelines using a realist evaluation framework.

PubMed

Reddy, Sandeep; Wakerman, John; Westhorp, Gill; Herring, Sally

2015-12-01

The Remote Primary Health Care Manuals (RPHCM) project team manages the development and publication of clinical protocols and procedures for primary care clinicians practicing in remote Australia. The Central Australian Rural Practitioners Association Standard Treatment Manual, the flagship manual of the RPHCM suite, has been evaluated for accessibility and acceptability in remote clinics three times in its 20-year history. These evaluations did not consider a theory-based framework or a programme theory, resulting in some limitations with the evaluation findings. With the RPHCM having an aim of enabling evidence-based practice in remote clinics and anecdotally reported to do so, testing this empirically for the full suite is vital for both stakeholders and future editions of the RPHCM. The project team utilized a realist evaluation framework to assess how, why and for what the RPHCM were being used by remote practitioners. A theory regarding the circumstances in which the manuals have and have not enabled evidence-based practice in the remote clinical context was tested. The project assessed this theory for all the manuals in the RPHCM suite, across government and aboriginal community-controlled clinics, in three regions of Australia. Implementing a realist evaluation framework to generate robust findings in this context has required innovation in the evaluation design and adaptation by researchers. This article captures the RPHCM team's experience in designing this evaluation. © 2015 John Wiley & Sons, Ltd.

A Framework For Analysis Of Coastal Infrastructure Vunerabilty To Global Sea Level Rise

NASA Astrophysics Data System (ADS)

Obrien, P. S.; White, K. D.; Veatch, W.; Marzion, R.; Moritz, H.; Moritz, H. R.

2017-12-01

Recorded impacts of global sea rise on coastal water levels have been documented over the past 100 to 150 years. In the recent 40 years the assumption of hydrologic stationarity has been recognized as invalid. New coastal infrastructure designs must recognize the paradigm shift from hydrologic stationarity to non-stationarity in coastal hydrology. A framework for the evaluation of existing coastal infrastructure is proposed to effectively assess design vulnerability. Two data sets developed from existing structures are chosen to test a proposed framework for vunerabilty to global sea level rise, with the proposed name Climate Preparedness and Resilience Register (CPRR). The CPRR framework consists of four major elements; Datum Adjustment, Coastal Water Levels, Scenario Projections and Performance Thresholds.

Implementation Guidance for the Next Generation Leaching Tests

EPA Science Inventory

Poster provides an overview of the purpose and utility of this research, highlights of the research to support the Leaching Environmental Assessment Framework (LEAF), application and translation (including data management and analysis software), intended end users, and lessons le...

A Risk Analysis Methodology to Address Human and Organizational Factors in Offshore Drilling Safety: With an Emphasis on Negative Pressure Test

NASA Astrophysics Data System (ADS)

Tabibzadeh, Maryam

According to the final Presidential National Commission report on the BP Deepwater Horizon (DWH) blowout, there is need to "integrate more sophisticated risk assessment and risk management practices" in the oil industry. Reviewing the literature of the offshore drilling industry indicates that most of the developed risk analysis methodologies do not fully and more importantly, systematically address the contribution of Human and Organizational Factors (HOFs) in accident causation. This is while results of a comprehensive study, from 1988 to 2005, of more than 600 well-documented major failures in offshore structures show that approximately 80% of those failures were due to HOFs. In addition, lack of safety culture, as an issue related to HOFs, have been identified as a common contributing cause of many accidents in this industry. This dissertation introduces an integrated risk analysis methodology to systematically assess the critical role of human and organizational factors in offshore drilling safety. The proposed methodology in this research focuses on a specific procedure called Negative Pressure Test (NPT), as the primary method to ascertain well integrity during offshore drilling, and analyzes the contributing causes of misinterpreting such a critical test. In addition, the case study of the BP Deepwater Horizon accident and their conducted NPT is discussed. The risk analysis methodology in this dissertation consists of three different approaches and their integration constitutes the big picture of my whole methodology. The first approach is the comparative analysis of a "standard" NPT, which is proposed by the author, with the test conducted by the DWH crew. This analysis contributes to identifying the involved discrepancies between the two test procedures. The second approach is a conceptual risk assessment framework to analyze the causal factors of the identified mismatches in the previous step, as the main contributors of negative pressure test misinterpretation. Finally, a rational decision making model is introduced to quantify a section of the developed conceptual framework in the previous step and analyze the impact of different decision making biases on negative pressure test results. Along with the corroborating findings of previous studies, the analysis of the developed conceptual framework in this paper indicates that organizational factors are root causes of accumulated errors and questionable decisions made by personnel or management. Further analysis of this framework identifies procedural issues, economic pressure, and personnel management issues as the organizational factors with the highest influence on misinterpreting a negative pressure test. It is noteworthy that the captured organizational factors in the introduced conceptual framework are not only specific to the scope of the NPT. Most of these organizational factors have been identified as not only the common contributing causes of other offshore drilling accidents but also accidents in other oil and gas related operations as well as high-risk operations in other industries. In addition, the proposed rational decision making model in this research introduces a quantitative structure for analysis of the results of a conducted NPT. This model provides a structure and some parametric derived formulas to determine a cut-off point value, which assists personnel in accepting or rejecting an implemented negative pressure test. Moreover, it enables analysts to assess different decision making biases involved in the process of interpreting a conducted negative pressure test as well as the root organizational factors of those biases. In general, although the proposed integrated research methodology in this dissertation is developed for the risk assessment of human and organizational factors contributions in negative pressure test misinterpretation, it can be generalized and be potentially useful for other well control situations, both offshore and onshore; e.g. fracking. In addition, this methodology can be applied for the analysis of any high-risk operations, in not only the oil and gas industry but also in other industries such as nuclear power plants, aviation industry, and transportation sector.

From multifunctionality to multiple ecosystem services? A conceptual framework for multifunctionality in green infrastructure planning for urban areas.

PubMed

Hansen, Rieke; Pauleit, Stephan

2014-05-01

Green infrastructure (GI) and ecosystem services (ES) are promoted as concepts that have potential to improve environmental planning in urban areas based on a more holistic understanding of the complex interrelations and dynamics of social-ecological systems. However, the scientific discourses around both concepts still lack application-oriented frameworks that consider such a holistic perspective and are suitable to mainstream GI and ES in planning practice. This literature review explores how multifunctionality as one important principle of GI planning can be operationalized by approaches developed and tested in ES research. Specifically, approaches developed in ES research can help to assess the integrity of GI networks, balance ES supply and demand, and consider trade-offs. A conceptual framework for the assessment of multifunctionality from a social-ecological perspective is proposed that can inform the design of planning processes and support stronger exchange between GI and ES research.

A Statistical Framework for the Functional Analysis of Metagenomes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sharon, Itai; Pati, Amrita; Markowitz, Victor

2008-10-01

Metagenomic studies consider the genetic makeup of microbial communities as a whole, rather than their individual member organisms. The functional and metabolic potential of microbial communities can be analyzed by comparing the relative abundance of gene families in their collective genomic sequences (metagenome) under different conditions. Such comparisons require accurate estimation of gene family frequencies. They present a statistical framework for assessing these frequencies based on the Lander-Waterman theory developed originally for Whole Genome Shotgun (WGS) sequencing projects. They also provide a novel method for assessing the reliability of the estimations which can be used for removing seemingly unreliable measurements.more » They tested their method on a wide range of datasets, including simulated genomes and real WGS data from sequencing projects of whole genomes. Results suggest that their framework corrects inherent biases in accepted methods and provides a good approximation to the true statistics of gene families in WGS projects.« less

The Translational Science Benefits Model: A New Framework for Assessing the Health and Societal Benefits of Clinical and Translational Sciences

PubMed Central

Sarli, Cathy C.; Suiter, Amy M.; Carothers, Bobbi J.; Combs, Todd B.; Allen, Jae L.; Beers, Courtney E.; Evanoff, Bradley A.

2017-01-01

Abstract We report the development of the Translational Science Benefits Model (TSBM), a framework designed to support institutional assessment of clinical and translational research outcomes to measure clinical and community health impacts beyond bibliometric measures. The TSBM includes 30 specific and potentially measurable indicators that reflect benefits that accrue from clinical and translational science research such as products, system characteristics, or activities. Development of the TSBM was based on literature review, a modified Delphi method, and in‐house expert panel feedback. Three case studies illustrate the feasibility and face validity of the TSBM for identification of clinical and community health impacts that result from translational science activities. Future plans for the TSBM include further pilot testing and a resource library that will be freely available for evaluators, translational scientists, and academic institutions who wish to implement the TSBM framework in their own evaluation efforts. PMID:28887873

The influence of verification jig on framework fit for nonsegmented fixed implant-supported complete denture.

PubMed

Ercoli, Carlo; Geminiani, Alessandro; Feng, Changyong; Lee, Heeje

2012-05-01

The purpose of this retrospective study was to assess if there was a difference in the likelihood of achieving passive fit when an implant-supported full-arch prosthesis framework is fabricated with or without the aid of a verification jig. This investigation was approved by the University of Rochester Research Subject Review Board (protocol #RSRB00038482). Thirty edentulous patients, 49 to 73 years old (mean 61 years old), rehabilitated with a nonsegmented fixed implant-supported complete denture were included in the study. During the restorative process, final impressions were made using the pickup impression technique and elastomeric impression materials. For 16 patients, a verification jig was made (group J), while for the remaining 14 patients, a verification jig was not used (group NJ) and the framework was fabricated directly on the master cast. During the framework try-in appointment, the fit was assessed by clinical (Sheffield test) and radiographic inspection and recorded as passive or nonpassive. When a verification jig was used (group J, n = 16), all frameworks exhibited clinically passive fit, while when a verification jig was not used (group NJ, n = 14), only two frameworks fit. This difference was statistically significant (p < .001). Within the limitations of this retrospective study, the fabrication of a verification jig ensured clinically passive fit of metal frameworks in nonsegmented fixed implant-supported complete denture. © 2011 Wiley Periodicals, Inc.

Structural monitoring via microwave tomography-enhanced GPR: the Montagnole test site

NASA Astrophysics Data System (ADS)

Catapano, Ilaria; Di Napoli, Rosario; Soldovieri, Francesco; Bavusi, Massimo; Loperte, Antonio; Dumoulin, Jean

2012-08-01

Structural integrity assessment and monitoring of infrastructures are key factors to prevent and manage crisis events (natural disasters, terrorist attacks and so on) and ensure urban safety. This necessity motivates huge interest towards design, optimization and integration of non-invasive remote and in situ diagnostic techniques. In this framework, ground penetrating radar (GPR) is a well-assessed instrumentation, which allows one to attain information on the inner status of man-made structures while avoiding invasive tests. However, despite its potential, a more widespread use of GPR is actually affected by the difficulties in providing highly informative and easily interpretable images as an outcome of the overall diagnostics procedure. This drawback can be mitigated thanks to the use of microwave tomography (MT) as a data processing tool able to enhance the achievable reconstruction capabilities, and several proofs of its effectiveness have been already shown. In this paper, the potential of the MT approach is investigated in the framework of structural monitoring by an experiment carried out in the Montagnole test site in the French Alps, where the progressive damage of a one-scale concrete beam has been monitored thanks to the integration of several electromagnetic sensing techniques. In this framework, the capability of the MT-enhanced GPR strategy is examined with respect to the possibility of providing information about the damage of the rebar grid of the beam.

A framework for the implementation of new radiation therapy technologies and treatment techniques in low-income countries.

PubMed

Brown, Derek W; Shulman, Adam; Hudson, Alana; Smith, Wendy; Fisher, Brandon; Hollon, Jon; Pipman, Yakov; Van Dyk, Jacob; Einck, John

2014-11-01

We present a practical, generic, easy-to-use framework for the implementation of new radiation therapy technologies and treatment techniques in low-income countries. The framework is intended to standardize the implementation process, reduce the effort involved in generating an implementation strategy, and provide improved patient safety by reducing the likelihood that steps are missed during the implementation process. The 10 steps in the framework provide a practical approach to implementation. The steps are, 1) Site and resource assessment, 2) Evaluation of equipment and funding, 3) Establishing timelines, 4) Defining the treatment process, 5) Equipment commissioning, 6) Training and competency assessment, 7) Prospective risk analysis, 8) System testing, 9) External dosimetric audit and incident learning, and 10) Support and follow-up. For each step, practical advice for completing the step is provided, as well as links to helpful supplementary material. An associated checklist is provided that can be used to track progress through the steps in the framework. While the emphasis of this paper is on addressing the needs of low-income countries, the concepts also apply in high-income countries. Copyright © 2014 Associazione Italiana di Fisica Medica. Published by Elsevier Ltd. All rights reserved.

Precision and Accuracy of a Digital Impression Scanner in Full-Arch Implant Rehabilitation.

PubMed

Pesce, Paolo; Pera, Francesco; Setti, Paolo; Menini, Maria

To evaluate the accuracy and precision of a digital scanner used to scan four implants positioned according to an immediate loading implant protocol and to assess the accuracy of an aluminum framework fabricated from a digital impression. Five master casts reproducing different edentulous maxillae with four tilted implants were used. Four scan bodies were screwed onto the low-profile abutments, and a digital intraoral scanner was used to perform five digital impressions of each master cast. To assess trueness, a metal framework of the best digital impression was produced with computer-aided design/computer-assisted manufacture (CAD/CAM) technology and passive fit was assessed with the Sheffield test. Gaps between the frameworks and the implant analogs were measured with a stereomicroscope. To assess precision, three-dimensional (3D) point cloud processing software was used to measure the deviations between the five digital impressions of each cast by producing a color map. The deviation values were grouped in three classes, and differences were assessed between class 2 (representing lower discrepancies) and the assembled classes 1 and 3 (representing the higher negative and positive discrepancies, respectively). The frameworks showed a mean gap of < 30 μm (range: 2 to 47 μm). A statistically significant difference was found between the two groups by the 3D point cloud software, with higher frequencies of points in class 2 than in grouped classes 1 and 3 (P < .001). Within the limits of this in vitro study, it appears that a digital impression may represent a reliable method for fabricating full-arch implant frameworks with good passive fit when tilted implants are present.

easyCBM[R] Mathematics Criterion Related Validity Evidence: Oregon State Test. Technical Report #1011

ERIC Educational Resources Information Center

Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

In this technical report, we present the results of a study examining the relation between the math measures available on the easyCBM[R] online benchmark and progress monitoring assessment system and the Oregon statewide assessment of mathematics. Designed for use within a response to intervention (RTI) framework, easyCBM[R] is intended to help…

Computer Based Testing Using "Digital Ink": Participatory Design of a Tablet PC Based Assessment Application for Secondary Education

ERIC Educational Resources Information Center

Siozos, Panagiotis; Palaigeorgiou, George; Triantafyllakos, George; Despotakis, Theofanis

2009-01-01

In this paper, we identify key challenges faced by computer-based assessment (CBA) in secondary education and we put forward a framework of design considerations: design with the students and teachers, select the most appropriate media platform and plan an evolution rather than a revolution of prior practices. We present the CBA application…

Seamless Assessment in Science: A Guide for Elementary & Middle School. Grades: K - 8

ERIC Educational Resources Information Center

National Science Teachers Association (NJ3), 2006

2006-01-01

When a classroom is opened to inquiry-based learning, teachers can no longer rely solely on traditional end-of-unit tests. "Seamless Assessment" is a one-stop guide to strategies that mirror the investigatory spirit. Working with the popular 5E model as an instructional framework, the authors have designed methods for embedding formative and…

Monitoring recreational impacts in wilderness of Kamchatka (on example of Kronotsky State Natural Biosphere Preserve)

Treesearch

Anya V. Zavadskaya

2011-01-01

This paper describes an assessment and monitoring program that was designed and initiated for monitoring recreational impacts in a wilderness in Kamchatka. The framework of the recreational assessment was tested through its application to a case study conducted during the summers of 2008 and 2009 in the Kronotsky State Natural Biosphere Preserve (Kamchatka peninsula,...

Why Assessment in Medical Education Needs a Solid Foundation in Modern Test Theory

ERIC Educational Resources Information Center

Schauber, Stefan K.; Hecht, Martin; Nouns, Zineb M.

2018-01-01

Despite the frequent use of state-of-the-art psychometric models in the field of medical education, there is a growing body of literature that questions their usefulness in the assessment of medical competence. Essentially, a number of authors raised doubt about the appropriateness of psychometric models as a guiding framework to secure and refine…

A Pedagogical Alliance for Trust, Wellbeing and the Identification of Errors for Learning and Formative Assessment

ERIC Educational Resources Information Center

Leighton, Jacqueline P.; Bustos Gómez, María Clara

2018-01-01

Formative assessments and feedback are vital to enhancing learning outcomes but require that learners feel at ease identifying their errors, and receiving feedback from a trusted source--teachers. An experimental test of a new theoretical framework was conducted to cultivate a pedagogical alliance to enhance students' (a) trust in the teacher, (b)…

The Development of Multiple-Choice Items Consistent with the AP Chemistry Curriculum Framework to More Accurately Assess Deeper Understanding

ERIC Educational Resources Information Center

Domyancich, John M.

2014-01-01

Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

Setting performance standards for medical practice: a theoretical framework.

PubMed

Southgate, L; Hays, R B; Norcini, J; Mulholland, H; Ayers, B; Woolliscroft, J; Cusimano, M; McAvoy, P; Ainsworth, M; Haist, S; Campbell, M

2001-05-01

The assessment of performance in the real world of medical practice is now widely accepted as the goal of assessment at the postgraduate level. This is largely a validity issue, as it is recognised that tests of knowledge and in clinical simulations cannot on their own really measure how medical practitioners function in the broader health care system. However, the development of standards for performance-based assessment is not as well understood as in competency assessment, where simulations can more readily reflect narrower issues of knowledge and skills. This paper proposes a theoretical framework for the development of standards that reflect the more complex world in which experienced medical practitioners work. The paper reflects the combined experiences of a group of education researchers and the results of literature searches that included identifying current health system data sources that might contribute information to the measurement of standards. Standards that reflect the complexity of medical practice may best be developed through an "expert systems" analysis of clinical conditions for which desired health care outcomes reflect the contribution of several health professionals within a complex, three-dimensional, contextual model. Examples of the model are provided, but further work is needed to test validity and measurability.

A new fit-for-purpose model testing framework: Decision Crash Tests

NASA Astrophysics Data System (ADS)

Tolson, Bryan; Craig, James

2016-04-01

Decision-makers in water resources are often burdened with selecting appropriate multi-million dollar strategies to mitigate the impacts of climate or land use change. Unfortunately, the suitability of existing hydrologic simulation models to accurately inform decision-making is in doubt because the testing procedures used to evaluate model utility (i.e., model validation) are insufficient. For example, many authors have identified that a good standard framework for model testing called the Klemes Crash Tests (KCTs), which are the classic model validation procedures from Klemeš (1986) that Andréassian et al. (2009) rename as KCTs, have yet to become common practice in hydrology. Furthermore, Andréassian et al. (2009) claim that the progression of hydrological science requires widespread use of KCT and the development of new crash tests. Existing simulation (not forecasting) model testing procedures such as KCTs look backwards (checking for consistency between simulations and past observations) rather than forwards (explicitly assessing if the model is likely to support future decisions). We propose a fundamentally different, forward-looking, decision-oriented hydrologic model testing framework based upon the concept of fit-for-purpose model testing that we call Decision Crash Tests or DCTs. Key DCT elements are i) the model purpose (i.e., decision the model is meant to support) must be identified so that model outputs can be mapped to management decisions ii) the framework evaluates not just the selected hydrologic model but the entire suite of model-building decisions associated with model discretization, calibration etc. The framework is constructed to directly and quantitatively evaluate model suitability. The DCT framework is applied to a model building case study on the Grand River in Ontario, Canada. A hypothetical binary decision scenario is analysed (upgrade or not upgrade the existing flood control structure) under two different sets of model building decisions. In one case, we show the set of model building decisions has a low probability to correctly support the upgrade decision. In the other case, we show evidence suggesting another set of model building decisions has a high probability to correctly support the decision. The proposed DCT framework focuses on what model users typically care about: the management decision in question. The DCT framework will often be very strict and will produce easy to interpret results enabling clear unsuitability determinations. In the past, hydrologic modelling progress has necessarily meant new models and model building methods. Continued progress in hydrologic modelling requires finding clear evidence to motivate researchers to disregard unproductive models and methods and the DCT framework is built to produce this kind of evidence. References: Andréassian, V., C. Perrin, L. Berthet, N. Le Moine, J. Lerat, C. Loumagne, L. Oudin, T. Mathevet, M.-H. Ramos, and A. Valéry (2009), Crash tests for a standardized evaluation of hydrological models. Hydrology and Earth System Sciences, 13, 1757-1764. Klemeš, V. (1986), Operational testing of hydrological simulation models. Hydrological Sciences Journal, 31 (1), 13-24.

Utilizing the Six Realms of Meaning in Improving Campus Standardized Test Scores through Team Teaching and Strategic Planning

ERIC Educational Resources Information Center

Stevenson, Rosnisha D.; Kritsonis, William Allan

2009-01-01

This article will seek to utilize Dr. William Allan Kritsonis' book "Ways of Knowing Through the Realms of Meaning" (2007) as a framework to improve a campus's standardized test scores, more specifically, their TAKS (Texas Assessment of Knowledge and Skills) scores. Many campuses have an improvement plan, also known as a Campus…

Assessment of 21st Century ICT Skills in Chile: Test Design and Results from High School Level Students

ERIC Educational Resources Information Center

Claro, Magdalena; Preiss, David D.; San Martin, Ernesto; Jara, Ignacio; Hinostroza, J. Enrique; Valenzuela, Susana; Cortes, Flavio; Nussbaum, Miguel

2012-01-01

This paper describes a study that evaluates fifteen-year-old Chilean students Information and Communication Technology (ICT) skills. The paper presents an operational definition of ICT skills, an instrument measuring these skills as well as the students' results in the test. The definition of ICT skills used considers Chile's curricular framework,…

Implementing a framework for integrating toxicokinetics into human health risk assessment for agrochemicals.

PubMed

Terry, Claire; Hays, Sean; McCoy, Alene T; McFadden, Lisa G; Aggarwal, Manoj; Rasoulpour, Reza J; Juberg, Daland R

2016-03-01

A strategic and comprehensive program in which toxicokinetic (TK) measurements are made for all agrochemicals undergoing toxicity testing (both new compounds and compounds already registered for use) is described. This approach provides the data to more accurately assess the toxicokinetics of agrochemicals and their metabolites in laboratory animals and humans. Having this knowledge provides the ability to conduct more insightful toxicity studies, refine and interpret exposure assessments and reduce uncertainty in risk assessments. By developing a better understanding of TK across species, including humans via in vitro metabolism studies, any differences across species in TK can be identified early and the most relevant species can be selected for toxicity tests. It also provides the ability to identify any non-linearities in TK as a function of dose, which in turn can be used to identify a kinetically derived maximum dose (KMD) and avoid dosing inappropriately outside of the kinetic linear range. Measuring TK in key life stages also helps to identify changes in ADME parameters from in utero to adults. A robust TK database can also be used to set internal concentration based "Reference Concentrations" and Biomonitoring Equivalents (BE), and support selection of Chemical Specific Adjustment Factors (CSAF). All of these factors support the reduction of uncertainty throughout the entire risk assessment process. This paper outlines how a TK research strategy can be integrated into new agrochemical toxicity testing programs, together with a proposed Framework for future use. Copyright © 2015 Elsevier Inc. All rights reserved.

Construction and Validation of SRA-FV Need Assessment.

PubMed

Thornton, David; Knight, Raymond A

2015-08-01

This article describes the construction and testing of a newly designed instrument to assess psychological factors associated with increased rates of sexual recidivism. The new instrument (Structured Risk Assessment-Forensic Version or SRA-FV) was based on previous research using the SRA framework. This article describes the results of testing SRA-FV with a large sample (N = 566) of sexual offenders being evaluated for an early civil commitment program. SRA-FV was found to significantly predict sexual recidivism for both child molesters and rapists and to have incremental predictive value relative to two widely used static actuarial instruments (Static-99R; Risk Matrix 2000/S). © The Author(s) 2013.

A reliability as an independent variable (RAIV) methodology for optimizing test planning for liquid rocket engines

NASA Astrophysics Data System (ADS)

Strunz, Richard; Herrmann, Jeffrey W.

2011-12-01

The hot fire test strategy for liquid rocket engines has always been a concern of space industry and agency alike because no recognized standard exists. Previous hot fire test plans focused on the verification of performance requirements but did not explicitly include reliability as a dimensioning variable. The stakeholders are, however, concerned about a hot fire test strategy that balances reliability, schedule, and affordability. A multiple criteria test planning model is presented that provides a framework to optimize the hot fire test strategy with respect to stakeholder concerns. The Staged Combustion Rocket Engine Demonstrator, a program of the European Space Agency, is used as example to provide the quantitative answer to the claim that a reduced thrust scale demonstrator is cost beneficial for a subsequent flight engine development. Scalability aspects of major subsystems are considered in the prior information definition inside the Bayesian framework. The model is also applied to assess the impact of an increase of the demonstrated reliability level on schedule and affordability.

A conceptual and disease model framework for osteoporotic kyphosis.

PubMed

Bayliss, M; Miltenburger, C; White, M; Alvares, L

2013-09-01

This paper presents a multi-method research project to develop a conceptual framework for measuring outcomes in studies of osteoporotic kyphosis. The research involved literature research and qualitative interviews among clinicians who treat patients with kyphosis and among patients with the condition. Kyphosis due to at least one vertebral compression fracture is prevalent among osteoporotic patients, resulting in well-documented symptoms and impact on functioning and well-being. A three-part study led to development of a conceptual measurement framework for comprehensive assessment of symptoms, impact, and treatment benefit for kyphosis. A literature-based disease model (DM) was developed and tested with physicians (n = 10) and patients (n = 10), and FDA guidelines were used to develop a final disease model and a conceptual framework. The DM included signs, symptoms, causes/triggers, exacerbations, and functional status associated with kyphosis. The DM was largely confirmed, but physicians and patients added several concepts related to impact on functioning, and some concepts were not confirmed and removed from the DM. This study confirms the need for more comprehensive assessment of health outcomes in kyphosis, as most current studies omit key concepts.

Framework for hyperspectral image processing and quantification for cancer detection during animal tumor surgery.

PubMed

Lu, Guolan; Wang, Dongsheng; Qin, Xulei; Halig, Luma; Muller, Susan; Zhang, Hongzheng; Chen, Amy; Pogue, Brian W; Chen, Zhuo Georgia; Fei, Baowei

2015-01-01

Hyperspectral imaging (HSI) is an imaging modality that holds strong potential for rapid cancer detection during image-guided surgery. But the data from HSI often needs to be processed appropriately in order to extract the maximum useful information that differentiates cancer from normal tissue. We proposed a framework for hyperspectral image processing and quantification, which includes a set of steps including image preprocessing, glare removal, feature extraction, and ultimately image classification. The framework has been tested on images from mice with head and neck cancer, using spectra from 450- to 900-nm wavelength. The image analysis computed Fourier coefficients, normalized reflectance, mean, and spectral derivatives for improved accuracy. The experimental results demonstrated the feasibility of the hyperspectral image processing and quantification framework for cancer detection during animal tumor surgery, in a challenging setting where sensitivity can be low due to a modest number of features present, but potential for fast image classification can be high. This HSI approach may have potential application in tumor margin assessment during image-guided surgery, where speed of assessment may be the dominant factor.

Framework for hyperspectral image processing and quantification for cancer detection during animal tumor surgery

NASA Astrophysics Data System (ADS)

Lu, Guolan; Wang, Dongsheng; Qin, Xulei; Halig, Luma; Muller, Susan; Zhang, Hongzheng; Chen, Amy; Pogue, Brian W.; Chen, Zhuo Georgia; Fei, Baowei

2015-12-01

Hyperspectral imaging (HSI) is an imaging modality that holds strong potential for rapid cancer detection during image-guided surgery. But the data from HSI often needs to be processed appropriately in order to extract the maximum useful information that differentiates cancer from normal tissue. We proposed a framework for hyperspectral image processing and quantification, which includes a set of steps including image preprocessing, glare removal, feature extraction, and ultimately image classification. The framework has been tested on images from mice with head and neck cancer, using spectra from 450- to 900-nm wavelength. The image analysis computed Fourier coefficients, normalized reflectance, mean, and spectral derivatives for improved accuracy. The experimental results demonstrated the feasibility of the hyperspectral image processing and quantification framework for cancer detection during animal tumor surgery, in a challenging setting where sensitivity can be low due to a modest number of features present, but potential for fast image classification can be high. This HSI approach may have potential application in tumor margin assessment during image-guided surgery, where speed of assessment may be the dominant factor.

Advancing the adverse outcome pathway framework and its ...

EPA Pesticide Factsheets

Regulatory agencies worldwide are confronted with the challenging task of assessing the risks of thousands of chemicals to protect both human health and the environment. Traditional toxicity testing largely relies on apical endpoints from whole animal studies, which, in addition to ethical concerns, is costly and time prohibitive. As a result, the utility of mechanism-based in silico, in vitro, and in vivo approaches to support chemical safety evaluations have increasingly been explored. An approach that has gained traction for capturing available knowledge describing the linkage between mechanistic data and apical toxicity endpoints, required for regulatory assessments, is the adverse outcome pathway (AOP) framework. A number of international workshops and expert meetings have been held over the past years focusing on the AOP framework and its applications to chemical risk assessment. Although, these interactions have illustrated the necessity of expert guidance in moving the science of AOPs and their applications forward, there is also the recognition that a broader survey of the scientific community could be useful in guiding future initiatives in the AOP arena. To that end, a Horizon Scanning exercise was conducted to solicit questions from the global scientific community concerning the challenges or limitations that must be addressed in order to realize the full potential of the AOP framework in research and regulatory decision making. Over a 4 month ques

Effective energy data management for low-carbon growth planning: An analytical framework for assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Bo; Evans, Meredydd; Yu, Sha

Readily available and reliable energy data is fundamental to effective analysis and policymaking for the energy sector. Energy statistics of high quality, systematically compiled and effectively disseminated, not only support governments to ensure national security and evaluate energy policies, but they also guide investment decisions in both the private and public sectors. Because of energy’s close link to greenhouse gas emissions, energy data has a particularly important role in assessing emissions and strategies to reduce emissions. In this study, energy data management in four countries – Canada, Germany, the United Kingdom and the United States – are examined from bothmore » organizational and operational perspectives. With insights from these best practices, we present a framework for the evaluation of national energy data management systems. It can be used by national statistics compilers to assess their chosen model and to identify areas for improvement. We then use India as a test case for this framework. Its government is working to enhance India’s energy data management to improve sustainable growth planning.« less

A Collaborative Evaluation Framework for Biometric Connected Devices in Healthcare.

PubMed

Farnia, Troskah; Jaulent, Marie Christine; Marchand, Guillaume; Yasini, Mobin

2017-01-01

A large number of biometric connected devices are currently available with a variety of designs. Healthcare users cannot easily choose the reliable ones that correspond the best to their healthcare problems. The existing evaluation methods do not consider at the same time aspects of connectivity and healthcare usage. In this study, a collaborative evaluation framework for biometric connected devices in healthcare usage is proposed. This framework contains six dimensions: medical validity, technical reliability, usability, ergonomy, legal compliance, and accuracy of measurements. In a first step, these dimensions were assessed by designing a self administered questionnaire answered by the stakeholders (patients, health professionals, payers, and manufacturers). A case study was then carried out in a second step to test this framework in a project of telemonitoring for heart failure patients. The results are in favor of the efficiency of the proposed framework as a decision making tool in healthcare usage.

Advancing the Adverse Outcome Pathway Framework - an International Horizon Scanning Approach

EPA Science Inventory

The ability of scientists to conduct whole organism toxicity tests to understand chemical safety has been significantly outpaced by the rapid synthesis of new chemicals. Therefore, to increase efficiencies in chemical risk assessment, scientists are turning to mechanistic-based ...

Green and sustainable remediation (GSR) evaluation: framework, standards, and tool. A case study in Taiwan.

PubMed

Huang, Wen-Yen; Hung, Weiteng; Vu, Chi Thanh; Chen, Wei-Ting; Lai, Jhih-Wei; Lin, Chitsan

2016-11-01

Taiwan has a large number of poorly managed contaminated sites in need of remediation. This study proposes a framework, a set of standards, and a spreadsheet-based evaluation tool for implementing green and sustainable principles into remediation projects and evaluating the projects from this perspective. We performed a case study to understand how the framework would be applied. For the case study, we used a spreadsheet-based evaluation tool (SEFA) and performed field scale cultivation tests on a site contaminated with total petroleum hydrocarbons (TPHs). The site was divided into two lots: one treated by chemical oxidation and the other by bioremediation. We evaluated five core elements of green and sustainable remediation (GSR): energy, air, water resources, materials and wastes, and land and ecosystem. The proposed evaluation tool and field scale cultivation test were found to efficiently assess the effectiveness of the two remediation alternatives. The framework and related tools proposed herein can potentially be used to support decisions about the remediation of contaminated sites taking into account engineering management, cost effectiveness, and social reconciliation.

A Corpus-Driven Design of a Test for Assessing the ESL Collocational Competence of University Students

ERIC Educational Resources Information Center

Jaen, Maria Moreno

2007-01-01

This paper reports an assessment of the collocational competence of students of English Linguistics at the University of Granada. This was carried out to meet a two-fold purpose. On the one hand, we aimed to establish a solid corpus-driven approach based upon a systematic and reliable framework for the evaluation of collocational competence in…

Framework for a space shuttle main engine health monitoring system

NASA Technical Reports Server (NTRS)

Hawman, Michael W.; Galinaitis, William S.; Tulpule, Sharayu; Mattedi, Anita K.; Kamenetz, Jeffrey

1990-01-01

A framework developed for a health management system (HMS) which is directed at improving the safety of operation of the Space Shuttle Main Engine (SSME) is summarized. An emphasis was placed on near term technology through requirements to use existing SSME instrumentation and to demonstrate the HMS during SSME ground tests within five years. The HMS framework was developed through an analysis of SSME failure modes, fault detection algorithms, sensor technologies, and hardware architectures. A key feature of the HMS framework design is that a clear path from the ground test system to a flight HMS was maintained. Fault detection techniques based on time series, nonlinear regression, and clustering algorithms were developed and demonstrated on data from SSME ground test failures. The fault detection algorithms exhibited 100 percent detection of faults, had an extremely low false alarm rate, and were robust to sensor loss. These algorithms were incorporated into a hierarchical decision making strategy for overall assessment of SSME health. A preliminary design for a hardware architecture capable of supporting real time operation of the HMS functions was developed. Utilizing modular, commercial off-the-shelf components produced a reliable low cost design with the flexibility to incorporate advances in algorithm and sensor technology as they become available.

The SEURAT-1 approach towards animal free human safety assessment.

PubMed

Gocht, Tilman; Berggren, Elisabet; Ahr, Hans Jürgen; Cotgreave, Ian; Cronin, Mark T D; Daston, George; Hardy, Barry; Heinzle, Elmar; Hescheler, Jürgen; Knight, Derek J; Mahony, Catherine; Peschanski, Marc; Schwarz, Michael; Thomas, Russell S; Verfaillie, Catherine; White, Andrew; Whelan, Maurice

2015-01-01

SEURAT-1 is a European public-private research consortium that is working towards animal-free testing of chemical compounds and the highest level of consumer protection. A research strategy was formulated based on the guiding principle to adopt a toxicological mode-of-action framework to describe how any substance may adversely affect human health.The proof of the initiative will be in demonstrating the applicability of the concepts on which SEURAT-1 is built on three levels:(i) Theoretical prototypes for adverse outcome pathways are formulated based on knowledge already available in the scientific literature on investigating the toxicological mode-of-actions leading to adverse outcomes (addressing mainly liver toxicity);(ii)adverse outcome pathway descriptions are used as a guide for the formulation of case studies to further elucidate the theoretical model and to develop integrated testing strategies for the prediction of certain toxicological effects (i.e., those related to the adverse outcome pathway descriptions);(iii) further case studies target the application of knowledge gained within SEURAT-1 in the context of safety assessment. The ultimate goal would be to perform ab initio predictions based on a complete understanding of toxicological mechanisms. In the near-term, it is more realistic that data from innovative testing methods will support read-across arguments. Both scenarios are addressed with case studies for improved safety assessment. A conceptual framework for a rational integrated assessment strategy emerged from designing the case studies and is discussed in the context of international developments focusing on alternative approaches for evaluating chemicals using the new 21st century tools for toxicity testing.

Counteracting obesity: developing a policy framework to guide action.

PubMed

Cismaru, Magdalena

2008-01-01

The purpose of this paper is to stimulate further debate regarding possible courses of policy action aimed at preventing obesity. Gostin's framework for classifying antiobesity legal interventions is tested and extended to incorporate non-legislative policy initiatives to include a comprehensive array of policy actions available to deal with obesity. A web search of the literature has been conducted. Initiatives from USA, Canada and the European Union were discussed in terms of their objectives and fit with the framework. Gostin's framework was found to be a useful tool in organizing all the initiatives (legislative and non-legislative). However, sometimes a broader definition of the category was needed. As well, in some categories, few initiatives were implemented to date and several new categories have to be added to the framework to classify all the existing initiatives. The theoretical developed framework will assist new initiatives assess possible courses of action as well as countries or organizations that have already implemented some measures identify what else can be done to effectively fight overweight and obesity.

Providing a Science Base for the Evaluation of Tobacco Products

PubMed Central

Berman, Micah L.; Connolly, Greg; Cummings, K. Michael; Djordjevic, Mirjana V.; Hatsukami, Dorothy K.; Henningfield, Jack E.; Myers, Matthew; O'Connor, Richard J.; Parascandola, Mark; Rees, Vaughan; Rice, Jerry M.

2015-01-01

Objective Evidence-based tobacco regulation requires a comprehensive scientific framework to guide the evaluation of new tobacco products and health-related claims made by product manufacturers. Methods The Tobacco Product Assessment Consortium (TobPRAC) employed an iterative process involving consortia investigators, consultants, a workshop of independent scientists and public health experts, and written reviews in order to develop a conceptual framework for evaluating tobacco products. Results The consortium developed a four-phased framework for the scientific evaluation of tobacco products. The four phases addressed by the framework are: (1) pre-market evaluation, (2) pre-claims evaluation, (3) post-market activities, and (4) monitoring and re-evaluation. For each phase, the framework proposes the use of validated testing procedures that will evaluate potential harms at both the individual and population level. Conclusions While the validation of methods for evaluating tobacco products is an ongoing and necessary process, the proposed framework need not wait for fully validated methods to be used in guiding tobacco product regulation today. PMID:26665160

Measuring social accountability in health professional education: development and international pilot testing of an evaluation framework.

PubMed

Larkins, Sarah L; Preston, Robyn; Matte, Marie C; Lindemann, Iris C; Samson, Rex; Tandinco, Filedito D; Buso, David; Ross, Simone J; Pálsdóttir, Björg; Neusy, André-Jacques

2013-01-01

Health professional schools are responsible for producing graduates with competencies and attitudes to address health inequities and respond to priority health needs. Health professional schools striving towards social accountability founded the Training for Health Equity Network (THEnet). This article describes the development of THEnet evaluation framework for socially accountable health professional education, presents the framework to be used as a tool by other schools and discusses the findings of pilot implementation at five schools. The framework was designed collaboratively and built on Boelen and Woollard's conceptualization, production and usability model. It includes key components, linked to aspirational statements, indicators and suggested measurement tools. Five schools completed pilot implementation, involving workshops, document/data review and focus group discussions with faculty, students and community members. Three sections of the framework consider: How does our school work?; What do we do? and What difference do we make? Pilot testing proved that the evaluation framework was acceptable and feasible across contexts and produced findings useful at school level and to compare schools. The framework is designed as a formative exercise to help schools take a critical look at their performance and progress towards social accountability. Initiatives to implement the framework more widely are underway. The framework effectively aids in identifying strengths, weaknesses and gaps, with a view to schools striving for continuous self-improvement. THEnet evaluation framework is applicable and useful across contexts. It is possible and desirable to assess progress towards social accountability in health professional schools and this is an important step in producing health professionals with knowledge, attitudes, and skills to meet the challenges of priority health needs of underserved populations.

Physico-chemical properties of manufactured nanomaterials - Characterisation and relevant methods. An outlook based on the OECD Testing Programme.

PubMed

Rasmussen, Kirsten; Rauscher, Hubert; Mech, Agnieszka; Riego Sintes, Juan; Gilliland, Douglas; González, Mar; Kearns, Peter; Moss, Kenneth; Visser, Maaike; Groenewold, Monique; Bleeker, Eric A J

2018-02-01

Identifying and characterising nanomaterials require additional information on physico-chemical properties and test methods, compared to chemicals in general. Furthermore, regulatory decisions for chemicals are usually based upon certain toxicological properties, and these effects may not be equivalent to those for nanomaterials. However, regulatory agencies lack an authoritative decision framework for nanomaterials that links the relevance of certain physico-chemical endpoints to toxicological effects. This paper investigates various physico-chemical endpoints and available test methods that could be used to produce such a decision framework for nanomaterials. It presents an overview of regulatory relevance and methods used for testing fifteen proposed physico-chemical properties of eleven nanomaterials in the OECD Working Party on Manufactured Nanomaterials' Testing Programme, complemented with methods from literature, and assesses the methods' adequacy and applications limits. Most endpoints are of regulatory relevance, though the specific parameters depend on the nanomaterial and type of assessment. Size (distribution) is the common characteristic of all nanomaterials and is decisive information for classifying a material as a nanomaterial. Shape is an important particle descriptor. The octanol-water partitioning coefficient is undefined for particulate nanomaterials. Methods, including sample preparation, need to be further standardised, and some new methods are needed. The current work of OECD's Test Guidelines Programme regarding physico-chemical properties is highlighted. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

A framework for evaluating the appropriateness of clinical decision support alerts and responses

PubMed Central

Waitman, Lemuel R; Lewis, Julia B; Wright, Julie A; Choma, David P; Miller, Randolph A; Peterson, Josh F

2011-01-01

Objective Alerting systems, a type of clinical decision support, are increasingly prevalent in healthcare, yet few studies have concurrently measured the appropriateness of alerts with provider responses to alerts. Recent reports of suboptimal alert system design and implementation highlight the need for better evaluation to inform future designs. The authors present a comprehensive framework for evaluating the clinical appropriateness of synchronous, interruptive medication safety alerts. Methods Through literature review and iterative testing, metrics were developed that describe successes, justifiable overrides, provider non-adherence, and unintended adverse consequences of clinical decision support alerts. The framework was validated by applying it to a medication alerting system for patients with acute kidney injury (AKI). Results Through expert review, the framework assesses each alert episode for appropriateness of the alert display and the necessity and urgency of a clinical response. Primary outcomes of the framework include the false positive alert rate, alert override rate, provider non-adherence rate, and rate of provider response appropriateness. Application of the framework to evaluate an existing AKI medication alerting system provided a more complete understanding of the process outcomes measured in the AKI medication alerting system. The authors confirmed that previous alerts and provider responses were most often appropriate. Conclusion The new evaluation model offers a potentially effective method for assessing the clinical appropriateness of synchronous interruptive medication alerts prior to evaluating patient outcomes in a comparative trial. More work can determine the generalizability of the framework for use in other settings and other alert types. PMID:21849334

WV R-EMAP STUDY: MULTIPLE-OBJECTIVE SAMPLING DESIGN FRAMEWORK

EPA Science Inventory

A multi-objective sampling design has been implemented through Regional Monitoring and Assessment Program (R-EMAP) support of a cooperative agreement with the state of West Virginia. Goals of the project include: 1) development and testing of a temperature-adjusted fish IBI for t...

Applying a dryland degradation framework for rangelands: the case of Mongolia.

PubMed

Jamsranjav, C; Reid, R S; Fernández-Giménez, M E; Tsevlee, A; Yadamsuren, B; Heiner, M

2018-04-01

Livestock-caused rangeland degradation remains a major policy concern globally and the subject of widespread scientific study. This concern persists in part because it is difficult to isolate the effects of livestock from climate and other factors that influence ecosystem conditions. Further, degradation studies seldom use multiple plant and soil indicators linked to a clear definition of and ecologically grounded framework for degradation assessment that distinguishes different levels of degradation. Here, we integrate two globally applicable rangeland degradation frameworks and apply them to a broad-scale empirical data set for the country of Mongolia. We compare our assessment results with two other recent national rangeland degradation assessments in Mongolia to gauge consistency of findings across assessments and evaluate the utility of our framework. We measured livestock-use impacts across Mongolia's major ecological zones: mountain and forest steppe, eastern steppe, steppe, and desert steppe. At 143 sites in 36 counties, we measured livestock-use and degradation indicators at increasing distances from livestock corrals in winter-grazed pastures. At each site, we measured multiple indicators linked to our degradation framework, including plant cover, standing biomass, palatability, species richness, forage quality, vegetation gaps, and soil surface characteristics. Livestock use had no effect on soils, plant species richness, or standing crop biomass in any ecological zone, but subtly affected plant cover and palatable plant abundance. Livestock effects were strongest in the steppe zone, moderate in the desert steppe, and limited in the mountain/forest and eastern steppes. Our results aligned closely with those of two other recent country-wide assessments, suggesting that our framework may have widespread application. All three assessments found that very severe and irreversible degradation is rare in Mongolia (1-18% of land area), with most rangelands slightly (33-53%) or moderately (25-40%) degraded. We conclude that very severe livestock-induced rangeland degradation is overstated in Mongolia. However, targeted rangeland restoration coupled with monitoring, adaptive management and stronger rangeland governance are needed to prevent further degradation where heavy grazing could cause irreversible change. Given the broad applicability of our degradation framework for Mongolia, we suggest it be tested for application in other temperate grasslands throughout Central Asia and North America. © 2018 The Authors Ecological Applications published by Wiley Periodicals, Inc. on behalf of Ecological Society of America.

'Healthy Eating and Lifestyle in Pregnancy (HELP)' trial: Process evaluation framework.

PubMed

Simpson, Sharon A; Cassidy, Dunla; John, Elinor

2014-07-01

We developed and tested in a cluster RCT a theory-driven group-based intervention for obese pregnant women. It was designed to support women to moderate weight gain during pregnancy and reduce BMI one year after birth, in addition to targeting secondary health and wellbeing outcomes. In line with MRC guidance on developing and evaluating complex interventions in health, we conducted a process evaluation alongside the trial. This paper describes the development of the process evaluation framework. This cluster RCT recruited 598 pregnant women. Women in the intervention group were invited to attend a weekly weight-management group. Following a review of relevant literature, we developed a process evaluation framework which outlined key process indicators that we wanted to address and how we would measure these. Central to the process evaluation was to understand the mechanism of effect of the intervention. We utilised a logic-modelling approach to describe the intervention which helped us focus on what potential mediators of intervention effect to measure, and how. The resulting process evaluation framework was designed to address 9 core elements; context, reach, exposure, recruitment, fidelity, recruitment, retention, contamination and theory-testing. These were assessed using a variety of qualitative and quantitative approaches. The logic model explained the processes by which intervention components bring about change in target outcomes through various mediators and theoretical pathways including self-efficacy, social support, self-regulation and motivation. Process evaluation is a key element in assessing the effect of any RCT. We developed a process evaluation framework and logic model, and the results of analyses using these will offer insights into why the intervention is or is not effective. Copyright © 2014.

Data Sufficiency Assessment and Pumping Test Design for Groundwater Prediction Using Decision Theory and Genetic Algorithms

NASA Astrophysics Data System (ADS)

McPhee, J.; William, Y. W.

2005-12-01

This work presents a methodology for pumping test design based on the reliability requirements of a groundwater model. Reliability requirements take into consideration the application of the model results in groundwater management, expressed in this case as a multiobjective management model. The pumping test design is formulated as a mixed-integer nonlinear programming (MINLP) problem and solved using a combination of genetic algorithm (GA) and gradient-based optimization. Bayesian decision theory provides a formal framework for assessing the influence of parameter uncertainty over the reliability of the proposed pumping test. The proposed methodology is useful for selecting a robust design that will outperform all other candidate designs under most potential 'true' states of the system

Computer Modeling of the Instructionally Insensitive Nature of the Texas Assessment of Knowledge and Skills (TAKS) Exam

NASA Astrophysics Data System (ADS)

Pham, Vinh Huy

Stakeholders of the educational system assume that standardized tests are transparently about the subject content being tested and therefore can be used as a metric to measure achievement in outcome-based educational reform. Both analysis of longitudinal data for the Texas Assessment of Knowledge and Skills (TAKS) exam and agent based computer modeling of its underlying theoretical testing framework have yielded results that indicate the exam only rank orders students on a persistent but uncharacterized latent trait across domains tested as well as across years. Such persistent rank ordering of students is indicative of an instructionally insensitive exam. This is problematic in the current atmosphere of high stakes testing which holds teachers, administrators, and school systems accountable for student achievement.

The HTA Core Model®-10 Years of Developing an International Framework to Share Multidimensional Value Assessment.

PubMed

Kristensen, Finn Børlum; Lampe, Kristian; Wild, Claudia; Cerbo, Marina; Goettsch, Wim; Becla, Lidia

2017-02-01

The HTA Core Model ® as a science-based framework for assessing dimensions of value was developed as a part of the European network for Health Technology Assessment project in the period 2006 to 2008 to facilitate production and sharing of health technology assessment (HTA) information, such as evidence on efficacy and effectiveness and patient aspects, to inform decisions. It covers clinical value as well as organizational, economic, and patient aspects of technologies and has been field-tested in two consecutive joint actions in the period 2010 to 2016. A large number of HTA institutions were involved in the work. The model has undergone revisions and improvement after iterations of piloting and can be used in a local, national, or international context to produce structured HTA information that can be taken forward by users into their own frameworks to fit their specific needs when informing decisions on technology. The model has a broad scope and offers a common ground to various stakeholders through offering a standard structure and a transparent set of proposed HTA questions. It consists of three main components: 1) the HTA ontology, 2) methodological guidance, and 3) a common reporting structure. It covers domains such as effectiveness, safety, and economics, and also includes domains covering organizational, patient, social, and legal aspects. There is a full model and a focused rapid relative effectiveness assessment model, and a third joint action is to continue till 2020. The HTA Core Model is now available for everyone around the world as a framework for assessing value. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Morphology predicts species' functional roles and their degree of specialization in plant-frugivore interactions.

PubMed

Dehling, D Matthias; Jordano, Pedro; Schaefer, H Martin; Böhning-Gaese, Katrin; Schleuning, Matthias

2016-01-27

Species' functional roles in key ecosystem processes such as predation, pollination or seed dispersal are determined by the resource use of consumer species. An interaction between resource and consumer species usually requires trait matching (e.g. a congruence in the morphologies of interaction partners). Species' morphology should therefore determine species' functional roles in ecological processes mediated by mutualistic or antagonistic interactions. We tested this assumption for Neotropical plant-bird mutualisms. We used a new analytical framework that assesses a species's functional role based on the analysis of the traits of its interaction partners in a multidimensional trait space. We employed this framework to test (i) whether there is correspondence between the morphology of bird species and their functional roles and (ii) whether morphologically specialized birds fulfil specialized functional roles. We found that morphological differences between bird species reflected their functional differences: (i) bird species with different morphologies foraged on distinct sets of plant species and (ii) morphologically distinct bird species fulfilled specialized functional roles. These findings encourage further assessments of species' functional roles through the analysis of their interaction partners, and the proposed analytical framework facilitates a wide range of novel analyses for network and community ecology. © 2016 The Author(s).

Enhancing a socio-hydrological modelling framework through field observations: a case study in India

NASA Astrophysics Data System (ADS)

den Besten, Nadja; Pande, Saket; Savenije, Huub H. G.

2016-04-01

Recently a smallholder socio-hydrological modelling framework was proposed and deployed to understand the underlying dynamics of Agrarian Crisis in Maharashtra state of India. It was found that cotton and sugarcane smallholders whom lack irrigation and storage techniques are most susceptible to distress. This study further expands the application of the modelling framework to other crops that are abundant in the state of Maharashtra, such as Paddy, Jowar and Soyabean to assess whether the conclusions on the possible causes behind smallholder distress still hold. Further, a fieldwork will be undertaken in March 2016 in the district of Pune. During the fieldwork 50 smallholders will be interviewed in which socio-hydrological assumptions on hydrology and capital equations and corresponding closure relationships, incorporated the current model, will be put to test. Besides the assumptions, the questionnaires will be used to better understand the hydrological reality of the farm holders, in terms of water usage and storage capacity. In combination with historical records on the smallholders' socio-economic data acquired over the last thirty years available through several NGOs in the region, socio-hydrological realism of the modelling framework will be enhanced. The preliminary outcomes of a desktop study show the possibilities of a water-centric modelling framework in understanding the constraints on smallholder farming. The results and methods described can be a first step guiding following research on the modelling framework: a start in testing the framework in multiple rural locations around the globe.

'Governance of' and 'Governance by': implementing a clinical governance framework in an area mental health service.

PubMed

O'Connor, Nick; Paton, Michael

2008-04-01

A framework developed to promote the understanding and application of clinical governance principles in an area mental health service is described. The framework is operationalized through systems, processes, roles and responsibilities. The development of an explicit and operationalizable framework for clinical governance arose from the authors' experiences in leading and managing mental health services. There is a particular emphasis on improvement of quality of care and patient safety. The framework is informed by recent developments in thinking about clinical governance, including key documents from Australia and the United Kingdom. The operational nature of the framework allows for key components of clinical governance to be described explicitly, communicated effectively, and continually tested and improved. Further consideration and assessment of the value of differing approaches to this task are required. For example, a general, illustrative approach to raise clinician awareness can be contrasted with prescriptive and specified approaches which progressively encompass the many functions and processes of a mental health service. Mental health clinicians and managers can be guided by a framework that will ensure safe, high quality and continually improving processes of care.

Assessing Students' Understanding of Macroevolution: Concerns regarding the validity of the MUM

NASA Astrophysics Data System (ADS)

Novick, Laura R.; Catley, Kefyn M.

2012-11-01

In a recent article, Nadelson and Southerland (2010. Development and preliminary evaluation of the Measure of Understanding of Macroevolution: Introducing the MUM. The Journal of Experimental Education, 78, 151-190) reported on their development of a multiple-choice concept inventory intended to assess college students' understanding of macroevolutionary concepts, the Measure of Understanding Macroevolution (MUM). Given that the only existing evolution inventories assess understanding of natural selection, a microevolutionary concept, a valid assessment of students' understanding of macroevolution would be a welcome and necessary addition to the field of science education. Although the conceptual framework underlying Nadelson and Southerland's test is promising, we believe the test has serious shortcomings with respect to validity evidence for the construct being tested. We argue and provide evidence that these problems are serious enough that the MUM should not be used in its current form to measure students' understanding of macroevolution.

Measurement and monitoring of safety: impact and challenges of putting a conceptual framework into practice.

PubMed

Chatburn, Eleanor; Macrae, Carl; Carthey, Jane; Vincent, Charles

2018-03-06

The Measurement and Monitoring of Safety Framework provides a conceptual model to guide organisations in assessing safety. The Health Foundation funded a large-scale programme to assess the value and impact of applying the Framework in regional and frontline care settings. We explored the experiences and reflections of key participants in the programme. The study was conducted in the nine healthcare organisations in England and Scotland testing the Framework (three regional improvement bodies, six frontline settings). Post hoc interviews with clinical and managerial staff were analysed using template analysis. Participants reported that the Framework promoted a substantial shift in their thinking about how safety is actively managed in their environment. It provided a common language, facilitated a more inquisitive approach and encouraged a more holistic view of the components of safety. These changes in conceptual understanding, however, did not always translate into broader changes in practice, with many sites only addressing some aspects of the Framework. One of the three regions did embrace the Framework in its entirety and achieved wider impact with a range of interventions. This region had committed leaders who took time to fully understand the concepts, who maintained a flexible approach to exploring the utility of the Framework and who worked with frontline staff to translate the concepts for local settings. The Measuring and Monitoring of Safety Framework has the potential to support a broader and richer approach to organisational safety. Such a conceptually based initiative requires both committed leaders who themselves understand the concepts and more time to establish understanding and aims than might be needed in a standard improvement programme. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

The Effect of Achievement Test Selection on Identification of Learning Disabilities within a Patterns of Strengths and Weaknesses Framework

PubMed Central

Miciak, Jeremy; Taylor, Pat; Denton, Carolyn A.; Fletcher, Jack M.

2014-01-01

Purpose Few empirical investigations have evaluated learning disabilities (LD) identification methods based on a pattern of cognitive strengths and weaknesses (PSW). This study investigated the reliability of LD classification decisions of the concordance/discordance method (C/DM) across different psychoeducational assessment batteries. Methods C/DM criteria were applied to assessment data from 177 second grade students based on two psychoeducational assessment batteries. The achievement tests were different, but were highly correlated and measured the same latent construct. Resulting LD identifications were then evaluated for agreement across batteries on LD status and the academic domain of eligibility. Results The two batteries identified a similar number of participants as having LD (80 and 74). However, indices of agreement for classification decisions were low (kappa = .29), especially for percent positive agreement (62%). The two batteries demonstrated agreement on the academic domain of eligibility for only 25 participants. Conclusions Cognitive discrepancy frameworks for LD identification are inherently unstable because of imperfect reliability and validity at the observed level. Methods premised on identifying a PSW profile may never achieve high reliability because of these underlying psychometric factors. An alternative is to directly assess academic skills to identify students in need of intervention. PMID:25243467

Applications of Automation Methods for Nonlinear Fracture Test Analysis

NASA Technical Reports Server (NTRS)

Allen, Phillip A.; Wells, Douglas N.

2013-01-01

As fracture mechanics material testing evolves, the governing test standards continue to be refined to better reflect the latest understanding of the physics of the fracture processes involved. The traditional format of ASTM fracture testing standards, utilizing equations expressed directly in the text of the standard to assess the experimental result, is self-limiting in the complexity that can be reasonably captured. The use of automated analysis techniques to draw upon a rich, detailed solution database for assessing fracture mechanics tests provides a foundation for a new approach to testing standards that enables routine users to obtain highly reliable assessments of tests involving complex, non-linear fracture behavior. Herein, the case for automating the analysis of tests of surface cracks in tension in the elastic-plastic regime is utilized as an example of how such a database can be generated and implemented for use in the ASTM standards framework. The presented approach forms a bridge between the equation-based fracture testing standards of today and the next generation of standards solving complex problems through analysis automation.

Development of a Conceptual Framework to Measure the Social Impact of Burns.

PubMed

Marino, Molly; Soley-Bori, Marina; Jette, Alan M; Slavin, Mary D; Ryan, Colleen M; Schneider, Jeffrey C; Resnik, Linda; Acton, Amy; Amaya, Flor; Rossi, Melinda; Soria-Saucedo, Rene; Kazis, Lewis E

Measuring community reintegration following burn injury is important to assess the efficacy of therapies designed to optimize recovery. This project aims to develop and validate a conceptual framework for understanding the social impact of burn injuries in adults. The framework is critical for developing the item banks used for a computerized adaptive test. We performed a comprehensive literature review and consulted with clinical experts and burn survivors about social life areas impacted by burn injury. Focus groups with burn survivors and clinicians were conducted to inform and validate the framework. Transcripts were coded using grounded theory methodology. The World Health Organization's International Classification of Functioning, Disability and Health, was chosen to ground the content model. The primary construct identified was social participation, which contains two concepts: societal role and personal relationships. The subdomains chosen for item development were work, recreation and leisure, relating with strangers, and romantic, sexual, family, and informal relationships. Qualitative results strongly suggest that the conceptual model fits the constructs for societal role and personal relationships with the respective subdomains. This conceptual framework has guided the implementation of a large-scale calibration study currently underway which will lead to a computerized adaptive test for monitoring the social impacts of burn injuries during recovery.

Application of a framework for extrapolating chemical effects across species in pathways controlled by estrogen receptor-á

EPA Science Inventory

Cross-species extrapolation of toxicity data from limited surrogate test organisms to all wildlife with potential of chemical exposure remains a key challenge in ecological risk assessment. A number of factors affect extrapolation, including the chemical exposure, pharmacokinetic...

Making and Measuring the California History Standards

ERIC Educational Resources Information Center

Fogo, Bradley

2011-01-01

The California history and social science standards-based reform has been touted as the "gold standard" for state history curricula. But the standards, framework, and tests that constitute this reform provide inconsistent and contradictory criteria for teaching and assessing history and social science. An examination of the political…

Assessment of wastewater treatment plant effluent on fish reproduction utilizing the adverse outcome pathway conceptual framework

EPA Science Inventory

Wastewater treatment plant (WWTP) effluents are a known contributor of chemical mixture inputs into the environment. Whole effluent testing guidelines were developed to screen these complex mixtures for acute toxicity. However, efficient and cost-effective approaches for screenin...

Advancing the adverse outcome pathway framework and its applications through a global horizon scanning exercise

EPA Science Inventory

Regulatory agencies worldwide are confronted with the challenging task of assessing the risks of thousands of chemicals to protect both human health and the environment. Traditional toxicity testing largely relies on apical endpoints from whole animal studies, which, in addition...

Trajectory-Based Performance Assessment for Aviation Weather Information

NASA Technical Reports Server (NTRS)

Vigeant-Langlois, Laurence; Hansman, R. John, Jr.

2003-01-01

Based on an analysis of aviation decision-makers' time-related weather information needs, an abstraction of the aviation weather decision task was developed, that involves 4-D intersection testing between aircraft trajectory hypertubes and hazardous weather hypervolumes. The framework builds on the hypothesis that hazardous meteorological fields can be simplified using discrete boundaries of surrogate threat attributes. The abstractions developed in the framework may be useful in studying how to improve the performance of weather forecasts from the trajectory-centric perspective, as well as for developing useful visualization techniques of weather information.

Towards a common oil spill risk assessment framework – Adapting ISO 31000 and addressing uncertainties.

PubMed

Sepp Neves, Antonio Augusto; Pinardi, Nadia; Martins, Flavio; Janeiro, Joao; Samaras, Achilleas; Zodiatis, George; De Dominicis, Michela

2015-08-15

Oil spills are a transnational problem, and establishing a common standard methodology for Oil Spill Risk Assessments (OSRAs) is thus paramount in order to protect marine environments and coastal communities. In this study we firstly identified the strengths and weaknesses of the OSRAs carried out in various parts of the globe. We then searched for a generic and recognized standard, i.e. ISO 31000, in order to design a method to perform OSRAs in a scientific and standard way. The new framework was tested for the Lebanon oil spill that occurred in 2006 employing ensemble oil spill modeling to quantify the risks and uncertainties due to unknown spill characteristics. The application of the framework generated valuable visual instruments for the transparent communication of the risks, replacing the use of risk tolerance levels, and thus highlighting the priority areas to protect in case of an oil spill. Copyright © 2015 Elsevier Ltd. All rights reserved.

Analysis of key technologies for virtual instruments metrology

NASA Astrophysics Data System (ADS)

Liu, Guixiong; Xu, Qingui; Gao, Furong; Guan, Qiuju; Fang, Qiang

2008-12-01

Virtual instruments (VIs) require metrological verification when applied as measuring instruments. Owing to the software-centered architecture, metrological evaluation of VIs includes two aspects: measurement functions and software characteristics. Complexity of software imposes difficulties on metrological testing of VIs. Key approaches and technologies for metrology evaluation of virtual instruments are investigated and analyzed in this paper. The principal issue is evaluation of measurement uncertainty. The nature and regularity of measurement uncertainty caused by software and algorithms can be evaluated by modeling, simulation, analysis, testing and statistics with support of powerful computing capability of PC. Another concern is evaluation of software features like correctness, reliability, stability, security and real-time of VIs. Technologies from software engineering, software testing and computer security domain can be used for these purposes. For example, a variety of black-box testing, white-box testing and modeling approaches can be used to evaluate the reliability of modules, components, applications and the whole VI software. The security of a VI can be assessed by methods like vulnerability scanning and penetration analysis. In order to facilitate metrology institutions to perform metrological verification of VIs efficiently, an automatic metrological tool for the above validation is essential. Based on technologies of numerical simulation, software testing and system benchmarking, a framework for the automatic tool is proposed in this paper. Investigation on implementation of existing automatic tools that perform calculation of measurement uncertainty, software testing and security assessment demonstrates the feasibility of the automatic framework advanced.

Validity and reliability of portfolio assessment of student competence in two dental school populations: a four-year study.

PubMed

Gadbury-Amyot, Cynthia C; McCracken, Michael S; Woldt, Janet L; Brennan, Robert L

2014-05-01

The purpose of this study was to empirically investigate the validity and reliability of portfolio assessment in two U.S. dental schools using a unified framework for validity. In the process of validation, it is not the test that is validated but rather the claims (interpretations and uses) about test scores that are validated. Kane's argument-based validation framework provided the structure for reporting results where validity claims are followed by evidence to support the argument. This multivariate generalizability theory study found that the greatest source of variance was attributable to faculty raters, suggesting that portfolio assessment would benefit from two raters' evaluating each portfolio independently. The results are generally supportive of holistic scoring, but analytical scoring deserves further research. Correlational analyses between student portfolios and traditional measures of student competence and readiness for licensure resulted in significant correlations between portfolios and National Board Dental Examination Part I (r=0.323, p<0.01) and Part II scores (r=0.268, p<0.05) and small and non-significant correlations with grade point average and scores on the Western Regional Examining Board (WREB) exam. It is incumbent upon the users of portfolio assessment to determine if the claims and evidence arguments set forth in this study support the proposed claims for and decisions about portfolio assessment in their respective institutions.

Measures of the recovery orientation of mental health services: systematic review.

PubMed

Williams, J; Leamy, M; Bird, V; Harding, C; Larsen, J; Le Boutillier, C; Oades, L; Slade, M

2012-11-01

The review aimed to (1) identify measures that assess the recovery orientation of services; (2) discuss how these measures have conceptualised recovery, and (3) characterise their psychometric properties. A systematic review was undertaken using seven sources. The conceptualisation of recovery within each measure was investigated by rating items against a conceptual framework of recovery comprising five recovery processes: connectedness; hope and optimism; identity; meaning and purpose; and empowerment. Psychometric properties of measures were evaluated using quality criteria. Thirteen recovery orientation measures were identified, of which six met eligibility criteria. No measure was a good fit with the conceptual framework. No measure had undergone extensive psychometric testing and none had data on test-retest reliability or sensitivity to change. Many measures have been developed to assess the recovery orientation of services. Comparisons between the measures were hampered by the different conceptualisations of recovery used and by the lack of uniformity on the level of organisation at which services were assessed. This situation makes it a challenge for services and researchers to make an informed choice on which measure to use. Further work is needed to produce measures with a transparent conceptual underpinning and demonstrated psychometric properties.

Operationalizing the Reciprocal Engagement Model of Genetic Counseling Practice: a Framework for the Scalable Delivery of Genomic Counseling and Testing.

PubMed

Schmidlen, Tara; Sturm, Amy C; Hovick, Shelly; Scheinfeldt, Laura; Scott Roberts, J; Morr, Lindsey; McElroy, Joseph; Toland, Amanda E; Christman, Michael; O'Daniel, Julianne M; Gordon, Erynn S; Bernhardt, Barbara A; Ormond, Kelly E; Sweet, Kevin

2018-02-19

With the advent of widespread genomic testing for diagnostic indications and disease risk assessment, there is increased need to optimize genetic counseling services to support the scalable delivery of precision medicine. Here, we describe how we operationalized the reciprocal engagement model of genetic counseling practice to develop a framework of counseling components and strategies for the delivery of genomic results. This framework was constructed based upon qualitative research with patients receiving genomic counseling following online receipt of potentially actionable complex disease and pharmacogenomics reports. Consultation with a transdisciplinary group of investigators, including practicing genetic counselors, was sought to ensure broad scope and applicability of these strategies for use with any large-scale genomic testing effort. We preserve the provision of pre-test education and informed consent as established in Mendelian/single-gene disease genetic counseling practice. Following receipt of genomic results, patients are afforded the opportunity to tailor the counseling agenda by selecting the specific test results they wish to discuss, specifying questions for discussion, and indicating their preference for counseling modality. The genetic counselor uses these patient preferences to set the genomic counseling session and to personalize result communication and risk reduction recommendations. Tailored visual aids and result summary reports divide areas of risk (genetic variant, family history, lifestyle) for each disease to facilitate discussion of multiple disease risks. Post-counseling, session summary reports are actively routed to both the patient and their physician team to encourage review and follow-up. Given the breadth of genomic information potentially resulting from genomic testing, this framework is put forth as a starting point to meet the need for scalable genetic counseling services in the delivery of precision medicine.

Evaluation of the Performance of Routine Information System Management (PRISM) framework: evidence from Uganda.

PubMed

Hotchkiss, David R; Aqil, Anwer; Lippeveld, Theo; Mukooyo, Edward

2010-07-03

Sound policy, resource allocation and day-to-day management decisions in the health sector require timely information from routine health information systems (RHIS). In most low- and middle-income countries, the RHIS is viewed as being inadequate in providing quality data and continuous information that can be used to help improve health system performance. In addition, there is limited evidence on the effectiveness of RHIS strengthening interventions in improving data quality and use. The purpose of this study is to evaluate the usefulness of the newly developed Performance of Routine Information System Management (PRISM) framework, which consists of a conceptual framework and associated data collection and analysis tools to assess, design, strengthen and evaluate RHIS. The specific objectives of the study are: a) to assess the reliability and validity of the PRISM instruments and b) to assess the validity of the PRISM conceptual framework. Facility- and worker-level data were collected from 110 health care facilities in twelve districts in Uganda in 2004 and 2007 using records reviews, structured interviews and self-administered questionnaires. The analysis procedures include Cronbach's alpha to assess internal consistency of selected instruments, test-retest analysis to assess the reliability and sensitivity of the instruments, and bivariate and multivariate statistical techniques to assess validity of the PRISM instruments and conceptual framework. Cronbach's alpha analysis suggests high reliability (0.7 or greater) for the indices measuring a promotion of a culture of information, RHIS tasks self-efficacy and motivation. The study results also suggest that a promotion of a culture of information influences RHIS tasks self-efficacy, RHIS tasks competence and motivation, and that self-efficacy and the presence of RHIS staff have a direct influence on the use of RHIS information, a key aspect of RHIS performance. The study results provide some empirical support for the reliability and validity of the PRISM instruments and the validity of the PRISM conceptual framework, suggesting that the PRISM approach can be effectively used by RHIS policy makers and practitioners to assess the RHIS and evaluate RHIS strengthening interventions. However, additional studies with larger sample sizes are needed to further investigate the value of the PRISM instruments in exploring the linkages between RHIS data quality and use, and health systems performance.

A generalized plate method for estimating total aerobic microbial count.

PubMed

Ho, Kai Fai

2004-01-01

The plate method outlined in Chapter 61: Microbial Limit Tests of the U.S. Pharmacopeia (USP 61) provides very specific guidance for assessing total aerobic bioburden in pharmaceutical articles. This methodology, while comprehensive, lacks the flexibility to be useful in all situations. By studying the plate method as a special case within a more general family of assays, the effects of each parameter in the guidance can be understood. Using a mathematical model to describe the plate counting procedure, a statistical framework for making more definitive statements about total aerobic bioburden is developed. Such a framework allows the laboratory scientist to adjust the USP 61 methods to satisfy specific practical constraints. In particular, it is shown that the plate method can be conducted, albeit with stricter acceptance criteria, using a test specimen quantity that is smaller than the 10 g or 10 mL prescribed in the guidance. Finally, the interpretation of results proffered by the guidance is re-examined within this statistical framework and shown to be overly aggressive.

Clinical validity of delayed recall tests as a gateway biomarker for Alzheimer's disease in the context of a structured 5-phase development framework.

PubMed

Cerami, Chiara; Dubois, Bruno; Boccardi, Marina; Monsch, Andreas U; Demonet, Jean Francois; Cappa, Stefano F

2017-04-01

Although Alzheimer's disease criteria promote the use of biomarkers, their maturity in clinical routine still needs to be assessed. In the light of the oncology framework, we conducted a literature review on measures used to assess delayed recall impairment due to medial temporal lobe dysfunction (i.e., free and cued word list recall tests). Ample evidence is available for phases 1 (rationale for use), 2 (discriminative ability), and 3 (early detection ability) for many of the tests in routine use. Evidence about phase 4 (performance in real world) and phase 5 (quantify impact and costs) is yet to come. Administration procedures have been standardized and cutoff scores are well validated in large Alzheimer's disease and mild cognitive impaired series. Some aspects (e.g., different task formats), however, hamper the comparability of results among different populations and the reproducibility between laboratories. No definite guideline for their use can thus be proposed at the moment. Accordingly, the maturity of such markers is not yet sufficient and requires future investigation to promote the proper use of memory measures in clinical settings. Copyright © 2016 Elsevier Inc. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Slunge, Daniel, E-mail: daniel.slunge@economics.gu.se; Tran, Trang Thi Huyen, E-mail: trang2k@yahoo.com

Building on new institutional theory, this paper develops an analytical framework for analyzing constraints to the institutionalization of strategic environmental assessment (SEA) at four different institutional levels. The framework is tested in an empirical analysis of the environmental assessment system in Vietnam, which is a frontrunner among developing countries regarding the introduction and use of SEA. Building on interviews with Vietnamese and international experts, as well as an extensive literature review, we identify institutional constraints which challenge the effective use of SEA in Vietnam. We conclude that commonly identified constraints, such as inadequate training, technical guidelines, baseline data and financialmore » resources, are strongly linked to constraints at higher institutional levels, such as incentives to not share information between ministries and severe restrictions on access to information and public participation. Without a thorough understanding of these institutional constraints, there is a risk that attempts to improve the use of SEA are misdirected. Thus, a careful institutional analysis should guide efforts to introduce and improve the use of SEA in Vietnam and other developing countries. The analytical framework for analyzing constraints to institutionalization of SEA presented in this paper represents a systematic effort in this direction. - Highlights: • A framework for analyzing constraints to institutionalizing SEA is developed • Empirical analysis of the strategic environmental assessment system in Vietnam • Constraints in the action arena linked to deeper institutional constraints • Institutional analysis needed prior to introducing SEA in developing countries.« less

77 FR 44613 - Notice of Availability of the External Review Draft of Framework for Human Health Risk Assessment...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-07-30

... External Review Draft of Framework for Human Health Risk Assessment To Inform Decision Making AGENCY: U.S... external review draft of ``A Framework for Human Health Risk Assessment to Inform Decision Making.'' This... a framework for conducting human health risk assessments that are responsive to the needs of...

Frameworks for Assessing the Quality of Modeling and Simulation Capabilities

NASA Astrophysics Data System (ADS)

Rider, W. J.

2012-12-01

The importance of assuring quality in modeling and simulation has spawned several frameworks for structuring the examination of quality. The format and content of these frameworks provides an emphasis, completeness and flow to assessment activities. I will examine four frameworks that have been developed and describe how they can be improved and applied to a broader set of high consequence applications. Perhaps the first of these frameworks was known as CSAU [Boyack] (code scaling, applicability and uncertainty) used for nuclear reactor safety and endorsed the United States' Nuclear Regulatory Commission (USNRC). This framework was shaped by nuclear safety practice, and the practical structure needed after the Three Mile Island accident. It incorporated the dominant experimental program, the dominant analysis approach, and concerns about the quality of modeling. The USNRC gave it the force of law that made the nuclear industry take it seriously. After the cessation of nuclear weapons' testing the United States began a program of examining the reliability of these weapons without testing. This program utilizes science including theory, modeling, simulation and experimentation to replace the underground testing. The emphasis on modeling and simulation necessitated attention on the quality of these simulations. Sandia developed the PCMM (predictive capability maturity model) to structure this attention [Oberkampf]. PCMM divides simulation into six core activities to be examined and graded relative to the needs of the modeling activity. NASA [NASA] has built yet another framework in response to the tragedy of the space shuttle accidents. Finally, Ben-Haim and Hemez focus upon modeling robustness and predictive fidelity in another approach. These frameworks are similar, and applied in a similar fashion. The adoption of these frameworks at Sandia and NASA has been slow and arduous because the force of law has not assisted acceptance. All existing frameworks are incomplete and need to be extended incorporating elements from the other as well as new elements related to how models are solved, and how the model will be applied. I will describe this merger of approach and how it should be applied. The problems in adoption are related to basic human nature in that no one likes to be graded, or told they are not sufficiently quality oriented. Rather than engage in an adversarial role, I suggest that the frameworks be viewed as a collaborative tool. Instead these frameworks should be used to structure collaborations that can be used to assist the modeling and simulation efforts to be high quality. The framework provides a comprehensive setting of modeling and simulation themes that should be explored in providing high quality. W. Oberkampf, M. Pilch, and T. Trucano, Predictive Capability Maturity Model for Computational Modeling and Simulation, SAND2007-5948, 2007. B. Boyack, Quantifying Reactor Safety Margins Part 1: An Overview of the Code Scaling, Applicability, and Uncertainty Evaluation Methodology, Nuc. Eng. Design, 119, pp. 1-15, 1990. National Aeronautics and Space Administration, STANDARD FOR MODELS AND SIMULATIONS, NASA-STD-7009, 2008. Y. Ben-Haim and F. Hemez, Robustness, fidelity and prediction-looseness of models, Proc. R. Soc. A (2012) 468, 227-244.

A multi-data stream assimilation framework for the assessment of volcanic unrest

NASA Astrophysics Data System (ADS)

Gregg, Patricia M.; Pettijohn, J. Cory

2016-01-01

Active volcanoes pose a constant risk to populations living in their vicinity. Significant effort has been spent to increase monitoring and data collection campaigns to mitigate potential volcano disasters. To utilize these datasets to their fullest extent, a new generation of model-data fusion techniques is required that combine multiple, disparate observations of volcanic activity with cutting-edge modeling techniques to provide efficient assessment of volcanic unrest. The purpose of this paper is to develop a data assimilation framework for volcano applications. Specifically, the Ensemble Kalman Filter (EnKF) is adapted to assimilate GPS and InSAR data into viscoelastic, time-forward, finite element models of an evolving magma system to provide model forecasts and error estimations. Since the goal of this investigation is to provide a methodological framework, our efforts are focused on theoretical development and synthetic tests to illustrate the effectiveness of the EnKF and its applicability in physical volcanology. The synthetic tests provide two critical results: (1) a proof of concept for using the EnKF for multi dataset assimilation in investigations of volcanic activity; and (2) the comparison of spatially limited, but temporally dense, GPS data with temporally limited InSAR observations for evaluating magma chamber dynamics during periods of volcanic unrest. Results indicate that the temporally dense information provided by GPS observations results in faster convergence and more accurate model predictions. However, most importantly, the synthetic tests illustrate that the EnKF is able to swiftly respond to data updates by changing the model forecast trajectory to match incoming observations. The synthetic results demonstrate a great potential for utilizing the EnKF model-data fusion method to assess volcanic unrest and provide model forecasts. The development of these new techniques provides: (1) a framework for future applications of rapid data assimilation and model development during volcanic crises; (2) a method for hind-casting to investigate previous volcanic eruptions, including potential eruption triggering mechanisms and precursors; and (3) an approach for optimizing survey designs for future data collection campaigns at active volcanic systems.

Using a social capital framework to enhance measurement of the nursing work environment.

PubMed

Sheingold, Brenda Helen; Sheingold, Steven H

2013-07-01

To develop, field test and analyse a social capital survey instrument for measuring the nursing work environment. The concept of social capital, which focuses on improving productive capacity by examining relationships and networks, may provide a promising framework to measure and evaluate the nurse work environment in a variety of settings. A survey instrument for measuring social capital in the nurse work environment was developed by adapting the World Bank's Social Capital - Integrated Questionnaire (SC-IQ). Exploratory factor analysis and multiple regression analyses were applied to assess the properties of the instrument. The exploratory factor analysis yielded five factors that align well with the social capital framework, while reflecting unique aspects of the nurse work environment. The results suggest that the social capital framework provides a promising context to assess the nurse work environment. Further work is needed to refine the instrument for a diverse range of health-care providers and to correlate social capital measures with quality of patient care. Social capital measurement of the nurse work environment has the potential to provide managers with an enhanced set of tools for building productive capacity in health-care organisations and achieving desired outcomes. © 2013 John Wiley & Sons Ltd.

Spatial, temporal, and experimental: three study-design cornerstones for establishing defensible numeric criteria for freshwater ecosystems

USDA-ARS?s Scientific Manuscript database

Robust stressor-response measures are needed to inform nutrient criteria development and protect inland waters from impacts associated with eutrophication. We tested a framework to help inform criteria development that relies on assessing stream assemblage responses to phosphorus (P) enrichment acro...

Web-Compatible Graphics Visualization Framework for Online Instruction and Assessment of Hardware Concepts

ERIC Educational Resources Information Center

Chandramouli, Magesh; Chittamuru, Siva-Teja

2016-01-01

This paper explains the design of a graphics-based virtual environment for instructing computer hardware concepts to students, especially those at the beginner level. Photorealistic visualizations and simulations are designed and programmed with interactive features allowing students to practice, explore, and test themselves on computer hardware…

TOEFL from a Communicative Viewpoint on Language Proficiency: A Working Paper.

ERIC Educational Resources Information Center

Duran, Richard P.; And Others

The content characteristics of the Test of English as a Foreign Language (TOEFL) are examined from a communicative viewpoint, based on current theory in applied linguistics and language proficiency assessment. The study employed a four-part operational framework. The first component analyzed the communicative characteristics of a language…

A Profile of Advanced Writing Performance: Putting Some Flesh on the Bones

ERIC Educational Resources Information Center

Morgan, Siân

2012-01-01

The "Common European Framework of Reference for Languages" (CEFR) has prompted much reflection on language testing and raised awareness of the importance of standardisation in assessing English for academic and professional purposes in an increasingly globalised world. Criticism has nevertheless been levelled at CEFR profiles for being…

Development and Use of the Leaching Environmental Assessment Framework in the United States

EPA Science Inventory

The purpose of this presentation is to provide technical expertise at an upcoming workshop to discuss the use of EPA’s new leaching tests at a workshop on “Risk Informed Approaches and Regulations for Reclamation, Treatment, Use orDisposal”. This presentation has been requested b...

Advances in Methods for Assessing Longitudinal Change

ERIC Educational Resources Information Center

Grimm, Kevin J.; Mazza, Gina L.; Mazzocco, Michèle M. M.

2016-01-01

Educational research aims to understand how and why students change over time. With its emphasis on within-person change, latent change score models provide educational researchers with a more general and flexible framework for testing nuanced hypotheses regarding within-person change and between-person differences in within-person change. Models…

The Implicit Curriculum in an Urban University Setting: Pathways to Students' Empowerment

ERIC Educational Resources Information Center

Peterson, N. Andrew; Farmer, Antoinette Y.; Zippay, Allison

2014-01-01

Professional schools are developing conceptual frameworks that can be used to assess and improve implicit curricula. Students' professional empowerment, defined to include perceived professional competence and identity, may be considered a vital outcome of these efforts. Our study evaluated measures and tested a path model that included…

Effects of chlorpyrifos and TCP on human kidney cells using toxicity testing and proteomics

EPA Science Inventory

An Adverse Outcome Pathway (AOP) is a conceptual framework to apply molecular pathway-based data for use in risk assessment and regulatory decision support. The development of AOPs requires data on the effects of chemicals on biological processes (i.e., molecular initiating event...

Decision making about healthcare-related tests and diagnostic test strategies. Paper 2: a review of methodological and practical challenges.

PubMed

Mustafa, Reem A; Wiercioch, Wojtek; Cheung, Adrienne; Prediger, Barbara; Brozek, Jan; Bossuyt, Patrick; Garg, Amit X; Lelgemann, Monika; Büehler, Diedrich; Schünemann, Holger J

2017-12-01

In this first of a series of five articles, we provide an overview of how and why healthcare-related tests and diagnostic strategies are currently applied. We also describe how our findings can be integrated with existing frameworks for making decisions that guide the use of healthcare-related tests and diagnostic strategies. We searched MEDLINE, references of identified articles, chapters in relevant textbooks, and identified articles citing classic literature on this topic. We provide updated frameworks for the potential roles and applications of tests with suggested definitions and practical examples. We also discuss study designs that are commonly used to assess tests' performance and the effects of tests on people's health. These designs include diagnostic randomized controlled trials and retrospective validation. We describe the utility of these and other currently suggested designs, which questions they can answer and which ones they cannot. In addition, we summarize the challenges unique to decision-making resulting from the use of tests. This overview highlights current challenges in the application of tests in decision-making in healthcare, provides clarifications, and informs the proposed solutions. Copyright © 2017 Elsevier Inc. All rights reserved.

Application of a framework for extrapolating chemical effects ...

EPA Pesticide Factsheets

Cross-species extrapolation of toxicity data from limited surrogate test organisms to all wildlife with potential of chemical exposure remains a key challenge in ecological risk assessment. A number of factors affect extrapolation, including the chemical exposure, pharmacokinetics, life-stage, and pathway similarities/differences. Here we propose a framework using a tiered approach for species extrapolation that enables a transparent weight-of-evidence driven evaluation of pathway conservation (or lack thereof) in the context of adverse outcome pathways. Adverse outcome pathways describe the linkages from a molecular initiating event, defined as the chemical-biomolecule interaction, through subsequent key events leading to an adverse outcome of regulatory concern (e.g., mortality, reproductive dysfunction). Tier 1 of the extrapolation framework employs in silico evaluations of sequence and structural conservation of molecules (e.g., receptors, enzymes) associated with molecular initiating events or upstream key events. Such evaluations make use of available empirical and sequence data to assess taxonomic relevance. Tier 2 uses in vitro bioassays, such as enzyme inhibition/activation, competitive receptor binding, and transcriptional activation assays to explore functional conservation of pathways across taxa. Finally, Tier 3 provides a comparative analysis of in vivo responses between species utilizing well-established model organisms to assess departure from

Medical school benchmarking - from tools to programmes.

PubMed

Wilkinson, Tim J; Hudson, Judith N; Mccoll, Geoffrey J; Hu, Wendy C Y; Jolly, Brian C; Schuwirth, Lambert W T

2015-02-01

Benchmarking among medical schools is essential, but may result in unwanted effects. To apply a conceptual framework to selected benchmarking activities of medical schools. We present an analogy between the effects of assessment on student learning and the effects of benchmarking on medical school educational activities. A framework by which benchmarking can be evaluated was developed and applied to key current benchmarking activities in Australia and New Zealand. The analogy generated a conceptual framework that tested five questions to be considered in relation to benchmarking: what is the purpose? what are the attributes of value? what are the best tools to assess the attributes of value? what happens to the results? and, what is the likely "institutional impact" of the results? If the activities were compared against a blueprint of desirable medical graduate outcomes, notable omissions would emerge. Medical schools should benchmark their performance on a range of educational activities to ensure quality improvement and to assure stakeholders that standards are being met. Although benchmarking potentially has positive benefits, it could also result in perverse incentives with unforeseen and detrimental effects on learning if it is undertaken using only a few selected assessment tools.

International framework for examination of the cervical region for potential of Cervical Arterial Dysfunction prior to Orthopaedic Manual Therapy intervention.

PubMed

Rushton, A; Rivett, D; Carlesso, L; Flynn, T; Hing, W; Kerry, R

2014-06-01

A consensus clinical reasoning framework for best practice for the examination of the cervical spine region has been developed through an iterative consultative process with experts and manual physical therapy organisations. The framework was approved by the 22 member countries of the International Federation of Orthopaedic Manipulative Physical Therapists (October 2012). The purpose of the framework is to provide guidance to clinicians for the assessment of the cervical region for potential of Cervical Arterial Dysfunction in advance of planned management (inclusive of manual therapy and exercise interventions). The best, most recent scientific evidence is combined with international expert opinion, and is presented with the intention to be informative, but not prescriptive; and therefore as an aid to the clinician's clinical reasoning. Important underlying principles of the framework are that 1] although presentations and adverse events of Cervical Arterial Dysfunction are rare, it is a potentially serious condition and needs to be considered in musculoskeletal assessment; 2] manual therapists cannot rely on the results of one clinical test to draw conclusions as to the presence or risk of Cervical Arterial Dysfunction; and 3] a clinically reasoned understanding of the patient's presentation, including a risk:benefit analysis, following an informed, planned and individualised assessment, is essential for recognition of this condition and for safe manual therapy practice in the cervical region. Clinicians should also be cognisant of jurisdictionally specific requirements and obligations, particularly related to patient informed consent, when intending to use manual therapy in the cervical region. Copyright © 2013 Elsevier Ltd. All rights reserved.

A Framework for the Next Generation of Risk Science

PubMed Central

Krewski, Daniel; Andersen, Melvin E.; Paoli, Gregory M.; Chiu, Weihsueh A.; Al-Zoughool, Mustafa; Croteau, Maxine C.; Burgoon, Lyle D.; Cote, Ila

2014-01-01

Objectives: In 2011, the U.S. Environmental Protection Agency initiated the NexGen project to develop a new paradigm for the next generation of risk science. Methods: The NexGen framework was built on three cornerstones: the availability of new data on toxicity pathways made possible by fundamental advances in basic biology and toxicological science, the incorporation of a population health perspective that recognizes that most adverse health outcomes involve multiple determinants, and a renewed focus on new risk assessment methodologies designed to better inform risk management decision making. Results: The NexGen framework has three phases. Phase I (objectives) focuses on problem formulation and scoping, taking into account the risk context and the range of available risk management decision-making options. Phase II (risk assessment) seeks to identify critical toxicity pathway perturbations using new toxicity testing tools and technologies, and to better characterize risks and uncertainties using advanced risk assessment methodologies. Phase III (risk management) involves the development of evidence-based population health risk management strategies of a regulatory, economic, advisory, community-based, or technological nature, using sound principles of risk management decision making. Conclusions: Analysis of a series of case study prototypes indicated that many aspects of the NexGen framework are already beginning to be adopted in practice. Citation: Krewski D, Westphal M, Andersen ME, Paoli GM, Chiu WA, Al-Zoughool M, Croteau MC, Burgoon LD, Cote I. 2014. A framework for the next generation of risk science. Environ Health Perspect 122:796–805; http://dx.doi.org/10.1289/ehp.1307260 PMID:24727499

Visualizing statistical significance of disease clusters using cartograms.

PubMed

Kronenfeld, Barry J; Wong, David W S

2017-05-15

Health officials and epidemiological researchers often use maps of disease rates to identify potential disease clusters. Because these maps exaggerate the prominence of low-density districts and hide potential clusters in urban (high-density) areas, many researchers have used density-equalizing maps (cartograms) as a basis for epidemiological mapping. However, we do not have existing guidelines for visual assessment of statistical uncertainty. To address this shortcoming, we develop techniques for visual determination of statistical significance of clusters spanning one or more districts on a cartogram. We developed the techniques within a geovisual analytics framework that does not rely on automated significance testing, and can therefore facilitate visual analysis to detect clusters that automated techniques might miss. On a cartogram of the at-risk population, the statistical significance of a disease cluster is determinate from the rate, area and shape of the cluster under standard hypothesis testing scenarios. We develop formulae to determine, for a given rate, the area required for statistical significance of a priori and a posteriori designated regions under certain test assumptions. Uniquely, our approach enables dynamic inference of aggregate regions formed by combining individual districts. The method is implemented in interactive tools that provide choropleth mapping, automated legend construction and dynamic search tools to facilitate cluster detection and assessment of the validity of tested assumptions. A case study of leukemia incidence analysis in California demonstrates the ability to visually distinguish between statistically significant and insignificant regions. The proposed geovisual analytics approach enables intuitive visual assessment of statistical significance of arbitrarily defined regions on a cartogram. Our research prompts a broader discussion of the role of geovisual exploratory analyses in disease mapping and the appropriate framework for visually assessing the statistical significance of spatial clusters.

ECTA/DaSy Framework Self-Assessment Comparison Tool

ERIC Educational Resources Information Center

Center for IDEA Early Childhood Data Systems (DaSy), 2016

2016-01-01

The Self-Assessment Comparison (SAC) Tool is for state Part C and Section 619/Preschool programs to use to assess changes in the implementation of one or more components of the ECTA System Framework and/or subcomponenets of the DaSy Data System Framework. It is a companion to the ECTA/DaSy Framework Self-Assessment. Key features of the SAC are…

Non-conscious processes in changing health-related behaviour: a conceptual analysis and framework

PubMed Central

Hollands, Gareth J.; Marteau, Theresa M.; Fletcher, Paul C.

2016-01-01

ABSTRACT Much of the global burden of non-communicable disease is caused by unhealthy behaviours that individuals enact even when informed of their health-harming consequences. A key insight is that these behaviours are not predominantly driven by deliberative conscious decisions, but occur directly in response to environmental cues and without necessary representation of their consequences. Consequently, interventions that target non-conscious rather than conscious processes to change health behaviour may have significant potential, but this important premise remains largely untested. This is in part due to the lack of a practicable conceptual framework that can be applied to better describe and assess these interventions. We propose a framework for describing or categorising interventions to change health behaviour by the degree to which their effects may be considered non-conscious. Potential practical issues with applying such a framework are discussed, as are the implications for further research to inform the testing and development of interventions. A pragmatic means of conceptualising interventions targeted at non-conscious processes is a necessary prelude to testing the potency of such interventions. This can ultimately inform the development of interventions with the potential to shape healthier behaviours across populations. PMID:26745243

Non-conscious processes in changing health-related behaviour: a conceptual analysis and framework.

PubMed

Hollands, Gareth J; Marteau, Theresa M; Fletcher, Paul C

2016-12-01

Much of the global burden of non-communicable disease is caused by unhealthy behaviours that individuals enact even when informed of their health-harming consequences. A key insight is that these behaviours are not predominantly driven by deliberative conscious decisions, but occur directly in response to environmental cues and without necessary representation of their consequences. Consequently, interventions that target non-conscious rather than conscious processes to change health behaviour may have significant potential, but this important premise remains largely untested. This is in part due to the lack of a practicable conceptual framework that can be applied to better describe and assess these interventions. We propose a framework for describing or categorising interventions to change health behaviour by the degree to which their effects may be considered non-conscious. Potential practical issues with applying such a framework are discussed, as are the implications for further research to inform the testing and development of interventions. A pragmatic means of conceptualising interventions targeted at non-conscious processes is a necessary prelude to testing the potency of such interventions. This can ultimately inform the development of interventions with the potential to shape healthier behaviours across populations.

KNODWAT: A scientific framework application for testing knowledge discovery methods for the biomedical domain

PubMed Central

2013-01-01

Background Professionals in the biomedical domain are confronted with an increasing mass of data. Developing methods to assist professional end users in the field of Knowledge Discovery to identify, extract, visualize and understand useful information from these huge amounts of data is a huge challenge. However, there are so many diverse methods and methodologies available, that for biomedical researchers who are inexperienced in the use of even relatively popular knowledge discovery methods, it can be very difficult to select the most appropriate method for their particular research problem. Results A web application, called KNODWAT (KNOwledge Discovery With Advanced Techniques) has been developed, using Java on Spring framework 3.1. and following a user-centered approach. The software runs on Java 1.6 and above and requires a web server such as Apache Tomcat and a database server such as the MySQL Server. For frontend functionality and styling, Twitter Bootstrap was used as well as jQuery for interactive user interface operations. Conclusions The framework presented is user-centric, highly extensible and flexible. Since it enables methods for testing using existing data to assess suitability and performance, it is especially suitable for inexperienced biomedical researchers, new to the field of knowledge discovery and data mining. For testing purposes two algorithms, CART and C4.5 were implemented using the WEKA data mining framework. PMID:23763826

DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs

NASA Astrophysics Data System (ADS)

Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin; Uram, Thomas D.; Benson, Andrew J.; Campbell, Duncan; Cora, Sofía A.; DeRose, Joseph; Di Matteo, Tiziana; Habib, Salman; Hearin, Andrew P.; Bryce Kalmbach, J.; Krughoff, K. Simon; Lanusse, François; Lukić, Zarija; Mandelbaum, Rachel; Newman, Jeffrey A.; Padilla, Nelson; Paillas, Enrique; Pope, Adrian; Ricker, Paul M.; Ruiz, Andrés N.; Tenneti, Ananth; Vega-Martínez, Cristian A.; Wechsler, Risa H.; Zhou, Rongpu; Zu, Ying; The LSST Dark Energy Science Collaboration

2018-02-01

The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.

KNODWAT: a scientific framework application for testing knowledge discovery methods for the biomedical domain.

PubMed

Holzinger, Andreas; Zupan, Mario

2013-06-13

Professionals in the biomedical domain are confronted with an increasing mass of data. Developing methods to assist professional end users in the field of Knowledge Discovery to identify, extract, visualize and understand useful information from these huge amounts of data is a huge challenge. However, there are so many diverse methods and methodologies available, that for biomedical researchers who are inexperienced in the use of even relatively popular knowledge discovery methods, it can be very difficult to select the most appropriate method for their particular research problem. A web application, called KNODWAT (KNOwledge Discovery With Advanced Techniques) has been developed, using Java on Spring framework 3.1. and following a user-centered approach. The software runs on Java 1.6 and above and requires a web server such as Apache Tomcat and a database server such as the MySQL Server. For frontend functionality and styling, Twitter Bootstrap was used as well as jQuery for interactive user interface operations. The framework presented is user-centric, highly extensible and flexible. Since it enables methods for testing using existing data to assess suitability and performance, it is especially suitable for inexperienced biomedical researchers, new to the field of knowledge discovery and data mining. For testing purposes two algorithms, CART and C4.5 were implemented using the WEKA data mining framework.

Influence of different tightening forces before laser welding to the implant/framework fit.

PubMed

da Silveira-Júnior, Clebio Domingues; Neves, Flávio Domingues; Fernandes-Neto, Alfredo Júlio; Prado, Célio Jesus; Simamoto-Júnior, Paulo César

2009-06-01

The aim of the present study was to evaluate the influence of abutment screw tightening force before laser welding procedures on the vertical fit of metal frameworks over four implants. To construct the frameworks, prefabricated titanium abutments and cylindrical titanium bars were joined by laser welding to compose three groups: group of manual torque (GMT), GT10 and GT20. Before welding, manual torque simulating routine laboratory procedure was applied to GTM. In GT10 and GT20, the abutment screws received 10 and 20 Ncm torque, respectively. After welding, the implant/framework interfaces were assessed by optical comparator microscope using two methods. First, the single screw test (SST) was used, in which the interfaces of the screwed and non-screwed abutments were assessed, considering only the abutments at the framework extremities. Second, the interfaces of all the abutments were evaluated when they were screwed. In the SST, intergroup analysis (Kruskal Wallis) showed no significant difference among the three conditions of tightening force; that is, the different tightening force before welding did not guarantee smaller distortions. Intragroup analysis (Wilcoxon) showed that for all groups, the interfaces of the non-screwed abutments were statistically greater than the interfaces of the screwed abutments, evidencing distortions in all the frameworks. ANOVA was applied for the comparison of interfaces when all the abutments were screwed and showed no significant difference among the groups. Under the conditions of this study, pre-welding tightness on abutment screws did not influence the vertical fit of implant-supported metal frameworks.

Exploring the oxygen supply and demand framework as a learning tool in undergraduate nursing education.

PubMed

Gillespie, Mary; Shackell, Eileen

2017-11-01

In nursing education, physiological concepts are typically presented within a body 'systems' framework yet learners are often challenged to apply this knowledge in the holistic and functional manner needed for effective clinical decision-making and safe patient care. A nursing faculty addressed this learning challenge by developing an advanced organizer as a conceptual and integrative learning tool to support learners in diverse learning environments and practice settings. A mixed methods research study was conducted that explored the effectiveness of the Oxygen Supply and Demand Framework as a learning tool in undergraduate nursing education. A pretest/post-test assessment and reflective journal were used to gather data. Findings indicated the Oxygen Supply and Demand Framework guided the development of pattern recognition and thinking processes and supported knowledge development, knowledge application and clinical decision-making. The Oxygen Supply and Demand Framework supports undergraduate students learning to provide safe and effective nursing care. Copyright © 2017 Elsevier Ltd. All rights reserved.

Operationalizing the social-ecological systems framework to assess sustainability.

PubMed

Leslie, Heather M; Basurto, Xavier; Nenadovic, Mateja; Sievanen, Leila; Cavanaugh, Kyle C; Cota-Nieto, Juan José; Erisman, Brad E; Finkbeiner, Elena; Hinojosa-Arango, Gustavo; Moreno-Báez, Marcia; Nagavarapu, Sriniketh; Reddy, Sheila M W; Sánchez-Rodríguez, Alexandra; Siegel, Katherine; Ulibarria-Valenzuela, José Juan; Weaver, Amy Hudson; Aburto-Oropeza, Octavio

2015-05-12

Environmental governance is more effective when the scales of ecological processes are well matched with the human institutions charged with managing human-environment interactions. The social-ecological systems (SESs) framework provides guidance on how to assess the social and ecological dimensions that contribute to sustainable resource use and management, but rarely if ever has been operationalized for multiple localities in a spatially explicit, quantitative manner. Here, we use the case of small-scale fisheries in Baja California Sur, Mexico, to identify distinct SES regions and test key aspects of coupled SESs theory. Regions that exhibit greater potential for social-ecological sustainability in one dimension do not necessarily exhibit it in others, highlighting the importance of integrative, coupled system analyses when implementing spatial planning and other ecosystem-based strategies.

Organizational readiness to change assessment (ORCA): Development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework

PubMed Central

Helfrich, Christian D; Li, Yu-Fang; Sharp, Nancy D; Sales, Anne E

2009-01-01

Background The Promoting Action on Research Implementation in Health Services, or PARIHS, framework is a theoretical framework widely promoted as a guide to implement evidence-based clinical practices. However, it has as yet no pool of validated measurement instruments that operationalize the constructs defined in the framework. The present article introduces an Organizational Readiness to Change Assessment instrument (ORCA), organized according to the core elements and sub-elements of the PARIHS framework, and reports on initial validation. Methods We conducted scale reliability and factor analyses on cross-sectional, secondary data from three quality improvement projects (n = 80) conducted in the Veterans Health Administration. In each project, identical 77-item ORCA instruments were administered to one or more staff from each facility involved in quality improvement projects. Items were organized into 19 subscales and three primary scales corresponding to the core elements of the PARIHS framework: (1) Strength and extent of evidence for the clinical practice changes represented by the QI program, assessed with four subscales, (2) Quality of the organizational context for the QI program, assessed with six subscales, and (3) Capacity for internal facilitation of the QI program, assessed with nine subscales. Results Cronbach's alpha for scale reliability were 0.74, 0.85 and 0.95 for the evidence, context and facilitation scales, respectively. The evidence scale and its three constituent subscales failed to meet the conventional threshold of 0.80 for reliability, and three individual items were eliminated from evidence subscales following reliability testing. In exploratory factor analysis, three factors were retained. Seven of the nine facilitation subscales loaded onto the first factor; five of the six context subscales loaded onto the second factor; and the three evidence subscales loaded on the third factor. Two subscales failed to load significantly on any factor. One measured resources in general (from the context scale), and one clinical champion role (from the facilitation scale). Conclusion We find general support for the reliability and factor structure of the ORCA. However, there was poor reliability among measures of evidence, and factor analysis results for measures of general resources and clinical champion role did not conform to the PARIHS framework. Additional validation is needed, including criterion validation. PMID:19594942

Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework.

PubMed

Helfrich, Christian D; Li, Yu-Fang; Sharp, Nancy D; Sales, Anne E

2009-07-14

The Promoting Action on Research Implementation in Health Services, or PARIHS, framework is a theoretical framework widely promoted as a guide to implement evidence-based clinical practices. However, it has as yet no pool of validated measurement instruments that operationalize the constructs defined in the framework. The present article introduces an Organizational Readiness to Change Assessment instrument (ORCA), organized according to the core elements and sub-elements of the PARIHS framework, and reports on initial validation. We conducted scale reliability and factor analyses on cross-sectional, secondary data from three quality improvement projects (n = 80) conducted in the Veterans Health Administration. In each project, identical 77-item ORCA instruments were administered to one or more staff from each facility involved in quality improvement projects. Items were organized into 19 subscales and three primary scales corresponding to the core elements of the PARIHS framework: (1) Strength and extent of evidence for the clinical practice changes represented by the QI program, assessed with four subscales, (2) Quality of the organizational context for the QI program, assessed with six subscales, and (3) Capacity for internal facilitation of the QI program, assessed with nine subscales. Cronbach's alpha for scale reliability were 0.74, 0.85 and 0.95 for the evidence, context and facilitation scales, respectively. The evidence scale and its three constituent subscales failed to meet the conventional threshold of 0.80 for reliability, and three individual items were eliminated from evidence subscales following reliability testing. In exploratory factor analysis, three factors were retained. Seven of the nine facilitation subscales loaded onto the first factor; five of the six context subscales loaded onto the second factor; and the three evidence subscales loaded on the third factor. Two subscales failed to load significantly on any factor. One measured resources in general (from the context scale), and one clinical champion role (from the facilitation scale). We find general support for the reliability and factor structure of the ORCA. However, there was poor reliability among measures of evidence, and factor analysis results for measures of general resources and clinical champion role did not conform to the PARIHS framework. Additional validation is needed, including criterion validation.

Development of two tier test to assess conceptual understanding in heat and temperature

NASA Astrophysics Data System (ADS)

Winarti; Cari; Suparmi; Sunarno, Widha; Istiyono, Edi

2017-01-01

Heat and temperature is a concept that has been learnt from primary school to undergraduate levels. One problem about heat and temperature is that they are presented abstractly, theoretical concept. A student conceptual frameworks develop from their daily experiences. The purpose of this research was to develop a two-tier test of heat and temperature concept and measure conceptual understanding of heat and temperature of the student. This study consist of two method is qualitative and quantitative method. The two-tier test was developed using procedures defined by Borg and Gall. The two-tier test consisted of 20 question and was tested for 137 students for collecting data. The result of the study showed that the two-tier test was effective in determining the students’ conceptual understanding and also it might be used as an alternative for assessment and evaluation of students’ achievement

Vulnerability Assessment and Adaptation Framework, Third Edition

DOT National Transportation Integrated Search

2017-11-01

The Federal Highway Administrations (FHWAs) Vulnerability Assessment and Adaptation Framework (the Framework), third edition, is a manual to help transportation agencies and their partners assess the vulnerability of transportation infrastructu...

How can we quantify impacts of contaminants in marine ecosystems? The ICON project.

PubMed

Hylland, Ketil; Burgeot, Thierry; Martínez-Gómez, Concepción; Lang, Thomas; Robinson, Craig D; Svavarsson, Jörundur; Thain, John E; Vethaak, A Dick; Gubbins, Matthew J

2017-03-01

An international workshop on marine integrated contaminant monitoring (ICON) was organised to test a framework on integrated environmental assessment and simultaneously assess the status of selected European marine areas. Biota and sediment were sampled in selected estuarine, inshore and offshore locations encompassing marine habitats from Iceland to the Spanish Mediterranean. The outcome of the ICON project is reported in this special issue as method-oriented papers addressing chemical analyses, PAH metabolites, oxidative stress, biotransformation, lysosomal membrane stability, genotoxicity, disease in fish, and sediment assessment, as well as papers assessing specific areas. This paper provides a background and introduction to the ICON project, by reviewing how effects of contaminants on marine organisms can be monitored and by describing strategies that have been employed to monitor and assess such effects. Through the ICON project we have demonstrated the use of an integrating framework and gleaned more knowledge than ever before in any single field campaign about the impacts contaminants may have in European marine areas. Copyright © 2015 Elsevier Ltd. All rights reserved.

Strategic Assessment of Risk and Risk Tolerance (StARRT) framework for return-to-play decision-making.

PubMed

Shrier, Ian

2015-10-01

The sport medicine clinician is faced with return-to-play (RTP) decisions for every patient who wants to return to activity. The complex interaction of factors related to history, physical examination, testing, activity and baseline characteristics can make RTP decision-making challenging. Further, when reasoning is not explicit, unnecessary conflict can arise among clinicians themselves, or among clinicians and patients. This conflict can have negative health consequences for the patient. In 2010, a transparent framework for RTP decisions was proposed. However, some have identified limitations to the framework and found difficulties in its implementation. This paper presents a revised framework that addresses the limitations, and provides concrete examples of how to apply it in simple and complex cases. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Brands as Intentional Agents Framework: How Perceived Intentions and Ability Can Map Brand Perception.

PubMed

Kervyn, Nicolas; Fiske, Susan T; Malone, Chris

2012-04-01

Building on the Stereotype Content Model, this paper introduces and tests the Brands as Intentional Agents Framework. A growing body of research suggests that consumers have relationships with brands that resemble relations between people. We propose that consumers perceive brands in the same way they perceive people. This approach allows us to explore how social perception theories and processes can predict brand purchase interest and loyalty. Brands as Intentional Agents Framework is based on a well-established social perception approach: the Stereotype Content Model. Two studies support the Brands as Intentional Agents Framework prediction that consumers assess a brand's perceived intentions and ability and that these perceptions elicit distinct emotions and drive differential brand behaviors. The research shows that human social interaction relationships translate to consumer-brand interactions in ways that are useful to inform brand positioning and brand communications.

Automated Detection of Leakage in Fluorescein Angiography Images with Application to Malarial Retinopathy

PubMed Central

Zhao, Yitian; J. C. MacCormick, Ian; G. Parry, David; Leach, Sophie; A. V. Beare, Nicholas; P. Harding, Simon; Zheng, Yalin

2015-01-01

The detection and assessment of leakage in retinal fluorescein angiogram images is important for the management of a wide range of retinal diseases. We have developed a framework that can automatically detect three types of leakage (large focal, punctate focal, and vessel segment leakage) and validated it on images from patients with malarial retinopathy. This framework comprises three steps: vessel segmentation, saliency feature generation and leakage detection. We tested the effectiveness of this framework by applying it to images from 20 patients with large focal leak, 10 patients with punctate focal leak, and 5,846 vessel segments from 10 patients with vessel leakage. The sensitivity in detecting large focal, punctate focal and vessel segment leakage are 95%, 82% and 81%, respectively, when compared to manual annotation by expert human observers. Our framework has the potential to become a powerful new tool for studying malarial retinopathy, and other conditions involving retinal leakage. PMID:26030010

Automated detection of leakage in fluorescein angiography images with application to malarial retinopathy.

PubMed

Zhao, Yitian; MacCormick, Ian J C; Parry, David G; Leach, Sophie; Beare, Nicholas A V; Harding, Simon P; Zheng, Yalin

2015-06-01

The detection and assessment of leakage in retinal fluorescein angiogram images is important for the management of a wide range of retinal diseases. We have developed a framework that can automatically detect three types of leakage (large focal, punctate focal, and vessel segment leakage) and validated it on images from patients with malarial retinopathy. This framework comprises three steps: vessel segmentation, saliency feature generation and leakage detection. We tested the effectiveness of this framework by applying it to images from 20 patients with large focal leak, 10 patients with punctate focal leak, and 5,846 vessel segments from 10 patients with vessel leakage. The sensitivity in detecting large focal, punctate focal and vessel segment leakage are 95%, 82% and 81%, respectively, when compared to manual annotation by expert human observers. Our framework has the potential to become a powerful new tool for studying malarial retinopathy, and other conditions involving retinal leakage.

Brands as Intentional Agents Framework: How Perceived Intentions and Ability Can Map Brand Perception

PubMed Central

Kervyn, Nicolas; Fiske, Susan T.; Malone, Chris

2013-01-01

Building on the Stereotype Content Model, this paper introduces and tests the Brands as Intentional Agents Framework. A growing body of research suggests that consumers have relationships with brands that resemble relations between people. We propose that consumers perceive brands in the same way they perceive people. This approach allows us to explore how social perception theories and processes can predict brand purchase interest and loyalty. Brands as Intentional Agents Framework is based on a well-established social perception approach: the Stereotype Content Model. Two studies support the Brands as Intentional Agents Framework prediction that consumers assess a brand’s perceived intentions and ability and that these perceptions elicit distinct emotions and drive differential brand behaviors. The research shows that human social interaction relationships translate to consumer-brand interactions in ways that are useful to inform brand positioning and brand communications. PMID:24403815

Evaluating the Quality of Competency Assessment in Pharmacy: A Framework for Workplace Learning.

PubMed

Shah, Shailly; McLaughlin, Jacqueline E; Eckel, Stephen F; Mangun, Jesica; Hawes, Emily

2016-01-19

Demonstration of achieved competencies is critical in the pharmacy workplace. The purpose of this study was to evaluate the quality of the competency assessment program for pharmacy residents at an academic medical center. The competency assessment program (CAP) survey is a validated, 48-item instrument that evaluates the quality of an assessment program based on 12 criteria, each measured by four questions on a scale of 0 to 100. The CAP was completed by residents ( n = 23) and preceptors ( n = 28) from the pharmacy residency program between 2010 and 2013. Results were analyzed using descriptive statistics, Cronbach's alpha, and non-parametric tests. Educational Consequences was the only quality criteria falling below the standard for "good quality." Participants that completed residency training elsewhere rated the Comparability (0.04) and Meaningfulness (0.01) of the assessment program higher than those that completed residency at the academic medical center. There were no significant differences between resident and preceptor scores. Overall, the quality of the assessment program was rated highly by residents and preceptors. The process described here provides a useful framework for understanding the quality of workplace learning assessments in pharmacy practice.

Soil Health Assessment Approaches and the Cornell Framework

NASA Astrophysics Data System (ADS)

van Es, Harold

2016-04-01

Soil health constraints beyond nutrient limitations and excesses currently limit agroecosystem productivity and sustainability, resilience to drought and extreme rainfall, and progress in soil and water conservation. With mounting pressure to produce food, feed, fiber, and even fuel for an increasing population, the concept of soil health is gaining national and international attention. Multiple regional, national, and global efforts are now leveraging that work to reach new stakeholder audiences, so that soil health management is expanding into mainstream agriculture. Each grower is generally faced with a unique situation in the choice of management options to address soil health constraints and each system affords its own set of opportunities or limitations to soil management. A more comprehensive understanding of soil health status can better guide farmers' management decisions. Until recently, there has not been a formalized decision making process for implementing a soil health management system that alleviates field-specific constrains identified through standard measurements and then maintains improved soil health. This presentation will discuss current US-based efforts related to soil health assessment, including efforts to build national consensus on appropriate methods for simple (inexpensive) and comprehensive tests. This includes the Cornell Soil Health Management Planning and Implementation Framework. The most relevant components of the framework are 1) measurement of indicators that represent critical soil processes, 2) scoring of measured values that allows for interpretation, and 3) linkage of identified constraints with management practices. Land managers can monitor changes over time through further assessment, and adapt management practices to achieve chosen goals. We will discuss the full tests and approaches for simplification.

Reconciling nature conservation and traditional farming practices: a spatially explicit framework to assess the extent of High Nature Value farmlands in the European countryside

PubMed Central

Lomba, Angela; Alves, Paulo; Jongman, Rob H G; McCracken, David I

2015-01-01

Agriculture constitutes a dominant land cover worldwide, and rural landscapes under extensive farming practices acknowledged due to high biodiversity levels. The High Nature Value farmland (HNVf) concept has been highlighted in the EU environmental and rural policies due to their inherent potential to help characterize and direct financial support to European landscapes where high nature and/or conservation value is dependent on the continuation of specific low-intensity farming systems. Assessing the extent of HNV farmland by necessity relies on the availability of both ecological and farming systems' data, and difficulties associated with making such assessments have been widely described across Europe. A spatially explicit framework of data collection, building out from local administrative units, has recently been suggested as a means of addressing such difficulties. This manuscript tests the relevance of the proposed approach, describes the spatially explicit framework in a case study area in northern Portugal, and discusses the potential of the approach to help better inform the implementation of conservation and rural development policies. Synthesis and applications: The potential of a novel approach (combining land use/cover, farming and environmental data) to provide more accurate and efficient mapping and monitoring of HNV farmlands is tested at the local level in northern Portugal. The approach is considered to constitute a step forward toward a more precise targeting of landscapes for agri-environment schemes, as it allowed a more accurate discrimination of areas within the case study landscape that have a higher value for nature conservation. PMID:25798221

Understanding unemployed people's job search behaviour, unemployment experience and well-being: a comparison of expectancy-value theory and self-determination theory.

PubMed

Vansteenkiste, Maarten; Lens, Willy; De Witte, Hans; Feather, N T

2005-06-01

Previous unemployment research has directly tested hypotheses derived from expectancy-value theory (EVT; Feather, 1982, 1990), but no comparative analysis has been executed with another motivational framework. In one large study with 446 unemployed people, separate analyses provided good evidence for predictions derived from both EVT and self-determination theory (SDT; Deci & Ryan, 1985, 2000). Comparative analyses indicated that the type of people's job search motivation, as conceptualized through the notions of autonomous versus controlled motivation within SDT, is an important predictor of people's unemployment experience and wellbeing, beyond people's strength of motivation assessed within EVT through expectancies of finding a job and employment value. The importance of simultaneously testing two theoretical frameworks is discussed.

Evaluation metrics for bone segmentation in ultrasound

NASA Astrophysics Data System (ADS)

Lougheed, Matthew; Fichtinger, Gabor; Ungi, Tamas

2015-03-01

Tracked ultrasound is a safe alternative to X-ray for imaging bones. The interpretation of bony structures is challenging as ultrasound has no specific intensity characteristic of bones. Several image segmentation algorithms have been devised to identify bony structures. We propose an open-source framework that would aid in the development and comparison of such algorithms by quantitatively measuring segmentation performance in the ultrasound images. True-positive and false-negative metrics used in the framework quantify algorithm performance based on correctly segmented bone and correctly segmented boneless regions. Ground-truth for these metrics are defined manually and along with the corresponding automatically segmented image are used for the performance analysis. Manually created ground truth tests were generated to verify the accuracy of the analysis. Further evaluation metrics for determining average performance per slide and standard deviation are considered. The metrics provide a means of evaluating accuracy of frames along the length of a volume. This would aid in assessing the accuracy of the volume itself and the approach to image acquisition (positioning and frequency of frame). The framework was implemented as an open-source module of the 3D Slicer platform. The ground truth tests verified that the framework correctly calculates the implemented metrics. The developed framework provides a convenient way to evaluate bone segmentation algorithms. The implementation fits in a widely used application for segmentation algorithm prototyping. Future algorithm development will benefit by monitoring the effects of adjustments to an algorithm in a standard evaluation framework.

towards a theory-based multi-dimensional framework for assessment in mathematics: The "SEA" framework

NASA Astrophysics Data System (ADS)

Anku, Sitsofe E.

1997-09-01

Using the reform documents of the National Council of Teachers of Mathematics (NCTM) (NCTM, 1989, 1991, 1995), a theory-based multi-dimensional assessment framework (the "SEA" framework) which should help expand the scope of assessment in mathematics is proposed. This framework uses a context based on mathematical reasoning and has components that comprise mathematical concepts, mathematical procedures, mathematical communication, mathematical problem solving, and mathematical disposition.

GPs’ opinions of health assessment instruments for people with intellectual disabilities: a qualitative study

PubMed Central

Bakker-van Gijssel, Esther J; Hartman, Tim C olde; Lucassen, Peter LBJ; van den Driessen Mareeuw, Francine; Dees, Marianne K; Assendelft, Willem JJ; van Schrojenstein Lantman-de Valk, Henny MJ

2017-01-01

Background GPs provide health care to people with intellectual disabilities (ID). People with ID find it difficult to express themselves concerning health-related matters. Applying health assessments is an effective method to reveal health needs, and can play a role in prevention and health promotion. Aim The aim of this qualitative study was to explore GPs’ considerations about applying a health assessment for people with ID. Design and setting This focus group study was conducted among a selection of Dutch GPs. Method An interview guide was developed. All discussions were audiorecorded and transcribed. Analysis was performed using the framework analysis approach. Two researchers independently applied open coding and identified a thematic framework. This framework and the summaries of views per theme were discussed in the research team. Results After four focus groups, with 23 GPs, saturation was reached. Three main themes evolved: health assessments in relation to GPs’ responsibility; the usefulness and necessity of health assessments; and barriers to using health assessments on people with ID. A health assessment instrument for people with ID can help GPs to focus on certain issues that are not so common in the general population. GPs are motivated to use such a tool if it is scientifically tested, and results in significant health gains. However, GPs identify barriers at the level of GP, patient, and organisation. Conclusion Most GPs in the focus groups consider providing medical care to people with ID their responsibility and indicate that a health assessment instrument could be a valuable tool. In order to deliver good care, they need education and support. Many barriers need to be overcome before a health assessment instrument can be implemented. PMID:27993898

A Modelling Framework to Assess the Effect of Pressures on River Abiotic Habitat Conditions and Biota

PubMed Central

Kail, Jochem; Guse, Björn; Radinger, Johannes; Schröder, Maria; Kiesel, Jens; Kleinhans, Maarten; Schuurman, Filip; Fohrer, Nicola; Hering, Daniel; Wolter, Christian

2015-01-01

River biota are affected by global reach-scale pressures, but most approaches for predicting biota of rivers focus on river reach or segment scale processes and habitats. Moreover, these approaches do not consider long-term morphological changes that affect habitat conditions. In this study, a modelling framework was further developed and tested to assess the effect of pressures at different spatial scales on reach-scale habitat conditions and biota. Ecohydrological and 1D hydrodynamic models were used to predict discharge and water quality at the catchment scale and the resulting water level at the downstream end of a study reach. Long-term reach morphology was modelled using empirical regime equations, meander migration and 2D morphodynamic models. The respective flow and substrate conditions in the study reach were predicted using a 2D hydrodynamic model, and the suitability of these habitats was assessed with novel habitat models. In addition, dispersal models for fish and macroinvertebrates were developed to assess the re-colonization potential and to finally compare habitat suitability and the availability / ability of species to colonize these habitats. Applicability was tested and model performance was assessed by comparing observed and predicted conditions in the lowland Treene River in northern Germany. Technically, it was possible to link the different models, but future applications would benefit from the development of open source software for all modelling steps to enable fully automated model runs. Future research needs concern the physical modelling of long-term morphodynamics, feedback of biota (e.g., macrophytes) on abiotic habitat conditions, species interactions, and empirical data on the hydraulic habitat suitability and dispersal abilities of macroinvertebrates. The modelling framework is flexible and allows for including additional models and investigating different research and management questions, e.g., in climate impact research as well as river restoration and management. PMID:26114430

Using a fuzzy comprehensive evaluation method to determine product usability: A test case

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Item and scale differential functioning of the Mini-Mental State Exam assessed using the Differential Item and Test Functioning (DFIT) Framework.

PubMed

Morales, Leo S; Flowers, Claudia; Gutierrez, Peter; Kleinman, Marjorie; Teresi, Jeanne A

2006-11-01

To illustrate the application of the Differential Item and Test Functioning (DFIT) method using English and Spanish versions of the Mini-Mental State Examination (MMSE). Study participants were 65 years of age or older and lived in North Manhattan, New York. Of the 1578 study participants who were administered the MMSE 665 completed it in Spanish. : The MMSE contains 20 items that measure the degree of cognitive impairment in the areas of orientation, attention and calculation, registration, recall and language, as well as the ability to follow verbal and written commands. After assessing the dimensionality of the MMSE scale, item response theory person and item parameters were estimated separately for the English and Spanish sample using Samejima's 2-parameter graded response model. Then the DFIT framework was used to assess differential item functioning (DIF) and differential test functioning (DTF). Nine items were found to show DIF; these were items that ask the respondent to name the correct season, day of the month, city, state, and 2 nearby streets, recall 3 objects, repeat the phrase no ifs, no ands, no buts, follow the command, "close your eyes," and the command, "take the paper in your right hand, fold the paper in half with both hands, and put the paper down in your lap." At the scale level, however, the MMSE did not show differential functioning. Respondents to the English and Spanish versions of the MMSE are comparable on the basis of scale scores. However, assessments based on individual MMSE items may be misleading.

Standardizing the classification of abortion incidents: the Procedural Abortion Incident Reporting and Surveillance (PAIRS) Framework.

PubMed

Taylor, Diana; Upadhyay, Ushma D; Fjerstad, Mary; Battistelli, Molly F; Weitz, Tracy A; Paul, Maureen E

2017-07-01

To develop and validate standardized criteria for assessing abortion-related incidents (adverse events, morbidities, near misses) for first-trimester aspiration abortion procedures and to demonstrate the utility of a standardized framework [the Procedural Abortion Incident Reporting & Surveillance (PAIRS) Framework] for estimating serious abortion-related adverse events. As part of a California-based study of early aspiration abortion provision conducted between 2007 and 2013, we developed and validated a standardized framework for defining and monitoring first-trimester (≤14weeks) aspiration abortion morbidity and adverse events using multiple methods: a literature review, framework criteria testing with empirical data, repeated expert reviews and data-based revisions to the framework. The final framework distinguishes incidents resulting from procedural abortion care (adverse events) from morbidity related to pregnancy, the abortion process and other nonabortion related conditions. It further classifies incidents by diagnosis (confirmatory data, etiology, risk factors), management (treatment type and location), timing (immediate or delayed), seriousness (minor or major) and outcome. Empirical validation of the framework using data from 19,673 women receiving aspiration abortions revealed almost an equal proportion of total adverse events (n=205, 1.04%) and total abortion- or pregnancy-related morbidity (n=194, 0.99%). The majority of adverse events were due to retained products of conception (0.37%), failed attempted abortion (0.15%) and postabortion infection (0.17%). Serious or major adverse events were rare (n=11, 0.06%). Distinguishing morbidity diagnoses from adverse events using a standardized, empirically tested framework confirms the very low frequency of serious adverse events related to clinic-based abortion care. The PAIRS Framework provides a useful set of tools to systematically classify and monitor abortion-related incidents for first-trimester aspiration abortion procedures. Standardization will assist healthcare providers, researchers and policymakers to anticipate morbidity and prevent abortion adverse events, improve care metrics and enhance abortion quality. Copyright © 2017 Elsevier Inc. All rights reserved.

A framework for investigating animal consciousness.

PubMed

Droege, Paula; Braithwaite, Victoria A

2015-01-01

An assessment of consciousness in nonverbal animals requires a framework for research that extends testing methods beyond subjective report. This chapter proposes a working definition of consciousness in terms of temporal representation that provides the critical link between internal phenomenology and external behavior and neural structure. Our claim is that consciousness represents the present moment as distinct from the past and the future in order to flexibly respond to stimuli. We discuss behavioral and neural evidence that indicates the capacity for both flexible response and temporal representation, and we illustrate these capacities in fish, a taxonomic group that challenges human intuitions about consciousness.

A Surrogate Approach to the Experimental Optimization of Multielement Airfoils

NASA Technical Reports Server (NTRS)

Otto, John C.; Landman, Drew; Patera, Anthony T.

1996-01-01

The incorporation of experimental test data into the optimization process is accomplished through the use of Bayesian-validated surrogates. In the surrogate approach, a surrogate for the experiment (e.g., a response surface) serves in the optimization process. The validation step of the framework provides a qualitative assessment of the surrogate quality, and bounds the surrogate-for-experiment error on designs "near" surrogate-predicted optimal designs. The utility of the framework is demonstrated through its application to the experimental selection of the trailing edge ap position to achieve a design lift coefficient for a three-element airfoil.

Effectiveness of Teamwork in an Integrated Care Setting for Patients with COPD: Development and Testing of a Self-Evaluation Instrument for Interprofessional Teams.

PubMed

Van Dijk-de Vries, Anneke N; Duimel-Peeters, Inge G P; Muris, Jean W; Wesseling, Geertjan J; Beusmans, George H M I; Vrijhoef, Hubertus J M

2016-04-08

Teamwork between healthcare providers is conditional for the delivery of integrated care. This study aimed to assess the usefulness of the conceptual framework Integrated Team Effectiveness Model for developing and testing of the Integrated Team Effectiveness Instrument. Focus groups with healthcare providers in an integrated care setting for people with chronic obstructive pulmonary disease (COPD) were conducted to examine the recognisability of the conceptual framework and to explore critical success factors for collaborative COPD practice out of this framework. The resulting items were transposed into a pilot instrument. This was reviewed by expert opinion and completed 153 times by healthcare providers. The underlying structure and internal consistency of the instrument were verified by factor analysis and Cronbach's alpha. The conceptual framework turned out to be comprehensible for discussing teamwork effectiveness. The pilot instrument measures 25 relevant aspects of teamwork in integrated COPD care. Factor analysis suggested three reliable components: teamwork effectiveness, team processes and team psychosocial traits (Cronbach's alpha between 0.76 and 0.81). The conceptual framework Integrated Team Effectiveness Model is relevant in developing a practical full-spectrum instrument to facilitate discussing teamwork effectiveness. The Integrated Team Effectiveness Instrument provides a well-founded basis to self-evaluate teamwork effectiveness in integrated COPD care by healthcare providers. Recommendations are provided for the improvement of the instrument.

Adolescents' View of Family Functioning: A Validation of the RES.

ERIC Educational Resources Information Center

Chambliss, Catherine; And Others

The contextual model argues that people in a relationship must experience a sense of loyalty, fairness, and reciprocity in order to build commitment and trust and provide ongoing mutual care. The Relational Ethics Scale (RES), which assess key relational variables, was developed for use in empirical research to test the theoretical framework of…

Evaluating and Improving Tech Prep: Development, Validation, and Results of the Minnesota Self-Assessment Model.

ERIC Educational Resources Information Center

Pucel, David J.; And Others

1996-01-01

The Minnesota Tech Prep Self-Evaluation System is a framework based on ideas from Deming, Juran, and the Baldridge award. Testing with 17 Minnesota tech prep consortia found it effective in identifying areas needing improvement and promoting dialog among those involved in tech prep implementation. (SK)

Take the Test: Sample Questions from OECD's PISA Assessments

ERIC Educational Resources Information Center

Salz, Susanne, Comp.; Figueroa, Diana Toledo, Comp.

2009-01-01

Parents, students, teachers, school leaders, governments and the general public need good information on how well their education systems prepare students for life. A growing commitment by governments to monitor the outcomes of education systems in terms of student achievement on a regular basis and within an internationally agreed framework led…

Classroom Learning and Achievement: How the Complexity of Classroom Interaction Impacts Students' Learning

ERIC Educational Resources Information Center

Podschuweit, Sören; Bernholt, Sascha; Brückmann, Maja

2016-01-01

Background: Complexity models have provided a suitable framework in various domains to assess students' educational achievement. Complexity is often used as the analytical focus when regarding learning outcomes, i.e. when analyzing written tests or problem-centered interviews. Numerous studies reveal negative correlations between the complexity of…

Applying Aggregate Exposure Pathway and Adverse Outcome Pathway frameworks to link toxicity testing data to exposure-relevant and biologically-relevant responses

EPA Science Inventory

Hazard assessment for nanomaterials often involves applying in vitro dose-response data to estimate potential health risks that arise from exposure to products that contain nanomaterials. However, much uncertainty is inherent in relating bioactivities observed in an in vitro syst...

Systematic Observation of Early Adolescents in Educational Settings: The Good, the Bad, and the Ugly

ERIC Educational Resources Information Center

Gregory, Anne; Mikami, Amori Yee

2015-01-01

The growing use of systematic, empirically tested observational frameworks in school-based research is crucial for increasing the replicability and generalizability of findings across settings. That said, observations are often mistakenly assumed to be the "gold standard" assessment, without more nuanced discussions about the best uses…

Command and Control Rapid Prototyping Continuum (C2RPC): The Framework for Achieving a New C2 Strategy

DTIC Science & Technology

2011-06-01

Sync Matrix Assessing J/ADOCS (Fires) TBMCS (ATO) Executing Monitoring (SA) C2 Strategy Objectives • Provide Expanded Mission Management...Computers, and Intelligence T&E Test and Evaluation PMW150 Program Warfare Office Command and Control TBMCS Theater Battle Management Core System POR

A General Multilevel SEM Framework for Assessing Multilevel Mediation

ERIC Educational Resources Information Center

Preacher, Kristopher J.; Zyphur, Michael J.; Zhang, Zhen

2010-01-01

Several methods for testing mediation hypotheses with 2-level nested data have been proposed by researchers using a multilevel modeling (MLM) paradigm. However, these MLM approaches do not accommodate mediation pathways with Level-2 outcomes and may produce conflated estimates of between- and within-level components of indirect effects. Moreover,…

Intelligence Assessment: Gardner Multiple Intelligence Theory as an Alternative

ERIC Educational Resources Information Center

Almeida, Leandro S.; Prieto, Maria Dolores; Ferreira, Aristides I.; Bermejo, Maria Rosario; Ferrando, Mercedes; Ferrandiz, Carmen

2010-01-01

In the multiple intelligence framework, newer and more contextualized cognitive tasks are suggested as alternative to more traditional psychometric tests. The purpose of this article is to examine whether or not these two types of instruments converge into a general factor of cognitive performance. Thus, the Battery of General and Differential…

Assessing Levels of Adaptation during Implementation of Evidence-Based Interventions: Introducing the Rogers-Rutten Framework

ERIC Educational Resources Information Center

Bowen, Shelly-Ann K.; Saunders, Ruth P.; Richter, Donna L.; Hussey, Jim; Elder, Keith; Lindley, Lisa

2010-01-01

Most HIV-prevention funding agencies require the use of evidence-based behavioral interventions, tested and proven to be effective through outcome evaluation. Adaptation of programs during implementation is common and may be influenced by many factors, including agency mission, time constraints, and funding streams. There are few theoretical…

Intent to Advocate before and after a Health Education Workshop

ERIC Educational Resources Information Center

McCrary-Quarles, Audrery R.; Pettit, Michele L.; Rahman, Fahmida; Brown, Stephen L.

2006-01-01

This pilot study evaluated the influence of an advocacy training workshop sponsored by an Eta Sigma Gamma chapter affiliated with a large university in the Midwest. The theory of planned behavior (TPB) was utilized as a framework for assessing participants' intentions to participate in advocacy. Participants completed pre- and post-test surveys to…

Motivation and Engagement in Jamaica: Testing a Multidimensional Framework among Students in an Emerging Regional Context

ERIC Educational Resources Information Center

Martin, Andrew J.; Martin, Tamica G.; Evans, Paul

2018-01-01

This study explored motivation and engagement among 585 Jamaican middle and high school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale. Confirmatory factor analysis (CFA) found satisfactory fit, and by most measures, multigroup CFA demonstrated comparable factor structure for males…

Development of a Computer-Based Measure of Listening Comprehension of Science Talk

ERIC Educational Resources Information Center

Lin, Sheau-Wen; Liu, Yu; Chen, Shin-Feng; Wang, Jing-Ru; Kao, Huey-Lien

2015-01-01

The purpose of this study was to develop a computer-based assessment for elementary school students' listening comprehension of science talk within an inquiry-oriented environment. The development procedure had 3 steps: a literature review to define the framework of the test, collecting and identifying key constructs of science talk, and…

Assessing Two Theoretical Frameworks of Civic Engagement

ERIC Educational Resources Information Center

García-Cabrero, Benilde; Pérez-Martínez, María Guadalupe; Sandoval-Hernández, Andrés; Caso-Niebla, Joaquín; Díaz-López, Carlos David

2016-01-01

The purpose of this study was to empirically test two major theoretical models: a modified version of the social capital model (Pattie, Seyd and Whiteley, 2003), and the Informed Social Engagement Model (Barr and Selman, 2014; Selman and Kwok, 2010), to explain civic participation and civic knowledge of adolescents from Chile, Colombia and Mexico,…

Crustose coralline algae increased framework and diversity on ancient coral reefs.

PubMed

Weiss, Anna; Martindale, Rowan C

2017-01-01

Crustose coralline algae (CCA) are key producers of carbonate sediment on reefs today. Despite their importance in modern reef ecosystems, the long-term relationship of CCA with reef development has not been quantitatively assessed in the fossil record. This study includes data from 128 Cenozoic coral reefs collected from the Paleobiology Database, the Paleoreefs Database, as well as the original literature and assesses the correlation of CCA abundance with taxonomic diversity (both corals and reef dwellers) and framework of fossil coral reefs. Chi-squared tests show reef type is significantly correlated with CCA abundance and post-hoc tests indicate higher involvement of CCA is associated with stronger reef structure. Additionally, general linear models show coral reefs with higher amounts of CCA had a higher diversity of reef-dwelling organisms. These data have important implications for paleoecology as they demonstrate that CCA increased building capacity, structural integrity, and diversity of ancient coral reefs. The analyses presented here demonstrate that the function of CCA on modern coral reefs is similar to their function on Cenozoic reefs; thus, studies of ancient coral reef collapse are even more meaningful as modern analogues.

Risk Assessment in the 21st Century - Conference Abstract ...

EPA Pesticide Factsheets

For the past ~50 years, risk assessment depended almost exclusively on animal testing for hazard identification and dose-response assessment. Originally sound and effective, with increasing dependence on chemical tools and the number of chemicals in commerce, this traditional approach is no longer sufficient. This presentation provides an update on current progress in achieving the goals outlined in the NAS reports: “Toxicology Testing in the 21st Century”, “Exposure Science in the 21st Century”, and most recently, “Using 21st Century Science to Improve Risk-Related Evaluations.” The presentation highlights many of the advances lead by the EPA. Topics covered include the evolution of the mode of action concept into the chemically agnostic, adverse outcome pathway (AOP), a systems-based data framework that facilitates integration of modifiable factors (e.g., genetic variation, life stages), and an understanding of networks, and mixtures. Further, the EDSP pivot is used to illustrate how AOPs drive development of predictive models for risk assessment based on assembly of high throughput assays representing AOP key elements. The birth of computational exposure science, capable of large-scale predictive exposure models, is reviewed. Although still in its infancy, development of non-targeted analysis to begin addressing the exposome is presented, as is the systems-based AEP that integrates exposure, toxicokinetics and AOPs into a comprehensive framework

A Framework for Assessing High School Students' Statistical Reasoning.

PubMed

Chan, Shiau Wei; Ismail, Zaleha; Sumintono, Bambang

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students' statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students' statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework's cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments.

Assessing value of innovative molecular diagnostic tests in the concept of predictive, preventive, and personalized medicine.

PubMed

Akhmetov, Ildar; Bubnov, Rostyslav V

2015-01-01

Molecular diagnostic tests drive the scientific and technological uplift in the field of predictive, preventive, and personalized medicine offering invaluable clinical and socioeconomic benefits to the key stakeholders. Although the results of diagnostic tests are immensely influential, molecular diagnostic tests (MDx) are still grudgingly reimbursed by payers and amount for less than 5 % of the overall healthcare costs. This paper aims at defining the value of molecular diagnostic test and outlining the most important components of "value" from miscellaneous assessment frameworks, which go beyond accuracy and feasibility and impact the clinical adoption, informing healthcare resource allocation decisions. The authors suggest that the industry should facilitate discussions with various stakeholders throughout the entire assessment process in order to arrive at a consensus about the depth of evidence required for positive marketing authorization or reimbursement decisions. In light of the evolving "value-based healthcare" delivery practices, it is also recommended to account for social and ethical parameters of value, since these are anticipated to become as critical for reimbursement decisions and test acceptance as economic and clinical criteria.

The Multidimensional Assessment of Interoceptive Awareness (MAIA)

PubMed Central

Mehling, Wolf E.; Price, Cynthia; Daubenmier, Jennifer J.; Acree, Mike; Bartmess, Elizabeth; Stewart, Anita

2012-01-01

This paper describes the development of a multidimensional self-report measure of interoceptive body awareness. The systematic mixed-methods process involved reviewing the current literature, specifying a multidimensional conceptual framework, evaluating prior instruments, developing items, and analyzing focus group responses to scale items by instructors and patients of body awareness-enhancing therapies. Following refinement by cognitive testing, items were field-tested in students and instructors of mind-body approaches. Final item selection was achieved by submitting the field test data to an iterative process using multiple validation methods, including exploratory cluster and confirmatory factor analyses, comparison between known groups, and correlations with established measures of related constructs. The resulting 32-item multidimensional instrument assesses eight concepts. The psychometric properties of these final scales suggest that the Multidimensional Assessment of Interoceptive Awareness (MAIA) may serve as a starting point for research and further collaborative refinement. PMID:23133619

US system of oversight for genetic testing: a report from the Secretary's Advisory Committee on Genetics, Health and Society.

PubMed

Ferreira-Gonzalez, Andrea; Teutsch, Steven; Williams, Marc S; Au, Sylvia M; Fitzgerald, Kevin T; Miller, Paul Steven; Fomous, Cathy

2008-09-01

As genetic testing technology is integrated into healthcare, increasingly detailed information about individual and population genetic variation is available to patients and providers. Health professionals use genetic testing to diagnose or assess the risk of disease in individuals, families and populations and to guide healthcare decisions. Consumers are beginning to explore personalized genomic services in an effort to learn more about their risk for common diseases. Scientific and technological advances in genetic testing, as with any newly introduced medical technology, present certain challenges to existing frameworks of oversight. In addition, the growing use of genetic testing will require a significant investment in evidence-based assessments to understand the validity and utility of these tests in clinical and personal decisionmaking. To optimize the use of genetic testing in healthcare, all sectors of the oversight system need to be strengthened and yet remain flexible in order to adapt to advances that will inevitably increase the range of genetic tests and methodologies.

Depth of Teachers' Knowledge: Frameworks for Teachers' Knowledge of Mathematics

ERIC Educational Resources Information Center

Holmes, Vicki-Lynn

2012-01-01

This article describes seven teacher knowledge frameworks and relates these frameworks to the teaching and assessment of elementary teacher's mathematics knowledge. The frameworks classify teachers' knowledge and provide a vocabulary and common language through which knowledge can be discussed and assessed. These frameworks are categorized into…

Risk-Informed Safety Assurance and Probabilistic Assessment of Mission-Critical Software-Intensive Systems

NASA Technical Reports Server (NTRS)

Guarro, Sergio B.

2010-01-01

This report validates and documents the detailed features and practical application of the framework for software intensive digital systems risk assessment and risk-informed safety assurance presented in the NASA PRA Procedures Guide for Managers and Practitioner. This framework, called herein the "Context-based Software Risk Model" (CSRM), enables the assessment of the contribution of software and software-intensive digital systems to overall system risk, in a manner which is entirely compatible and integrated with the format of a "standard" Probabilistic Risk Assessment (PRA), as currently documented and applied for NASA missions and applications. The CSRM also provides a risk-informed path and criteria for conducting organized and systematic digital system and software testing so that, within this risk-informed paradigm, the achievement of a quantitatively defined level of safety and mission success assurance may be targeted and demonstrated. The framework is based on the concept of context-dependent software risk scenarios and on the modeling of such scenarios via the use of traditional PRA techniques - i.e., event trees and fault trees - in combination with more advanced modeling devices such as the Dynamic Flowgraph Methodology (DFM) or other dynamic logic-modeling representations. The scenarios can be synthesized and quantified in a conditional logic and probabilistic formulation. The application of the CSRM method documented in this report refers to the MiniAERCam system designed and developed by the NASA Johnson Space Center.

A Computational Framework for Automation of Point Defect Calculations

NASA Astrophysics Data System (ADS)

Goyal, Anuj; Gorai, Prashun; Peng, Haowei; Lany, Stephan; Stevanovic, Vladan; National Renewable Energy Laboratory, Golden, Colorado 80401 Collaboration

A complete and rigorously validated open-source Python framework to automate point defect calculations using density functional theory has been developed. The framework provides an effective and efficient method for defect structure generation, and creation of simple yet customizable workflows to analyze defect calculations. The package provides the capability to compute widely accepted correction schemes to overcome finite-size effects, including (1) potential alignment, (2) image-charge correction, and (3) band filling correction to shallow defects. Using Si, ZnO and In2O3as test examples, we demonstrate the package capabilities and validate the methodology. We believe that a robust automated tool like this will enable the materials by design community to assess the impact of point defects on materials performance. National Renewable Energy Laboratory, Golden, Colorado 80401.

Benchmarking density functional theory predictions of framework structures and properties in a chemically diverse test set of metal-organic frameworks

DOE PAGES

Nazarian, Dalar; Ganesh, P.; Sholl, David S.

2015-09-30

We compiled a test set of chemically and topologically diverse Metal–Organic Frameworks (MOFs) with high accuracy experimentally derived crystallographic structure data. The test set was used to benchmark the performance of Density Functional Theory (DFT) functionals (M06L, PBE, PW91, PBE-D2, PBE-D3, and vdW-DF2) for predicting lattice parameters, unit cell volume, bonded parameters and pore descriptors. On average PBE-D2, PBE-D3, and vdW-DF2 predict more accurate structures, but all functionals predicted pore diameters within 0.5 Å of the experimental diameter for every MOF in the test set. The test set was also used to assess the variance in performance of DFT functionalsmore » for elastic properties and atomic partial charges. The DFT predicted elastic properties such as minimum shear modulus and Young's modulus can differ by an average of 3 and 9 GPa for rigid MOFs such as those in the test set. Moreover, we calculated the partial charges by vdW-DF2 deviate the most from other functionals while there is no significant difference between the partial charges calculated by M06L, PBE, PW91, PBE-D2 and PBE-D3 for the MOFs in the test set. We find that while there are differences in the magnitude of the properties predicted by the various functionals, these discrepancies are small compared to the accuracy necessary for most practical applications.« less

Measuring sustainability as a programming tool for health sector investments: report from a pilot sustainability assessment in five Nepalese health districts.

PubMed

Sarriot, Eric; Ricca, Jim; Ryan, Leo; Basnet, Jagat; Arscott-Mills, Sharon

2009-01-01

Sustainability is a critical determinant of scale and impact of health sector development assistance programs. Working with USAID/Nepal implementing partners, we adapted a sustainability assessment framework to help USAID test how an evaluation tool could inform its health portfolio management. The essential first process step was to define the boundaries of the local system being examined. This local system-the unit of analysis of the study-was defined as the health district.We developed a standardized set of assessment tools to measure 53 indicators. Data collection was carried out over 4 weeks by a Nepalese agency. Scaling and combining indicators into six component indices provided a map of progress toward sustainable maternal, child, health, and family planning results for the five districts included in this pilot study, ranked from "no sustainability" to "beginning of sustainability."We conclude that systematic application of the Sustainability Framework could improve the health sector investment decisions of development agencies. It could also give districts an information base on which to build autonomy and accountability. The ability to form and test hypotheses about the sustainability of outcomes under various funding strategies-made possible by this approach-will be a prerequisite for more efficiently meeting the global health agenda.

Parents' assessment of circadian preference in elementary school-aged children: Validity and relations to educational outcomes.

PubMed

Scherrer, Vsevolod; Roberts, Richard; Preckel, Franzis

2016-01-01

Meta-analyses suggest that morning-oriented students obtain better school grades than evening-oriented students. This finding has generally been found for students in high school using self-report data for the assessment of circadian preference. Two studies (N = 2718/192) investigated whether these findings generalize across samples (i.e. elementary school-aged students) and methods (i.e. parent reports). These studies also explored whether the relation between circadian preference and school achievement could be explained within an expectancy-value framework. To this end, the Lark-Owl Chronotype Indicator (LOCI) was modified to obtain parents' evaluations of their children's circadian preference, while students completed a battery of assessments designed to explore the test-criterion evidence. Structural equation modeling and correlational analyses revealed: (1) morning and evening orientation were two separable factors of children's circadian preference; (2) correlations with behavioral (e.g. sleep and eating times) and psychological (e.g. cognitive ability) data supported the test-criterion validity of both factors; (3) morning orientation was positively related to school achievement and (4) consistent with an expectancy-value framework this relation was mediated by children's academic self-concept (ASC). These findings have important research and policy implications for considering circadian preference in the schooling of elementary students.

New Perspectives on Assessing Amplification Effects

PubMed Central

Souza, Pamela E.; Tremblay, Kelly L.

2006-01-01

Clinicians have long been aware of the range of performance variability with hearing aids. Despite improvements in technology, there remain many instances of well-selected and appropriately fitted hearing aids whereby the user reports minimal improvement in speech understanding. This review presents a multistage framework for understanding how a hearing aid affects performance. Six stages are considered: (1) acoustic content of the signal, (2) modification of the signal by the hearing aid, (3) interaction between sound at the output of the hearing aid and the listener's ear, (4) integrity of the auditory system, (5) coding of available acoustic cues by the listener's auditory system, and (6) correct identification of the speech sound. Within this framework, this review describes methodology and research on 2 new assessment techniques: acoustic analysis of speech measured at the output of the hearing aid and auditory evoked potentials recorded while the listener wears hearing aids. Acoustic analysis topics include the relationship between conventional probe microphone tests and probe microphone measurements using speech, appropriate procedures for such tests, and assessment of signal-processing effects on speech acoustics and recognition. Auditory evoked potential topics include an overview of physiologic measures of speech processing and the effect of hearing loss and hearing aids on cortical auditory evoked potential measurements in response to speech. Finally, the clinical utility of these procedures is discussed. PMID:16959734

One of These Things Is Not Like the Others: The Idea of Precedence in Health Technology Assessment and Coverage Decisions

PubMed Central

Giacomini, Mita

2005-01-01

Health plans often deliberate covering technologies with challenging purposes, effects, or costs. They must integrate quantitative evidence (e.g., how well a technology works) with qualitative, normative assessments (e.g., whether it works well enough for a worthwhile purpose). Arguments from analogy and precedent help integrate these criteria and establish standards for their policy application. Examples of arguments are described for three technologies (ICSI, genetic tests, and Viagra). Drawing lessons from law, ethics, philosophy, and the social sciences, a framework is developed for case-based evaluation of new technologies. The decision-making cycle includes (1) taking stock of past decisions and formulating precedents, (2) deciding new cases, and (3) assimilating decisions into the case history and evaluation framework. Each stage requires distinctive decision maker roles, information, and methods. PMID:15960769

A comparative framework for maneuverability and gust tolerance of aerial microsystems

NASA Astrophysics Data System (ADS)

Campbell, Renee

Aerial microsystems have the potential of navigating low-altitude, cluttered environments such as urban corridors and building interiors. Reliable systems require both agility and tolerance to gusts. While many platform designs are under development, no framework currently exists to quantitatively assess these inherent bare airframe characteristics which are independent of closed loop controllers. This research develops a method to quantify the maneuverability and gust tolerance of vehicles using reachability and disturbance sensitivity sets. The method is applied to a stable flybar helicopter and an unstable flybarless helicopter, whose state space models were formed through system identification. Model-based static H∞ controllers were also implemented on the vehicles and tested in the lab using fan-generated gusts. It is shown that the flybar restricts the bare airframe's ability to maneuver in translational velocity directions. As such, the flybarless helicopter proved more maneuverable and gust tolerant than the flybar helicopter. This approach was specifically applied here to compare stable and unstable helicopter platforms; however, the framework may be used to assess a broad range of aerial microsystems.

Calculation of the Phenix end-of-life test 'Control Rod Withdrawal' with the ERANOS code

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tiberi, V.

2012-07-01

The Inst. of Radiological Protection and Nuclear Safety (IRSN) acts as technical support to French public authorities. As such, IRSN is in charge of safety assessment of operating and under construction reactors, as well as future projects. In this framework, one current objective of IRSN is to evaluate the ability and accuracy of numerical tools to foresee consequences of accidents. Neutronic studies step in the safety assessment from different points of view among which the core design and its protection system. They are necessary to evaluate the core behavior in case of accident in order to assess the integrity ofmore » the first barrier and the absence of a prompt criticality risk. To reach this objective one main physical quantity has to be evaluated accurately: the neutronic power distribution in core during whole reactor lifetime. Phenix end of life tests, carried out in 2009, aim at increasing the experience feedback on sodium cooled fast reactors. These experiments have been done in the framework of the development of the 4. generation of nuclear reactors. Ten tests have been carried out: 6 on neutronic and fuel aspects, 2 on thermal hydraulics and 2 for the emergency shutdown. Two of them have been chosen for an international exercise on thermal hydraulics and neutronics in the frame of an IAEA Coordinated Research Project. Concerning neutronics, the Control Rod Withdrawal test is relevant for safety because it allows evaluating the capability of calculation tools to compute the radial power distribution on fast reactors core configurations in which the flux field is very deformed. IRSN participated to this benchmark with the ERANOS code developed by CEA for fast reactors studies. This paper presents the results obtained in the framework of the benchmark activity. A relatively good agreement was found with available measures considering the approximations done in the modeling. The work underlines the importance of burn-up calculations in order to have a fine core concentrations mesh for the calculation of the power distribution. (authors)« less

Bridging the gap between climate change and maritime security: Towards a comprehensive framework for planning.

PubMed

Mazaris, Antonios D; Germond, Basil

2018-09-01

For the past two decades, the need to shield strategic maritime interests, to tackle criminality and terrorism at or from the sea and to conserve valuable marine resources has been recognized at the highest political level. Acknowledging and accounting for the interplay between climate change, the vulnerability of coastal populations and the occurrence of maritime criminality should be part of any ocean governance process. Still, given the complex interactions between climate change and socio-economic components of the marine realm, it has become urgent to establish a solid methodological framework, which could lead to sound and effective decisions. We propose that any such framework should not be built from scratch. The adaptation of well tested, existing uncertainty-management tools, such as Cumulative Effect Assessments, could serve as a solid basis to account for the magnitude and directionality of the dependencies between the impacts of climate change and the occurrence of maritime criminality, offering spatial explicit risk evaluations. Multi-Criteria Decision Making could then be employed to better and faster inform decision-makers. These mechanisms could provide a framework for comparison of alternative mitigation and adaptation actions and are essential in assessing responses to tackle maritime crime in the context of climate change. Copyright © 2018 Elsevier B.V. All rights reserved.

A conceptual framework for achieving performance enhancing drug compliance in sport.

PubMed

Donovan, Robert J; Egger, Garry; Kapernick, Vicki; Mendoza, John

2002-01-01

There has been, and continues to be, widespread international concern about athletes' use of banned performance enhancing drugs (PEDs). This concern culminated in the formation of the World Anti-Doping Agency (WADA) in November 1999. To date, the main focus on controlling the use of PEDs has been on testing athletes and the development of tests to detect usage. Although athletes' beliefs and values are known to influence whether or not an athlete will use drugs, little is known about athletes' beliefs and attitudes, and the limited empirical literature shows little use of behavioural science frameworks to guide research methodology, results interpretation, and intervention implications. Mindful of this in preparing its anti-doping strategy for the 2000 Olympics, the Australian Sports Drug Agency (ASDA) in 1997 commissioned a study to assess the extent to which models of attitude-behaviour change in the public health/injury prevention literature had useful implications for compliance campaigns in the sport drug area. A preliminary compliance model was developed from three behavioural science frameworks: social cognition models; threat (or fear) appeals; and instrumental and normative approaches. A subsequent review of the performance enhancing drug literature confirmed that the overall framework was consistent with known empirical data, and therefore had at least face validity if not construct validity. The overall model showed six major inputs to an athlete's attitudes and intentions with respect to performance enhancing drug usage: personality factors, threat appraisal, benefit appraisal, reference group influences, personal morality and legitimacy. The model demonstrated that a comprehensive, fully integrated programme is necessary for maximal effect, and provides anti-doping agencies with a structured framework for strategic planning and implementing interventions. Programmes can be developed in each of the six major areas, with allocation of resources to each area based on needs-assessment research with athletes and other relevant groups.

Toward an Ecological Risk Assessment Framework for Special Education

ERIC Educational Resources Information Center

Trepanier, Nathalie S.

2005-01-01

We suggest a new framework for conducting research in the field of special education. This framework is inspired by the ecological risk assessment frameworks of the U.S. Environmental Protection Agency (1995) and G.W. Suter (1993), which are primarily used in ecotoxicology and environmental toxicology. The framework includes three phases by which…

DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin

The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users tomore » assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. Here in this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.« less

DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs

DOE PAGES

Mao, Yao-Yuan; Kovacs, Eve; Heitmann, Katrin; ...

2018-02-08

The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users tomore » assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. Here in this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.« less

Assessment of urban pluvial flood risk and efficiency of adaptation options through simulations - A new generation of urban planning tools

NASA Astrophysics Data System (ADS)

Löwe, Roland; Urich, Christian; Sto. Domingo, Nina; Mark, Ole; Deletic, Ana; Arnbjerg-Nielsen, Karsten

2017-07-01

We present a new framework for flexible testing of flood risk adaptation strategies in a variety of urban development and climate scenarios. This framework couples the 1D-2D hydrodynamic simulation package MIKE FLOOD with the agent-based urban development model DAnCE4Water and provides the possibility to systematically test various flood risk adaptation measures ranging from large infrastructure changes over decentralised water management to urban planning policies. We have tested the framework in a case study in Melbourne, Australia considering 9 scenarios for urban development and climate and 32 potential combinations of flood adaptation measures. We found that the performance of adaptation measures strongly depended on the considered climate and urban development scenario and the other implementation measures implemented, suggesting that adaptive strategies are preferable over one-off investments. Urban planning policies proved to be an efficient means for the reduction of flood risk, while implementing property buyback and pipe increases in a guideline-oriented manner was too costly. Random variations in location and time point of urban development could have significant impact on flood risk and would in some cases outweigh the benefits of less efficient adaptation strategies. The results of our setup can serve as an input for robust decision making frameworks and thus support the identification of flood risk adaptation measures that are economically efficient and robust to variations of climate and urban layout.

A Framework for Assessing High School Students' Statistical Reasoning

PubMed Central

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students’ statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students’ statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework’s cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments. PMID:27812091

TIMSS 2007 Assessment Frameworks

ERIC Educational Resources Information Center

Mullis, Ina V. S.; Martin, Michael O.; Ruddock, Graham J.; O'Sullivan, Christine Y.; Arora, Alka; Erberber, Ebru

2005-01-01

Developing the Trends in International Mathematics and Science Study (TIMSS) 2007 Assessment Frameworks represents an extensive collaborative effort involving individuals and expert groups from more than 60 countries around the world. The document contains three frameworks for implementing TIMSS 2007--the Mathematics Framework, the Science…

Best practices for assessing ocean health in multiple contexts using tailorable frameworks

PubMed Central

Pacheco, Erich J.; Best, Benjamin D.; Scarborough, Courtney; Longo, Catherine; Katona, Steven K.; Halpern, Benjamin S.

2015-01-01

Marine policy is increasingly calling for maintaining or restoring healthy oceans while human activities continue to intensify. Thus, successful prioritization and management of competing objectives requires a comprehensive assessment of the current state of the ocean. Unfortunately, assessment frameworks to define and quantify current ocean state are often site-specific, limited to a few ocean components, and difficult to reproduce in different geographies or even through time, limiting spatial or temporal comparisons as well as the potential for shared learning. Ideally, frameworks should be tailorable to accommodate use in disparate locations and contexts, removing the need to develop frameworks de novo and allowing efforts to focus on the assessments themselves to advise action. Here, we present some of our experiences using the Ocean Health Index (OHI) framework, a tailorable and repeatable approach that measures health of coupled human-ocean ecosystems in different contexts by accommodating differences in local environmental characteristics, cultural priorities, and information availability and quality. Since its development in 2012, eleven assessments using the OHI framework have been completed at global, national, and regional scales, four of which have been led by independent academic or government groups. We have found the following to be best practices for conducting assessments: Incorporate key characteristics and priorities into the assessment framework design before gathering information; Strategically define spatial boundaries to balance information availability and decision-making scales; Maintain the key characteristics and priorities of the assessment framework regardless of information limitations; and Document and share the assessment process, methods, and tools. These best practices are relevant to most ecosystem assessment processes, but also provide tangible guidance for assessments using the OHI framework. These recommendations also promote transparency around which decisions were made and why, reproducibility through access to detailed methods and computational code, repeatability via the ability to modify methods and computational code, and ease of communication to wide audiences, all of which are critical for any robust assessment process. PMID:26713251

Best practices for assessing ocean health in multiple contexts using tailorable frameworks.

PubMed

Lowndes, Julia S Stewart; Pacheco, Erich J; Best, Benjamin D; Scarborough, Courtney; Longo, Catherine; Katona, Steven K; Halpern, Benjamin S

2015-01-01

Marine policy is increasingly calling for maintaining or restoring healthy oceans while human activities continue to intensify. Thus, successful prioritization and management of competing objectives requires a comprehensive assessment of the current state of the ocean. Unfortunately, assessment frameworks to define and quantify current ocean state are often site-specific, limited to a few ocean components, and difficult to reproduce in different geographies or even through time, limiting spatial or temporal comparisons as well as the potential for shared learning. Ideally, frameworks should be tailorable to accommodate use in disparate locations and contexts, removing the need to develop frameworks de novo and allowing efforts to focus on the assessments themselves to advise action. Here, we present some of our experiences using the Ocean Health Index (OHI) framework, a tailorable and repeatable approach that measures health of coupled human-ocean ecosystems in different contexts by accommodating differences in local environmental characteristics, cultural priorities, and information availability and quality. Since its development in 2012, eleven assessments using the OHI framework have been completed at global, national, and regional scales, four of which have been led by independent academic or government groups. We have found the following to be best practices for conducting assessments: Incorporate key characteristics and priorities into the assessment framework design before gathering information; Strategically define spatial boundaries to balance information availability and decision-making scales; Maintain the key characteristics and priorities of the assessment framework regardless of information limitations; and Document and share the assessment process, methods, and tools. These best practices are relevant to most ecosystem assessment processes, but also provide tangible guidance for assessments using the OHI framework. These recommendations also promote transparency around which decisions were made and why, reproducibility through access to detailed methods and computational code, repeatability via the ability to modify methods and computational code, and ease of communication to wide audiences, all of which are critical for any robust assessment process.

A comparison of fit of CNC-milled titanium and zirconia frameworks to implants.

PubMed

Abduo, Jaafar; Lyons, Karl; Waddell, Neil; Bennani, Vincent; Swain, Michael

2012-05-01

Computer numeric controlled (CNC) milling was proven to be predictable method to fabricate accurately fitting implant titanium frameworks. However, no data are available regarding the fit of CNC-milled implant zirconia frameworks. To compare the precision of fit of implant frameworks milled from titanium and zirconia and relate it to peri-implant strain development after framework fixation. A partially edentulous epoxy resin models received two Branemark implants in the areas of the lower left second premolar and second molar. From this model, 10 identical frameworks were fabricated by mean of CNC milling. Half of them were made from titanium and the other half from zirconia. Strain gauges were mounted close to the implants to qualitatively and quantitatively assess strain development as a result of framework fitting. In addition, the fit of the framework implant interface was measured using an optical microscope, when only one screw was tightened (passive fit) and when all screws were tightened (vertical fit). The data was statistically analyzed using the Mann-Whitney test. All frameworks produced measurable amounts of peri-implant strain. The zirconia frameworks produced significantly less strain than titanium. Combining the qualitative and quantitative information indicates that the implants were under vertical displacement rather than horizontal. The vertical fit was similar for zirconia (3.7 µm) and titanium (3.6 µm) frameworks; however, the zirconia frameworks exhibited a significantly finer passive fit (5.5 µm) than titanium frameworks (13.6 µm). CNC milling produced zirconia and titanium frameworks with high accuracy. The difference between the two materials in terms of fit is expected to be of minimal clinical significance. The strain developed around the implants was more related to the framework fit rather than framework material. © 2011 Wiley Periodicals, Inc.

A review of instruments to measure interprofessional team-based primary care.

PubMed

Shoemaker, Sarah J; Parchman, Michael L; Fuda, Kathleen Kerwin; Schaefer, Judith; Levin, Jessica; Hunt, Meaghan; Ricciardi, Richard

2016-07-01

Interprofessional team-based care is increasingly regarded as an important feature of delivery systems redesigned to provide more efficient and higher quality care, including primary care. Measurement of the functioning of such teams might enable improvement of team effectiveness and could facilitate research on team-based primary care. Our aims were to develop a conceptual framework of high-functioning primary care teams to identify and review instruments that measure the constructs identified in the framework, and to create a searchable, web-based atlas of such instruments (available at: http://primarycaremeasures.ahrq.gov/team-based-care/ ). Our conceptual framework was developed from existing frameworks, the teamwork literature, and expert input. The framework is based on an Input-Mediator-Output model and includes 12 constructs to which we mapped both instruments as a whole, and individual instrument items. Instruments were also reviewed for relevance to measuring team-based care, and characterized. Instruments were identified from peer-reviewed and grey literature, measure databases, and expert input. From nearly 200 instruments initially identified, we found 48 to be relevant to measuring team-based primary care. The majority of instruments were surveys (n = 44), and the remainder (n = 4) were observational checklists. Most instruments had been developed/tested in healthcare settings (n = 30) and addressed multiple constructs, most commonly communication (n = 42), heedful interrelating (n = 42), respectful interactions (n = 40), and shared explicit goals (n = 37). The majority of instruments had some reliability testing (n = 39) and over half included validity testing (n = 29). Currently available instruments offer promise to researchers and practitioners to assess teams' performance, but additional work is needed to adapt these instruments for primary care settings.

Application of Adverse Outcome Pathways to U.S. EPA’s Endocrine Disruptor Screening Program

PubMed Central

Noyes, Pamela D.; Casey, Warren M.; Dix, David J.

2017-01-01

Background: The U.S. EPA’s Endocrine Disruptor Screening Program (EDSP) screens and tests environmental chemicals for potential effects in estrogen, androgen, and thyroid hormone pathways, and it is one of the only regulatory programs designed around chemical mode of action. Objectives: This review describes the EDSP’s use of adverse outcome pathway (AOP) and toxicity pathway frameworks to organize and integrate diverse biological data for evaluating the endocrine activity of chemicals. Using these frameworks helps to establish biologically plausible links between endocrine mechanisms and apical responses when those end points are not measured in the same assay. Results: Pathway frameworks can facilitate a weight of evidence determination of a chemical’s potential endocrine activity, identify data gaps, aid study design, direct assay development, and guide testing strategies. Pathway frameworks also can be used to evaluate the performance of computational approaches as alternatives for low-throughput and animal-based assays and predict downstream key events. In cases where computational methods can be validated based on performance, they may be considered as alternatives to specific assays or end points. Conclusions: A variety of biological systems affect apical end points used in regulatory risk assessments, and without mechanistic data, an endocrine mode of action cannot be determined. Because the EDSP was designed to consider mode of action, toxicity pathway and AOP concepts are a natural fit. Pathway frameworks have diverse applications to endocrine screening and testing. An estrogen pathway example is presented, and similar approaches are being used to evaluate alternative methods and develop predictive models for androgen and thyroid pathways. https://doi.org/10.1289/EHP1304 PMID:28934726

Towards the Implementation of an Assessment-Centred Blended Learning Framework at the Course Level: A Case Study in a Vietnamese National University

ERIC Educational Resources Information Center

Nguyen, Viet Anh

2017-01-01

Purpose: The purpose of this paper is to build an assessment-centred blended learning (BL) framework to assess learners, to analyse and to evaluate the impact of the technology support in the form of formative assessment in students' positive learning. Design/methodology/approach: This research proposed an assessment-centred BL framework at the…

Knowledge Management and Information Technology in Customer Support: A Quantitative Assessment of the U.S. Navy's Distance Support Program

ERIC Educational Resources Information Center

O'Malley, Kevin Dermit

2010-01-01

Centralized customer support is an established industry method used to improve revenue and profitability. What remains unknown is whether this cost-saving commercial business practice is similarly applicable to the unique, often isolated military environment. This research study statistically tested a theoretical framework for knowledge management…

Multi-Dimensional Education: A Common Sense Approach to Data-Driven Thinking

ERIC Educational Resources Information Center

Corrigan, Michael W.; Grove, Doug; Vincent, Philip F.

2011-01-01

Schools aren't one dimensional. Your decision making shouldn't be either. If you want to look beyond student test scores to identify the specific areas that need improvement in your school, you will find practical tools for assessing multiple areas with confidence here. The authors detail a step-by-step framework for identifying, collecting,…

Diagnostic Efficiency of easyCBM[R] Math: Washington State. Technical Report #1008

ERIC Educational Resources Information Center

Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

easyCBM[R] is an online benchmark and progress monitoring assessment system designed for use within a response to intervention framework. Educators using easyCBM[R] are often interested in using the results to predict students' state test performance. In the following technical document, we report diagnostic efficiency statistics using a sample…

Some Uses of a Computer in Teaching, Training, and Testing: Student/Learner Self-Assessment Responding.

ERIC Educational Resources Information Center

Hunt, Darwin P.

The use of systems theory as a conceptual framework is proposed as useful when considering computers as a machine component in teaching. Skinner's proposal that the label "computer" is inaccurate and counterproductive when used to refer to a machine being used for teaching is discussed. It is suggested that the alternative label…

The Effect of Achievement Test Selection on Identification of Learning Disabilities within a Patterns of Strengths and Weaknesses Framework

ERIC Educational Resources Information Center

Miciak, Jeremy; Taylor, W. Pat; Denton, Carolyn A.; Fletcher, Jack M.

2015-01-01

Few empirical investigations have evaluated learning disabilities (LD) identification methods based on a pattern of cognitive strengths and weaknesses (PSW). This study investigated the reliability of LD classification decisions of the concordance/discordance method (C/DM) across different psychoeducational assessment batteries. C/DM criteria were…

Examining Chemistry Students Visual-Perceptual Skills Using the VSCS Tool and Interview Data

ERIC Educational Resources Information Center

Christian, Caroline

2010-01-01

The Visual-Spatial Chemistry Specific (VSCS) assessment tool was developed to test students' visual-perceptual skills, which are required to form a mental image of an object. The VSCS was designed around the theoretical framework of Rochford and Archer that provides eight distinct and well-defined visual-perceptual skills with identified problems…

Contributions of Academic Language, Perspective Taking, and Complex Reasoning to Deep Reading Comprehension

ERIC Educational Resources Information Center

LaRusso, Maria; Kim, Ha Yeon; Selman, Robert; Uccelli, Paola; Dawson, Theo; Jones, Stephanie; Donovan, Suzanne; Snow, Catherine

2016-01-01

"Deep reading comprehension" refers to the process required to succeed at tasks defined by the Common Core State Literacy Standards, as well as to achieve proficiency on the more challenging reading tasks in the Program for International Student Assessment (PISA) framework. The purpose of this study was to test the hypothesis that three…

A Unified Framework for Bounded and Unbounded Numerical Estimation

ERIC Educational Resources Information Center

Kim, Dan; Opfer, John E.

2017-01-01

Representations of numerical value have been assessed by using bounded (e.g., 0-1,000) and unbounded (e.g., 0-?) number-line tasks, with considerable debate regarding whether 1 or both tasks elicit unique cognitive strategies (e.g., addition or subtraction) and require unique cognitive models. To test this, we examined how well a mixed log-linear…

Testing the Hydrological Coherence of High-Resolution Gridded Precipitation and Temperature Data Sets

NASA Astrophysics Data System (ADS)

Laiti, L.; Mallucci, S.; Piccolroaz, S.; Bellin, A.; Zardi, D.; Fiori, A.; Nikulin, G.; Majone, B.

2018-03-01

Assessing the accuracy of gridded climate data sets is highly relevant to climate change impact studies, since evaluation, bias correction, and statistical downscaling of climate models commonly use these products as reference. Among all impact studies those addressing hydrological fluxes are the most affected by errors and biases plaguing these data. This paper introduces a framework, coined Hydrological Coherence Test (HyCoT), for assessing the hydrological coherence of gridded data sets with hydrological observations. HyCoT provides a framework for excluding meteorological forcing data sets not complying with observations, as function of the particular goal at hand. The proposed methodology allows falsifying the hypothesis that a given data set is coherent with hydrological observations on the basis of the performance of hydrological modeling measured by a metric selected by the modeler. HyCoT is demonstrated in the Adige catchment (southeastern Alps, Italy) for streamflow analysis, using a distributed hydrological model. The comparison covers the period 1989-2008 and includes five gridded daily meteorological data sets: E-OBS, MSWEP, MESAN, APGD, and ADIGE. The analysis highlights that APGD and ADIGE, the data sets with highest effective resolution, display similar spatiotemporal precipitation patterns and produce the largest hydrological efficiency indices. Lower performances are observed for E-OBS, MESAN, and MSWEP, especially in small catchments. HyCoT reveals deficiencies in the representation of spatiotemporal patterns of gridded climate data sets, which cannot be corrected by simply rescaling the meteorological forcing fields, as often done in bias correction of climate model outputs. We recommend this framework to assess the hydrological coherence of gridded data sets to be used in large-scale hydroclimatic studies.

Status on the Development of a Modeling and Simulation Framework for the Economic Assessment of Nuclear Hybrid Energy Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bragg-Sitton, Shannon Michelle; Rabiti, Cristian; Kinoshita, Robert Arthur

An effort to design and build a modeling and simulation framework to assess the economic viability of Nuclear Hybrid Energy Systems (NHES) was undertaken in fiscal year 2015 (FY15). The purpose of this report is to document the various tasks associated with the development of such a framework and to provide a status on its progress. Several tasks have been accomplished. First, starting from a simulation strategy, a rigorous mathematical formulation has been achieved in which the economic optimization of a Nuclear Hybrid Energy System is presented as a constrained robust (under uncertainty) optimization problem. Some possible algorithms for themore » solution of the optimization problem are presented. A variation of the Simultaneous Perturbation Stochastic Approximation algorithm has been implemented in RAVEN and preliminary tests have been performed. The development of the software infrastructure to support the simulation of the whole NHES has also moved forward. The coupling between RAVEN and an implementation of the Modelica language (OpenModelica) has been implemented, migrated under several operating systems and tested using an adapted model of a desalination plant. In particular, this exercise was focused on testing the coupling of the different code systems; testing parallel, computationally expensive simulations on the INL cluster; and providing a proof of concept for the possibility of using surrogate models to represent the different NHES subsystems. Another important step was the porting of the RAVEN code under the Windows™ operating system. This accomplishment makes RAVEN compatible with the development environment that is being used for dynamic simulation of NHES components. A very simplified model of a NHES on the electric market has been built in RAVEN to confirm expectations on the analysis capability of RAVEN to provide insight into system economics and to test the capability of RAVEN to identify limit surfaces even for stochastic constraints. This capability will be needed in the future to enforce the stochastic constraints on the electric demand coverage from the NHES. The development team gained experience with many of the tools that are currently envisioned for use in the economic analysis of NHES and completed several important steps. Given the complexity of the project, preference has been given to a structural approach in which several independent efforts have been used to build the cornerstone of the simulation framework. While this is good approach in establishing such a complex framework, it may delay reaching more complete results on the performance of analyzed system configurations. The integration of the previously reported exergy analysis approach was initially proposed as part of this milestone. However, in reality, the exergy-based apportioning of cost will take place only in a second stage of the implementation since it will be used to properly allocate cost among the different NHES subsystems. Therefore, exergy does not appear at the level of the main drivers in the analysis framework; the latter development of the base framework is the focus of this report.« less

Systematic review of the application of the plan–do–study–act method to improve quality in healthcare

PubMed Central

Taylor, Michael J; McNicholas, Chris; Nicolay, Chris; Darzi, Ara; Bell, Derek; Reed, Julie E

2014-01-01

Background Plan–do–study–act (PDSA) cycles provide a structure for iterative testing of changes to improve quality of systems. The method is widely accepted in healthcare improvement; however there is little overarching evaluation of how the method is applied. This paper proposes a theoretical framework for assessing the quality of application of PDSA cycles and explores the consistency with which the method has been applied in peer-reviewed literature against this framework. Methods NHS Evidence and Cochrane databases were searched by three independent reviewers. Empirical studies were included that reported application of the PDSA method in healthcare. Application of PDSA cycles was assessed against key features of the method, including documentation characteristics, use of iterative cycles, prediction-based testing of change, initial small-scale testing and use of data over time. Results 73 of 409 individual articles identified met the inclusion criteria. Of the 73 articles, 47 documented PDSA cycles in sufficient detail for full analysis against the whole framework. Many of these studies reported application of the PDSA method that failed to accord with primary features of the method. Less than 20% (14/73) fully documented the application of a sequence of iterative cycles. Furthermore, a lack of adherence to the notion of small-scale change is apparent and only 15% (7/47) reported the use of quantitative data at monthly or more frequent data intervals to inform progression of cycles. Discussion To progress the development of the science of improvement, a greater understanding of the use of improvement methods, including PDSA, is essential to draw reliable conclusions about their effectiveness. This would be supported by the development of systematic and rigorous standards for the application and reporting of PDSAs. PMID:24025320

A framework for investigating geographical variation in diseases, based on a study of Legionnaires' disease.

PubMed

Bhopal, R S

1991-11-01

Demonstration of geographical variations in disease can yield powerful insight into the disease pathway, particularly for environmentally acquired conditions, but only if the many problems of data interpretation can be solved. This paper presents the framework, methods and principles guiding a study of the geographical epidemiology of Legionnaires' Disease in Scotland. A case-list was constructed and disease incidence rates were calculated by geographical area; these showed variation. Five categories of explanation for the variation were identified: short-term fluctuations of incidence in time masquerading as differences by place; artefact; and differences in host-susceptibility, agent virulence, or environment. The methods used to study these explanations, excepting agent virulence, are described, with an emphasis on the use of previously existing data to test hypotheses. Examples include the use of mortality, census and hospital morbidity data to assess the artefact and host-susceptibility explanations; and the use of ratios of serology tests to disease to examine the differential testing hypothesis. The reasoning and process by which the environmental focus of the study was narrowed and the technique for relating the geographical pattern of disease to the putative source are outlined. This framework allows the researcher to plan for the parallel collection of the data necessary both to demonstrate geographical variation and to point to the likely explanation.

A Bayesian Framework for Reliability Analysis of Spacecraft Deployments

NASA Technical Reports Server (NTRS)

Evans, John W.; Gallo, Luis; Kaminsky, Mark

2012-01-01

Deployable subsystems are essential to mission success of most spacecraft. These subsystems enable critical functions including power, communications and thermal control. The loss of any of these functions will generally result in loss of the mission. These subsystems and their components often consist of unique designs and applications for which various standardized data sources are not applicable for estimating reliability and for assessing risks. In this study, a two stage sequential Bayesian framework for reliability estimation of spacecraft deployment was developed for this purpose. This process was then applied to the James Webb Space Telescope (JWST) Sunshield subsystem, a unique design intended for thermal control of the Optical Telescope Element. Initially, detailed studies of NASA deployment history, "heritage information", were conducted, extending over 45 years of spacecraft launches. This information was then coupled to a non-informative prior and a binomial likelihood function to create a posterior distribution for deployments of various subsystems uSing Monte Carlo Markov Chain sampling. Select distributions were then coupled to a subsequent analysis, using test data and anomaly occurrences on successive ground test deployments of scale model test articles of JWST hardware, to update the NASA heritage data. This allowed for a realistic prediction for the reliability of the complex Sunshield deployment, with credibility limits, within this two stage Bayesian framework.

Critical analysis of e-health readiness assessment frameworks: suitability for application in developing countries.

PubMed

Mauco, Kabelo Leonard; Scott, Richard E; Mars, Maurice

2018-02-01

Introduction e-Health is an innovative way to make health services more effective and efficient and application is increasing worldwide. e-Health represents a substantial ICT investment and its failure usually results in substantial losses in time, money (including opportunity costs) and effort. Therefore it is important to assess e-health readiness prior to implementation. Several frameworks have been published on e-health readiness assessment, under various circumstances and geographical regions of the world. However, their utility for the developing world is unknown. Methods A literature review and analysis of published e-health readiness assessment frameworks or models was performed to determine if any are appropriate for broad assessment of e-health readiness in the developing world. A total of 13 papers described e-health readiness in different settings. Results and Discussion Eight types of e-health readiness were identified and no paper directly addressed all of these. The frameworks were based upon varying assumptions and perspectives. There was no underlying unifying theory underpinning the frameworks. Few assessed government and societal readiness, and none cultural readiness; all are important in the developing world. While the shortcomings of existing frameworks have been highlighted, most contain aspects that are relevant and can be drawn on when developing a framework and assessment tools for the developing world. What emerged is the need to develop different assessment tools for the various stakeholder sectors. This is an area that needs further research before attempting to develop a more generic framework for the developing world.

The development and validation of testing materials for literacy, numeracy and digital skills in a Dutch context

NASA Astrophysics Data System (ADS)

de Greef, Maurice; Segers, Mien; Nijhuis, Jan; Lam, Jo Fond; van Groenestijn, Mieke; van Hoek, Frans; van Deursen, Alexander J. A. M.; Bohnenn, Ella; Tubbing, Marga

2015-10-01

Besides work-oriented training, most Dutch adult learning courses of formal and non-formal education focus on three basic skills: literacy, numeracy and problem solving in technology-rich environments. In the Netherlands, the Ministry of Education, Culture and Science recently initiated the development of a new adult education framework concerning literacy, numeracy and digital skills. In order to monitor the progress of literacy, numeracy and digital competencies, it is necessary to develop and validate testing materials for specific competencies. This study validates the testing materials which were developed to assess learners' proficiency in literacy (reading and writing), numeracy and digital skills based on the new Dutch framework. The outcome is that the materials proved valid and can be used in different courses referring to basic skills and adult learning, though there are still some limitations. Besides adult education professionals (such teachers and trainers), policy makers can also use the results of these tests in order to describe and monitor the impact of adult education on the lives of adult learners.

Fatigue Damage Assessment Leveraging Nondestructive Evaluation Data

NASA Astrophysics Data System (ADS)

Mazur, K.; Wisner, B.; Kontsos, A.

2018-05-01

Fatigue in materials depends on several microstructural parameters. The length and time scales involved in such processes have been investigated by characterization methods that target microstructural effects or that rely on specimen-level observations. Combinations of in situ and ex situ techniques are also used to correlate microstructural changes to bulk properties. We present herein an effort to directly link local changes with specimen-level fatigue damage assessment. To achieve this goal, grain-scale observations in an aluminum alloy are linked with deformation measurements made by digital image correlation and with acoustic emission monitoring obtained from inside the scanning electron microscope. Damage assessment is attempted using a data-processing framework that involves noise removal, data reduction, and classification. The results demonstrate that nondestructive evaluation combined with small-scale testing can provide a means for fatigue damage assessment applicable to a broad range of materials and testing conditions.

Full-arch implant fixed prostheses: a comparative study on the effect of connection type and impression technique on accuracy of fit.

PubMed

Papaspyridakos, Panos; Hirayama, Hiroshi; Chen, Chun-Jung; Ho, Chung-Han; Chronopoulos, Vasilios; Weber, Hans-Peter

2016-09-01

The aim of this study was to assess the effect of connection type and impression technique on the accuracy of fit of implant-supported fixed complete-arch dental prostheses (IFCDPs). An edentulous mandibular cast with five implants was fabricated to serve as master cast (control) for both implant- and abutment-level baselines. A titanium one-piece framework for an IFCDP was milled at abutment level and used for accuracy of fit measurements. Polyether impressions were made using a splinted and non-splinted technique at the implant and abutment level leading to four test groups, n = 10 each. Hence, four groups of test casts were generated. The impression accuracy was evaluated indirectly by assessing the fit of the IFCDP framework on the generated casts of the test groups, clinically and radiographically. Additionally, the control and all test casts were digitized with a high-resolution reference scanner (IScan D103i, Imetric, Courgenay, Switzerland) and standard tessellation language datasets were generated and superimposed. Potential correlations between the clinical accuracy of fit data and the data from the digital scanning were investigated. To compare the accuracy of casts of the test groups versus the control at the implant and abutment level, Fisher's exact test was used. Of the 10 casts of test group I (implant-level splint), all 10 presented with accurate clinical fit when the framework was seated on its respective cast, while only five of 10 casts of test group II (implant-level non-splint) showed adequate fit. All casts of group III (abutment-level splint) presented with accurate fit, whereas nine of 10 of the casts of test group IV (abutment-level non-splint) were accurate. Significant 3D deviations (P < 0.05) were found between group II and the control. No statistically significant differences were found between groups I, III, and IV compared with the control. Implant connection type (implant level vs. abutment level) and impression technique did affect the 3D accuracy of implant impressions only with the non-splint technique (P < 0.05). For one-piece IFCDPs, the implant-level splinted impression technique showed to be more accurate than the non-splinted approach, whereas at the abutment-level, no difference in the accuracy was found. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

International validation of quality indicators for evaluating priority setting in low income countries: process and key lessons.

PubMed

Kapiriri, Lydia

2017-06-19

While there have been efforts to develop frameworks to guide healthcare priority setting; there has been limited focus on evaluation frameworks. Moreover, while the few frameworks identify quality indicators for successful priority setting, they do not provide the users with strategies to verify these indicators. Kapiriri and Martin (Health Care Anal 18:129-147, 2010) developed a framework for evaluating priority setting in low and middle income countries. This framework provides BOTH parameters for successful priority setting and proposes means of their verification. Before its use in real life contexts, this paper presents results from a validation process of the framework. The framework validation involved 53 policy makers and priority setting researchers at the global, national and sub-national levels (in Uganda). They were requested to indicate the relative importance of the proposed parameters as well as the feasibility of obtaining the related information. We also pilot tested the proposed means of verification. Almost all the respondents evaluated all the parameters, including the contextual factors, as 'very important'. However, some respondents at the global level thought 'presence of incentives to comply', 'reduced disagreements', 'increased public understanding,' 'improved institutional accountability' and 'meeting the ministry of health objectives', which could be a reflection of their levels of decision making. All the proposed means of verification were assessed as feasible with the exception of meeting observations which would require an insider. These findings results were consistent with those obtained from the pilot testing. These findings are relevant to policy makers and researchers involved in priority setting in low and middle income countries. To the best of our knowledge, this is one of the few initiatives that has involved potential users of a framework (at the global and in a Low Income Country) in its validation. The favorable validation of all the parameters at the national and sub-national levels implies that the framework has potential usefulness at those levels, as is. The parameters that were disputed at the global level necessitate further discussion when using the framework at that level. The next step is to use the validated framework in evaluating actual priority setting at the different levels.

Development and validation of the Myasthenia Gravis Impairment Index.

PubMed

Barnett, Carolina; Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M

2016-08-30

We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test-retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test-retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79-0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79-0.94). The MGII correlated well with comparison measures, with higher correlations with the MG-activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. © 2016 American Academy of Neurology.

Climate change adaptation frameworks: an evaluation of plans for coastal Suffolk, UK

NASA Astrophysics Data System (ADS)

Armstrong, J.; Wilby, R.; Nicholls, R. J.

2015-11-01

This paper asserts that three principal frameworks for climate change adaptation can be recognised in the literature: scenario-led (SL), vulnerability-led (VL) and decision-centric (DC) frameworks. A criterion is developed to differentiate these frameworks in recent adaptation projects. The criterion features six key hallmarks as follows: (1) use of climate model information; (2) analysis of metrics/units; (3) socio-economic knowledge; (4) stakeholder engagement; (5) adaptation of implementation mechanisms; (6) tier of adaptation implementation. The paper then tests the validity of this approach using adaptation projects on the Suffolk coast, UK. Fourteen adaptation plans were identified in an online survey. They were analysed in relation to the hallmarks outlined above and assigned to an adaptation framework. The results show that while some adaptation plans are primarily SL, VL or DC, the majority are hybrid, showing a mixture of DC/VL and DC/SL characteristics. Interestingly, the SL/VL combination is not observed, perhaps because the DC framework is intermediate and attempts to overcome weaknesses of both SL and VL approaches. The majority (57 %) of adaptation projects generated a risk assessment or advice notes. Further development of this type of framework analysis would allow better guidance on approaches for organisations when implementing climate change adaptation initiatives, and other similar proactive long-term planning.

Climate change adaptation frameworks: an evaluation of plans for coastal, Suffolk, UK

NASA Astrophysics Data System (ADS)

Armstrong, J.; Wilby, R.; Nicholls, R. J.

2015-06-01

This paper asserts that three principal frameworks for climate change adaptation can be recognised in the literature: Scenario-Led (SL), Vulnerability-Led (VL) and Decision-Centric (DC) frameworks. A criterion is developed to differentiate these frameworks in recent adaptation projects. The criterion features six key hallmarks as follows: (1) use of climate model information; (2) analysis metrics/units; (3) socio-economic knowledge; (4) stakeholder engagement; (5) adaptation implementation mechanisms; (6) tier of adaptation implementation. The paper then tests the validity of this approach using adaptation projects on the Suffolk coast, UK. Fourteen adaptation plans were identified in an online survey. They were analysed in relation to the hallmarks outlined above and assigned to an adaptation framework. The results show that while some adaptation plans are primarily SL, VL or DC, the majority are hybrid showing a mixture of DC/VL and DC/SL characteristics. Interestingly, the SL/VL combination is not observed, perhaps because the DC framework is intermediate and attempts to overcome weaknesses of both SL and VL approaches. The majority (57 %) of adaptation projects generated a risk assessment or advice notes. Further development of this type of framework analysis would allow better guidance on approaches for organisations when implementing climate change adaptation initiatives, and other similar proactive long-term planning.

Sustainability assessment framework for scenarios – SAFS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Arushanyan, Yevgeniya, E-mail: yevgeniya.arushanyan@abe.kth.se; KTH Royal Institute of Technology, Centre for Sustainable Communications; Ekener, Elisabeth

To address current challenges regarding sustainable development and support planning for this form of development, new learning about different possible futures and their potential sustainability implications is needed. One way of facilitating this learning is by combining the futures studies and sustainability assessment (SA) research fields. This paper presents the sustainability assessment framework for scenarios (SAFS), a method developed for assessing the environmental and social risks and opportunities of future scenarios, provides guidelines for its application and demonstrates how the framework can be applied. SAFS suggests assessing environmental and social aspects using a consumption perspective and a life cycle approach,more » and provides qualitative results. SAFS does not suggest any modelling using precise data, but instead offers guidelines on how to carry out a qualitative assessment, where both the process of assessing and the outcome of the assessment are valuable and can be used as a basis for discussion. The benefits, drawbacks and potential challenges of applying SAFS are also discussed in the paper. SAFS uses systems thinking looking at future societies as a whole, considering both environmental and social consequences. This encourages researchers and decision-makers to consider the whole picture, and not just individual elements, when considering different futures. - Highlights: • The paper presents a new methodological framework for qualitative sustainability assessment of future scenarios with transformative changes. • The framework suggests qualitative assessment with consumption perspective and a life cycle approach. • The paper presents the framework and provides guidelines for its application. • The paper demonstrates on an example how the framework can be applied. • The benefits, drawbacks and challenges of the framework application and the need for further development are discussed.« less

A conceptual framework to assess effectiveness in wheelchair provision.

PubMed

Kamaraj, Deepan C; Bray, Nathan; Rispin, Karen; Kankipati, Padmaja; Pearlman, Jonathan; Borg, Johan

2017-01-01

Currently, inadequate wheelchair provision has forced many people with disabilities to be trapped in a cycle of poverty and deprivation, limiting their ability to access education, work and social facilities. This issue is in part because of the lack of collaboration among various stakeholders who need to work together to design, manufacture and deliver such assistive mobility devices. This in turn has led to inadequate evidence about intervention effectiveness, disability prevalence and subsequent costeffectiveness that would help facilitate appropriate provision and support for people with disabilities. In this paper, we describe a novel conceptual framework that can be tested across the globe to study and evaluate the effectiveness of wheelchair provision. The Comparative Effectiveness Research Subcommittee (CER-SC), consisting of the authors of this article, housed within the Evidence-Based Practice Working Group (EBP-WG) of the International Society of Wheelchair Professionals (ISWP), conducted a scoping review of scientific literature and standard practices used during wheelchair service provision. The literature review was followed by a series of discussion groups. The three iterations of the conceptual framework are described in this manuscript. We believe that adoption of this conceptual framework could have broad applications in wheelchair provision globally to develop evidence-based practices. Such a perspective will help in the comparison of different strategies employed in wheelchair provision and further improve clinical guidelines. Further work is being conducted to test the efficacy of this conceptual framework to evaluate effectiveness of wheelchair service provision in various settings across the globe.

Effectiveness of Teamwork in an Integrated Care Setting for Patients with COPD: Development and Testing of a Self-Evaluation Instrument for Interprofessional Teams

PubMed Central

Van Dijk-de Vries, Anneke N.; Duimel-Peeters, Inge G. P.; Muris, Jean W.; Wesseling, Geertjan J.; Beusmans, George H. M. I.

2016-01-01

Introduction: Teamwork between healthcare providers is conditional for the delivery of integrated care. This study aimed to assess the usefulness of the conceptual framework Integrated Team Effectiveness Model for developing and testing of the Integrated Team Effectiveness Instrument. Theory and methods: Focus groups with healthcare providers in an integrated care setting for people with chronic obstructive pulmonary disease (COPD) were conducted to examine the recognisability of the conceptual framework and to explore critical success factors for collaborative COPD practice out of this framework. The resulting items were transposed into a pilot instrument. This was reviewed by expert opinion and completed 153 times by healthcare providers. The underlying structure and internal consistency of the instrument were verified by factor analysis and Cronbach’s alpha. Results: The conceptual framework turned out to be comprehensible for discussing teamwork effectiveness. The pilot instrument measures 25 relevant aspects of teamwork in integrated COPD care. Factor analysis suggested three reliable components: teamwork effectiveness, team processes and team psychosocial traits (Cronbach’s alpha between 0.76 and 0.81). Conclusions and discussion: The conceptual framework Integrated Team Effectiveness Model is relevant in developing a practical full-spectrum instrument to facilitate discussing teamwork effectiveness. The Integrated Team Effectiveness Instrument provides a well-founded basis to self-evaluate teamwork effectiveness in integrated COPD care by healthcare providers. Recommendations are provided for the improvement of the instrument. PMID:27616953

A Source-Term Based Boundary Layer Bleed/Effusion Model for Passive Shock Control

NASA Technical Reports Server (NTRS)

Baurle, Robert A.; Norris, Andrew T.

2011-01-01

A modeling framework for boundary layer effusion has been developed based on the use of source (or sink) terms instead of the usual practice of specifying bleed directly as a boundary condition. This framework allows the surface boundary condition (i.e. isothermal wall, adiabatic wall, slip wall, etc.) to remain unaltered in the presence of bleed. This approach also lends itself to easily permit the addition of empirical models for second order effects that are not easily accounted for by simply defining effective transpiration values. Two effusion models formulated for supersonic flows have been implemented into this framework; the Doerffer/Bohning law and the Slater formulation. These models were applied to unit problems that contain key aspects of the flow physics applicable to bleed systems designed for hypersonic air-breathing propulsion systems. The ability of each model to predict bulk bleed properties was assessed, as well as the response of the boundary layer as it passes through and downstream of a porous bleed system. The model assessment was performed with and without the presence of shock waves. Three-dimensional CFD simulations that included the geometric details of the porous plate bleed systems were also carried out to supplement the experimental data, and provide additional insights into the bleed flow physics. Overall, both bleed formulations fared well for the tests performed in this study. However, the sample of test problems considered in this effort was not large enough to permit a comprehensive validation of the models.

Application of the Activity Framework for Assessing Aquatic Ecotoxicology Data for Organic Chemicals.

PubMed

Thomas, Paul; Dawick, James; Lampi, Mark; Lemaire, Philippe; Presow, Shaun; van Egmond, Roger; Arnot, Jon A; Mackay, Donald; Mayer, Philipp; Galay Burgos, Malyka

2015-10-20

Toxicological research in the 1930s gave the first indications of the link between narcotic toxicity and the chemical activity of organic chemicals. More recently, chemical activity has been proposed as a novel exposure parameter that describes the fraction of saturation and that quantifies the potential for partitioning and diffusive uptake. In the present study, more than 2000 acute and chronic algal, aquatic invertebrates and fish toxicity data, as well as water solubility and melting point values, were collected from a series of sources. The data were critically reviewed and grouped by mode of action (MoA). We considered 660 toxicity data to be of acceptable quality. The 328 data which applied to the 72 substances identified as MoA 1 were then evaluated within the activity-toxicity framework: EC50 and LC50 values for all three taxa correlated generally well with (subcooled) liquid solubilities. Acute toxicity was typically exerted within the chemical activity range of 0.01-0.1, whereas chronic toxicity was exerted in the range of 0.001-0.01. These results confirm that chemical activity has the potential to contribute to the determination, interpretation and prediction of toxicity to aquatic organisms. It also has the potential to enhance regulation of organic chemicals by linking results from laboratory tests, monitoring and modeling programs. The framework can provide an additional line of evidence for assessing aquatic toxicity, for improving the design of toxicity tests, reducing animal usage and addressing chemical mixtures.

A Computational Framework for Efficient Low Temperature Plasma Simulations

NASA Astrophysics Data System (ADS)

Verma, Abhishek Kumar; Venkattraman, Ayyaswamy

2016-10-01

Over the past years, scientific computing has emerged as an essential tool for the investigation and prediction of low temperature plasmas (LTP) applications which includes electronics, nanomaterial synthesis, metamaterials etc. To further explore the LTP behavior with greater fidelity, we present a computational toolbox developed to perform LTP simulations. This framework will allow us to enhance our understanding of multiscale plasma phenomenon using high performance computing tools mainly based on OpenFOAM FVM distribution. Although aimed at microplasma simulations, the modular framework is able to perform multiscale, multiphysics simulations of physical systems comprises of LTP. Some salient introductory features are capability to perform parallel, 3D simulations of LTP applications on unstructured meshes. Performance of the solver is tested based on numerical results assessing accuracy and efficiency of benchmarks for problems in microdischarge devices. Numerical simulation of microplasma reactor at atmospheric pressure with hemispherical dielectric coated electrodes will be discussed and hence, provide an overview of applicability and future scope of this framework.

Development of a new integrated local trajectory planning and tracking control framework for autonomous ground vehicles

NASA Astrophysics Data System (ADS)

Li, Xiaohui; Sun, Zhenping; Cao, Dongpu; Liu, Daxue; He, Hangen

2017-03-01

This study proposes a novel integrated local trajectory planning and tracking control (ILTPTC) framework for autonomous vehicles driving along a reference path with obstacles avoidance. For this ILTPTC framework, an efficient state-space sampling-based trajectory planning scheme is employed to smoothly follow the reference path. A model-based predictive path generation algorithm is applied to produce a set of smooth and kinematically-feasible paths connecting the initial state with the sampling terminal states. A velocity control law is then designed to assign a speed value at each of the points along the generated paths. An objective function considering both safety and comfort performance is carefully formulated for assessing the generated trajectories and selecting the optimal one. For accurately tracking the optimal trajectory while overcoming external disturbances and model uncertainties, a combined feedforward and feedback controller is developed. Both simulation analyses and vehicle testing are performed to verify the effectiveness of the proposed ILTPTC framework, and future research is also briefly discussed.

Framework for Infectious Disease Analysis: A comprehensive and integrative multi-modeling approach to disease prediction and management.

PubMed

Erraguntla, Madhav; Zapletal, Josef; Lawley, Mark

2017-12-01

The impact of infectious disease on human populations is a function of many factors including environmental conditions, vector dynamics, transmission mechanics, social and cultural behaviors, and public policy. A comprehensive framework for disease management must fully connect the complete disease lifecycle, including emergence from reservoir populations, zoonotic vector transmission, and impact on human societies. The Framework for Infectious Disease Analysis is a software environment and conceptual architecture for data integration, situational awareness, visualization, prediction, and intervention assessment. Framework for Infectious Disease Analysis automatically collects biosurveillance data using natural language processing, integrates structured and unstructured data from multiple sources, applies advanced machine learning, and uses multi-modeling for analyzing disease dynamics and testing interventions in complex, heterogeneous populations. In the illustrative case studies, natural language processing from social media, news feeds, and websites was used for information extraction, biosurveillance, and situation awareness. Classification machine learning algorithms (support vector machines, random forests, and boosting) were used for disease predictions.

Framework for Assessing Health Risk of Environmental Exposure to Children (External Review Draft)

EPA Science Inventory

The draft document, Framework For Assessing Health Risks of Environmental Exposure to Children, can serve as a resource on children's health risk assessment and it addresses the need to provide a comprehensive and consistent framework for considering children in risk asses...

Psychological Assessment with the DSM-5 Alternative Model for Personality Disorders: Tradition and Innovation

PubMed Central

Waugh, Mark H.; Hopwood, Christopher J.; Krueger, Robert F.; Morey, Leslie C.; Pincus, Aaron L.; Wright, Aidan G. C.

2016-01-01

The Diagnostic and Statistical Manual of Mental Disorders Fifth Edition (DSM-5) Section III Alternative Model for Personality Disorders (AMPD; APA, 2013) represents an innovative system for simultaneous psychiatric classification and psychological assessment of personality disorders (PD). The AMPD combines major paradigms of personality assessment and provides an original, heuristic, flexible, and practical framework that enriches clinical thinking and practice. Origins, emerging research, and clinical application of the AMPD for diagnosis and psychological assessment are reviewed. The AMPD integrates assessment and research traditions, facilitates case conceptualization, is easy to learn and use, and assists in providing patient feedback. New as well as existing tests and psychometric methods may be used to operationalize the AMPD for clinical assessments. PMID:28450760

Psychological Assessment with the DSM-5 Alternative Model for Personality Disorders: Tradition and Innovation.

PubMed

Waugh, Mark H; Hopwood, Christopher J; Krueger, Robert F; Morey, Leslie C; Pincus, Aaron L; Wright, Aidan G C

2017-04-01

The Diagnostic and Statistical Manual of Mental Disorders Fifth Edition (DSM-5) Section III Alternative Model for Personality Disorders (AMPD; APA, 2013) represents an innovative system for simultaneous psychiatric classification and psychological assessment of personality disorders (PD). The AMPD combines major paradigms of personality assessment and provides an original, heuristic, flexible, and practical framework that enriches clinical thinking and practice. Origins, emerging research, and clinical application of the AMPD for diagnosis and psychological assessment are reviewed. The AMPD integrates assessment and research traditions, facilitates case conceptualization, is easy to learn and use, and assists in providing patient feedback. New as well as existing tests and psychometric methods may be used to operationalize the AMPD for clinical assessments.

Analysis test of understanding of vectors with the three-parameter logistic model of item response theory and item response curves technique

NASA Astrophysics Data System (ADS)

Rakkapao, Suttida; Prasitpong, Singha; Arayathanitkul, Kwan

2016-12-01

This study investigated the multiple-choice test of understanding of vectors (TUV), by applying item response theory (IRT). The difficulty, discriminatory, and guessing parameters of the TUV items were fit with the three-parameter logistic model of IRT, using the parscale program. The TUV ability is an ability parameter, here estimated assuming unidimensionality and local independence. Moreover, all distractors of the TUV were analyzed from item response curves (IRC) that represent simplified IRT. Data were gathered on 2392 science and engineering freshmen, from three universities in Thailand. The results revealed IRT analysis to be useful in assessing the test since its item parameters are independent of the ability parameters. The IRT framework reveals item-level information, and indicates appropriate ability ranges for the test. Moreover, the IRC analysis can be used to assess the effectiveness of the test's distractors. Both IRT and IRC approaches reveal test characteristics beyond those revealed by the classical analysis methods of tests. Test developers can apply these methods to diagnose and evaluate the features of items at various ability levels of test takers.

A Regression Framework for Effect Size Assessments in Longitudinal Modeling of Group Differences

PubMed Central

Feingold, Alan

2013-01-01

The use of growth modeling analysis (GMA)--particularly multilevel analysis and latent growth modeling--to test the significance of intervention effects has increased exponentially in prevention science, clinical psychology, and psychiatry over the past 15 years. Model-based effect sizes for differences in means between two independent groups in GMA can be expressed in the same metric (Cohen’s d) commonly used in classical analysis and meta-analysis. This article first reviews conceptual issues regarding calculation of d for findings from GMA and then introduces an integrative framework for effect size assessments that subsumes GMA. The new approach uses the structure of the linear regression model, from which effect sizes for findings from diverse cross-sectional and longitudinal analyses can be calculated with familiar statistics, such as the regression coefficient, the standard deviation of the dependent measure, and study duration. PMID:23956615

Development of the Informing Relatives Inventory (IRI): Assessing Index Patients' Knowledge, Motivation and Self-Efficacy Regarding the Disclosure of Hereditary Cancer Risk Information to Relatives.

PubMed

de Geus, Eveline; Aalfs, Cora M; Menko, Fred H; Sijmons, Rolf H; Verdam, Mathilde G E; de Haes, Hanneke C J M; Smets, Ellen M A

2015-08-01

Despite the use of genetic services, counselees do not always share hereditary cancer information with at-risk relatives. Reasons for not informing relatives may be categorized as a lack of: knowledge, motivation, and/or self-efficacy. This study aims to develop and test the psychometric properties of the Informing Relatives Inventory, a battery of instruments that intend to measure counselees' knowledge, motivation, and self-efficacy regarding the disclosure of hereditary cancer risk information to at-risk relatives. Guided by the proposed conceptual framework, existing instruments were selected and new instruments were developed. We tested the instruments' acceptability, dimensionality, reliability, and criterion-related validity in consecutive index patients visiting the Clinical Genetics department with questions regarding hereditary breast and/or ovarian cancer or colon cancer. Data of 211 index patients were included (response rate = 62%). The Informing Relatives Inventory (IRI) assesses three barriers in disclosure representing seven domains. Instruments assessing index patients' (positive) motivation and self-efficacy were acceptable and reliable and suggested good criterion-related validity. Psychometric properties of instruments assessing index patients knowledge were disputable. These items were moderately accepted by index patients and the criterion-related validity was weaker. This study presents a first conceptual framework and associated inventory (IRI) that improves insight into index patients' barriers regarding the disclosure of genetic cancer information to at-risk relatives. Instruments assessing (positive) motivation and self-efficacy proved to be reliable measurements. Measuring index patients knowledge appeared to be more challenging. Further research is necessary to ensure IRI's dimensionality and sensitivity to change.

Supporting shared hypothesis testing in the biomedical domain.

PubMed

Agibetov, Asan; Jiménez-Ruiz, Ernesto; Ondrésik, Marta; Solimando, Alessandro; Banerjee, Imon; Guerrini, Giovanna; Catalano, Chiara E; Oliveira, Joaquim M; Patanè, Giuseppe; Reis, Rui L; Spagnuolo, Michela

2018-02-08

Pathogenesis of inflammatory diseases can be tracked by studying the causality relationships among the factors contributing to its development. We could, for instance, hypothesize on the connections of the pathogenesis outcomes to the observed conditions. And to prove such causal hypotheses we would need to have the full understanding of the causal relationships, and we would have to provide all the necessary evidences to support our claims. In practice, however, we might not possess all the background knowledge on the causality relationships, and we might be unable to collect all the evidence to prove our hypotheses. In this work we propose a methodology for the translation of biological knowledge on causality relationships of biological processes and their effects on conditions to a computational framework for hypothesis testing. The methodology consists of two main points: hypothesis graph construction from the formalization of the background knowledge on causality relationships, and confidence measurement in a causality hypothesis as a normalized weighted path computation in the hypothesis graph. In this framework, we can simulate collection of evidences and assess confidence in a causality hypothesis by measuring it proportionally to the amount of available knowledge and collected evidences. We evaluate our methodology on a hypothesis graph that represents both contributing factors which may cause cartilage degradation and the factors which might be caused by the cartilage degradation during osteoarthritis. Hypothesis graph construction has proven to be robust to the addition of potentially contradictory information on the simultaneously positive and negative effects. The obtained confidence measures for the specific causality hypotheses have been validated by our domain experts, and, correspond closely to their subjective assessments of confidences in investigated hypotheses. Overall, our methodology for a shared hypothesis testing framework exhibits important properties that researchers will find useful in literature review for their experimental studies, planning and prioritizing evidence collection acquisition procedures, and testing their hypotheses with different depths of knowledge on causal dependencies of biological processes and their effects on the observed conditions.

Integrated Testing Strategy (ITS) - Opportunities to better use existing data and guide future testing in toxicology.

PubMed

Jaworska, Joanna; Hoffmann, Sebastian

2010-01-01

The topic of Integrated Testing Strategies (ITS) has attracted considerable attention, and not only because it is supposed to be a central element of REACH, the ambitious European chemical regulation effort. Although what ITSs are supposed to do seems unambiguous, i.e. speeding up hazard and risk assessment while reducing testing costs, not much has been said, except basic conceptual proposals, about the methodologies that would allow execution of these concepts. Although a pressing concern, the topic of ITS has drawn mostly general reviews, broad concepts, and the expression of a clear need for more research on ITS. Published research in the field remains scarce. Solutions for ITS design emerge slowly, most likely due to the methodological challenges of the task, and perhaps also to it its complexity and the need for multidisciplinary collaboration. Along with the challenge, ITS offer a unique opportunity to contribute to the Toxicology of the 21st century by providing frameworks and tools to actually implement 21st century toxicology data in the chemical management and decision making processes. Further, ITS have the potential to significantly contribute to a modernization of the science of risk assessment. Therefore, to advance ITS research we propose a methodical approach to their design and will discuss currently available approaches as well as challenges to overcome. To this end, we define a framework for ITS that will inform toxicological decisions in a systematic, transparent, and consistent way. We review conceptual requirements for ITS developed earlier and present a roadmap to an operational framework that should be probabilistic, hypothesis-driven, and adaptive. Furthermore, we define properties an ITS should have in order to meet the identified requirements and differentiate them from evidence synthesis. Making use of an ITS for skin sensitization, we demonstrate how the proposed ITS concepts can be implemented.

Outcomes-focused knowledge translation: a framework for knowledge translation and patient outcomes improvement.

PubMed

Doran, Diane M; Sidani, Souraya

2007-01-01

Regularly accessing information that is current and reliable continues to be a challenge for front-line staff nurses. Reconceptualizing how nurses access information and designing appropriate decision support systems to facilitate timely access to information may be important for increasing research utilization. An outcomes-focused knowledge translation framework was developed to guide the continuous improvement of patient care through the uptake of research evidence and feedback data about patient outcomes. The framework operationalizes the three elements of the PARIHS framework at the point of care. Outcomes-focused knowledge translation involves four components: (a) patient outcomes measurement and real-time feedback about outcomes achievement; (b) best-practice guidelines, embedded in decision support tools that deliver key messages in response to patient assessment data; (c) clarification of patients' preferences for care; and (d) facilitation by advanced practice nurses and practice leaders. In this paper the framework is described and evidence is provided to support theorized relationships among the concepts in the framework. The framework guided the design of a knowledge translation intervention aimed at continuous improvement of patient care and evidence-based practice, which are fostered through real-time feedback data about patient outcomes, electronic access to evidence-based resources at the point of care, and facilitation by advanced practice nurses. The propositions in the framework need to be empirically tested through future research.

Frameworks and tools for risk assessment of manufactured nanomaterials.

PubMed

Hristozov, Danail; Gottardo, Stefania; Semenzin, Elena; Oomen, Agnes; Bos, Peter; Peijnenburg, Willie; van Tongeren, Martie; Nowack, Bernd; Hunt, Neil; Brunelli, Andrea; Scott-Fordsmand, Janeck J; Tran, Lang; Marcomini, Antonio

2016-10-01

Commercialization of nanotechnologies entails a regulatory requirement for understanding their environmental, health and safety (EHS) risks. Today we face challenges to assess these risks, which emerge from uncertainties around the interactions of manufactured nanomaterials (MNs) with humans and the environment. In order to reduce these uncertainties, it is necessary to generate sound scientific data on hazard and exposure by means of relevant frameworks and tools. The development of such approaches to facilitate the risk assessment (RA) of MNs has become a dynamic area of research. The aim of this paper was to review and critically analyse these approaches against a set of relevant criteria. The analysis concluded that none of the reviewed frameworks were able to fulfill all evaluation criteria. Many of the existing modelling tools are designed to provide screening-level assessments rather than to support regulatory RA and risk management. Nevertheless, there is a tendency towards developing more quantitative, higher-tier models, capable of incorporating uncertainty into their analyses. There is also a trend towards developing validated experimental protocols for material identification and hazard testing, reproducible across laboratories. These tools could enable a shift from a costly case-by-case RA of MNs towards a targeted, flexible and efficient process, based on grouping and read-across strategies and compliant with the 3R (Replacement, Reduction, Refinement) principles. In order to facilitate this process, it is important to transform the current efforts on developing databases and computational models into creating an integrated data and tools infrastructure to support the risk assessment and management of MNs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Relationships among Classical Test Theory and Item Response Theory Frameworks via Factor Analytic Models

ERIC Educational Resources Information Center

Kohli, Nidhi; Koran, Jennifer; Henn, Lisa

2015-01-01

There are well-defined theoretical differences between the classical test theory (CTT) and item response theory (IRT) frameworks. It is understood that in the CTT framework, person and item statistics are test- and sample-dependent. This is not the perception with IRT. For this reason, the IRT framework is considered to be theoretically superior…

Remembering the snake in the grass: Threat enhances recognition but not source memory.

PubMed

Meyer, Miriam Magdalena; Bell, Raoul; Buchner, Axel

2015-12-01

Research on the influence of emotion on source memory has yielded inconsistent findings. The object-based framework (Mather, 2007) predicts that negatively arousing stimuli attract attention, resulting in enhanced within-object binding, and, thereby, enhanced source memory for intrinsic context features of emotional stimuli. To test this prediction, we presented pictures of threatening and harmless animals, the color of which had been experimentally manipulated. In a memory test, old-new recognition for the animals and source memory for their color was assessed. In all 3 experiments, old-new recognition was better for the more threatening material, which supports previous reports of an emotional memory enhancement. This recognition advantage was due to the emotional properties of the stimulus material, and not specific for snake stimuli. However, inconsistent with the prediction of the object-based framework, intrinsic source memory was not affected by emotion. (c) 2015 APA, all rights reserved).

An Integrated Data-Driven Strategy for Safe-by-Design Nanoparticles: The FP7 MODERN Project.

PubMed

Brehm, Martin; Kafka, Alexander; Bamler, Markus; Kühne, Ralph; Schüürmann, Gerrit; Sikk, Lauri; Burk, Jaanus; Burk, Peeter; Tamm, Tarmo; Tämm, Kaido; Pokhrel, Suman; Mädler, Lutz; Kahru, Anne; Aruoja, Villem; Sihtmäe, Mariliis; Scott-Fordsmand, Janeck; Sorensen, Peter B; Escorihuela, Laura; Roca, Carlos P; Fernández, Alberto; Giralt, Francesc; Rallo, Robert

2017-01-01

The development and implementation of safe-by-design strategies is key for the safe development of future generations of nanotechnology enabled products. The safety testing of the huge variety of nanomaterials that can be synthetized is unfeasible due to time and cost constraints. Computational modeling facilitates the implementation of alternative testing strategies in a time and cost effective way. The development of predictive nanotoxicology models requires the use of high quality experimental data on the structure, physicochemical properties and bioactivity of nanomaterials. The FP7 Project MODERN has developed and evaluated the main components of a computational framework for the evaluation of the environmental and health impacts of nanoparticles. This chapter describes each of the elements of the framework including aspects related to data generation, management and integration; development of nanodescriptors; establishment of nanostructure-activity relationships; identification of nanoparticle categories; hazard ranking and risk assessment.

Motivation and engagement in music and sport: testing a multidimensional framework in diverse performance settings.

PubMed

Martin, Andrew J

2008-02-01

The present study assessed the application of a multidimensional model of motivation and engagement (the Motivation and Engagement Wheel) and its accompanying instrumentation (the Motivation and Engagement Scale) to the music and sport domains. Participants were 463 young classical musicians (N=224) and sportspeople (N=239). In both music and sport samples, the data confirmed the good fit of the four hypothesized higher-order dimensions and their 11 first-order dimensions: adaptive cognitions (self-efficacy, valuing, mastery orientation), adaptive behaviors (planning, task management, persistence), impeding/maladaptive cognitions (uncertain control, anxiety, failure avoidance), and maladaptive behaviors (self-handicapping, disengagement). Multigroup tests of factor invariance showed that in terms of underlying motivational constructs and the composition of and relationships among these constructs, key subsamples are not substantially different. Moreover-and of particular relevance to issues around the generalizability of the framework-the factor structure for music and sport samples was predominantly invariant.

Toward implementation of a national ground water monitoring network

USGS Publications Warehouse

Schreiber, Robert P.; Cunningham, William L.; Copeland, Rick; Frederick, Kevin D.

2008-01-01

The Federal Advisory Committee on Water Information's (ACWI) Subcommittee on Ground Water (SOGW) has been working steadily to develop and encourage implementation of a nationwide, long-term ground-water quantity and quality monitoring framework. Significant progress includes the planned submission this fall of a draft framework document to the full committee. The document will include recommendations for implementation of the network and continued acknowledgment at the federal and state level of ACWI's potential role in national monitoring toward an improved assessment of the nation's water reserves. The SOGW mission includes addressing several issues regarding network design, as well as developing plans for concept testing, evaluation of costs and benefits, and encouraging the movement from pilot-test results to full-scale implementation within a reasonable time period. With the recent attention to water resource sustainability driven by severe droughts, concerns over global warming effects, and persistent water supply problems, the SOGW mission is now even more critical.

Developing Academic English Language Proficiency Prototypes for 5th Grade Reading: Psychometric and Linguistic Profiles of Tasks. CSE Technical Report 727

ERIC Educational Resources Information Center

Bailey, Alison L.; Huang, Becky H.; Shin, Hye Won; Farnsworth, Tim; Butler, Frances A.

2007-01-01

Within an evidentiary framework for operationally defining academic English language proficiency (AELP), linguistic analyses of standards, classroom discourse, and textbooks have led to specifications for assessment of AELP. The test development process described here is novel due to the emphasis on using linguistic profiles to inform the …

Some Thoughts about the Value of an OECD International Assessment Framework for Early Childhood Services in Aotearoa New Zealand

ERIC Educational Resources Information Center

Carr, Margaret; Mitchell, Linda; Rameka, Lesley

2016-01-01

In this article, the authors argue that the use of Organisation for Economic Co-operation and Development (OECD) standardized tests to evaluate the early childhood education sector, while it may be perfectly "scientific", could be disastrous for "Te Whariki", a curriculum that is child-centred and learning-oriented. The basic…

Reading Framework for the 2009 National Assessment of Educational Progress

ERIC Educational Resources Information Center

National Assessment Governing Board, 2008

2008-01-01

This document sets forth the design of a test of reading comprehension. The exam requires students to read passages of written English text--either literary or informational--and to answer questions about what they have read. In some cases, the questions deal with facts in the text or vocabulary. In other cases, a complete answer requires a clear…

TOEFL Junior® Design Framework. TOEFL Junior® Research Report. TOEFL JR-02. ETS Research Report No. RR-15-13

ERIC Educational Resources Information Center

So, Youngsoon; Wolf, Mikyung Kim; Hauck, Maurice C.; Mollaun, Pamela; Rybinski, Paul; Tumposky, Daniel; Wang, Lin

2015-01-01

This paper presents the theoretical and empirical foundations of the "TOEFL Junior"® assessment and its development process. The TOEFL Junior test was developed to address the increasing need for objective measures of English language proficiency for young adolescent learners, who are being introduced to English as a second or foreign…

Metrological Traceability in the Social Sciences: A Model from Reading Measurement

NASA Astrophysics Data System (ADS)

Stenner, A. Jackson; Fisher, William P., Jr.

2013-09-01

The central importance of reading ability in learning makes it the natural place to start in formative and summative assessments in education. The Lexile Framework for Reading constitutes a commercial metrological traceability network linking books, test results, instructional materials, and students in elementary and secondary English and Spanish language reading education in the U.S., Canada, Mexico, and Australia.

Research on Data Use: A Framework and Analysis

ERIC Educational Resources Information Center

Coburn, Cynthia E.; Turner, Erica O.

2011-01-01

One of the central lessons from research on data use in schools and school districts is that assessments, student tests, and other forms of data are only as good as how they are used. But what influences how they are used? This relatively straightforward question turns out to be fairly complex to answer. Data use implicates a number of processes,…

The Impact of Model Misspecification on Parameter Estimation and Item-Fit Assessment in Log-Linear Diagnostic Classification Models

ERIC Educational Resources Information Center

Kunina-Habenicht, Olga; Rupp, Andre A.; Wilhelm, Oliver

2012-01-01

Using a complex simulation study we investigated parameter recovery, classification accuracy, and performance of two item-fit statistics for correct and misspecified diagnostic classification models within a log-linear modeling framework. The basic manipulated test design factors included the number of respondents (1,000 vs. 10,000), attributes (3…

Assessing the Relationship Between Questioning and Understanding to Improve Learning and Thinking (QUILT) and Student Achievement in Mathematics: A Pilot Study

ERIC Educational Resources Information Center

Craig, Jim; Cairo, III, Leslie

2005-01-01

Good questions, effectively delivered are a key feature of learning and teaching. QUILT is a research-based, field-tested professional development program designed to assist teachers in developing and implementing effective questioning skills to facilitate student learning. The QUILT framework presents classroom questioning as a five-stage…

Assessing the health impact of transnational corporations: a case study on McDonald's Australia.

PubMed

Anaf, Julia; Baum, Frances E; Fisher, Matt; Harris, Elizabeth; Friel, Sharon

2017-02-06

The practices of transnational corporations affect population health through production methods, shaping social determinants of health, or influencing the regulatory structures governing their activities. There has been limited research on community exposures to TNC policies and practices. Our pilot research used McDonald's Australia to test methods for assessing the health impacts of one TNC within Australia. We adapted existing Health Impact Assessment methods to assess McDonald's activities. Data identifying potential impacts were sourced through document analysis, including McDonald's corporate literature; media analysis and semi-structured interviews. We commissioned a spatial and socioeconomic analysis of McDonald's restaurants in Australia through Geographic Information System technology. The data was mapped against a corporate health impact assessment framework which included McDonald's Australia's political and business practices; products and marketing; workforce, social, environmental and economic conditions; and consumers' health related behaviours. We identified both positive and detrimental aspects of McDonald's Australian operations across the scope of the CHIA framework. We found that McDonald's outlets were slightly more likely to be located in areas of lower socioeconomic status. McDonald's workplace conditions were found to be more favourable than those in many other countries which reflects compliance with Australian employment regulations. The breadth of findings revealed the need for governments to strengthen regulatory mechanisms that are conducive to health; the opportunity for McDonald's to augment their corporate social responsibility initiatives and bolster reputational endorsement; and civil society actors to inform their advocacy towards health and equity outcomes from TNC operations. Our study indicates that undertaking a corporate health impact assessment is possible, with the different methods revealing sufficient information to realise that strong regulatory frameworks are need to help to avoid or to mediate negative health impacts.

Fish embryo toxicity test, threshold approach, and moribund as approaches to implement 3R principles to the acute fish toxicity test.

PubMed

Dang, ZhiChao; van der Ven, Leo T M; Kienhuis, Anne S

2017-11-01

The acute fish toxicity test (AFT) is requested by EU legal frameworks for hazard classification and risk assessment. AFT is one of the few regulatory required tests using death as an endpoint. This paper reviews efforts made to reduce, refine and replace (3Rs) AFT. We make an inventory of information requirements for AFT, summarize studies on 3Rs of AFT and give recommendations. The fish embryo toxicity test (FET) is proposed as a replacement of AFT and analyses have focused on two aspects: assessing the capacity of FET in predicting AFT and defining the applicability domain of FET. Six comparison studies have consistently shown a strong correlation of FET and AFT. In contrast, the applicability domain of FET has not yet been fully defined. FET has not yet been accepted as a replacement of AFT by any EU legal frameworks to fulfill information requirements because FET is insensitive to some chemicals. It is recommended that the outlier chemicals that do not correlate between FET and AFT should be further investigated. When necessary, additional FET data should be generated. Another effort to reduce and refine AFT is incorporation of FET into the threshold approach. Furthermore, moribund as an endpoint of fish death has been introduced in revising AFT guideline to reduce the duration of suffering for refinement. This endpoint, however, needs further work on the link of moribund and death. Global regulatory acceptance of the moribund endpoint would be critical for this development. Copyright © 2017 Elsevier Ltd. All rights reserved.

The comparative risk assessment framework and tools (CRAFT)

Treesearch

Southern Research Station USDA Forest Service

2010-01-01

To help address these challenges, the USDA Forest Service’s Eastern Forest Environmental Threat Assessment Center (EFETAC) and the University of North Carolina Asheville’s National Environmental Modeling and Analysis Center (NEMAC) designed a planning framework, called the Comparative Risk Assessment Framework and Tools (CRAFT). CRAFT is...

Assessing Higher-Order Cognitive Constructs by Using an Information-Processing Framework

ERIC Educational Resources Information Center

Dickison, Philip; Luo, Xiao; Kim, Doyoung; Woo, Ada; Muntean, William; Bergstrom, Betty

2016-01-01

Designing a theory-based assessment with sound psychometric qualities to measure a higher-order cognitive construct is a highly desired yet challenging task for many practitioners. This paper proposes a framework for designing a theory-based assessment to measure a higher-order cognitive construct. This framework results in a modularized yet…

Retrofitting Non-Cognitive-Diagnostic Reading Assessment under the Generalized DINA Model Framework

ERIC Educational Resources Information Center

Chen, Huilin; Chen, Jinsong

2016-01-01

Cognitive diagnosis models (CDMs) are psychometric models developed mainly to assess examinees' specific strengths and weaknesses in a set of skills or attributes within a domain. By adopting the Generalized-DINA model framework, the recently developed general modeling framework, we attempted to retrofit the PISA reading assessments, a…

Assessment of the importance of neutron multiplication for tritium production

NASA Astrophysics Data System (ADS)

Chiovaro, P.; Di Maio, P. A.

2017-01-01

One of the major requirements for a fusion power plant in the future is tritium self-sufficiency. For this reason the scientific community has dedicated a lot of effort to research activity on reactor tritium breeding blankets. In the framework of the international project DEMO, many concepts of breeding blanket have been taken into account and some of them will be tested in the experimental reactor ITER by means of appropriate test blanket modules (TBMs). All the breeding blanket concepts rely on the adoption of binary systems composed of a material acting as neutronic multiplier and another as a breeder. This paper addresses a neutronic feature of these kinds of systems. In particular, attention has been focused on the assessment of the importance of neutrons coming from multiplication reactions for the production of tritium. A theoretical framework has been set up and a procedure to evaluate the performance of the multiplier-breeder systems, under the aforementioned point of view, has been developed. Moreover, the model set up has been applied to helium cooled lithium lead and helium cooled pebble bad TBMs under irradiation in ITER and the results have been critically discussed.

A Model Independent S/W Framework for Search-Based Software Testing

PubMed Central

Baik, Jongmoon

2014-01-01

In Model-Based Testing (MBT) area, Search-Based Software Testing (SBST) has been employed to generate test cases from the model of a system under test. However, many types of models have been used in MBT. If the type of a model has changed from one to another, all functions of a search technique must be reimplemented because the types of models are different even if the same search technique has been applied. It requires too much time and effort to implement the same algorithm over and over again. We propose a model-independent software framework for SBST, which can reduce redundant works. The framework provides a reusable common software platform to reduce time and effort. The software framework not only presents design patterns to find test cases for a target model but also reduces development time by using common functions provided in the framework. We show the effectiveness and efficiency of the proposed framework with two case studies. The framework improves the productivity by about 50% when changing the type of a model. PMID:25302314

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

PubMed

Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

The Framework for the National Assessment of Educational Progress in Civics. ERIC Digest.

ERIC Educational Resources Information Center

Patrick, John J.

This digest briefly summarizes the contents of the "Civics Framework for the 1998 National Assessment of Educational Progress" in terms of the Framework's development and components including civic knowledge, civic skills, and civic dispositions. The framework may be used to inform and guide curriculum development projects in civics and…

Toward an Ecological Risk Assessment Framework for Special Education

ERIC Educational Resources Information Center

Trepanier, Nathalie Sonia

2005-01-01

This paper suggests a new framework for conducting research in the field of special education. This framework is inspired by the ecological risk assessment frameworks of the U.S. Environmental Protection Agency (1995) and G.W. Suter (1993), which are primarily used in ecotoxicology and environmental toxicology. The methodology used to develop the…

Ex-ante assessment of the safety effects of intelligent transport systems.

PubMed

Kulmala, Risto

2010-07-01

There is a need to develop a comprehensive framework for the safety assessment of Intelligent Transport Systems (ITS). This framework should: (1) cover all three dimensions of road safety-exposure, crash risk and consequence, (2) cover, in addition to the engineering effect, also the effects due to behavioural adaptation and (3) be compatible with the other aspects of state of the art road safety theories. A framework based on nine ITS safety mechanisms is proposed and discussed with regard to the requirements set to the framework. In order to illustrate the application of the framework in practice, the paper presents a method based on the framework and the results from applying that method for twelve intelligent vehicle systems in Europe. The framework is also compared to two recent frameworks applied in the safety assessment of intelligent vehicle safety systems. Copyright 2010 Elsevier Ltd. All rights reserved.

The Sequential Probability Ratio Test: An efficient alternative to exact binomial testing for Clean Water Act 303(d) evaluation.

PubMed

Chen, Connie; Gribble, Matthew O; Bartroff, Jay; Bay, Steven M; Goldstein, Larry

2017-05-01

The United States's Clean Water Act stipulates in section 303(d) that states must identify impaired water bodies for which total maximum daily loads (TMDLs) of pollution inputs into water bodies are developed. Decision-making procedures about how to list, or delist, water bodies as impaired, or not, per Clean Water Act 303(d) differ across states. In states such as California, whether or not a particular monitoring sample suggests that water quality is impaired can be regarded as a binary outcome variable, and California's current regulatory framework invokes a version of the exact binomial test to consolidate evidence across samples and assess whether the overall water body complies with the Clean Water Act. Here, we contrast the performance of California's exact binomial test with one potential alternative, the Sequential Probability Ratio Test (SPRT). The SPRT uses a sequential testing framework, testing samples as they become available and evaluating evidence as it emerges, rather than measuring all the samples and calculating a test statistic at the end of the data collection process. Through simulations and theoretical derivations, we demonstrate that the SPRT on average requires fewer samples to be measured to have comparable Type I and Type II error rates as the current fixed-sample binomial test. Policymakers might consider efficient alternatives such as SPRT to current procedure. Copyright © 2017 Elsevier Ltd. All rights reserved.

Case studies to test: A framework for using structural, reactivity, metabolic and physicochemical similarity to evaluate the suitability of analogs for SAR-based toxicological assessments.

PubMed

Blackburn, Karen; Bjerke, Donald; Daston, George; Felter, Susan; Mahony, Catherine; Naciff, Jorge; Robison, Steven; Wu, Shengde

2011-06-01

A process for evaluating analogs for use in SAR (Structure-Activity Relationship) assessments was previously published (Wu et al. 2010). Subsequently, this process has been updated to include a decision tree for estrogen binding (from US EPA) and flags for developmental and reproductive toxicity (DART). This paper presents the results of blinded case studies designed to test this updated framework. The results of these case studies support the conclusion that the process outlined by Wu et al. (2010) can be successfully applied to develop surrogate values for risk assessment. The read across results generated by the process were shown to be protective when compared to the actual toxicity data. Successful application of the approach requires significant expertise as well as discipline to not overstep the boundaries of the defined analogs and the rating system. The end result of this rigor can be the inability to read across all endpoints for all chemicals resulting in data gaps that cannot be filled using read across, however, this reflects the current state of the science and is preferable to making non-protective decisions. Future work will be targeted towards expanding read across capabilities. Two examples of a broader category approach are also shown. Copyright © 2011 Elsevier Inc. All rights reserved.

Prediction of skin sensitizers using alternative methods to animal experimentation.

PubMed

Johansson, Henrik; Lindstedt, Malin

2014-07-01

Regulatory frameworks within the European Union demand that chemical substances are investigated for their ability to induce sensitization, an adverse health effect caused by the human immune system in response to chemical exposure. A recent ban on the use of animal tests within the cosmetics industry has led to an urgent need for alternative animal-free test methods that can be used for assessment of chemical sensitizers. To date, no such alternative assay has yet completed formal validation. However, a number of assays are in development and the understanding of the biological mechanisms of chemical sensitization has greatly increased during the last decade. In this MiniReview, we aim to summarize and give our view on the recent progress of method development for alternative assessment of chemical sensitizers. We propose that integrated testing strategies should comprise complementary assays, providing measurements of a wide range of mechanistic events, to perform well-educated risk assessments based on weight of evidence. © 2014 Nordic Association for the Publication of BCPT (former Nordic Pharmacological Society).

Framework and indicator testing protocol for developing and piloting quality indicators for the UK quality and outcomes framework.

PubMed

Campbell, Stephen M; Kontopantelis, Evangelos; Hannon, Kerin; Burke, Martyn; Barber, Annette; Lester, Helen E

2011-08-10

Quality measures should be subjected to a testing protocol before being used in practice using key attributes such as acceptability, feasibility and reliability, as well as identifying issues derived from actual implementation and unintended consequences. We describe the methodologies and results of an indicator testing protocol (ITP) using data from proposed quality indicators for the United Kingdom Quality and Outcomes Framework (QOF). The indicator testing protocol involved a multi-step and methodological process: 1) The RAND/UCLA Appropriateness Method, to test clarity and necessity, 2) data extraction from patients' medical records, to test technical feasibility and reliability, 3) diaries, to test workload, 4) cost-effectiveness modelling, and 5) semi-structured interviews, to test acceptability, implementation issues and unintended consequences. Testing was conducted in a sample of representative family practices in England. These methods were combined into an overall recommendation for each tested indicator. Using an indicator testing protocol as part of piloting was seen as a valuable way of testing potential indicators in 'real world' settings. Pilot 1 (October 2009-March 2010) involved thirteen indicators across six clinical domains and twelve indicators passed the indicator testing protocol. However, the indicator testing protocol identified a number of implementation issues and unintended consequences that can be rectified or removed prior to national roll out. A palliative care indicator is used as an exemplar of the value of piloting using a multiple attribute indicator testing protocol - while technically feasible and reliable, it was unacceptable to practice staff and raised concerns about potentially causing actual patient harm. This indicator testing protocol is one example of a protocol that may be useful in assessing potential quality indicators when adapted to specific country health care settings and may be of use to policy-makers and researchers worldwide to test the likely effect of implementing indicators prior to roll out. It builds on and codifies existing literature and other testing protocols to create a field testing methodology that can be used to produce country specific quality indicators for pay-for-performance or quality improvement schemes.

Developing and Validating Practical Eye Metrics for the Sense-Assess-Augment Framework

DTIC Science & Technology

2015-09-29

Sense-Assess-Augment ( SAA ) Framework. To better close the loop between the human and machine teammates AFRL’s Human Performance Wing and Human...Sense-Assess-Augment ( SAA ) framework, which is designed to sense a suite of physiological signals from the operator, use these signals to assess the...to use psychophysiological measures to improve human-machine teamwork (such as Biocybernetics or Augmented Cognition) the AFRL- SAA research program

Alternatives Assessment Frameworks: Research Needs for the Informed Substitution of Hazardous Chemicals

PubMed Central

Jacobs, Molly M.; Malloy, Timothy F.; Tickner, Joel A.; Edwards, Sally

2015-01-01

Background Given increasing pressures for hazardous chemical replacement, there is growing interest in alternatives assessment to avoid substituting a toxic chemical with another of equal or greater concern. Alternatives assessment is a process for identifying, comparing, and selecting safer alternatives to chemicals of concern (including those used in materials, processes, or technologies) on the basis of their hazards, performance, and economic viability. Objectives The purposes of this substantive review of alternatives assessment frameworks are to identify consistencies and differences in methods and to outline needs for research and collaboration to advance science policy practice. Methods This review compares methods used in six core components of these frameworks: hazard assessment, exposure characterization, life-cycle impacts, technical feasibility evaluation, economic feasibility assessment, and decision making. Alternatives assessment frameworks published from 1990 to 2014 were included. Results Twenty frameworks were reviewed. The frameworks were consistent in terms of general process steps, but some differences were identified in the end points addressed. Methodological gaps were identified in the exposure characterization, life-cycle assessment, and decision–analysis components. Methods for addressing data gaps remain an issue. Discussion Greater consistency in methods and evaluation metrics is needed but with sufficient flexibility to allow the process to be adapted to different decision contexts. Conclusion Although alternatives assessment is becoming an important science policy field, there is a need for increased cross-disciplinary collaboration to refine methodologies in support of the informed substitution and design of safer chemicals, materials, and products. Case studies can provide concrete lessons to improve alternatives assessment. Citation Jacobs MM, Malloy TF, Tickner JA, Edwards S. 2016. Alternatives assessment frameworks: research needs for the informed substitution of hazardous chemicals. Environ Health Perspect 124:265–280; http://dx.doi.org/10.1289/ehp.1409581 PMID:26339778

Harmonised framework for ecological risk assessment of sediments from ports and estuarine zones of North and South Atlantic.

PubMed

Choueri, R B; Cesar, A; Abessa, D M S; Torres, R J; Riba, I; Pereira, C D S; Nascimento, M R L; Morais, R D; Mozeto, A A; DelValls, T A

2010-04-01

This paper presents a harmonised framework of sediment quality assessment and dredging material characterisation for estuaries and port zones of North and South Atlantic. This framework, based on the weight-of-evidence approach, provides a structure and a process for conducting sediment/dredging material assessment that leads to a decision. The main structure consists of "step 1" (examination of available data); "step 2" (chemical characterisation and toxicity assessment); "decision 1" (any chemical level higher than reference values? are sediments toxic?); "step 3" (assessment of benthic community structure); "step 4" (integration of the results); "decision 2" (are sediments toxic or benthic community impaired?); "step 5" (construction of the decision matrix) and "decision 3" (is there environmental risk?). The sequence of assessments may be interrupted when the information obtained is judged to be sufficient for a correct characterisation of the risk posed by the sediments/dredging material. This framework brought novel features compared to other sediment/dredging material risk assessment frameworks: data integration through multivariate analysis allows the identification of which samples are toxic and/or related to impaired benthic communities; it also discriminates the chemicals responsible for negative biological effects; and the framework dispenses the use of a reference area. We demonstrated the successful application of this framework in different port and estuarine zones of the North (Gulf of Cádiz) and South Atlantic (Santos and Paranaguá Estuarine Systems).

Managing risk in healthcare: understanding your safety culture using the Manchester Patient Safety Framework (MaPSaF).

PubMed

Parker, Dianne

2009-03-01

To provide sufficient information about the Manchester Patient Safety Framework (MaPSaF) to allow healthcare professionals to assess its potential usefulness. The assessment of safety culture is an important aspect of risk management, and one in which there is increasing interest among healthcare organizations. Manchester Patient Safety Framework offers a theory-based framework for assessing safety culture, designed specifically for use in the NHS. The framework covers multiple dimensions of safety culture, and five levels of safety culture development. This allows the generation of a profile of an organization's safety culture in terms of areas of relative strength and challenge, which can be used to identify focus issues for change and improvement. Manchester Patient Safety Framework provides a useful method for engaging healthcare professionals in assessing and improving the safety culture in their organization, as part of a programme of risk management.

A cognitive framework to inform the design of professional development supporting teachers' classroom assessment of inquiry-based science

NASA Astrophysics Data System (ADS)

Matese, Gabrielle

Inquiry-based science places new demands on teachers for assessing students' growth, both of deep conceptual understanding as well as developing inquiry skills. In addition, new ideas about classroom assessment, such as the importance of formative assessment, are gaining currency. While we have ideas about what classroom assessment consistent with inquiry-based pedagogy might look like, and why it is necessary, we have little understanding of what it takes to implement it. That teachers face a challenge in doing so is well-documented. Researchers have noted that teachers attempting changes in classroom assessment often bring with them incompatible beliefs, knowledge, and practices. However, noting general incompatibility is insufficient to support addressing these issues through professional development. In response to this need, I initiated a research project to identify and describe in more detail the categories of beliefs, knowledge and skills that play an important role in inquiry-based science assessment practices. I created an assessment framework outlining specific categories of beliefs, knowledge, and skills affecting particular classroom assessment practices. I then used the framework to examine teachers' classroom assessment practices and to create comparative cases between three middle-school science teachers, highlighting how the different cognitive factors affect four particular assessment practices. The comparative cases demonstrate the framework's utility for analyzing and explicating teacher assessment practices. As a tool for analyzing and understanding teacher practice, the framework supports the design of professional development. To demonstrate the value of the framework, I draw on the comparative cases to identify implications for the design of professional development to support teachers' classroom assessment of inquiry-based science. In this dissertation I provide a brief overview of the framework and its rationale, present an example of the comparative case studies demonstrating the application of the framework and what it reveals about the cognitive influences on teacher practice, and outline the resulting design implications for professional development. This research allows us to better understand the cognitive factors underlying classroom assessment in inquiry-based science, and to design professional development to support teachers engaging in these practices.

Perceived Utility of the RE-AIM Framework for Health Promotion/Disease Prevention Initiatives for Older Adults: A Case Study from the U.S. Evidence-Based Disease Prevention Initiative.

PubMed

Ory, Marcia G; Altpeter, Mary; Belza, Basia; Helduser, Janet; Zhang, Chen; Smith, Matthew Lee

2014-01-01

Dissemination and implementation (D&I) frameworks are increasingly being promoted in public health research. However, less is known about their uptake in the field, especially for diverse sets of programs. Limited questionnaires exist to assess the ways that frameworks can be utilized in program planning and evaluation. We present a case study from the United States that describes the implementation of the RE-AIM framework by state aging services providers and public health partners and a questionnaire that can be used to assess the utility of such frameworks in practice. An online questionnaire was developed to capture community perspectives about the utility of the RE-AIM framework. Distributed to project leads in 27 funded states in an evidence-based disease prevention initiative for older adults, 40 key stakeholders responded representing a 100% state-participation rate among the 27 funded states. Findings suggest that there is perceived utility in using the RE-AIM framework when evaluating grand-scale initiatives for older adults. The RE-AIM framework was seen as useful for planning, implementation, and evaluation with relevance for evaluators, providers, community leaders, and policy makers. Yet, the uptake was not universal, and some respondents reported difficulties in use, especially adopting the framework as a whole. This questionnaire can serve as the basis to assess ways the RE-AIM framework can be utilized by practitioners in state-wide D&I efforts. Maximal benefit can be derived from examining the assessment of RE-AIM-related knowledge and confidence as part of a continual quality assurance process. We recommend such an assessment be performed before the implementation of new funding initiatives and throughout their course to assess RE-AIM uptake and to identify areas for technical assistance.

Framework for an Effective Assessment and Accountability Program: The Philadelphia Example

ERIC Educational Resources Information Center

Porter, Andrew C.; Chester, Mitchell D.; Schlesinger, Michael D.

2004-01-01

The purpose of this article is to put in the hands of researchers, practitioners, and policy makers a powerful framework for building and studying the effects of high-quality assessment and accountability programs. The framework is illustrated through a description and analysis of the assessment and accountability program in the School District of…

Science Framework for the 2009 National Assessment of Educational Progress

ERIC Educational Resources Information Center

National Assessment Governing Board, 2008

2008-01-01

This document sets forth recommendations for the design of a new science assessment. The assessment resulting from this framework will start a new NAEP science trend (i.e., measure of student progress in science) beginning in 2009. This framework represents a unique opportunity to build on previous NAEP science work as well as key developments in…

A theoretical framework for measuring knowledge in screening decision aid trials.

PubMed

Smith, Sian K; Barratt, Alexandra; Trevena, Lyndal; Simpson, Judy M; Jansen, Jesse; McCaffery, Kirsten J

2012-11-01

To describe a theoretical framework for assessing knowledge about the possible outcomes of participating in bowel cancer screening for the faecal occult blood test. The content of the knowledge measure was based on the UK General Medical Council's screening guidelines and a theory-based approach to assessing gist knowledge (Fuzzy Trace Theory). It comprised conceptual and numeric questions to assess knowledge of the underlying construct (e.g. false positive concept) and the approximate numbers affected (e.g. likelihood of a false positive). The measure was used in a randomised controlled trial involving 530 adults with low education, to compare the impact of a bowel screening decision aid with a screening information booklet developed for the Australian Government National Bowel Cancer Screening Program. The numeric knowledge scale was particularly responsive to the effects of the decision aid; at follow-up decision aid participants' numeric knowledge was significantly greater than the controls (P<0.001). This contrasts with the conceptual knowledge scale which improved significantly in both groups from baseline to follow-up (P<0.001). Our theory-based knowledge measure was responsive to change in conceptual knowledge and to the effect on numeric knowledge of a decision aid. This theoretical framework has the potential to guide the development of knowledge measures in other screening settings. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Review of Recent US Value Frameworks-A Health Economics Approach: An ISPOR Special Task Force Report [6].

PubMed

Willke, Richard J; Neumann, Peter J; Garrison, Louis P; Ramsey, Scott D

2018-02-01

The sixth section of our Special Task Force (STF) report reviews and comments on recent US-oriented value assessment frameworks, specifically those published by the American College of Cardiology/American Heart Association, the Institute for Clinical and Economic Research, the American Society of Clinical Oncology, the National Comprehensive Cancer Network, and the Memorial Sloan Kettering Cancer Center. We review published commentaries that address the validity, reliability, and conceptual underpinnings of these frameworks. We find common themes of critique regarding the strengths and limitations across frameworks. Particular shortcomings of some frameworks pose greater threats to their face validity and utility compared with others. The most significant limitations include lack of clear perspective (e.g., patient vs. health plan) and poor transparency in accounting for costs and benefits. We then review how each framework adheres to core STF recommendations, with particular emphasis on whether the framework can be used to support coverage decisions by health insurers, and whether it adheres to core principles of cost-effectiveness analysis. The Institute for Clinical and Economic Research framework most closely adheres to core STF recommendations. Others have significant limitations that vary widely from framework to framework. We also review how the frameworks follow STF recommendations for addressing potentially relevant issues beyond cost-effectiveness analysis - for example, equity in resource allocation and patient heterogeneity. Finally, we review whether and how each framework uses value thresholds and addresses affordability concerns. We conclude with suggestions for further research, particularly in the areas of testing the measurement and use of novel elements of value and deliberative processes. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Newman, Jennifer; Clifton, Andrew; Bonin, Timothy

As wind turbine sizes increase and wind energy expands to more complex and remote sites, remote-sensing devices such as lidars are expected to play a key role in wind resource assessment and power performance testing. The switch to remote-sensing devices represents a paradigm shift in the way the wind industry typically obtains and interprets measurement data for wind energy. For example, the measurement techniques and sources of uncertainty for a remote-sensing device are vastly different from those associated with a cup anemometer on a meteorological tower. Current IEC standards for quantifying remote sensing device uncertainty for power performance testing considermore » uncertainty due to mounting, calibration, and classification of the remote sensing device, among other parameters. Values of the uncertainty are typically given as a function of the mean wind speed measured by a reference device and are generally fixed, leading to climatic uncertainty values that apply to the entire measurement campaign. However, real-world experience and a consideration of the fundamentals of the measurement process have shown that lidar performance is highly dependent on atmospheric conditions, such as wind shear, turbulence, and aerosol content. At present, these conditions are not directly incorporated into the estimated uncertainty of a lidar device. In this presentation, we describe the development of a new dynamic lidar uncertainty framework that adapts to current flow conditions and more accurately represents the actual uncertainty inherent in lidar measurements under different conditions. In this new framework, sources of uncertainty are identified for estimation of the line-of-sight wind speed and reconstruction of the three-dimensional wind field. These sources are then related to physical processes caused by the atmosphere and lidar operating conditions. The framework is applied to lidar data from a field measurement site to assess the ability of the framework to predict errors in lidar-measured wind speed. The results show how uncertainty varies over time and can be used to help select data with different levels of uncertainty for different applications, for example, low uncertainty data for power performance testing versus all data for plant performance monitoring.« less

A systematic approach to assessing the clinical significance of genetic variants.

PubMed

Duzkale, H; Shen, J; McLaughlin, H; Alfares, A; Kelly, M A; Pugh, T J; Funke, B H; Rehm, H L; Lebo, M S

2013-11-01

Molecular genetic testing informs diagnosis, prognosis, and risk assessment for patients and their family members. Recent advances in low-cost, high-throughput DNA sequencing and computing technologies have enabled the rapid expansion of genetic test content, resulting in dramatically increased numbers of DNA variants identified per test. To address this challenge, our laboratory has developed a systematic approach to thorough and efficient assessments of variants for pathogenicity determination. We first search for existing data in publications and databases including internal, collaborative and public resources. We then perform full evidence-based assessments through statistical analyses of observations in the general population and disease cohorts, evaluation of experimental data from in vivo or in vitro studies, and computational predictions of potential impacts of each variant. Finally, we weigh all evidence to reach an overall conclusion on the potential for each variant to be disease causing. In this report, we highlight the principles of variant assessment, address the caveats and pitfalls, and provide examples to illustrate the process. By sharing our experience and providing a framework for variant assessment, including access to a freely available customizable tool, we hope to help move towards standardized and consistent approaches to variant assessment. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Assessment of Intralaminar Progressive Damage and Failure Analysis Using an Efficient Evaluation Framework

NASA Technical Reports Server (NTRS)

Hyder, Imran; Schaefer, Joseph; Justusson, Brian; Wanthal, Steve; Leone, Frank; Rose, Cheryl

2017-01-01

Reducing the timeline for development and certification for composite structures has been a long standing objective of the aerospace industry. This timeline can be further exacerbated when attempting to integrate new fiber-reinforced composite materials due to the large number of testing required at every level of design. computational progressive damage and failure analysis (PDFA) attempts to mitigate this effect; however, new PDFA methods have been slow to be adopted in industry since material model evaluation techniques have not been fully defined. This study presents an efficient evaluation framework which uses a piecewise verification and validation (V&V) approach for PDFA methods. Specifically, the framework is applied to evaluate PDFA research codes within the context of intralaminar damage. Methods are incrementally taken through various V&V exercises specifically tailored to study PDFA intralaminar damage modeling capability. Finally, methods are evaluated against a defined set of success criteria to highlight successes and limitations.

Quantitative diagnostics of soft tissue through viscoelastic characterization using time-based instrumented palpation.

PubMed

Palacio-Torralba, Javier; Hammer, Steven; Good, Daniel W; Alan McNeill, S; Stewart, Grant D; Reuben, Robert L; Chen, Yuhang

2015-01-01

Although palpation has been successfully employed for centuries to assess soft tissue quality, it is a subjective test, and is therefore qualitative and depends on the experience of the practitioner. To reproduce what the medical practitioner feels needs more than a simple quasi-static stiffness measurement. This paper assesses the capacity of dynamic mechanical palpation to measure the changes in viscoelastic properties that soft tissue can exhibit under certain pathological conditions. A diagnostic framework is proposed to measure elastic and viscous behaviors simultaneously using a reduced set of viscoelastic parameters, giving a reliable index for quantitative assessment of tissue quality. The approach is illustrated on prostate models reconstructed from prostate MRI scans. The examples show that the change in viscoelastic time constant between healthy and cancerous tissue is a key index for quantitative diagnostics using point probing. The method is not limited to any particular tissue or material and is therefore useful for tissue where defining a unique time constant is not trivial. The proposed framework of quantitative assessment could become a useful tool in clinical diagnostics for soft tissue. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Frameworks to assess health systems governance: a systematic review.

PubMed

Pyone, Thidar; Smith, Helen; van den Broek, Nynke

2017-06-01

Governance of the health system is a relatively new concept and there are gaps in understanding what health system governance is and how it could be assessed. We conducted a systematic review of the literature to describe the concept of governance and the theories underpinning as applied to health systems; and to identify which frameworks are available and have been applied to assess health systems governance. Frameworks were reviewed to understand how the principles of governance might be operationalized at different levels of a health system. Electronic databases and web portals of international institutions concerned with governance were searched for publications in English for the period January 1994 to February 2016. Sixteen frameworks developed to assess governance in the health system were identified and are described. Of these, six frameworks were developed based on theories from new institutional economics; three are primarily informed by political science and public management disciplines; three arise from the development literature and four use multidisciplinary approaches. Only five of the identified frameworks have been applied. These used the principal-agent theory, theory of common pool resources, North's institutional analysis and the cybernetics theory. Governance is a practice, dependent on arrangements set at political or national level, but which needs to be operationalized by individuals at lower levels in the health system; multi-level frameworks acknowledge this. Three frameworks were used to assess governance at all levels of the health system. Health system governance is complex and difficult to assess; the concept of governance originates from different disciplines and is multidimensional. There is a need to validate and apply existing frameworks and share lessons learnt regarding which frameworks work well in which settings. A comprehensive assessment of governance could enable policy makers to prioritize solutions for problems identified as well as replicate and scale-up examples of good practice. © The Author 2017. Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine.

Frameworks to assess health systems governance: a systematic review

PubMed Central

Smith, Helen; van den Broek, Nynke

2017-01-01

Abstract Governance of the health system is a relatively new concept and there are gaps in understanding what health system governance is and how it could be assessed. We conducted a systematic review of the literature to describe the concept of governance and the theories underpinning as applied to health systems; and to identify which frameworks are available and have been applied to assess health systems governance. Frameworks were reviewed to understand how the principles of governance might be operationalized at different levels of a health system. Electronic databases and web portals of international institutions concerned with governance were searched for publications in English for the period January 1994 to February 2016. Sixteen frameworks developed to assess governance in the health system were identified and are described. Of these, six frameworks were developed based on theories from new institutional economics; three are primarily informed by political science and public management disciplines; three arise from the development literature and four use multidisciplinary approaches. Only five of the identified frameworks have been applied. These used the principal–agent theory, theory of common pool resources, North’s institutional analysis and the cybernetics theory. Governance is a practice, dependent on arrangements set at political or national level, but which needs to be operationalized by individuals at lower levels in the health system; multi-level frameworks acknowledge this. Three frameworks were used to assess governance at all levels of the health system. Health system governance is complex and difficult to assess; the concept of governance originates from different disciplines and is multidimensional. There is a need to validate and apply existing frameworks and share lessons learnt regarding which frameworks work well in which settings. A comprehensive assessment of governance could enable policy makers to prioritize solutions for problems identified as well as replicate and scale-up examples of good practice. PMID:28334991

Regulatory framework on bioequivalence criteria for locally acting gastrointestinal drugs: the case for oral modified release mesalamine formulations.

PubMed

Sferrazza, Gianluca; Siviero, Paolo D; Nicotera, Giuseppe; Turella, Paola; Serafino, Annalucia; Blandizzi, Corrado; Pierimarchi, Pasquale

2017-09-01

Bioequivalence testing for locally acting gastrointestinal drugs is a challenging issue for both regulatory authorities and pharmaceutical industries. The international regulatory framework has been characterized by the lack of specific bioequivalence tests that has generated a negative impact on the market competition and drug use in clinical practice. Areas covered: This review article provides an overview of the European Union and United States regulatory frameworks on bioequivalence criteria for locally acting gastrointestinal drugs, also discussing the most prominent scientific issues and advances that has been made in this field. A focus on oral modified release mesalamine formulations will be also provided, with practical examples of the regulatory pathways followed by pharmaceutical companies to determine bioequivalence. Expert commentary: The development of a scientific rationale to demonstrate bioequivalence in this field has been complex and often associated with uncertainties related to scientific and regulatory aspects. Only in recent years, thanks to advanced knowledge in this field, the criteria for bioequivalence assessment are undergoing substantial changes. This new scenario will likely result in a significant impact on pharmaceutical companies, promoting more competition through a clearer regulatory approach, conceived for streamlining the demonstration of therapeutic equivalence for locally acting gastrointestinal drugs.

Students Explaining Science—Assessment of Science Communication Competence

NASA Astrophysics Data System (ADS)

Kulgemeyer, Christoph; Schecker, Horst

2013-12-01

Science communication competence (SCC) is an important educational goal in the school science curricula of several countries. However, there is a lack of research about the structure and the assessment of SCC. This paper specifies the theoretical framework of SCC by a competence model. We developed a qualitative assessment method for SCC that is based on an expert-novice dialog: an older student (explainer, expert) explains a physics phenomenon to a younger peer (addressee, novice) in a controlled test setting. The explanations are video-recorded and analysed by qualitative content analysis. The method was applied in a study with 46 secondary school students as explainers. Our aims were (a) to evaluate whether our model covers the relevant features of SCC, (b) to validate the assessment method and (c) to find characteristics of addressee-adequate explanations. A performance index was calculated to quantify the explainers' levels of competence on an ordinal scale. We present qualitative and quantitative evidence that the index is adequate for assessment purposes. It correlates with results from a written SCC test and a perspective taking test (convergent validity). Addressee-adequate explanations can be characterized by use of graphical representations and deliberate switches between scientific and everyday language.

Demonstration of the Military Ecological Risk Assessment Framework (MERAF): Apache Longbow - Hellfire Missile Test at Yuma Proving Ground

DTIC Science & Technology

2001-11-01

that there were· no· target misses. The Hellfire missile does not have a depleted uranium head . . -,, 2.2.2.3 Tank movement During the test, the...guide otber users through the use of this. complicated program. The_input data files for NOISEMAP consist of a root file name with several extensions...SOURCES subdirectory. This file will have the root file name followed by an accession number, then the .bps extension. The user must check the *.log

Capacity, consent, and mental health legislation: time for a new standard?

PubMed

O'Brien, Anthony J

2010-01-01

Recent international reforms in mental health legislation have introduced a capacity test as a criterion for civil commitment. There are proposals that a common test of incapacity should apply in both mental and physical health under a single legislative framework for all cases in which the normally accepted standard of informed consent for treatment is not met. Capacity is a complex concept, but can be reliably assessed in clinical practice. Nurses need to be involved in the policy debate about capacity and consent in mental health care.

Using a CAS Self-Study to Teach Assessment Practice

ERIC Educational Resources Information Center

Bourke, Brian

2017-01-01

There are likely as many approaches to teaching assessment as there are people teaching assessment. Graduate courses on assessment can be structured with a singular focus, such as learning outcomes assessment, or along a competencies-based framework. Such frameworks include the Assessment Skills and Knowledge (ASK) Standards developed by College…

Combining Structural Magnetic Resonance Imaging and Visuospatial Tests to Classify Mild Cognitive Impairment.

PubMed

Fasano, Fabrizio; Mitolo, Micaela; Gardini, Simona; Venneri, Annalena; Caffarra, Paolo; Pazzaglia, Francesca

2018-01-01

Recently, efforts have been made to combine complementary perspectives in the assessment of Alzheimer type dementia. Of particular interest is the definition of the fingerprints of an early stage of the disease known as Mild Cognitive Impairment or prodromal Alzheimer's Disease. Machine learning approaches have been shown to be extremely suitable for the implementation of such a combination. In the present pilot study we combined the machine learning approach with structural magnetic resonance imaging and cognitive test assessments to classify a small cohort of 11 healthy participants and 11 patients experiencing Mild Cognitive Impairment. Cognitive assessment included a battery of standardised tests and a battery of experimental visuospatial memory tests. Correct classification was achieved in 100% of the participants, suggesting that the combination of neuroimaging with more complex cognitive tests is suitable for early detection of Alzheimer Disease. In particular, the results highlighted the importance of the experimental visuospatial memory test battery in the efficiency of classification, suggesting that the high-level brain computational framework underpinning the participant's performance in these ecological tests may represent a "natural filter" in the exploration of cognitive patterns of information able to identify early signs of the disease. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Guidelines for point-of-care testing: haematology.

PubMed

Briggs, Carol; Guthrie, David; Hyde, Keith; Mackie, Ian; Parker, Norman; Popek, Mary; Porter, Neil; Stephens, Clare

2008-09-01

This guideline provides a framework for the arrangement of point-of-care testing (POCT) services, previously known as near patient testing (patient self-testing not covered). POCT is defined as any analytical test performed outside the laboratory. Primary users are often non-laboratory healthcare workers. The guidance applies to units within hospitals as well as general practioner surgeries, community clinics and pharmacies. The head of the haematology laboratory or a point of care coordinator must take responsibility for all aspects of the POCT service, including quality and training. Depending on the size and nature of the POCT practice, a local POCT manager may also be required. Equipment selected should have received a successful independent performance evaluation. If an independent evaluation has not been performed the purchaser should assess the device according to the protocol in this document. POCT devices should generate results that are comparable to those of the local laboratory. An accredited external quality assessment programme and internal quality control system must be established. Manufacturers promoting POCT devices designed for non-laboratory sites, e.g. pharmacies, should undertake training and annual competency assessment, perhaps using a web-based system. A diagram to illustrate the stages for the implementation of a POCT service is illustrated.

Testing a Conceptual Change Model Framework for Visual Data

ERIC Educational Resources Information Center

Finson, Kevin D.; Pedersen, Jon E.

2015-01-01

An emergent data analysis technique was employed to test the veracity of a conceptual framework constructed around visual data use and instruction in science classrooms. The framework incorporated all five key components Vosniadou (2007a, 2007b) described as existing in a learner's schema: framework theory, presuppositions, conceptual domains,…

A sequential test for assessing observed agreement between raters.

PubMed

Bersimis, Sotiris; Sachlas, Athanasios; Chakraborti, Subha

2018-01-01

Assessing the agreement between two or more raters is an important topic in medical practice. Existing techniques, which deal with categorical data, are based on contingency tables. This is often an obstacle in practice as we have to wait for a long time to collect the appropriate sample size of subjects to construct the contingency table. In this paper, we introduce a nonparametric sequential test for assessing agreement, which can be applied as data accrues, does not require a contingency table, facilitating a rapid assessment of the agreement. The proposed test is based on the cumulative sum of the number of disagreements between the two raters and a suitable statistic representing the waiting time until the cumulative sum exceeds a predefined threshold. We treat the cases of testing two raters' agreement with respect to one or more characteristics and using two or more classification categories, the case where the two raters extremely disagree, and finally the case of testing more than two raters' agreement. The numerical investigation shows that the proposed test has excellent performance. Compared to the existing methods, the proposed method appears to require significantly smaller sample size with equivalent power. Moreover, the proposed method is easily generalizable and brings the problem of assessing the agreement between two or more raters and one or more characteristics under a unified framework, thus providing an easy to use tool to medical practitioners. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

An aquatic multiscale assessment and planning framework approach—forest plan revision case study

Treesearch

Kerry Overton; Ann D. Carlson; Cynthia Tait

2010-01-01

The Aquatic Multiscale Assessment and Planning Framework is a Web-based decision-support tool developed to assist aquatic practitioners in managing fisheries and watershed information. This tool, or framework, was designed to assist resource assessments and planning efforts from the broad scale to the fine scale, to document procedures, and to link directly to relevant...

Near Real-Time Monitoring of Forest Disturbance: A Multi-Sensor Remote Sensing Approach and Assessment Framework

NASA Astrophysics Data System (ADS)

Tang, Xiaojing

Fast and accurate monitoring of tropical forest disturbance is essential for understanding current patterns of deforestation as well as helping eliminate illegal logging. This dissertation explores the use of data from different satellites for near real-time monitoring of forest disturbance in tropical forests, including: development of new monitoring methods; development of new assessment methods; and assessment of the performance and operational readiness of existing methods. Current methods for accuracy assessment of remote sensing products do not address the priority of near real-time monitoring of detecting disturbance events as early as possible. I introduce a new assessment framework for near real-time products that focuses on the timing and the minimum detectable size of disturbance events. The new framework reveals the relationship between change detection accuracy and the time needed to identify events. In regions that are frequently cloudy, near real-time monitoring using data from a single sensor is difficult. This study extends the work by Xin et al. (2013) and develops a new time series method (Fusion2) based on fusion of Landsat and MODIS (Moderate Resolution Imaging Spectroradiometer) data. Results of three test sites in the Amazon Basin show that Fusion2 can detect 44.4% of the forest disturbance within 13 clear observations (82 days) after the initial disturbance. The smallest event detected by Fusion2 is 6.5 ha. Also, Fusion2 detects disturbance faster and has less commission error than more conventional methods. In a comparison of coarse resolution sensors, MODIS Terra and Aqua combined provides faster and more accurate detection of disturbance events than VIIRS (Visible Infrared Imaging Radiometer Suite) and MODIS single sensor data. The performance of near real-time monitoring using VIIRS is slightly worse than MODIS Terra but significantly better than MODIS Aqua. New monitoring methods developed in this dissertation provide forest protection organizations the capacity to monitor illegal logging events promptly. In the future, combining two Landsat and two Sentinel-2 satellites will provide global coverage at 30 m resolution every 4 days, and routine monitoring may be possible at high resolution. The methods and assessment framework developed in this dissertation are adaptable to newly available datasets.

A task scheduler framework for self-powered wireless sensors.

PubMed

Nordman, Mikael M

2003-10-01

The cost and inconvenience of cabling is a factor limiting widespread use of intelligent sensors. Recent developments in short-range, low-power radio seem to provide an opening to this problem, making development of wireless sensors feasible. However, for these sensors the energy availability is a main concern. The common solution is either to use a battery or to harvest ambient energy. The benefit of harvested ambient energy is that the energy feeder can be considered as lasting a lifetime, thus it saves the user from concerns related to energy management. The problem is, however, the unpredictability and unsteady behavior of ambient energy sources. This becomes a main concern for sensors that run multiple tasks at different priorities. This paper proposes a new scheduler framework that enables the reliable assignment of task priorities and scheduling in sensors powered by ambient energy. The framework being based on environment parameters, virtual queues, and a state machine with transition conditions, dynamically manages task execution according to priorities. The framework is assessed in a test system powered by a solar panel. The results show the functionality of the framework and how task execution reliably is handled without violating the priority scheme that has been assigned to it.

A Framework for Assessing Health Risk of Environmental ...

EPA Pesticide Factsheets

EPA released the final report entitled, A Framework for Assessing Health Risk of Environmental Exposures to Children, which examines the impact of potential exposures during developmental lifestages and subsequent lifestages, while emphasizing the iterative nature of the analysis phase with a multidisciplinary team. Major findings and conclusions: This report outlines the framework in which mode of action(s) (MOA) can be considered across life stages. The framework is based upon existing approaches adopted in the Framework on Cumulative Risk Assessment and identifies existing guidance, guidelines and policy papers that relate to children's health risk assessment. It emphasizes the importance of an iterative approach between hazard, dose response, and exposure analyses. In addition, it includes discussion of principles for weight of evidence consideration across life stages for the hazard characterization database.Key science/assessment issues:This framework addresses the questions of why and how an improved children's health risk assessment will strengthen the overall risk assessment process across the Agency. This approach improves the scientific explanation of children's risk and will add value by: 1) providing for a more complete evaluation of the potential for vulnerability at different life stages, including a focus on the underlying biological events and critical developmental periods for incorporating MOA considerations; 2) evaluating of the potential fo

A conceptual framework to assess effectiveness in wheelchair provision

PubMed Central

Kankipati, Padmaja

2017-01-01

Background Currently, inadequate wheelchair provision has forced many people with disabilities to be trapped in a cycle of poverty and deprivation, limiting their ability to access education, work and social facilities. This issue is in part because of the lack of collaboration among various stakeholders who need to work together to design, manufacture and deliver such assistive mobility devices. This in turn has led to inadequate evidence about intervention effectiveness, disability prevalence and subsequent costeffectiveness that would help facilitate appropriate provision and support for people with disabilities. Objectives In this paper, we describe a novel conceptual framework that can be tested across the globe to study and evaluate the effectiveness of wheelchair provision. Method The Comparative Effectiveness Research Subcommittee (CER-SC), consisting of the authors of this article, housed within the Evidence-Based Practice Working Group (EBP-WG) of the International Society of Wheelchair Professionals (ISWP), conducted a scoping review of scientific literature and standard practices used during wheelchair service provision. The literature review was followed by a series of discussion groups. Results The three iterations of the conceptual framework are described in this manuscript. Conclusion We believe that adoption of this conceptual framework could have broad applications in wheelchair provision globally to develop evidence-based practices. Such a perspective will help in the comparison of different strategies employed in wheelchair provision and further improve clinical guidelines. Further work is being conducted to test the efficacy of this conceptual framework to evaluate effectiveness of wheelchair service provision in various settings across the globe. PMID:28936421

A stochastically fully connected conditional random field framework for super resolution OCT

NASA Astrophysics Data System (ADS)

Boroomand, A.; Tan, B.; Wong, A.; Bizheva, K.

2017-02-01

A number of factors can degrade the resolution and contrast of OCT images, such as: (1) changes of the OCT pointspread function (PSF) resulting from wavelength dependent scattering and absorption of light along the imaging depth (2) speckle noise, as well as (3) motion artifacts. We propose a new Super Resolution OCT (SR OCT) imaging framework that takes advantage of a Stochastically Fully Connected Conditional Random Field (SF-CRF) model to generate a Super Resolved OCT (SR OCT) image of higher quality from a set of Low-Resolution OCT (LR OCT) images. The proposed SF-CRF SR OCT imaging is able to simultaneously compensate for all of the factors mentioned above, that degrade the OCT image quality, using a unified computational framework. The proposed SF-CRF SR OCT imaging framework was tested on a set of simulated LR human retinal OCT images generated from a high resolution, high contrast retinal image, and on a set of in-vivo, high resolution, high contrast rat retinal OCT images. The reconstructed SR OCT images show considerably higher spatial resolution, less speckle noise and higher contrast compared to other tested methods. Visual assessment of the results demonstrated the usefulness of the proposed approach in better preservation of fine details and structures of the imaged sample, retaining biological tissue boundaries while reducing speckle noise using a unified computational framework. Quantitative evaluation using both Contrast to Noise Ratio (CNR) and Edge Preservation (EP) parameter also showed superior performance of the proposed SF-CRF SR OCT approach compared to other image processing approaches.

Developing Brain Vital Signs: Initial Framework for Monitoring Brain Function Changes Over Time

PubMed Central

Ghosh Hajra, Sujoy; Liu, Careesa C.; Song, Xiaowei; Fickling, Shaun; Liu, Luke E.; Pawlowski, Gabriela; Jorgensen, Janelle K.; Smith, Aynsley M.; Schnaider-Beeri, Michal; Van Den Broek, Rudi; Rizzotti, Rowena; Fisher, Kirk; D'Arcy, Ryan C. N.

2016-01-01

Clinical assessment of brain function relies heavily on indirect behavior-based tests. Unfortunately, behavior-based assessments are subjective and therefore susceptible to several confounding factors. Event-related brain potentials (ERPs), derived from electroencephalography (EEG), are often used to provide objective, physiological measures of brain function. Historically, ERPs have been characterized extensively within research settings, with limited but growing clinical applications. Over the past 20 years, we have developed clinical ERP applications for the evaluation of functional status following serious injury and/or disease. This work has identified an important gap: the need for a clinically accessible framework to evaluate ERP measures. Crucially, this enables baseline measures before brain dysfunction occurs, and might enable the routine collection of brain function metrics in the future much like blood pressure measures today. Here, we propose such a framework for extracting specific ERPs as potential “brain vital signs.” This framework enabled the translation/transformation of complex ERP data into accessible metrics of brain function for wider clinical utilization. To formalize the framework, three essential ERPs were selected as initial indicators: (1) the auditory N100 (Auditory sensation); (2) the auditory oddball P300 (Basic attention); and (3) the auditory speech processing N400 (Cognitive processing). First step validation was conducted on healthy younger and older adults (age range: 22–82 years). Results confirmed specific ERPs at the individual level (86.81–98.96%), verified predictable age-related differences (P300 latency delays in older adults, p < 0.05), and demonstrated successful linear transformation into the proposed brain vital sign (BVS) framework (basic attention latency sub-component of BVS framework reflects delays in older adults, p < 0.05). The findings represent an initial critical step in developing, extracting, and characterizing ERPs as vital signs, critical for subsequent evaluation of dysfunction in conditions like concussion and/or dementia. PMID:27242415

Motivation and Engagement in the United States, Canada, United Kingdom, Australia, and China: Testing a Multi-Dimensional Framework

ERIC Educational Resources Information Center

Martin, Andrew J.; Yu, Kai; Papworth, Brad; Ginns, Paul; Collie, Rebecca J.

2015-01-01

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

Large-Scale Assessment of Language Proficiency: Theoretical and Pedagogical Reflections on the Use of Multiple-Choice Tests

ERIC Educational Resources Information Center

Argüelles Álvarez, Irina

2013-01-01

The new requirement placed on students in tertiary settings in Spain to demonstrate a B1 or a B2 proficiency level of English, in accordance with the Common European Framework of Reference for Languages (CEFRL), has led most Spanish universities to develop a program of certification or accreditation of the required level. The first part of this…

Developing Academic English Language Proficiency Prototypes for 5th Grade Reading: Psychometric and Linguistic Profiles of Tasks. An Extended Executive Summary. CSE Report 720

ERIC Educational Resources Information Center

Bailey, Alison L.; Huang, Becky H.; Shin, Hye Won; Farnsworth, Tim; Butler, Frances A.

2007-01-01

Within an evidentiary framework for operationally defining academic English language proficiency (AELP), linguistic analyses of standards, classroom discourse, and textbooks have led to specifications for assessment of AELP. The test development process described here is novel due to the emphasis on using linguistic profiles to inform the …

The Hierarchical Rater Model for Rated Test Items and Its Application to Large-Scale Educational Assessment Data.

ERIC Educational Resources Information Center

Patz, Richard J.; Junker, Brian W.; Johnson, Matthew S.; Mariano, Louis T.

2002-01-01

Discusses the hierarchical rater model (HRM) of R. Patz (1996) and shows how it can be used to scale examinees and items, model aspects of consensus among raters, and model individual rater severity and consistency effects. Also shows how the HRM fits into the generalizability theory framework. Compares the HRM to the conventional item response…

Using Standards and High-Stakes Testing for Students: Exploiting Power with Critical Pedagogy. Counterpoints: Studies in the Postmodern Theory of Education. Volume 425

ERIC Educational Resources Information Center

Gorlewski, Julie A., Ed.; Porfilio, Brad J., Ed.; Gorlewski, David A., Ed.

2012-01-01

This book overturns the typical conception of standards, empowering educators by providing concrete examples of how top-down models of assessment can be embraced and used in ways that are consistent with critical pedagogies. Although standards, as broad frameworks for setting learning targets, are not necessarily problematic, when they are…

Evaluation of the implementation of a whole-workplace walking programme using the RE-AIM framework.

PubMed

Adams, Emma J; Chalkley, Anna E; Esliger, Dale W; Sherar, Lauren B

2017-05-18

Promoting walking for the journey to/from work and during the working day is one potential approach to increase physical activity in adults. Walking Works was a practice-led, whole-workplace walking programme delivered by employees (walking champions). This study aimed to evaluate the implementation of Walking Works using the RE-AIM framework and provide recommendations for future delivery of whole-workplace walking programmes. Two cross sectional surveys were conducted; 1544 (28%) employees completed the baseline survey and 918 employees (21%) completed the follow-up survey. Effectiveness was assessed using baseline and follow-up data; reach, implementation and maintenance were assessed using follow-up data only. For categorical data, Chi square tests were conducted to assess differences between surveys or groups. Continuous data were analysed to test for significant differences using a Mann-Whitney U test. Telephone interviews were conducted with the lead organisation co-ordinator, eight walking champions and three business representatives at follow-up. Interviews were transcribed verbatim and analysed to identify key themes related to adoption, implementation and maintenance. Adoption: Five workplaces participated in Walking Works. Reach: 480 (52.3%) employees were aware of activities and 221 (24.1%) participated. A variety of walking activities were delivered. Some programme components were not delivered as planned which was partly due to barriers in using walking champions to deliver activities. These included the walking champions' capacity, skills, support needs, ability to engage senior management, and the number and type of activities they could deliver. Other barriers included lack of management support, difficulties communicating information about activities and challenges embedding the programme into normal business activities. Effectiveness: No significant changes in walking to/from work or walking during the working day were observed. Maintenance: Plans to continue activities were mainly dependent on identifying continued funding. RE-AIM provided a useful framework for evaluating Walking Works. No changes in walking behaviour were observed. This may have been due to barriers in using walking champions to deliver activities, programme components not being delivered as intended, the types of activities delivered, or lack of awareness and participation by employees. Recommendations are provided for researchers and practitioners implementing future whole-workplace walking programmes.

Assessing the multi-scale predictive ability of ecosystem functional attributes for species distribution modelling.

PubMed

Arenas-Castro, Salvador; Gonçalves, João; Alves, Paulo; Alcaraz-Segura, Domingo; Honrado, João P

2018-01-01

Global environmental changes are rapidly affecting species' distributions and habitat suitability worldwide, requiring a continuous update of biodiversity status to support effective decisions on conservation policy and management. In this regard, satellite-derived Ecosystem Functional Attributes (EFAs) offer a more integrative and quicker evaluation of ecosystem responses to environmental drivers and changes than climate and structural or compositional landscape attributes. Thus, EFAs may hold advantages as predictors in Species Distribution Models (SDMs) and for implementing multi-scale species monitoring programs. Here we describe a modelling framework to assess the predictive ability of EFAs as Essential Biodiversity Variables (EBVs) against traditional datasets (climate, land-cover) at several scales. We test the framework with a multi-scale assessment of habitat suitability for two plant species of conservation concern, both protected under the EU Habitats Directive, differing in terms of life history, range and distribution pattern (Iris boissieri and Taxus baccata). We fitted four sets of SDMs for the two test species, calibrated with: interpolated climate variables; landscape variables; EFAs; and a combination of climate and landscape variables. EFA-based models performed very well at the several scales (AUCmedian from 0.881±0.072 to 0.983±0.125), and similarly to traditional climate-based models, individually or in combination with land-cover predictors (AUCmedian from 0.882±0.059 to 0.995±0.083). Moreover, EFA-based models identified additional suitable areas and provided valuable information on functional features of habitat suitability for both test species (narrowly vs. widely distributed), for both coarse and fine scales. Our results suggest a relatively small scale-dependence of the predictive ability of satellite-derived EFAs, supporting their use as meaningful EBVs in SDMs from regional and broader scales to more local and finer scales. Since the evaluation of species' conservation status and habitat quality should as far as possible be performed based on scalable indicators linking to meaningful processes, our framework may guide conservation managers in decision-making related to biodiversity monitoring and reporting schemes.

A Modular Simulation Framework for Assessing Swarm Search Models

DTIC Science & Technology

2014-09-01

SUBTITLE A MODULAR SIMULATION FRAMEWORK FOR ASSESSING SWARM SEARCH MODELS 5. FUNDING NUMBERS 6. AUTHOR(S) Blake M. Wanier 7. PERFORMING ORGANIZATION...Numerical studies demonstrate the ability to leverage the developed simulation and analysis framework to investigate three canonical swarm search models ...as benchmarks for future exploration of more sophisticated swarm search scenarios. 14. SUBJECT TERMS Swarm Search, Search Theory, Modeling Framework

Advancing implementation science through measure development and evaluation: a study protocol.

PubMed

Lewis, Cara C; Weiner, Bryan J; Stanick, Cameo; Fischer, Sarah M

2015-07-22

Significant gaps related to measurement issues are among the most critical barriers to advancing implementation science. Three issues motivated the study aims: (a) the lack of stakeholder involvement in defining pragmatic measure qualities; (b) the dearth of measures, particularly for implementation outcomes; and (c) unknown psychometric and pragmatic strength of existing measures. Aim 1: Establish a stakeholder-driven operationalization of pragmatic measures and develop reliable, valid rating criteria for assessing the construct. Aim 2: Develop reliable, valid, and pragmatic measures of three critical implementation outcomes, acceptability, appropriateness, and feasibility. Aim 3: Identify Consolidated Framework for Implementation Research and Implementation Outcome Framework-linked measures that demonstrate both psychometric and pragmatic strength. For Aim 1, we will conduct (a) interviews with stakeholder panelists (N = 7) and complete a literature review to populate pragmatic measure construct criteria, (b) Q-sort activities (N = 20) to clarify the internal structure of the definition, (c) Delphi activities (N = 20) to achieve consensus on the dimension priorities, (d) test-retest and inter-rater reliability assessments of the emergent rating system, and (e) known-groups validity testing of the top three prioritized pragmatic criteria. For Aim 2, our systematic development process involves domain delineation, item generation, substantive validity assessment, structural validity assessment, reliability assessment, and predictive validity assessment. We will also assess discriminant validity, known-groups validity, structural invariance, sensitivity to change, and other pragmatic features. For Aim 3, we will refine our established evidence-based assessment (EBA) criteria, extract the relevant data from the literature, rate each measure using the EBA criteria, and summarize the data. The study outputs of each aim are expected to have a positive impact as they will establish and guide a comprehensive measurement-focused research agenda for implementation science and provide empirically supported measures, tools, and methods for accomplishing this work.

Climate change & extreme weather vulnerability assessment framework.

DOT National Transportation Integrated Search

2012-12-01

The Federal Highway Administrations (FHWAs) Climate Change and Extreme Weather Vulnerability : Assessment Framework is a guide for transportation agencies interested in assessing their vulnerability : to climate change and extreme weather event...

Ethics skills laboratory experience for surgery interns.

PubMed

Moon, Margaret R; Hughes, Mark T; Chen, Jiin-Yu; Khaira, Kiran; Lipsett, Pamela; Carrese, Joseph A

2014-01-01

Ethics curricula are nearly universal in residency training programs, but the content and delivery methods are not well described, and there is still a relative paucity of literature evaluating the effect of ethics curricula. Several commentators have called for more ethics curriculum development at the postgraduate level, and specifically in surgery training. We detail our development and implementation of a clinical ethics curriculum for surgery interns. We developed curricula and simulated patient cases for 2 core clinical ethics skills--breaking bad news and obtaining informed consent. Educational sessions for each topic included (1) framework development (discussion of interns' current experience, development of a consensus framework for ethical practice, and comparison with established frameworks) and (2) practice with simulated patient followed by peer and faculty feedback. At the beginning and end of each session, we administered a test of confidence and knowledge about the topics to assess the effect of the sessions. A total of 98 surgical interns participated in the ethics skills laboratory from Spring 2008 to Spring 2011. We identified significant improvement in confidence regarding the appropriate content of informed consent (<0.001) and capacity to break bad news (<0.001). We also identified significant improvement in overall knowledge regarding informed consent (<0.01), capacity assessment (<0.05), and breaking bad news (0.001). Regarding specific components of informed consent, capacity assessment, and breaking bad news, significant improvement was shown in some areas, while we failed to improve knowledge in others. Through faculty-facilitated small group discussion, surgery interns were able to develop frameworks for ethical practice that paralleled established frameworks. Skills-based training in clinical ethics resulted in an increase in knowledge scores and self-reported confidence. Evaluation of 4 annual cohorts of surgery interns demonstrates significant successes and some areas for improvement in this educational intervention. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Development of an mHealth trauma registry in the Middle East using an implementation science framework

PubMed Central

Mehmood, Amber; Chan, Edward; Allen, Katharine; Al-Kashmiri, Ammar; Al-Busaidi, Ali; Al-Abri, Jehan; Al-Yazidi, Mohamed; Al-Maniri, Abdullah; Hyder, Adnan A.

2017-01-01

ABSTRACT Background: Trauma registries (TRs) play a vital role in the assessment of trauma care, but are often underutilized in countries with a high burden of injuries. Objectives: We investigated whether information and communications technology (ICT) such as mobile health (mHealth) could enable the design of a tablet-based application for healthcare professionals. This would be used to inform trauma care and acquire surveillance data for injury control and prevention in Oman. This paper focuses on documenting the implementation process in a healthcare setting. Methods: The study was conducted using an ICT implementation framework consisting of multistep assessment, development and pilot testing of an electronic tablet-based TR. The pilot study was conducted at two large hospitals in Oman, followed by detailed evaluation of the process, system and impact of implementation. Results: The registry was designed to provide comprehensive information on each trauma case from the location of injury until hospital discharge, with variables organized to cover 11 domains of demographic and clinical information. The pilot study demonstrated that the registry was user friendly and reliable, and the implementation framework was useful in planning for the Omani hospital setting. Data collection by trained and dedicated nurses proved to be more feasible, efficient and reliable than real-time data entry by care providers. Conclusions: The initial results show the promising potential of a user-friendly, comprehensive electronic TR through the use of mHealth tools. The pilot test in two hospitals indicates that the registry can be used to create a multicenter trauma database. PMID:29027507

The GRADE evidence-to-decision framework: a report of its testing and application in 15 international guideline panels.

PubMed

Neumann, Ignacio; Brignardello-Petersen, Romina; Wiercioch, Wojtek; Carrasco-Labra, Alonso; Cuello, Carlos; Akl, Elie; Mustafa, Reem A; Al-Hazzani, Waleed; Etxeandia-Ikobaltzeta, Itziar; Rojas, Maria Ximena; Falavigna, Maicon; Santesso, Nancy; Brozek, Jan; Iorio, Alfonso; Alonso-Coello, Pablo; Schünemann, Holger J

2016-07-15

Judgments underlying guideline recommendations are seldom recorded and presented in a systematic fashion. The GRADE Evidence-to-Decision Framework (EtD) offers a transparent way to record and report guideline developers' judgments. In this paper, we report the experiences with the EtD frameworks in 15 real guideline panels. Following the guideline panel meetings, we asked methodologists participating in the panel to provide feedback regarding the EtD framework. They were instructed to consider their own experience and the feedback collected from the rest of the panel. Two investigators independently summarized the responses and jointly interpreted the data using pre-specified domains as coding system. We asked methodologists to review the results and provide further input to improve the structure of the EtDs iteratively. The EtD framework was well received, and the comments were generally positive. Methodologists felt that in a real guideline panel, the EtD framework helps structuring a complex process through relatively simple steps in an explicit and transparent way. However, some sections (e.g., "values and preferences" and "balance between benefits and harms") required further development and clarification that were considered in the current version of the EtD framework. The use of an EtD framework in guideline development offers a structured and explicit way to record and report the judgments and discussion of guideline panels during the formulation of recommendations. In addition, it facilitates the formulation of recommendations, assessment of their strength, and identifying gaps in research.

A Framework for Dimensionality Assessment for Multidimensional Item Response Models

ERIC Educational Resources Information Center

Svetina, Dubravka; Levy, Roy

2014-01-01

A framework is introduced for considering dimensionality assessment procedures for multidimensional item response models. The framework characterizes procedures in terms of their confirmatory or exploratory approach, parametric or nonparametric assumptions, and applicability to dichotomous, polytomous, and missing data. Popular and emerging…

Framework for Metals Risk Assessment

EPA Pesticide Factsheets

The Framework for Metals Risk Assessment is a science-based document that addresses the special attributes and behaviors of metals and metal compounds to be considered when assessing their human health and ecological risks.

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

A framework for guiding sustainability assessment and on-farm strategic decision making

DOE Office of Scientific and Technical Information (OSTI.GOV)

Coteur, Ine, E-mail: ine.coteur@ilvo.vlaanderen.be; Marchand, Fleur; University of Antwerp, Ecosystem Management Research Group and IMDO, Universiteitsplein 1, 2610 Wilrijk

Responding to future challenges and societal needs, various actions are taken in agriculture to evolve towards more sustainable farming practices. These actions imply strategic choices and suppose adequate sustainability assessments to identify, measure, evaluate and communicate sustainable development. However, literature is scarce on the link between strategic decision making and sustainability assessment. As questions emerge on how, what and when to measure, the objective of this paper is to construct a framework for guiding sustainability assessment and on-farm strategic decision making. Qualitative research on own experiences from the past and a recent project revealed four categories of actual needs farmers,more » advisors and experts have regarding sustainability assessment: context, flexibility, focus on farm and farmer and communication. These stakeholders' needs are then incorporated into a two-dimensional framework that marries the intrinsic complexity of sustainability assessment tools and the time frame of strategic decision making. The framework allows a farm-specific and flexible approach leading to harmonized actions towards sustainable farming. As this framework is mainly a procedural instrument to guide the use of sustainability assessment tools within strategic decision making, it fits to incorporate, even guide, future research on sustainability assessment tools themselves and on their adoption on farms. - Highlights: • How to link sustainability assessment and on-farm strategic decision making is unclear. • Two-dimensional framework incorporating stakeholders' needs regarding sustainability assessment • Linking complexity of sustainability assessment tools and the time frame of strategic decision making • Farm-specific and flexible approach to harmonize action towards sustainable farming.« less

Opportunities to Apply the 3Rs in Safety Assessment Programs

PubMed Central

Sewell, Fiona; Edwards, Joanna; Prior, Helen; Robinson, Sally

2016-01-01

Abstract Before a potential new medicine can be administered to humans it is essential that its safety is adequately assessed. Safety assessment in animals forms an integral part of this process, from early drug discovery and initial candidate selection to the program of recommended regulatory tests in animals. The 3Rs (replacement, reduction, and refinement of animals in research) are integrated in the current regulatory requirements and expectations and, in the EU, provide a legal and ethical framework for in vivo research to ensure the scientific objectives are met whilst minimizing animal use and maintaining high animal welfare standards. Though the regulations are designed to uncover potential risks, they are intended to be flexible, so that the most appropriate approach can be taken for an individual product. This article outlines current and future opportunities to apply the 3Rs in safety assessment programs for pharmaceuticals, and the potential (scientific, financial, and ethical) benefits to the industry, across the drug discovery and development process. For example, improvements to, or the development of, novel, early screens (e.g., in vitro, in silico, or nonmammalian screens) designed to identify compounds with undesirable characteristics earlier in development have the potential to reduce late-stage attrition by improving the selection of compounds that require regulatory testing in animals. Opportunities also exist within the current regulatory framework to simultaneously reduce and/or refine animal use and improve scientific outcomes through improvements to technical procedures and/or adjustments to study designs. It is important that approaches to safety assessment are continuously reviewed and challenged to ensure they are science-driven and predictive of relevant effects in humans. PMID:28053076

. Ecological conceptual models: a framework and case study on ecosystem management for South Florida sustainability

USGS Publications Warehouse

Gentile, J.H.; Harwell, M.A.; Cropper, W.; Harwell, C. C.; DeAngelis, Donald L.; Davis, S.; Ogden, J.C.; Lirman, D.

2001-01-01

The Everglades and South Florida ecosystems are the focus of national and international attention because of their current degraded and threatened state. Ecological risk assessment, sustainability and ecosystem and adaptive management principles and processes are being used nationally as a decision and policy framework for a variety of types of ecological assessments. The intent of this study is to demonstrate the application of these paradigms and principles at a regional scale. The effects-directed assessment approach used in this study consists of a retrospective, eco-epidemiological phase to determine the causes for the current conditions and a prospective predictive risk-based assessment using scenario analysis to evaluate future options. Embedded in these assessment phases is a process that begins with the identification of goals and societal preferences which are used to develop an integrated suite of risk-based and policy relevant conceptual models. Conceptual models are used to illustrate the linkages among management (societal) actions, environmental stressors, and societal/ecological effects, and provide the basis for developing and testing causal hypotheses. These models, developed for a variety of landscape units and their drivers, stressors, and endpoints, are used to formulate hypotheses to explain the current conditions. They are also used as the basis for structuring management scenarios and analyses to project the temporal and spatial magnitude of risk reduction and system recovery. Within the context of recovery, the conceptual models are used in the initial development of performance criteria for those stressors that are determined to be most important in shaping the landscape, and to guide the use of numerical models used to develop quantitative performance criteria in the scenario analysis. The results will be discussed within an ecosystem and adaptive management framework that provides the foundation for decision making.

Ecological conceptual models: a framework and case study on ecosystem management for South Florida sustainability.

PubMed

Gentile, J H; Harwell, M A; Cropper, W; Harwell, C C; DeAngelis, D; Davis, S; Ogden, J C; Lirman, D

2001-07-02

The Everglades and South Florida ecosystems are the focus of national and international attention because of their current degraded and threatened state. Ecological risk assessment, sustainability, and ecosystem and adaptive management principles and processes are being used nationally as a decision and policy framework for a variety of types of ecological assessments. The intent of this study is to demonstrate the application of these paradigms and principles at a regional scale. The effects-directed assessment approach used in this study consists of a retrospective, eco-epidemiological phase to determine the causes for the current conditions and a prospective predictive risk-based assessment using scenario analysis to evaluate future options. Embedded in these assessment phases is a process that begins with the identification of goals and societal preferences which are used to develop an integrated suite of risk-based and policy relevant conceptual models. Conceptual models are used to illustrate the linkages among management (societal) actions, environmental stressors, and societal/ecological effects, and provide the basis for developing and testing causal hypotheses. These models, developed for a variety of landscape units and their drivers, stressors, and endpoints, are used to formulate hypotheses to explain the current conditions. They are also used as the basis for structuring management scenarios and analyses to project the temporal and spatial magnitude of risk reduction and system recovery. Within the context of recovery, the conceptual models are used in the initial development of performance criteria for those stressors that are determined to be most important in shaping the landscape, and to guide the use of numerical models used to develop quantitative performance criteria in the scenario analysis. The results will be discussed within an ecosystem and adaptive management framework that provides the foundation for decision making.

Extended Theories of Gravitation. Observation Protocols and Experimental Tests

NASA Astrophysics Data System (ADS)

Fatibene, Lorenzo; Ferraris, Marco; Francaviglia, Mauro; Magnano, Guido

2013-09-01

Within the framework of extended theories of gravitation we shall discuss physical equivalences among different formalisms and classical tests. As suggested by the Ehlers-Pirani-Schild framework, the conformal invariance will be preserved and its effect on observational protocols discussed. Accordingly, we shall review standard tests showing how Palatini f(R)-theories naturally passes solar system tests. Observation protocols will be discussed in this wider framework.

Culturally Targeted Strategies for Diabetes Prevention in Minority Populations: A Systematic Review and Framework

PubMed Central

Lagisetty, Pooja A.; Priyadarshini, Shubadra; Terrell, Stephanie; Hamati, Mary; Landgraf, Jessica; Chopra, Vineet; Heisler, Michele

2017-01-01

Purpose The purpose of this study is to (a) assess the effectiveness of culturally tailored diabetes prevention interventions in minority populations and (b) develop a novel framework to characterize four key domains of culturally tailored interventions. Prevention strategies specifically tailored to the culture of ethnic minority patients may help reduce the incidence of diabetes. Methods We searched PubMed, EMBASE, and CINAHL for English-language, randomized controlled trials (RCTs) or quasi-experimental (QE) trials testing culturally tailored interventions to prevent diabetes in minority populations. Two reviewers independently extracted data and assessed risk of bias. Inductive thematic analysis was used to develop a framework with four domains (FiLLM: Facilitating [i.e., delivering] Interventions through Language, Location and Message). The framework was used to assess the overall effectiveness of culturally tailored interventions. Results Thirty-four trials met eligibility criteria. Twelve studies were randomized controlled trials, and 22 were quasi-experimental trials. Twenty-five out of 34 studies (74%) that used cultural tailoring demonstrated significantly improved Hemoglobin A1C, fasting glucose, and/or weight loss. Of the 25 successful interventions, 21 (84%) incorporated at least three culturally targeted domains. Seven studies used all four domains and were all successful. The least utilized domain was delivery (4/34) of the intervention’s key educational message. Conclusions Culturally tailoring interventions across the four domains of facilitators, language, location, and messaging can be effective in improving risk factors for progression to diabetes among ethnic minority groups. Future studies should evaluate how specific tailoring approaches work compared to usual care as well as comparative effectiveness of each tailoring domain. Registration (PROSPERO registration: CRD42015016914) PMID:28118127

A decision-making framework for sediment contamination.

PubMed

Chapman, Peter M; Anderson, Janette

2005-07-01

A decision-making framework for determining whether or not contaminated sediments are polluted is described. This framework is intended to be sufficiently prescriptive to standardize the decision-making process but without using "cook book" assessments. It emphasizes 4 guidance "rules": (1) sediment chemistry data are only to be used alone for remediation decisions when the costs of further investigation outweigh the costs of remediation and there is agreement among all stakeholders to act; (2) remediation decisions are based primarily on biology; (3) lines of evidence (LOE), such as laboratory toxicity tests and models that contradict the results of properly conducted field surveys, are assumed incorrect; and (4) if the impacts of a remedial alternative will cause more environmental harm than good, then it should not be implemented. Sediments with contaminant concentrations below sediment quality guidelines (SQGs) that predict toxicity toless than 5% of sediment-dwelling infauna and that contain no quantifiable concentrations of substances capable of biomagnifying are excluded from further consideration, as are sediments that do not meet these criteria but have contaminant concentrations equal to or below reference concentrations. Biomagnification potential is initially addressed by conservative (worst case) modeling based on benthos and sediments and, subsequently, by additional food chain data and more realistic assumptions. Toxicity (acute and chronic) and alterations to resident communities are addressed by, respectively, laboratory studies and field observations. The integrative decision point for sediments is a weight of evidence (WOE) matrix combining up to 4 main LOE: chemistry, toxicity, community alteration, and biomagnification potential. Of 16 possible WOE scenarios, 6 result in definite decisions, and 10 require additional assessment. Typically, this framework will be applied to surficial sediments. The possibility that deeper sediments may be uncovered as a result of natural or other processes must also be investigated and may require similar assessment.

Conceptualizing the Science Curriculum: 40 Years of Developing Assessment Frameworks in Three Large-Scale Assessments

ERIC Educational Resources Information Center

Kind, Per Morten

2013-01-01

The paper analyzes conceptualizations in the science frameworks in three large-scale assessments, Trends in Mathematics and Science Study (TIMSS), Programme for International Student Assessment (PISA), and National Assessment of Educational Progress (NAEP). The assessments have a shared history, but have developed different conceptualizations. The…

A new scenario-based approach to damage detection using operational modal parameter estimates

NASA Astrophysics Data System (ADS)

Hansen, J. B.; Brincker, R.; López-Aenlle, M.; Overgaard, C. F.; Kloborg, K.

2017-09-01

In this paper a vibration-based damage localization and quantification method, based on natural frequencies and mode shapes, is presented. The proposed technique is inspired by a damage assessment methodology based solely on the sensitivity of mass-normalized experimental determined mode shapes. The present method differs by being based on modal data extracted by means of Operational Modal Analysis (OMA) combined with a reasonable Finite Element (FE) representation of the test structure and implemented in a scenario-based framework. Besides a review of the basic methodology this paper addresses fundamental theoretical as well as practical considerations which are crucial to the applicability of a given vibration-based damage assessment configuration. Lastly, the technique is demonstrated on an experimental test case using automated OMA. Both the numerical study as well as the experimental test case presented in this paper are restricted to perturbations concerning mass change.

Analyzing force concept inventory with item response theory

NASA Astrophysics Data System (ADS)

Wang, Jing; Bao, Lei

2010-10-01

Item response theory is a popular assessment method used in education. It rests on the assumption of a probability framework that relates students' innate ability and their performance on test questions. Item response theory transforms students' raw test scores into a scaled proficiency score, which can be used to compare results obtained with different test questions. The scaled score also addresses the issues of ceiling effects and guessing, which commonly exist in quantitative assessment. We used item response theory to analyze the force concept inventory (FCI). Our results show that item response theory can be useful for analyzing physics concept surveys such as the FCI and produces results about the individual questions and student performance that are beyond the capability of classical statistics. The theory yields detailed measurement parameters regarding the difficulty, discrimination features, and probability of correct guess for each of the FCI questions.

Durability assessment to environmental impact of nano-structured consolidants on Carrara marble by field exposure tests.

PubMed

Bonazza, Alessandra; Vidorni, Giorgia; Natali, Irene; Ciantelli, Chiara; Giosuè, Chiara; Tittarelli, Francesca

2017-01-01

The EU policy of reducing the emissions of combustion generated pollutants entails climate induced deterioration to become more important. Moreover, products applied to preserve outdoor built heritage and their preliminary performance tests often turn out to be improper. In such context, the paper reports the outcomes of the methodology adopted to assess the durability and efficiency of nano-based consolidating products utilized for the conservation of carbonate artworks, performing field exposure tests on Carrara marble model samples in different sites in the framework of the EC Project NANOMATCH. Surface properties and cohesion, extent and penetration of the conservative products and their interactions with marble substrates and environmental conditions are here examined after outdoor exposure for eleven months in four different European cities and compared with the features of undamaged and of untreated damaged specimens undergoing the same exposure settings. Copyright © 2016 Elsevier B.V. All rights reserved.

Instrument Development of Integrative Health and Wellness Assessment™.

PubMed

McElligott, Deborah; Eckardt, Sarah; Montgomery Dossey, Barbara; Luck, Susan; Eckardt, Patricia

2017-12-01

The nurse coach role was developed to address the needs of our nation and the world for health and wellbeing. The Theory of Integrative Nurse Coaching provides a foundation for coaching interventions supporting health promotion, and a framework for the development of the Integrative Health and Wellness Assessment (IHWA) short form. This 36-question Likert-type scale self-reporting tool assists participants in assessing healthy behaviors through a self-reflection process, provides information for the coaching relationship, and may be an outcome measurement. This article describes the history of the IHWA tool and the development and pilot testing of the IHWA short form using guidelines provided by DeVellis. Results of the Kaiser-Meyer-Olkin test yielded a value of .520, and the Bartlett's test of sphericity was significant. Cronbach's alpha overall scale internal consistency was .88 ( n = 36). Pilot study results indicate that the scale could be improved through additional revision, and an ongoing study is in progress.

Design of an assessment to probe teachers' content knowledge for teaching: An example from energy in high school physics

NASA Astrophysics Data System (ADS)

Etkina, Eugenia; Gitomer, Drew; Iaconangelo, Charles; Phelps, Geoffrey; Seeley, Lane; Vokos, Stamatis

2018-06-01

Research into teacher learning and practice over the last three decades shows that the teachers of a specific subject need to possess knowledge that is different from the knowledge of other content experts. Yet this specialized version of content knowledge that teachers need to plan instruction, respond to student ideas, and assess student understanding in real time is a theoretically elusive construct. It is crucial for the fields of precollege teacher preparation, teacher professional education, and postsecondary faculty professional development to (a) clarify the construct that underlies this specialized content knowledge, (b) operationalize it in some domain, (c) measure it in both static contexts and as it is enacted in the classroom, and (d) correlate its presence with "richness" of classroom instruction and its effect on student learning. This paper documents a piece of a multiyear, multi-institutional effort to investigate points (a)-(d) in the domain of energy in the first high school physics course. In particular, we describe the framework that we developed to clarify content knowledge for teaching in the context of high school energy learning. We then outline the process through which we developed, tested, and refined a "paper-and-pencil" assessment administered on a computer and discuss the substantive and psychometric features of several items based on a field test of the final form of the assessment. We choose to discuss these items for a dual purpose: to illustrate the application of our general framework and to present performance findings from a sample of 362 practicing high school teachers of physics.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

PubMed

Carney, Patricia A; Palmer, Ryan T; Fuqua Miller, Marissa; Thayer, Erin K; Estroff, Sue E; Litzelman, Debra K; Biagioli, Frances E; Teal, Cayla R; Lambros, Ann; Hatt, William J; Satterfield, Jason M

2016-05-01

Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review

PubMed Central

Carney, Patricia A.; Palmer, Ryan T.; Miller, Marissa Fuqua; Thayer, Erin K.; Estroff, Sue E.; Litzelman, Debra K.; Biagioli, Frances E.; Teal, Cayla R.; Lambros, Ann; Hatt, William J.; Satterfield, Jason M.

2015-01-01

Purpose Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. Method The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final, included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Results Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. Conclusions These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development. PMID:26796091

From the Margins to the Spotlight: Diverse Deaf and Hard of Hearing Student Populations and Standardized Assessment Accessibility.

PubMed

Cawthon, Stephanie

2015-01-01

Designing assessments and tests is one of the more challenging aspects of creating an accessible learning environment for students who are deaf or hard of hearing (DHH), particularly for deaf students with a disability (DWD). Standardized assessments are a key mechanism by which the educational system in the United States measures student progress, teacher effectiveness, and the impact of school reform. The diversity of student characteristics within DHH and DWD populations is only now becoming visible in the research literature relating to standardized assessments and their use in large-scale accountability reforms. The purpose of this article is to explore the theoretical frameworks surrounding assessment policy and practice, current research related to standardized assessment and students who are DHH and DWD, and potential implications for practice within both the assessment and instruction contexts.

TIMSS Advanced 2008 Assessment Frameworks

ERIC Educational Resources Information Center

Garden, Robert A.; Lie, Svein; Robitaille, David F.; Angell, Carl; Martin, Michael O.; Mullis, Ina V.S.; Foy, Pierre; Arora, Alka

2006-01-01

Developing the Trends in International Mathematics and Science Study (TIMSS) Advanced 2008 Assessment Frameworks was a collaborative venture involving mathematics and physics experts from around the world. The document contains two frameworks for implementing TIMSS Advanced 2008--one for advanced mathematics and one for physics. It also contains…

A successful approach to minimizing attrition in racial/ethnic minority, low-income populations.

PubMed

Flores, Glenn; Portillo, Alberto; Lin, Hua; Walker, Candy; Fierro, Marco; Henry, Monica; Massey, Kenneth

2017-03-01

Recruiting and retaining minority participants in clinical trials continue to be major challenges. Although multiple studies document lower minority trial enrollment, much less is known about effective minority retention strategies. Our objectives were to evaluate an innovative approach to high RCT retention of minority children, and identify child/caregiver characteristics predicting attrition. The Kids' HELP trial examined the effects of Parent Mentors on insuring uninsured minority children. We tested a retention strategic framework consisting of: 1) optimizing cultural/linguistic competency; 2) staff training on participant relationships and trust; 3) comprehensive participant contact information; 4) an electronic tracking database; 5) reminders for upcoming outcomes-assessment appointments; 6) frequent, sustained contact attempts for non-respondents; 7) financial incentives; 8) individualized rapid-cycle quality-improvement approaches to non-respondents; 9) reinforcing study importance; and 10) home assessment visits. We compared attrition in Kids' HELP vs. two previous RCTs in similar populations, and conducted bivariate and multivariable analyses of factors associated with Kids' HELP attrition. Attrition in Kids' HELP was lower than in two similar RCTs, at 10.9% vs. 37% and 40% ( P <0.001). After multivariable adjustment, missing the first outcomes follow-up assessment was the only factor significantly associated with attrition (relative risk=1.5; 95% confidence interval, 1.1-2.0). A retention strategic framework was successful in minimizing attrition in minority, low-income children. Participants missing first assessment appointments were at highest risk of subsequent attrition. These findings suggest that deploying this framework may help RCT retention of low-income minority children, particularly those at the highest risk of subsequent attrition.

A Local to National Scale Catchment Model Simulation Framework for Hydrological Predictions and Impact Assessments Under Uncertainty

NASA Astrophysics Data System (ADS)

Freer, Jim; Coxon, Gemma; Quinn, Niall; Dunne, Toby; Lane, Rosie; Bates, Paul; Wagener, Thorsten; Woods, Ross; Neal, Jeff; Howden, Nicholas; Musuuza, Jude

2017-04-01

There is a huge challenge in developing hydrological model structures that can be used for hypothesis testing, prediction, impact assessment and risk analyses over a wide range of spatial scales. There are many reasons why this is the case, from computational demands, to how we define and characterize different features and pathway connectivities in the landscape, that differ depending on the objectives of the study. However there is certainly a need more than ever to explore the trade-offs between the complexity of modelling applied (i.e. spatial discretization, levels of process representation, complexity of landscape representation) compared to the benefits realized in terms of predictive capability and robustness of these predictions during hydrological extremes and during change. Furthermore, there is a further balance, particularly associated with prediction uncertainties, in that it is not desirable to have modelling systems that are too complex compared to the observed data that would ever be available to apply them. This is particularly the case when models are applied to quantify national impact assessments, especially if these are based on validation assessments from smaller more detailed case studies. Therefore the hydrological community needs modelling tools and approaches that enable these trade-offs to be explored and to understand the level of representation needed in models to be 'fit-for-purpose' for a given application. This paper presents a catchment scale national modelling framework based on Dynamic-TOPMODEL specifically setup to fulfil these aims. A key component of the modelling framework is it's structural flexibility, as is the ability to assess model outputs using Monte Carlo simulation techniques. The model build has been automated to work at any spatial scale to the national scale, and within that to control the level of spatial discretisation and connectivity of locally accounted landscape elements in the form of hydrological response units (HRU's). This allows for the explicit consideration of spatial rainfall fields, landscape, soils and geological attributes and the spatial connectivity of hydrological flow pathways to explore what level of modelling complexity we need for different prediction problems. We shall present this framework and show how it can be used in flood and drought risk analyses as well as include attributes and features within the landscape to explore societal and climate impacts effectively within an uncertainty analyses framework.

Power system security enhancement through direct non-disruptive load control

NASA Astrophysics Data System (ADS)

Ramanathan, Badri Narayanan

The transition to a competitive market structure raises significant concerns regarding reliability of the power grid. A need to build tools for security assessment that produce operating limit boundaries for both static and dynamic contingencies is recognized. Besides, an increase in overall uncertainty in operating conditions makes corrective actions at times ineffective leaving the system vulnerable to instability. The tools that are in place for stability enhancement are mostly corrective and suffer from lack of robustness to operating condition changes. They often pose serious coordination challenges. With deregulation, there have also been ownership and responsibility issues associated with stability controls. However, the changing utility business model and the developments in enabling technologies such as two-way communication, metering, and control open up several new possibilities for power system security enhancement. This research proposes preventive modulation of selected loads through direct control for power system security enhancement. Two main contributions of this research are the following: development of an analysis framework and two conceptually different analysis approaches for load modulation to enhance oscillatory stability, and the development and study of algorithms for real-time modulation of thermostatic loads. The underlying analysis framework is based on the Structured Singular Value (SSV or mu) theory. Based on the above framework, two fundamentally different approaches towards analysis of the amount of load modulation for desired stability performance have been developed. Both the approaches have been tested on two different test systems: CIGRE Nordic test system and an equivalent of the Western Electric Coordinating Council test system. This research also develops algorithms for real-time modulation of thermostatic loads that use the results of the analysis. In line with some recent load management programs executed by utilities, two different algorithms based on dynamic programming are proposed for air-conditioner loads, while a decision-tree based algorithm is proposed for water-heater loads. An optimization framework has been developed employing the above algorithms. Monte Carlo simulations have been performed using this framework with the objective of studying the impact of different parameters and constraints on the effectiveness as well as the effect of control. The conclusions drawn from this research strongly advocate direct load control for stability enhancement from the perspectives of robustness and coordination, as well as economic viability and the developments towards availability of the institutional framework for load participation in providing system reliability services.

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

Reflections on Assessment

ERIC Educational Resources Information Center

DiRanna, Kathy; Osmundson, Ellen; Topps, Jo; Gearhart, Maryl

2008-01-01

In this article, the authors describe an assessment-centered teaching (ACT) framework they developed to communicate the integration of assessment and instruction. The framework is a visual representation of the relationships among the fundamental elements of assessment knowledge: the characteristics of quality goals for student learning and…

Preparing to Test for Deep Space

NASA Image and Video Library

2015-07-15

A structural steel section is lifted into place atop the B-2 Test Stand at NASA’s Stennis Space Center as part of modification work to prepare for testing the core stage of NASA’s new Space Launch System. The section is part of the Main Propulsion Test Article (MPTA) framework, which will support the SLS core stage for testing. The existing framework was installed on the stand in the late 1970s to test the shuttle MPTA. However, that framework had to be repositioned and modified to accommodate the larger SLS stage. About 1 million pounds of structural steel has been added, extending the framework about 100 feet higher and providing a new look to the Stennis skyline. Stennis will test the actual flight core stage for the first uncrewed SLS mission, Exploration Mission-1.

Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations.

PubMed

Mustafa, Reem A; Wiercioch, Wojtek; Falavigna, Maicon; Zhang, Yuan; Ivanova, Liudmila; Arevalo-Rodriguez, Ingrid; Cheung, Adrienne; Prediger, Barbara; Ventresca, Matthew; Brozek, Jan; Santesso, Nancy; Bossuyt, Patrick; Garg, Amit X; Lloyd, Nancy; Lelgemann, Monika; Bühler, Diedrich; Schünemann, Holger J

2017-12-01

The objective of this study was to identify and describe critical appraisal tools designed for assessing the quality of evidence (QoE) and/or strength of recommendations (SoRs) related to health care-related tests and diagnostic strategies (HCTDSs). We conducted a systematic review to identify tools applied in guidelines, methodological articles, and systematic reviews to assess HCTDS. We screened 5,534 titles and abstracts, 1,004 full-text articles, and abstracted data from 330 references. We identified 29 tools and 14 modifications of existing tools for assessing QoE and SoR. Twenty-three out of 29 tools acknowledge the importance of assessing the QoE and SoR separately, but in 8, the SoR is based solely on QoE. When making decisions about the use of tests, patient values and preferences and impact on resource utilization were considered in 6 and 8 tools, respectively. There is also confusion about the terminology that describes the various factors that influence the QoE and SoR. Although at least one approach includes all relevant criteria for assessing QoE and determining SoR, more detailed guidance about how to operationalize these assessments and make related judgments will be beneficial. There is a need for a better description of the framework for using evidence to make decisions and develop recommendations about HCTDS. Copyright © 2017 Elsevier Inc. All rights reserved.

Method to characterize directional changes in Arctic sea ice drift and associated deformation due to synoptic atmospheric variations using Lagrangian dispersion statistics

NASA Astrophysics Data System (ADS)

Lukovich, Jennifer V.; Geiger, Cathleen A.; Barber, David G.

2017-07-01

A framework is developed to assess the directional changes in sea ice drift paths and associated deformation processes in response to atmospheric forcing. The framework is based on Lagrangian statistical analyses leveraging particle dispersion theory which tells us whether ice drift is in a subdiffusive, diffusive, ballistic, or superdiffusive dynamical regime using single-particle (absolute) dispersion statistics. In terms of sea ice deformation, the framework uses two- and three-particle dispersion to characterize along- and across-shear transport as well as differential kinematic parameters. The approach is tested with GPS beacons deployed in triplets on sea ice in the southern Beaufort Sea at varying distances from the coastline in fall of 2009 with eight individual events characterized. One transition in particular follows the sea level pressure (SLP) high on 8 October in 2009 while the sea ice drift was in a superdiffusive dynamic regime. In this case, the dispersion scaling exponent (which is a slope between single-particle absolute dispersion of sea ice drift and elapsed time) changed from superdiffusive (α ˜ 3) to ballistic (α ˜ 2) as the SLP was rounding its maximum pressure value. Following this shift between regimes, there was a loss in synchronicity between sea ice drift and atmospheric motion patterns. While this is only one case study, the outcomes suggest similar studies be conducted on more buoy arrays to test momentum transfer linkages between storms and sea ice responses as a function of dispersion regime states using scaling exponents. The tools and framework developed in this study provide a unique characterization technique to evaluate these states with respect to sea ice processes in general. Application of these techniques can aid ice hazard assessments and weather forecasting in support of marine transportation and indigenous use of near-shore Arctic areas.

Incorporating Social Determinants into a Groundwater Risk Framework

NASA Astrophysics Data System (ADS)

Simpson, M.; Allen, D. M.; Journeay, M.; Korteling, B.

2009-12-01

The remediation of polluted groundwater is often very costly, therefore water managers utilize various proactive measures, such as wellhead protection planning, to prevent contamination events. With limited available resources, it is essential to prioritize where these measures are introduced; systematic and integrated methodologies of assessing risk to groundwater can be utilized for this prioritization. To quantify the resistance of the physical system to pollution, Aquifer Vulnerability is commonly mapped for the area of interest. This information is useful for focusing monitoring efforts and identifying data gaps, but is a relative measure of contaminant risk. To more accurately assess the probability of contamination, an inventory of hazards can be integrated with intrinsic vulnerability of the physical system. This Threat indicator links land-use with chemicals and quantifies the risk based on the toxicity and environmental fate of these substances. Local knowledge of the quantity stored and likelihood of release can be utilized to further assess these threats. Both of these steps form part of an existing frameworks for assessing risk to groundwater. In this study, a groundwater risk framework is developed and tested in two study areas; Pender Island and the Lower Fraser Valley in British Columbia, Canada. Enhancements of a basic groundwater risk framework include not only incorporating points sources such as septic systems, landfills and fuel storage, but also various social determinants of risk. These social determinants include the Resistance of a community, which represents the planning and protection initiatives designed to safeguard the resource. These include items such as land-use planning that consider groundwater vulnerability and best management practices enforced by local governments. The ability to recover following an event is the Capacity of a community; indicators include the presence or absence of spill response plans, treatment systems or an alternative supply of water. The determinant of Loss quantifies the financial impact of this work. This indicator may be altered in future applications to include loss associated with human health and/or that stemming from a reduction in ecosystem health.