Creating More Trauma-Informed Services for Children Using Assessment-Focused Tools

ERIC Educational Resources Information Center

Igelman, Robyn; Taylor, Nicole; Gilbert, Alicia; Ryan, Barbara; Steinberg, Alan; Wilson, Charles; Mann, Gail

2007-01-01

This article promotes integrating assessment and evidence-based practice in the treatment of traumatized children through a review of two newly developed trauma assessment tools: (1) the Child Welfare Trauma Referral Tool (CWT), and (2) Assessment-Based Treatment for Traumatized Children: A Trauma Assessment Pathway Model (TAP). These tools use…

Multicomponent Musculoskeletal Movement Assessment Tools: A Systematic Review and Critical Appraisal of Their Development and Applicability to Professional Practice.

PubMed

Bennett, Hunter; Davison, Kade; Arnold, John; Slattery, Flynn; Martin, Max; Norton, Kevin

2017-10-01

Multicomponent movement assessment tools have become commonplace to measure movement quality, proposing to indicate injury risk and performance capabilities. Despite popular use, there has been no attempt to compare the components of each tool reported in the literature, the processes in which they were developed, or the underpinning rationale for their included content. As such, the objective of this systematic review was to provide a comprehensive summary of current movement assessment tools and appraise the evidence supporting their development. A systematic literature search was performed using PRISMA guidelines to identify multicomponent movement assessment tools. Commonalities between tools and the evidence provided to support the content of each tool was identified. Each tool underwent critical appraisal to identify the rigor in which it was developed, and its applicability to professional practice. Eleven tools were identified, of which 5 provided evidence to support their content as assessments of movement quality. One assessment tool (Soccer Injury Movement Screen [SIMS]) received an overall score of above 65% on critical appraisal, with a further 2 tools (Movement Competency Screen [MCS] and modified 4 movement screen [M4-MS]) scoring above 60%. Only the MCS provided clear justification for its developmental process. The remaining 8 tools scored between 40 and 60%. On appraisal, the MCS, M4-MS, and SIMS seem to provide the most practical value for assessing movement quality as they provide the strongest reports of developmental rigor and an identifiable evidence base. In addition, considering the evidence provided, these tools may have the strongest potential for identifying performance capabilities and guiding exercise prescription in athletic and sport-specific populations.

The Development and Pilot Testing of the Marijuana Retail Surveillance Tool (MRST): Assessing Marketing and Point-of-Sale Practices among Recreational Marijuana Retailers

ERIC Educational Resources Information Center

Berg, Carla J.; Henriksen, Lisa; Cavazos-Rehg, Patricia; Schauer, Gillian L.; Freisthler, Bridget

2017-01-01

As recreational marijuana expands, it is critical to develop standardized surveillance measures to study the retail environment. To this end, our research team developed and piloted a tool assessing recreational marijuana retailers in a convenience sample of 20 Denver retailers in 2016. The tool assesses: (i) compliance and security (e.g.…

Development of a Multi-Domain Assessment Tool for Quality Improvement Projects.

PubMed

Rosenbluth, Glenn; Burman, Natalie J; Ranji, Sumant R; Boscardin, Christy K

2017-08-01

Improving the quality of health care and education has become a mandate at all levels within the medical profession. While several published quality improvement (QI) assessment tools exist, all have limitations in addressing the range of QI projects undertaken by learners in undergraduate medical education, graduate medical education, and continuing medical education. We developed and validated a tool to assess QI projects with learner engagement across the educational continuum. After reviewing existing tools, we interviewed local faculty who taught QI to understand how learners were engaged and what these faculty wanted in an ideal assessment tool. We then developed a list of competencies associated with QI, established items linked to these competencies, revised the items using an iterative process, and collected validity evidence for the tool. The resulting Multi-Domain Assessment of Quality Improvement Projects (MAQIP) rating tool contains 9 items, with criteria that may be completely fulfilled, partially fulfilled, or not fulfilled. Interrater reliability was 0.77. Untrained local faculty were able to use the tool with minimal guidance. The MAQIP is a 9-item, user-friendly tool that can be used to assess QI projects at various stages and to provide formative and summative feedback to learners at all levels.

Issues in developing valid assessments of speech pathology students' performance in the workplace.

PubMed

McAllister, Sue; Lincoln, Michelle; Ferguson, Alison; McAllister, Lindy

2010-01-01

Workplace-based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be 'the gold standard', but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace-based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. This paper reviews important conceptual issues in the design of valid and reliable workplace-based assessments of competence including assessment content, process, impact on learning, measurement issues, and validation strategies. It then goes on to share what has been learned about quality assessment and validation of a workplace-based performance assessment using competency-based ratings. The outcomes of a four-year national development and validation of an assessment tool are described. A literature review of issues in conceptualizing, designing, and validating workplace-based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling, and data analysis in the validation stages of the development process. This paper provides an accessible overview of factors to consider in the design and validation of workplace-based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS, used in an every speech pathology programme in Australia, New Zealand, and Singapore. The paper also describes Rasch analysis, a model-based statistical approach which is useful for establishing validity and reliability of assessment tools. Through careful attention to conceptual and design issues in the development and trialling of workplace-based assessments, it has been possible to develop the world's first valid and reliable national assessment tool for the assessment of performance in speech pathology.

Users' manual for the Hydroecological Integrity Assessment Process software (including the New Jersey Assessment Tools)

USGS Publications Warehouse

Henriksen, James A.; Heasley, John; Kennen, Jonathan G.; Nieswand, Steven

2006-01-01

Applying the Hydroecological Integrity Assessment Process involves four steps: (1) a hydrologic classification of relatively unmodified streams in a geographic area using long-term gage records and 171 ecologically relevant indices; (2) the identification of statistically significant, nonredundant, hydroecologically relevant indices associated with the five major flow components for each stream class; and (3) the development of a stream-classification tool and a hydrologic assessment tool. Four computer software tools have been developed.

Tools for Embedded Computing Systems Software

NASA Technical Reports Server (NTRS)

1978-01-01

A workshop was held to assess the state of tools for embedded systems software and to determine directions for tool development. A synopsis of the talk and the key figures of each workshop presentation, together with chairmen summaries, are presented. The presentations covered four major areas: (1) tools and the software environment (development and testing); (2) tools and software requirements, design, and specification; (3) tools and language processors; and (4) tools and verification and validation (analysis and testing). The utility and contribution of existing tools and research results for the development and testing of embedded computing systems software are described and assessed.

Community-based oral health promotion practices targeted at children and adolescents in Finland--developing an assessment tool.

PubMed

Blomqvist, Pia; Ojala, Ellinoora; Kettunen, Tarja; Poskiparta, Marita; Kasila, Kirsti

2014-06-01

To develop an assessment tool for evaluating oral health promotion practices and to evaluate community-based oral health promotion practices targeted at children and adolescents with this tool. A theoretical framework about health promotion planning, implementation and evaluation was made on the basis of a literature review. Then, information about Finnish community-based oral health promotion practices (n=12) targeted at children and adolescents was collected using semi-structured interviews. Also, related documents, for example action plans and reports, were collected when available. Next, an assessment tool based on the theoretical framework was developed, and the recorded and transcribed interview data and other documents were evaluated with this tool. The assessment tool proved to be practical: it pointed out the strengths and weaknesses of the practices. The tool revealed strengths in the implementation and deficiencies in the planning and evaluation of oral health promotion practices. One-quarter of the 12 practices assessed could be considered 'good practices'. There is a need to improve the planning and evaluation of oral health promotion practices. The assessment tool developed in this study might be useful for practitioners both in the field of oral health promotion and general health promotion. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A literature review of the cardiovascular risk-assessment tools: applicability among Asian population.

PubMed

Liau, Siow Yen; Mohamed Izham, M I; Hassali, M A; Shafie, A A

2010-01-01

Cardiovascular diseases, the main causes of hospitalisations and death globally, have put an enormous economic burden on the healthcare system. Several risk factors are associated with the occurrence of cardiovascular events. At the heart of efficient prevention of cardiovascular disease is the concept of risk assessment. This paper aims to review the available cardiovascular risk-assessment tools and its applicability in predicting cardiovascular risk among Asian populations. A systematic search was performed using keywords as MeSH and Boolean terms. A total of 25 risk-assessment tools were identified. Of these, only two risk-assessment tools (8%) were derived from an Asian population. These risk-assessment tools differ in various ways, including characteristics of the derivation sample, type of study, time frame of follow-up, end points, statistical analysis and risk factors included. Very few cardiovascular risk-assessment tools were developed in Asian populations. In order to accurately predict the cardiovascular risk of our population, there is a need to develop a risk-assessment tool based on local epidemiological data.

Movement skill assessment of typically developing preschool children: a review of seven movement skill assessment tools.

PubMed

Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

2009-06-01

The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child's physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools' usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool's test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool's normative data samples would benefit from frequent movement skill performance follow-up of today's children. MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: Körper-Koordinationtest für Kinder, TGDM: Test of Gross Motor Development, MMT: Maastrichtse Motoriektest, BOTMP: Bruininks-Oseretsky Test of Motor Proficiency. ICC: intraclass correlation coefficient, NR: not reported, GM: gross motor, LV: long version, SV: short version, LF: long form, SF: short form, STV: subtest version, SEMs: standard errors of measurement, TMQ: Total Motor Quotient, TMC: Total Motor Composite, CSSA: Comprehensive Scales of Student Abilities MSEL: Mullen Scales of Early learning: AGS Edition AUC: Areas under curve BC: Battery composite ROC: Receiver operating characteristic.

Measurement of the dimensions of food insecurity in developed countries: a systematic literature review.

PubMed

Ashby, Stephanie; Kleve, Suzanne; McKechnie, Rebecca; Palermo, Claire

2016-11-01

Food insecurity is a salient health issue comprised of four dimensions - food access, availability, utilization and stability over time. The aim of the present study was to conduct a systematic literature review to identify all multi-item tools that measure food insecurity and explore which of the dimensions they assess. Five databases were searched (CENTRAL, CINAHL plus, EMBASE, MEDLINE, TRIP) for studies published in English since 1999. Inclusion criteria included human studies using multi-item tools to measure food security and studies conducted in developed countries. Manuscripts describing the US Department of Agriculture Food Security Survey Module, that measures 'food access', were excluded due to wide acceptance of the validity and reliability of this instrument. Two authors extracted data and assessed the quality of the included studies. Data were summarized against the dimensions of food insecurity. A systematic review of the literature. The majority of tools were developed in the USA and had been used in different age groups and cultures. Eight multi-item tools were identified. All of the tools assessed the 'food access' dimension and two partially assessed the dimensions 'food utilization' and 'stability over time', respectively. 'Food availability' was not assessed by existing tools. Current tools available for measuring food insecurity are subjective, limited in scope, with a majority assessing only one dimension of food insecurity (access). To more accurately assess the true burden of food insecurity, tools should be adapted or developed to assess all four dimensions of food insecurity.

An overview of clinical tools used to assess neonatal abstinence syndrome.

PubMed

Orlando, Susan

2014-01-01

Several clinical tools have been developed to quantify the severity of withdrawal signs and symptoms exhibited by infants born to substance-using mothers. Scores from the systematic assessments are used to guide treatment of infants with moderate to severe clinical signs. This article provides an overview of published assessment tools developed for infants with neonatal abstinence syndrome. Nurses caring for infants at risk for neonatal abstinence syndrome should be knowledgeable about the tools used to evaluate these infants and guide their treatment. The ideal assessment tool should be published and include item definitions and a protocol for administering the tool. Nurses need education and training to achieve competency and interobserver reliability in the use of a selected tool. Tool-specific materials should be used to standardize training and improve accuracy in assessments. Competent and knowledgeable nurses play a critical role in improving outcomes for infants with neonatal abstinence syndrome.

Developing an Intelligent Diagnosis and Assessment E-Learning Tool for Introductory Programming

ERIC Educational Resources Information Center

Huang, Chenn-Jung; Chen, Chun-Hua; Luo, Yun-Cheng; Chen, Hong-Xin; Chuang, Yi-Ta

2008-01-01

Recently, a lot of open source e-learning platforms have been offered for free in the Internet. We thus incorporate the intelligent diagnosis and assessment tool into an open software e-learning platform developed for programming language courses, wherein the proposed learning diagnosis assessment tools based on text mining and machine learning…

Whakawhiti Kōrero, a Method for the Development of a Cultural Assessment Tool, Te Waka Kuaka, in Māori Traumatic Brain Injury.

PubMed

Elder, Hinemoa; Kersten, Paula

2015-01-01

The importance of tools for the measurement of outcomes and needs in traumatic brain injury is well recognised. The development of tools for these injuries in indigenous communities has been limited despite the well-documented disparity of brain injury. The wairua theory of traumatic brain injury (TBI) in Māori proposes that a culturally defined injury occurs in tandem with the physical injury. A cultural response is therefore indicated. This research investigates a Māori method used in the development of cultural needs assessment tool designed to further examine needs associated with the culturally determined injury and in preparation for formal validation. Whakawhiti kōrero is a method used to develop better statements in the development of the assessment tool. Four wānanga (traditional fora) were held including one with whānau (extended family) with experience of traumatic brain injury. The approach was well received. A final version, Te Waka Kuaka, is now ready for validation. Whakawhiti kōrero is an indigenous method used in the development of cultural needs assessment tool in Māori traumatic brain injury. This method is likely to have wider applicability, such as Mental Health and Addictions Services, to ensure robust process of outcome measure and needs assessment development.

Using an Internally-Developed Tool to Assess Intercultural Competence in Short-Term Study Abroad Programs

ERIC Educational Resources Information Center

Kartoshkina, Yuliya

2013-01-01

An internally-developed tool was developed to assess the intercultural competence of students taking part in short-term study abroad programs. Four scales were built to assess possible change in students' host culture knowledge, cross-cultural awareness, cross-cultural adaptation, and self-assessed foreign language proficiency. Enrollment in a…

Development of the Canadian Physiotherapy Assessment of Clinical Performance: A New Tool to Assess Physiotherapy Students' Performance in Clinical Education.

PubMed

Mori, Brenda; Brooks, Dina; Norman, Kathleen E; Herold, Jodi; Beaton, Dorcas E

2015-08-01

To develop the first draft of a Canadian tool to assess physiotherapy (PT) students' performance in clinical education (CE). Phase 1: to gain consensus on the items within the new tool, the number and placement of the comment boxes, and the rating scale; Phase 2: to explore the face and content validity of the draft tool. Phase 1 used the Delphi method; Phase 2 used cognitive interviewing methods with recent graduates and clinical instructors (CIs) and detailed interviews with clinical education and measurement experts. Consensus was reached on the first draft of the new tool by round 3 of the Delphi process, which was completed by 21 participants. Interviews were completed with 13 CIs, 6 recent graduates, and 7 experts. Recent graduates and CIs were able to interpret the tool accurately, felt they could apply it to a recent CE experience, and provided suggestions to improve the draft. Experts provided salient advice. The first draft of a new tool to assess PT students in CE, the Canadian Physiotherapy Assessment of Clinical Performance (ACP), was developed and will undergo further development and testing, including national consultation with stakeholders. Data from Phase 2 will contribute to developing an online education module for CIs and students.

Assessing the health workforce implications of health policy and programming: how a review of grey literature informed the development of a new impact assessment tool.

PubMed

Nove, Andrea; Cometto, Giorgio; Campbell, James

2017-11-09

In their adoption of WHA resolution 69.19, World Health Organization Member States requested all bilateral and multilateral initiatives to conduct impact assessments of their funding to human resources for health. The High-Level Commission for Health Employment and Economic Growth similarly proposed that official development assistance for health, education, employment and gender are best aligned to creating decent jobs in the health and social workforce. No standard tools exist for assessing the impact of global health initiatives on the health workforce, but tools exist from other fields. The objectives of this paper are to describe how a review of grey literature informed the development of a draft health workforce impact assessment tool and to introduce the tool. A search of grey literature yielded 72 examples of impact assessment tools and guidance from a wide variety of fields including gender, health and human rights. These examples were reviewed, and information relevant to the development of a health workforce impact assessment was extracted from them using an inductive process. A number of good practice principles were identified from the review. These informed the development of a draft health workforce impact assessment tool, based on an established health labour market framework. The tool is designed to be applied before implementation. It consists of a relatively short and focused screening module to be applied to all relevant initiatives, followed by a more in-depth assessment to be applied only to initiatives for which the screening module indicates that significant implications for HRH are anticipated. It thus aims to strike a balance between maximising rigour and minimising administrative burden. The application of the new tool will help to ensure that health workforce implications are incorporated into global health decision-making processes from the outset and to enhance positive HRH impacts and avoid, minimise or offset negative impacts.

Developing and Validating a New Classroom Climate Observation Assessment Tool

PubMed Central

Leff, Stephen S.; Thomas, Duane E.; Shapiro, Edward S.; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F.

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children’s psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression. PMID:21643447

Developing and Validating a New Classroom Climate Observation Assessment Tool.

PubMed

Leff, Stephen S; Thomas, Duane E; Shapiro, Edward S; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children's psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression.

Development and testing of a DVT risk assessment tool: providing evidence of validity and reliability.

PubMed

McCaffrey, Ruth; Bishop, Mary; Adonis-Rizzo, Marie; Williamson, Ellen; McPherson, Melanie; Cruikshank, Alice; Carrier, Vicki Jo; Sands, Simone; Pigano, Diane; Girard, Patricia; Lauzon, Cathy

2007-01-01

Hospital-acquired deep vein thrombosis (DVT) and pulmonary embolisms (PE) are preventable problems that can increase mortality. Early assessment and recognition of risk as well as initiating appropriate prevention measures can prevent DVT or PE. The purpose of this research project was to develop a DVT risk assessment tool and test the tool for validity and reliability. Three phases were undertaken in developing and testing the JFK Medical Center DVT risk assessment tool. Investigation and clarification of risk and predisposing factors for DVT were identified from the literature, expert nursing knowledge, and medical staff input. Second, item development and weighting were undertaken. Third, parametric testing for content validity measured the differences in mean assessment tool scores between a group of patients who developed DVT in the hospital and a demographically similar group who did not develop DVT. Interrater reliability was measured by having three different nurses score each patient and compare the differences in scores among the three. The DVT group had significantly higher scores on the JFK DVT assessment scale than did those who did not experience DVT. Interrater reliability showed a strong correlation among the scores of the three nurses (.98). Providing a valid and reliable tool for measuring the risk for DVT or PE in hospitalized patients will enable nurses to intervene early in patients at risk. Basing DVT risk assessment on the evidence provided in this study will assist nurses in becoming more confident in recognizing the necessity for interventions in hospitalized patients and decreasing risk. Nurses can now evaluate patients at risk for DVT or PE using the JFK Medial Center's risk assessment tool.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

Grounding formative assessment in high-school chemistry classrooms: Connections between professional development and teacher practice

NASA Astrophysics Data System (ADS)

Cisterna Alburquerque, Dante Igor

This study describes and analyzes the experiences of two high-school chemistry teachers who participated in a team-based professional development program to learn about and enact formative assessment in their classrooms. The overall purpose of this study is to explain how participation in this professional development influenced both teachers' classroom enactment of formative assessment practices. This study focuses on 1) teachers' participation in the professional development program, 2) teachers' enactment of formative assessment, and 3) factors that enabled or hindered enactment of formative assessment. Drawing on cultural-historical activity theory (CHAT) and using evidence from teacher lessons, teacher interviews, professional development meetings as data sources, this single embedded case study analyzes how these two teachers who participated in the same learning team and have similar characteristics (i.e., teaching in the same school, teaching the same courses and population of students, and using the same materials) differentially used the professional development learning about formative assessment as mediating tools to improve their classroom instruction. The learning team experience contributed to both teachers' development of a better understanding of formative assessment---especially in recognizing that their current grading and assessment practices were not appropriate to promote student learning---and the co-creation of artifacts to gather evidence of students' ideas. Although both teachers demonstrated understanding about how formative assessment may serve to promote student learning and had a set of tools available to utilize for formative assessment use, they did not enact these tools in the same way. One teacher appropriated formative assessment as mediating tool to verify if the students were following her explanations, and to check if the students were able to provide the correct response. The other teacher used the mediating tool to promote better understanding of students' ideas and her mindset shifted to place more value on the diversity of students' thinking and help them be more aware of their ideas. This study illustrates the complexities of enacting formative assessment practices in particular classrooms because teachers may interpret and use these tools in different ways. Thus, when teachers enacted these mediating tools, their interaction with the activity system's components produced different instructional outcomes and tensions. Similarly, this study describes how the use of artifacts of practice can be a vehicle between professional development and classrooms, especially in early stages of professional development. This study presents implications for professional development and formative assessment research and practice. Professional development needs to support teachers in reflecting on their practice in terms of activity systems, use a solid and research-based understanding of formative assessment, and promote opportunities to teachers to create, enact, and reflect on formative assessment artifacts and tools.

BASINS and WEPP Climate Assessment Tools (CAT): Case ...

EPA Pesticide Factsheets

This draft report supports application of two recently developed water modeling tools, the BASINS and WEPP climate assessment tools. The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments of the potential future effects of climate change on water resources. This report presents a series of short, illustrative case studies using the BASINS and WEPP climate assessment tools.

Nursing Assessment Tool for People With Liver Cirrhosis

PubMed Central

Reis, Renata Karina; da Silva, Patrícia Costa dos Santos; Silva, Ana Elisa Bauer de Camargo; Atila, Elisabeth

2016-01-01

The aim of this study was to describe the process of developing a nursing assessment tool for hospitalized adult patients with liver cirrhosis. A descriptive study was carried out in three stages. First, we conducted a literature review to develop a data collection tool on the basis of the Conceptual Model of Wanda Horta. Second, the data collection tool was assessed through an expert panel. Third, we conducted the pilot testing in hospitalized patients. Most of the comments offered by the panel members were accepted to improve the tool. The final version was in the form of a questionnaire with open-closed questions. The panel members concluded that the tool was useful for accurate nursing diagnosis. Horta's Conceptual Model assisted with the development of this data collection tool to help nurses identify accurate nursing diagnosis in hospitalized patients with liver cirrhosis. We hope that the tool can be used by all nurses in clinical practice. PMID:26425862

BASINS and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications (External Review Draft)

EPA Science Inventory

This draft report supports application of two recently developed water modeling tools, the BASINS and WEPP climate assessment tools. The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments...

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

Field application of farm-food safety risk assessment (FRAMp) tool for small and medium fresh produce farms.

PubMed

Soon, J M; Davies, W P; Chadd, S A; Baines, R N

2013-02-15

The objective of this study was to develop a farm food safety-risk assessment tool (FRAMp) which serves as a self-assessment and educational tool for fresh produce farms. FRAMp was developed in Microsoft® Excel spreadsheet software using standard mathematical and logical functions and utilised a qualitative risk assessment approach for farmers to evaluate their food safety practices. The FRAMp tool has since been tested on 12 fresh produce farms throughout UK. All the farms determined that FRAMp was interesting but 17% found it too long while 25% of the farms felt the tool was too complicated. The instructions on FRAMp usage were revised and farmers were given the options to skip and select specific steps in the farm risk assessment. The end users (farmers/farm managers) determined that developing their own action plans and using it as proof of assessment for future third-party audits were most useful to them. FRAMp tool can be described as an illustrative risk ranking tool to facilitate farms to identify potential risk factors during their crop production. Copyright © 2012 Elsevier Ltd. All rights reserved.

TRACI 2.0 - The Tool for the Reduction and Assessment of Chemical and other environmental Impacts

EPA Science Inventory

TRACI 2.0, the Tool for the Reduction and Assessment of Chemical and other environmental Impacts 2.0, has been expanded and developed for sustainability metrics, life cycle impact assessment, industrial ecology, and process design impact assessment for developing increasingly sus...

Tool for the Reduction and Assessment of Chemical and Other Environmental Impacts (TRACI) TRACI version 2.1 User’s Guide

EPA Science Inventory

TRACI 2.1 (the Tool for the Reduction and Assessment of Chemical and other environmental Impacts) has been developed for sustainability metrics, life cycle impact assessment, industrial ecology, and process design impact assessment for developing increasingly sustainable products...

HEFCE's People Management Self-Assessment Tool: Ticking Boxes or Adding Value? A Case Study

ERIC Educational Resources Information Center

McDonald, Claire

2009-01-01

This article examines one specific organisational development tool in depth and uses a case study to investigate whether using the tool is more than a tick-box exercise and really can add value and help organisations to develop and improve. The People Management Self-Assessment Tool (SAT) is used to examine higher education institutions' (HEIs)…

An Integrated Approach to Risk Assessment for Concurrent Design

NASA Technical Reports Server (NTRS)

Meshkat, Leila; Voss, Luke; Feather, Martin; Cornford, Steve

2005-01-01

This paper describes an approach to risk assessment and analysis suited to the early phase, concurrent design of a space mission. The approach integrates an agile, multi-user risk collection tool, a more in-depth risk analysis tool, and repositories of risk information. A JPL developed tool, named RAP, is used for collecting expert opinions about risk from designers involved in the concurrent design of a space mission. Another in-house developed risk assessment tool, named DDP, is used for the analysis.

Development of the Assessment of Burden of COPD tool: an integrated tool to measure the burden of COPD.

PubMed

Slok, Annerika H M; in 't Veen, Johannes C C M; Chavannes, Niels H; van der Molen, Thys; Rutten-van Mölken, Maureen P M H; Kerstjens, Huib A M; Salomé, Philippe L; Holverda, Sebastiaan; Dekhuijzen, P N Richard; Schuiten, Denise; Asijee, Guus M; van Schayck, Onno C P

2014-07-10

In deciding on the treatment plan for patients with chronic obstructive pulmonary disease (COPD), the burden of COPD as experienced by patients should be the core focus. It is therefore important for daily practice to develop a tool that can both assess the burden of COPD and facilitate communication with patients in clinical practice. This paper describes the development of an integrated tool to assess the burden of COPD in daily practice. A definition of the burden of COPD was formulated by a Dutch expert team. Interviews showed that patients and health-care providers agreed on this definition. We found no existing instruments that fully measured burden of disease according to this definition. However, the Clinical COPD Questionnaire meets most requirements, and was therefore used and adapted. The adapted questionnaire is called the Assessment of Burden of COPD (ABC) scale. In addition, the ABC tool was developed, of which the ABC scale is the core part. The ABC tool is a computer program with an algorithm that visualises outcomes and provides treatment advice. The next step in the development of the tool is to test the validity and effectiveness of both the ABC scale and tool in daily practice.

Development of the Assessment of Burden of COPD tool: an integrated tool to measure the burden of COPD

PubMed Central

Slok, Annerika H M; in ’t Veen, Johannes C C M; Chavannes, Niels H; van der Molen, Thys; Rutten-van Mölken, Maureen P M H; Kerstjens, Huib A M; Salomé, Philippe L; Holverda, Sebastiaan; Dekhuijzen, PN Richard; Schuiten, Denise; Asijee, Guus M; van Schayck, Onno C P

2014-01-01

In deciding on the treatment plan for patients with chronic obstructive pulmonary disease (COPD), the burden of COPD as experienced by patients should be the core focus. It is therefore important for daily practice to develop a tool that can both assess the burden of COPD and facilitate communication with patients in clinical practice. This paper describes the development of an integrated tool to assess the burden of COPD in daily practice. A definition of the burden of COPD was formulated by a Dutch expert team. Interviews showed that patients and health-care providers agreed on this definition. We found no existing instruments that fully measured burden of disease according to this definition. However, the Clinical COPD Questionnaire meets most requirements, and was therefore used and adapted. The adapted questionnaire is called the Assessment of Burden of COPD (ABC) scale. In addition, the ABC tool was developed, of which the ABC scale is the core part. The ABC tool is a computer program with an algorithm that visualises outcomes and provides treatment advice. The next step in the development of the tool is to test the validity and effectiveness of both the ABC scale and tool in daily practice. PMID:25010353

Development and validation of the TOCO-TURBT tool: a summative assessment tool that measures surgical competency in transurethral resection of bladder tumour.

PubMed

de Vries, Anna H; Muijtjens, Arno M M; van Genugten, Hilde G J; Hendrikx, Ad J M; Koldewijn, Evert L; Schout, Barbara M A; van der Vleuten, Cees P M; Wagner, Cordula; Tjiam, Irene M; van Merriënboer, Jeroen J G

2018-06-05

The current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT). The 'Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n = 15), procedural (n = 21), and completion (n = 15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory. The majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r > 0.5, p < 0.01). Generalizability-theory analysis showed high reliability (coefficient Phi ≥ 0.8) when using the format of two assessors and two cases. This study provides first evidence that the TOCO-TURBT tool is a feasible, valid and reliable assessment tool for measuring competency in TURBT. The tool has the potential to be used for future certification of competencies for residents and urologists. The methodology of CTA might be valuable in the development of assessment tools in other areas of clinical practice.

Enabling Research Tools for Sustained Climate Assessment

NASA Technical Reports Server (NTRS)

Leidner, Allison K.; Bosilovich, Michael G.; Jasinski, Michael F.; Nemani, Ramakrishna R.; Waliser, Duane Edward; Lee, Tsengdar J.

2016-01-01

The U.S. Global Change Research Program Sustained Assessment process benefits from long-term investments in Earth science research that enable the scientific community to conduct assessment-relevant science. To this end, NASA initiated several research programs over the past five years to support the Earth observation community in developing indicators, datasets, research products, and tools to support ongoing and future National Climate Assessments. These activities complement NASA's ongoing Earth science research programs. One aspect of the assessment portfolio funds four "enabling tools" projects at NASA research centers. Each tool leverages existing capacity within the center, but has developed tailored applications and products for National Climate Assessments. The four projects build on the capabilities of a global atmospheric reanalysis (MERRA-2), a continental U.S. land surface reanalysis (NCA-LDAS), the NASA Earth Exchange (NEX), and a Regional Climate Model Evaluation System (RCMES). Here, we provide a brief overview of each enabling tool, highlighting the ways in which it has advanced assessment science to date. We also discuss how the assessment community can access and utilize these tools for National Climate Assessments and other sustained assessment activities.

Evaluation of tools used to measure calcium and/or dairy consumption in children and adolescents.

PubMed

Magarey, Anthea; Yaxley, Alison; Markow, Kylie; Baulderstone, Lauren; Miller, Michelle

2014-08-01

To identify and critique tools that assess Ca and/or dairy intake in children to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles were included on the basis that they reported on a tool measuring Ca and/or dairy intake in children in Western countries and reported on originally developed tools or tested the validity or reliability of existing tools. Defined criteria for reporting reliability and validity properties were applied. Studies in Western countries. Children. Eighteen papers reporting on two tools that assessed dairy intake, ten that assessed Ca intake and five that assessed both dairy and Ca were identified. An examination of tool testing revealed high reliance on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful significance. Only half of the tools were tested for reliability and results indicated that only one Ca tool and one dairy tool were reliable. Validation studies showed acceptable levels of agreement (<100 mg difference) and/or sensitivity (62-83 %) and specificity (55-77 %) in three Ca tools. With reference to the testing methodology and results, no tools were considered both valid and reliable for the assessment of dairy intake and only one tool proved valid and reliable for the assessment of Ca intake. These results clearly indicate the need for development and rigorous testing of tools to assess Ca and/or dairy intake in children and adolescents.

Development and validation of an observation tool for the assessment of nursing pain management practices in intensive care unit in a standardized clinical simulation setting.

PubMed

Gosselin, Emilie; Bourgault, Patricia; Lavoie, Stephan; Coleman, Robin-Marie; Méziat-Burdin, Anne

2014-12-01

Pain management in the intensive care unit is often inadequate. There is no tool available to assess nursing pain management practices. The aim of this study was to develop and validate a measuring tool to assess nursing pain management in the intensive care unit during standardized clinical simulation. A literature review was performed to identify relevant components demonstrating optimal pain management in adult intensive care units and to integrate them in an observation tool. This tool was submitted to an expert panel and pretested. It was then used to assess pain management practice during 26 discrete standardized clinical simulation sessions with intensive care nurses. The Nursing Observation Tool for Pain Management (NOTPaM) contains 28 statements grouped into 8 categories, which are grouped into 4 dimensions: subjective assessment, objective assessment, interventions, and reassessment. The tool's internal consistency was calculated at a Cronbach's alpha of 0.436 for the whole tool; the alpha varies from 0.328 to 0.518 for each dimension. To evaluate the inter-rater reliability, intra-class correlation coefficient was used, which was calculated at 0.751 (p < .001) for the whole tool, with variations from 0.619 to 0.920 (p < .01) between dimensions. The expert panel was satisfied with the content and face validity of the tool. The psychometric qualities of the NOTPaM developed in this study are satisfactory. However, the tool could be improved with slight modifications. Nevertheless, it was useful in assessing intensive care nurses' pain management in a standardized clinical simulation. The NOTPaM is the first tool created for this purpose. Copyright © 2014 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

The Social Construction of Ability in Movement Assessment Tools

ERIC Educational Resources Information Center

Tidén, Anna; Redelius, Karin; Lundvall, Suzanne

2017-01-01

This paper focuses on how "ability" is conceptualised, configured and produced in movement assessment tools. The aim of the study was to critically analyse assessment tools used for healthy and typically developed children. The sample consists of 10 tools from 6 different countries. In the study, we pay special attention to content and…

Quantitative health impact assessment: taking stock and moving forward.

PubMed

Fehr, Rainer; Hurley, Fintan; Mekel, Odile Cecile; Mackenbach, Johan P

2012-12-01

Over the past years, application of health impact assessment has increased substantially, and there has been a strong growth of tools that allow quantification of health impacts for a range of health relevant policies. We review these developments, and conclude that further tool development is no longer a main priority, although several aspects need to be further developed, such as methods to assess impacts on health inequalities and to assess uncertainties. The main new challenges are, first, to conduct a comparative evaluation of different tools, and, second, to ensure the maintenance and continued availability of the toolkits including their data contents.

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Construct Validation--Community College Instructional Development Inventory

ERIC Educational Resources Information Center

Xiong, Soua; Delgado, Nexi; Wood, J. Luke; Harris, Frank, III

2017-01-01

This white paper describes the construct validation of the Community College Instructional Development Inventory (CC-IDI). The CC-IDI is an institutional assessment tool designed to inform professional development programming for instructional faculty. The instrument was developed to serve as a standardized assessment tool to determine the…

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

PubMed

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Tools Available to Communities for Conducting Cumulative Exposure and Risk Assessments

EPA Science Inventory

This paper summarizes and assesses over 70 tools that could aid with gathering information and taking action on environmental issues related to community-based cumulative risk assessments (CBCRA). Information on tool use, development and research needs, was gathered from websites...

The Development of a Visual-Perceptual Chemistry Specific (VPCS) Assessment Tool

ERIC Educational Resources Information Center

Oliver-Hoyo, Maria; Sloan, Caroline

2014-01-01

The development of the Visual-Perceptual Chemistry Specific (VPCS) assessment tool is based on items that align to eight visual-perceptual skills considered as needed by chemistry students. This tool includes a comprehensive range of visual operations and presents items within a chemistry context without requiring content knowledge to solve…

BASINs and WEPP Climate Assessment Tools (CAT): Case ...

EPA Pesticide Factsheets

EPA announced the release of the final report, BASINs and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications. This report supports application of two recently developed water modeling tools, the Better Assessment Science Integrating point & Non-point Sources (BASINS) and the Water Erosion Prediction Project Climate Assessment Tool (WEPPCAT). The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments of the potential effects of climate change on streamflow and water quality. This report presents a series of short, illustrative case studies using the BASINS and WEPP climate assessment tools.

EAST: Developing an Electronic Assessment and Storage Tool.

ERIC Educational Resources Information Center

Edwards, Katherine I.; Fernandez, Eugenia; Milionis, Tracey M.; Williamson, David M.

2002-01-01

Describes the purpose, development, analysis, prototyping, and features of the Electronic Assessment and Storage Tool (EAST). The Web-based system aids curriculum assessment at Purdue School of Engineering and Technology at Indiana University Purdue University Indianapolis through the ability to easily store artifacts in electronic form, support…

Development of a music therapy assessment tool for patients in low awareness states.

PubMed

Magee, Wendy L

2007-01-01

People in low awareness states following profound brain injury typically demonstrate subtle changes in functional behaviors which challenge the sensitivity of measurement tools. Failure to identify and measure changes in functioning can lead to misdiagnosis and withdrawal of treatment with this population. Thus, the development of tools which are sensitive to responsiveness is of central concern. As the auditory modality has been found to be particularly sensitive in identifying responses indicating awareness, a convincing case can be made for music therapy as a treatment medium. However, little has been recommended about protocols for intervention or tools for measuring patient responses within the music therapy setting. This paper presents the rationale for an assessment tool specifically designed to measure responses in the music therapy setting with patients who are diagnosed as minimally conscious or in a vegetative state. Developed over fourteen years as part of interdisciplinary assessment and treatment, the music therapy assessment tool for low awareness states (MATLAS) contains fourteen items which rate behavioral responses across a number of domains. The tool can provide important information for interdisciplinary assessment and treatment particularly in the auditory and communication domains. Recommendations are made for testing its reliability and validity through research.

Development and evaluation of RAMP I - a practitioner's tool for screening of musculoskeletal disorder risk factors in manual handling.

PubMed

Lind, Carl Mikael; Forsman, Mikael; Rose, Linda Maria

2017-10-16

RAMP I is a screening tool developed to support practitioners in screening for work-related musculoskeletal disorder risk factors related to manual handling. RAMP I, which is part of the RAMP tool, is based on research-based studies combined with expert group judgments. More than 80 practitioners participated in the development of RAMP I. The tool consists of dichotomous assessment items grouped into seven categories. Acceptable reliability was found for a majority of the assessment items for 15 practitioners who were given 1 h of training. The usability evaluation points to RAMP I being usable for screening for musculoskeletal disorder risk factors, i.e., usable for assessing risks, being usable as a decision base, having clear results and that the time needed for an assessment is acceptable. It is concluded that RAMP I is a usable tool for practitioners.

A mobile phone based tool to identify symptoms of common childhood diseases in Ghana: development and evaluation of the integrated clinical algorithm in a cross-sectional study.

PubMed

Franke, Konstantin H; Krumkamp, Ralf; Mohammed, Aliyu; Sarpong, Nimako; Owusu-Dabo, Ellis; Brinkel, Johanna; Fobil, Julius N; Marinovic, Axel Bonacic; Asihene, Philip; Boots, Mark; May, Jürgen; Kreuels, Benno

2018-03-27

The aim of this study was the development and evaluation of an algorithm-based diagnosis-tool, applicable on mobile phones, to support guardians in providing appropriate care to sick children. The algorithm was developed on the basis of the Integrated Management of Childhood Illness (IMCI) guidelines and evaluated at a hospital in Ghana. Two hundred and thirty-seven guardians applied the tool to assess their child's symptoms. Data recorded by the tool and health records completed by a physician were compared in terms of symptom detection, disease assessment and treatment recommendation. To compare both assessments, Kappa statistics and predictive values were calculated. The tool detected the symptoms of cough, fever, diarrhoea and vomiting with good agreement to the physicians' findings (kappa = 0.64; 0.59; 0.57 and 0.42 respectively). The disease assessment barely coincided with the physicians' findings. The tool's treatment recommendation correlated with the physicians' assessments in 93 out of 237 cases (39.2% agreement, kappa = 0.11), but underestimated a child's condition in only seven cases (3.0%). The algorithm-based tool achieved reliable symptom detection and treatment recommendations were administered conformably to the physicians' assessment. Testing in domestic environment is envisaged.

Nutrition Environment Food Pantry Assessment Tool (NEFPAT): Development and Evaluation.

PubMed

Nikolaus, Cassandra J; Laurent, Emily; Loehmer, Emily; An, Ruopeng; Khan, Naiman; McCaffrey, Jennifer

2018-04-24

To develop and evaluate a nutrition environment assessment tool to assess the consumer nutrition environment and use of recommended practices in food pantries. The Nutrition Environment Food Pantry Assessment Tool (NEFPAT) was developed based on a literature review and guidance from professionals working with food pantries. The tool was pilot-tested at 9 food pantries, an expert panel assessed content validity, and interrater reliability was evaluated by pairs in 3 pantries. After revisions, the NEFPAT was used in 27 pantries. Pilot tests indicated positive appraisal for the NEFPAT and recommendations were addressed. The NEFPAT's 6 objectives and the overall tool were rated as content valid by experts, with an average section rating of 3.85 ± 0.10. Intraclass correlation coefficients for interrater reliability were >0.90. The NEFPAT is content valid with high interrater reliability. It provides baseline data that could be valuable for interventions within the nutrition environment of food pantries. Published by Elsevier Inc.

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

Multifactorial screening for fall risk in community-dwelling older adults in the primary care office: development of the fall risk assessment & screening tool.

PubMed

Renfro, Mindy Oxman; Fehrer, Steven

2011-01-01

Unintentional falls is an increasing public health problem as incidence of falls rises and the population ages. The Centers for Disease Control and Prevention reports that 1 in 3 adults aged 65 years and older will experience a fall this year; 20% to 30% of those who fall will sustain a moderate to severe injury. Physical therapists caring for older adults are usually engaged with these patients after the first injury fall and may have little opportunity to abate fall risk before the injuries occur. This article describes the content selection and development of a simple-to-administer, multifactorial, Fall Risk Assessment & Screening Tool (FRAST), designed specifically for use in primary care settings to identify those older adults with high fall risk. Fall Risk Assessment & Screening Tool incorporates previously validated measures within a new multifactorial tool and includes targeted recommendations for intervention. Development of the multifactorial FRAST used a 5-part process: identification of significant fall risk factors, review of best evidence, selection of items, creation of the scoring grid, and development of a recommended action plan. Fall Risk Assessment & Screening Tool has been developed to assess fall risk in the target population of older adults (older than 65 years) living and ambulating independently in the community. Many fall risk factors have been considered and 15 items selected for inclusion. Fall Risk Assessment & Screening Tool includes 4 previously validated measures to assess balance, depression, falls efficacy, and home safety. Reliability and validity studies of FRAST are under way. Fall risk for community-dwelling older adults is an urgent, multifactorial, public health problem. Providing primary care practitioners (PCPs) with a very simple screening tool is imperative. Fall Risk Assessment & Screening Tool was created to allow for safe, quick, and low-cost administration by minimally trained office staff with interpretation and follow-up provided by the PCP.

Issues in the Development of Cross-Cultural Assessments of Speech and Language for Children

ERIC Educational Resources Information Center

Carter, Julie A.; Lees, Janet A.; Murira, Gladys M.; Gona, Joseph; Neville, Brian G. R.; Newton, Charles R. J. C.

2005-01-01

Background: There is an increasing demand for the assessment of speech and language in clinical and research situations in countries where there are few assessment resources. Due to the nature of cultural variation and the potential for cultural bias, new assessment tools need to be developed or existing tools require adaptation. However, there…

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology.

PubMed

Melchiors, Jacob; Henriksen, Mikael Johannes Vuokko; Dikkers, Frederik G; Gavilán, Javier; Noordzij, J Pieter; Fried, Marvin P; Novakovic, Daniel; Fagan, Johannes; Charabi, Birgitte W; Konge, Lars; von Buchwald, Christian

2018-05-01

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. FIFTY PANELISTS COMPLETED THE DELPHI PROCESS. THE MEDIAN AGE OF THE PANELISTS WAS 44 YEARS (RANGE 33-64 YEARS). MEDIAN EXPERIENCE IN OTORHINOLARYNGOLOGY WAS 15 YEARS (RANGE 6-35 YEARS). TWENTY-FIVE WERE SPECIALIZED IN LARYNGOLOGY, 16 WERE HEAD AND NECK SURGEONS, AND NINE WERE GENERAL OTORHINOLARYNGOLOGISTS. AN ASSESSMENT TOOL WAS CREATED CONSISTING OF TWELVE DISTINCT ITEMS.: Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.

Falls risk assessment begins with hello: lessons learned from the use of one home health agency's fall risk tool.

PubMed

Flemming, Patricia J; Ramsay, Katherine

2012-10-01

Identifying older adults at risk for falls is a challenge all home healthcare agencies (HHAs) face. The process of assessing for falls risk begins with the initial home visit. One HHA affiliated with an academic medical center describes its experience in development and use of a Falls Risk Assessment (FRA) tool over a 10-year period. The FRA tool has been modified since initial development to clarify elements of the tool based on research and to reflect changes in the Outcome and Assessment Information Set (OASIS) document. The primary purpose of this article is to share a validated falls risk assessment tool to facilitate identification of fall-related risk factors in the homebound population. A secondary purpose is to share lessons learned by the HHA during the 10 years using the FRA.

The Development and Validation of the Contextualized Assessment Tool for Risk and Protection Management (CAT-RPM)

ERIC Educational Resources Information Center

Bower, Julie M.; Carroll, Annemaree; Ashman, Adrian

2014-01-01

Traditional resources for ascertaining risk and protection for disengaged youth are often unsuitable, due to the stamina and skill required to complete them. Many of these tools assess risk without considering participants' potential for personal growth. The present study outlines the development and initial validation of a tool titled the…

Issues in the development of cross-cultural assessments of speech and language for children.

PubMed

Carter, Julie A; Lees, Janet A; Murira, Gladys M; Gona, Joseph; Neville, Brian G R; Newton, Charles R J C

2005-01-01

There is an increasing demand for the assessment of speech and language in clinical and research situations in countries where there are few assessment resources. Due to the nature of cultural variation and the potential for cultural bias, new assessment tools need to be developed or existing tools require adaptation. However, there are few guidelines on how to develop 'culturally appropriate' assessment tools. To review the literature on cross-cultural assessment in order to identify the major issues in the development and adaptation of speech and language assessments for children and to illustrate these issues with practical examples from our own research programme in Kenya. Five broad categories pertaining to cross-cultural assessment development were identified: the influence of culture on performance, familiarity with the testing situation, the effect of formal education, language issues and picture recognition. It was outlined how some of these issues were addressed in our research. The results of the review were integrated to produce a list of ten guidelines highlighting the importance of collaboration with mother tongue speakers; piloting; familiar assessment materials; assessment location; and practice items and prompts. There are few clinicians and assessors, whether in the UK or abroad, who do not assess or treat children from a culture different to their own. Awareness of cultural variation and bias and cooperative efforts to develop and administer culturally appropriate assessment tools are the foundation of effective, valid treatment programmes.

BASINs and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications (Final Report)

EPA Science Inventory

EPA announced the release of the final report, BASINs and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications. This report supports application of two recently developed water modeling tools, the Better Assessment Science Integrating point & ...

The development of environmental assessment tools to support the creation of dementia friendly care environments: Innovative practice.

PubMed

Waller, Sarah; Masterson, Abigail; Evans, Simon C

2017-02-01

The need for more dementia friendly design in hospitals and other care settings is now widely acknowledged. Working with 26 NHS Trusts in England as part of a Department of Health commissioned programme, The King's Fund developed a set of overarching design principles and an environmental assessment tool for hospital wards in 2012. Following requests from other sectors, additional tools were developed for hospitals, care homes, health centres and housing with care. The tools have proven to be effective in both disseminating the principles of dementia friendly design and in enabling the case to be made for improvements that have a positive effect on patient outcomes and staff morale. This paper reports on the development, use and review of the environmental assessment tools, including further work that is now being taken forward by The Association for Dementia Studies, University of Worcester.

Development of bilingual tools to assess functional health patterns.

PubMed

Krozy, R E; McCarthy, N C

1999-01-01

The theory and process of developing bilingual assessment tools based on Gordon's 11 functional health patterns. To facilitate assessing the individual, family, and community in a student clinical practicum in a Spanish-speaking country. Multiple family and community health promotion theories; translation theories, Gordon's Manual of Nursing Diagnosis (1982); translation/back-translation involving Ecuadorian faculty and students; student community assessments; faculty and staff workshops in Ecuador. Bilingual, culturally sensitive health assessment tools facilitate history taking, establish nursing diagnoses and interventions, and promote mutual learning. These outcomes demonstrate potential application to other systems in the international nursing community.

Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Review of Currently Available Instruments

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

An extensive list of published and unpublished instruments used to investigate or evaluate sleep issues in children was collected and assessed based on the fundamental operational principles of instrument development (11 steps). Of all the available tools identified, only a few were validated and standardized using appropriate psychometric criteria. In fact, only 2 fulfill all desirable criteria and approximately 11 instruments seem to adhere to most of the psychometric tool development requirements, and were therefore assessed in greater detail. Notwithstanding, in the rapidly developing scientific world of pediatric sleep, there are too many tools being used that have not undergone careful and methodical psychometric evaluation, and as such may be fraught with biased or invalid findings. It is hoped that this initial effort in categorizing and assessing available tools for pediatric sleep will serve as recognition of the relatively early developmental stage of our field, and provide the necessary impetus for future tool development using multicentered approaches and adequate methodologies. PMID:20934896

[Tools to assess the impact on health of public health programmes and community interventions from an equity perspective].

PubMed

Suárez Álvarez, Óscar; Fernández-Feito, Ana; Vallina Crespo, Henar; Aldasoro Unamuno, Elena; Cofiño, Rafael

2018-05-11

It is essential to develop a comprehensive approach to institutionally promoted interventions to assess their impact on health from the perspective of the social determinants of health and equity. Simple, adapted tools must be developed to carry out these assessments. The aim of this paper is to present two tools to assess the impact of programmes and community-based interventions on the social determinants of health. The first tool is intended to assess health programmes through interviews and analysis of information provided by the assessment team. The second tool, by means of online assessments of community-based interventions, also enables a report on inequality issues that includes recommendations for improvement. In addition to reducing health-related social inequities, the implementation of these tools can also help to improve the efficiency of public health interventions. Copyright © 2018 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Developing a Tool for Increasing the Awareness about Gendered and Intersectional Processes in the Clinical Assessment of Patients--A Study of Pain Rehabilitation.

PubMed

Hammarström, Anne; Wiklund, Maria; Stålnacke, Britt-Marie; Lehti, Arja; Haukenes, Inger; Fjellman-Wiklund, Anncristine

2016-01-01

There is a need for tools addressing gender inequality in the everyday clinical work in health care. The aim of our paper was to develop a tool for increasing the awareness of gendered and intersectional processes in clinical assessment of patients, based on a study of pain rehabilitation. In the overarching project named "Equal care in rehabilitation" we used multiple methods (both quantitative and qualitative) in five sub studies. With a novel approach we used Grounded Theory in order to synthesize the results from our sub studies, in order to develop the gender equality tool. The gender equality tool described and developed in this article is thus based on results from sub studies about the processes of assessment and selection of patients in pain rehabilitation. Inspired by some questions in earlier tools, we posed open ended questions and inductively searched for findings and concepts relating to gendered and social selection processes in pain rehabilitation, in each of our sub studies. Through this process, the actual gender equality tool was developed as 15 questions about the process of assessing and selecting patients to pain rehabilitation. As a more comprehensive way of understanding the tool, we performed a final step of the GT analyses. Here we synthesized the results of the tool into a comprehensive model with two dimensions in relation to several possible discrimination axes. The process of assessing and selecting patients was visualized as a funnel, a top down process governed by gendered attitudes, rules and structures. We found that the clinicians judged inner and outer characteristics and status of patients in a gendered and intersectional way in the process of clinical decision-making which thus can be regarded as (potentially) biased with regard to gender, socio-economic status, ethnicity and age. The clinical implications of our tool are that the tool can be included in the systematic routine of clinical assessment of patients for both awareness raising and as a base for avoiding gender bias in clinical decision-making. The tool could also be used in team education for health professionals as an instrument for critical reflection on gender bias. Thus, tools for clinical assessment can be developed from empirical studies in various clinical settings. However, such a micro-level approach must be understood from a broader societal perspective including gender relations on both the macro- and the meso-level.

Developing a Tool for Increasing the Awareness about Gendered and Intersectional Processes in the Clinical Assessment of Patients – A Study of Pain Rehabilitation

PubMed Central

Hammarström, Anne; Wiklund, Maria; Stålnacke, Britt-Marie; Lehti, Arja; Haukenes, Inger; Fjellman-Wiklund, Anncristine

2016-01-01

Objective There is a need for tools addressing gender inequality in the everyday clinical work in health care. The aim of our paper was to develop a tool for increasing the awareness of gendered and intersectional processes in clinical assessment of patients, based on a study of pain rehabilitation. Methods In the overarching project named “Equal care in rehabilitation” we used multiple methods (both quantitative and qualitative) in five sub studies. With a novel approach we used Grounded Theory in order to synthesize the results from our sub studies, in order to develop the gender equality tool. The gender equality tool described and developed in this article is thus based on results from sub studies about the processes of assessment and selection of patients in pain rehabilitation. Inspired by some questions in earlier tools, we posed open ended questions and inductively searched for findings and concepts relating to gendered and social selection processes in pain rehabilitation, in each of our sub studies. Through this process, the actual gender equality tool was developed as 15 questions about the process of assessing and selecting patients to pain rehabilitation. As a more comprehensive way of understanding the tool, we performed a final step of the GT analyses. Here we synthesized the results of the tool into a comprehensive model with two dimensions in relation to several possible discrimination axes. Results The process of assessing and selecting patients was visualized as a funnel, a top down process governed by gendered attitudes, rules and structures. We found that the clinicians judged inner and outer characteristics and status of patients in a gendered and intersectional way in the process of clinical decision-making which thus can be regarded as (potentially) biased with regard to gender, socio-economic status, ethnicity and age. Implications The clinical implications of our tool are that the tool can be included in the systematic routine of clinical assessment of patients for both awareness raising and as a base for avoiding gender bias in clinical decision-making. The tool could also be used in team education for health professionals as an instrument for critical reflection on gender bias. Conclusions Thus, tools for clinical assessment can be developed from empirical studies in various clinical settings. However, such a micro-level approach must be understood from a broader societal perspective including gender relations on both the macro- and the meso-level. PMID:27055029

The Individual Basic Facts Assessment Tool

ERIC Educational Resources Information Center

Tait-McCutcheon, Sandi; Drake, Michael

2015-01-01

There is an identified and growing need for a levelled diagnostic basic facts assessment tool that provides teachers with formative information about students' mastery of a broad range of basic fact sets. The Individual Basic Facts Assessment tool has been iteratively and cumulatively developed, trialled, and refined with input from teachers and…

Institutional capacity for health systems research in East and Central African schools of public health: experiences with a capacity assessment tool.

PubMed

Jessani, Nasreen; Lewy, Daniela; Ekirapa-Kiracho, Elizabeth; Bennett, Sara

2014-06-02

Despite significant investments in health systems research (HSR) capacity development, there is a dearth of information regarding how to assess HSR capacity. An alliance of schools of public health (SPHs) in East and Central Africa developed a tool for the self-assessment of HSR capacity with the aim of producing institutional capacity development plans. Between June and November 2011, seven SPHs across the Democratic Republic of Congo, Ethiopia, Kenya, Rwanda, Tanzania, and Uganda implemented this co-created tool. The objectives of the institutional assessments were to assess existing capacities for HSR and to develop capacity development plans to address prioritized gaps. A mixed-method approach was employed consisting of document analysis, self-assessment questionnaires, in-depth interviews, and institutional dialogues aimed at capturing individual perceptions of institutional leadership, collective HSR skills, knowledge translation, and faculty incentives to engage in HSR. Implementation strategies for the capacity assessment varied across the SPHs. This paper reports findings from semi-structured interviews with focal persons from each SPH, to reflect on the process used at each SPH to execute the institutional assessments as well as the perceived strengths and weaknesses of the assessment process. The assessment tool was robust enough to be utilized in its entirety across all seven SPHs resulting in a thorough HSR capacity assessment and a capacity development plan for each SPH. Successful implementation of the capacity assessment exercises depended on four factors: (i) support from senior leadership and collaborators, (ii) a common understanding of HSR, (iii) adequate human and financial resources for the exercise, and (iv) availability of data. Methods of extracting information from the results of the assessments, however, were tailored to the unique objectives of each SPH. This institutional HSR capacity assessment tool and the process for its utilization may be valuable for any SPH. The self-assessments, as well as interviews with external stakeholders, provided diverse sources of input and galvanized interest around HSR at multiple levels.

Model Modules to Assist Assessing and Controlling SCC

DOT National Transportation Integrated Search

2008-04-04

This project developed and validated tools to assist in integrity assessment and management both forms of SCC. Because the understanding that underlies integrity management tools was most comprehensive for high-pH SCC, development targeted NN-pH SCC,...

Development of a decision support tool for assessing vulnerability of transportation networks.

DOT National Transportation Integrated Search

2010-08-01

This research develops a decision support tool for assessing vulnerability of transportation networks. This report consists of 1) describing the trends of freight movements in Utah, 2) identifying the current and potential freight chokepoints/bottlen...

Understanding Interrater Reliability and Validity of Risk Assessment Tools Used to Predict Adverse Clinical Events.

PubMed

Siedlecki, Sandra L; Albert, Nancy M

This article will describe how to assess interrater reliability and validity of risk assessment tools, using easy-to-follow formulas, and to provide calculations that demonstrate principles discussed. Clinical nurse specialists should be able to identify risk assessment tools that provide high-quality interrater reliability and the highest validity for predicting true events of importance to clinical settings. Making best practice recommendations for assessment tool use is critical to high-quality patient care and safe practices that impact patient outcomes and nursing resources. Optimal risk assessment tool selection requires knowledge about interrater reliability and tool validity. The clinical nurse specialist will understand the reliability and validity issues associated with risk assessment tools, and be able to evaluate tools using basic calculations. Risk assessment tools are developed to objectively predict quality and safety events and ultimately reduce the risk of event occurrence through preventive interventions. To ensure high-quality tool use, clinical nurse specialists must critically assess tool properties. The better the tool's ability to predict adverse events, the more likely that event risk is mediated. Interrater reliability and validity assessment is relatively an easy skill to master and will result in better decisions when selecting or making recommendations for risk assessment tool use.

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

A user's guide to coping with estuarine management bureaucracy: An Estuarine Planning Support System (EPSS) tool.

PubMed

Lonsdale, Jemma; Nicholson, Rose; Weston, Keith; Elliott, Michael; Birchenough, Andrew; Sühring, Roxana

2018-02-01

Estuaries are amongst the most socio-economically and ecologically important environments however, due to competing and conflicting demands, management is often challenging with a complex legislative framework managed by multiple agencies. To facilitate the understanding of this legislative framework, we have developed a GISbased Estuarine Planning Support System tool. The tool integrates the requirements of the relevant legislation and provides a basis for assessing the current environmental state of an estuary as well as informing and assessing new plans to ensure a healthy estuarine state. The tool ensures that the information is easily accessible for regulators, managers, developers and the public. The tool is intended to be adaptable, but is assessed using the Humber Estuary, United Kingdom as a case study area. The successful application of the tool for complex socio-economic and environmental systems demonstrates that the tool can efficiently guide users through the complex requirements needed to support sustainable development. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Rapid assessment of infrastructure of primary health care facilities - a relevant instrument for health care systems management.

PubMed

Scholz, Stefan; Ngoli, Baltazar; Flessa, Steffen

2015-05-01

Health care infrastructure constitutes a major component of the structural quality of a health system. Infrastructural deficiencies of health services are reported in literature and research. A number of instruments exist for the assessment of infrastructure. However, no easy-to-use instruments to assess health facility infrastructure in developing countries are available. Present tools are not applicable for a rapid assessment by health facility staff. Therefore, health information systems lack data on facility infrastructure. A rapid assessment tool for the infrastructure of primary health care facilities was developed by the authors and pilot-tested in Tanzania. The tool measures the quality of all infrastructural components comprehensively and with high standardization. Ratings use a 2-1-0 scheme which is frequently used in Tanzanian health care services. Infrastructural indicators and indices are obtained from the assessment and serve for reporting and tracing of interventions. The tool was pilot-tested in Tanga Region (Tanzania). The pilot test covered seven primary care facilities in the range between dispensary and district hospital. The assessment encompassed the facilities as entities as well as 42 facility buildings and 80 pieces of technical medical equipment. A full assessment of facility infrastructure was undertaken by health care professionals while the rapid assessment was performed by facility staff. Serious infrastructural deficiencies were revealed. The rapid assessment tool proved a reliable instrument of routine data collection by health facility staff. The authors recommend integrating the rapid assessment tool in the health information systems of developing countries. Health authorities in a decentralized health system are thus enabled to detect infrastructural deficiencies and trace the effects of interventions. The tool can lay the data foundation for district facility infrastructure management.

Frailty in trauma: A systematic review of the surgical literature for clinical assessment tools.

PubMed

McDonald, Victoria S; Thompson, Kimberly A; Lewis, Paul R; Sise, C Beth; Sise, Michael J; Shackford, Steven R

2016-05-01

Elderly trauma patients have outcomes worse than those of similarly injured younger patients. Although patient age and comorbidities explain some of the difference, the contribution of frailty to outcomes is largely unknown because of the lack of assessment tools developed specifically to assess frailty in the trauma population. This systematic review of the surgical literature identifies currently available frailty clinical assessment tools and evaluates the potential of each instrument to assess frailty in elderly patients with trauma. This review was registered with PROSPERO (the international prospective register of systematic reviews, registration number CRD42014015350). Publications in English from January 1995 to October 2014 were identified by a comprehensive search strategy in MEDLINE, EMBASE, and CINAHL, supplemented by manual screening of article bibliographies and subjected to three tiers of review. Forty-two studies reporting on frailty assessment tools were selected for analysis. Criteria for objectivity, feasibility in the trauma setting, and utility to predict trauma outcomes were formulated and used to evaluate the tools, including their subscales and individual items. Thirty-two unique frailty assessment tools were identified. Of those, 4 tools as a whole, 2 subscales, and 29 individual items qualified as objective, feasible, and useful in the clinical assessment of trauma patients. The single existing tool developed specifically to assess frailty in trauma did not meet evaluation criteria. Few frailty assessment tools in the surgical literature qualify as objective, feasible, and useful measures of frailty in the trauma population. However, a number of individual tool items and subscales could be combined to assess frailty in the trauma setting. Research to determine the accuracy of these measures and the magnitude of the contribution of frailty to trauma outcomes is needed. Systematic review, level III.

A Management Tool Kit on Training Needs Assessment and Programme Design: An Integrated Resource for Management Development in Transition Countries. Companion.

ERIC Educational Resources Information Center

European Training Foundation, Turin (Italy).

This document presents a management tool kit on training needs assessment and program design for countries in transition to a market economy. Chapter 1 describes the tool's development within the framework of the project called Strengthening of Partnership between Management Training Institutions and Companies, Ukraine-Kazakhstan-Kyrgyzstan.…

The Democritos Movement Screening Tool for Preschool Children (DEMOST-PRE©): development and factorial validity.

PubMed

Kambas, Antonis; Venetsanou, Fotini

2014-07-01

The aim of this study was (a) to develop an assessment tool (the Democritos Movement Screening Tool for Preschool Children - DEMOST-PRE), designed to provide preschool educators, clinicians and researchers with information about assessment and screening of the motor proficiency of children aged 4-6 years, as well as the development and control of movement programmes and (b) to assess its factorial validity. First, tool's content and face validity were established and its final structure was determined. Then, the DEMOST-PRE was administered to 435 children (197 girls) aged 48-71 months (M=60.48 months, SD=6.98). The factor analysis conducted revealed two distinct components. Present evidence combined with the DEMOST-PRE administrative traits make it promising for preschool aged children's assessment. Copyright © 2014 Elsevier Ltd. All rights reserved.

Technical Manual for the Conceptual Learning and Development Assessment Series II: Cutting Tool. Technical Report No. 435. Reprinted December 1977.

ERIC Educational Resources Information Center

DiLuzio, Geneva J.; And Others

This document accompanies Conceptual Learning and Development Assessment Series II: Cutting Tool, a test constructed to chart the conceptual development of individuals. As a technical manual, it contains information on the rationale, development, standardization, and reliability of the test, as well as essential information and statistical data…

Perspectives and Practices of Elementary Teachers Using an Internet-Based Formative Assessment Tool: The Case of "Assessing Mathematics Concepts"

ERIC Educational Resources Information Center

Martin, Christie S.; Polly, Drew; Wang, Chuang; Lambert, Richard G.; Pugalee, David K.

2016-01-01

This study examined the influence of professional development on elementary school teachers' perceptions of and use of an internet-based formative assessment tool focused on students' number sense skills. Data sources include teacher-participants' pre and post survey, open ended response on post survey, use of the assessment tool and their written…

Automated Geospatial Watershed Assessment (AGWA) 3.0 Software Tool

EPA Science Inventory

The Automated Geospatial Watershed Assessment (AGWA) tool has been developed under an interagency research agreement between the U.S. Environmental Protection Agency, Office of Research and Development, and the U.S. Department of Agriculture, Agricultural Research Service. AGWA i...

Evaluating a standardised clinical assessment tool for pre-registration midwifery students: A cross-sectional survey of midwifery students and midwives in Australia.

PubMed

Morrow, Jane; Biggs, Laura; Stelfox, Sara; Phillips, Diane; McKellar, Lois; McLachlan, Helen

2016-02-01

Assessment of clinical competence is a core component of midwifery education. Clinical assessment tools have been developed to help increase consistency and overcome subjectivity of assessment. The study had two main aims. The first was to explore midwifery students and educators/clinical midwives' views and experiences of a common clinical assessment tool used for all preregistration midwifery programmes in Victoria and the University of South Australia. The second was to assess the need for changes to the tool to align with developments in clinical practice and evidence-based care. A cross-sectional, web-based survey including Likert-type scales and open-ended questions was utilised. Students enrolled in all four entry pathways to midwifery at seven Victorian and one South Australian university and educators/clinical midwives across both states. One hundred and ninety-one midwifery students' and 86 educators/clinical midwives responded. Overall, students and educators/clinical midwives were positive about the Clinical Assessment Tool with over 90% reporting that it covered the necessary midwifery skills. Students and educators/clinical midwives reported high levels of satisfaction with the content of the learning tools. Only 4% of educators/clinical midwives and 6% of students rated the Clinical Assessment Tool as poor overall. Changes to some learning tools were necessary in order to reflect recent practice and evidence. A common clinical assessment tool for evaluating midwifery students' clinical practice may facilitate the provision of consistent, reliable and objective assessment of student skills and competency. Copyright © 2015 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

Tool development to assess the work related neck and upper limb musculoskeletal disorders among female garment workers in Sri-Lanka.

PubMed

Amarasinghe, Nirmalie Champika; De AlwisSenevirathne, Rohini

2016-10-17

Musculoskeletal disorders (MSDs) have been identified as a predisposing factor for lesser productivity, but no validated tool has been developed to assess them in the Sri- Lankan context. To develop a validated tool to assess the neck and upper limb MSDs. It comprises three components: item selections, item reduction using principal component analysis, and validation. A tentative self-administrated questionnaire was developed, translated, and pre-tested. Four important domains - neck, shoulder, elbow and wrist - were identified through principal component analysis. Prevalence of any MSDs was 38.1% and prevalence of neck, shoulder, elbow and wrist MSDs are 12.85%, 13.71%, 12%, 13.71% respectively. Content and criterion validity of the tool was assessed. Separate ROC curves were produced and sensitivity and specificity of neck (83.1%, 71.7%), shoulder (97.6%, 91.9%), elbow (98.2%, 87.2%), and wrist (97.6%, 94.9%) was determined. Cronbach's Alpha and correlation coefficient was above 0.7. The tool has high sensitivity, specificity, internal consistency, and test re-test reliability.

Development, initial reliability and validity testing of an observational tool for assessing technical skills of operating room nurses.

PubMed

Sevdalis, Nick; Undre, Shabnam; Henry, Janet; Sydney, Elaine; Koutantji, Mary; Darzi, Ara; Vincent, Charles A

2009-09-01

The recent emergence of the Systems Approach to the safety and quality of surgical care has triggered individual and team skills training modules for surgeons and anaesthetists and relevant observational assessment tools have been developed. To develop an observational tool that captures operating room (OR) nurses' technical skill and can be used for assessment and training. The Imperial College Assessment of Technical Skills for Nurses (ICATS-N) assesses (i) gowning and gloving, (ii) setting up instrumentation, (iii) draping, and (iv) maintaining sterility. Three to five observable behaviours have been identified for each skill and are rated on 1-6 scales. Feasibility and aspects of reliability and validity were assessed in 20 simulation-based crisis management training modules for trainee nurses and doctors, carried out in a Simulated Operating Room. The tool was feasible to use in the context of simulation-based training. Satisfactory reliability (Cronbach alpha) was obtained across trainers' and trainees' scores (analysed jointly and separately). Moreover, trainer nurse's ratings of the four skills correlated positively, thus indicating adequate content validity. Trainer's and trainees' ratings did not correlate. Assessment of OR nurses' technical skill is becoming a training priority. The present evidence suggests that the ICATS-N could be considered for use as an assessment/training tool for junior OR nurses.

A Standards-Based Grading and Reporting Tool for Faculty: Design and Implications

ERIC Educational Resources Information Center

Sadik, Alaa M.

2011-01-01

The use of standard-based assessment, grading and reporting tools is essential to ensure that assessment meets acceptable levels of quality and standardization. This study reports the design, development and evaluation of a standards-based assessment tool for the instructors at Sultan Qaboos University, Sultanate of Oman. The Rapid Applications…

Early Learning Assessment Innovation in South Africa: A Locally Appropriate Monitoring Tool

ERIC Educational Resources Information Center

Dawes, Andrew; Biersteker, Linda; Girdwood, Elizabeth; Snelling, Matthew; Tredoux, C. G.

2018-01-01

In 2015, Innovation Edge commissioned the development of South Africa's first national-level preschool child assessment tool. The project's key innovations were that the tool should fairly assess children from across the cultural and socio-economic spectrum, be inexpensive in terms of equipment and administration costs, and be administered in…

Design and validation of a three-instrument toolkit for the assessment of competence in electrocardiogram rhythm recognition.

PubMed

Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano

2017-06-01

Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in electrocardiogram rhythm recognition.

Measuring New Media Literacies: Towards the Development of a Comprehensive Assessment Tool

ERIC Educational Resources Information Center

Literat, Ioana

2014-01-01

This study assesses the psychometric properties of a newly tested self-report assessment tool for media literacy, based on the twelve new media literacy skills (NMLs) developed by Jenkins et al. (2006). The sample (N = 327) consisted of normal volunteers who completed a comprehensive online survey that measured their NML skills, media exposure,…

Crash Attenuator Data Collection and Life Cycle Tool Development

DOT National Transportation Integrated Search

2014-06-14

This research study was aimed at data collection and development of a decision support tool for life cycle cost assessment of crash attenuators. Assessing arrenuator life cycle costs based on in-place expected costs and not just the initial cost enha...

Assessing the complexity of interventions within systematic reviews: development, content and use of a new tool (iCAT_SR).

PubMed

Lewin, Simon; Hendry, Maggie; Chandler, Jackie; Oxman, Andrew D; Michie, Susan; Shepperd, Sasha; Reeves, Barnaby C; Tugwell, Peter; Hannes, Karin; Rehfuess, Eva A; Welch, Vivien; Mckenzie, Joanne E; Burford, Belinda; Petkovic, Jennifer; Anderson, Laurie M; Harris, Janet; Noyes, Jane

2017-04-26

Health interventions fall along a spectrum from simple to more complex. There is wide interest in methods for reviewing 'complex interventions', but few transparent approaches for assessing intervention complexity in systematic reviews. Such assessments may assist review authors in, for example, systematically describing interventions and developing logic models. This paper describes the development and application of the intervention Complexity Assessment Tool for Systematic Reviews (iCAT_SR), a new tool to assess and categorise levels of intervention complexity in systematic reviews. We developed the iCAT_SR by adapting and extending an existing complexity assessment tool for randomized trials. We undertook this adaptation using a consensus approach in which possible complexity dimensions were circulated for feedback to a panel of methodologists with expertise in complex interventions and systematic reviews. Based on these inputs, we developed a draft version of the tool. We then invited a second round of feedback from the panel and a wider group of systematic reviewers. This informed further refinement of the tool. The tool comprises ten dimensions: (1) the number of active components in the intervention; (2) the number of behaviours of recipients to which the intervention is directed; (3) the range and number of organizational levels targeted by the intervention; (4) the degree of tailoring intended or flexibility permitted across sites or individuals in applying or implementing the intervention; (5) the level of skill required by those delivering the intervention; (6) the level of skill required by those receiving the intervention; (7) the degree of interaction between intervention components; (8) the degree to which the effects of the intervention are context dependent; (9) the degree to which the effects of the interventions are changed by recipient or provider factors; (10) and the nature of the causal pathway between intervention and outcome. Dimensions 1-6 are considered 'core' dimensions. Dimensions 7-10 are optional and may not be useful for all interventions. The iCAT_SR tool facilitates more in-depth, systematic assessment of the complexity of interventions in systematic reviews and can assist in undertaking reviews and interpreting review findings. Further testing of the tool is now needed.

Computer assisted blast design and assessment tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cameron, A.R.; Kleine, T.H.; Forsyth, W.W.

1995-12-31

In general the software required by a blast designer includes tools that graphically present blast designs (surface and underground), can analyze a design or predict its result, and can assess blasting results. As computers develop and computer literacy continues to rise the development of and use of such tools will spread. An example of the tools that are becoming available includes: Automatic blast pattern generation and underground ring design; blast design evaluation in terms of explosive distribution and detonation simulation; fragmentation prediction; blast vibration prediction and minimization; blast monitoring for assessment of dynamic performance; vibration measurement, display and signal processing;more » evaluation of blast results in terms of fragmentation; and risk and reliability based blast assessment. The authors have identified a set of criteria that are essential in choosing appropriate software blasting tools.« less

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations.

PubMed

Timmings, Caitlyn; Khan, Sobia; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Straus, Sharon E

2016-02-24

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation. A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability. Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool . Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.

Part 1: Pressure ulcer assessment - the development of Critical Care Pressure Ulcer Assessment Tool made Easy (CALCULATE).

PubMed

Richardson, Annette; Barrow, Isabel

2015-11-01

Critically ill patients are at high risk of developing pressure ulcers resulting in serious untoward patient and health care system outcomes. Pressure ulcer prevention is therefore an important patient safety priority and establishing a structured approach to pressure ulcer risk assessment to identify patients at risk is a critical first step. The literature was searched using three electronic databases from 2000 to 2011 to identify papers reporting on pressure ulcer risk factors and assessment in adult critical care. The review and appraisal of papers were conducted by two critical care nurses. Papers underwent detailed review if they met inclusion criteria where they identified pressure ulcer assessment scores, scales or risk factors and related to adult critical care patients Seven papers were reviewed. No single assessment tool was sufficiently validated for critically ill patients and seven key critical care risk factors were identified. These risk factors were: mechanical ventilation, impaired circulation, dialysis, long surgery, low protein and too unstable to turn. The tool Critical Care Pressure Ulcer Assessment Tool made Easy (CALCULATE) was developed utilizing the risk factors from the literature and expert critical care nursing consensus decision-making. In the absence of current consensus, valid assessment scales and limited evidence for the most appropriate pressure ulcer assessment for critically ill patients, this assessment tool offers an easy, appropriate alternative for critically ill patients than existing tools primarily validated for acute care wards. 'CALCULATE' offers an important contribution towards the advancement and development of critical care pressure ulcer risk assessment. Future research is needed to further enhance and inform pressure ulcer risk assessment of the critically ill patients. The identification of critical care risk factors may be an indicative method of assessing pressure ulcer risk in the critically ill patients. © 2015 British Association of Critical Care Nurses.

Development and validation of a risk assessment tool for gastric cancer in a general Japanese population.

PubMed

Iida, Masahiro; Ikeda, Fumie; Hata, Jun; Hirakawa, Yoichiro; Ohara, Tomoyuki; Mukai, Naoko; Yoshida, Daigo; Yonemoto, Koji; Esaki, Motohiro; Kitazono, Takanari; Kiyohara, Yutaka; Ninomiya, Toshiharu

2018-05-01

There have been very few reports of risk score models for the development of gastric cancer. The aim of this study was to develop and validate a risk assessment tool for discerning future gastric cancer risk in Japanese. A total of 2444 subjects aged 40 years or over were followed up for 14 years from 1988 (derivation cohort), and 3204 subjects of the same age group were followed up for 5 years from 2002 (validation cohort). The weighting (risk score) of each risk factor for predicting future gastric cancer in the risk assessment tool was determined based on the coefficients of a Cox proportional hazards model in the derivation cohort. The goodness of fit of the established risk assessment tool was assessed using the c-statistic and the Hosmer-Lemeshow test in the validation cohort. During the follow-up, gastric cancer developed in 90 subjects in the derivation cohort and 35 subjects in the validation cohort. In the derivation cohort, the risk prediction model for gastric cancer was established using significant risk factors: age, sex, the combination of Helicobacter pylori antibody and pepsinogen status, hemoglobin A1c level, and smoking status. The incidence of gastric cancer increased significantly as the sum of risk scores increased (P trend < 0.001). The risk assessment tool was validated internally and showed good discrimination (c-statistic = 0.76) and calibration (Hosmer-Lemeshow test P = 0.43) in the validation cohort. We developed a risk assessment tool for gastric cancer that provides a useful guide for stratifying an individual's risk of future gastric cancer.

Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools

PubMed Central

Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

2009-01-01

The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child’s physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools’ usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool’s test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool’s normative data samples would benefit from frequent movement skill performance follow-up of today’s children. Abbreviations MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: Körper-Koordinationtest für Kinder, TGDM: Test of Gross Motor Development, MMT: Maastrichtse Motoriektest, BOTMP: Bruininks-Oseretsky Test of Motor Proficiency. ICC: intraclass correlation coefficient, NR: not reported, GM: gross motor, LV: long version, SV: short version, LF: long form, SF: short form, STV: subtest version, SEMs: standard errors of measurement, TMQ: Total Motor Quotient, TMC: Total Motor Composite, CSSA: Comprehensive Scales of Student Abilities MSEL: Mullen Scales of Early learning: AGS Edition AUC: Areas under curve BC: Battery composite ROC: Receiver operating characteristic PMID:24149522

Operational Assessment of Tools for Accelerating Leader Development (ALD): Volume 2, Appendices

DTIC Science & Technology

2009-06-01

Qual Qualitative Quant Quantitative RC Reserve Component R&D Research and Development re: reference reqts requirements ROTC Reserve Officer...part in the Accelerating Leader Development program, please complete the Pretest , Training, and Posttest . Of course, you may complete the longer...ARI Research Note 2009-09 Operational Assessment of Tools for Accelerating Leader Development (ALD): Volume II, Appendices Bruce

Assessment Tools' Indicators for Sustainability in Universities: An Analytical Overview

ERIC Educational Resources Information Center

Alghamdi, Naif; den Heijer, Alexandra; de Jonge, Hans

2017-01-01

Purpose: The purpose of this paper is to analyse 12 assessment tools of sustainability in universities and develop the structure and the contents of these tools to be more intelligible. The configuration of the tools reviewed highlight indicators that clearly communicate only the essential information. This paper explores how the theoretical…

Measuring laboratory-based influenza surveillance capacity: development of the 'International Influenza Laboratory Capacity Review' Tool.

PubMed

Muir-Paulik, S A; Johnson, L E A; Kennedy, P; Aden, T; Villanueva, J; Reisdorf, E; Humes, R; Moen, A C

2016-01-01

The 2005 International Health Regulations (IHR 2005) emphasized the importance of laboratory capacity to detect emerging diseases including novel influenza viruses. To support IHR 2005 requirements and the need to enhance influenza laboratory surveillance capacity, the Association of Public Health Laboratories (APHL) and the Centers for Disease Control and Prevention (CDC) Influenza Division developed the International Influenza Laboratory Capacity Review (Tool). Data from 37 assessments were reviewed and analyzed to verify that the quantitative analysis results accurately depicted a laboratory's capacity and capabilities. Subject matter experts in influenza and laboratory practice used an iterative approach to develop the Tool incorporating feedback and lessons learnt through piloting and implementation. To systematically analyze assessment data, a quantitative framework for analysis was added to the Tool. The review indicated that changes in scores consistently reflected enhanced or decreased capacity. The review process also validated the utility of adding a quantitative analysis component to the assessments and the benefit of establishing a baseline from which to compare future assessments in a standardized way. Use of the Tool has provided APHL, CDC and each assessed laboratory with a standardized analysis of the laboratory's capacity. The information generated is used to improve laboratory systems for laboratory testing and enhance influenza surveillance globally. We describe the development of the Tool and lessons learnt. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

The impact of illiteracy on the assessment of cognition and dementia: a critical issue in the developing countries.

PubMed

Noroozian, Maryam; Shakiba, Alia; Iran-nejad, Shahrzad

2014-12-01

Dementia and Alzheimer's disease (AD) is considered a major public health challenge in this decade and in the future. Early detection of AD through appropriate screening tools would be valuable approach in facing the burden of disease specifically in developing societies with insufficient resources. Selecting a screening tool which is non-expensive, non-invasive and implementable by trained primary healthcare providers is the first and probably the most important step in detecting high risk individuals. The goal of this review is to address the key issues in assessment tools in developing countries with a high level of illiteracy. We set about a review on literature on the subject of cognitive function assessment among minorities, people with low or no education, and people who live in underdeveloped societies. We also reviewed the studies on validation of such tests in a new society. The most popular assessment tools are more or less biased by the level of education; not all of them are useful for any type of dementia as they assess only some domains of cognitive function. Even though people with lower level of education have a higher rate of developing dementia, cognitive function cannot be accurately assessed because of limitations of current available tools. It is strongly suggested that special attention be paid to assess them by functional scales and activity daily living scales. For a more efficient assessment, cognitive tests can also benefit from illustrative questions, proverbs, metaphors, traditions, religious rituals and historical events.

GEOGLAM Crop Assessment Tool: Adapting from global agricultural monitoring to food security monitoring

NASA Astrophysics Data System (ADS)

Humber, M. L.; Becker-Reshef, I.; Nordling, J.; Barker, B.; McGaughey, K.

2014-12-01

The GEOGLAM Crop Monitor's Crop Assessment Tool was released in August 2013 in support of the GEOGLAM Crop Monitor's objective to develop transparent, timely crop condition assessments in primary agricultural production areas, highlighting potential hotspots of stress/bumper crops. The Crop Assessment Tool allows users to view satellite derived products, best available crop masks, and crop calendars (created in collaboration with GEOGLAM Crop Monitor partners), then in turn submit crop assessment entries detailing the crop's condition, drivers, impacts, trends, and other information. Although the Crop Assessment Tool was originally intended to collect data on major crop production at the global scale, the types of data collected are also relevant to the food security and rangelands monitoring communities. In line with the GEOGLAM Countries at Risk philosophy of "foster[ing] the coordination of product delivery and capacity building efforts for national and regional organizations, and the development of harmonized methods and tools", a modified version of the Crop Assessment Tool is being developed for the USAID Famine Early Warning Systems Network (FEWS NET). As a member of the Countries at Risk component of GEOGLAM, FEWS NET provides agricultural monitoring, timely food security assessments, and early warnings of potential significant food shortages focusing specifically on countries at risk of food security emergencies. While the FEWS NET adaptation of the Crop Assessment Tool focuses on crop production in the context of food security rather than large scale production, the data collected is nearly identical to the data collected by the Crop Monitor. If combined, the countries monitored by FEWS NET and GEOGLAM Crop Monitor would encompass over 90 countries representing the most important regions for crop production and food security.

Developing an Evaluation Tool for Assessing Clinical Ethics Consultation Skills in Simulation Based Education: The ACES Project.

PubMed

Wasson, Katherine; Parsi, Kayhan; McCarthy, Michael; Siddall, Viva Jo; Kuczewski, Mark

2016-06-01

The American Society for Bioethics and Humanities has created a quality attestation (QA) process for clinical ethics consultants; the pilot phase of reviewing portfolios has begun. One aspect of the QA process which is particularly challenging is assessing the interpersonal skills of individual clinical ethics consultants. We propose that using case simulation to evaluate clinical ethics consultants is an approach that can meet this need provided clear standards for assessment are identified. To this end, we developed the Assessing Clinical Ethics Skills (ACES) tool, which identifies and specifies specific behaviors that a clinical ethics consultant should demonstrate in an ethics case simulation. The aim is for the clinical ethics consultant or student to use a videotaped case simulation, along with the ACES tool scored by a trained rater, to demonstrate their competence as part of their QA portfolio. The development and piloting of the tool is described.

Developing a uniformed assessment tool to evaluate care service needs for disabled persons in Japan.

PubMed

Takei, Teiji; Takahashi, Hiroshi; Nakatani, Hiroki

2008-05-01

Until recently, the care services for disabled persons have been under rigid control by public sectors in terms of provision and funding in Japan. A reform was introduced in 2003 that brought a rapid increase of utilization of services and serious shortage of financial resources. Under these circumstances, the "Services and Supports for Persons with Disabilities Act" was enacted in 2005, requiring that the care service provision process should be transparent, fair and standardized. The purpose of this study is to develop an objective tool for assessing the need for disability care. In the present study we evaluate 1423 cases of patients receiving care services in 60 municipalities, including all three categories of disabilities (physical, intellectual and mental). Using the data of the total 106 items, we conducted factor analysis and regression analysis to develop an assessment tool for people with disabilities. The data revealed that instrumental activities of daily living (IADL) played an essential role in assessing disability levels. We have developed the uniformed assessment tool that has been utilized to guide the types and quantity of care services throughout Japan.

An international road map to improve pain assessment in people with impaired cognition: the development of the Pain Assessment in Impaired Cognition (PAIC) meta-tool.

PubMed

Corbett, Anne; Achterberg, Wilco; Husebo, Bettina; Lobbezoo, Frank; de Vet, Henrica; Kunz, Miriam; Strand, Liv; Constantinou, Marios; Tudose, Catalina; Kappesser, Judith; de Waal, Margot; Lautenbacher, Stefan

2014-12-10

Pain is common in people with dementia, yet identification is challenging. A number of pain assessment tools exist, utilizing observation of pain-related behaviours, vocalizations and facial expressions. Whilst they have been developed robustly, these often lack sufficient evidence of psychometric properties, like reliability, face and construct validity, responsiveness and usability, and are not internationally implemented. The EU-COST initiative "Pain in impaired cognition, especially dementia" aims to combine the expertise of clinicians and researchers to address this important issue by building on previous research in the area, identifying existing pain assessment tools for dementia, and developing consensus for items for a new universal meta-tool for use in research and clinical settings. This paper reports on the initial phase of this collaboration task. All existing observational pain behaviour tools were identified and elements categorised using a three-step reduction process. Selection and refinement of items for the draft Pain Assessment in Impaired Cognition (PAIC) meta-tool was achieved through scrutiny of the evidence, consensus of expert opinion, frequency of use and alignment with the American Geriatric Society guidelines. The main aim of this process was to identify key items with potential empirical, rather than theoretical value to take forward for testing. 12 eligible assessment tools were identified, and pain items categorised according to behaviour, facial expression and vocalisation according to the AGS guidelines (Domains 1 - 3). This has been refined to create the PAIC meta-tool for validation and further refinement. A decision was made to create a supporting comprehensive toolkit to support the core assessment tool to provide additional resources for the assessment of overlapping symptoms in dementia, including AGS domains four to six, identification of specific types of pain and assessment of duration and location of pain. This multidisciplinary, cross-cultural initiative has created a draft meta-tool for capturing pain behaviour to be used across languages and culture, based on the most promising items used in existing tools. The draft PAIC meta-tool will now be taken forward for evaluation according to COSMIN guidelines and the EU-COST protocol in order to exclude invalid items, refine included items and optimise the meta-tool.

Assessment Tool Development for Extracurricular Smet Programs for Girls

NASA Astrophysics Data System (ADS)

House, Jody; Johnson, Molly; Borthwick, Geoffrey

Many different programs have been designed to increase girls' interest in and exposure to science, mathematics, engineering, and technology (SMET). Two of these programs are discussed and contrasted in the dimensions of length, level of science content, pedagogical approach, degree of self- vs. parent-selected participants, and amount of communitybuilding content. Two different evaluation tools were used. For one program, a modified version of the University of Pittsburgh's undergraduate engineering attitude assessment survey was used. Program participants' responses were compared to those from a fifth grade, mixed-sex science class. The only gender difference found was in the area of parental encouragement. The girls in the special class were more encouraged to participate in SMET areas. For the second program, a new age-appropriate tool developed specifically for these types of programs was used, and the tool itself was evaluated. The results indicate that the new tool has construct validity. On the basis of these preliminary results, a long-term plan for the continued development of the assessment tool is outlined.

Children's estimates of food portion size: the development and evaluation of three portion size assessment tools for use with children.

PubMed

Foster, E; Matthews, J N S; Lloyd, J; Marshall, L; Mathers, J C; Nelson, M; Barton, K L; Wrieden, W L; Cornelissen, P; Harris, J; Adamson, A J

2008-01-01

A number of methods have been developed to assist subjects in providing an estimate of portion size but their application in improving portion size estimation by children has not been investigated systematically. The aim was to develop portion size assessment tools for use with children and to assess the accuracy of children's estimates of portion size using the tools. The tools were food photographs, food models and an interactive portion size assessment system (IPSAS). Children (n 201), aged 4-16 years, were supplied with known quantities of food to eat, in school. Food leftovers were weighed. Children estimated the amount of each food using each tool, 24 h after consuming the food. The age-specific portion sizes represented were based on portion sizes consumed by children in a national survey. Significant differences were found between the accuracy of estimates using the three tools. Children of all ages performed well using the IPSAS and food photographs. The accuracy and precision of estimates made using the food models were poor. For all tools, estimates of the amount of food served were more accurate than estimates of the amount consumed. Issues relating to reporting of foods left over which impact on estimates of the amounts of foods actually consumed require further study. The IPSAS has shown potential for assessment of dietary intake with children. Before practical application in assessment of dietary intake of children the tool would need to be expanded to cover a wider range of foods and to be validated in a 'real-life' situation.

Computer-aided system design

NASA Technical Reports Server (NTRS)

Walker, Carrie K.

1991-01-01

A technique has been developed for combining features of a systems architecture design and assessment tool and a software development tool. This technique reduces simulation development time and expands simulation detail. The Architecture Design and Assessment System (ADAS), developed at the Research Triangle Institute, is a set of computer-assisted engineering tools for the design and analysis of computer systems. The ADAS system is based on directed graph concepts and supports the synthesis and analysis of software algorithms mapped to candidate hardware implementations. Greater simulation detail is provided by the ADAS functional simulator. With the functional simulator, programs written in either Ada or C can be used to provide a detailed description of graph nodes. A Computer-Aided Software Engineering tool developed at the Charles Stark Draper Laboratory (CSDL CASE) automatically generates Ada or C code from engineering block diagram specifications designed with an interactive graphical interface. A technique to use the tools together has been developed, which further automates the design process.

The Development of a Conceptual Framework and Tools to Assess Undergraduates' Principled Use of Models in Cellular Biology

ERIC Educational Resources Information Center

Richmond, Gail; Merritt, Brett; Urban-Lurain, Mark; Parker, Joyce

2010-01-01

Recent science education reform has been marked by a shift away from a focus on facts toward deep, rich, conceptual understanding. This requires assessment that also focuses on conceptual understanding rather than recall of facts. This study outlines our development of a new assessment framework and tool--a taxonomy--which, unlike existing…

Classroom Research: Assessment of Student Understanding of Sampling Distributions of Means and the Central Limit Theorem in Post-Calculus Probability and Statistics Classes

ERIC Educational Resources Information Center

Lunsford, M. Leigh; Rowell, Ginger Holmes; Goodson-Espy, Tracy

2006-01-01

We applied a classroom research model to investigate student understanding of sampling distributions of sample means and the Central Limit Theorem in post-calculus introductory probability and statistics courses. Using a quantitative assessment tool developed by previous researchers and a qualitative assessment tool developed by the authors, we…

Toolbox of assessment tools of technical skills in otolaryngology-head and neck surgery: A systematic review.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2017-10-08

To support the development of programs of assessment of technical skills in the operating room (OR), we systematically reviewed the literature to identify assessment tools specific to otolaryngology-head and neck surgery (OTL-HNS) core procedures and summarized their characteristics. We systematically searched Embase, MEDLINE, PubMed, and Cochrane to identify and report on assessment tools that can be used to assess residents' technical surgical skills in the operating room for OTL-HNS core procedures. Of the 736 unique titles retrieved, 16 articles met inclusion criteria, covering 11 different procedures (in otology, rhinology, laryngology, head and neck, and general otolaryngology). The tools were composed of a task-specific checklist and/or global rating scale and were developed in the OR, on human cadavers, or in a simulation setting. Our study reports on published tools for assessing technical skills for OTL-HNS residents during core procedures conducted in the OR. These assessment tools could facilitate the provision of timely feedback to trainees including specific goals for improvement. However, the paucity of publications suggests little agreement on how to best perform work-based direct-observation assessment for core surgical procedures in OTL-HNS. The sparsity of tools specific to OTL-HNS may become a barrier to a fluid transition to competency-based medical education. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Employability Skills Assessment Tool Development

ERIC Educational Resources Information Center

Rasul, Mohamad Sattar; Rauf, Rose Amnah Abd; Mansor, Azlin Norhaini; Puvanasvaran, A. P.

2012-01-01

Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

Systematic Review: Concept and Tool Development with Application in the Integrated Risk Information System (IRIS) Assessment Process

EPA Science Inventory

Systematic Review: Concept and tool development with application to the National Toxicology Program (NTP) and the Integrated Risk Information System (IRIS) Assessment Processes. There is growing interest within the environmental health community to incorporate systematic review m...

Developing an SSAC Self-Assessment Tool for Operators and Regulators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Frazar, Sarah L.; Innes-Jones, Gemma; Hamilton, Ian

Enabling an SSAC to understand why it is performing inefficiently can help it allocate resources more effectively to better support IAEA safeguards implementation. In collaboration with international consulting firm, Environmental Resources Management (ERM) and a U.S. based nuclear fuel cycle facility, the Pacific Northwest National Laboratory (PNNL) has been developing a framework for a future self-assessment tool for nuclear operators and regulators. This paper will describe the effort to date, with particular emphasis on the steps the team took to align the framework with relevant IAEA self-assessment tools.

STOPDVTs: Development and testing of a clinical assessment tool to guide nursing assessment of postoperative patients for Deep Vein Thrombosis.

PubMed

O'Brien, Alanna; Redley, Bernice; Wood, Beverley; Botti, Mari; Hutchinson, Anastasia F

2018-03-01

To develop and test a clinical tool to guide nurses' assessment of postoperative patients for Deep Vein Thrombosis. Preventing venous thromboembolism in hospitalised patients is an international patient safety priority. Despite high-level evidence for optimal venous thromboembolism prophylaxis, implementation is inconsistent and the incidence of Deep Vein Thrombosis remains high. A two-stage sequential multi-method design was used. In stage 1, the STOPDVTs tool was developed using a review of the literature and focus groups with local clinical experts. Stage 2 involved pilot testing the tool with 38 surgical nurses who conducted repeated assessments on a prospective sample of 50 postoperative orthopaedic patients. Stage 1: The focus group members who were members of the nursing leadership team agreed on eight local and systemic signs and symptoms that should be included in a nursing patient assessment tool for early Deep Vein Thrombosis. Local symptoms were pain in the limbs, calf swelling and tightness, changes in the affected limb's skin temperature. Systemic signs included in the tool were as follows: increased shortness of breath, increased respiratory and heart rates, and decreased oxygen saturation. Stage 2: The STOPDVTs tool had acceptable face and content validity, the agreement between the expert nurse and surgical nurses on assessments of individual signs and symptoms varied between 44%-94%. Surgical nurses were less likely than the expert nurse to identify signs indicative of Deep Vein Thrombosis. Despite finding the STOPDVTs clinical assessment tool was a useful guide for nursing assessment, surgical nurses often underestimated the potential importance of clinical signs. The findings reveal a gap in nursing knowledge and skill in assessing for Deep Vein Thrombosis in postoperative orthopaedic patients. This study identified a possible risk to patient safety related to under-recognition of the signs and symptoms of possible Deep Vein Thrombosis (DVT) in postoperative orthopaedic patients. The findings demonstrate the feasibility of developing and implementing a protocol for consistent screening by nurses for possible DVT in the postoperative period. © 2018 John Wiley & Sons Ltd.

[Contributions of child psychology to the assessment of pain].

PubMed

Zabalia, M

2009-12-01

The efficacy of pain management is subordinated to the efficacy of pain assessment. Children are particularly difficult-to-assess patients. In this area, child psychology can contribute to the development of tools and to improving pain assessment. This paper highlights the relevance of studies on dialog in pain assessment situations and the importance of the specificity of both the patient and his pain. Assessing pain and listening to the patient's complaint means meeting the child in his own world. Nonetheless, it is necessary to use and develop assessment tools that are scientifically validated.

A critical review of seven selected neighborhood sustainability assessment tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sharifi, Ayyoob, E-mail: sharifi.ayyoob@a.mbox.nagoya-u.ac.jp; Murayama, Akito, E-mail: murayama@corot.nuac.nagoya-u.ac.jp

2013-01-15

Neighborhood sustainability assessment tools have become widespread since the turn of 21st century and many communities, mainly in the developed world, are utilizing these tools to measure their success in approaching sustainable development goals. In this study, seven tools from Australia, Europe, Japan, and the United States are selected and analyzed with the aim of providing insights into the current situations; highlighting the strengths, weaknesses, successes, and failures; and making recommendations for future improvements. Using a content analysis, the issues of sustainability coverage, pre-requisites, local adaptability, scoring and weighting, participation, reporting, and applicability are discussed in this paper. The resultsmore » of this study indicate that most of the tools are not doing well regarding the coverage of social, economic, and institutional aspects of sustainability; there are ambiguities and shortcomings in the weighting, scoring, and rating; in most cases, there is no mechanism for local adaptability and participation; and, only those tools which are embedded within the broader planning framework are doing well with regard to applicability. - Highlights: Black-Right-Pointing-Pointer Seven widely used assessment tools were analyzed. Black-Right-Pointing-Pointer There is a lack of balanced assessment of sustainability dimensions. Black-Right-Pointing-Pointer Tools are not doing well regarding the applicability. Black-Right-Pointing-Pointer Refinements are needed to make the tools more effective. Black-Right-Pointing-Pointer Assessment tools must be integrated into the planning process.« less

A New Disability-related Health Care Needs Assessment Tool for Persons With Brain Disorders

PubMed Central

Kim, Yoon; Eun, Sang June; Kim, Wan Ho; Lee, Bum-Suk; Leigh, Ja-Ho; Kim, Jung-Eun

2013-01-01

Objectives This study aimed to develop a health needs assessment (HNA) tool for persons with brain disorders and to assess the unmet needs of persons with brain disorders using the developed tool. Methods The authors used consensus methods to develop a HNA tool. Using a randomized stratified systematic sampling method adjusted for sex, age, and districts, 57 registered persons (27 severe and 30 mild cases) with brain disorders dwelling in Seoul, South Korea were chosen and medical specialists investigated all of the subjects with the developed tools. Results The HNA tool for brain disorders we developed included four categories: 1) medical interventions and operations, 2) assistive devices, 3) rehabilitation therapy, and 4) regular follow-up. This study also found that 71.9% of the subjects did not receive appropriate medical care, which implies that the severity of their disability is likely to be exacerbated and permanent, and the loss irrecoverable. Conclusions Our results showed that the HNA tool for persons with brain disorders based on unmet needs defined by physicians can be a useful method for evaluating the appropriateness and necessity of medical services offered to the disabled, and it can serve as the norm for providing health care services for disabled persons. Further studies should be undertaken to increase validity and reliability of the tool. Fundamental research investigating the factors generating or affecting the unmet needs is necessary; its results could serve as basis for developing policies to eliminate or alleviate these factors. PMID:24137530

A new disability-related health care needs assessment tool for persons with brain disorders.

PubMed

Kim, Yoon; Eun, Sang June; Kim, Wan Ho; Lee, Bum-Suk; Leigh, Ja-Ho; Kim, Jung-Eun; Lee, Jin Yong

2013-09-01

This study aimed to develop a health needs assessment (HNA) tool for persons with brain disorders and to assess the unmet needs of persons with brain disorders using the developed tool. The authors used consensus methods to develop a HNA tool. Using a randomized stratified systematic sampling method adjusted for sex, age, and districts, 57 registered persons (27 severe and 30 mild cases) with brain disorders dwelling in Seoul, South Korea were chosen and medical specialists investigated all of the subjects with the developed tools. The HNA tool for brain disorders we developed included four categories: 1) medical interventions and operations, 2) assistive devices, 3) rehabilitation therapy, and 4) regular follow-up. This study also found that 71.9% of the subjects did not receive appropriate medical care, which implies that the severity of their disability is likely to be exacerbated and permanent, and the loss irrecoverable. Our results showed that the HNA tool for persons with brain disorders based on unmet needs defined by physicians can be a useful method for evaluating the appropriateness and necessity of medical services offered to the disabled, and it can serve as the norm for providing health care services for disabled persons. Further studies should be undertaken to increase validity and reliability of the tool. Fundamental research investigating the factors generating or affecting the unmet needs is necessary; its results could serve as basis for developing policies to eliminate or alleviate these factors.

Using a Personal Development Plan for Different Purposes: Its Influence on Undertaking Learning Activities and Job Performance

ERIC Educational Resources Information Center

Beausaert, Simon A. J.; Segers, Mien S. R.; Gijselaers, Wim H.

2011-01-01

Today, organizations are increasingly implementing assessment tools such as Personal Development Plans. Although the true power of the tool lies in supporting the employee's continuing professional development, organizations implement the tool for various different purposes, professional development purposes on the one hand and promotion/salary…

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

A streamlined sustainability assessment tool for improved decision making in the urban water industry.

PubMed

Schulz, Matthias; Short, Michael D; Peters, Gregory M

2012-01-01

Water supply is a key consideration in sustainable urban planning. Ideally, detailed quantitative sustainability assessments are undertaken during the planning stage to inform the decision-making process. In reality, however, the significant time and cost associated with undertaking such detailed environmental and economic assessments is often cited as a barrier to wider implementation of these key decision support tools, particularly for decisions made at the local or regional government level. In an attempt to overcome this barrier of complexity, 4 water service providers in Melbourne, Australia, funded the development of a publicly available streamlined Environmental Sustainability Assessment Tool, which is aimed at a wide range of decision makers to assist them in broadening the type and number of water servicing options that can be considered for greenfield or backlog developments. The Environmental Sustainability Assessment Tool consists of a simple user interface and draws on life cycle inventory data to allow for rapid estimation of the environmental and economic performance of different water servicing scenarios. Scenario options can then be further prioritized by means of an interactive multicriteria analysis. The intent of this article is to identify the key issues to be considered in a streamlined sustainability assessment tool for the urban water industry, and to demonstrate the feasibility of generating accurate life cycle assessments and life cycle costings, using such a tool. We use a real-life case study example consisting of 3 separate scenarios for a planned urban development to show that this kind of tool can emulate life cycle assessments and life cycle costings outcomes obtained through more detailed studies. This simplified approach is aimed at supporting "sustainability thinking" early in the decision-making process, thereby encouraging more sustainable water and sewerage infrastructure solutions. Copyright © 2011 SETAC.

Development of a research ethics knowledge and analytical skills assessment tool.

PubMed

Taylor, Holly A; Kass, Nancy E; Ali, Joseph; Sisson, Stephen; Bertram, Amanda; Bhan, Anant

2012-04-01

The goal of this project was to develop and validate a new tool to evaluate learners' knowledge and skills related to research ethics. A core set of 50 questions from existing computer-based online teaching modules were identified, refined and supplemented to create a set of 74 multiple-choice, true/false and short answer questions. The questions were pilot-tested and item discrimination was calculated for each question. Poorly performing items were eliminated or refined. Two comparable assessment tools were created. These assessment tools were administered as a pre-test and post-test to a cohort of 58 Indian junior health research investigators before and after exposure to a new course on research ethics. Half of the investigators were exposed to the course online, the other half in person. Item discrimination was calculated for each question and Cronbach's α for each assessment tool. A final version of the assessment tool that incorporated the best questions from the pre-/post-test phase was used to assess retention of research ethics knowledge and skills 3 months after course delivery. The final version of the REKASA includes 41 items and had a Cronbach's α of 0.837. The results illustrate, in one sample of learners, the successful, systematic development and use of a knowledge and skills assessment tool in research ethics capable of not only measuring basic knowledge in research ethics and oversight but also assessing learners' ability to apply ethics knowledge to the analytical task of reasoning through research ethics cases, without reliance on essay or discussion-based examination. These promising preliminary findings should be confirmed with additional groups of learners.

Team performance in resuscitation teams: Comparison and critique of two recently developed scoring tools☆

PubMed Central

McKay, Anthony; Walker, Susanna T.; Brett, Stephen J.; Vincent, Charles; Sevdalis, Nick

2012-01-01

Background and aim Following high profile errors resulting in patient harm and attracting negative publicity, the healthcare sector has begun to focus on training non-technical teamworking skills as one way of reducing the rate of adverse events. Within the area of resuscitation, two tools have been developed recently aiming to assess these skills – TEAM and OSCAR. The aims of the study reported here were:1.To determine the inter-rater reliability of the tools in assessing performance within the context of resuscitation.2.To correlate scores of the same resuscitation teams episodes using both tools, thereby determining their concurrent validity within the context of resuscitation.3.To carry out a critique of both tools and establish how best each one may be utilised. Methods The study consisted of two phases – reliability assessment; and content comparison, and correlation. Assessments were made by two resuscitation experts, who watched 24 pre-recorded resuscitation simulations, and independently rated team behaviours using both tools. The tools were critically appraised, and correlation between overall score surrogates was assessed. Results Both OSCAR and TEAM achieved high levels of inter-rater reliability (in the form of adequate intra-class coefficients) and minor significant differences between Wilcoxon tests. Comparison of the scores from both tools demonstrated a high degree of correlation (and hence concurrent validity). Finally, critique of each tool highlighted differences in length and complexity. Conclusion Both OSCAR and TEAM can be used to assess resuscitation teams in a simulated environment, with the tools correlating well with one another. We envisage a role for both tools – with TEAM giving a quick, global assessment of the team, but OSCAR enabling more detailed breakdown of the assessment, facilitating feedback, and identifying areas of weakness for future training. PMID:22561464

Rapid Assessment Tool for Haemophilus influenzae type b Disease in Developing Countries1

PubMed Central

Nelson, Christopher B.; Watt, James P.; Mohsni, Ezzeddine; Wenger, Jay D.; Levine, Orin S.

2004-01-01

Haemophilus influenzae type b (Hib) still causes a substantial number of deaths among children in developing countries, despite the availability of effective conjugate vaccines. A major obstacle in developing a Hib vaccine has been limited awareness about the impact of Hib disease. A tool was developed to estimate the national rates of Hib meningitis and pneumonia by assessing retrospective local data over 7 to 10 days. Data from 11 countries in Africa, the Middle East, and Asia were studied and showed rates of Hib meningitis from >50 cases per 100,000 children >5 years in Ghana and Uganda to <15 per 100,000 in Iran, Jordan, and Uzbekistan. Results were affected by the quality of available data. The Hib rapid assessment tool can be useful to countries that desire a timely assessment of Hib disease rates. PMID:15324548

An exploration of inter-organisational partnership assessment tools in the context of Australian Aboriginal-mainstream partnerships: a scoping review of the literature.

PubMed

Tsou, Christina; Haynes, Emma; Warner, Wayne D; Gray, Gordon; Thompson, Sandra C

2015-04-23

The need for better partnerships between Aboriginal organisations and mainstream agencies demands attention on process and relational elements of these partnerships, and improving partnership functioning through transformative or iterative evaluation procedures. This paper presents the findings of a literature review which examines the usefulness of existing partnership tools to the Australian Aboriginal-mainstream partnership (AMP) context. Three sets of best practice principles for successful AMP were selected based on authors' knowledge and experience. Items in each set of principles were separated into process and relational elements and used to guide the analysis of partnership assessment tools. The review and analysis of partnership assessment tools were conducted in three distinct but related parts. Part 1- identify and select reviews of partnership tools; part 2 - identify and select partnership self-assessment tool; part 3 - analysis of selected tools using AMP principles. The focus on relational and process elements in the partnership tools reviewed is consistent with the focus of Australian AMP principles by reconciliation advocates; however, historical context, lived experience, cultural context and approaches of Australian Aboriginal people represent key deficiencies in the tools reviewed. The overall assessment indicated that the New York Partnership Self-Assessment Tool and the VicHealth Partnership Analysis Tools reflect the greatest number of AMP principles followed by the Nuffield Partnership Assessment Tool. The New York PSAT has the strongest alignment with the relational elements while VicHealth and Nuffield tools showed greatest alignment with the process elements in the chosen AMP principles. Partnership tools offer opportunities for providing evidence based support to partnership development. The multiplicity of tools in existence and the reported uniqueness of each partnership, mean the development of a generic partnership analysis for AMP may not be a viable option for future effort.

Initial development of a practical safety audit tool to assess fleet safety management practices.

PubMed

Mitchell, Rebecca; Friswell, Rena; Mooren, Lori

2012-07-01

Work-related vehicle crashes are a common cause of occupational injury. Yet, there are few studies that investigate management practices used for light vehicle fleets (i.e. vehicles less than 4.5 tonnes). One of the impediments to obtaining and sharing information on effective fleet safety management is the lack of an evidence-based, standardised measurement tool. This article describes the initial development of an audit tool to assess fleet safety management practices in light vehicle fleets. The audit tool was developed by triangulating information from a review of the literature on fleet safety management practices and from semi-structured interviews with 15 fleet managers and 21 fleet drivers. A preliminary useability assessment was conducted with 5 organisations. The audit tool assesses the management of fleet safety against five core categories: (1) management, systems and processes; (2) monitoring and assessment; (3) employee recruitment, training and education; (4) vehicle technology, selection and maintenance; and (5) vehicle journeys. Each of these core categories has between 1 and 3 sub-categories. Organisations are rated at one of 4 levels on each sub-category. The fleet safety management audit tool is designed to identify the extent to which fleet safety is managed in an organisation against best practice. It is intended that the audit tool be used to conduct audits within an organisation to provide an indicator of progress in managing fleet safety and to consistently benchmark performance against other organisations. Application of the tool by fleet safety researchers is now needed to inform its further development and refinement and to permit psychometric evaluation. Copyright © 2012 Elsevier Ltd. All rights reserved.

Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours

PubMed Central

Wong, William CW; Cheung, Catherine SK; Hart, Graham J

2008-01-01

Background Systematic reviews based on the critical appraisal of observational and analytic studies on HIV prevalence and risk factors for HIV transmission among men having sex with men are very useful for health care decisions and planning. Such appraisal is particularly difficult, however, as the quality assessment tools available for use with observational and analytic studies are poorly established. Methods We reviewed the existing quality assessment tools for systematic reviews of observational studies and developed a concise quality assessment checklist to help standardise decisions regarding the quality of studies, with careful consideration of issues such as external and internal validity. Results A pilot version of the checklist was developed based on epidemiological principles, reviews of study designs, and existing checklists for the assessment of observational studies. The Quality Assessment Tool for Systematic Reviews of Observational Studies (QATSO) Score consists of five items: External validity (1 item), reporting (2 items), bias (1 item) and confounding factors (1 item). Expert opinions were sought and it was tested on manuscripts that fulfil the inclusion criteria of a systematic review. Like all assessment scales, QATSO may oversimplify and generalise information yet it is inclusive, simple and practical to use, and allows comparability between papers. Conclusion A specific tool that allows researchers to appraise and guide study quality of observational studies is developed and can be modified for similar studies in the future. PMID:19014686

The development of a multimedia online language assessment tool for young children with autism.

PubMed

Lin, Chu-Sui; Chang, Shu-Hui; Liou, Wen-Ying; Tsai, Yu-Show

2013-10-01

This study aimed to provide early childhood special education professionals with a standardized and comprehensive language assessment tool for the early identification of language learning characteristics (e.g., hyperlexia) of young children with autism. In this study, we used computer technology to develop a multi-media online language assessment tool that presents auditory or visual stimuli. This online comprehensive language assessment consists of six subtests: decoding, homographs, auditory vocabulary comprehension, visual vocabulary comprehension, auditory sentence comprehension, and visual sentence comprehension. Three hundred typically developing children and 35 children with autism from Tao-Yuan County in Taiwan aged 4-6 participated in this study. The Cronbach α values of the six subtests ranged from .64 to .97. The variance explained by the six subtests ranged from 14% to 56%, the current validity of each subtest with the Peabody Picture Vocabulary Test-Revised ranged from .21 to .45, and the predictive validity of each subtest with WISC-III ranged from .47 to .75. This assessment tool was also found to be able to accurately differentiate children with autism up to 92%. These results indicate that this assessment tool has both adequate reliability and validity. Additionally, 35 children with autism have completed the entire assessment in this study without exhibiting any extremely troubling behaviors. However, future research is needed to increase the sample size of both typically developing children and young children with autism and to overcome the technical challenges associated with internet issues. Copyright © 2013 Elsevier Ltd. All rights reserved.

Understanding online health information: Evaluation, tools, and strategies.

PubMed

Beaunoyer, Elisabeth; Arsenault, Marianne; Lomanowska, Anna M; Guitton, Matthieu J

2017-02-01

Considering the status of the Internet as a prominent source of health information, assessing online health material has become a central issue in patient education. We describe the strategies available to evaluate the characteristics of online health information, including readability, emotional content, understandability, usability. Popular tools used in assessment of readability, emotional content and comprehensibility of online health information were reviewed. Tools designed to evaluate both printed and online material were considered. Readability tools are widely used in online health material evaluation and are highly covariant. Assessment of emotional content of online health-related communications via sentiment analysis tools is becoming more popular. Understandability and usability tools have been developed specifically for health-related material, but each tool has important limitations and has been tested on a limited number of health issues. Despite the availability of numerous assessment tools, their overall reliability differs between readability (high) and understandability (low). Approaches combining multiple assessment tools and involving both quantitative and qualitative observations would optimize assessment strategies. Effective assessment of online health information should rely on mixed strategies combining quantitative and qualitative evaluations. Assessment tools should be selected according to their functional properties and compatibility with target material. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Development of a context specific accreditation assessment tool for affirming quality midwifery education in Bangladesh.

PubMed

Bogren, Malin; Sathyanarayanan Doraiswamy; Erlandsson, Kerstin; Akhter, Halima; Akter, Dalia; Begum, Momtaz; Chowdhury, Merry; Das, Lucky; Akter, Rehana; Begum, Sufia; Akter, Renoara; Yesmin, Syeada; Khatun, Yamin Ara

2018-06-01

using the International Confederation of Midwives (ICM) Global Standards for Midwifery Education as a conceptual framework, the aim of this study was to explore and describe important 'must haves' for inclusion in a context-specific accreditation assessment tool in Bangladesh. A questionnaire study was conducted using a Likert rating scale and 111 closed-response single items on adherence to accreditation-related statements, ending with an open-ended question. The ICM Global Standards guided data collection, deductive content analysis and description of the quantitative results. twenty-five public institutes/colleges (out of 38 in Bangladesh), covering seven out of eight geographical divisions in the country. one hundred and twenty-three nursing educators teaching the 3-year diploma midwifery education programme. this study provides insight into the development of a context-specific accreditation assessment tool for Bangladesh. Important components to be included in this accreditation tool are presented under the following categories and domains: 'organization and administration', 'midwifery faculty', 'student body', 'curriculum content', 'resources, facilities and services' and 'assessment strategies'. The identified components were a prerequisite to ensure that midwifery students achieve the intended learning outcomes of the midwifery curriculum, and hence contribute to a strong midwifery workforce. The components further ensure well-prepared teachers and a standardized curriculum supported at policy level to enable effective deployment of professional midwives in the existing health system. as part of developing an accreditation assessment tool, it is imperative to build ownership and capacity when translating the ICM Global Standards for Midwifery Education into the national context. this initiative can be used as lessons learned from Bangladesh to develop a context-specific accreditation assessment tool in line with national priorities, supporting the development of national policies. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Development and Testing of the Church Environment Audit Tool.

PubMed

Kaczynski, Andrew T; Jake-Schoffman, Danielle E; Peters, Nathan A; Dunn, Caroline G; Wilcox, Sara; Forthofer, Melinda

2018-05-01

In this paper, we describe development and reliability testing of a novel tool to evaluate the physical environment of faith-based settings pertaining to opportunities for physical activity (PA) and healthy eating (HE). Tool development was a multistage process including a review of similar tools, stakeholder review, expert feedback, and pilot testing. Final tool sections included indoor opportunities for PA, outdoor opportunities for PA, food preparation equipment, kitchen type, food for purchase, beverages for purchase, and media. Two independent audits were completed at 54 churches. Interrater reliability (IRR) was determined with Kappa and percent agreement. Of 218 items, 102 were assessed for IRR and 116 could not be assessed because they were not present at enough churches. Percent agreement for all 102 items was over 80%. For 42 items, the sample was too homogeneous to assess Kappa. Forty-six of the remaining items had Kappas greater than 0.60 (25 items 0.80-1.00; 21 items 0.60-0.79), indicating substantial to almost perfect agreement. The tool proved reliable and efficient for assessing church environments and identifying potential intervention points. Future work can focus on applications within faith-based partnerships to understand how church environments influence diverse health outcomes.

Developing and Using Dashboard Indicators in Student Affairs Assessment

ERIC Educational Resources Information Center

Mitchell, Joshua J.; Ryder, Andrew J.

2013-01-01

Dashboard systems are increasingly popular as assessment and performance management tools in higher education. This chapter examines the use of dashboards in student affairs, including examples of key indicators and considerations for developing and implementing these tools. The chapter begins with an overview of the origins of dashboards, from…

Assessing and Managing Caregiver Stress: Development of a Teaching Tool for Medical Residents

ERIC Educational Resources Information Center

Famakinwa, Abisola; Fabiny, Anne

2008-01-01

Forty medical residents from major teaching hospitals in Boston, Massachusetts, participated in small group teaching sessions about caregiver stress. A teaching tool was developed that included a teaching handout, interactive cases, standard instruments for assessing caregiver stress, peer-reviewed articles about caregiving, and a list of…

A new framework for modeling decentralized low impact developments using Soil and Water Assessment Tool

USDA-ARS?s Scientific Manuscript database

Assessing the performance of Low Impact Development (LID) practices at a catchment scale is important in managing urban watersheds. Few modeling tools exist that are capable of explicitly representing the hydrological mechanisms of LIDs while considering the diverse land uses of urban watersheds. ...

The development of an online decision support tool for organizational readiness for change.

PubMed

Khan, Sobia; Timmings, Caitlyn; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Gheihman, Galina; Straus, Sharon E

2014-05-10

Much importance has been placed on assessing readiness for change as one of the earliest steps of implementation, but measuring it can be a complex and daunting task. Organizations and individuals struggle with how to reliably and accurately measure readiness for change. Several measures have been developed to help organizations assess readiness, but these are often underused due to the difficulty of selecting the right measure. In response to this challenge, we will develop and test a prototype of a decision support tool that is designed to guide individuals interested in implementation in the selection of an appropriate readiness assessment measure for their setting. A multi-phase approach will be used to develop the decision support tool. First, we will identify key measures for assessing organizational readiness for change from a recently completed systematic review. Included measures will be those developed for healthcare settings (e.g., acute care, public health, mental health) and that have been deemed valid and reliable. Second, study investigators and field experts will engage in a mapping exercise to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a stakeholder panel will be recruited and consulted to determine the feasibility and relevance of the selected measures using a modified Delphi process. Fourth, findings from the mapping exercise and stakeholder consultation will inform the development of a decision support tool that will guide users in appropriately selecting change readiness measures. Fifth, the tool will undergo usability testing. Our proposed decision support tool will address current challenges in the field of organizational change readiness by aiding individuals in selecting a valid and reliable assessment measure that is relevant to user needs and practice settings. We anticipate that implementers and researchers who use our tool will be more likely to conduct readiness for change assessments in their settings when planning for implementation. This, in turn, may contribute to more successful implementation outcomes. We will test this tool in a future study to determine its efficacy and impact on implementation processes.

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

Cognitive Assessment in Long-Duration Space Flight

NASA Technical Reports Server (NTRS)

Kane, Robert; Seaton, Kimberly; Sipes, Walter

2011-01-01

This slide presentation reviews the development and use of a tool for assessing spaceflight cognitive ability in astronauts. This tool. the Spaceflight Cognitive Assessment Tool for Windows (WinSCAT) has been used to provide ISS flight surgeons with an objective clinical tool to monitor the astronauts cognitive status during long-duration space flight and allow immediate feedback to the astronaut. Its use is medically required for all long-duration missions and it contains a battery of five cognitive assessment subtests that are scheduled monthly and compared against the individual preflight baseline.

Information security system quality assessment through the intelligent tools

NASA Astrophysics Data System (ADS)

Trapeznikov, E. V.

2018-04-01

The technology development has shown the automated system information security comprehensive analysis necessity. The subject area analysis indicates the study relevance. The research objective is to develop the information security system quality assessment methodology based on the intelligent tools. The basis of the methodology is the information security assessment model in the information system through the neural network. The paper presents the security assessment model, its algorithm. The methodology practical implementation results in the form of the software flow diagram are represented. The practical significance of the model being developed is noted in conclusions.

Developing an Assessment Process for a Master's of Science Degree in a Pharmaceutical Sciences Program.

PubMed

Bloom, Timothy J; Hall, Julie M; Liu, Qinfeng; Stagner, William C; Adams, Michael L

2016-09-25

Objective. To develop a program-level assessment process for a master's of science degree in a pharmaceutical sciences (MSPS) program. Design. Program-level goals were created and mapped to course learning objectives. Embedded assessment tools were created by each course director and used to gather information related to program-level goals. Initial assessment iterations involved a subset of offered courses, and course directors met with the department assessment committee to review the quality of the assessment tools as well as the data collected with them. Insights from these discussions were used to improve the process. When all courses were used for collecting program-level assessment data, a modified system of guided reflection was used to reduce demands on committee members. Assessment. The first two iterations of collecting program-level assessment revealed problems with both the assessment tools and the program goals themselves. Course directors were inconsistent in the Bloom's Taxonomy level at which they assessed student achievement of program goals. Moreover, inappropriate mapping of program goals to course learning objectives were identified. These issues led to unreliable measures of how well students were doing with regard to program-level goals. Peer discussions between course directors and the assessment committee led to modification of program goals as well as improved assessment data collection tools. Conclusion. By starting with a subset of courses and using course-embedded assessment tools, a program-level assessment process was created with little difficulty. Involving all faculty members and avoiding comparisons between courses made obtaining faculty buy-in easier. Peer discussion often resulted in consensus on how to improve assessment tools.

A Comparative Analysis of Life-Cycle Assessment Tools for ...

EPA Pesticide Factsheets

We identified and evaluated five life-cycle assessment tools that community decision makers can use to assess the environmental and economic impacts of end-of-life (EOL) materials management options. The tools evaluated in this report are waste reduction mode (WARM), municipal solid waste-decision support tool (MSW-DST), solid waste optimization life-cycle framework (SWOLF), environmental assessment system for environmental technologies (EASETECH), and waste and resources assessment for the environment (WRATE). WARM, MSW-DST, and SWOLF were developed for US-specific materials management strategies, while WRATE and EASETECH were developed for European-specific conditions. All of the tools (with the exception of WARM) allow specification of a wide variety of parameters (e.g., materials composition and energy mix) to a varying degree, thus allowing users to model specific EOL materials management methods even outside the geographical domain they are originally intended for. The flexibility to accept user-specified input for a large number of parameters increases the level of complexity and the skill set needed for using these tools. The tools were evaluated and compared based on a series of criteria, including general tool features, the scope of the analysis (e.g., materials and processes included), and the impact categories analyzed (e.g., climate change, acidification). A series of scenarios representing materials management problems currently relevant to c

DOE Office of Scientific and Technical Information (OSTI.GOV)

Runhaar, Hens

An abundance of approaches, strategies, and instruments – in short: tools – have been developed that intend to stimulate or facilitate the integration of a variety of environmental objectives into development planning, national or regional sectoral policies, international agreements, business strategies, etc. These tools include legally mandatory procedures, such as Environmental Impact Assessment and Strategic Environmental Assessment; more voluntary tools such as environmental indicators developed by scientists and planning tools; green budgeting, etc. A relatively underexplored question is what integration tool fits what particular purposes and contexts, in short: “what works where?”. This paper intends to contribute to answering thismore » question, by first providing conceptual clarity about what integration entails, by suggesting and illustrating a classification of integration tools, and finally by summarising some of the lessons learned about how and why integration tools are (not) used and with what outcomes, particularly in terms of promoting the integration of environmental objectives.« less

Developing and Validating a Tool to Assess Ethical Decision-Making Ability of Nursing Students, Using Rubrics

ERIC Educational Resources Information Center

Indhraratana, Apinya; Kaemkate, Wannee

2012-01-01

The aim of this paper is to develop a reliable and valid tool to assess ethical decision-making ability of nursing students using rubrics. A proposed ethical decision making process, from reviewing related literature was used as a framework for developing the rubrics. Participants included purposive sample of 86 nursing students from the Royal…

Data and Tools | Energy Analysis | NREL

Science.gov Websites

and Tools Energy Analysis Data and Tools NREL develops energy analysis data and tools to assess collections. Data Products Technology and Performance Analysis Tools Energy Systems Analysis Tools Economic and Financial Analysis Tools

Pushing and pulling: an assessment tool for occupational health and safety practitioners.

PubMed

Lind, Carl Mikael

2018-03-01

A tool has been developed for supporting practitioners when assessing manual pushing and pulling operations based on an initiative by two global companies in the manufacturing industry. The aim of the tool is to support occupational health and safety practitioners in risk assessment and risk management of pushing and pulling operations in the manufacturing and logistics industries. The tool is based on a nine-multiplier equation that includes a wide range of factors affecting an operator's health risk and capacity in pushing and pulling. These multipliers are based on psychophysical, physiological and biomechanical studies in combination with judgments from an expert group consisting of senior researchers and ergonomists. In order to consider usability, more than 50 occupational health and safety practitioners (e.g., ergonomists, managers, safety representatives and production personnel) participated in the development of the tool. An evaluation by 22 ergonomists supports that the push/pull tool is user friendly in general.

Development and testing of a tool for assessing and resolving medication-related problems in older adults in an ambulatory care setting: the individualized medication assessment and planning (iMAP) tool.

PubMed

Crisp, Ginny D; Burkhart, Jena Ivey; Esserman, Denise A; Weinberger, Morris; Roth, Mary T

2011-12-01

Medication is one of the most important interventions for improving the health of older adults, yet it has great potential for causing harm. Clinical pharmacists are well positioned to engage in medication assessment and planning. The Individualized Medication Assessment and Planning (iMAP) tool was developed to aid clinical pharmacists in documenting medication-related problems (MRPs) and associated recommendations. The purpose of our study was to assess the reliability and usability of the iMAP tool in classifying MRPs and associated recommendations in older adults in the ambulatory care setting. Three cases, representative of older adults seen in an outpatient setting, were developed. Pilot testing was conducted and a "gold standard" key developed. Eight eligible pharmacists consented to participate in the study. They were instructed to read each case, make an assessment of MRPs, formulate a plan, and document the information using the iMAP tool. Inter-rater reliability was assessed for each case, comparing the pharmacists' identified MRPs and recommendations to the gold standard. Consistency of categorization across reviewers was assessed using the κ statistic or percent agreement. The mean κ across the 8 pharmacists in classifying MRPs compared with the gold standard was 0.74 (range, 0.54-1.00) for case 1 and 0.68 (range, 0.36-1.00) for case 2, indicating substantial agreement. For case 3, percent agreement was 63% (range, 40%-100%). The mean κ across the 8 pharmacists when classifying recommendations compared with the gold standard was 0.87 (range, 0.58-1.00) for case 1 and 0.88 (range, 0.75-1.00) for case 2, indicating almost perfect agreement. For case 3, percent agreement was 68% (range, 40%-100%). Clinical pharmacists found the iMAP tool easy to use. The iMAP tool provides a reliable and standardized approach for clinical pharmacists to use in the ambulatory care setting to classify MRPs and associated recommendations. Future studies will explore the predictive validity of the tool on clinical outcomes such as health care utilization. Copyright © 2011 Elsevier HS Journals, Inc. All rights reserved.

Development of a shared decision-making tool to assist patients and clinicians with decisions on oral anticoagulant treatment for atrial fibrillation.

PubMed

Kaiser, Karen; Cheng, Wendy Y; Jensen, Sally; Clayman, Marla L; Thappa, Andrew; Schwiep, Frances; Chawla, Anita; Goldberger, Jeffrey J; Col, Nananda; Schein, Jeff

2015-12-01

Decision aids (DAs) are increasingly used to operationalize shared decision-making (SDM) but their development is not often described. Decisions about oral anticoagulants (OACs) for atrial fibrillation (AF) involve a trade-off between lowering stroke risk and increasing OAC-associated bleeding risk, and consideration of how treatment affects lifestyle. The benefits and risks of OACs hinge upon a patient's risk factors for stroke and bleeding and how they value these outcomes. We present the development of a DA about AF that estimates patients' risks for stroke and bleeding and assesses their preferences for outcomes. Based on a literature review and expert discussions, we identified stroke and major bleeding risk prediction models and embedded them into risk assessment modules. We identified the most important factors in choosing OAC treatment (warfarin used as the default reference OAC) through focus group discussions with AF patients who had used warfarin and clinician interviews. We then designed preference assessment and introductory modules accordingly. We integrated these modules into a prototype AF SDM tool and evaluated its usability through interviews. Our tool included four modules: (1) introduction to AF and OAC treatment risks and benefits; (2) stroke risk assessment; (3) bleeding risk assessment; and (4) preference assessment. Interactive risk calculators estimated patient-specific stroke and bleeding risks; graphics were developed to communicate these risks. After cognitive interviews, the content was improved. The final AF tool calculates patient-specific risks and benefits of OAC treatment and couples these estimates with patient preferences to improve clinical decision-making. The AF SDM tool may help patients choose whether OAC treatment is best for them and represents a patient-centered, integrative approach to educate patients on the benefits and risks of OAC treatment. Future research is needed to evaluate this tool in a real-world setting. The development process presented can be applied to similar SDM tools.

System Maturity and Architecture Assessment Methods, Processes, and Tools

DTIC Science & Technology

2012-03-02

Deshmukh , and M. Sarfaraz. Development of Systems Engineering Maturity Models and Management Tools. Systems Engineering Research Center Final Technical...Ramirez- Marquez, D. Nowicki, A. Deshmukh , and M. Sarfaraz. Development of Systems Engineering Maturity Models and Management Tools. Systems Engineering

Assessment Tools for the Evaluation of Risk

EPA Science Inventory

ASTER (Assessment Tools for the Evaluation of Risk) was developed by the U.S. EPA Mid-Continent Ecology Division, Duluth, MN to assist regulators in performing ecological risk assessments. ASTER is an integration of the ECOTOXicology Database (ECOTOX; Evaluation of the validity of osteoporosis and fracture risk assessment tools (IOF One Minute Test, SCORE, and FRAX) in postmenopausal Palestinian women.

PubMed

Kharroubi, Akram; Saba, Elias; Ghannam, Ibrahim; Darwish, Hisham

2017-12-01

The need for simple self-assessment tools is necessary to predict women at high risk for developing osteoporosis. In this study, tools like the IOF One Minute Test, Fracture Risk Assessment Tool (FRAX), and Simple Calculated Osteoporosis Risk Estimation (SCORE) were found to be valid for Palestinian women. The threshold for predicting women at risk for each tool was estimated. The purpose of this study is to evaluate the validity of the updated IOF (International Osteoporosis Foundation) One Minute Osteoporosis Risk Assessment Test, FRAX, SCORE as well as age alone to detect the risk of developing osteoporosis in postmenopausal Palestinian women. Three hundred eighty-two women 45 years and older were recruited including 131 women with osteoporosis and 251 controls following bone mineral density (BMD) measurement, 287 completed questionnaires of the different risk assessment tools. Receiver operating characteristic (ROC) curves were evaluated for each tool using bone BMD as the gold standard for osteoporosis. The area under the ROC curve (AUC) was the highest for FRAX calculated with BMD for predicting hip fractures (0.897) followed by FRAX for major fractures (0.826) with cut-off values ˃1.5 and ˃7.8%, respectively. The IOF One Minute Test AUC (0.629) was the lowest compared to other tested tools but with sufficient accuracy for predicting the risk of developing osteoporosis with a cut-off value ˃4 total yes questions out of 18. SCORE test and age alone were also as good predictors of risk for developing osteoporosis. According to the ROC curve for age, women ≥64 years had a higher risk of developing osteoporosis. Higher percentage of women with low BMD (T-score ≤-1.5) or osteoporosis (T-score ≤-2.5) was found among women who were not exposed to the sun, who had menopause before the age of 45 years, or had lower body mass index (BMI) compared to controls. Women who often fall had lower BMI and approximately 27% of the recruited postmenopausal Palestinian women had accidents that caused fractures. Simple self-assessment tools like FRAX without BMD, SCORE, and the IOF One Minute Tests were valid for predicting Palestinian postmenopausal women at high risk of developing osteoporosis.

Tool to assess causality of direct and indirect adverse events associated with therapeutic interventions.

PubMed

Zorzela, Liliane; Mior, Silvano; Boon, Heather; Gross, Anita; Yager, Jeromy; Carter, Rose; Vohra, Sunita

2018-03-01

To develop and test a tool to assess the causality of direct and indirect adverse events associated with therapeutic interventions. The intervention was one or more drugs and/or natural health products, a device, or practice (professional delivering the intervention). Through the assessment of causality of adverse events, we can learn about factors contributing to the harm and consider what modification may prevent its reoccurrence. Existing scales (WHO-UMC, Naranjo and Horn) were adapted to develop a tool (algorithm and table) to evaluate cases of serious harmful events reported through a national surveillance study. We also incorporated a novel approach that assesses indirect harm (caused by the delay in diagnosis/treatment) and the health provider delivering the intervention (practice). The tool was tested, revised and then implemented to assess all reported cases of serious events resulting from use of complementary therapies. The use of complementary therapies was the trigger to report the event. Each case was evaluated by two assessors, out of a panel of five, representing different health care professionals. The tool was used in assessment of eight serious adverse events. Each event was independently evaluated by two assessors. The algorithm facilitated assessment of a serious direct or indirect harm. Assessors agreed in the final score on seven of eight cases (weighted kappa coefficient of 0.75). A tool to support the assessment of causality of adverse events was developed and tested. We propose a novel method to assess direct and indirect harms related to product(s), device(s), practice or a combination of the previous. Further research will probably help evaluate this approach across different settings and interventions.

FFI: A software tool for ecological monitoring

Treesearch

Duncan C. Lutes; Nathan C. Benson; MaryBeth Keifer; John F. Caratti; S. Austin Streetman

2009-01-01

A new monitoring tool called FFI (FEAT/FIREMON Integrated) has been developed to assist managers with collection, storage and analysis of ecological information. The tool was developed through the complementary integration of two fire effects monitoring systems commonly used in the United States: FIREMON and the Fire Ecology Assessment Tool. FFI provides software...

Development of a Geographic Information System (GIS) tool for the preliminary assessment of the effects of predicted sea level and tidal change on transportation infrastructure.

DOT National Transportation Integrated Search

2013-09-01

In this project, researchers from the University of Florida developed a sketch planning tool that can be used to conduct statewide and regional assessments of transportation facilities potentially vulnerable to sea level change trends. Possible futur...

Development, Evaluation, and Validation of Environmental Assessment Tools to Evaluate the College Nutrition Environment

ERIC Educational Resources Information Center

Freedman, Marjorie R.

2010-01-01

Objective: To develop, evaluate, and validate 2 nutrition environment assessment tools (surveys), for specific use in combating overweight on college/university campuses. Participants and Methods: Invitations to complete surveys were e-mailed to food service and health center directors at 47 universities, Winter 2008. Overall response rate was…

Development of Assessment Tools To Measure Organizational Support for Employee Health.

ERIC Educational Resources Information Center

Golaszewski, Thomas; Barr, Donald; Pronk, Nico

2003-01-01

Describes one working group's attempts to develop and utilize assessment tools for measuring and changing organizational support for employee health. Originally designed as part of a heart health related intervention, the system has evolved into a managed care evaluation and major chronic disease inventory. Findings indicate the potential of…

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Integrating NASA Earth Observations into the Global Indicator Framework for Monitoring the United Nations' Sustainable Development Goals

NASA Astrophysics Data System (ADS)

Crepps, G.; Gotschalk, E.; Childs-Gleason, L. M.; Favors, J.; Ruiz, M. L.; Allsbrook, K. N.; Rogers, L.; Ross, K. W.

2016-12-01

The NASA DEVELOP National Program conducts rapid 10-week feasibility projects that build decision makers' capacity to utilize NASA Earth observations in their decision making. Teams, in collaboration with partner organizations, conduct projects that create end products such as maps, analyses, and automated tools tailored for their partners' specific decision making needs. These projects illustrate the varied applications about which Earth observations can assist in making better informed decisions, such topics as land use changes, ecological forecasting, public health, and species habitats. As a capacity building program, DEVELOP is interested in understanding how these end products are utilized once the project is over and if Earth observations become a regular tool in the partner's decision making toolkit. While DEVELOP's niche is short-term projects, to assess the impacts of these projects, a longer-term scale is needed. As a result, DEVELOP has created a project strength metrics, and partner assessments, pre- and post-project, as well as a follow up form. This presentation explores the challenges in both quantitative and qualitative assessments of valuing the contributions of these Earth observation tools. This proposal lays out the assessment framework created within the program, and illustrates case studies in which projects have been assessed and long-term partner use of tools examined and quantified.

An investigation of the validity of the Work Assessment Triage Tool clinical decision support tool for selecting optimal rehabilitation interventions for workers with musculoskeletal injuries.

PubMed

Qin, Ziling; Armijo-Olivo, Susan; Woodhouse, Linda J; Gross, Douglas P

2016-03-01

To evaluate the concurrent validity of a clinical decision support tool (Work Assessment Triage Tool (WATT)) developed to select rehabilitation treatments for injured workers with musculoskeletal conditions. Methodological study with cross-sectional and prospective components. Data were obtained from the Workers' Compensation Board of Alberta rehabilitation facility in Edmonton, Canada. A total of 432 workers' compensation claimants evaluated between November 2011 and June 2012. Percentage agreement between the Work Assessment Triage Tool and clinician recommendations was used to determine concurrent validity. In claimants returning to work, frequencies of matching were calculated and compared between clinician and Work Assessment Triage Tool recommendations and the actual programs undertaken by claimants. The frequency of each intervention recommended by clinicians, Work Assessment Triage Tool, and case managers were also calculated and compared. Percentage agreement between clinician and Work Assessment Triage Tool recommendations was poor (19%) to moderate (46%) and Kappa = 0.37 (95% CI -0.02, 0.76). The Work Assessment Triage Tool did not improve upon clinician recommendations as only 14 out of 31 claimants returning to work had programs that contradicted clinician recommendations, but were consistent with Work Assessment Triage Tool recommendations. Clinicians and case managers were inclined to recommend functional restoration, physical therapy, or no rehabilitation while the Work Assessment Triage Tool recommended additional evidence-based interventions, such as workplace-based interventions. Our findings do not provide evidence of concurrent validity for the Work Assessment Triage Tool compared with clinician recommendations. Based on these results, we cannot recommend further implementation of the Work Assessment Triage Tool. However, the Work Assessment Triage Tool appeared more likely than clinicians to recommend interventions supported by evidence; thus warranting further research. © The Author(s) 2015.

Role-playing simulation as an educational tool for health care personnel: developing an embedded assessment framework.

PubMed

Libin, Alexander; Lauderdale, Manon; Millo, Yuri; Shamloo, Christine; Spencer, Rachel; Green, Brad; Donnellan, Joyce; Wellesley, Christine; Groah, Suzanne

2010-04-01

Simulation- and video game-based role-playing techniques have been proven effective in changing behavior and enhancing positive decision making in a variety of professional settings, including education, the military, and health care. Although the need for developing assessment frameworks for learning outcomes has been clearly defined, there is a significant gap between the variety of existing multimedia-based instruction and technology-mediated learning systems and the number of reliable assessment algorithms. This study, based on a mixed methodology research design, aims to develop an embedded assessment algorithm, a Knowledge Assessment Module (NOTE), to capture both user interaction with the educational tool and knowledge gained from the training. The study is regarded as the first step in developing an assessment framework for a multimedia educational tool for health care professionals, Anatomy of Care (AOC), that utilizes Virtual Experience Immersive Learning Simulation (VEILS) technology. Ninety health care personnel of various backgrounds took part in online AOC training, choosing from five possible scenarios presenting difficult situations of everyday care. The results suggest that although the simulation-based training tool demonstrated partial effectiveness in improving learners' decision-making capacity, a differential learner-oriented approach might be more effective and capable of synchronizing educational efforts with identifiable relevant individual factors such as sociobehavioral profile and professional background.

The EPA's human exposure research program for assessing cumulative risk in communities.

PubMed

Zartarian, Valerie G; Schultz, Bradley D

2010-06-01

Communities are faced with challenges in identifying and prioritizing environmental issues, taking actions to reduce their exposures, and determining their effectiveness for reducing human health risks. Additional challenges include determining what scientific tools are available and most relevant, and understanding how to use those tools; given these barriers, community groups tend to rely more on risk perception than science. The U.S. Environmental Protection Agency's Office of Research and Development, National Exposure Research Laboratory (NERL) and collaborators are developing and applying tools (models, data, methods) for enhancing cumulative risk assessments. The NERL's "Cumulative Communities Research Program" focuses on key science questions: (1) How to systematically identify and prioritize key chemical stressors within a given community?; (2) How to develop estimates of exposure to multiple stressors for individuals in epidemiologic studies?; and (3) What tools can be used to assess community-level distributions of exposures for the development and evaluation of the effectiveness of risk reduction strategies? This paper provides community partners and scientific researchers with an understanding of the NERL research program and other efforts to address cumulative community risks; and key research needs and opportunities. Some initial findings include the following: (1) Many useful tools exist for components of risk assessment, but need to be developed collaboratively with end users and made more comprehensive and user-friendly for practical application; (2) Tools for quantifying cumulative risks and impact of community risk reduction activities are also needed; (3) More data are needed to assess community- and individual-level exposures, and to link exposure-related information with health effects; and (4) Additional research is needed to incorporate risk-modifying factors ("non-chemical stressors") into cumulative risk assessments. The products of this research program will advance the science for cumulative risk assessments and empower communities with information so that they can make informed, cost-effective decisions to improve public health.

Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

PubMed

Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

2015-01-01

Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief disease management encounters. MISHCE also evaluates quality of the patient-provider therapeutic alliance, i.e., the "flow" of the interaction. Copyright © 2015 Elsevier Inc. All rights reserved.

Superitem Test: An Alternative Assessment Tool to Assess Students' Algebraic Solving Ability

ERIC Educational Resources Information Center

Lian, Lim Hooi; Yew, Wun Thiam; Idris, Noraini

2010-01-01

Superitem test based on the SOLO model (Structure of the Observing Learning Outcome) has become a powerful alternative assessment tool for monitoring the growth of students' cognitive ability in solving mathematics problems. This article focused on developing a superitem test to assess students' algebraic solving ability through interview method.…

The Mental Disability Military Assessment Tool: A Reliable Tool for Determining Disability in Veterans with Post-traumatic Stress Disorder.

PubMed

Fokkens, Andrea S; Groothoff, Johan W; van der Klink, Jac J L; Popping, Roel; Stewart, Roy E; van de Ven, Lex; Brouwer, Sandra; Tuinstra, Jolanda

2015-09-01

An assessment tool was developed to assess disability in veterans who suffer from post-traumatic stress disorder (PTSD) due to a military mission. The objective of this study was to determine the reliability, intra-rater and inter-rater variation of the Mental Disability Military (MDM) assessment tool. Twenty-four assessment interviews of veterans with an insurance physician were videotaped. Each videotaped interview was assessed by a group of five independent raters on limitations of the veterans using the MDM assessment tool. After 2 months the raters repeated this procedure. Next the intra-rater and inter-rater variation was assessed with an adjusted version of AG09 computing weighted percentage agreement. The results of this study showed that both the intra-rater variation and inter-rater variation on the ten subcategories of the MDM assessment tool were small, with an agreement of 84-100% within raters and 93-100% between raters. The MDM assessment tool proves to be a reliable instrument to measure PTSD limitations in functioning in Dutch military veterans who apply for disability compensation. Further research is needed to assess the validity of this instrument.

The Tracking Meteogram, an AWIPS II Tool for Time-Series Analysis

NASA Technical Reports Server (NTRS)

Burks, Jason Eric; Sperow, Ken

2015-01-01

A new tool has been developed for the National Weather Service (NWS) Advanced Weather Interactive Processing System (AWIPS) II through collaboration between NASA's Short-term Prediction Research and Transition (SPoRT) and the NWS Meteorological Development Laboratory (MDL). Referred to as the "Tracking Meteogram", the tool aids NWS forecasters in assessing meteorological parameters associated with moving phenomena. The tool aids forecasters in severe weather situations by providing valuable satellite and radar derived trends such as cloud top cooling rates, radial velocity couplets, reflectivity, and information from ground-based lightning networks. The Tracking Meteogram tool also aids in synoptic and mesoscale analysis by tracking parameters such as the deepening of surface low pressure systems, changes in surface or upper air temperature, and other properties. The tool provides a valuable new functionality and demonstrates the flexibility and extensibility of the NWS AWIPS II architecture. In 2014, the operational impact of the tool was formally evaluated through participation in the NOAA/NWS Operations Proving Ground (OPG), a risk reduction activity to assess performance and operational impact of new forecasting concepts, tools, and applications. Performance of the Tracking Meteogram Tool during the OPG assessment confirmed that it will be a valuable asset to the operational forecasters. This presentation reviews development of the Tracking Meteogram tool, performance and feedback acquired during the OPG activity, and future goals for continued support and extension to other application areas.

The National Clinical Assessment Tool for Medical Students in the Emergency Department (NCAT-EM)

PubMed Central

Jung, Julianna; Franzen, Douglas; Lawson, Luan; Manthey, David; Tews, Matthew; Dubosh, Nicole; Fisher, Jonathan; Haughey, Marianne; House, Joseph B.; Trainor, Arleigh; Wald, David A.; Hiller, Katherine

2018-01-01

Introduction Clinical assessment of medical students in emergency medicine (EM) clerkships is a highly variable process that presents unique challenges and opportunities. Currently, clerkship directors use institution-specific tools with unproven validity and reliability that may or may not address competencies valued most highly in the EM setting. Standardization of assessment practices and development of a common, valid, specialty-specific tool would benefit EM educators and students. Methods A two-day national consensus conference was held in March 2016 in the Clerkship Directors in Emergency Medicine (CDEM) track at the Council of Residency Directors in Emergency Medicine (CORD) Academic Assembly in Nashville, TN. The goal of this conference was to standardize assessment practices and to create a national clinical assessment tool for use in EM clerkships across the country. Conference leaders synthesized the literature, articulated major themes and questions pertinent to clinical assessment of students in EM, clarified the issues, and outlined the consensus-building process prior to consensus-building activities. Results The first day of the conference was dedicated to developing consensus on these key themes in clinical assessment. The second day of the conference was dedicated to discussing and voting on proposed domains to be included in the national clinical assessment tool. A modified Delphi process was initiated after the conference to reconcile questions and items that did not reach an a priori level of consensus. Conclusion The final tool, the National Clinical Assessment Tool for Medical Students in Emergency Medicine (NCAT-EM) is presented here. PMID:29383058

A Rapid Assessment Tool for affirming good practice in midwifery education programming.

PubMed

Fullerton, Judith T; Johnson, Peter; Lobe, Erika; Myint, Khine Haymar; Aung, Nan Nan; Moe, Thida; Linn, Nay Aung

2016-03-01

to design a criterion-referenced assessment tool that could be used globally in a rapid assessment of good practices and bottlenecks in midwifery education programs. a standard tool development process was followed, to generate standards and reference criteria; followed by external review and field testing to document psychometric properties. review of standards and scoring criteria were conducted by stakeholders around the globe. Field testing of the tool was conducted in Myanmar. eleven of Myanmar׳s 22 midwifery education programs participated in the assessment. the clinimetric tool was demonstrated to have content validity and high inter-rater reliability in use. a globally validated tool, and accompanying user guide and handbook are now available for conducting rapid assessments of compliance with good practice criteria in midwifery education programming. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Development of a self-assessment teamwork tool for use by medical and nursing students.

PubMed

Gordon, Christopher J; Jorm, Christine; Shulruf, Boaz; Weller, Jennifer; Currie, Jane; Lim, Renee; Osomanski, Adam

2016-08-24

Teamwork training is an essential component of health professional student education. A valid and reliable teamwork self-assessment tool could assist students to identify desirable teamwork behaviours with the potential to promote learning about effective teamwork. The aim of this study was to develop and evaluate a self-assessment teamwork tool for health professional students for use in the context of emergency response to a mass casualty. The authors modified a previously published teamwork instrument designed for experienced critical care teams for use with medical and nursing students involved in mass casualty simulations. The 17-item questionnaire was administered to students immediately following the simulations. These scores were used to explore the psychometric properties of the tool, using Exploratory and Confirmatory Factor Analysis. 202 (128 medical and 74 nursing) students completed the self-assessment teamwork tool for students. Exploratory factor analysis revealed 2 factors (5 items - Teamwork coordination and communication; 4 items - Information sharing and support) and these were justified with confirmatory factor analysis. Internal consistency was 0.823 for Teamwork coordination and communication, and 0.812 for Information sharing and support. These data provide evidence to support the validity and reliability of the self-assessment teamwork tool for students This self-assessment tool could be of value to health professional students following team training activities to help them identify the attributes of effective teamwork.

Development, Validation, and Verification of a Self-Assessment Tool to Estimate Agnibala (Digestive Strength).

PubMed

Singh, Aparna; Singh, Girish; Patwardhan, Kishor; Gehlot, Sangeeta

2017-01-01

According to Ayurveda, the traditional system of healthcare of Indian origin, Agni is the factor responsible for digestion and metabolism. Four functional states (Agnibala) of Agni have been recognized: regular, irregular, intense, and weak. The objective of the present study was to develop and validate a self-assessment tool to estimate Agnibala The developed tool was evaluated for its reliability and validity by administering it to 300 healthy volunteers of either gender belonging to 18 to 40-year age group. Besides confirming the statistical validity and reliability, the practical utility of the newly developed tool was also evaluated by recording serum lipid parameters of all the volunteers. The results show that the lipid parameters vary significantly according to the status of Agni The tool, therefore, may be used to screen normal population to look for possible susceptibility to certain health conditions. © The Author(s) 2016.

Survey Tools for Faculty to Quickly Assess Multidisciplinary Team Dynamics in Capstone Courses

ERIC Educational Resources Information Center

Solnosky, Ryan; Fairchild, Joshua

2017-01-01

Many engineering faculty have limited skills and/or assessment tools to evaluate team dynamics in multidisciplinary team-based capstone courses. Rapidly deployable tools are needed here to provide proactive feedback to teams to facilitate deeper learning. Two surveys were developed based on industrial and organizational psychology theories around…

Designing Online Assessment Tools for Disengaged Youth

ERIC Educational Resources Information Center

Brader, Andy; Luke, Allan; Klenowski, Val; Connolly, Stephen; Behzadpour, Adib

2014-01-01

This article reports on the development of online assessment tools for disengaged youth in flexible learning environments. Sociocultural theories of learning and assessment and Bourdieu's sociological concepts of capital and exchange were used to design a purpose-built content management system. This design experiment engaged participants in…

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED TOOL FOR WATERSHED ASSESSMENT AND PLANNING

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University of Wyoming to automate the parameterization and execu...

Toolkit of Available EPA Green Infrastructure Modeling ...

EPA Pesticide Factsheets

This webinar will present a toolkit consisting of five EPA green infrastructure models and tools, along with communication material. This toolkit can be used as a teaching and quick reference resource for use by planners and developers when making green infrastructure implementation decisions. It can also be used for low impact development design competitions. Models and tools included: Green Infrastructure Wizard (GIWiz), Watershed Management Optimization Support Tool (WMOST), Visualizing Ecosystem Land Management Assessments (VELMA) Model, Storm Water Management Model (SWMM), and the National Stormwater Calculator (SWC). This webinar will present a toolkit consisting of five EPA green infrastructure models and tools, along with communication material. This toolkit can be used as a teaching and quick reference resource for use by planners and developers when making green infrastructure implementation decisions. It can also be used for low impact development design competitions. Models and tools included: Green Infrastructure Wizard (GIWiz), Watershed Management Optimization Support Tool (WMOST), Visualizing Ecosystem Land Management Assessments (VELMA) Model, Storm Water Management Model (SWMM), and the National Stormwater Calculator (SWC).

Development and Inter-Rater Reliability of the Liverpool Adverse Drug Reaction Causality Assessment Tool

PubMed Central

Gallagher, Ruairi M.; Kirkham, Jamie J.; Mason, Jennifer R.; Bird, Kim A.; Williamson, Paula R.; Nunn, Anthony J.; Turner, Mark A.; Smyth, Rosalind L.; Pirmohamed, Munir

2011-01-01

Aim To develop and test a new adverse drug reaction (ADR) causality assessment tool (CAT). Methods A comparison between seven assessors of a new CAT, formulated by an expert focus group, compared with the Naranjo CAT in 80 cases from a prospective observational study and 37 published ADR case reports (819 causality assessments in total). Main Outcome Measures Utilisation of causality categories, measure of disagreements, inter-rater reliability (IRR). Results The Liverpool ADR CAT, using 40 cases from an observational study, showed causality categories of 1 unlikely, 62 possible, 92 probable and 125 definite (1, 62, 92, 125) and ‘moderate’ IRR (kappa 0.48), compared to Naranjo (0, 100, 172, 8) with ‘moderate’ IRR (kappa 0.45). In a further 40 cases, the Liverpool tool (0, 66, 81, 133) showed ‘good’ IRR (kappa 0.6) while Naranjo (1, 90, 185, 4) remained ‘moderate’. Conclusion The Liverpool tool assigns the full range of causality categories and shows good IRR. Further assessment by different investigators in different settings is needed to fully assess the utility of this tool. PMID:22194808

Development of an Outcome Measurement Tool for a Teen Parent Wraparound Program

ERIC Educational Resources Information Center

Fries, Derrick; Carney, Karen J.; Blackman-Urteaga, Laura; Savas, Sue Ann

2012-01-01

This article chronicles the search for and development of an outcome measurement tool for teen parents receiving community-based wraparound services. The criteria for selecting functional assessment tools available in the literature is presented along with the barriers experienced in using two of these well-cited tools. The rationale for in-house…

Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations.

PubMed

Mustafa, Reem A; Wiercioch, Wojtek; Falavigna, Maicon; Zhang, Yuan; Ivanova, Liudmila; Arevalo-Rodriguez, Ingrid; Cheung, Adrienne; Prediger, Barbara; Ventresca, Matthew; Brozek, Jan; Santesso, Nancy; Bossuyt, Patrick; Garg, Amit X; Lloyd, Nancy; Lelgemann, Monika; Bühler, Diedrich; Schünemann, Holger J

2017-12-01

The objective of this study was to identify and describe critical appraisal tools designed for assessing the quality of evidence (QoE) and/or strength of recommendations (SoRs) related to health care-related tests and diagnostic strategies (HCTDSs). We conducted a systematic review to identify tools applied in guidelines, methodological articles, and systematic reviews to assess HCTDS. We screened 5,534 titles and abstracts, 1,004 full-text articles, and abstracted data from 330 references. We identified 29 tools and 14 modifications of existing tools for assessing QoE and SoR. Twenty-three out of 29 tools acknowledge the importance of assessing the QoE and SoR separately, but in 8, the SoR is based solely on QoE. When making decisions about the use of tests, patient values and preferences and impact on resource utilization were considered in 6 and 8 tools, respectively. There is also confusion about the terminology that describes the various factors that influence the QoE and SoR. Although at least one approach includes all relevant criteria for assessing QoE and determining SoR, more detailed guidance about how to operationalize these assessments and make related judgments will be beneficial. There is a need for a better description of the framework for using evidence to make decisions and develop recommendations about HCTDS. Copyright © 2017 Elsevier Inc. All rights reserved.

Systematic Sustainability Assessment (SSA) Tool for Hydroelectric Project in Malaysia

NASA Astrophysics Data System (ADS)

Turan, Faiz Mohd; Johan, Kartina

2017-08-01

Sustainably developed and managed hydropower has enormous potential to contribute to global sustainability goals. It is known that hydroelectricity contributing small amounts to greenhouse gas emissions and other atmospheric pollutants. However, developing the remaining hydroelectric potential offers many challenges, and public pressure and expectations on the environmental and social performance of hydroelectric tend to increase over time. This paper aims to develop Systematic Sustainability Assessment (SSA) Tool that promotes and guides more sustainable hydroelectric projects in the context of Malaysia. The proposed SSA tool which not only provide a quality and quantitative report of sustainability performance but also act as Self-Assessment Report (SAR) to provide roadmap to achieve greater level of sustainability in project management for continuous improvement. It is expected to provide a common language that allow government, civil society, financial institutions and the hydroelectric sector to talk about and evaluate sustainability issues. The advantage of SSA tool is it can be used at any stage of hydroelectric development, from the earliest planning stages right through to operation.

Interventions and assessment tools addressing key concepts people need to know to appraise claims about treatment effects: a systematic mapping review.

PubMed

Austvoll-Dahlgren, Astrid; Nsangi, Allen; Semakula, Daniel

2016-12-29

People's ability to appraise claims about treatment effects is crucial for informed decision-making. Our objective was to systematically map this area of research in order to (a) provide an overview of interventions targeting key concepts that people need to understand to assess treatment claims and (b) to identify assessment tools used to evaluate people's understanding of these concepts. The findings of this review provide a starting point for decisions about which key concepts to address when developing new interventions, and which assessment tools should be considered. We conducted a systematic mapping review of interventions and assessment tools addressing key concepts important for people to be able to assess treatment claims. A systematic literature search was done by a reserach librarian in relevant databases. Judgement about inclusion of studies and data collection was done by at least two researchers. We included all quantitative study designs targeting one or more of the key concepts, and targeting patients, healthy members of the public, and health professionals. The studies were divided into four categories: risk communication and decision aids, evidence-based medicine and critical appraisal, understanding of controlled trials, and science education. Findings were summarised descriptively. We included 415 studies, of which the interventions and assessment tools we identified included only a handful of the key concepts. The most common key concepts in interventions were "Treatments usually have beneficial and harmful effects," "Treatment comparisons should be fair," "Compare like with like," and "Single studies can be misleading." A variety of assessment tools were identified, but only four assessment tools included 10 or more key concepts. There is great potential for developing learning and assessment tools targeting key concepts that people need to understand to assess claims about treatment effects. There is currently no instrument covering assessment of all these key concepts.

Two Thinking Skills Assessment Approaches: "Assessment of Pupils' Thinking Skills" and "Individual Thinking Skills Assessments"

ERIC Educational Resources Information Center

Burke, Lynsey A.; Williams, Joanne M.

2012-01-01

This paper is linked to a previous paper outlining an evaluation of a thinking skills intervention (Burke & Williams, 2008). Following extensive requests for the assessment tools used in the intervention, this short paper presents the development and potential uses of two thinking skills assessment tools. The aim of the paper is simply to make…

A quality assessment tool for markup-based clinical guidelines.

PubMed

Shalom, Erez; Shahar, Yuval; Taieb-Maimon, Meirav; Lunenfeld, Eitan

2008-11-06

We introduce a tool for quality assessment of procedural and declarative knowledge. We developed this tool for evaluating the specification of mark-up-based clinical GLs. Using this graphical tool, the expert physician and knowledge engineer collaborate to perform scoring, using pre-defined scoring scale, each of the knowledge roles of the mark-ups, comparing it to a gold standard. The tool enables scoring the mark-ups simultaneously at different sites by different users at different locations.

Assessing the nutritional status of hospitalized elderly.

PubMed

Abd Aziz, Nur Adilah Shuhada; Teng, Nur Islami Mohd Fahmi; Abdul Hamid, Mohd Ramadan; Ismail, Nazrul Hadi

2017-01-01

The increasing number of elderly people worldwide throughout the years is concerning due to the health problems often faced by this population. This review aims to summarize the nutritional status among hospitalized elderly and the role of the nutritional assessment tools in this issue. A literature search was performed on six databases using the terms "malnutrition", "hospitalised elderly", "nutritional assessment", "Mini Nutritional Assessment (MNA)", "Geriatric Nutrition Risk Index (GNRI)", and "Subjective Global Assessment (SGA)". According to the previous studies, the prevalence of malnutrition among hospitalized elderly shows an increasing trend not only locally but also across the world. Under-recognition of malnutrition causes the number of malnourished hospitalized elderly to remain high throughout the years. Thus, the development of nutritional screening and assessment tools has been widely studied, and these tools are readily available nowadays. SGA, MNA, and GNRI are the nutritional assessment tools developed specifically for the elderly and are well validated in most countries. However, to date, there is no single tool that can be considered as the universal gold standard for the diagnosis of nutritional status in hospitalized patients. It is important to identify which nutritional assessment tool is suitable to be used in this group to ensure that a structured assessment and documentation of nutritional status can be established. An early and accurate identification of the appropriate treatment of malnutrition can be done as soon as possible, and thus, the malnutrition rate among this group can be minimized in the future.

A Systematic Review of Tools Used to Assess Team Leadership in Health Care Action Teams.

PubMed

Rosenman, Elizabeth D; Ilgen, Jonathan S; Shandro, Jamie R; Harper, Amy L; Fernandez, Rosemarie

2015-10-01

To summarize the characteristics of tools used to assess leadership in health care action (HCA) teams. HCA teams are interdisciplinary teams performing complex, critical tasks under high-pressure conditions. The authors conducted a systematic review of the PubMed/MEDLINE, CINAHL, ERIC, EMBASE, PsycINFO, and Web of Science databases, key journals, and review articles published through March 2012 for English-language articles that applied leadership assessment tools to HCA teams in all specialties. Pairs of reviewers assessed identified articles for inclusion and exclusion criteria and abstracted data on study characteristics, tool characteristics, and validity evidence. Of the 9,913 abstracts screened, 83 studies were included. They described 61 team leadership assessment tools. Forty-nine tools (80%) provided behaviors, skills, or characteristics to define leadership. Forty-four tools (72%) assessed leadership as one component of a larger assessment, 13 tools (21%) identified leadership as the primary focus of the assessment, and 4 (7%) assessed leadership style. Fifty-three studies (64%) assessed leadership at the team level; 29 (35%) did so at the individual level. Assessments of simulated (n = 55) and live (n = 30) patient care events were performed. Validity evidence included content validity (n = 75), internal structure (n = 61), relationship to other variables (n = 44), and response process (n = 15). Leadership assessment tools applied to HCA teams are heterogeneous in content and application. Comparisons between tools are limited by study variability. A systematic approach to team leadership tool development, evaluation, and implementation will strengthen understanding of this important competency.

Becoming with Data: Developing Self-Assessing Recursive Pedagogies in Schools and Using Second-Order Cybernetics as a Thinking Tool

ERIC Educational Resources Information Center

Reinertsen, Anne Beate

2014-01-01

This article is about developing school-based self-assessing recursive pedagogies and case/action research practices and/or approaches in schools, and teachers, teacher researchers and researchers simultaneously producing and theorising their own practices using second-order cybernetics as a thinking tool. It is a move towards pragmatic…

Development of the Biology Card Sorting Task to Measure Conceptual Expertise in Biology

ERIC Educational Resources Information Center

Smith, Julia I.; Combs, Elijah D.; Nagami, Paul H.; Alto, Valerie M.; Goh, Henry G.; Gourdet, Muryam A. A.; Hough, Christina M.; Nickell, Ashley E.; Peer, Adrian G.; Coley, John D.; Tanner, Kimberly D.

2013-01-01

There are widespread aspirations to focus undergraduate biology education on teaching students to think conceptually like biologists; however, there is a dearth of assessment tools designed to measure progress from novice to expert biological conceptual thinking. We present the development of a novel assessment tool, the Biology Card Sorting Task,…

Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

ERIC Educational Resources Information Center

Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

2017-01-01

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

An ergonomic approach to improve work conditions of older employees in social housing.

PubMed

Biquand, Sylvain; Heddad, Nadia

2012-01-01

French companies are legally required to develop action plans to improve employment and work conditions for older workers ("plans seniors"). These plans contain measures oriented towards recruiting, career evolution, skills developme1nt, knowledge transmission and improvement of work conditions. A tool for assessing work situations experienced by council buildings caretakers ("gardiens") was used in such a plan on behalf of the main agency of council housing in Paris, and we developed. This assessment tool was developed after ergonomic work analysis on a sample of 36 older caretakers (age > 57 y.o). The technical inspectors in charge of technical interventions on buildings and managing caretakers were trained to use the assessment tool and apply it to all caretakers aged 50 and over.

Modeling and Simulation Tools for Heavy Lift Airships

NASA Technical Reports Server (NTRS)

Hochstetler, Ron; Chachad, Girish; Hardy, Gordon; Blanken, Matthew; Melton, John

2016-01-01

For conventional fixed wing and rotary wing aircraft a variety of modeling and simulation tools have been developed to provide designers the means to thoroughly investigate proposed designs and operational concepts. However, lighter-than-air (LTA) airships, hybrid air vehicles, and aerostats have some important aspects that are different from heavier-than-air (HTA) vehicles. In order to account for these differences, modifications are required to the standard design tools to fully characterize the LTA vehicle design and performance parameters.. To address these LTA design and operational factors, LTA development organizations have created unique proprietary modeling tools, often at their own expense. An expansion of this limited LTA tool set could be accomplished by leveraging existing modeling and simulation capabilities available in the National laboratories and public research centers. Development of an expanded set of publicly available LTA modeling and simulation tools for LTA developers would mitigate the reliance on proprietary LTA design tools in use today. A set of well researched, open source, high fidelity LTA design modeling and simulation tools would advance LTA vehicle development and also provide the analytical basis for accurate LTA operational cost assessments. This paper will present the modeling and analysis tool capabilities required for LTA vehicle design, analysis of operations, and full life-cycle support. A survey of the tools currently available will be assessed to identify the gaps between their capabilities and the LTA industry's needs. Options for development of new modeling and analysis capabilities to supplement contemporary tools will also be presented.

Development of a tool to support holistic generic assessment of clinical procedure skills.

PubMed

McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

2008-06-01

The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

Multi-criteria decision analysis of breast cancer control in low- and middle- income countries: development of a rating tool for policy makers.

PubMed

Venhorst, Kristie; Zelle, Sten G; Tromp, Noor; Lauer, Jeremy A

2014-01-01

The objective of this study was to develop a rating tool for policy makers to prioritize breast cancer interventions in low- and middle- income countries (LMICs), based on a simple multi-criteria decision analysis (MCDA) approach. The definition and identification of criteria play a key role in MCDA, and our rating tool could be used as part of a broader priority setting exercise in a local setting. This tool may contribute to a more transparent priority-setting process and fairer decision-making in future breast cancer policy development. First, an expert panel (n = 5) discussed key considerations for tool development. A literature review followed to inventory all relevant criteria and construct an initial set of criteria. A Delphi study was then performed and questionnaires used to discuss a final list of criteria with clear definitions and potential scoring scales. For this Delphi study, multiple breast cancer policy and priority-setting experts from different LMICs were selected and invited by the World Health Organization. Fifteen international experts participated in all three Delphi rounds to assess and evaluate each criterion. This study resulted in a preliminary rating tool for assessing breast cancer interventions in LMICs. The tool consists of 10 carefully crafted criteria (effectiveness, quality of the evidence, magnitude of individual health impact, acceptability, cost-effectiveness, technical complexity, affordability, safety, geographical coverage, and accessibility), with clear definitions and potential scoring scales. This study describes the development of a rating tool to assess breast cancer interventions in LMICs. Our tool can offer supporting knowledge for the use or development of rating tools as part of a broader (MCDA based) priority setting exercise in local settings. Further steps for improving the tool are proposed and should lead to its useful adoption in LMICs.

Technical skills assessment toolbox: a review using the unitary framework of validity.

PubMed

Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

2015-02-01

The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

Assessing Competencies Needed to Engage With Digital Health Services: Development of the eHealth Literacy Assessment Toolkit.

PubMed

Karnoe, Astrid; Furstrand, Dorthe; Christensen, Karl Bang; Norgaard, Ole; Kayser, Lars

2018-05-10

To achieve full potential in user-oriented eHealth projects, we need to ensure a match between the eHealth technology and the user's eHealth literacy, described as knowledge and skills. However, there is a lack of multifaceted eHealth literacy assessment tools suitable for screening purposes. The objective of our study was to develop and validate an eHealth literacy assessment toolkit (eHLA) that assesses individuals' health literacy and digital literacy using a mix of existing and newly developed scales. From 2011 to 2015, scales were continuously tested and developed in an iterative process, which led to 7 tools being included in the validation study. The eHLA validation version consisted of 4 health-related tools (tool 1: "functional health literacy," tool 2: "health literacy self-assessment," tool 3: "familiarity with health and health care," and tool 4: "knowledge of health and disease") and 3 digitally-related tools (tool 5: "technology familiarity," tool 6: "technology confidence," and tool 7: "incentives for engaging with technology") that were tested in 475 respondents from a general population sample and an outpatient clinic. Statistical analyses examined floor and ceiling effects, interitem correlations, item-total correlations, and Cronbach coefficient alpha (CCA). Rasch models (RM) examined the fit of data. Tools were reduced in items to secure robust tools fit for screening purposes. Reductions were made based on psychometrics, face validity, and content validity. Tool 1 was not reduced in items; it consequently consists of 10 items. The overall fit to the RM was acceptable (Anderson conditional likelihood ratio, CLR=10.8; df=9; P=.29), and CCA was .67. Tool 2 was reduced from 20 to 9 items. The overall fit to a log-linear RM was acceptable (Anderson CLR=78.4, df=45, P=.002), and CCA was .85. Tool 3 was reduced from 23 to 5 items. The final version showed excellent fit to a log-linear RM (Anderson CLR=47.7, df=40, P=.19), and CCA was .90. Tool 4 was reduced from 12 to 6 items. The fit to a log-linear RM was acceptable (Anderson CLR=42.1, df=18, P=.001), and CCA was .59. Tool 5 was reduced from 20 to 6 items. The fit to the RM was acceptable (Anderson CLR=30.3, df=17, P=.02), and CCA was .94. Tool 6 was reduced from 5 to 4 items. The fit to a log-linear RM taking local dependency (LD) into account was acceptable (Anderson CLR=26.1, df=21, P=.20), and CCA was .91. Tool 7 was reduced from 6 to 4 items. The fit to a log-linear RM taking LD and differential item functioning into account was acceptable (Anderson CLR=23.0, df=29, P=.78), and CCA was .90. The eHLA consists of 7 short, robust scales that assess individual's knowledge and skills related to digital literacy and health literacy. ©Astrid Karnoe, Dorthe Furstrand, Karl Bang Christensen, Ole Norgaard, Lars Kayser. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 10.05.2018.

Ares Project Technology Assessment: Approach and Tools

NASA Technical Reports Server (NTRS)

Hueter, Uwe; Tyson, Richard

2010-01-01

Technology assessments provide a status of the development maturity of specific technologies. Along with benefit analysis, the risks the project assumes can be quantified. Normally due to budget constraints, the competing technologies are prioritized and decisions are made which ones to fund. A detailed technology development plan is produced for the selected technologies to provide a roadmap to reach the desired maturity by the project s critical design review. Technology assessments can be conducted for both technology only tasks or for product development programs. This paper is primarily biased toward the product development programs. The paper discusses the Ares Project s approach to technology assessment. System benefit analysis, risk assessment, technology prioritization, and technology readiness assessment are addressed. A description of the technology readiness level tool being used is provided.

Preparing for Euro 2012: developing a hazard risk assessment.

PubMed

Wong, Evan G; Razek, Tarek; Luhovy, Artem; Mogilevkina, Irina; Prudnikov, Yuriy; Klimovitskiy, Fedor; Yutovets, Yuriy; Khwaja, Kosar A; Deckelbaum, Dan L

2015-04-01

Risk assessment is a vital step in the disaster-preparedness continuum as it is the foundation of subsequent phases, including mitigation, response, and recovery. To develop a risk assessment tool geared specifically towards the Union of European Football Associations (UEFA) Euro 2012. In partnership with the Donetsk National Medical University, Donetsk Research and Development Institute of Traumatology and Orthopedics, Donetsk Regional Public Health Administration, and the Ministry of Emergency of Ukraine, a table-based tool was created, which, based on historical evidence, identifies relevant potential threats, evaluates their impacts and likelihoods on graded scales based on previous available data, identifies potential mitigating shortcomings, and recommends further mitigation measures. This risk assessment tool has been applied in the vulnerability-assessment-phase of the UEFA Euro 2012. Twenty-three sub-types of potential hazards were identified and analyzed. Ten specific hazards were recognized as likely to very likely to occur, including natural disasters, bombing and blast events, road traffic collisions, and disorderly conduct. Preventative measures, such as increased stadium security and zero tolerance for impaired driving, were recommended. Mitigating factors were suggested, including clear, incident-specific preparedness plans and enhanced inter-agency communication. This hazard risk assessment tool is a simple aid in vulnerability assessment, essential for disaster preparedness and response, and may be applied broadly to future international events.

The Influence of an Internet-Based Formative Assessment Tool on Primary Grades Students' Number Sense Achievement

ERIC Educational Resources Information Center

Polly, Drew; Wang, Chuang; Martin, Christie; Lambert, Richard G.; Pugalee, David K.; Middleton, Catharina Win

2017-01-01

This study examined primary grades students' achievement on number sense tasks administered through an Internet-based formative assessment tool, Assessing Math Concepts Anywhere. Data were analyzed from 2,357 students in teachers' classrooms who had participated in a year-long professional development program on mathematics formative assessment,…

A Web-Based Course Assessment Tool with Direct Mapping to Student Outcomes

ERIC Educational Resources Information Center

Ibrahim, Walid; Atif, Yacine; Shuaib, Khaled; Sampson, Demetrios

2015-01-01

The assessment of curriculum outcomes is an essential element for continuous academic improvement. However, the collection, aggregation and analysis of assessment data are notoriously complex and time-consuming processes. At the same time, only few developments of supporting electronic processes and tools for continuous academic program assessment…

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYDROLOGIC MODELING TOOL FOR WATERSHED ASSESSMENT AND ANALYSIS

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University of Wyoming to automate the parameterization and execu...

AUTOMATED GEOSPATICAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYDROLOICAL MODELING TOOL FOR WATERSHED ASSESSMENT AND ANALYSIS

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University of Wyoming to automate the parameterization and execut...

PREDICTING LEVELS OF STRESS FROM BIOLOGICAL ASSESSMENT DATA: EMPIRICAL MODELS FROM THE EASTERN CORN BELT PLAINS

EPA Science Inventory

Biological assessment is becoming an increasingly popular tool in the evaluation of stream ecosystem integrity. However, little progress has been made to date in developing tools to relate assessment results to specific stressors. This paper continues the investigation of the f...

Development of a Palliative Education Assessment Tool for Medical Student Education.

ERIC Educational Resources Information Center

Meekin, Sharon Abele; Klein, Jason E.; Fleischman, Alan R.; Fins, Joseph J.

2000-01-01

Describes the Palliative Education Assessment Tool (PEAT), an innovative assessment to facilitate curricular mapping of palliative care education. The PEAT comprises seven palliative care domains, each of which details specific objectives of knowledge, skills, and attitudes. PEAT enables educators to describe a specific multidimensional aspect of…

Assessment of health risks of policies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ádám, Balázs, E-mail: badam@cmss.sdu.dk; Department of Preventive Medicine, Faculty of Public Health, University of Debrecen, P.O. Box 9, H-4012 Debrecen; Molnár, Ágnes, E-mail: MolnarAg@smh.ca

The assessment of health risks of policies is an inevitable, although challenging prerequisite for the inclusion of health considerations in political decision making. The aim of our project was to develop a so far missing methodological guide for the assessment of the complex impact structure of policies. The guide was developed in a consensual way based on experiences gathered during the assessment of specific national policies selected by the partners of an EU project. Methodological considerations were discussed and summarized in workshops and pilot tested on the EU Health Strategy for finalization. The combined tool, which includes a textual guidancemore » and a checklist, follows the top-down approach, that is, it guides the analysis of causal chains from the policy through related health determinants and risk factors to health outcomes. The tool discusses the most important practical issues of assessment by impact level. It emphasises the transparent identification and prioritisation of factors, the consideration of the feasibility of exposure and outcome assessment with special focus on quantification. The developed guide provides useful methodological instructions for the comprehensive assessment of health risks of policies that can be effectively used in the health impact assessment of policy proposals. - Highlights: • Methodological guide for the assessment of health risks of policies is introduced. • The tool is developed based on the experiences from several case studies. • The combined tool consists of a textual guidance and a checklist. • The top-down approach is followed through the levels of the full impact chain. • The guide provides assistance for the health impact assessment of policy proposals.« less

Application of the GEM Inventory Data Capture Tools for Dynamic Vulnerability Assessment and Recovery Modelling

NASA Astrophysics Data System (ADS)

Verrucci, Enrica; Bevington, John; Vicini, Alessandro

2014-05-01

A set of open-source tools to create building exposure datasets for seismic risk assessment was developed from 2010-13 by the Inventory Data Capture Tools (IDCT) Risk Global Component of the Global Earthquake Model (GEM). The tools were designed to integrate data derived from remotely-sensed imagery, statistically-sampled in-situ field data of buildings to generate per-building and regional exposure data. A number of software tools were created to aid the development of these data, including mobile data capture tools for in-field structural assessment, and the Spatial Inventory Data Developer (SIDD) for creating "mapping schemes" - statistically-inferred distributions of building stock applied to areas of homogeneous urban land use. These tools were made publically available in January 2014. Exemplar implementations in Europe and Central Asia during the IDCT project highlighted several potential application areas beyond the original scope of the project. These are investigated here. We describe and demonstrate how the GEM-IDCT suite can be used extensively within the framework proposed by the EC-FP7 project SENSUM (Framework to integrate Space-based and in-situ sENSing for dynamic vUlnerability and recovery Monitoring). Specifically, applications in the areas of 1) dynamic vulnerability assessment (pre-event), and 2) recovery monitoring and evaluation (post-event) are discussed. Strategies for using the IDC Tools for these purposes are discussed. The results demonstrate the benefits of using advanced technology tools for data capture, especially in a systematic fashion using the taxonomic standards set by GEM. Originally designed for seismic risk assessment, it is clear the IDCT tools have relevance for multi-hazard risk assessment. When combined with a suitable sampling framework and applied to multi-temporal recovery monitoring, data generated from the tools can reveal spatio-temporal patterns in the quality of recovery activities and resilience trends can be inferred. Lastly, this work draws attention to the use of the IDCT suite as an education resource for inspiring and training new students and engineers in the field of disaster risk reduction.

Primary care physicians' perspectives on computer-based health risk assessment tools for chronic diseases: a mixed methods study.

PubMed

Voruganti, Teja R; O'Brien, Mary Ann; Straus, Sharon E; McLaughlin, John R; Grunfeld, Eva

2015-09-24

Health risk assessment tools compute an individual's risk of developing a disease. Routine use of such tools by primary care physicians (PCPs) is potentially useful in chronic disease prevention. We sought physicians' awareness and perceptions of the usefulness, usability and feasibility of performing assessments with computer-based risk assessment tools in primary care settings. Focus groups and usability testing with a computer-based risk assessment tool were conducted with PCPs from both university-affiliated and community-based practices. Analysis was derived from grounded theory methodology. PCPs (n = 30) were aware of several risk assessment tools although only select tools were used routinely. The decision to use a tool depended on how use impacted practice workflow and whether the tool had credibility. Participants felt that embedding tools in the electronic medical records (EMRs) system might allow for health information from the medical record to auto-populate into the tool. User comprehension of risk could also be improved with computer-based interfaces that present risk in different formats. In this study, PCPs chose to use certain tools more regularly because of usability and credibility. Despite there being differences in the particular tools a clinical practice used, there was general appreciation for the usefulness of tools for different clinical situations. Participants characterised particular features of an ideal tool, feeling strongly that embedding risk assessment tools in the EMR would maximise accessibility and use of the tool for chronic disease management. However, appropriate practice workflow integration and features that facilitate patient understanding at point-of-care are also essential.

Self-Report Dietary Assessment Tools Used in Canadian Research: A Scoping Review123

PubMed Central

Vanderlee, Lana; Raffoul, Amanda; Stapleton, Jackie; Csizmadi, Ilona; Boucher, Beatrice A; Massarelli, Isabelle; Rondeau, Isabelle

2017-01-01

Choosing the most appropriate dietary assessment tool for a study can be a challenge. Through a scoping review, we characterized self-report tools used to assess diet in Canada to identify patterns in tool use and to inform strategies to strengthen nutrition research. The research databases Medline, PubMed, PsycINFO, and CINAHL were used to identify Canadian studies published from 2009 to 2014 that included a self-report assessment of dietary intake. The search elicited 2358 records that were screened to identify those that reported on self-report dietary intake among nonclinical, non-Aboriginal adult populations. A pool of 189 articles (reflecting 92 studies) was examined in-depth to assess the dietary assessment tools used. Food-frequency questionnaires (FFQs) and screeners were used in 64% of studies, whereas food records and 24-h recalls were used in 18% and 14% of studies, respectively. Three studies (3%) used a single question to assess diet, and for 3 studies the tool used was not clear. A variety of distinct FFQs and screeners, including those developed and/or adapted for use in Canada and those developed elsewhere, were used. Some tools were reported to have been evaluated previously in terms of validity or reliability, but details of psychometric testing were often lacking. Energy and fat were the most commonly studied, reported by 42% and 39% of studies, respectively. For ∼20% of studies, dietary data were used to assess dietary quality or patterns, whereas close to half assessed ≤5 dietary components. A variety of dietary assessment tools are used in Canadian research. Strategies to improve the application of current evidence on best practices in dietary assessment have the potential to support a stronger and more cohesive literature on diet and health. Such strategies could benefit from national and global collaboration. PMID:28298272

ROBIS: A new tool to assess risk of bias in systematic reviews was developed.

PubMed

Whiting, Penny; Savović, Jelena; Higgins, Julian P T; Caldwell, Deborah M; Reeves, Barnaby C; Shea, Beverley; Davies, Philippa; Kleijnen, Jos; Churchill, Rachel

2016-01-01

To develop ROBIS, a new tool for assessing the risk of bias in systematic reviews (rather than in primary studies). We used four-stage approach to develop ROBIS: define the scope, review the evidence base, hold a face-to-face meeting, and refine the tool through piloting. ROBIS is currently aimed at four broad categories of reviews mainly within health care settings: interventions, diagnosis, prognosis, and etiology. The target audience of ROBIS is primarily guideline developers, authors of overviews of systematic reviews ("reviews of reviews"), and review authors who might want to assess or avoid risk of bias in their reviews. The tool is completed in three phases: (1) assess relevance (optional), (2) identify concerns with the review process, and (3) judge risk of bias. Phase 2 covers four domains through which bias may be introduced into a systematic review: study eligibility criteria; identification and selection of studies; data collection and study appraisal; and synthesis and findings. Phase 3 assesses the overall risk of bias in the interpretation of review findings and whether this considered limitations identified in any of the phase 2 domains. Signaling questions are included to help judge concerns with the review process (phase 2) and the overall risk of bias in the review (phase 3); these questions flag aspects of review design related to the potential for bias and aim to help assessors judge risk of bias in the review process, results, and conclusions. ROBIS is the first rigorously developed tool designed specifically to assess the risk of bias in systematic reviews. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

ROBIS: A new tool to assess risk of bias in systematic reviews was developed

PubMed Central

Whiting, Penny; Savović, Jelena; Higgins, Julian P.T.; Caldwell, Deborah M.; Reeves, Barnaby C.; Shea, Beverley; Davies, Philippa; Kleijnen, Jos; Churchill, Rachel

2016-01-01

Objective To develop ROBIS, a new tool for assessing the risk of bias in systematic reviews (rather than in primary studies). Study Design and Setting We used four-stage approach to develop ROBIS: define the scope, review the evidence base, hold a face-to-face meeting, and refine the tool through piloting. Results ROBIS is currently aimed at four broad categories of reviews mainly within health care settings: interventions, diagnosis, prognosis, and etiology. The target audience of ROBIS is primarily guideline developers, authors of overviews of systematic reviews (“reviews of reviews”), and review authors who might want to assess or avoid risk of bias in their reviews. The tool is completed in three phases: (1) assess relevance (optional), (2) identify concerns with the review process, and (3) judge risk of bias. Phase 2 covers four domains through which bias may be introduced into a systematic review: study eligibility criteria; identification and selection of studies; data collection and study appraisal; and synthesis and findings. Phase 3 assesses the overall risk of bias in the interpretation of review findings and whether this considered limitations identified in any of the phase 2 domains. Signaling questions are included to help judge concerns with the review process (phase 2) and the overall risk of bias in the review (phase 3); these questions flag aspects of review design related to the potential for bias and aim to help assessors judge risk of bias in the review process, results, and conclusions. Conclusions ROBIS is the first rigorously developed tool designed specifically to assess the risk of bias in systematic reviews. PMID:26092286

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review

PubMed Central

Dall, PM; Coulter, EH; Fitzsimons, CF; Skelton, DA; Chastin, SFM

2017-01-01

Objective Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. Design A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Data sources Systematic searches were conducted via EBSCO, reference lists and expert opinion. Eligibility criteria for selecting studies The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. Results The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Conclusions Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. Trial registration number International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. PMID:28391233

Development of computer-based analytical tool for assessing physical protection system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mardhi, Alim, E-mail: alim-m@batan.go.id; Chulalongkorn University, Faculty of Engineering, Nuclear Engineering Department, 254 Phayathai Road, Pathumwan, Bangkok Thailand. 10330; Pengvanich, Phongphaeth, E-mail: ppengvan@gmail.com

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work,more » we have developed a computer–based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system’s detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.« less

Assessing and managing breast cancer risk: clinicians' current practice and future needs.

PubMed

Collins, Ian M; Steel, Emma; Mann, G Bruce; Emery, Jon D; Bickerstaffe, Adrian; Trainer, Alison; Butow, Phyllis; Pirotta, Marie; Antoniou, Antonis C; Cuzick, Jack; Hopper, John; Phillips, Kelly-Anne; Keogh, Louise A

2014-10-01

Decision support tools for the assessment and management of breast cancer risk may improve uptake of prevention strategies. End-user input in the design of such tools is critical to increase clinical use. Before developing such a computerized tool, we examined clinicians' practice and future needs. Twelve breast surgeons, 12 primary care physicians and 5 practice nurses participated in 4 focus groups. These were recorded, coded, and analyzed to identify key themes. Participants identified difficulties assessing risk, including a lack of available tools to standardize practice. Most expressed confidence identifying women at potentially high risk, but not moderate risk. Participants felt a tool could especially reassure young women at average risk. Desirable features included: evidence-based, accessible (e.g. web-based), and displaying absolute (not relative) risks in multiple formats. The potential to create anxiety was a concern. Development of future tools should address these issues to optimize translation of knowledge into clinical practice. Copyright © 2014 Elsevier Ltd. All rights reserved.

Development of computer-based analytical tool for assessing physical protection system

NASA Astrophysics Data System (ADS)

Mardhi, Alim; Pengvanich, Phongphaeth

2016-01-01

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work, we have developed a computer-based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system's detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.

Development and psychometric testing of the Carter Assessment of Critical Thinking in Midwifery (Preceptor/Mentor version).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2016-03-01

develop and test a tool designed for use by preceptors/mentors to assess undergraduate midwifery students׳ critical thinking in practice. a descriptive cohort design was used. participants worked in a range of maternity settings in Queensland, Australia. 106 midwifery clinicians who had acted in the role of preceptor for undergraduate midwifery students. this study followed a staged model for tool development recommended by DeVellis (2012). This included generation of items, content validity testing through mapping of draft items to critical thinking concepts and expert review, administration of items to a convenience sample of preceptors, and psychometric testing. A 24 item tool titled the XXXX Assessment of Critical Thinking in Midwifery (CACTiM) was completed by registered midwives in relation to students they had recently preceptored in the clinical environment. ratings by experts revealed a content validity index score of 0.97, representing good content validity. An evaluation of construct validity through factor analysis generated three factors: 'partnership in practice', 'reflection on practice' and 'practice improvements'. The scale demonstrated good internal reliability with a Cronbach alpha coefficient of 0.97. The mean total score for the CACTiM scale was 116.77 (SD=16.68) with a range of 60-144. Total and subscale scores correlated significantly. the CACTiM (Preceptor/Mentor version) was found to be a valid and reliable tool for use by preceptors to assess critical thinking in undergraduate midwifery students. given the importance of critical thinking skills for midwifery practice, mapping and assessing critical thinking development in students׳ practice across an undergraduate programme is vital. The CACTiM (Preceptor/Mentor version) has utility for clinical education, research and practice. The tool can inform and guide preceptors׳ assessment of students׳ critical thinking in practice. The availability of a reliable and valid tool can be used to research the development of critical thinking in practice. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

A protocol for the development of a critical thinking assessment tool for nurses using a Delphi technique.

PubMed

Jacob, Elisabeth; Duffield, Christine; Jacob, Darren

2017-08-01

The aim of this study was to develop an assessment tool to measure the critical thinking ability of nurses. As an increasing number of complex patients are admitted to hospitals, the importance of nurses recognizing changes in health status and picking up on deterioration is more important. To detect early signs of complication requires critical thinking skills. Registered Nurses are expected to commence their clinical careers with the necessary critical thinking skills to ensure safe nursing practice. Currently, there is no published tool to assess critical thinking skills which is context specific to Australian nurses. A modified Delphi study will be used for the project. This study will develop a series of unfolding case scenarios using national health data with multiple-choice questions to assess critical thinking. Face validity of the scenarios will be determined by an expert reference group of clinical and academic nurses. A Delphi study will determine the answers to scenario questions. Panel members will be expert clinicians and educators from two states in Australia. Rasch analysis of the questionnaire will assess validity and reliability of the tool. Funding for the study and Research Ethics Committee approval were obtained in March and November 2016, respectively. Patient outcomes and safety are directly linked to nurses' critical thinking skills. This study will develop an assessment tool to provide a standardized method of measuring nurses' critical thinking skills across Australia. This will provide healthcare providers with greater confidence in the critical thinking level of graduate Registered Nurses. © 2017 John Wiley & Sons Ltd.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study.

PubMed

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D

2017-01-01

As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Panelist's responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. Copyright® by the International Brazilian Journal of Urology.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

PubMed Central

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D.

2017-01-01

ABSTRACT Introduction As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. Materials and methods We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Results Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Conclusions Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. PMID:28379668

Web-enabling Ecological Risk Assessment for Accessibility and Transparency

EPA Science Inventory

Ecological risk methods and tools are necessarily diverse to account for different combinations of receptors, exposure processes, effects estimation, and degree of conservatism/realism necessary to support chemical-based assessments. These tools have been continuously developed s...

Development of a Self-Assessment Tool to Facilitate Decision-Making in Choosing a Long Term Care Administration Major

ERIC Educational Resources Information Center

Johs-Artisensi, Jennifer L.; Olson, Douglas M.; Nahm, Abraham Y.

2016-01-01

Long term care administrators need a broad base of knowledge, skills, and interests to provide leadership and be successful in managing a fiscally responsible, quality long term care organization. Researchers developed a tool to help students assess whether a long term care administration major is a compatible fit. With input from professionals in…

The Development and Validation of the Transition Competence Battery for Adolescents and Young Adults with Deafness.

ERIC Educational Resources Information Center

Reiman, John; Bullis, Michael

1988-01-01

The lack of appropriate assessment tools designed for deaf adolescents and young adults making the transition from educational programs to adult life is cited as one of the most glaring deficits in the field of deafness. The Transition Competence Battery (TCB) is being developed as an assessment tool that will guide individual training decisions…

An innovative framework for psychosocial assessment in complex mental capacity evaluations.

PubMed

Newberry, Andrea M; Pachet, Arlin K

2008-08-01

This study describes an innovative tool developed by the Regional Capacity Assessment Team (RCAT) to assess unique psychosocial factors related to capacity evaluations. Capacity is a socio-legal construct entailing the ability to understand choices, appreciate consequences and follow through (or direct a surrogate) with chosen options. RCAT's targeted psychosocial assessment includes medico-legal factors, social history and supports, coping skills, religious/cultural factors and risk of abuse. RCAT completes the psychosocial assessment to determine whether a full capacity assessment is required (referral disposition) and to determine the impact of an adult's social functioning on their decision-making capacity (capacity determination). RCAT's psychosocial assessment protocol was developed after a comprehensive literature review of capacity assessment and incorporates recommended practices in geriatric social work and psychology. This study will synthesise the pertinent literature, discuss cultural interviewing processes significant to capacity, caregiver assessment and describe the tool itself. Suggestions for future research and appropriate implementation of this tool are provided.

Integrated performance and reliability specification for digital avionics systems

NASA Technical Reports Server (NTRS)

Brehm, Eric W.; Goettge, Robert T.

1995-01-01

This paper describes an automated tool for performance and reliability assessment of digital avionics systems, called the Automated Design Tool Set (ADTS). ADTS is based on an integrated approach to design assessment that unifies traditional performance and reliability views of system designs, and that addresses interdependencies between performance and reliability behavior via exchange of parameters and result between mathematical models of each type. A multi-layer tool set architecture has been developed for ADTS that separates the concerns of system specification, model generation, and model solution. Performance and reliability models are generated automatically as a function of candidate system designs, and model results are expressed within the system specification. The layered approach helps deal with the inherent complexity of the design assessment process, and preserves long-term flexibility to accommodate a wide range of models and solution techniques within the tool set structure. ADTS research and development to date has focused on development of a language for specification of system designs as a basis for performance and reliability evaluation. A model generation and solution framework has also been developed for ADTS, that will ultimately encompass an integrated set of analytic and simulated based techniques for performance, reliability, and combined design assessment.

Development and Pilot Testing of a Bilingual Environmental Health Assessment Tool to Promote Asthma-friendly Childcares.

PubMed

Evans-Agnew, Robin A; Postma, Julie; Camacho, Ariana Ochoa; Hershberg, Rachel M; Trujilio, Elsa; Tinajera, Maria

2018-01-01

Childhood marks the highest risk for allergic sensitization to asthma triggers. Hispanic/Latino children are at higher risk for hospitalization for asthma than non-Hispanic White children. Childcare providers lack knowledge about reducing asthma triggers. The purpose of this paper is to describe a community-based participatory research (CBPR) initiative aimed at developing and pilot testing a bilingual walk-through assessment tool for asthma-friendly childcare environments. Ten Latina mothers of children with asthma living in the Pacific Northwest collaborated with research partners to develop and pilot test a Childcare Environmental Health (CEH) assessment walk-through survey.Results and Lessons Learned: The women innovated the survey with photography and structural examinations of stress and provision of basic needs. The survey tool identified environmental threats to asthma in all three childcares surveyed. Parents are well-positioned to build trust with childcare providers, assess asthma triggers, and recommend practical mitigation strategies.

WILDLIFE RISK ASSESSMENT: DEVELOPMENT OF METHODS TO ASSESS THE EFFECTS OF MERCURY AND HABITAT ALTERATION ON POPULATIONS OF AQUATIC-DEPENDENT WILDLIFE

EPA Science Inventory

NHEERL is conducting a demonstration project to develop tools and approaches for assessing the risks of multiple stressors to populations of piscivorous wildlife, leading to the development of risk-based criteria. Specifically, we are developing methods and approaches to assess...

Drinking Water Consequences Tools. A Literature Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pasqualini, Donatella

2016-05-12

In support of the goals of Department of Homeland Security’s (DHS) National Protection and Programs Directorate and the Federal Emergency Management Agency, the DHS Office of Science and Technology is seeking to develop and/or modify consequence assessment tools to enable drinking water systems owner/operators to estimate the societal and economic consequences of drinking water disruption due to the threats and hazards. This work will expand the breadth of consequence estimation methods and tools using the best-available data describing water distribution infrastructure, owner/assetlevel economic losses, regional-scale economic activity, and health. In addition, this project will deploy the consequence methodology and capabilitymore » within a Web-based platform. This report is intended to support DHS effort providing a review literature review of existing assessment tools of water and wastewater systems consequences to disruptions. The review includes tools that assess water systems resilience, vulnerability, and risk. This will help to understand gaps and limitations of these tools in order to plan for the development of the next-generation consequences tool for water and waste water systems disruption.« less

ARBOOK: Development and Assessment of a Tool Based on Augmented Reality for Anatomy

ERIC Educational Resources Information Center

Ferrer-Torregrosa, J.; Torralba, J.; Jimenez, M. A.; García, S.; Barcia, J. M.

2015-01-01

The evolution of technologies and the development of new tools with educational purposes are growing up. This work presents the experience of a new tool based on augmented reality (AR) focusing on the anatomy of the lower limb. ARBOOK was constructed and developed based on TC and MRN images, dissections and drawings. For ARBOOK evaluation, a…

Lightning Tracking Tool for Assessment of Total Cloud Lightning within AWIPS II

NASA Technical Reports Server (NTRS)

Burks, Jason E.; Stano, Geoffrey T.; Sperow, Ken

2014-01-01

Total lightning (intra-cloud and cloud-to-ground) has been widely researched and shown to be a valuable tool to aid real-time warning forecasters in the assessment of severe weather potential of convective storms. The trend of total lightning has been related to the strength of a storm's updraft. Therefore a rapid increase in total lightning signifies the strengthening of the parent thunderstorm. The assessment of severe weather potential occurs in a time limited environment and therefore constrains the use of total lightning. A tool has been developed at NASA's Short-term Prediction Research and Transition (SPoRT) Center to assist in quickly analyzing the total lightning signature of multiple storms. The development of this tool comes as a direct result of forecaster feedback from numerous assessments requesting a real-time display of the time series of total lightning. This tool also takes advantage of the new architecture available within the AWIPS II environment. SPoRT's lightning tracking tool has been tested in the Hazardous Weather Testbed (HWT) Spring Program and significant changes have been made based on the feedback. In addition to the updates in response to the HWT assessment, the lightning tracking tool may also be extended to incorporate other requested displays, such as the intra-cloud to cloud-to-ground ratio as well as incorporate the lightning jump algorithm.

A new comprehension and communication tool: a valuable resource for internationally educated occupational therapists.

PubMed

Nguyen, Tram; Baptiste, Sue; Jung, Bonny; Wilkins, Seanne

2014-06-01

The need was identified for a way to assess internationally educated occupational therapists’ skills in understanding and communicating professional terminology used in occupational therapy practice. The project aim was to develop and validate such a resource. A scenario-based assessment was developed using a three-phase process for tool development. The development process involved completion of a literature scan of professional terminology used in occupational therapy practice; selection of terms and concepts commonly used in occupational therapy practice; and, creation of practice-based scenarios illustrating key concepts complete with rating rubrics. An advisory group provided oversight, and a sample of internationally educated occupational therapists completed pilot and validity testing. The initial findings showed the assessment to be easy to complete and sensitive to testing understanding of the defined terms. The final outcome is an assessment tool that has broad application for occupational therapists wishing to enter professional practice in a new country. © 2013 Occupational Therapy Australia.

Prevention of MSD by means of ergonomic risk assessment (tools) in all phases of the vehicle development process.

PubMed

Karlheinz, Schaub; Michaela, Kugler; Max, Bierwirth; Andrea, Sinn-Behrendt; Ralph, Bruder

2012-01-01

In industrialized countries musculoskeletal disorders (MSD) play an import role and are often responsible for almost one third of the total sick leave. The changes in the demographic profiles, i.e. aging work forces might even worsen this situation in the future. For a highly productive and sustainable use of human resources in production systems, ergonomics offers high potentials. In the recent years the authors have developed several ergonomic risk assessment tools, especially for the use in automotive industries. These methods may be used during the planning phases in the Tech Centers as well as during the production phase at shop floor level. The tools might also be used for a standardized communication in between the Tech Center and the plants to improve the effects of "lessons learned" for the design and layout of workstations and processes and the optimization of vehicle components. This paper describes suitable risk assessment tools as well as the integration of these tools into the vehicle development process. It introduces a comprehensive management approach for the integration of ergonomics into the management of production systems.

TRACI THE TOOL FOR THE REDUCTION AND ASSESSMENT OF CHEMICAL AND OTHER ENVIRONMENTAL IMPACTS - VERSION 2 CHANGES

EPA Science Inventory

The Tool for the Reduction and Assessment of Chemical and other environmental Impacts (TRACI) was developed to allow the quantification of environmental impacts for a variety of impact categories which are necessary for a comprehensive impact assessment. See Figure 1. TRACI is c...

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYRDOLOGIC MODELING TOOL FOR WATERSHED ASSESSMENT AND ANALYSIS

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly

developed by the USDA Agricultural Research Service, the U.S. Environmental Protection

Agency, the University of Arizona, and the University of Wyoming to automate the

parame...

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYDROLOGICAL MODELING TOOL FOR WATERSHED MANAGEMENT AND LANDSCAPE ASSESSMENT

EPA Science Inventory

The Automated Geospatial Watershed Assessment (http://www.epa.gov/nerlesd1/land-sci/agwa/introduction.htm and www.tucson.ars.ag.gov/agwa) tool is a GIS interface jointly developed by the U.S. Environmental Protection Agency, USDA-Agricultural Research Service, and the University ...

Using Software Tools to Automate the Assessment of Student Programs.

ERIC Educational Resources Information Center

Jackson, David

1991-01-01

Argues that advent of computer-aided instruction (CAI) systems for teaching introductory computer programing makes it imperative that software be developed to automate assessment and grading of student programs. Examples of typical student programing problems are given, and application of the Unix tools Lex and Yacc to the automatic assessment of…

Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

ERIC Educational Resources Information Center

Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

2013-01-01

Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

Innovative Assessment Tools for a Short, Fast-Paced, Summer Field Course

ERIC Educational Resources Information Center

Baustian, Melissa M.; Bentley, Samuel J.; Wandersee, James H.

2008-01-01

An experiential science program, such as a summer course at a field station, requires unique assessment tools. Traditional assessment via a pencil-and-paper exam cannot capture the essential skills and concepts learned at a summer field station. Therefore, the authors developed a pre- and postcourse image-based analysis to evaluate student…

The Language Exposure Assessment Tool: Quantifying Language Exposure in Infants and Children

ERIC Educational Resources Information Center

DeAnda, Stephanie; Bosch, Laura; Poulin-Dubois, Diane; Zesiger, Pascal; Friend, Margaret

2016-01-01

Purpose: The aim of this study was to develop the Language Exposure Assessment Tool (LEAT) and to examine its cross-linguistic validity, reliability, and utility. The LEAT is a computerized interview-style assessment that requests parents to estimate language exposure. The LEAT yields an automatic calculation of relative language exposure and…

Exploring Novel Tools for Assessing High School Students' Meaningful Understanding of Organic Reactions

ERIC Educational Resources Information Center

Vachliotis, Theodoros; Salta, Katerina; Vasiliou, Petroula; Tzougraki, Chryssa

2011-01-01

Systemic assessment questions (SAQs) are novel assessment tools used in the context of the Systemic Approach to Teaching and Learning (SATL) model. The purpose of this model is to enhance students' meaningful understanding of scientific concepts by use of constructivist concept mapping procedures, which emphasize the development of systems…

Assessing Teachers' Skills in Detecting and Identifying Effective Interactions in the Classroom: Theory and Measurement

ERIC Educational Resources Information Center

Jamil, Faiza M.; Sabol, Terri J.; Hamre, Bridget K.; Pianta, Robert C.

2015-01-01

Contemporary education reforms focus on assessing teachers' performance and developing selection mechanisms for hiring effective teachers. Tools that enable the prediction of teachers' classroom performance promote schools' ability to hire teachers more likely to be successful in the classroom. In addition, these assessment tools can be used for…

A multisource feedback tool to assess ward round leadership skills of senior paediatric trainees: (1) Development of tool.

PubMed

Lakshminarayana, Indumathy; Wall, David; Bindal, Taruna; Goodyear, Helen M

2015-05-01

Leading a ward round is an essential skill for hospital consultants and senior trainees but is rarely assessed during training. To investigate the key attributes for ward round leadership and to use these results to develop a multisource feedback (MSF) tool to assess the ward round leadership skills of senior specialist trainees. A panel of experts comprising four senior paediatric consultants and two nurse managers were interviewed from May to August 2009. From analysis of the interview transcripts, 10 key themes emerged. A structured questionnaire based on the key themes was designed and sent electronically to paediatric consultants, nurses and trainees at a large university hospital (June-October 2010). 81 consultants, nurses and trainees responded to the survey. The internal consistency of this tool was high (Cronbach's α 0.95). Factor analysis showed that five factors accounted for 72% of variance. The five key areas for ward round leadership were communication skills, preparation and organisation, teaching and enthusiasm, team working and punctuality; communication was the most important key theme. A MSF tool for ward round leadership skills was developed with these areas as five domains. We believe that this tool will add to the current assessment tools available by providing feedback about ward round leadership skills. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development of a patient-administered self-assessment tool (SATp) for follow-up of colorectal cancer patients in general practice.

PubMed

Ngune, Irene; Jiwa, Moyez; McManus, Alexandra; Hughes, Jeff; Parsons, Richard; Hodder, Rupert; Entriken, Fiona

2014-01-01

Treatment for colorectal cancer (CRC) may result in physical, social, and psychological needs that affect patients' quality of life post-treatment. A comprehensive assessment should be conducted to identify these needs in CRC patients post treatment, however, there is a lack of tools and processes available in general practice. This study aimed to develop a patient-completed needs screening tool that identifies potentially unmet physical, psychological, and social needs in CRC and facilitates consultation with a general practitioner (GP) to address these needs. The development of the self-assessment tool for patients (SATp) included a review of the literature; face and content validity with reference to an expert panel; psychometric testing including readability, internal consistency, and test-retest reliability; and usability in clinical practice. The SATp contains 25 questions. The tool had internal consistency (Cronbach's alpha 0.70-0.97), readability (reading ease 82.5%), and test-retest reliability (kappa 0.689-1.000). A total of 66 patients piloted the SATp. Participants were on average 69.2 (SD 9.9) years old and had a median follow-up period of 26.7 months. The SATp identified a total of 547 needs (median 7 needs/per patient; IQR [3-12.25]). Needs were categorised into social (175[32%]), psychological (175[32%]), and physical (197[36%]) domains. SATp is a reliable self-assessment tool useful for identifying CRC patient needs. Further testing of this tool for validity and usability is underway.

Helping coaches apply the principles of representative learning design: validation of a tennis specific practice assessment tool.

PubMed

Krause, Lyndon; Farrow, Damian; Reid, Machar; Buszard, Tim; Pinder, Ross

2018-06-01

Representative Learning Design (RLD) is a framework for assessing the degree to which experimental or practice tasks simulate key aspects of specific performance environments (i.e. competition). The key premise being that when practice replicates the performance environment, skills are more likely to transfer. In applied situations, however, there is currently no simple or quick method for coaches to assess the key concepts of RLD (e.g. during on-court tasks). The aim of this study was to develop a tool for coaches to efficiently assess practice task design in tennis. A consensus-based tool was developed using a 4-round Delphi process with 10 academic and 13 tennis-coaching experts. Expert consensus was reached for the inclusion of seven items, each consisting of two sub-questions related to (i) the task goal and (ii) the relevance of the task to competition performance. The Representative Practice Assessment Tool (RPAT) is proposed for use in assessing and enhancing practice task designs in tennis to increase the functional coupling between information and movement, and to maximise the potential for skill transfer to competition contexts.

Assessing primary care in Austria: room for improvement.

PubMed

Stigler, Florian L; Starfield, Barbara; Sprenger, Martin; Salzer, Helmut J F; Campbell, Stephen M

2013-04-01

There is emerging evidence that strong primary care achieves better health at lower costs. Although primary care can be measured, in many countries, including Austria, there is little understanding of primary care development. Assessing the primary care development in Austria. A primary care assessment tool developed by Barbara Starfield in 1998 was implemented in Austria. This tool defines 15 primary care characteristics and distinguishes between system and practice characteristics. Each characteristic was evaluated by six Austrian primary care experts and rated as 2 (high), 1 (intermediate) or 0 (low) points, respectively, to their primary care strength (maximum score: n = 30). Austria received 7 out of 30 points; no characteristic was rated as '2' but 8 were rated as '0'. Compared with the 13 previously assessed countries, Austria ranks 10th of 14 countries and is classified as a 'low primary care' country. This study provides the first evidence concerning primary care in Austria, benchmarking it as weak and in need of development. The practicable application of an existing assessment tool can be encouraging for other countries to generate evidence about their primary care system as well.

Objective assessment of technique in laparoscopic colorectal surgery: what are the existing tools?

PubMed

Foster, J D; Francis, N K

2015-01-01

Assessment can improve the effectiveness of surgical training and enable valid judgments of competence. Laparoscopic colon resection surgery is now taught within surgical residency programs, and assessment tools are increasingly used to stimulate formative feedback and enhance learning. Formal assessment of technical performance in laparoscopic colon resection has been successfully applied at the specialist level in the English "LAPCO" National Training Program. Objective assessment tools need to be developed for training and assessment in laparoscopic rectal cancer resection surgery. Simulation may have a future role in assessment and accreditation in laparoscopic colorectal surgery; however, existing virtual reality models are not ready to be used for assessment of this advanced surgery.

Psychometric validation of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool for older Chinese inpatients.

PubMed

Zhang, Junhong; Wang, Min; Liu, Yu

2016-10-01

To culturally adapt and evaluate the reliability and validity of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool among older inpatients in the mainland of China. Patient falls are an important safety consideration within hospitals among older inpatients. Nurses need specific risk assessment tools for older inpatients to reliably identify at-risk populations and guide interventions that highlight fixable risk factors for falls and consequent injuries. In China, a few tools have been developed to measure fall risk. However, they lack the solid psychometric development necessary to establish their validity and reliability, and they are not widely used for elderly inpatients. A cross-sectional study. A convenient sampling was used to recruit 201 older inpatients from two tertiary-level hospitals in Beijing and Xiamen, China. The Johns Hopkins Fall Risk Assessment Tool was translated using forward and backward translation procedures and was administered to these 201 older inpatients. Reliability of the tool was calculated by inter-rater reliability and Cronbach's alpha. Validity was analysed through content validity index and construct validity. The Inter-rater reliability of Chinese version of Johns Hopkins Fall Risk Assessment Tool was 97·14% agreement with Cohen's Kappa of 0·903. Cronbach's α was 0·703. Content of Validity Index was 0·833. Two factors represented intrinsic and extrinsic risk factors were explored that together explained 58·89% of the variance. This study provided evidence that Johns Hopkins Fall Risk Assessment Tool is an acceptable, valid and reliable tool to identify older inpatients at risk of falls and falls with injury. Further psychometric testing on criterion validity and evaluation of its advanced utility in geriatric clinical settings are warranted. The Chinese version of Johns Hopkins Fall Risk Assessment Tool may be useful for health care personnel to identify older Chinese inpatients at risk of falls and falls with injury. © 2016 John Wiley & Sons Ltd.

LANDSCAPE ASSESSMENT TOOLS FOR WATERSHED CHARACTERIZATION

EPA Science Inventory

A combination of process-based, empirical and statistical models has been developed to assist states in their efforts to assess water quality, locate impairments over large areas, and calculate TMDL allocations. By synthesizing outputs from a number of these tools, LIPS demonstr...

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Review of quality assessment tools for the evaluation of pharmacoepidemiological safety studies

PubMed Central

Neyarapally, George A; Hammad, Tarek A; Pinheiro, Simone P; Iyasu, Solomon

2012-01-01

Objectives Pharmacoepidemiological studies are an important hypothesis-testing tool in the evaluation of postmarketing drug safety. Despite the potential to produce robust value-added data, interpretation of findings can be hindered due to well-recognised methodological limitations of these studies. Therefore, assessment of their quality is essential to evaluating their credibility. The objective of this review was to evaluate the suitability and relevance of available tools for the assessment of pharmacoepidemiological safety studies. Design We created an a priori assessment framework consisting of reporting elements (REs) and quality assessment attributes (QAAs). A comprehensive literature search identified distinct assessment tools and the prespecified elements and attributes were evaluated. Primary and secondary outcome measures The primary outcome measure was the percentage representation of each domain, RE and QAA for the quality assessment tools. Results A total of 61 tools were reviewed. Most tools were not designed to evaluate pharmacoepidemiological safety studies. More than 50% of the reviewed tools considered REs under the research aims, analytical approach, outcome definition and ascertainment, study population and exposure definition and ascertainment domains. REs under the discussion and interpretation, results and study team domains were considered in less than 40% of the tools. Except for the data source domain, quality attributes were considered in less than 50% of the tools. Conclusions Many tools failed to include critical assessment elements relevant to observational pharmacoepidemiological safety studies and did not distinguish between REs and QAAs. Further, there is a lack of considerations on the relative weights of different domains and elements. The development of a quality assessment tool would facilitate consistent, objective and evidence-based assessments of pharmacoepidemiological safety studies. PMID:23015600

Thrombocalc: implementation and uptake of personalized postpartum venous thromboembolism risk assessment in a high-throughput obstetric environment.

PubMed

O'Shaughnessy, Fergal; Donnelly, Jennifer C; Cooley, Sharon M; Deering, Mary; Raman, Ajita; Gannon, Geraldine; Hickey, Jane; Holland, Alan; Hayes, Niamh; Bennett, Kathleen; Ní Áinle, Fionnuala; Cleary, Brian J

2017-11-01

Venous thromboembolism risk assessment (VTERA) is recommended in all pregnant and postpartum women. Our objective was to develop, pilot and implement a user-friendly electronic VTERA tool. We developed "Thrombocalc", an electronic VTERA tool using Microsoft EXCEL ™ . Thrombocalc was designed as a score-based tool to facilitate rapid assessment of all women after childbirth. Calculation of a total score estimated risk of venous thromboembolism in line with consensus guidelines. Recommendations for thromboprophylaxis were included in the VTERA output. Implementation was phased. Uptake of the VTERA tool was assessed prospectively by monitoring the proportion of women who gave birth in our institution and had a completed risk assessment. Factors affecting completion and accuracy of risk assessments were also assessed. Thrombocalc was used prospectively to risk-assess 8380 women between September 2014 and December 2015. Compliance with this tool increased dramatically throughout the study period; over 92% of women were risk-assessed in the last quarter of data collection. Compliance was not adversely affected if delivery took place out of working hours [adjusted odds ratio (aOR) 1.03, 95% confidence interval (CI) 0.93-1.14]. Risk assessment was less likely in the case of cesarean deliveries (aOR 0.66, 95% CI 0.60-0.73) and stillborn infants (aOR 0.48, 95% CI 0.29-0.79). Misclassification of risk factors led to approximately 207 (2.5%) inaccurate thromboprophylaxis recommendations. Our electronic, score-based VTERA tool provides a highly effective mechanism for rapid assessment of individual postpartum venous thromboembolism risk in a high-throughput environment. © 2017 Nordic Federation of Societies of Obstetrics and Gynecology.

Physical activity and healthy eating environmental audit tools in youth care settings: A systematic review.

PubMed

Ajja, Rahma; Beets, Michael W; Chandler, Jessica; Kaczynski, Andrew T; Ward, Dianne S

2015-08-01

There is a growing interest in evaluating the physical activity (PA) and healthy eating (HE) policy and practice environment characteristics in settings frequented by youth (≤18years). This review evaluates the measurement properties of audit tools designed to assess PA and HE policy and practice environment characteristics in settings that care for youth (e.g., childcare, school, afterschool, summer camp). Three electronic databases, reference lists, educational department and national health organizations' web pages were searched between January 1980 and February 2014 to identify tools assessing PA and/or HE policy and practice environments in settings that care for youth (≤18years). Sixty-five audit tools were identified of which 53 individual tools met the inclusion criteria. Thirty-three tools assessed both the PA and HE domains, 6 assessed the PA domain and 14 assessed the HE domain solely. The majority of the tools were self-assessment tools (n=40), and were developed to assess the PA and/or HE environment in school settings (n=33), childcare (n=12), and after school programs (n=4). Four tools assessed the community at-large and had sections for assessing preschool, school and/or afterschool settings within the tool. The majority of audit tools lacked validity and/or reliability data (n=42). Inter-rater reliability and construct validity were the most frequently reported reliability (n=7) and validity types (n=5). Limited attention has been given to establishing the reliability and validity of audit tools for settings that care for youth. Future efforts should be directed towards establishing a strong measurement foundation for these important environmental audit tools. Published by Elsevier Inc.

Development and testing of a prototype tool for integrated assessment of chemical status in marine environments.

PubMed

Andersen, Jesper H; Murray, Ciarán; Larsen, Martin M; Green, Norman; Høgåsen, Tore; Dahlgren, Elin; Garnaga-Budrė, Galina; Gustavson, Kim; Haarich, Michael; Kallenbach, Emilie M F; Mannio, Jaakko; Strand, Jakob; Korpinen, Samuli

2016-02-01

We report the development and application of a prototype tool for integrated assessment of chemical status in aquatic environments based on substance- and matrix-specific environmental assessment criteria (thresholds). The Chemical Status Assessment Tool (CHASE) integrates data on hazardous substances in water, sediments and biota as well as bio-effect indicators and is based on a substance- or bio-effect-specific calculation of a 'contamination ratio' being the ratio between an observed concentration and a threshold value. Values <1.0 indicate areas potentially 'unaffected', while values >1.0 indicate areas potentially 'affected'. These ratios are combined within matrices, i.e. for water, sediment and biota and for biological effects. The overall assessment used a 'one out, all out principle' with regard to each matrix. The CHASE tool was tested in the Baltic Sea and the North Sea in 376 assessment units. In the former, the chemical status was >1.0 in practically all areas indicating that all areas assessed were potentially affected. The North Sea included areas classified as unaffected or affected. The CHASE tool can in combination with temporal trend assessments of individual substances be advantageous for use in remedial action plans and, in particular, for the science-based evaluation of the status and for determining which specific substances are responsible for a status as potentially affected.

Electronic Assessment and Feedback Tool in Supervision of Nursing Students during Clinical Training

ERIC Educational Resources Information Center

Mettiäinen, Sari

2015-01-01

The aim of this study was to determine nursing teachers' and students' attitudes to and experiences of using an electronic assessment and feedback tool in supervision of clinical training. The tool was called eTaitava, and it was developed in Finland. During the pilot project, the software was used by 12 nursing teachers and 430 nursing students.…

The Health Impact Assessment (HIA) Resource and Tool Compilation: A Comprehensive Toolkit for New and Experienced HIA Practitioners in the U.S.

EPA Science Inventory

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct...

A systematic review of clinical assessment for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Lee, Cindy Ching Siang; Wang, Wenru

2015-02-01

Consolidated clinical practicum prepares pre-registration nursing students to function as beginning practitioners. The clinical competencies of final-year nursing students provide a key indication of professional standards of practice and patient safety. Thus, clinical assessment of nursing students is a crucial issue for educators and administrators. The aim of this systematic review was to explore the clinical competency assessment for undergraduate nursing students. PubMed, CINAHL, ScienceDirect, Web of Science, and EBSCO were systematically searched from January 2000 to December 2013. The systematic review was in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Published quantitative and qualitative studies that examined clinical assessment practices and tools used in clinical nursing education were retrieved. Quality assessment, data extraction, and analysis were completed on all included studies. This review screened 2073 titles, abstracts and full-text records, resulting in 33 included studies. Two reviewers assessed the quality of the included studies. Fourteen quantitative and qualitative studies were identified for this evaluation. The evidence was ordered into emergent themes; the overarching themes were current practices in clinical assessment, issues of learning and assessment, development of assessment tools, and reliability and validity of assessment tools. There is a need to develop a holistic clinical assessment tool with reasonable level of validity and reliability. Clinical assessment is a robust activity and requires collaboration between clinical partners and academia to enhance the clinical experiences of students, the professional development of preceptors, and the clinical credibility of academics. Copyright © 2014 Elsevier Ltd. All rights reserved.

Nonverbal communication in doctor-elderly patient transactions (NDEPT): development of a tool.

PubMed

Gorawara-Bhat, Rita; Cook, Mary Ann; Sachs, Greg A

2007-05-01

There are several measurement tools to assess verbal dimensions in clinical encounters; in contrast, there is no established tool to evaluate physical nonverbal dimensions in geriatric encounters. The present paper describes the development of a tool to assess the physical context of exam rooms in doctor-older patient visits. Salient features of the tool were derived from the medical literature and systematic observations of videotapes and refined during current research. The tool consists of two main dimensions of exam rooms: (1) physical dimensions comprising static and dynamic attributes that become operational through the spatial configuration and can influence the manifestation of (2) kinesic attributes. Details of the coding form and inter-rater reliability are presented. The usefulness of the tool is demonstrated through an analysis of 50 National Institute of Aging videotapes. Physicians in exam rooms with no desk in the interaction, no height difference and optimal interaction distance were observed to have greater eye contact and touch than physicians' in exam rooms with a desk, similar height difference and interaction distance. The tool can enable physicians to assess the spatial configuration of exam rooms (through Parts A and B) and thus facilitate the structuring of kinesic attributes (Part C).

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

OLTARIS: On-Line Tool for the Assessment of Radiation in Space

NASA Technical Reports Server (NTRS)

Sandridge, Chris A.; Blattnig, Steve R.; Clowdsley, Martha S.; Norbury, John; Qualis, Garry D.; Simonsen, Lisa C.; Singleterry, Robert C.; Slaba, Tony C.; Walker, Steven A.; Badavi, Francis F.;

Security Risks: Management and Mitigation in the Software Life Cycle

NASA Technical Reports Server (NTRS)

Gilliam, David P.

2004-01-01

A formal approach to managing and mitigating security risks in the software life cycle is requisite to developing software that has a higher degree of assurance that it is free of security defects which pose risk to the computing environment and the organization. Due to its criticality, security should be integrated as a formal approach in the software life cycle. Both a software security checklist and assessment tools should be incorporated into this life cycle process and integrated with a security risk assessment and mitigation tool. The current research at JPL addresses these areas through the development of a Sotfware Security Assessment Instrument (SSAI) and integrating it with a Defect Detection and Prevention (DDP) risk management tool.

Cross-cultural validity of standardized motor development screening and assessment tools: a systematic review.

PubMed

Mendonça, Bianca; Sargent, Barbara; Fetters, Linda

2016-12-01

To investigate whether standardized motor development screening and assessment tools that are used to evaluate motor abilities of children aged 0 to 2 years are valid in cultures other than those in which the normative sample was established. This was a systematic review in which six databases were searched. Studies were selected based on inclusion/exclusion criteria and appraised for evidence level and quality. Study variables were extracted. Twenty-three studies representing six motor development screening and assessment tools in 16 cultural contexts met the inclusion criteria: Alberta Infant Motor Scale (n=7), Ages and Stages Questionnaire, 3rd edition (n=2), Bayley Scales of Infant and Toddler Development, 3rd edition (n=8), Denver Developmental Screening Test, 2nd edition (n=4), Harris Infant Neuromotor Test (n=1), and Peabody Developmental Motor Scales, 2nd edition (n=1). Thirteen studies found significant differences between the cultural context and normative sample. Two studies established reliability and/or validity of standardized motor development assessments in high-risk infants from different cultural contexts. Five studies established new population norms. Eight studies described the cross-cultural adaptation of a standardized motor development assessment. Standardized motor development assessments have limited validity in cultures other than that in which the normative sample was established. Their use can result in under- or over-referral for services. © 2016 Mac Keith Press.

Developing a tool to assess motivation among health service providers working with public health system in India.

PubMed

Purohit, Bhaskar; Maneskar, Abhishek; Saxena, Deepak

2016-04-14

Addressing the shortage of health service providers (doctors and nurses) in rural health centres remains a huge challenge. The lack of motivation of health service providers to serve in rural areas is one of the major reasons for such shortage. While many studies have aimed at analysing the reasons for low motivation, hardly any studies in India have focused on developing valid and reliable tools to measure motivation among health service providers. Hence, the objective of the study was to test and develop a valid and reliable instrument to assess the motivation of health service providers working with the public health system in India and the extent to which the motivation factors included in the study motivate health service providers to perform better at work. The present study adapted an already developed tool on motivation. The reliability and validity of the tool were established using different methods. The first stage of the tool development involved content development and assessment where, after a detailed literature review, a predeveloped tool with 19 items was adapted. However, in light of the literature review and pilot test, the same tool was modified to suit the local context by adding 7 additional items so that the final modified tool comprised of 26 items. A correlation matrix was applied to check the pattern of relationships among the items. The total sample size for the study was 154 health service providers from one Western state in India. To understand the sampling adequacy, the Kaiser-Meyer-Olkin measure of sampling adequacy and Bartlett's test of sphericity were applied and finally factor analysis was carried out to calculate the eigenvalues and to understand the relative impact of factors affecting motivation. A correlation matrix value of 0.017 was obtained narrating multi-co-linearity among the observations. Based on initial factor analysis, 8 out of 26 study factors were excluded from the study components with a cutoff range of less than 0.6. Running the factor analysis again suggested the inclusion of 18 items which were subsequently labelled under the following heads: transparency, goals, security, convenience, benefits, encouragement, adequacy of earnings and further growth and power. There is a great need to develop instruments aimed at assessing the motivation of health service providers. The instrument used in the study has good psychometric properties and may serve as a useful tool to assess motivation among healthcare providers.

API REST Web service and backend system Of Lecturer’s Assessment Information System on Politeknik Negeri Bali

NASA Astrophysics Data System (ADS)

Manuaba, I. B. P.; Rudiastini, E.

2018-01-01

Assessment of lecturers is a tool used to measure lecturer performance. Lecturer’s assessment variable can be measured from three aspects : teaching activities, research and community service. Broad aspect to measure the performance of lecturers requires a special framework, so that the system can be developed in a sustainable manner. Issues of this research is to create a API web service data tool, so the lecturer assessment system can be developed in various frameworks. The research was developed with web service and php programming language with the output of json extension data. The conclusion of this research is API web service data application can be developed using several platforms such as web, mobile application

The Development and Use of a Concept Mapping Assessment Tool with Young Children on Family Visits to a Live Butterfly Exhibit

ERIC Educational Resources Information Center

Mesa, Jennifer Cheryl

2010-01-01

Although young children are major audiences of science museums, limited evidence exists documenting changes in children's knowledge in these settings due in part to the limited number of valid and reliable assessment tools available for use with this population. The purposes of this study were to develop and validate a concept mapping assessment…

Development and Initial Validation of the NyTid Test: A Movement Assessment Tool for Compulsory School Pupils

ERIC Educational Resources Information Center

Tidén, Anna; Lundqvist, Carolina; Nyberg, Marie

2015-01-01

This study presents the development process and initial validation of the NyTid test, a process-oriented movement assessment tool for compulsory school pupils. A sample of 1,260 (627 girls and 633 boys; mean age of 14.39) Swedish school children participated in the study. In the first step, exploratory factor analyses (EFAs) were performed in…

Evaluation of the Level of Students with Visual Impairments in Turkey in Terms of the Concepts of Mobility Prerequisites (Body Plane/Traffic)

ERIC Educational Resources Information Center

Altunay Arslantekin, Banu

2017-01-01

Purpose: Visually impaired people are weak in terms of their learning words and concepts by hearing them and their experience of the world with their bodies. In addition to developing a standardized assessment tool in the Development of Orientation and Mobility Skill Assessment Tool (OMSAT/YOBDA) for Visually Impaired Students Project, supported…

Identifying opportunities to advance practice at a large academic medical center using the ASHP Ambulatory Care Self-Assessment Tool.

PubMed

Martirosov, Amber Lanae; Michael, Angela; McCarty, Melissa; Bacon, Opal; DiLodovico, John R; Jantz, Arin; Kostoff, Diana; MacDonald, Nancy C; Mikulandric, Nancy; Neme, Klodiana; Sulejmani, Nimisha; Summers, Bryant B

2018-05-29

The use of the ASHP Ambulatory Care Self-Assessment Tool to advance pharmacy practice at 8 ambulatory care clinics of a large academic medical center is described. The ASHP Ambulatory Care Self-Assessment Tool was developed to help ambulatory care pharmacists assess how their current practices align with the ASHP Practice Advancement Initiative. The Henry Ford Hospital Ambulatory Care Advisory Group (ACAG) opted to use the "Practitioner Track" sections of the tool to assess pharmacy practices within each of 8 ambulatory care clinics individually. The responses to self-assessment items were then compiled and discussed by ACAG members. The group identified best practices and ways to implement action items to advance ambulatory care practice throughout the institution. Three recommended action items were common to most clinics: (1) identify and evaluate solutions to deliver financially viable services, (2) develop technology to improve patient care, and (3) optimize the role of pharmacy technicians and support personnel. The ACAG leadership met with pharmacy administrators to discuss how action items that were both feasible and deemed likely to have a medium-to-high impact aligned with departmental goals and used this information to develop an ambulatory care strategic plan. This process informed and enabled initiatives to advance ambulatory care pharmacy practice within the system. The ASHP Ambulatory Care Self-Assessment Tool was useful in identifying opportunities for practice advancement in a large academic medical center. Copyright © 2018 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Using TRACI for Sustainability Metrics

EPA Science Inventory

TRACI, the Tool for the Reduction and Assessment of Chemical and other environmental Impacts, has been developed for sustainability metrics, life cycle impact assessment, and product and process design impact assessment for developing increasingly sustainable products, processes,...

The assessment of creativity in creativity/psychopathology research - a systematic review.

PubMed

Thys, E; Sabbe, B; De Hert, M

2014-01-01

The possible link between creativity and psychopathology has been a long time focus of research up to the present day. However, this research is hampered by methodological problems, especially the definition and assessment of creativity. This makes interpretation and comparison of studies difficult and possibly accounts for the contradictory results of this research. In this systematic review of the literature, research articles in the field of creativity and psychopathology were searched for creativity assessment tools. The tools used in the collected articles are presented and discussed. The results indicate that a multitude of creativity assessment tools were used, that many studies only used one tool to assess creativity and that most of these tools were only used in a limited number of studies. A few assessment tools stand out by a more frequent use, also outside psychopathological research, and more solid psychometric properties. Most scales used to evaluate creativity have poor psychometric properties. The scattered methodology to assess creativity compromises the generalizability and validity of this research. The field should creatively develop new validated instruments.

Improving nutrition surveillance and public health research in Central and Eastern Europe/Balkan Countries using the Balkan Food Platform and dietary tools.

PubMed

Gurinović, Mirjana; Milešević, Jelena; Novaković, Romana; Kadvan, Agnes; Djekić-Ivanković, Marija; Šatalić, Zvonimir; Korošec, Mojca; Spiroski, Igor; Ranić, Marija; Dupouy, Eleonora; Oshaug, Arne; Finglas, Paul; Glibetić, Maria

2016-02-15

The objective of this paper is to share experience and provide updated information on Capacity Development in the Central and Eastern Europe/Balkan Countries (CEE/BC) region relevant to public health nutrition, particularly in creation of food composition databases (FCDBs), applying dietary intake assessment and monitoring tools, and harmonizing methodology for nutrition surveillance. Balkan Food Platform was established by a Memorandum of Understanding among EuroFIR AISBL, Institute for Medical Research, Belgrade, Capacity Development Network in Nutrition in CEE - CAPNUTRA and institutions from nine countries in the region. Inventory on FCDB status identified lack of harmonized and standardized research tools. To strengthen harmonization in CEE/BC in line with European research trends, the Network members collaborated in development of a Regional FCDB, using web-based food composition data base management software following EuroFIR standards. Comprehensive nutrition assessment and planning tool - DIET ASSESS & PLAN could enable synchronization of nutrition surveillance across countries. Copyright © 2015 Elsevier Ltd. All rights reserved.

The development of a new breast feeding assessment tool and the relationship with breast feeding self-efficacy

PubMed Central

Ingram, Jenny; Johnson, Debbie; Copeland, Marion; Churchill, Cathy; Taylor, Hazel

2015-01-01

Objective to develop a breast feeding assessment tool to facilitate improved targeting of optimum positioning and attachment advice and to describe the changes seen following the release of a tongue-tie. Design development and validation of the Bristol Breastfeeding Assessment Tool (BBAT) and correlation with breast feeding self-efficacy. Setting maternity hospital in South West England. Participants 218 breast feeds (160 mother–infant dyads); seven midwife assessors. Findings the tool has more explanation than other tools to remind those supporting breast-feeding women about the components of an efficient breast feed. There was good internal reliability for the final 4-item BBAT (Cronbach׳s alpha=0.668) and the midwives who used it showed a high correlation in the consistency of its use (ICC=0.782). Midwives were able to score a breast feed consistently using the BBAT and felt that it helped them with advice to mothers about improving positioning and attachment to make breast feeding less painful, particularly with a tongue-tied infant. The tool showed strong correlation with breast feeding self-efficacy, indicating that more efficient breast feeding technique is associated with increased confidence in breast feeding an infant. Conclusions the BBAT is a concise breast feeding assessment tool facilitating accurate, rapid breast feeding appraisal, and targeting breast feeding advice to mothers acquiring early breast feeding skills or for those experiencing problems with an older infant. Accurate assessment is essential to ensure enhanced breast feeding efficiency and increased maternal self-confidence. Implications for practice the BBAT could be used both clinically and in research to target advice to improve breast feeding efficacy. Further research is needed to establish its wider usefulness. PMID:25061006

The development of a new breast feeding assessment tool and the relationship with breast feeding self-efficacy.

PubMed

Ingram, Jenny; Johnson, Debbie; Copeland, Marion; Churchill, Cathy; Taylor, Hazel

2015-01-01

to develop a breast feeding assessment tool to facilitate improved targeting of optimum positioning and attachment advice and to describe the changes seen following the release of a tongue-tie. development and validation of the Bristol Breastfeeding Assessment Tool (BBAT) and correlation with breast feeding self-efficacy. maternity hospital in South West England. 218 breast feeds (160 mother-infant dyads); seven midwife assessors. the tool has more explanation than other tools to remind those supporting breast-feeding women about the components of an efficient breast feed. There was good internal reliability for the final 4-item BBAT (Cronbach's alpha=0.668) and the midwives who used it showed a high correlation in the consistency of its use (ICC=0.782). Midwives were able to score a breast feed consistently using the BBAT and felt that it helped them with advice to mothers about improving positioning and attachment to make breast feeding less painful, particularly with a tongue-tied infant. The tool showed strong correlation with breast feeding self-efficacy, indicating that more efficient breast feeding technique is associated with increased confidence in breast feeding an infant. the BBAT is a concise breast feeding assessment tool facilitating accurate, rapid breast feeding appraisal, and targeting breast feeding advice to mothers acquiring early breast feeding skills or for those experiencing problems with an older infant. Accurate assessment is essential to ensure enhanced breast feeding efficiency and increased maternal self-confidence. the BBAT could be used both clinically and in research to target advice to improve breast feeding efficacy. Further research is needed to establish its wider usefulness. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Tool for the Reduction and Assessment of Chemical and other Environmental Impacts

EPA Science Inventory

TRACI, the Tool for the Reduction and Assessment of Chemical and other environmental Impacts, has been developed by the US Environmental Protection Agency’s National Risk Management Research Laboratory to facilitate the characterization of stressors that have potential effects, ...

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

Pediatric Psychologist Use of Adherence Assessments and Interventions

PubMed Central

Rohan, Jennifer M.; Martin, Staci; Hommel, Kevin; Greenley, Rachel Neff; Loiselle, Kristin; Ambrosino, Jodie; Fredericks, Emily M.

2013-01-01

Objective To document current clinical practices for medical regimen adherence assessment and intervention in the field of pediatric psychology. Methods 113 members of the Society of Pediatric Psychology completed an anonymous online survey that assessed use of adherence assessments and interventions in clinical practice, barriers and facilitators to their use, and preferred resources for obtaining information on adherence assessments and interventions. Results Respondents reported using a range of adherence assessment and intervention strategies, some of which are evidence-based. Barriers to implementing these clinical strategies included time constraints and lack of familiarity with available clinical tools. Respondents reported that education about effective clinical tools would facilitate their use of adherence assessments and interventions. Conclusions Future research and clinical efforts in adherence should consider developing practical tools for clinical practice, making accessible resources to promote dissemination of these tools, and increase understanding of clinician implementation of adherence assessments and interventions. PMID:23658375

The Microbial Fecal Indicator Paradigm: Tools in the Toolbox Applications in Recreational Waters

EPA Science Inventory

Summary of ORD’s recent research to develop tools for assessing microbial water quality in recreational waters. Methods discussed include the development of health associations between microbial fecal indicators and the development of culture, and molecular methods for fec...

The development and validity of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To develop the construct, content, and criterion validity of the Salford Gait Tool (SF-GT) and to evaluate agreement between gait observations using the SF-GT and kinematic gait data. Tool development and comparative evaluation. University in the United Kingdom. For designing construct and content validity, convenience samples of 10 children with hemiplegic, diplegic, and quadriplegic cerebral palsy (CP) and 152 physical therapy students and 4 physical therapists were recruited. For developing criterion validity, kinematic gait data of 13 gait clusters containing 56 children with hemiplegic, diplegic, and quadriplegic CP and 11 neurologically intact children was used. For clinical evaluation, a convenience sample of 23 pediatric physical therapists participated. We developed a sagittal plane observational gait assessment tool through a series of design, test, and redesign iterations. The tool's grading system was calibrated using kinematic gait data of 13 gait clusters and was evaluated by comparing the agreement of gait observations using the SF-GT with kinematic gait data. Criterion standard kinematic gait data. There was 58% mean agreement based on grading categories and 80% mean agreement based on degree estimations evaluated with the least significant difference method. The new SF-GT has good concurrent criterion validity.

Development and Validation of a Family Meeting Assessment Tool (FMAT).

PubMed

Hagiwara, Yuya; Healy, Jennifer; Lee, Shuko; Ross, Jeanette; Fischer, Dixie; Sanchez-Reilly, Sandra

2018-01-01

A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Assessing the nutritional status of hospitalized elderly

PubMed Central

Abd Aziz, Nur Adilah Shuhada; Teng, Nur Islami Mohd Fahmi; Abdul Hamid, Mohd Ramadan; Ismail, Nazrul Hadi

2017-01-01

Purpose The increasing number of elderly people worldwide throughout the years is concerning due to the health problems often faced by this population. This review aims to summarize the nutritional status among hospitalized elderly and the role of the nutritional assessment tools in this issue. Methods A literature search was performed on six databases using the terms “malnutrition”, “hospitalised elderly”, “nutritional assessment”, “Mini Nutritional Assessment (MNA)”, “Geriatric Nutrition Risk Index (GNRI)”, and “Subjective Global Assessment (SGA)”. Results According to the previous studies, the prevalence of malnutrition among hospitalized elderly shows an increasing trend not only locally but also across the world. Under-recognition of malnutrition causes the number of malnourished hospitalized elderly to remain high throughout the years. Thus, the development of nutritional screening and assessment tools has been widely studied, and these tools are readily available nowadays. SGA, MNA, and GNRI are the nutritional assessment tools developed specifically for the elderly and are well validated in most countries. However, to date, there is no single tool that can be considered as the universal gold standard for the diagnosis of nutritional status in hospitalized patients. Conclusion It is important to identify which nutritional assessment tool is suitable to be used in this group to ensure that a structured assessment and documentation of nutritional status can be established. An early and accurate identification of the appropriate treatment of malnutrition can be done as soon as possible, and thus, the malnutrition rate among this group can be minimized in the future. PMID:29042762

Enhancing Palliative Care Education in Medical School Curricula: Implementation of the Palliative Education Assessment Tool.

ERIC Educational Resources Information Center

Wood, Emily B.; Meekin, Sharon Abele; Fins, Joseph J.; Fleischman, Alan R.

2002-01-01

Evaluated a project to catalyze New York State medical schools to develop and implement strategic plans for curricular change to enhance palliative care education. Found that the project's process of self-assessment and curriculum mapping with the Palliative Education Assessment Tool, along with strategic planning for change, appears to have…

Developing a Web-Based Mechanism for Assessing Teacher Science Content Knowledge

NASA Astrophysics Data System (ADS)

Byers, Al; Koba, Susan; Sherman, Greg; Scheppke, Joan; Bolus, Roger

2011-04-01

The National Science Teachers Association (NSTA) recently launched a comprehensive electronic professional development (e-PD) online portal, the NSTA Learning Center. This support site for educators currently includes over 6,000 e-PD resources and opportunities available on-demand, as well as various tools designed to help educators maximize the effectiveness of using NSTA resources. One tool, the PD Indexer, helps teachers identify their own areas of content strengths and weaknesses by selecting content-specific assessments. Individual NSTA resources are recommended based on assessment outcomes. This paper presents a detailed description of the procedures employed by NSTA to develop valid and reliable PD Indexer content-specific multiple-choice assessment items.

Evolution of a Simulation Testbed into an Operational Tool

NASA Technical Reports Server (NTRS)

Sheth, Kapil; Bilimoria, Karl D.; Sridhar, Banavar; Sterenchuk, Mike; Niznik, Tim; O'Neill, Tom; Clymer, Alexis; Gutierrez Nolasco, Sebastian; Edholm, Kaj; Shih, Fu-Tai

2017-01-01

This paper describes the evolution over a 20-year period of the Future ATM (Air Traffic Management) Concepts Evaluation Tool (FACET) from a National Airspace System (NAS) based simulation testbed into an operational tool. FACET was developed as a testbed for assessing futuristic ATM concepts, e.g., automated conflict detection and resolution. NAS Constraint Evaluation and Notification Tool (NASCENT) is an application, within FACET, for alerting airspace users of inefficiencies in flight operations and advising time- and fuel-saving reroutes.It is currently in use at American Airlines Integrated Operations Center in Fort Worth, TX. The concepts assessed,research conducted, and the operational capability developed, along with the NASA support and achievements are presented in this paper.

Usability Testing of the iPhone App to Improve Pain Assessment for Older Adults with Cognitive Impairment (Prehospital Setting): A Qualitative Study.

PubMed

Docking, Rachael E; Lane, Matthew; Schofield, Pat A

2017-03-15

Pain assessment in older adults with cognitive impairment is often challenging, and paramedics are not given sufficient tools/training to assess pain. The development of a mobile app may improve pain assessment and management in this vulnerable population. We conducted usability testing of a newly developed iPhone pain assessment application with potential users, in this case as a tool for clinical paramedic practice to improve pain assessment of older adults with cognitive impairment. We conducted usability testing with paramedic students and a Delphi panel of qualified paramedics. Participants studied the app and paper-based algorithm from which the app was developed. The potential use for the app was discussed. Usability testing focus groups were recorded, transcribed verbatim, and analyzed using a thematic approach. Proposed recommendations were disseminated to the Delphi panel that reviewed and confirmed them. Twenty-four paramedic students from two UK ambulance services participated in the focus groups. Usability of the app and its potential were viewed positively. Four major themes were identified: 1) overall opinion of the app for use in paramedic services; 2) incorporating technological applications into the health care setting; 3) improving knowledge and governance; and 4) alternative uses for the app. Subthemes were identified and are presented. Our results indicate that the pain assessment app constitutes a potentially useful tool in the prehospital setting. By providing access to a tool specifically developed to help identify/assess pain in a user-friendly format, paramedics are likely to have increased knowledge and confidence in assessing pain in patients with dementia. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Monitoring Compliance to Promote Quality Assurance: Development of a Mental Health Clinical Chart Audit Tool in Belize, 2013.

PubMed

Winer, Rachel A; Bennett, Eleanor; Murillo, Illouise; Schuetz-Mueller, Jan; Katz, Craig L

2015-09-01

Belize trained psychiatric nurse practitioners (PNPs) in the early 1990s to provide mental health services throughout the country. Despite overwhelming success, the program is limited by lack of monitoring, evaluation, and surveillance. To promote quality assurance, we developed a chart audit tool to monitor mental healthcare delivery compliance for initial psychiatric assessment notes completed by PNPs. After reviewing the Belize Health Information System electronic medical record system, we developed a clinical audit tool to capture 20 essential components for initial assessment clinical notes. The audit tool was then piloted for initial assessment notes completed during July through September of 2013. One hundred and thirty-four initial psychiatric interviews were audited. The average chart score among all PNPs was 9.57, ranging from 3 to 15. Twenty-three charts-or 17.2%-had a score of 14 or higher and met a 70% compliance benchmark goal. Among indicators most frequently omitted included labs ordered and named (15.7%) and psychiatric diagnosis (21.6%). Explicit statement of medications initiated with dose and frequency occurred in 47.0% of charts. Our findings provide direction for training and improvement, such as emphasizing the importance of naming labs ordered, medications and doses prescribed, and psychiatric diagnoses in initial assessment clinical notes. We hope this initial assessment helps enhance mental health delivery compliance by prompting creation of BHIS templates, development of audits tools for revisit follow-up visits, and establishment of corrective actions for low-scoring practitioners. These efforts may serve as a model for implementing quality assurance programming in other low resource settings.

Frameworks and tools for risk assessment of manufactured nanomaterials.

PubMed

Hristozov, Danail; Gottardo, Stefania; Semenzin, Elena; Oomen, Agnes; Bos, Peter; Peijnenburg, Willie; van Tongeren, Martie; Nowack, Bernd; Hunt, Neil; Brunelli, Andrea; Scott-Fordsmand, Janeck J; Tran, Lang; Marcomini, Antonio

2016-10-01

Commercialization of nanotechnologies entails a regulatory requirement for understanding their environmental, health and safety (EHS) risks. Today we face challenges to assess these risks, which emerge from uncertainties around the interactions of manufactured nanomaterials (MNs) with humans and the environment. In order to reduce these uncertainties, it is necessary to generate sound scientific data on hazard and exposure by means of relevant frameworks and tools. The development of such approaches to facilitate the risk assessment (RA) of MNs has become a dynamic area of research. The aim of this paper was to review and critically analyse these approaches against a set of relevant criteria. The analysis concluded that none of the reviewed frameworks were able to fulfill all evaluation criteria. Many of the existing modelling tools are designed to provide screening-level assessments rather than to support regulatory RA and risk management. Nevertheless, there is a tendency towards developing more quantitative, higher-tier models, capable of incorporating uncertainty into their analyses. There is also a trend towards developing validated experimental protocols for material identification and hazard testing, reproducible across laboratories. These tools could enable a shift from a costly case-by-case RA of MNs towards a targeted, flexible and efficient process, based on grouping and read-across strategies and compliant with the 3R (Replacement, Reduction, Refinement) principles. In order to facilitate this process, it is important to transform the current efforts on developing databases and computational models into creating an integrated data and tools infrastructure to support the risk assessment and management of MNs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating online diagnostic decision support tools for the clinical setting.

PubMed

Pryor, Marie; White, David; Potter, Bronwyn; Traill, Roger

2012-01-01

Clinical decision support tools available at the point of care are an effective adjunct to support clinicians to make clinical decisions and improve patient outcomes. We developed a methodology and applied it to evaluate commercially available online clinical diagnostic decision support (DDS) tools for use at the point of care. We identified 11 commercially available DDS tools and assessed these against an evaluation instrument that included 6 categories; general information, content, quality control, search, clinical results and other features. We developed diagnostically challenging clinical case scenarios based on real patient experience that were commonly missed by junior medical staff. The evaluation was divided into 2 phases; an initial evaluation of all identified and accessible DDS tools conducted by the Clinical Information Access Portal (CIAP) team and a second phase that further assessed the top 3 tools identified in the initial evaluation phase. An evaluation panel consisting of senior and junior medical clinicians from NSW Health conducted the second phase. Of the eleven tools that were assessed against the evaluation instrument only 4 tools completely met the DDS definition that was adopted for this evaluation and were able to produce a differential diagnosis. From the initial phase of the evaluation 4 DDS tools scored 70% or more (maximum score 96%) for the content category, 8 tools scored 65% or more (maximum 100%) for the quality control category, 5 tools scored 65% or more (maximum 94%) for the search category, and 4 tools score 70% or more (maximum 81%) for the clinical results category. The second phase of the evaluation was focused on assessing diagnostic accuracy for the top 3 tools identified in the initial phase. Best Practice ranked highest overall against the 6 clinical case scenarios used. Overall the differentiating factor between the top 3 DDS tools was determined by diagnostic accuracy ranking, ease of use and the confidence and credibility of the clinical information. The evaluation methodology used here to assess the quality and comprehensiveness of clinical DDS tools was effective in identifying the most appropriate tool for the clinical setting. The use of clinical case scenarios is fundamental in determining the diagnostic accuracy and usability of the tools.

Minimally invasive surgical video analysis: a powerful tool for surgical training and navigation.

PubMed

Sánchez-González, P; Oropesa, I; Gómez, E J

2013-01-01

Analysis of minimally invasive surgical videos is a powerful tool to drive new solutions for achieving reproducible training programs, objective and transparent assessment systems and navigation tools to assist surgeons and improve patient safety. This paper presents how video analysis contributes to the development of new cognitive and motor training and assessment programs as well as new paradigms for image-guided surgery.

Tools used to assess medical students competence in procedural skills at the end of a primary medical degree: a systematic review.

PubMed

Morris, Marie C; Gallagher, Tom K; Ridgway, Paul F

2012-01-01

The objective was to systematically review the literature to identify and grade tools used for the end point assessment of procedural skills (e.g., phlebotomy, IV cannulation, suturing) competence in medical students prior to certification. The authors searched eight bibliographic databases electronically - ERIC, Medline, CINAHL, EMBASE, Psychinfo, PsychLIT, EBM Reviews and the Cochrane databases. Two reviewers independently reviewed the literature to identify procedural assessment tools used specifically for assessing medical students within the PRISMA framework, the inclusion/exclusion criteria and search period. Papers on OSATS and DOPS were excluded as they focused on post-registration assessment and clinical rather than simulated competence. Of 659 abstracted articles 56 identified procedural assessment tools. Only 11 specifically assessed medical students. The final 11 studies consisted of 1 randomised controlled trial, 4 comparative and 6 descriptive studies yielding 12 heterogeneous procedural assessment tools for analysis. Seven tools addressed four discrete pre-certification skills, basic suture (3), airway management (2), nasogastric tube insertion (1) and intravenous cannulation (1). One tool used a generic assessment of procedural skills. Two tools focused on postgraduate laparoscopic skills and one on osteopathic students and thus were not included in this review. The levels of evidence are low with regard to reliability - κ = 0.65-0.71 and minimum validity is achieved - face and content. In conclusion, there are no tools designed specifically to assess competence of procedural skills in a final certification examination. There is a need to develop standardised tools with proven reliability and validity for assessment of procedural skills competence at the end of medical training. Medicine graduates must have comparable levels of procedural skills acquisition entering the clinical workforce irrespective of the country of training.

The Field-tested Learning Assessment Guide (FLAG): A Community Repository of Proven Alternative Assessment Instruments for STEM Education

NASA Astrophysics Data System (ADS)

Zeilik, M.; Garvin-Doxas, K.

2003-12-01

FLAG, the Field-tested Learning Assessment Guide (http://www.flaguide.org/) is a NSF funded website that offers broadly-applicable, self-contained modular classroom assessment techniques (CATs) and discipline-specific tools for STEM instructors creating new approaches to evaluate student learning, attitudes and performance. In particular, the FLAG contains proven techniques for alterative assessments---those needed for reformed, innovative STEM courses. Each tool has been developed, tested and refined in real classrooms at colleges and universities. The FLAG also contains an assessment primer, a section to help you select the most appropriate assessment technique(s) for your course goals, and other resources. In addition to references on instrument development and field-tested instruments on attitudes towards science, the FLAG also includes discipline-specific tools in Physics, Astronomy, Biology, and Mathematics. Building of the Geoscience collection is currently under way with the development of an instrument for detecting misconceptions of incoming freshmen on Space Science, which is being developed with the help of the Committee on Space Science and Astronomy of the American Association of Physics Teachers. Additional field-tested resources from the Geosciences are solicited from the community. Contributions should be sent to Michael Zeilik, zeilik@la.unm.edu. This work has been supported in part by NSF grant DUE 99-81155.

The SAFE-T assessment tool: derivation and validation of a web-based application for point-of-care evaluation of gastroenterology fellow performance in colonoscopy.

PubMed

Kumar, Navin L; Kugener, Guillaume; Perencevich, Molly L; Saltzman, John R

2018-01-01

Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise assessment tool to evaluate real-time fellow performance in colonoscopy administered via a web-based application. The Skill Assessment in Fellow Endoscopy Training (SAFE-T) tool was derived as a novel 5-question evaluation tool that captures both summative and formative feedback adapted into a web-based application. A prospective study of 15 gastroenterology fellows (5 fellows each from years 1 to 3 of training) was performed using the SAFE-T tool. An independent reviewer evaluated a subset of these procedures and completed the SAFE-T tool and Mayo Colonoscopy Skills Assessment Tool (MCSAT) for reliability testing. Twenty-six faculty completed 350 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score (year 1, 2.00; year 2, 3.84; year 3, 4.28) differentiated each sequential fellow year of training (P < .0001). The mean SAFE-T overall score decreased with increasing case complexity score, with straightforward cases compared with average cases (4.07 vs 3.50, P < .0001), and average cases compared with challenging cases (3.50 vs 3.08, P = .0134). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a kappa agreement statistic of 0.898 (P < .0001). Correlation of the SAFE-T overall score with the MCSAT overall hands-on and individual motor scores was excellent (each r > 0.90, P < .0001). We developed and validated the SAFE-T assessment tool, a concise and web-based means of assessing real-time gastroenterology fellow performance in colonoscopy. Copyright © 2018 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.

Measurement and Research Tools. Symposium 37. [AHRD Conference, 2001].

ERIC Educational Resources Information Center

2001

This symposium on measurement and research tools consists of three presentations. "An Examination of the Multiple Intelligences Developmental Assessment Scales (MIDAS)" (Albert Wiswell et al.) explores MIDAS's psychometric saliency. Findings indicates this instrument represents an incomplete attempt to develop a valid assessment of…

Health Impact Assessment Training Bijelo Polje Community Workshop

EPA Science Inventory

The main objective of the session is to develop capacity on this decision-making tool during a mini-workshop on the Health Impact Assessment (HIA) in Bijelo Polje, Montenegro. The HIA is a combination of procedures, methods and tools that systematically judges the potential, and ...

AGWA: The Automated Geospatial Watershed Assessment Tool

EPA Science Inventory

The Automated Geospatial Watershed Assessment Tool (AGWA, see: www.tucson.ars.ag.gov/agwa or http://www.epa.gov/esd/land-sci/agwa/) is a GIS interface jointly developed by the USDA-Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona...

Automated Geospatial Watershed Assessment Tool (AGWA) Poster Presentation

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA, see: www.tucson.ars.ag.gov/agwa or http://www.epa.gov/esd/land-sci/agwa/) is a GIS interface jointly developed by the USDA-Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona...

A GIS-BASED MODAL MODEL OF AUTOMOBILE EXHAUST EMISSIONS

EPA Science Inventory

The report presents progress toward the development of a computer tool called MEASURE, the Mobile Emission Assessment System for Urban and Regional Evaluation. The tool works toward a goal of providing researchers and planners with a way to assess new mobile emission mitigation s...

INTEGRATING A LANDSCAPE HYDROLOGIC ANALYSIS FOR WATERSHED ASSESSMENT

EPA Science Inventory

Methods to provide linkages between a hydrologic modeling tool (AGW A) and landscape assessment tool (A TtILA) for determining the vulnerability of semi-arid landscapes to natural and human-induced landscape pattern changes have been developed. The objective of this study is to ...

Family history assessment for colorectal cancer (CRC) risk analysis - comparison of diagram- and questionnaire-based web interfaces.

PubMed

Schultz, Michael; Seo, Steven Bohwan; Holt, Alec; Regenbrecht, Holger

2015-11-18

Colorectal cancer (CRC) has a high incidence, especially in New Zealand. The reasons for this are unknown. While most cancers develop sporadically, a positive family history, determined by the number and age at diagnosis of affected first and second degree relatives with CRC is one of the major factors, which may increase an individual's lifetime risk. Before a patient can be enrolled in a surveillance program a detailed assessment and documentation of the family history is important but time consuming and often inaccurate. The documentation is usually paper-based. Our aim was therefore to develop and validate the usability and efficacy of a web-based family history assessment tool for CRC suitable for the general population. The tool was also to calculate the risk and make a recommendation for surveillance. Two versions of an electronic assessment tool, diagram-based and questionnaire-based, were developed with the risk analysis and recommendations for surveillance based on the New Zealand Guidelines Group recommendations. Accuracy of our tool was tested prior to the study by comparing risk calculations based on family history by experienced gastroenterologists with the electronic assessment. The general public, visiting a local science fair were asked to use and comment on the usability of the two interfaces. Ninety people assessed and commented on the two interfaces. Both interfaces were effective in assessing the risk to develop CRC through their familial history for CRC. However, the questionnaire-based interface performed with significantly better satisfaction (p = 0.001) than the diagram-based interface. There was no difference in efficacy though. We conclude that a web-based questionnaire tool can assist in the accurate documentation and analysis of the family history relevant to determine the individual risk of CRC based on local guidelines. The calculator is now implemented and assessable through the web-page of a local charity for colorectal cancer awareness and integral part of the local general practitioners' e-referral system for colonic imaging.

Inspection of the Math Model Tools for On-Orbit Assessment of Impact Damage Report. Version 1.0

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Raju, Ivatury S.; Piascik, Robert S.; Kramer White, Julie; Labbe, Steve G.; Rotter, Hank A.

2005-01-01

In Spring of 2005, the NASA Engineering Safety Center (NESC) was engaged by the Space Shuttle Program (SSP) to peer review the suite of analytical tools being developed to support the determination of impact and damage tolerance of the Orbiter Thermal Protection Systems (TPS). The NESC formed an independent review team with the core disciplines of materials, flight sciences, structures, mechanical analysis and thermal analysis. The Math Model Tools reviewed included damage prediction and stress analysis, aeroheating analysis, and thermal analysis tools. Some tools are physics-based and other tools are empirically-derived. Each tool was created for a specific use and timeframe, including certification, real-time pre-launch assessments, and real-time on-orbit assessments. The tools are used together in an integrated strategy for assessing the ramifications of impact damage to tile and RCC. The NESC teams conducted a peer review of the engineering data package for each Math Model Tool. This report contains the summary of the team observations and recommendations from these reviews.

Assessment of a human computer interface prototyping environment

NASA Technical Reports Server (NTRS)

Moore, Loretta A.

1993-01-01

A Human Computer Interface (HCI) prototyping environment with embedded evaluation capability has been successfully assessed which will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. The HCI prototyping environment is designed to include four components: (1) a HCI format development tool, (2) a test and evaluation simulator development tool, (3) a dynamic, interactive interface between the HCI prototype and simulator, and (4) an embedded evaluation capability to evaluate the adequacy of an HCI based on a user's performance.

My child at mealtime: A visually enhanced self-assessment of feeding styles for low-income parents of preschoolers.

PubMed

Ontai, Lenna L; Sitnick, Stephanie L; Shilts, Mical K; Townsend, Marilyn S

2016-04-01

The importance of caregiver feeding styles on children's dietary outcomes is well documented. However, the instruments used to assess feeding style are limited by high literacy demands, making selfassessment with low-income audiences challenging. The purpose of the current study is to report on the development of My Child at Mealtime (MCMT), a self-assessment tool with reduced literacy demands, designed to measure feeding styles with parents of preschool-aged children. Cognitive interviews were conducted with 44 Head Start parents of 2-5 year old children to develop question wording and identify appropriate visuals. The resulting tool was administered to 119 ethnically diverse, low-income parents of 2-5 year old children. Factor analysis resulted in a two-factor structure that reflects responsiveness and demandingness in a manner consistent with existing assessment tools. Results indicate the final visually enhanced MCMT self-assessment tool provides a measure of parenting style consistent with existing measures, while reducing the literacy demand. Copyright © 2016 Elsevier Ltd. All rights reserved.

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

FFI: What it is and what it can do for you

Treesearch

Duncan C. Lutes; MaryBeth Keifer; Nathan C. Benson; John F. Caratti

2009-01-01

A new monitoring tool called FFI (FEAT/FIREMON Integrated) has been developed to assist managers with collection, storage and analysis of ecological information. The tool was developed through the complementary integration of two fire effects monitoring systems commonly used in the United States: FIREMON and the Fire Ecology Assessment Tool (FEAT). FFI provides...

Part 2: pressure ulcer assessment: implementation and revision of CALCULATE.

PubMed

Richardson, Annette; Straughan, Christine

2015-11-01

Critically ill patients are a vulnerable group at very high risk of developing pressure ulcers, and the incidence varies within critical care. A number of strategies were used to implement the pressure ulcer assessment tool CALCULATE across four adult critical care units. Strategies included, nursing leadership, the provision of definitions for each risk factor, information laid out on posters at each patient's bedside, changes to pre-printed nursing documentation and a 30-min focused training package. Two local audits were conducted to measure the number and types of risk factors occurring in patients with pressure ulcers, and to assess the frequency of assessments and gain feedback on the usability of the tool in practice. Critical care acquired pressure ulcer incidence was 3.4%. The two most commonly occurring risk factors were impaired circulation (82%) and mechanical ventilation (75%). Patients had a mean score of 4, and 65% had 4 or more reported risk factors. Feedback on the usability of the tool was mainly positive. The tool CALCULATE was relatively straightforward to implement and was likely to be due to the design and the various change strategies used to implement the new approach. The seven point tool was revised to an eight point score based on nurses' clinical feedback. Research is required to further enhance and develop pressure ulcer assessment. Meanwhile CALCULATE offers an easy to use and appropriate tool to assist in the identification of patients at an elevated risk of pressure ulcer damage. Careful choice of change management strategies are needed when implementing a new assessment tool. CALCULATE should be considered for use in critical care for pressure ulcer assessment, but used alongside nurses' clinical judgement and observations of skin. © 2015 British Association of Critical Care Nurses.

Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

PubMed

Cagiltay, Nergiz Ercil; Ozcelik, Erol; Sengul, Gokhan; Berker, Mustafa

2017-11-01

In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is critical for better designing and developing skill assessment surgical simulation tools.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cox, S.; Katz, J.; Wurtenberger, L.

Low emission development strategies (LEDS) articulate economy-wide policies and implementation plans designed to enable a country to meet its long-term development objectives while reducing greenhouse gas emissions. A development impact assessment tool was developed to inform an analytically robust and transparent prioritization of LEDS actions based on their economic, social, and environmental impacts. The graphical tool helps policymakers communicate the development impacts of LEDS options and identify actions that help meet both emissions reduction and development goals. This paper summarizes the adaptation and piloting of the tool in Kenya and Montenegro. The paper highlights strengths of the tool and discussesmore » key needs for improving it.« less

Cumulative Impact Assessment: Approaching Environmental Capacity in Development Area Using Environmental Impact Assessment Information

NASA Astrophysics Data System (ADS)

Cho, N.; Lee, M. J.; Maeng, J. H.

2017-12-01

Environmental impact assessment estimates the impact of development as a business unit and establishes mitigation plan. If the development is done, its economic effects can spread to the nearby areas. So that various developments can be distributed at different time intervals. The impact of the new developments can be combined with existing environmental impacts and can have a larger impact. That is, Cumulative impact assessment is needed to consider the environmental capacity of the Nearby area. Cumulative impact assessments require policy tools such as environmental impact assessment information and cumulative impact estimation models. In Korea, environmental information (water quality, air quality, etc.) of the development site is measured for environmental impact assessment and monitored for a certain period (generally 5 years) after the project. In addition, by constructing the environmental information as a spatial database, it is possible to express the environmental impact on a regional basis spatially and to intuitively use it for development site selection. Utilizing a composite model of environmental impact assessment information and Remote Sensing data for cumulative impact estimation, That can be used as a policy decision support tool that provides quantitative information for development area management, such as time series effect and sprawl phenomenon.

The ELPAT living organ donor Psychosocial Assessment Tool (EPAT): from 'what' to 'how' of psychosocial screening - a pilot study.

PubMed

Massey, Emma K; Timmerman, Lotte; Ismail, Sohal Y; Duerinckx, Nathalie; Lopes, Alice; Maple, Hannah; Mega, Inês; Papachristou, Christina; Dobbels, Fabienne

2018-01-01

Thorough psychosocial screening of donor candidates is required in order to minimize potential negative consequences and to strive for optimal safety within living donation programmes. We aimed to develop an evidence-based tool to standardize the psychosocial screening process. Key concepts of psychosocial screening were used to structure our tool: motivation and decision-making, personal resources, psychopathology, social resources, ethical and legal factors and information and risk processing. We (i) discussed how each item per concept could be measured, (ii) reviewed and rated available validated tools, (iii) where necessary developed new items, (iv) assessed content validity and (v) pilot-tested the new items. The resulting ELPAT living organ donor Psychosocial Assessment Tool (EPAT) consists of a selection of validated questionnaires (28 items in total), a semi-structured interview (43 questions) and a Red Flag Checklist. We outline optimal procedures and conditions for implementing this tool. The EPAT and user manual are available from the authors. Use of this tool will standardize the psychosocial screening procedure ensuring that no psychosocial issues are overlooked and ensure that comparable selection criteria are used and facilitate generation of comparable psychosocial data on living donor candidates. © 2017 Steunstichting ESOT.

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review.

PubMed

Dall, P M; Coulter, E H; Fitzsimons, C F; Skelton, D A; Chastin, Sfm

2017-04-08

Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Systematic searches were conducted via EBSCO, reference lists and expert opinion. The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Cognitive assessment tools in Asia: a systematic review.

PubMed

Rosli, Roshaslina; Tan, Maw Pin; Gray, William Keith; Subramanian, Pathmawathi; Chin, Ai-Vyrn

2016-02-01

The prevalence of dementia is increasing in Asia than in any other continent. However, the applicability of the existing cognitive assessment tools is limited by differences in educational and cultural factors in this setting. We conducted a systematic review of published studies on cognitive assessments tools in Asia. We aimed to rationalize the results of available studies which evaluated the validity of cognitive tools for the detection of cognitive impairment and to identify the issues surrounding the available cognitive impairment screening tools in Asia. Five electronic databases (CINAHL, MEDLINE, Embase, Cochrane Library, and Science Direct) were searched using the keywords dementia Or Alzheimer Or cognitive impairment And screen Or measure Or test Or tool Or instrument Or assessment, and 2,381 articles were obtained. Thirty-eight articles, evaluating 28 tools in seven Asian languages, were included. Twenty-nine (76%) of the studies had been conducted in East Asia with only four studies conducted in South Asia and no study from northern, western, or central Asia or Indochina. Local language translations of the Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA) were assessed in 15 and six studies respectively. Only three tools (the Korean Dementia Screening Questionnaire, the Picture-based Memory Intelligence Scale, and the revised Hasegawa Dementia Screen) were derived de novo from Asian populations. These tools were assessed in five studies. Highly variable cut-offs were reported for the MMSE (17-29/30) and MoCA (21-26/30), with 13/19 (68%) of studies reporting educational bias. Few cognitive assessment tools have been validated in Asia, with no published validation studies for many Asian nations and languages. In addition, many available tools display educational bias. Future research should include concerted efforts to develop culturally appropriate tools with minimal educational bias.

Scientific Overview /Regional Analyses and Approaches

EPA Science Inventory

A workshop, Tools for Assessing Stream Dissolved Minerals, will introduce approaches and EPA tools for regional and site specific development of water quality criteria based on observations from Arkansas streams. In this presentation regional approaches and tools are described. ...

Methodology to Assess No Touch Audit Software Using Simulated Building Utility Data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cheung, Howard; Braun, James E.; Langner, M. Rois

This report describes a methodology developed for assessing the performance of no touch building audit tools and presents results for an available tool. Building audits are conducted in many commercial buildings to reduce building energy costs and improve building operation. Because the audits typically require significant input obtained by building engineers, they are usually only affordable for larger commercial building owners. In an effort to help small building and business owners gain the benefits of an audit at a lower cost, no touch building audit tools have been developed to remotely analyze a building's energy consumption.

The Systems SOAP Note: A Systems Learning Tool.

PubMed

Mitsuishi, Fumi; Young, John Q; Leary, Mark; Dilley, James; Mangurian, Christina

2016-02-01

Systems-based practice (SBP) is the only Accreditation Council for Graduate Medical Education (ACGME) competency concerned with public health and is relatively neglected in residency curricula. A tool was developed and pilot-tested to improve SBP learning on inpatient psychiatry rotations. A four-step approach was used: (1) literature review, (2) expert consultation, (3) tool development, and (4) pilot testing on four cases and evaluation for completion time and preliminary efficacy. Out of 51 SBP articles, six (12%) focused on psychiatric residency programs, and none had a practical SBP learning tool. The "systems SOAP (subjective, objective, assessment, plan) note" (S-SOAP) was structured after a clinical SOAP note and was easy to use (mean completion time = 60 min), and residents self-reported more insight into systems issues. The S-SOAP tool was effectively integrated into clinical experience and provided insight into systemic complexities. Future research should assess SBP knowledge acquisition after the use of such tools.

Behavioral Health Support of NASA Astronauts for International Space Station Missions

NASA Technical Reports Server (NTRS)

Sipes, Walter

2000-01-01

Two areas of focus for optimizing behavioral health and human performance during International Space Station missions are 1) sleep and circadian assessment and 2) behavioral medicine. The Mir experience provided the opportunity to examine the use and potential effectiveness of tools and procedures to support the behavioral health of the crew. The experience of NASA has shown that on-orbit performance can be better maintained if behavioral health, sleep, and circadian issues are effectively monitored and properly addressed. For example, schedules can be tailored based upon fatigue level of crews and other behavioral and cognitive indicators to maximize performance. Previous research and experience with long duration missions has resulted in the development and upgrade of tools used to monitor fatigue, stress, cognitive function, and behavioral health. Self-assessment and objective tools such as the Spaceflight Cognitive Assessment Tool have been developed and refined to effectively address behavioral medicine countermeasures in space.

Automated Geospatial Watershed Assessment Tool (AGWA)

USDA-ARS?s Scientific Manuscript database

The Automated Geospatial Watershed Assessment tool (AGWA, see: www.tucson.ars.ag.gov/agwa or http://www.epa.gov/esd/land-sci/agwa/) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University ...

THE TWO FACES OF WATER CHEMISTRY: STRESSOR ON, AND INDICATOR OF, THE ECOLOGICAL CONDITION OF THE GREAT RIVERS.

EPA Science Inventory

This poster presentation is designed to enlighten the interested masses about water quality assessment tools. It is not intended for policy, rather to stimulate thought on the importance of developing water chemistry as as assessment tool.

Monitoring the ability to deliver care in low- and middle-income countries: a systematic review of health facility assessment tools

PubMed Central

Nickerson, Jason W; Adams, Orvill; Attaran, Amir; Hatcher-Roberts, Janet; Tugwell, Peter

2015-01-01

Introduction Health facilities assessments are an essential instrument for health system strengthening in low- and middle-income countries. These assessments are used to conduct health facility censuses to assess the capacity of the health system to deliver health care and to identify gaps in the coverage of health services. Despite the valuable role of these assessments, there are currently no minimum standards or frameworks for these tools. Methods We used a structured keyword search of the MEDLINE, EMBASE and HealthStar databases and searched the websites of the World Health Organization, the World Bank and the International Health Facilities Assessment Network to locate all available health facilities assessment tools intended for use in low- and middle-income countries. We parsed the various assessment tools to identify similarities between them, which we catalogued into a framework comprising 41 assessment domains. Results We identified 10 health facility assessment tools meeting our inclusion criteria, all of which were included in our analysis. We found substantial variation in the comprehensiveness of the included tools, with the assessments containing indicators in 13 to 33 (median: 25.5) of the 41 assessment domains included in our framework. None of the tools collected data on all 41 of the assessment domains we identified. Conclusions Not only do a large number of health facility assessment tools exist, but the data they collect and methods they employ are very different. This certainly limits the comparability of the data between different countries’ health systems and probably creates blind spots that impede efforts to strengthen those systems. Agreement is needed on the essential elements of health facility assessments to guide the development of specific indicators and for refining existing instruments. PMID:24895350

Creation of a Tool for Assessing Knowledge in Evidence-Based Decision-Making in Practicing Health Care Providers.

PubMed

Spurr, Kathy; Dechman, Gail; Lackie, Kelly; Gilbert, Robert

2016-01-01

Evidence-based decision-making (EBDM) is the process health care providers (HCPs) use to identify and appraise potential evidence. It supports the integration of best research evidence with clinical expertise and patient values into the decision-making process for patient care. Competence in this process is essential to delivery of optimal care. There is no objective tool that assesses EBDM across HCP groups. This research aimed to develop a content valid tool to assess knowledge of the principles of evidence-based medicine and the EBDM process, for use with all HCPs. A Delphi process was used in the creation of the tool. Pilot testing established its content validity with the added benefit of evaluating HCPs' knowledge of EBDM. Descriptive statistics and multivariate mixed models were used to evaluate individual survey responses in total, as well as within each EBDM component. The tool consisted of 26 multiple-choice questions. A total of 12,884 HCPs in Nova Scotia were invited to participate in the web-based validation study, yielding 818 (6.3%) participants, 471 of whom completed all questions. The mean overall score was 68%. Knowledge in one component, integration of evidence with clinical expertise and patient preferences, was identified as needing development across all HCPs surveyed. A content valid tool for assessing HCP EBDM knowledge was created and can be used to support the development of continuing education programs to enhance EBDM competency.

Development of a methodological tool for the assessment of the hydromorphological conditions of lakes in Europe

NASA Astrophysics Data System (ADS)

Gay, Aurore; Argillier, Christine; Reynaud, Nathalie; Nicolas, Delphine; Baudoin, Jean-Marc

2017-04-01

The assessment of the ecological status of surface waters considering the biological, physico-chemical and hydromorphological conditions is requested by the European Water Framework Directive (WFD). If research efforts have particularly concentrated on rivers, lakes have yet received less attention. Nevertheless, due to their function of receptacles of inland waters, the habitats they provide to an important biodiversity and the numerous services they support (water supply, recreational activities, hydroelectricity), assessing the ecological quality of lakes becomes crucial for their protection. Still, this task remains challenging, especially considering the hydromorphological compartments. Indeed, while promising tools already exist to assess the lake biological and physico-chemical status, our comprehension of the impact of hydromophological impairments on the global ecosystem functioning remains poor and existing tools to assess such impacts often focus only on morphological aspects and in a qualitative rather than quantitative way. In this context, our study aims at providing stakeholders with a methodology to assess quantitatively the hydrological and morphological quality of lakes in Europe. The developed methodology, LAKe HYdromorphological Conditions tool (LAKHYC tool) is based on our current knowledge of the functioning of lakes and pre-existing works (e.g., Rowan et al., 2012; Rinaldi et al., 2013). The LAKHYC tool integrates the six parameters requested by the WFD, each one being assessed by at least three descriptors that are calculated as Ecological Quality Ratios, i.e. as the deviation from a reference condition. The originality of the present method lies in the fact that specific reference conditions are defined for each descriptor. In this way, we avoid using a predetermined set of lakes considered as not impacted by human activities and which often corresponds to natural lakes in specific areas (e.g., mountains) and do not represent the diversity of lakes in Europe. Moreover, the combination of all descriptors provides a score that reflects the overall hydromorphological conditions of each lake and allows for a strict comparison of the results between different systems. The range of values is subdivided into five classes corresponding to various level of impairment (from low to high degradation). The application of the LAKHYC tool on lakes across Europe is necessary to improve the tool (i.e., for intercalibration) and enable the comparison of the conditions of lakes on a European-large scale. Further developments of the LAKHYC tool will also include the estimation of associated uncertainties and a sensitivity analysis of this multimetric index. Rinaldi M., Surian N., Comiti F., Bussettini M. (2013) A method for the assessment and analysis of the hydromorphological condition of Italian streams: The Morphological Quality Index (MQI). Geomorphology, 180-181:96-108 Rowan J.S., Greig S.J., Armstrong C.T., Smith D.C., Tierney D. (2012) Development of a classification and decision-support tool for assessing lake hydromorphology. Environmental Modelling & Software, 36:86-98.

Development and Construct Validation of the Interprofessional Attitudes Scale

PubMed Central

Norris, Jeffrey; Carpenter, Joan G.; Eaton, Jacqueline; Guo, Jia-Wen; Lassche, Madeline; Pett, Marjorie A.; Blumenthal, Donald K.

2015-01-01

Purpose Training of health professionals requires development of interprofessional competencies and assessment of these competencies. No validated tools exist to assess all four competency domains described in the 2011 Core Competencies for Interprofessional Collaborative Practice (the IPEC Report). The purpose of this study was to develop and validate a scale based on the IPEC competency domains that assesses interprofessional attitudes of students in the health professions. Method In 2012, a survey tool was developed and administered to 1,549 students from the University of Utah Health Science Center, an academic health center composed of four schools and colleges (Health, Medicine, Nursing, and Pharmacy). Exploratory and confirmatory factor analyses (EFA and CFA) were performed to validate the assessment tool, eliminate redundant questions, and to identify subscales. Results The EFA and CFA focused on aligning subscales with IPEC core competencies, and demonstrating good construct validity and internal consistency reliability. A response rate of 45% (n = 701) was obtained. Responses with complete data (n=678) were randomly split into two datasets which were independently analyzed using EFA and CFA. The EFA produced a 27-item scale, with five subscales (Cronbach’s alpha coefficients: 0.62 to 0.92). CFA indicated the content of the five subscales was consistent with the EFA model. Conclusions The Interprofessional Attitudes Scale (IPAS) is a novel tool that, compared to previous tools, better reflects current trends in interprofessional competencies. The IPAS should be useful to health sciences educational institutions and others training people to work collaboratively in interprofessional teams. PMID:25993280

Conceptualisation and development of the Conversational Health Literacy Assessment Tool (CHAT).

PubMed

O'Hara, Jonathan; Hawkins, Melanie; Batterham, Roy; Dodson, Sarity; Osborne, Richard H; Beauchamp, Alison

2018-03-22

The aim of this study was to develop a tool to support health workers' ability to identify patients' multidimensional health literacy strengths and challenges. The tool was intended to be suitable for administration in healthcare settings where health workers must identify health literacy priorities as the basis for person-centred care. Development was based on a qualitative co-design process that used the Health Literacy Questionnaire (HLQ) as a framework to generate questions. Health workers were recruited to participate in an online consultation, a workshop, and two rounds of pilot testing. Participating health workers identified and refined ten questions that target five areas of assessment: supportive professional relationships, supportive personal relationships, health information access and comprehension, current health behaviours, and health promotion barriers and support. Preliminary evidence suggests that application of the Conversational Health Literacy Assessment Tool (CHAT) can support health workers to better understand the health literacy challenges and supportive resources of their patients. As an integrated clinical process, the CHAT can supplement existing intake and assessment procedures across healthcare settings to give insight into patients' circumstances so that decisions about care can be tailored to be more appropriate and effective.

An aquatic multiscale assessment and planning framework approach—forest plan revision case study

Treesearch

Kerry Overton; Ann D. Carlson; Cynthia Tait

2010-01-01

The Aquatic Multiscale Assessment and Planning Framework is a Web-based decision-support tool developed to assist aquatic practitioners in managing fisheries and watershed information. This tool, or framework, was designed to assist resource assessments and planning efforts from the broad scale to the fine scale, to document procedures, and to link directly to relevant...

Operational Assessment of Tools for Accelerating Leader Development (ALD): Volume 1, Capstone Report

DTIC Science & Technology

2009-06-01

in units and user juries provided feedback on the tools. The pressures of the operational environment seriously limited the time available to work...following functions: account set-up, user authentication, learning management , usage monitoring, problem reporting, assessment data collection, data...especially sources of data) represented—demonstration/assessment manager , operations manager , Web site experts, users (target audience), data collectors

Falls risk assessment in older patients in hospital.

PubMed

Matarese, Maria; Ivziku, Dhurata

2016-07-27

Falls are the most frequent adverse event reported in hospitals, usually affecting older patients. All hospitals in NHS organisations develop risk prevention policies that include falls risk assessment. Falls risk assessment involves the use of risk screening tools, aimed at identifying patients at increased risk of falls, and risk assessment tools, which identify a patient's risk factors for falls. Various risk screening tools have been used in clinical practice, but no single tool is able to identify all patients at risk of falls or to accurately exclude all those who are not at risk of falls. Guidelines recommend that patients aged 65 years and over who are admitted to hospital should be considered at high risk of falls and that a multifactorial falls risk assessment should be performed. Therefore, falls risk assessment tools should be used to identify the risk factors for each inpatient aged 65 years or over, in order to determine the most appropriate care plan for falls prevention and to maximise patient mobility and independence.

Screening and assessment tools for pediatric malnutrition.

PubMed

Huysentruyt, Koen; Vandenplas, Yvan; De Schepper, Jean

2016-06-18

The ideal measures for screening and assessing undernutrition in children remain a point of discussion in literature. This review aims to provide an overview of recent advances in the nutritional screening and assessment methods in children. This review focuses on two major topics that emerged in literature since 2015: the practical endorsement of the new definition for pediatric undernutrition, with a focus on anthropometric measurements and the search for a consensus on pediatric nutritional screening tools in different settings. Few analytical tools exist for the assessment of the nutritional status in children. The subjective global nutritional assessment has been validated by anthropometric as well as clinical outcome parameters. Nutritional screening can help in selecting patients that benefit the most from a full nutritional assessment. Two new screening tools have been developed for use in a general (mixed) hospital population, and one for a population of children with cancer. The value of screening tools in different disease-specific and outpatient pediatric populations remains to be proven.

The development and application of a new tool to assess the adequacy of the content and timing of antenatal care

PubMed Central

2011-01-01

Background Current measures of antenatal care use are limited to initiation of care and number of visits. This study aimed to describe the development and application of a tool to assess the adequacy of the content and timing of antenatal care. Methods The Content and Timing of care in Pregnancy (CTP) tool was developed based on clinical relevance for ongoing antenatal care and recommendations in national and international guidelines. The tool reflects minimal care recommended in every pregnancy, regardless of parity or risk status. CTP measures timing of initiation of care, content of care (number of blood pressure readings, blood tests and ultrasound scans) and whether the interventions were received at an appropriate time. Antenatal care trajectories for 333 pregnant women were then described using a standard tool (the APNCU index), that measures the quantity of care only, and the new CTP tool. Both tools categorise care into 4 categories, from 'Inadequate' (both tools) to 'Adequate plus' (APNCU) or 'Appropriate' (CTP). Participants recorded the timing and content of their antenatal care prospectively using diaries. Analysis included an examination of similarities and differences in categorisation of care episodes between the tools. Results According to the CTP tool, the care trajectory of 10,2% of the women was classified as inadequate, 8,4% as intermediate, 36% as sufficient and 45,3% as appropriate. The assessment of quality of care differed significantly between the two tools. Seventeen care trajectories classified as 'Adequate' or 'Adequate plus' by the APNCU were deemed 'Inadequate' by the CTP. This suggests that, despite a high number of visits, these women did not receive the minimal recommended content and timing of care. Conclusions The CTP tool provides a more detailed assessment of the adequacy of antenatal care than the current standard index. However, guidelines for the content of antenatal care vary, and the tool does not at the moment grade over-use of interventions as 'Inappropriate'. Further work needs to be done to refine the content items prior to larger scale testing of the impact of the new measure. PMID:21896201

The Development of a Conceptual Framework and Tools to Assess Undergraduates' Principled Use of Models in Cellular Biology

PubMed Central

Merritt, Brett; Urban-Lurain, Mark; Parker, Joyce

2010-01-01

Recent science education reform has been marked by a shift away from a focus on facts toward deep, rich, conceptual understanding. This requires assessment that also focuses on conceptual understanding rather than recall of facts. This study outlines our development of a new assessment framework and tool—a taxonomy— which, unlike existing frameworks and tools, is grounded firmly in a framework that considers the critical role that models play in science. It also provides instructors a resource for assessing students' ability to reason about models that are central to the organization of key scientific concepts. We describe preliminary data arising from the application of our tool to exam questions used by instructors of a large-enrollment cell and molecular biology course over a 5-yr period during which time our framework and the assessment tool were increasingly used. Students were increasingly able to describe and manipulate models of the processes and systems being studied in this course as measured by assessment items. However, their ability to apply these models in new contexts did not improve. Finally, we discuss the implications of our results and the future directions for our research. PMID:21123691

Improving diabetic foot care in a nurse-managed safety-net clinic.

PubMed

Peterson, Joann M; Virden, Mary D

2013-05-01

This article is a description of the development and implementation of a Comprehensive Diabetic Foot Care Program and assessment tool in an academically affiliated nurse-managed, multidisciplinary, safety-net clinic. The assessment tool parallels parameters identified in the Task Force Foot Care Interest Group of the American Diabetes Association's report published in 2008, "Comprehensive Foot Examination and Risk Assessment." Review of literature, Silver City Health Center's (SCHC) 2009 Annual Report, retrospective chart review. Since the full implementation of SCHC's Comprehensive Diabetic Foot Care Program, there have been no hospitalizations of clinic patients for foot-related complications. The development of the Comprehensive Diabetic Foot Assessment tool and the implementation of the Comprehensive Diabetic Foot Care Program have resulted in positive outcomes for the patients in a nurse-managed safety-net clinic. This article demonstrates that quality healthcare services can successfully be developed and implemented in a safety-net clinic setting. ©2012 The Author(s) Journal compilation ©2012 American Association of Nurse Practitioners.

Sustaining Innovation: Developing an Instructional Technology Assessment Process

ERIC Educational Resources Information Center

Carmo, Monica Cristina

2013-01-01

This case study developed an instructional technology assessment process for the Gevirtz Graduate School of Education (GGSE). The theoretical framework of Adelman and Taylor (2001) guided the development of this instructional technology assessment process and the tools to aid in its facilitation. GGSE faculty, staff, and graduate students…

Prostate Upgrading Team Project — EDRN Public Portal

Cancer.gov

Aim 1: We will develop a risk assessment tool using commonly-collected clinical information from a series of contemporary radical prostatectomies to predict the risk of prostate cancer upgrading to high grade cancer at radical prostatectomy. These data will be combined as a part of our Early Detection Research Network (EDRN) GU Working Group into a risk assessment tool; this tool will be named the EDRN Prostatectomy Upgrading Calculator or (EPUC).

Evaluation of tools used to measure calcium and/or dairy consumption in adults.

PubMed

Magarey, Anthea; Baulderstone, Lauren; Yaxley, Alison; Markow, Kylie; Miller, Michelle

2015-05-01

To identify and critique tools for the assessment of Ca and/or dairy intake in adults, in order to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles reporting on originally developed tools or testing the reliability or validity of existing tools that measure Ca and/or dairy intake in adults were included. Author-defined criteria for reporting reliability and validity properties were applied. Studies conducted in Western countries. Adults. Thirty papers, utilising thirty-six tools assessing intake of dairy, Ca or both, were identified. Reliability testing was conducted on only two dairy and five Ca tools, with results indicating that only one dairy and two Ca tools were reliable. Validity testing was conducted for all but four Ca-only tools. There was high reliance in validity testing on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful differences. Results of the validity testing suggest one dairy and five Ca tools are valid. Thus one tool was considered both reliable and valid for the assessment of dairy intake and only two tools proved reliable and valid for the assessment of Ca intake. While several tools are reliable and valid, their application across adult populations is limited by the populations in which they were tested. These results indicate a need for tools that assess Ca and/or dairy intake in adults to be rigorously tested for reliability and validity.

Nursing students' evaluation of a new feedback and reflection tool for use in high-fidelity simulation - Formative assessment of clinical skills. A descriptive quantitative research design.

PubMed

Solheim, Elisabeth; Plathe, Hilde Syvertsen; Eide, Hilde

2017-11-01

Clinical skills training is an important part of nurses' education programmes. Clinical skills are complex. A common understanding of what characterizes clinical skills and learning outcomes needs to be established. The aim of the study was to develop and evaluate a new reflection and feedback tool for formative assessment. The study has a descriptive quantitative design. 129 students participated who were at the end of the first year of a Bachelor degree in nursing. After highfidelity simulation, data were collected using a questionnaire with 19 closed-ended and 2 open-ended questions. The tool stimulated peer assessment, and enabled students to be more thorough in what to assess as an observer in clinical skills. The tool provided a structure for selfassessment and made visible items that are important to be aware of in clinical skills. This article adds to simulation literature and provides a tool that is useful in enhancing peer learning, which is essential for nurses in practice. The tool has potential for enabling students to learn about reflection and developing skills for guiding others in practice after they have graduated. Copyright © 2017 Elsevier Ltd. All rights reserved.

A method for the design and development of medical or health care information websites to optimize search engine results page rankings on Google.

PubMed

Dunne, Suzanne; Cummins, Niamh Maria; Hannigan, Ailish; Shannon, Bill; Dunne, Colum; Cullen, Walter

2013-08-27

The Internet is a widely used source of information for patients searching for medical/health care information. While many studies have assessed existing medical/health care information on the Internet, relatively few have examined methods for design and delivery of such websites, particularly those aimed at the general public. This study describes a method of evaluating material for new medical/health care websites, or for assessing those already in existence, which is correlated with higher rankings on Google's Search Engine Results Pages (SERPs). A website quality assessment (WQA) tool was developed using criteria related to the quality of the information to be contained in the website in addition to an assessment of the readability of the text. This was retrospectively applied to assess existing websites that provide information about generic medicines. The reproducibility of the WQA tool and its predictive validity were assessed in this study. The WQA tool demonstrated very high reproducibility (intraclass correlation coefficient=0.95) between 2 independent users. A moderate to strong correlation was found between WQA scores and rankings on Google SERPs. Analogous correlations were seen between rankings and readability of websites as determined by Flesch Reading Ease and Flesch-Kincaid Grade Level scores. The use of the WQA tool developed in this study is recommended as part of the design phase of a medical or health care information provision website, along with assessment of readability of the material to be used. This may ensure that the website performs better on Google searches. The tool can also be used retrospectively to make improvements to existing websites, thus, potentially enabling better Google search result positions without incurring the costs associated with Search Engine Optimization (SEO) professionals or paid promotion.

LARGE AND GREAT RIVERS: NEW ASSESSMENT TOOLS

EPA Science Inventory

The Ecological Exposure Research Division has been conducting research to support the development of the next generation of bioassessment and monitoring tools for large and great rivers. Focus has largely been on the development of standardized protocols for the traditional indi...

Development of a Comprehensive and Interactive Tool to Inform State Violence and Injury Prevention Plans.

PubMed

Wilson, Lauren; Deokar, Angela J; Zaesim, Araya; Thomas, Karen; Kresnow-Sedacca, Marcie-Jo

The Center of Disease Control and Prevention's Core State Violence and Injury Prevention Program (Core SVIPP) provides an opportunity for states to engage with their partners to implement, evaluate, and disseminate strategies that lead to the reduction and prevention of injury and violence. Core SVIPP requires awardees to develop or update their state injury and violence plans. Currently, literature informing state planning efforts is limited, especially regarding materials related to injury and violence. Presumably, plans that are higher quality result in having a greater impact on preventing injury and violence, and literature to improve quality would benefit prevention programming. (1) To create a comprehensive injury-specific index to aid in the development and revision of state injury and violence prevention plans, and (2) to assess the reliability and utility of this index. Through an iterative development process, a workgroup of subject matter experts created the Violence and Injury Prevention: Comprehensive Index Tool (VIP:CIT). The tool was pilot tested on 3 state injury and violence prevention plans and assessed for initial usability. Following revisions to the tool (ie, a rubric was developed to further delineate consistent criteria for rating; items were added and clarified), the same state plans were reassessed to test interrater reliability and tool utility. For the second assessment, reliability of the VIP:CIT improved, indicating that the rubric was a useful addition. Qualitative feedback from states suggested that the tool significantly helped guide plan development and communicate about planning processes. The final VIP:CIT is a tool that can help increase plan quality, decrease the research-to-practice gap, and increase connectivity to emerging public health paradigms. The tool provides an example of tailoring guidance materials to reflect academic literature, and it can be easily adapted to other topic areas to promote quality of strategic plans for numerous outcomes.

Development of a Comprehensive and Interactive Tool to Inform State Violence and Injury Prevention Plans

PubMed Central

Wilson, Lauren; Deokar, Angela J.; Zaesim, Araya; Thomas, Karen; Kresnow-Sedacca, Marcie-jo

2018-01-01

Context The Center of Disease Control and Prevention’s Core State Violence and Injury Prevention Program (Core SVIPP) provides an opportunity for states to engage with their partners to implement, evaluate, and disseminate strategies that lead to the reduction and prevention of injury and violence. Core SVIPP requires awardees to develop or update their state injury and violence plans. Currently, literature informing state planning efforts is limited, especially regarding materials related to injury and violence. Presumably, plans that are higher quality result in having a greater impact on preventing injury and violence, and literature to improve quality would benefit prevention programming. Objective (1) To create a comprehensive injury-specific index to aid in the development and revision of state injury and violence prevention plans, and (2) to assess the reliability and utility of this index. Design Through an iterative development process, a workgroup of subject matter experts created the Violence and Injury Prevention: Comprehensive Index Tool (VIP:CIT). The tool was pilot tested on 3 state injury and violence prevention plans and assessed for initial usability. Following revisions to the tool (ie, a rubric was developed to further delineate consistent criteria for rating; items were added and clarified), the same state plans were reassessed to test interrater reliability and tool utility. Results For the second assessment, reliability of the VIP:CIT improved, indicating that the rubric was a useful addition. Qualitative feedback from states suggested that the tool significantly helped guide plan development and communicate about planning processes. Conclusion The final VIP:CIT is a tool that can help increase plan quality, decrease the research-to-practice gap, and increase connectivity to emerging public health paradigms. The tool provides an example of tailoring guidance materials to reflect academic literature, and it can be easily adapted to other topic areas to promote quality of strategic plans for numerous outcomes. PMID:29189505

The development and pilot testing of a rapid assessment tool to improve local public health system capacity in Australia.

PubMed

Bagley, Prue; Lin, Vivian

2009-11-15

To operate effectively the public health system requires infrastructure and the capacity to act. Public health's ability to attract funding for infrastructure and capacity development would be enhanced if it was able to demonstrate what level of capacity was required to ensure a high performing system. Australia's public health activities are undertaken within a complex organizational framework that involves three levels of government and a diverse range of other organizations. The question of appropriate levels of infrastructure and capacity is critical at each level. Comparatively little is known about infrastructure and capacity at the local level. In-depth interviews were conducted with senior managers in two Australian states with different frameworks for health administration. They were asked to reflect on the critical components of infrastructure and capacity required at the local level. The interviews were analyzed to identify the major themes. Workshops with public health experts explored this data further. The information generated was used to develop a tool, designed to be used by groups of organizations within discrete geographical locations to assess local public health capacity. Local actors in these two different systems pointed to similar areas for inclusion for the development of an instrument to map public health capacity at the local level. The tool asks respondents to consider resources, programs and the cultural environment within their organization. It also asks about the policy environment - recognizing that the broader environment within which organizations operate impacts on their capacity to act. Pilot testing of the tool pointed to some of the challenges involved in such an exercise, particularly if the tool were to be adopted as policy. This research indicates that it is possible to develop a tool for the systematic assessment of public health capacity at the local level. Piloting the tool revealed some concerns amongst participants, particularly about how the tool would be used. However there was also recognition that the areas covered by the tool were those considered relevant.

Assessment of competence in video-assisted thoracoscopic surgery lobectomy: A Danish nationwide study.

PubMed

Petersen, René Horsleben; Gjeraa, Kirsten; Jensen, Katrine; Møller, Lars Borgbjerg; Hansen, Henrik Jessen; Konge, Lars

2018-04-18

Competence in video-assisted thoracoscopic surgery lobectomy has previously been established on the basis of numbers of procedures performed, but this approach does not ensure competence. Specific assessment tools, such as the newly developed video-assisted thoracoscopic surgery lobectomy assessment tool, allow for structured and objective assessment of competence. Our aim was to provide validity evidence for the video-assisted thoracoscopic surgery lobectomy assessment tool. Video recordings of 60 video-assisted thoracoscopic surgery lobectomies performed by 18 thoracic surgeons were rated using the video-assisted thoracoscopic surgery lobectomy assessment tool. All 4 centers of thoracic surgery in Denmark participated in the study. Two video-assisted thoracoscopic surgery experts rated the videos. They were blinded to surgeon and center. The total internal consistency reliability Cronbach's alpha was 0.93. Inter-rater reliability between the 2 raters was Pearson's r = 0.71 (P < .001). The mean video-assisted thoracoscopic surgery lobectomy assessment tool scores for the 10 procedures performed by beginners were 22.1 (standard deviation [SD], 8.6) for the 28 procedures performed by the intermediate surgeons, 31.2 (SD, 4.4), and for the 20 procedures performed by experts 35.9 (SD, 2.9) (P < .001). Bonferroni post hoc tests showed that experts were significantly better than intermediates (P < .008) and beginners (P < .001). Intermediates' mean scores were significantly better than beginners (P < .001). The pass/fail standard calculated using the contrasting group's method was 31 points. One of the beginners passed, and 2 experts failed the test. Validity evidence was provided for a newly developed assessment tool for video-assisted thoracoscopic surgery lobectomy (video-assisted thoracoscopic surgery lobectomy assessment tool) in a clinical setting. The discriminatory ability among expert surgeons, intermediate surgeons, and beginners proved highly significant. The video-assisted thoracoscopic surgery lobectomy assessment tool could be an important aid in the future training and certification of thoracic surgeons. Copyright © 2018 The American Association for Thoracic Surgery. Published by Elsevier Inc. All rights reserved.

The Depression Inventory Development Workgroup: A Collaborative, Empirically Driven Initiative to Develop a New Assessment Tool for Major Depressive Disorder.

PubMed

Vaccarino, Anthony L; Evans, Kenneth R; Kalali, Amir H; Kennedy, Sidney H; Engelhardt, Nina; Frey, Benicio N; Greist, John H; Kobak, Kenneth A; Lam, Raymond W; MacQueen, Glenda; Milev, Roumen; Placenza, Franca M; Ravindran, Arun V; Sheehan, David V; Sills, Terrence; Williams, Janet B W

2016-01-01

The Depression Inventory Development project is an initiative of the International Society for CNS Drug Development whose goal is to develop a comprehensive and psychometrically sound measurement tool to be utilized as a primary endpoint in clinical trials for major depressive disorder. Using an iterative process between field testing and psychometric analysis and drawing upon expertise of international researchers in depression, the Depression Inventory Development team has established an empirically driven and collaborative protocol for the creation of items to assess symptoms in major depressive disorder. Depression-relevant symptom clusters were identified based on expert clinical and patient input. In addition, as an aid for symptom identification and item construction, the psychometric properties of existing clinical scales (assessing depression and related indications) were evaluated using blinded datasets from pharmaceutical antidepressant drug trials. A series of field tests in patients with major depressive disorder provided the team with data to inform the iterative process of scale development. We report here an overview of the Depression Inventory Development initiative, including results of the third iteration of items assessing symptoms related to anhedonia, cognition, fatigue, general malaise, motivation, anxiety, negative thinking, pain and appetite. The strategies adopted from the Depression Inventory Development program, as an empirically driven and collaborative process for scale development, have provided the foundation to develop and validate measurement tools in other therapeutic areas as well.

Critical thinking skills in midwifery practice: Development of a self-assessment tool for students.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-07-01

Develop and test a tool designed for use by pre-registration midwifery students to self-appraise their critical thinking in practice. A descriptive cohort design was used. All students (n=164) enrolled in a three-year Bachelor of Midwifery program in Queensland, Australia. The staged model for tool development involved item generation, mapping draft items to critical thinking concepts and expert review to test content validity, pilot testing of the tool to a convenience sample of students, and psychometric testing. Students (n=126, 76.8% response rate) provided demographic details, completed the new tool, and five questions from the Motivated Strategies for Learning Questionnaire (MSLQ) via an online platform or paper version. A high content validity index score of 0.97 was achieved through expert review. Construct validity via factor analysis revealed four factors: seeks information, reflects on practice, facilitates shared decision making, and evaluates practice. The mean total score for the tool was 124.98 (SD=12.58). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of 0.92. Concurrent validity with the MSLQ subscale was 0.35 (p<0.001). This study established the reliability and validity of the CACTiM - student version for use by pre-registration midwifery students to self-assess critical thinking in practice. Critical thinking skills are vital for safe and effective midwifery practice. Students' assessment of their critical thinking development throughout their pre-registration programme makes these skills explicit, and could guide teaching innovation to address identified deficits. The availability of a reliable and valid tool assists research into the development of critical thinking in education and practice. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

The development and evaluation of the Screening Tool for the Assessment of Malnutrition in Paediatrics (STAMP©) for use by healthcare staff.

PubMed

McCarthy, H; Dixon, M; Crabtree, I; Eaton-Evans, M J; McNulty, H

2012-08-01

The early identification of malnutrition and nutrition risk through nutrition screening is common practice in adult clinical care but, in children, this has been hampered by the lack of an appropriate nutrition screening tool. The present study aimed to develop and evaluate a simple, child-specific nutrition screening tool for administration by non-nutrition healthcare professionals. In a two-phase observational study, significant predictors of nutrition risk were identified using a structured questionnaire. These were then combined to produce a nutrition screening tool. For evaluation purposes, the reliability, sensitivity and specificity of the newly-developed Screening Tool for the Assessment of Malnutrition in Paediatrics (STAMP(©)) were estimated by comparing the classification of nutrition risk using the tool with that determined by a full nutritional assessment by a registered dietitian. A total of 122 children were recruited for development phase and a separate cohort of 238 children was recruited for the evaluation phase. Low percentile weight for age, reported weight loss, discrepancy between weight and height percentile and recently changed appetite were all identified as predictors of nutrition risk. These predictors, together with the expected nutrition risk of clinical diagnoses, were combined to produce STAMP(©). Evaluation of STAMP(©) demonstrated fair to moderate reliability in identifying nutrition risk compared to the nutrition risk classification determined by a registered dietitian (κ = 0.541; 95% confidence interval = 0.461-0.621). Sensitivity and specificity were estimated at 70% (51-84%) and 91% (86-94%), respectively. The present study describes the development and evaluation of a new nutrition screening tool specifically for use in a UK general paediatric inpatient population. © 2012 The Authors. Journal of Human Nutrition and Dietetics © 2012 The British Dietetic Association Ltd.

Trauma system evaluation in developing countries: applicability of American College of Surgeons/Committee on Trauma (ACS/COT) basic criteria.

PubMed

Latifi, Rifat; Ziemba, Michelle; Leppäniemi, Ari; Dasho, Erion; Dogjani, Agron; Shatri, Zhaneta; Kociraj, Agim; Oldashi, Fatos; Shosha, Lida

2014-08-01

Trauma continues to be a major health problem worldwide, particularly in the developing world, with high mortality and morbidity. Yet most developing countries lack an organized trauma system. Furthermore, developing countries do not have in place any accreditation process for trauma centers; thus, no accepted standard assessment tools exist to evaluate their trauma services. The aims of this study were to evaluate the trauma system in Albania, using the basic trauma criteria of the American College of Surgeons/Committee on Trauma (ACS/COT) as assessment tools, and to provide the Government with a situational analysis relative to these criteria. We used the ACS/COT basic criteria as assessment tools to evaluate the trauma system in Albania. We conducted a series of semi-structured interviews, unstructured interviews, and focus groups with all stakeholders at the Ministry of Health, at the University Trauma Hospital (UTH) based in Tirana (the capital city), and at ten regional hospitals across the country. Albania has a dedicated national trauma center that serves as the only tertiary center, plus ten regional hospitals that provide some trauma care. However, overall, its trauma system is in need of major reforms involving all essential elements in order to meet the basic requirements of a structured trauma system. The ACS/COT basic criteria can be used as assessment tools to evaluate trauma care in developing countries. Further studies are needed in other developing countries to validate the applicability of these criteria.

RISK ASSESSMENT ANALYSES USING EPA'S ON-LINE SITE-SPECIFIC TRANSPORT MODELS AND FIELD DATA

EPA Science Inventory

EPA has developed a suite of on-line calculators and transport models to aid in risk assessment for subsurface contamination. The calculators (www.epa.gov/athens/onsite) provide several levels of tools and data. These include tools for generating commonly-used model input param...

The Food-Safe Schools Action Guide

ERIC Educational Resources Information Center

Centers for Disease Control and Prevention, 2007

2007-01-01

"The Food-Safe School Needs Assessment and Planning Guide" is a tool that can help schools assess their food safety policies, procedures, and programs and develop plans for improvement. This tool includes a simple, straightforward questionnaire, score card, and planning guide that give administrators, school staff, families, and students a chance…

SADA: A FREEWARE DECISION SUPPORT TOOL INTEGRATING GIS, SAMPLE DESIGN, SPATIAL MODELING AND RISK ASSESSMENT (SLIDE PRESENTATION)

EPA Science Inventory

Spatial Analysis and Decision Assistance (SADA) is a Windows freeware program that incorporates tools from environmental assessment into an effective problem-solving environment. SADA was developed by the Institute for Environmental Modeling at the University of Tennessee and inc...

MEETING IN CHICAGO: SADA: A FREEWARE DECISION SUPPORT TOOL INTEGRATING GIS, SAMPLE DESIGN, SPATIAL MODELING, AND ENVIRONMENTAL RISK ASSESSMENT

EPA Science Inventory

Spatial Analysis and Decision Assistance (SADA) is a Windows freeware program that incorporates tools from environmental assessment into an effective problem-solving environment. SADA was developed by the Institute for Environmental Modeling at the University of Tennessee and inc...

MEETING IN CZECH REPUBLIC: SADA: A FREEWARE DECISION SUPPORT TOOL INTEGRATING GIS, SAMPLE DESIGN, SPATIAL MODELING, AND RISK ASSESSMENT

EPA Science Inventory

Spatial Analysis and Decision Assistance (SADA) is a Windows freeware program that incorporates tools from environmental assessment into an effective problem-solving environment. SADA was developed by the Institute for Environmental Modeling at the University of Tennessee and inc...

Modelling Student Misconceptions Using Nested Logit Item Response Models

ERIC Educational Resources Information Center

Yildiz, Mustafa

2017-01-01

Student misconceptions have been studied for decades from a curricular/instructional perspective and from the assessment/test level perspective. Numerous misconception assessment tools have been developed in order to measure students' misconceptions relative to the correct content. Often, these tools are used to make a variety of educational…

Conceptual Assessment Tool for Advanced Undergraduate Electrodynamics

ERIC Educational Resources Information Center

Baily, Charles; Ryan, Qing X.; Astolfi, Cecilia; Pollock, Steven J.

2017-01-01

As part of ongoing investigations into student learning in advanced undergraduate courses, we have developed a conceptual assessment tool for upper-division electrodynamics (E&M II): the Colorado UppeR-division ElectrodyNamics Test (CURrENT). This is a free response, postinstruction diagnostic with 6 multipart questions, an optional 3-question…

Developing a Quantitative Tool for Sustainability Assessment of HEIs

ERIC Educational Resources Information Center

Waheed, Bushra; Khan, Faisal I.; Veitch, Brian

2011-01-01

Purpose: Implementation of a sustainability paradigm demands new choices and innovative ways of thinking. The main objective of this paper is to provide a meaningful sustainability assessment tool for make informed decisions, which is applied to higher education institutions (HEIs). Design/methodology/approach: The objective is achieved by…

The children's menu assessment: development, evaluation, and relevance of a tool for evaluating children's menus.

PubMed

Krukowski, Rebecca A; Eddings, Kenya; West, Delia Smith

2011-06-01

Restaurant foods represent a substantial portion of children's dietary intake, and consumption of foods away from home has been shown to contribute to excess adiposity. This descriptive study aimed to pilot-test and establish the reliability of a standardized and comprehensive assessment tool, the Children's Menu Assessment, for evaluating the restaurant food environment for children. The tool is an expansion of the Nutrition Environment Measures Survey-Restaurant. In 2009-2010, a randomly selected sample of 130 local and chain restaurants were chosen from within 20 miles of Little Rock, AR, to examine the availability of children's menus and to conduct initial calibration of the Children's Menu Assessment tool (final sample: n=46). Independent raters completed the Children's Menu Assessment in order to determine inter-rater reliability. Test-retest reliability was also examined. Inter-rater reliability was high: percent agreement was 97% and Spearman correlation was 0.90. Test-retest was also high: percent agreement was 91% and Spearman correlation was 0.96. Mean Children's Menu Assessment completion time was 14 minutes, 56 seconds ± 10 minutes, 21 seconds. Analysis of Children's Menu Assessment findings revealed that few healthier options were available on children's menus, and most menus did not provide parents with information for making healthy choices, including nutrition information or identification of healthier options. The Children's Menu Assessment tool allows for comprehensive, rapid measurement of the restaurant food environment for children with high inter-rater reliability. This tool has the potential to contribute to public health efforts to develop and evaluate targeted environmental interventions and/or policy changes regarding restaurant foods. Copyright © 2011 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Systematic review of methods for quantifying teamwork in the operating theatre

PubMed Central

Marshall, D.; Sykes, M.; McCulloch, P.; Shalhoub, J.; Maruthappu, M.

2018-01-01

Background Teamwork in the operating theatre is becoming increasingly recognized as a major factor in clinical outcomes. Many tools have been developed to measure teamwork. Most fall into two categories: self‐assessment by theatre staff and assessment by observers. A critical and comparative analysis of the validity and reliability of these tools is lacking. Methods MEDLINE and Embase databases were searched following PRISMA guidelines. Content validity was assessed using measurements of inter‐rater agreement, predictive validity and multisite reliability, and interobserver reliability using statistical measures of inter‐rater agreement and reliability. Quantitative meta‐analysis was deemed unsuitable. Results Forty‐eight articles were selected for final inclusion; self‐assessment tools were used in 18 and observational tools in 28, and there were two qualitative studies. Self‐assessment of teamwork by profession varied with the profession of the assessor. The most robust self‐assessment tool was the Safety Attitudes Questionnaire (SAQ), although this failed to demonstrate multisite reliability. The most robust observational tool was the Non‐Technical Skills (NOTECHS) system, which demonstrated both test–retest reliability (P > 0·09) and interobserver reliability (Rwg = 0·96). Conclusion Self‐assessment of teamwork by the theatre team was influenced by professional differences. Observational tools, when used by trained observers, circumvented this.

Inspection of the Math Model Tools for On-Orbit Assessment of Impact Damage Report

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Raju, Ivatury S.; Piascik, Robert S> ; KramerWhite, Julie A.; KramerWhite, Julie A.; Labbe, Steve G.; Rotter, Hank A.

2007-01-01

In Spring of 2005, the NASA Engineering Safety Center (NESC) was engaged by the Space Shuttle Program (SSP) to peer review the suite of analytical tools being developed to support the determination of impact and damage tolerance of the Orbiter Thermal Protection Systems (TPS). The NESC formed an independent review team with the core disciplines of materials, flight sciences, structures, mechanical analysis and thermal analysis. The Math Model Tools reviewed included damage prediction and stress analysis, aeroheating analysis, and thermal analysis tools. Some tools are physics-based and other tools are empirically-derived. Each tool was created for a specific use and timeframe, including certification, real-time pre-launch assessments. In addition, the tools are used together in an integrated strategy for assessing the ramifications of impact damage to tile and RCC. The NESC teams conducted a peer review of the engineering data package for each Math Model Tool. This report contains the summary of the team observations and recommendations from these reviews.

The development of a quality appraisal tool for studies of diagnostic reliability (QAREL).

PubMed

Lucas, Nicholas P; Macaskill, Petra; Irwig, Les; Bogduk, Nikolai

2010-08-01

In systematic reviews of the reliability of diagnostic tests, no quality assessment tool has been used consistently. The aim of this study was to develop a specific quality appraisal tool for studies of diagnostic reliability. Key principles for the quality of studies of diagnostic reliability were identified with reference to epidemiologic principles, existing quality appraisal checklists, and the Standards for Reporting of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) resources. Specific items that encompassed each of the principles were developed. Experts in diagnostic research provided feedback on the items that were to form the appraisal tool. This process was iterative and continued until consensus among experts was reached. The Quality Appraisal of Reliability Studies (QAREL) checklist includes 11 items that explore seven principles. Items cover the spectrum of subjects, spectrum of examiners, examiner blinding, order effects of examination, suitability of the time interval among repeated measurements, appropriate test application and interpretation, and appropriate statistical analysis. QAREL has been developed as a specific quality appraisal tool for studies of diagnostic reliability. The reliability of this tool in different contexts needs to be evaluated. Copyright (c) 2010 Elsevier Inc. All rights reserved.

BASINs 4.0 Climate Assessment Tool (CAT): Supporting ...

EPA Pesticide Factsheets

EPA announced the availability of the report, BASINS 4.0 Climate Assessment Tool (CAT): Supporting Documentation and User's Manual. This report was prepared by the EPA's Global Change Research Program (GCRP), an assessment-oriented program, that sits within the Office of Research and Development, that focuses on assessing how potential changes in climate and other global environmental stressors may impact water quality, air quality, aquatic ecosystems, and human health in the United States. The Program’s focus on water quality is consistent with the Research Strategy of the U.S. Climate Change Research Program—the federal umbrella organization for climate change science in the U.S. government—and is responsive to U.S. EPA’s mission and responsibilities as defined by the Clean Water Act and the Safe Drinking Water Act. A central goal of the EPA GCRP is to provide EPA program offices, Regions, and other stakeholders with tools and information for assessing and responding to any potential future impacts of climate change. In 2007, the EPA Global Change Research Program (GCRP), in partnership with the EPA Office of Water, supported development of a Climate Assessment Tool (CAT) for version 4 of EPA’s BASINS modeling system. This report provides supporting documentation and user support materials for the BASINS CAT tool. The purpose of this report is to provide in a single document a variety of documentation and user support materials supporting the use

Practical tools and methods for health technology assessment in Europe: structures, methodologies, and tools developed by the European Network for Health Technology Assessment, EUnetHTA.

PubMed

Kristensen, Finn Børlum; Lampe, Kristian; Chase, Deborah L; Lee-Robin, Sun Hae; Wild, Claudia; Moharra, Montse; Garrido, Marcial Velasco; Nielsen, Camilla Palmhøj; Røttingen, John-Arne; Neikter, Susanna Allgurin; Bistrup, Marie Louise

2009-12-01

This article presents an overview of the practical methods and tools to support transnational Health Technology Assessment (HTA) that were developed and pilot tested by the European network for HTA (EUnetHTA), which involved a total of sixty-four Partner organizations. The methods differ according to scope and purpose of each of the tools developed. They included, for example, literature reviews, surveys, Delphi and consensus methods, workshops, pilot tests, and internal/public consultation. Practical results include an HTA Core Model and a Handbook on the use of the model, two pilot examples of HTA core information, an HTA Adaptation Toolkit for taking existing reports into new settings, a book about HTA and health policy making in Europe, a newsletter providing structured information about emerging/new technologies, an interactive Web-based tool to share information about monitoring activities for emerging/new technologies, and a Handbook on HTA capacity building for Member States with limited institutionalization of HTA. The tools provide high-quality information and methodological frameworks for HTA that facilitate preparation of HTA documentation, and sharing of information in and across national or regional systems. The tools will be used and further tested by partners in the EUnetHTA Collaboration aiming to (i) help reduce unnecessary duplication of HTA activities, (ii) develop and promote good practice in HTA methods and processes, (iii) share what can be shared, (iv) facilitate local adaptation of HTA information, (v) improve the links between health policy and HTA.

Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review

PubMed Central

Page, Matthew J; McKenzie, Joanne E; Higgins, Julian P T

2018-01-01

Background Several scales, checklists and domain-based tools for assessing risk of reporting biases exist, but it is unclear how much they vary in content and guidance. We conducted a systematic review of the content and measurement properties of such tools. Methods We searched for potentially relevant articles in Ovid MEDLINE, Ovid Embase, Ovid PsycINFO and Google Scholar from inception to February 2017. One author screened all titles, abstracts and full text articles, and collected data on tool characteristics. Results We identified 18 tools that include an assessment of the risk of reporting bias. Tools varied in regard to the type of reporting bias assessed (eg, bias due to selective publication, bias due to selective non-reporting), and the level of assessment (eg, for the study as a whole, a particular result within a study or a particular synthesis of studies). Various criteria are used across tools to designate a synthesis as being at ‘high’ risk of bias due to selective publication (eg, evidence of funnel plot asymmetry, use of non-comprehensive searches). However, the relative weight assigned to each criterion in the overall judgement is unclear for most of these tools. Tools for assessing risk of bias due to selective non-reporting guide users to assess a study, or an outcome within a study, as ‘high’ risk of bias if no results are reported for an outcome. However, assessing the corresponding risk of bias in a synthesis that is missing the non-reported outcomes is outside the scope of most of these tools. Inter-rater agreement estimates were available for five tools. Conclusion There are several limitations of existing tools for assessing risk of reporting biases, in terms of their scope, guidance for reaching risk of bias judgements and measurement properties. Development and evaluation of a new, comprehensive tool could help overcome present limitations. PMID:29540417

Validation of a novel duplex ultrasound objective structured assessment of technical skills (DUOSATS) for arterial stenosis detection.

PubMed

Jaffer, U; Singh, P; Pandey, V A; Aslam, M; Standfield, N J

2014-01-01

Duplex ultrasound facilitates bedside diagnosis and hence timely patient care. Its uptake has been hampered by training and accreditation issues. We have developed an assessment tool for Duplex arterial stenosis measurement for both simulator and patient based training. A novel assessment tool: duplex ultrasound assessment of technical skills was developed. A modified duplex ultrasound assessment of technical skills was used for simulator training. Novice, intermediate experience and expert users of duplex ultrasound were invited to participate. Participants viewed an instructional video and were allowed ample time to familiarize with the equipment. Participants' attempts were recorded and independently assessed by four experts using the modified duplex ultrasound assessment of technical skills. 'Global' assessment was also done on a four point Likert scale. Content, construct and concurrent validity as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. The simulator had good satisfaction rating from participants: median 4; range 3-5. Receiver operator characteristic analysis has established a cut point of 22/ 34 and 25/ 40 were most appropriate for simulator and patient based assessment respectively. We have validated a novel assessment tool for duplex arterial stenosis detection. Further work is underway to establish transference validity of simulator training to improved skill in scanning patients. We have developed and validated duplex ultrasound assessment of technical skills for simulator training.

Measuring diet in the 21st century: use of new technologies.

PubMed

Cade, Janet E

2017-08-01

The advent of the internet and smartphone technology has allowed dietary assessment to reach the 21st century! The variety of foods available on the supermarket shelf is now greater than ever before. New approaches to measuring diet may help to reduce measurement error and advance our understanding of nutritional determinants of disease. This advance provides the potential to capture detailed dietary data on large numbers of individuals without the need for costly and time-consuming manual nutrition coding. This aim of the present paper is to review the need for new technologies to measure diet with an overview of tools available. The three main areas will be addressed: (1) development of web-based tools to measure diet; (2) use of smartphone apps to self-monitor diet; (3) improving the quality of dietary assessment through development of an online library of tools. A practical example of the development of a web-based tool to assess diet myfood24 (www.myfood24.org) will be given exploring its potential, limitations and challenges. The development of a new food composition database using back-of-pack information will be described. Smartphone apps used to measure diet with a focus on obesity will be reviewed. Many apps are unreliable in terms of tracking, and most are not evaluated. Accurate and consistent measurement of diet is needed for public health and epidemiology. The choice of the most appropriate dietary assessment method tends to rely on experience. The DIET@NET partnership has developed best practice guidelines for selection of dietary assessment tools, which aim to improve the quality, consistency and comparability of dietary data. These developments provide us with a step-change in our ability to reliably characterise food and nutrient intake in population studies. The need for high-quality, validated systems will be important to fully realise the benefits of new technologies.

Periodontal Management by Risk Assessment: A Pragmatic Approach.

PubMed

Mullins, Joanna M; Even, Joshua B; White, Joel M

2016-06-01

An evidence-based periodontal disease risk assessment and diagnosis system has been developed and combined with a clinical decision support and management program to improve treatment and measure patient outcomes. There is little agreement on a universally accepted periodontal risk assessment, periodontal diagnosis, and treatment management tool and their incorporation into dental practice to improve patient care. This article highlights the development and use of a practical periodontal management and risk assessment program that can be implemented in dental settings. The approach taken by Willamette Dental Group to develop a periodontal disease risk assessment, periodontal diagnosis, and treatment management tool is described using evidence-based best practices. With goals of standardized treatment interventions while maintaining personalized care and improved communication, this process is described to facilitate its incorporation into other dental settings. Current electronic health records can be leveraged to enhance patient-centered care through the use of risk assessments and standardized guidelines to more effectively assess, diagnose, and treat patients to improve outcomes. Dental hygienists, and other committed providers, with their emphasis on prevention of periodontal disease can be principal drivers in creation and implementation of periodontal risk assessments and personalized treatment planning. Willamette Dental Group believes that such evidence-based tools can advance dentistry to new diagnostic and treatment standards. Copyright © 2016 Elsevier Inc. All rights reserved.

A Systematic Approach to Capacity Strengthening of Laboratory Systems for Control of Neglected Tropical Diseases in Ghana, Kenya, Malawi and Sri Lanka

PubMed Central

Njelesani, Janet; Dacombe, Russell; Palmer, Tanith; Smith, Helen; Koudou, Benjamin; Bockarie, Moses; Bates, Imelda

2014-01-01

Background The lack of capacity in laboratory systems is a major barrier to achieving the aims of the London Declaration (2012) on neglected tropical diseases (NTDs). To counter this, capacity strengthening initiatives have been carried out in NTD laboratories worldwide. Many of these initiatives focus on individuals' skills or institutional processes and structures ignoring the crucial interactions between the laboratory and the wider national and international context. Furthermore, rigorous methods to assess these initiatives once they have been implemented are scarce. To address these gaps we developed a set of assessment and monitoring tools that can be used to determine the capacities required and achieved by laboratory systems at the individual, organizational, and national/international levels to support the control of NTDs. Methodology and principal findings We developed a set of qualitative and quantitative assessment and monitoring tools based on published evidence on optimal laboratory capacity. We implemented the tools with laboratory managers in Ghana, Malawi, Kenya, and Sri Lanka. Using the tools enabled us to identify strengths and gaps in the laboratory systems from the following perspectives: laboratory quality benchmarked against ISO 15189 standards, the potential for the laboratories to provide support to national and regional NTD control programmes, and the laboratory's position within relevant national and international networks and collaborations. Conclusion We have developed a set of mixed methods assessment and monitoring tools based on evidence derived from the components needed to strengthen the capacity of laboratory systems to control NTDs. Our tools help to systematically assess and monitor individual, organizational, and wider system level capacity of laboratory systems for NTD control and can be applied in different country contexts. PMID:24603407

An Early Years Toolbox for Assessing Early Executive Function, Language, Self-Regulation, and Social Development: Validity, Reliability, and Preliminary Norms

ERIC Educational Resources Information Center

Howard, Steven J.; Melhuish, Edward

2017-01-01

Several methods of assessing executive function (EF), self-regulation, language development, and social development in young children have been developed over previous decades. Yet new technologies make available methods of assessment not previously considered. In resolving conceptual and pragmatic limitations of existing tools, the Early Years…

Capacity Building as a Tool for Assessing Training and Development Activity: An Indian Case Study

ERIC Educational Resources Information Center

Krishnaveni, R.; Sripirabaa, B.

2008-01-01

In recognition of its increasing importance, many organizations make periodic assessments of their training and development activity. The objective of the present study was to extend the concept of capacity building to the assessment of training and development activity in an automobile component manufacturing organization, using a developed and…

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Utility of a brief assessment tool developed from the Dizziness Handicap Inventory to screen for Cervicogenic dizziness: A case control study.

PubMed

Reid, Susan A; Callister, Robin; Katekar, Michael G; Treleaven, Julia M

2017-08-01

Cervicogenic dizziness (CGD) is hard to diagnose as there is no objective test. Can a brief assessment tool be derived from the Dizziness Handicap Inventory (DHI) to assist in screening for CGD? Case-control study with split-sample analysis. 86 people with CGD and 86 people with general dizziness completed the DHI as part of the assessment of their dizziness. Descriptive statistics were used to assess how frequently each question on the DHI was answered 'yes' or 'sometimes' by participants with CGD and by participants with general dizziness. The questions that best discriminated between GCD and general dizziness were compiled into a brief assessment tool for CGD. Data from 80 participants (40 from each group) were used to generate a receiver operating characteristic (ROC) curve to establish a cut-off score for that brief assessment tool. Then, data from the remaining 92 participants were used to try to validate the diagnostic ability of the brief assessment tool using that cut-off score. Questions 1, 9 and 11 were the most discriminatory and were combined to form the brief assessment tool. The ROC curve indicated an optimal threshold of 9. The diagnostic ability of the brief assessment tool among the remaining 46 participants from each group was: sensitivity 77% (95% CI: 67 to 84), specificity 66% (56-75), positive likelihood ratio 2.28 (1.66-3.13), and negative likelihood ratio 0.35 (0.23-0.53). A brief assessment tool of three questions appears to be helpful in screening for CGD. Copyright © 2017. Published by Elsevier Ltd.

SALT 2010 Bilingual S/E Version: A Tool for Assessing the Language Production of Bilingual (Spanish/English) Children

ERIC Educational Resources Information Center

Miller, Jon F.; Iglesias, Aquiles; Rojas, Raul

2010-01-01

Assessing the language development of bilingual children can be a challenge--too often, children in the complex process of learning both Spanish and English are under- or over-diagnosed with language disorders. SLPs can change that with "SALT 2010 Bilingual S/E Version" for grades K-3, the first tool to comprehensively assess children's language…

NC roadway lighting needs assessment, maintenance prioritization tool and performance measures.

DOT National Transportation Integrated Search

2013-05-01

The objectives of this project are to 1) develop an assessment report and summary of accumulated modernization / replacement needs, 2) assess current lighting needs and develop a method to allocate funds at NCDOT Division level, 3) research and docum...

Coastal Online Analysis and Synthesis Tool 2.0 (COAST)

NASA Technical Reports Server (NTRS)

Brown, Richard B.; Navard, Andrew R.; Nguyen, Beth T.

2009-01-01

The Coastal Online Assessment and Synthesis Tool (COAST) 3D geobrowser has been developed to integrate disparate coastal datasets from NASA and other sources into a desktop tool that provides new data visualization and analysis capabilities for coastal researchers, managers, and residents. It is built upon the widely used NASA-developed open source World Wind geobrowser from NASA Ames (Patrick Hogan et al.) .Net and C# version is used for development. It is leveraged off of World Wind community shared code samples and COAST 2.0 enhancement direction is based on Coastal science community feedback and needs assessment (GOMA). The main objective is to empower the user to bring more user-meaningful data into multi-layered, multi-temporal spatial context.

Analysis and Design of Fuselage Structures Including Residual Strength Prediction Methodology

NASA Technical Reports Server (NTRS)

Knight, Norman F.

1998-01-01

The goal of this research project is to develop and assess methodologies for the design and analysis of fuselage structures accounting for residual strength. Two primary objectives are included in this research activity: development of structural analysis methodology for predicting residual strength of fuselage shell-type structures; and the development of accurate, efficient analysis, design and optimization tool for fuselage shell structures. Assessment of these tools for robustness, efficient, and usage in a fuselage shell design environment will be integrated with these two primary research objectives.

Conducting Site and Economic Renewable Energy Project Feasibility Assessments

EPA Pesticide Factsheets

The Toolbox for Renewable Energy Project Development's Conducting Site and Economic Renewable Energy Project Feasibility Assessments page provides tools and resources to evaluate solar project feasibility and economics that influence project development.

Implementation of Health Insurance Support Tools in Community Health Centers.

PubMed

Huguet, Nathalie; Hatch, Brigit; Sumic, Aleksandra; Tillotson, Carrie; Hicks, Elizabeth; Nelson, Joan; DeVoe, Jennifer E

2018-01-01

Health information technology (HIT) provides new opportunities for primary care clinics to support patients with health insurance enrollment and maintenance. We present strategies, early findings, and clinic reflections on the development and implementation of HIT tools designed to streamline and improve health insurance tracking at community health centers. We are conducting a hybrid implementation-effectiveness trial to assess novel health insurance enrollment and support tools in primary care clinics. Twenty-three clinics in 7 health centers from the OCHIN practice-based research network are participating in the implementation component of the trial. Participating health centers were randomized to 1 of 2 levels of implementation support, including arm 1 (n = 4 health centers, 11 clinic sites) that received HIT tools and educational materials and arm 2 (n = 3 health centers, 12 clinic sites) that received HIT tools, educational materials, and individualized implementation support with a practice coach. We used mixed-methods (qualitative and quantitative) to assess tool use rates and facilitators and barriers to implementation in the first 6 months. Clinics reported favorable attitudes toward the HIT tools, which replace less efficient and more cumbersome processes, and reflect on the importance of clinic engagement in tool development and refinement. Five of 7 health centers are now regularly using the tools and are actively working to increase tool use. Six months after formal implementation, arm 2 clinics demonstrated higher rates of tool use, compared with arm 1. These results highlight the value of early clinic input in tool development, the potential benefit of practice coaching during HIT tool development and implementation, and a novel method for coupling a hybrid implementation-effectiveness design with principles of improvement science in primary care research. © Copyright 2018 by the American Board of Family Medicine.

The application of health literacy measurement tools (collective or individual domains) in assessing chronic disease management: a systematic review protocol.

PubMed

Shum, Jessica; Poureslami, Iraj; Doyle-Waters, Mary M; FitzGerald, J Mark

2016-06-07

The term "health literacy" (HL) was first coined in 1974, and its most common definition is currently defined as a person's ability to access, understand, evaluate, communicate, and use health information to make decisions for one's health. The previous systematic reviews assessing the effect of existing HL measurement tools on health outcomes have simply searched for the term "health literacy" only to identify measures instead of incorporating either one or more of the five domains in their search. Furthermore, as the domain "use" is fairly new, few studies have actually assessed this domain. In this protocol, we propose to identify and assess HL measures that applied the mentioned five domains either collectively or individually in assessing chronic disease management, in particular for asthma and chronic obstructive pulmonary disease (COPD). The ultimate goal is to provide recommendations towards the development and validation of a patient-centric HL measurement tool for the two diseases. A comprehensive, electronic search will be conducted to identify potential studies dating from 1974 to 2016 from databases such as Embase, MEDLINE, CINAHL, Cochrane Central Register of Controlled Trials, Web of Science, ERIC, PsycINFO, and HAPI. Database searches will be complemented with grey literature. Two independent reviewers will perform tool selection, study selection, data extraction, and quality assessment using pre-designed study forms. Any disagreement will be resolved through discussion or a third reviewer. Only studies that have developed or validated HL measurement tools (including one or more of the five domains mentioned above) among asthma and COPD patients will be included. Information collected from the studies will include instrument details such as versions, purpose, underlying constructs, administration, mapping of items onto the five domains, internal structure, scoring, response processes, standard error of measurement (SEM), correlation with other variables, clinically important difference, and item response theory (IRT)-based analyses. The identified strengths and weaknesses as well as reliability, validity, responsiveness, and interpretability of the tools from the validation studies will also be assessed using the COSMIN checklist. A synthesis will be presented for all tools in relation to asthma and COPD management. This systematic review will be one of several key contributions central to a global evidence-based strategy funded by the Canadian Institutes of Health Research (CIHR) for measuring HL in patients with asthma and COPD, highlighting the gaps and inconsistencies of domains between existing tools. The knowledge generated from this review will provide the team information on (1) the five-domain model and cross domains, (2) underlying constructs, (3) tool length, (4) time for completion, (5) reading level, and (6) format for development of the proposed tool. Other aspects of the published validation studies such as reliability coefficients, SEM, correlations with other variables, clinically important difference, and IRT-based analyses will be important for comparison purposes when testing, interpreting, and validating the developed tool. PROSPERO CRD42016037532.

A decision analysis tool for the assessment of posterior fossa tumour surgery outcomes in children--the "Liverpool Neurosurgical Complication Causality Assessment Tool".

PubMed

Zakaria, Rasheed; Ellenbogen, Jonathan; Graham, Catherine; Pizer, Barry; Mallucci, Conor; Kumar, Ram

2013-08-01

Complications may occur following posterior fossa tumour surgery in children. Such complications are subjectively and inconsistently reported even though they may have significant long-term behavioural and cognitive consequences for the child. This makes comparison of surgeons, programmes and treatments problematic. We have devised a causality tool for assessing if an adverse event after surgery can be classified as a surgical complication using a series of simple questions, based on a tool used in assessing adverse drug reactions. This tool, which we have called the "Liverpool Neurosurgical Complication Causality Assessment Tool", was developed by reviewing a series of ten posterior fossa tumour cases with a panel of neurosurgery, neurology, oncology and neuropsychology specialists working in a multidisciplinary paediatric tumour treatment programme. We have demonstrated its use and hope that it may improve reliability between different assessors both in evaluating the outcomes of existing programmes and treatments as well as aiding in trials which may directly compare the effects of surgical and medical treatments.

Use of the Home Safety Self-Assessment Tool (HSSAT) within Community Health Education to Improve Home Safety.

PubMed

Horowitz, Beverly P; Almonte, Tiffany; Vasil, Andrea

2016-10-01

This exploratory research examined the benefits of a health education program utilizing the Home Safety Self-Assessment Tool (HSSAT) to increase perceived knowledge of home safety, recognition of unsafe activities, ability to safely perform activities, and develop home safety plans of 47 older adults. Focus groups in two senior centers explored social workers' perspectives on use of the HSSAT in community practice. Results for the health education program found significant differences between reported knowledge of home safety (p = .02), ability to recognize unsafe activities (p = .01), safely perform activities (p = .04), and develop a safety plan (p = .002). Social workers identified home safety as a major concern and the HSSAT a promising assessment tool. Research has implications for reducing environmental fall risks.

Navigation and Guidance for Low-Thrust Trajectories, LOTNAV

NASA Astrophysics Data System (ADS)

Cano, J. L.; Bello, M.; Rodriguez-Canabal, J.

A number of interplanetary low-thrust missions have already been flown by many space agencies. Examples of already flown missions based on the use of electric propulsion are Deep Space 1, Hayabusa and SMART-1. Many others are already in the assessment phase or in the development phase itself. In such perspective, it is required by the space agencies the procurement and utilisation of assessment tools for fast prototyping in the areas of mission design and navigation. The Low-Thrust Interplanetary Navigation Tool, which is the subject of this paper, allows the mission analyst performing such type of quick assessment studies for the early phases in the development of low-thrust missions. A number of test cases on low-thrust missions are also presented along with the utilities composing the LOTNAV tool.

Extending LMS to Support IRT-Based Assessment Test Calibration

NASA Astrophysics Data System (ADS)

Fotaris, Panagiotis; Mastoras, Theodoros; Mavridis, Ioannis; Manitsaris, Athanasios

Developing unambiguous and challenging assessment material for measuring educational attainment is a time-consuming, labor-intensive process. As a result Computer Aided Assessment (CAA) tools are becoming widely adopted in academic environments in an effort to improve the assessment quality and deliver reliable results of examinee performance. This paper introduces a methodological and architectural framework which embeds a CAA tool in a Learning Management System (LMS) so as to assist test developers in refining items to constitute assessment tests. An Item Response Theory (IRT) based analysis is applied to a dynamic assessment profile provided by the LMS. Test developers define a set of validity rules for the statistical indices given by the IRT analysis. By applying those rules, the LMS can detect items with various discrepancies which are then flagged for review of their content. Repeatedly executing the aforementioned procedure can improve the overall efficiency of the testing process.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hoogmartens, Rob, E-mail: rob.hoogmartens@uhasselt.be; Van Passel, Steven, E-mail: steven.vanpassel@uhasselt.be; Van Acker, Karel, E-mail: karel.vanacker@lrd.kuleuven.be

Increasing interest in sustainability has led to the development of sustainability assessment tools such as Life Cycle Analysis (LCA), Life Cycle Costing (LCC) and Cost–Benefit Analysis (CBA). Due to methodological disparity of these three tools, conflicting assessment results generate confusion for many policy and business decisions. In order to interpret and integrate assessment results, the paper provides a framework that clarifies the connections and coherence between the included assessment methodologies. Building on this framework, the paper further focuses on key aspects to adapt any of the methodologies to full sustainability assessments. Aspects dealt with in the review are for examplemore » the reported metrics, the scope, data requirements, discounting, product- or project-related and approaches with respect to scarcity and labor requirements. In addition to these key aspects, the review shows that important connections exist: (i) the three tools can cope with social inequality, (ii) processes such as valuation techniques for LCC and CBA are common, (iii) Environmental Impact Assessment (EIA) is used as input in both LCA and CBA and (iv) LCA can be used in parallel with LCC. Furthermore, the most integrated sustainability approach combines elements of LCA and LCC to achieve the Life Cycle Sustainability Assessment (LCSA). The key aspects and the connections referred to in the review are illustrated with a case study on the treatment of end-of-life automotive glass. - Highlights: • Proliferation of assessment tools creates ambiguity and confusion. • The developed assessment framework clarifies connections between assessment tools. • Broadening LCA, key aspects are metric and data requirements. • Broadening LCC, key aspects are scope, time frame and discounting. • Broadening CBA, focus point, timespan, references, labor and scarcity are key.« less

A tutorial on aphasia test development in any language: Key substantive and psychometric considerations

PubMed Central

Ivanova, Maria V.; Hallowell, Brooke

2013-01-01

Background There are a limited number of aphasia language tests in the majority of the world's commonly spoken languages. Furthermore, few aphasia tests in languages other than English have been standardized and normed, and few have supportive psychometric data pertaining to reliability and validity. The lack of standardized assessment tools across many of the world's languages poses serious challenges to clinical practice and research in aphasia. Aims The current review addresses this lack of assessment tools by providing conceptual and statistical guidance for the development of aphasia assessment tools and establishment of their psychometric properties. Main Contribution A list of aphasia tests in the 20 most widely spoken languages is included. The pitfalls of translating an existing test into a new language versus creating a new test are outlined. Factors to consider in determining test content are discussed. Further, a description of test items corresponding to different language functions is provided, with special emphasis on implementing important controls in test design. Next, a broad review of principal psychometric properties relevant to aphasia tests is presented, with specific statistical guidance for establishing psychometric properties of standardized assessment tools. Conclusions This article may be used to help guide future work on developing, standardizing and validating aphasia language tests. The considerations discussed are also applicable to the development of standardized tests of other cognitive functions. PMID:23976813

Reliability and validity of play-based assessments of motor and cognitive skills for infants and young children: a systematic review.

PubMed

O'Grady, Michael G; Dusing, Stacey C

2015-01-01

Play is vital for development. Infants and children learn through play. Traditional standardized developmental tests measure whether a child performs individual skills within controlled environments. Play-based assessments can measure skill performance during natural, child-driven play. The purpose of this study was to systematically review reliability, validity, and responsiveness of all play-based assessments that quantify motor and cognitive skills in children from birth to 36 months of age. Studies were identified from a literature search using PubMed, ERIC, CINAHL, and PsycINFO databases and the reference lists of included papers. Included studies investigated reliability, validity, or responsiveness of play-based assessments that measured motor and cognitive skills for children to 36 months of age. Two reviewers independently screened 40 studies for eligibility and inclusion. The reviewers independently extracted reliability, validity, and responsiveness data. They examined measurement properties and methodological quality of the included studies. Four current play-based assessment tools were identified in 8 included studies. Each play-based assessment tool measured motor and cognitive skills in a different way during play. Interrater reliability correlations ranged from .86 to .98 for motor development and from .23 to .90 for cognitive development. Test-retest reliability correlations ranged from .88 to .95 for motor development and from .45 to .91 for cognitive development. Structural validity correlations ranged from .62 to .90 for motor development and from .42 to .93 for cognitive development. One study assessed responsiveness to change in motor development. Most studies had small and poorly described samples. Lack of transparency in data management and statistical analysis was common. Play-based assessments have potential to be reliable and valid tools to assess cognitive and motor skills, but higher-quality research is needed. Psychometric properties should be considered for each play-based assessment before it is used in clinical and research practice. © 2015 American Physical Therapy Association.

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

Frailty screening and assessment tools: a review of characteristics and use in Public Health.

PubMed

Gilardi, F; Capanna, A; Ferraro, M; Scarcella, P; Marazzi, M C; Palombi, L; Liotta, G

2018-01-01

Frailty screening and assessment are a fundamental issue in Public Health in order to plan prevention programs and services. By a narrative review of the literature employing the International Narrative Systematic Assessment tool, the authors aims to develop an updated framework for the main procedures and measurement tools to assess frailty in older adults, paying attention to the use in the primary care setting. The study selected 10 reviews published between January 2010 and December 2016 that define some characteristics of the main tools used to measure the frailty. Within the selected reviews only one of the described tools met all the criteria (multidimensionality, quick and easy administration, accurate risk prediction of negative outcomes and high sensitivity and specificity) necessary for a screening tool. Accurate risk prediction of negative outcomes could be the appropriate and sufficient criteria to assess a tool aimed to detect frailty in the community-dwelling elderly population. A two-step process (a first short questionnaire to detect frailty and a second longer questionnaire to define the care demand at individual level) could represent the appropriate pathway for planning care services at community level.

Clinical instruments: reliability and validity critical appraisal.

PubMed

Brink, Yolandi; Louw, Quinette A

2012-12-01

RATIONALE, AIM AND OBJECTIVES: There is a lack of health care practitioners using objective clinical tools with sound psychometric properties. There is also a need for researchers to improve their reporting of the validity and reliability results of these clinical tools. Therefore, to promote the use of valid and reliable tools or tests for clinical evaluation, this paper reports on the development of a critical appraisal tool to assess the psychometric properties of objective clinical tools. A five-step process was followed to develop the new critical appraisal tool: (1) preliminary conceptual decisions; (2) defining key concepts; (3) item generation; (4) assessment of face validity; and (5) formulation of the final tool. The new critical appraisal tool consists of 13 items, of which five items relate to both validity and reliability studies, four items to validity studies only and four items to reliability studies. The 13 items could be scored as 'yes', 'no' or 'not applicable'. This critical appraisal tool will aid both the health care practitioner to critically appraise the relevant literature and researchers to improve the quality of reporting of the validity and reliability of objective clinical tools. © 2011 Blackwell Publishing Ltd.

Modeling fate and transport of "Contaminants of Emerging Concern" (CECs): is the Soil Water Assessment Tool (SWAT) the appropriate model?

USDA-ARS?s Scientific Manuscript database

Background/Question/Methods As the scientific and regulatory communities realize the significant environmental impacts and ubiquity of “contaminants of emerging concern” (CECs), it is increasingly imperative to develop quantitative assessment tools to evaluate and predict the fate and transport of...

Probing the Question Order Effect While Developing a Chemistry Concept Inventory

ERIC Educational Resources Information Center

Undersander, Molly A.; Lund, Travis J.; Langdon, Laurie S.; Stains, Marilyne

2017-01-01

The design of assessment tools is critical to accurately evaluate students' understanding of chemistry. Although extensive research has been conducted on various aspects of assessment tool design, few studies in chemistry have focused on the impact of the order in which questions are presented to students on the measurement of students'…

Assessment in the Digital Age: An Overview of Online Tools and Considerations for School Psychologists and School Counsellors

ERIC Educational Resources Information Center

Jellins, Laura

2015-01-01

With recent developments in technology, online tests and digital tools offer school psychologists and school counsellors alternate modes of assessment. These new technologies have the potential to increase accessibility to tests (through greater portability), allow school psychologists and school counsellors to service more students (through…

Enhancing Writing Skills of EFL Learners through Blogging

ERIC Educational Resources Information Center

Akdag, Emrah; Özkan, Yonca

2017-01-01

In such a rapidly developing world, it has been inevitable to integrate some modern assessment approaches and tools into English teaching. Hence, several up to date Formative Assessment Tools have been used by teachers during the learning process to modify teaching and learning activities by means of acquiring qualitative feedback. Blogs or…

Tools to aid post-wildfire assessment and erosion-mitigation treatment decisions

Treesearch

Peter R. Robichaud; Louise E. Ashmun

2013-01-01

A considerable investment in post-fire research over the past decade has improved our understanding of wildfire effects on soil, hydrology, erosion and erosion-mitigation treatment effectiveness. Using this new knowledge, we have developed several tools to assist land managers with post-wildfire assessment and treatment decisions, such as prediction models, research...

An Overview of the State of Environmental Assessment Education at Canadian Universities

ERIC Educational Resources Information Center

Stelmack, Colleen M.; Sinclair, John A.; Fitzpatrick, Patricia

2005-01-01

Purpose--Environmental assessment (EA) is a proactive planning tool designed to consider the ecological, cultural, socio-political and economic impacts of potential projects, making it a major tool for achieving sustainable development. Meaningful EA requires a bridging of the natural sciences with the social sciences to broaden understanding of…

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

ERIC Educational Resources Information Center

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Rehabilitation Needs Assessment for Vocational Rehabilitation Agencies. Volume II. Needs Assessment Topics Identified in the Rehabilitation Act: Issues and Resources.

ERIC Educational Resources Information Center

Wisconsin Univ.-Stout, Menomonie. Stout Vocational Rehabilitation Inst.

This guide was developed to help Wisconsin agency assessment, evaluation, and planning personnel to develop a perspective on how needs assessment fits into their state's vocational rehabilitation program planning. Volume II provides state agency personnel with tools for conducting rehabilitation needs assessment. The first three chapters consider…

E-Assessment: Institutional Development Strategies and the Assessment Life Cycle

ERIC Educational Resources Information Center

Tomas, Carmen; Borg, Michaela; McNeil, Jane

2015-01-01

E-assessment is an umbrella term that comprises a complex array of tools of varying capacities. This paper focuses on the topic of e-assessment from the perspective of its strategic institutional development in higher education. The paper argues that research on e-assessment has been dominated by a focus on investigating benefits of use and…

Combining web-based tools for transparent evaluation of data for risk assessment: developmental effects of bisphenol A on the mammary gland as a case study.

PubMed

Molander, Linda; Hanberg, Annika; Rudén, Christina; Ågerstrand, Marlene; Beronius, Anna

2017-03-01

Different tools have been developed that facilitate systematic and transparent evaluation and handling of toxicity data in the risk assessment process. The present paper sets out to explore the combined use of two web-based tools for study evaluation and identification of reliable data relevant to health risk assessment. For this purpose, a case study was performed using in vivo toxicity studies investigating low-dose effects of bisphenol A on mammary gland development. The reliability of the mammary gland studies was evaluated using the Science in Risk Assessment and Policy (SciRAP) criteria for toxicity studies. The Health Assessment Workspace Collaborative (HAWC) was used for characterizing and visualizing the mammary gland data in terms of type of effects investigated and reported, and the distribution of these effects within the dose interval. It was then investigated whether there was any relationship between study reliability and the type of effects reported and/or their distribution in the dose interval. The combination of the SciRAP and HAWC tools allowed for transparent evaluation and visualization of the studies investigating developmental effects of BPA on the mammary gland. The use of these tools showed that there were no apparent differences in the type of effects and their distribution in the dose interval between the five studies assessed as most reliable and the whole data set. Combining the SciRAP and HAWC tools was found to be a useful approach for evaluating in vivo toxicity studies and identifying reliable and sensitive information relevant to regulatory risk assessment of chemicals. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Development of RAD-Score: A Tool to Assess the Procedural Competence of Diagnostic Radiology Residents.

PubMed

Isupov, Inga; McInnes, Matthew D F; Hamstra, Stan J; Doherty, Geoffrey; Gupta, Ashish; Peddle, Susan; Jibri, Zaid; Rakhra, Kawan; Hibbert, Rebecca M

2017-04-01

The purpose of this study is to develop a tool to assess the procedural competence of radiology trainees, with sources of evidence gathered from five categories to support the construct validity of tool: content, response process, internal structure, relations to other variables, and consequences. A pilot form for assessing procedural competence among radiology residents, known as the RAD-Score tool, was developed by evaluating published literature and using a modified Delphi procedure involving a group of local content experts. The pilot version of the tool was tested by seven radiology department faculty members who evaluated procedures performed by 25 residents at one institution between October 2014 and June 2015. Residents were evaluated while performing multiple procedures in both clinical and simulation settings. The main outcome measure was the percentage of residents who were considered ready to perform procedures independently, with testing conducted to determine differences between levels of training. A total of 105 forms (for 52 procedures performed in a clinical setting and 53 procedures performed in a simulation setting) were collected for a variety of procedures (eight vascular or interventional, 42 body, 12 musculoskeletal, 23 chest, and 20 breast procedures). A statistically significant difference was noted in the percentage of trainees who were rated as being ready to perform a procedure independently (in postgraduate year [PGY] 2, 12% of residents; in PGY3, 61%; in PGY4, 85%; and in PGY5, 88%; p < 0.05); this difference persisted in the clinical and simulation settings. User feedback and psychometric analysis were used to create a final version of the form. This prospective study describes the successful development of a tool for assessing the procedural competence of radiology trainees with high levels of construct validity in multiple domains. Implementation of the tool in the radiology residency curriculum is planned and can play an instrumental role in the transition to competency-based radiology training.

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

PubMed

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in standardizing the assessment of surgical skills.

Comparative assessment of methods for the fusion transcripts detection from RNA-Seq data

PubMed Central

Kumar, Shailesh; Vo, Angie Duy; Qin, Fujun; Li, Hui

2016-01-01

RNA-Seq made possible the global identification of fusion transcripts, i.e. “chimeric RNAs”. Even though various software packages have been developed to serve this purpose, they behave differently in different datasets provided by different developers. It is important for both users, and developers to have an unbiased assessment of the performance of existing fusion detection tools. Toward this goal, we compared the performance of 12 well-known fusion detection software packages. We evaluated the sensitivity, false discovery rate, computing time, and memory usage of these tools in four different datasets (positive, negative, mixed, and test). We conclude that some tools are better than others in terms of sensitivity, positive prediction value, time consumption and memory usage. We also observed small overlaps of the fusions detected by different tools in the real dataset (test dataset). This could be due to false discoveries by various tools, but could also be due to the reason that none of the tools are inclusive. We have found that the performance of the tools depends on the quality, read length, and number of reads of the RNA-Seq data. We recommend that users choose the proper tools for their purpose based on the properties of their RNA-Seq data. PMID:26862001

Teamwork Assessment Tools in Modern Surgical Practice: A Systematic Review

PubMed Central

Whittaker, George; Abboudi, Hamid; Khan, Muhammed Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-01-01

Introduction. Deficiencies in teamwork skills have been shown to contribute to the occurrence of adverse events during surgery. Consequently, several teamwork assessment tools have been developed to evaluate trainee nontechnical performance. This paper aims to provide an overview of these instruments and review the validity of each tool. Furthermore, the present paper aims to review the deficiencies surrounding training and propose several recommendations to address these issues. Methods. A systematic literature search was conducted to identify teamwork assessment tools using MEDLINE (1946 to August 2015), EMBASE (1974 to August 2015), and PsycINFO (1806 to August 2015) databases. Results. Eight assessment tools which encompass aspects of teamwork were identified. The Nontechnical Skills for Surgeons (NOTSS) assessment was found to possess the highest level of validity from a variety of sources; reliability and acceptability have also been established for this tool. Conclusions. Deficits in current surgical training pathways have prompted several recommendations to meet the evolving requirements of surgeons. Recommendations from the current paper include integration of teamwork training and assessment into medical school curricula, standardised formal training of assessors to ensure accurate evaluation of nontechnical skill acquisition, and integration of concurrent technical and nontechnical skills training throughout training. PMID:26425732

Different type 2 diabetes risk assessments predict dissimilar numbers at ‘high risk’: a retrospective analysis of diabetes risk-assessment tools

PubMed Central

Gray, Benjamin J; Bracken, Richard M; Turner, Daniel; Morgan, Kerry; Thomas, Michael; Williams, Sally P; Williams, Meurig; Rice, Sam; Stephens, Jeffrey W

2015-01-01

Background Use of a validated risk-assessment tool to identify individuals at high risk of developing type 2 diabetes is currently recommended. It is under-reported, however, whether a different risk tool alters the predicted risk of an individual. Aim This study explored any differences between commonly used validated risk-assessment tools for type 2 diabetes. Design and setting Cross-sectional analysis of individuals who participated in a workplace-based risk assessment in Carmarthenshire, South Wales. Method Retrospective analysis of 676 individuals (389 females and 287 males) who participated in a workplace-based diabetes risk-assessment initiative. Ten-year risk of type 2 diabetes was predicted using the validated QDiabetes®, Leicester Risk Assessment (LRA), FINDRISC, and Cambridge Risk Score (CRS) algorithms. Results Differences between the risk-assessment tools were apparent following retrospective analysis of individuals. CRS categorised the highest proportion (13.6%) of individuals at ‘high risk’ followed by FINDRISC (6.6%), QDiabetes (6.1%), and, finally, the LRA was the most conservative risk tool (3.1%). Following further analysis by sex, over one-quarter of males were categorised at high risk using CRS (25.4%), whereas a greater percentage of females were categorised as high risk using FINDRISC (7.8%). Conclusion The adoption of a different valid risk-assessment tool can alter the predicted risk of an individual and caution should be used to identify those individuals who really are at high risk of type 2 diabetes. PMID:26541180

Different type 2 diabetes risk assessments predict dissimilar numbers at 'high risk': a retrospective analysis of diabetes risk-assessment tools.

PubMed

Gray, Benjamin J; Bracken, Richard M; Turner, Daniel; Morgan, Kerry; Thomas, Michael; Williams, Sally P; Williams, Meurig; Rice, Sam; Stephens, Jeffrey W

2015-12-01

Use of a validated risk-assessment tool to identify individuals at high risk of developing type 2 diabetes is currently recommended. It is under-reported, however, whether a different risk tool alters the predicted risk of an individual. This study explored any differences between commonly used validated risk-assessment tools for type 2 diabetes. Cross-sectional analysis of individuals who participated in a workplace-based risk assessment in Carmarthenshire, South Wales. Retrospective analysis of 676 individuals (389 females and 287 males) who participated in a workplace-based diabetes risk-assessment initiative. Ten-year risk of type 2 diabetes was predicted using the validated QDiabetes(®), Leicester Risk Assessment (LRA), FINDRISC, and Cambridge Risk Score (CRS) algorithms. Differences between the risk-assessment tools were apparent following retrospective analysis of individuals. CRS categorised the highest proportion (13.6%) of individuals at 'high risk' followed by FINDRISC (6.6%), QDiabetes (6.1%), and, finally, the LRA was the most conservative risk tool (3.1%). Following further analysis by sex, over one-quarter of males were categorised at high risk using CRS (25.4%), whereas a greater percentage of females were categorised as high risk using FINDRISC (7.8%). The adoption of a different valid risk-assessment tool can alter the predicted risk of an individual and caution should be used to identify those individuals who really are at high risk of type 2 diabetes. © British Journal of General Practice 2015.

Validation of a novel venous duplex ultrasound objective structured assessment of technical skills for the assessment of venous reflux.

PubMed

Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J

2015-01-01

Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Integration of eHealth Tools in the Process of Workplace Health Promotion: Proposal for Design and Implementation

PubMed Central

2018-01-01

Background Electronic health (eHealth) and mobile health (mHealth) tools can support and improve the whole process of workplace health promotion (WHP) projects. However, several challenges and opportunities have to be considered while integrating these tools in WHP projects. Currently, a large number of eHealth tools are developed for changing health behavior, but these tools can support the whole WHP process, including group administration, information flow, assessment, intervention development process, or evaluation. Objective To support a successful implementation of eHealth tools in the whole WHP processes, we introduce a concept of WHP (life cycle model of WHP) with 7 steps and present critical and success factors for the implementation of eHealth tools in each step. Methods We developed a life cycle model of WHP based on the World Health Organization (WHO) model of healthy workplace continual improvement process. We suggest adaptations to the WHO model to demonstrate the large number of possibilities to implement eHealth tools in WHP as well as possible critical points in the implementation process. Results eHealth tools can enhance the efficiency of WHP in each of the 7 steps of the presented life cycle model of WHP. Specifically, eHealth tools can support by offering easier administration, providing an information and communication platform, supporting assessments, presenting and discussing assessment results in a dashboard, and offering interventions to change individual health behavior. Important success factors include the possibility to give automatic feedback about health parameters, create incentive systems, or bring together a large number of health experts in one place. Critical factors such as data security, anonymity, or lack of management involvement have to be addressed carefully to prevent nonparticipation and dropouts. Conclusions Using eHealth tools can support WHP, but clear regulations for the usage and implementation of these tools at the workplace are needed to secure quality and reach sustainable results. PMID:29475828

Survey of mental health nurses' attitudes towards risk assessment, risk assessment tools and positive risk.

PubMed

Downes, C; Gill, A; Doyle, L; Morrissey, J; Higgins, A

2016-04-01

WHAT IS KNOWN ON THE SUBJECT?: Risk assessment and safety planning are a core aspect of the role of the mental health nurse. Conflicting views exist on the value of risk assessment tools. Few studies have examined mental health nurses' attitudes towards risk, including use of tools and the role of positive risk in recovery. WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: Mental health nurses view risk assessment as a core dimension of their role and not merely an exercise to fulfil organizational clinical safety and governance obligations. The majority of nurses hold positive attitudes towards therapeutic or positive risk, and consider creative risk taking as vital to people's recovery. The majority of nurses believe that risk assessment tools facilitate professional decision making, however, some are concerned that tools may negatively impact upon therapeutic relationships. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Ongoing education on the use of risk assessment tools is required to minimize views that their use is incompatible with therapeutic engagement, and to enable nurses to develop confidence to engage with positive risk and to allow service users make decisions and take responsibility. Introduction Risk assessment and safety planning are considered core components of the role of the mental health nurse; however, little is known about nurses' attitudes towards risk assessment, use of tools to assess risk or therapeutic risk taking. Aim This study aimed to explore mental health nurses' attitudes towards completing risk assessments, use of tools as an aid, and therapeutic or positive risk. Method An anonymous survey which included 13 attitudinal statements, rated on a five-point Likert scale, was completed by 381 mental health nurses working in adult services in Ireland. Findings Findings indicate strong support for the practice of risk assessment in mental health practice. The vast majority of nurses believe that risk assessment tools facilitate professional decision making; however, there is concern that the use of these tools may negatively impact upon therapeutic engagement with service users. The majority of participants have positive attitudes towards therapeutic risk, believing that service users have the right to take informed risks in the context of recovery-orientated care. Discussion The provision of education on the use of risk assessment tools within the context of engagement may help minimize views that the use of assessment tools are incompatible with therapeutic engagement. © 2016 John Wiley & Sons Ltd.

DEVELOPMENT OF TOOLS TO ASSESS THE EFFECTS OF INDIVIDUAL, POPULATION, AND SPATIAL LEVELS: INTEGRATED ASSESSMENT OF MULTIPLE STRESSORS ON PISCIVOROUS BIRDS

EPA Science Inventory

The goal of the US Environmental Protection Agency's National Health and Environmental Research Laboratory's Wildlife Risk Assessment program is to develop scientifically valid methods to assess risks to wildlife and aquatic organisms from multiple stressors. To this end, the Loo...

Assessment of eutrophication in estuaries: Pressure-state-response and source apportionment

Treesearch

David Whitall; Suzanne Bricker

2006-01-01

The National Estuarine Eutrophication Assessment (NEEA) Update Program is a management oriented program designed to improve monitoring and assessment efforts through the development of type specific classification of estuaries that will allow improved assessment methods and development of analytical and research models and tools for managers which will help guide and...

Smart Growth Self-Assessment for Rural Communities: Madison County

EPA Pesticide Factsheets

Report from a technical assistance project to help Madison County, NY, develop a tool to help rural local governments assess how well their policies are helping them achieve the type of development they want.

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

Multi-modal virtual environment research at Armstrong Laboratory

NASA Technical Reports Server (NTRS)

Eggleston, Robert G.

1995-01-01

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Planning Tool for Strategic Evaluation of Facility Plans - 13570

DOE Office of Scientific and Technical Information (OSTI.GOV)

Magoulas, Virginia; Cercy, Michael; Hall, Irin

2013-07-01

Savannah River National Laboratory (SRNL) has developed a strategic planning tool for the evaluation of the utilization of its unique resources for processing and research and development of nuclear materials. The Planning Tool is a strategic level tool for assessing multiple missions that could be conducted utilizing the SRNL facilities and showcasing the plan. Traditional approaches using standard scheduling tools and laying out a strategy on paper tended to be labor intensive and offered either a limited or cluttered view for visualizing and communicating results. A tool that can assess the process throughput, duration, and utilization of the facility wasmore » needed. SRNL teamed with Newport News Shipbuilding (NNS), a division of Huntington Ingalls Industries, to create the next generation Planning Tool. The goal of this collaboration was to create a simulation based tool that allows for quick evaluation of strategies with respect to new or changing missions, and clearly communicates results to the decision makers. This tool has been built upon a mature modeling and simulation software previously developed by NNS. The Planning Tool provides a forum for capturing dependencies, constraints, activity flows, and variable factors. It is also a platform for quickly evaluating multiple mission scenarios, dynamically adding/updating scenarios, generating multiple views for evaluating/communicating results, and understanding where there are areas of risks and opportunities with respect to capacity. The Planning Tool that has been developed is useful in that it presents a clear visual plan for the missions at the Savannah River Site (SRS). It not only assists in communicating the plans to SRS corporate management, but also allows the area stakeholders a visual look at the future plans for SRS. The design of this tool makes it easily deployable to other facility and mission planning endeavors. (authors)« less

A web-based endodontic case difficulty assessment tool.

PubMed

Shah, P K; Chong, B S

2018-07-01

To develop a web-based tool to facilitate identification, evaluation and management of teeth requiring endodontic treatment. Following a literature search and thorough analysis of existing case difficulty assessment forms, the web-based tool was developed using an online survey builder (Qualtrics, Qualtrics Lab, UT, USA). Following feedback from a pilot study, it was refined and improved. A study was performed, using the updated version (EndoApp) on a cohort (n = 53) of dental professionals and dental students. The participants were e-mailed instructions detailing the assessment of five test cases using EndoApp, followed by completion of a structured feedback form. Analysis of the EndoApp responses was used to evaluate usage times, whereas the results of the feedback forms were used to assess user experience and relevance, other potential applications and comments on further improvement/s. The average usage time was 2 min 7 s; the average times needed for the last three (Cases 3-5) were significantly less than the preceding two (Cases 1 & 2) test cases. An overwhelming majority of participants expressed favourable views on user experience and relevance of the web-based case difficulty assessment tool. Only two participants (4%) were unlikely or very unlikely to use EndoApp again. The potential application of EndoApp as an 'educational tool' and for 'primary care triage' was deemed the most popular features and of greater importance than the secondary options of 'fee setting' and as a 'dento-legal justification tool'. Within the study limitations, owing to its ability to quantify the level of difficulty and provide guidance, EndoApp was considered user-friendly and helped facilitate endodontic case difficulty assessment. From the feedback, further improvements and the development of a Smartphone App version are in progress. EndoApp may facilitate treatment planning, improve treatment cost-effectiveness and reduce frequency of procedural errors by providing appropriate guidance on endodontic case management.

Defense Facility Condition: Revised Guidance Needed to Improve Oversight of Assessments and Ratings

DTIC Science & Technology

2016-06-01

are to implement the standardized process in part by assessing the condition of buildings, pavement , and rail using the same set of software tools...facility to current standards; costs for labor, equipment, materials, and currency exchange rates overseas; costs for project planning and design ...example, the services are to assess the condition of buildings, pavement , and rail using Sustainment Management System software tools developed by the

A New Network Modeling Tool for the Ground-based Nuclear Explosion Monitoring Community

NASA Astrophysics Data System (ADS)

Merchant, B. J.; Chael, E. P.; Young, C. J.

2013-12-01

Network simulations have long been used to assess the performance of monitoring networks to detect events for such purposes as planning station deployments and network resilience to outages. The standard tool has been the SAIC-developed NetSim package. With correct parameters, NetSim can produce useful simulations; however, the package has several shortcomings: an older language (FORTRAN), an emphasis on seismic monitoring with limited support for other technologies, limited documentation, and a limited parameter set. Thus, we are developing NetMOD (Network Monitoring for Optimal Detection), a Java-based tool designed to assess the performance of ground-based networks. NetMOD's advantages include: coded in a modern language that is multi-platform, utilizes modern computing performance (e.g. multi-core processors), incorporates monitoring technologies other than seismic, and includes a well-validated default parameter set for the IMS stations. NetMOD is designed to be extendable through a plugin infrastructure, so new phenomenological models can be added. Development of the Seismic Detection Plugin is being pursued first. Seismic location and infrasound and hydroacoustic detection plugins will follow. By making NetMOD an open-release package, it can hopefully provide a common tool that the monitoring community can use to produce assessments of monitoring networks and to verify assessments made by others.

DEVELOPMENT OF PROTOCOLS AND DECISION SUPPORT TOOLS FOR ASSESSING WATERSHED SYSTEM ASSIMILATIVE

EPA Science Inventory

Investigations are underway on Lake Texoma, a Corps of Engineers lake on the Oklahoma/Texas border, to develop decision support tools and information to evaluate the transport and attenuation of contaminants and stressors in a lake ecosystem, and link them to observable ecologica...

Professional Development through Organizational Assessment: Using APPA's Facilities Management Evaluation Program

ERIC Educational Resources Information Center

Medlin, E. Lander; Judd, R. Holly

2013-01-01

APPA's Facilities Management Evaluation Program (FMEP) provides an integrated system to optimize organizational performance. The criteria for evaluation not only provide a tool for organizational continuous improvement, they serve as a compelling leadership development tool essential for today's facilities management professional. The senior…

Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-06-19

The methodological quality and completeness of reporting of the systematic reviews (SRs) is fundamental to optimal implementation of evidence-based health care and the reduction of research waste. Methods exist to appraise SRs yet little is known about how they are used in SRs or where there are potential gaps in research best-practice guidance materials. The aims of this study are to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of a cohort of SRs and to assess their number, general characteristics, and approaches to 'quality' assessment over time. The Cochrane Library, MEDLINE®, and EMBASE® were searched from January 1990 to October 16, 2014, for reports assessing MQ and/or RQ of SRs. Title, abstract, and full-text screening of all reports were conducted independently by two reviewers. Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included. All results are reported as frequencies and percentages of reports. Of 20,765 unique records retrieved, 1189 of them were reviewed for full-text review, of which 76 reports were included. Eight previously published approaches to assessing MQ or reporting guidelines used as proxy to assess RQ were used in 80% (61/76) of identified reports. These included two reporting guidelines (PRISMA and QUOROM) and five quality assessment tools (AMSTAR, R-AMSTAR, OQAQ, Mulrow, Sacks) and GRADE criteria. The remaining 24% (18/76) of reports developed their own criteria. PRISMA, OQAQ, and AMSTAR were the most commonly used published tools to assess MQ or RQ. In conjunction with other approaches, published tools were used in 29% (22/76) of reports, with 36% (8/22) assessing adherence to both PRISMA and AMSTAR criteria and 26% (6/22) using QUOROM and OQAQ. The methods used to assess quality of SRs are diverse, and none has become universally accepted. The most commonly used quality assessment tools are AMSTAR, OQAQ, and PRISMA. As new tools and guidelines are developed to improve both the MQ and RQ of SRs, authors of methodological studies are encouraged to put thoughtful consideration into the use of appropriate tools to assess quality and reporting.

Design of capability measurement instruments pedagogic content knowledge (PCK) for prospective mathematics teachers

NASA Astrophysics Data System (ADS)

Aminah, N.; Wahyuni, I.

2018-05-01

The purpose of this study is to find out how the process of designing a tool of measurement Pedagogical Content Knowledge (PCK) capabilities, especially for prospective mathematics teachers are valid and practical. The design study of this measurement appliance uses modified Plomp development step, which consists of (1) initial assessment stage, (2) design stage at this stage, the researcher designs the measuring grille of PCK capability, (3) realization stage that is making measurement tool ability of PCK, (4) test phase, evaluation, and revision that is testing validation of measurement tools conducted by experts. Based on the results obtained that the design of PCK capability measurement tool is valid as indicated by the assessment of expert validator, and the design of PCK capability measurement tool, shown based on the assessment of teachers and lecturers as users of states strongly agree the design of PCK measurement tools can be used.

The Health Information Technology Competencies Tool: Does It Translate for Nursing Informatics in the United States?

PubMed

Sipes, Carolyn; Hunter, Kathleen; McGonigle, Dee; West, Karen; Hill, Taryn; Hebda, Toni

2017-12-01

Information technology use in healthcare delivery mandates a prepared workforce. The initial Health Information Technology Competencies tool resulted from a 2-year transatlantic effort by experts from the US and European Union to identify approaches to develop skills and knowledge needed by healthcare workers. It was determined that competencies must be identified before strategies are established, resulting in a searchable database of more than 1000 competencies representing five domains, five skill levels, and more than 250 roles. Health Information Technology Competencies is available at no cost and supports role- or competency-based queries. Health Information Technology Competencies developers suggest its use for curriculum planning, job descriptions, and professional development.The Chamberlain College of Nursing informatics research team examined Health Information Technology Competencies for its possible application to our research and our curricular development, comparing it originally with the TIGER-based Assessment of Nursing Informatics Competencies and Nursing Informatics Competency Assessment of Level 3 and Level 4 tools, which examine informatics competencies at four levels of nursing practice. Additional analysis involved the 2015 Nursing Informatics: Scope and Standards of Practice. Informatics is a Health Information Technology Competencies domain, so clear delineation of nursing-informatics competencies was expected. Researchers found TIGER-based Assessment of Nursing Informatics Competencies and Nursing Informatics Competency Assessment of Level 3 and Level 4 differed from Health Information Technology Competencies 2016 in focus, definitions, ascribed competencies, and defined levels of expertise. When Health Information Technology Competencies 2017 was compared against the nursing informatics scope and standards, researchers found an increase in the number of informatics competencies but not to a significant degree. This is not surprising, given that Health Information Technology Competencies includes all healthcare workers, while the TIGER-based Assessment of Nursing Informatics Competencies and Nursing Informatics Competency Assessment of Level 3 and Level 4 tools and the American Nurses Association Nursing Informatics: Scope and Standards of Practice are nurse specific. No clear cross mapping across these tools and the standards of nursing informatics practice exists. Further examination and review are needed to translate Health Information Technology Competencies as a viable tool for nursing informatics use in the US.

Developing an Objective Structured Assessment of Technical Skills for Laparoscopic Suturing and Intracorporeal Knot Tying.

PubMed

Chang, Olivia H; King, Louise P; Modest, Anna M; Hur, Hye-Chun

2016-01-01

To develop a teaching and assessment tool for laparoscopic suturing and intracorporeal knot tying. We designed an Objective Structured Assessment of Technical Skills (OSATS) tool that includes a procedure-specific checklist (PSC) and global rating scale (GRS) to assess laparoscopic suturing and intracorporeal knot-tying performance. Obstetrics and Gynecology residents at our institution were videotaped while performing a laparoscopic suturing and intracorporeal knot-tying task at a surgical simulation workshop. A total of 2 expert reviewers assessed resident performance using the OSATS tool during live performance and 1 month later using the videotaped recordings. OSATS scores were analyzed using the Wilcoxon rank-sum test. Data are presented as median scores (interquartile range [IQR]). Intrarater and interrater reliabilities were assessed using a Spearman correlation and are presented as an r correlation coefficient and p value. An r ≥ 0.8 was considered as a high correlation. After testing, we received feedback from residents and faculty to improve the OSATS tool as part of an iterative design process. In all, 14 of 21 residents (66.7%) completed the study, with 9 junior residents and 5 senior residents. Junior residents had a lower score on the PSC than senior residents did; however, this was not statistically significant (median = 6.0 [IQR: 4.0-10.0] and median = 13.0 [IQR: 10.0-13.0]; p = 0.09). There was excellent intrarater reliability with our OSATS tool (for PSC component, r = 0.88 for Rater 1 and 0.93 for Rater 2, both p < 0.0001; for GRS component, r = 0.85 for Rater 1 and 0.88 for Rater 2, both p ≤ 0.0002). The PSC also has high interrater reliability during live evaluation (r = 0.92; p < 0.0001), and during the videotape scoring with r = 0.77 (p = 0.001). Our OSATS tool may be a useful assessment and teaching tool for laparoscopic suturing and intracorporeal knot-tying skills. Overall, good intrarater reliability was demonstrated, suggesting that this tool may be useful for longitudinal assessment of surgical skills. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Teaching residents screening, brief intervention, and referral to treatment (SBIRT) skills for alcohol use: Using chart-stimulated recall to assess curricular impact.

PubMed

Wamsley, Maria A; Steiger, Scott; Julian, Katherine A; Gleason, Nathaniel; O'Sullivan, Patricia S; Guy, Michelle; Satterfield, Jason M

2016-01-01

Screening, brief intervention, and referral to treatment (SBIRT) improves identification and intervention for patients at risk for developing an alcohol use disorder (AUD). Residency curriculum is designed to teach SBIRT skills, but resources are needed to promote skill implementation. The electronic health record (EHR) can facilitate implementation through integration of decision-support tools. The authors developed electronic tools to facilitate documentation of alcohol assessment and brief intervention and to reinforce skills from an SBIRT curriculum. This prospective cohort study assessed primary care internal medicine residents' use of SBIRT skills and EHR tools in practice using chart-stimulated recall (CSR). Postgraduate year 2 and 3 residents received a 5-hour SBIRT curriculum with skills practice and instruction on SBIRT electronic tools. Participants were then given a list of their patients seen in a 1-year period who were drinking at/above the recommended limit. Trainees selected 3 patients to review with a faculty member in a CSR. Faculty used a 24-item chart checklist to assess application of SBIRT skills and electronic tool use and met with residents to complete a CSR interview. CSR interview notes were analyzed qualitatively to understand application of SBIRT skills and EHR tool use. Eighteen of 20 residents participated in the CSR, and 5 faculty reviewed 46 patient charts. Residents documented alcohol use (84.2% of charts) and assessment of quantity/frequency of use (71.0%) but were less likely to document assessment for an AUD (34%), an appropriate plan (50.0%), or follow-up (55%). Few residents used EHR tools. Residents reported barriers in addressing alcohol use, including lack of knowledge, patient barriers, and time constraints. More intensive training in SBIRT with opportunities for practice and feedback may be necessary for residents to consistently apply SBIRT skills in practice. EHR tools need to be better integrated into the clinic workflow in order to be useful.

Evaluation tools to support ITS planning process : development of a sketch planning tool in FSUTMS/cube environment.

DOT National Transportation Integrated Search

2008-12-15

Intelligent Transportation Systems (ITS) planning requires the use of tools to assess the performance of ITS deployment alternatives relative to each other and to other types of transportation system improvement alternatives. This research project in...

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ameen, Raed Fawzi Mohammed, E-mail: MohammedAmeenRF@cardiff.ac.uk; Department of Civil Engineering, College of Engineering, University of Karbala; Mourshed, Monjur, E-mail: MourshedM@cardiff.ac.uk

Cities are responsible for the depletion of natural resources and agricultural lands, and 70% of global CO{sub 2} emissions. There are significant risks to cities from the impacts of climate change in addition to existing vulnerabilities, primarily because of rapid urbanization. Urban design and development are generally considered as the instrument to shape the future of the city and they determine the pattern of a city's resource usage and resilience to change, from climate or otherwise. Cities are inherently dynamic and require the participation and engagement of their diverse stakeholders for the effective management of change, which enables wider stakeholdermore » involvement and buy-in at various stages of the development process. Sustainability assessment of urban design and development is increasingly being seen as indispensable for informed decision-making. A sustainability assessment tool also acts as a driver for the uptake of sustainable pathways by recognizing excellence through their rating system and by creating a market demand for sustainable products and processes. This research reviews six widely used sustainability assessment tools for urban design and development: BREEAM Communities, LEED-ND, CASBEE-UD, SBTool{sup PT}–UP, Pearl Community Rating System (PCRS) and GSAS/QSAS, to identify, compare and contrast the aim, structure, assessment methodology, scoring, weighting and suitability for application in different geographical contexts. Strengths and weaknesses of each tool are critically discussed. The study highlights the disparity in local and international contexts for global sustainability assessment tools. Despite their similarities in aim on environmental aspects, differences exist in the relative importance and share of mandatory vs optional indicators in both environmental and social dimensions. PCRS and GSAS/QSAS are new incarnations, but have widely varying shares of mandatory indicators, at 45.4% and 11.36% respectively, compared to 30% in BREEAM Community. Considerations of economic and cultural aspects are only marginal in the reviewed sustainability assessment tools. However, the newly developed sustainability assessment tools such as GSAS/QSAS and PCRS diverge from their predecessors in their consideration of cultural aspects. - Highlights: • Reviews six urban sustainability assessment methods: LEED-ND, BREEAM Communities, CASBEE-UD, SBTool{sup PT}-UP, PCRS, GSAS/QSAS. • Reviewed methods are biased more towards the environmental, followed by social and economic dimensions of sustainability. • Water issues are highlighted in the Middle East but natural hazards are emphasized only in CASBEE and BREEAM Communities. • SBTool{sup PT}-UP, the most recent of the groups puts more weight (7.32%) on cultural aspects. • Share of mandatory indicators is highest (45.4%) in the Pearl Community Rating System (PCRS)« less

[Personnel marketing in anesthesiology. Perception, use and evaluation by the target group].

PubMed

Berlet, T

2015-09-01

The human resources situation in the healthcare system is characterized by a manpower shortage. Recruiting medical staff is of great importance for hospitals and particularly in anesthesiology. Approaching and recruiting staff usually happens through external personnel marketing (PM); however, up until now the efficacy of these PM measures has barely been empirically investigated. The goal of this empirical study was to examine how familiar hospital physicians at varying career levels are with the different tools employed by external PM and how frequently they used as well as rated these tools in terms of benefits. Based on this information, the preferences of medical staff with respect to detailing the workplace of "hospital physician" as well as factors of the hospital's attractiveness as an employer were evaluated. Another aim was to derive recommendations on how to optimize the marketing instruments used for external PM in the healthcare system. In an internet-based survey, 154 female and male physicians were questioned about their knowledge, use and benefit assessment of a total of 43 PM tools. Conventional methods of addressing applicants were commonly used but ranked behind the more personal and direct targeting tools in terms of benefit assessments. Internet-based tools with a conceptual affinity to conventional methods were also highly rated in terms of benefits. In contrast, unconventional methods of addressing applicants were hardly known and were not viewed as being useful. The PM tools from the field of "overall conditions for cooperation in the company" mainly received high to very high benefit assessments. These referred primarily to non-monetary factors, human resource development measures and also to aspects of remuneration. Image-promoting PM tools were rarely assessed as being useful, with the exception of measures aimed at creating personal contact between the hospital or unit/department and applicants or those allowing personal insight into the department's range of activities. The correlation between familiarity with PM tools and positive benefit assessments was low. The results of this PM study can contribute to the development of an effective and efficient conception of PM measures by hospitals. Addressing applicants through traditional job and internet-based advertisements should be supplemented by personalized targeting of potential applicants and innovative targeting instruments must be systematically developed and promoted in order to become effective. It remains questionable whether the target group of external PM can be reached with exclusively or even predominantly image-cultivating measures on behalf of the healthcare company, such as image campaigns. The most effective PM tools create good working conditions and develop factors contributing to the employer's attractiveness. These two tools should be given priority in human resource development also taking material incentives into consideration, all of which support the effective set-up of an employer branding.

Tools for Communication: Novel infrastructure to address patient-perceived gaps in oncology care
.

PubMed

McMullen, Suzanne; Szabo, Shelagh; Halbert, Ronald J; Lai, Catherine; Parikh, Aparna; Bunce, Mikele; Khoury, Raya; Small, Art; Masaquel, Anthony

2017-04-01

Healthcare providers (HCPs) and patient communication are integral to high-quality oncology care. The patient and HCP perspectives are needed to identify gaps in care and develop communication tools.
. This study aimed to understand patient- and HCP-perceived elements of and gaps in high-quality care to develop novel communication tools to improve care. 
. Qualitative interviews were conducted among 16 patients with cancer and 10 HCPs in the United States. Trained interviewers elicited patients' and HCPs' concerns, views, and perceived needs for communication tools. A thematic analysis was used to identify four quality of care domains, depicted in a conceptual model, and two draft communication tools were developed to address identified gaps.
. No patients reported previously using a communication tool, and gaps in communication regarding treatment aims and education were evident. Two tools were developed to assess patients' life and treatment goals and the importance of ongoing education.

Hospital process orientation from an operations management perspective: development of a measurement tool and practical testing in three ophthalmic practices

PubMed Central

2013-01-01

Background Although research interest in hospital process orientation (HPO) is growing, the development of a measurement tool to assess process orientation (PO) has not been very successful yet. To view a hospital as a series of processes organized around patients with a similar demand seems to be an attractive proposition, but it is hard to operationalize this idea in a measurement tool that can actually measure the level of PO. This research contributes to HPO from an operations management (OM) perspective by addressing the alignment, integration and coordination of activities within patient care processes. The objective of this study was to develop and practically test a new measurement tool for assessing the degree of PO within hospitals using existing tools. Methods Through a literature search we identified a number of constructs to measure PO in hospital settings. These constructs were further operationalized, using an OM perspective. Based on five dimensions of an existing questionnaire a new HPO-measurement tool was developed to measure the degree of PO within hospitals on the basis of respondents’ perception. The HPO-measurement tool was pre-tested in a non-participating hospital and discussed with experts in a focus group. The multicentre exploratory case study was conducted in the ophthalmic practices of three different types of Dutch hospitals. In total 26 employees from three disciplines participated. After filling in the questionnaire an interview was held with each participant to check the validity and the reliability of the measurement tool. Results The application of the HPO-measurement tool, analysis of the scores and interviews with the participants resulted in the possibility to identify differences of PO performance and the areas of improvement – from a PO point of view – within each hospital. The result of refinement of the items of the measurement tool after practical testing is a set of 41 items to assess the degree of PO from an OM perspective within hospitals. Conclusions The development and practically testing of a new HPO-measurement tool improves the understanding and application of PO in hospitals and the reliability of the measurement tool. The study shows that PO is a complex concept and appears still hard to objectify. PMID:24219362

Hospital process orientation from an operations management perspective: development of a measurement tool and practical testing in three ophthalmic practices.

PubMed

Gonçalves, Pedro D; Hagenbeek, Marie Louise; Vissers, Jan M H

2013-11-13

Although research interest in hospital process orientation (HPO) is growing, the development of a measurement tool to assess process orientation (PO) has not been very successful yet. To view a hospital as a series of processes organized around patients with a similar demand seems to be an attractive proposition, but it is hard to operationalize this idea in a measurement tool that can actually measure the level of PO. This research contributes to HPO from an operations management (OM) perspective by addressing the alignment, integration and coordination of activities within patient care processes. The objective of this study was to develop and practically test a new measurement tool for assessing the degree of PO within hospitals using existing tools. Through a literature search we identified a number of constructs to measure PO in hospital settings. These constructs were further operationalized, using an OM perspective. Based on five dimensions of an existing questionnaire a new HPO-measurement tool was developed to measure the degree of PO within hospitals on the basis of respondents' perception. The HPO-measurement tool was pre-tested in a non-participating hospital and discussed with experts in a focus group. The multicentre exploratory case study was conducted in the ophthalmic practices of three different types of Dutch hospitals. In total 26 employees from three disciplines participated. After filling in the questionnaire an interview was held with each participant to check the validity and the reliability of the measurement tool. The application of the HPO-measurement tool, analysis of the scores and interviews with the participants resulted in the possibility to identify differences of PO performance and the areas of improvement--from a PO point of view--within each hospital. The result of refinement of the items of the measurement tool after practical testing is a set of 41 items to assess the degree of PO from an OM perspective within hospitals. The development and practically testing of a new HPO-measurement tool improves the understanding and application of PO in hospitals and the reliability of the measurement tool. The study shows that PO is a complex concept and appears still hard to objectify.

Knowing the operative game plan: a novel tool for the assessment of surgical procedural knowledge.

PubMed

Balayla, Jacques; Bergman, Simon; Ghitulescu, Gabriela; Feldman, Liane S; Fraser, Shannon A

2012-08-01

What is the source of inadequate performance in the operating room? Is it a lack of technical skills, poor judgment or a lack of procedural knowledge? We created a surgical procedural knowledge (SPK) assessment tool and evaluated its use. We interviewed medical students, residents and training program staff on SPK assessment tools developed for 3 different common general surgery procedures: inguinal hernia repair with mesh in men, laparoscopic cholecystectomy and right hemicolectomy. The tools were developed as a step-wise assessment of specific surgical procedures based on techniques described in a current surgical text. We compared novice (medical student to postgraduate year [PGY]-2) and expert group (PGY-3 to program staff) scores using the Mann-Whitney U test. We calculated the total SPK score and defined a cut-off score using receiver operating characteristic analysis. In all, 5 participants in 7 different training groups (n = 35) underwent an interview. Median scores for each procedure and overall SPK scores increased with experience. The median SPK for novices was 54.9 (95% confidence interval [CI] 21.6-58.8) compared with 98.05 (95% CP 94.1-100.0) for experts (p = 0.012). The SPK cut-off score of 93.1 discriminates between novice and expert surgeons. Surgical procedural knowledge can reliably be assessed using our SPK assessment tool. It can discriminate between novice and expert surgeons for common general surgical procedures. Future studies are planned to evaluate its use for more complex procedures.

[Physiotherapeutic assessment of chronic pelvic pain syndrome : Development of a standardized physiotherapeutic assessment instrument for interprofessional cooperation in patients with chronic pelvic pain syndrome].

PubMed

Klotz, S G R; Ketels, G; Richardsen, B; Löwe, B; Brünahl, C A

2018-04-24

The chronic pelvic pain syndrome (CPPS) can be associated with physiotherapeutic findings. An interprofessional approach is recommended for patients with CPPS; however, no standardized physiotherapeutic assessment and documentation instrument for specific physiotherapeutic assessments exist, which is not only the foundation for physiotherapy but also for interprofessional communication. The aim was the development of a physiotherapeutic assessment instrument for patients with CPPS and therefore, to create a tool for clinical use, research and interprofessional communication. Based on an explorative literature search and an expert consensus, the first version of the instrument was developed as part of a specialized outpatient clinic. This version was applied clinically for 13 months, edited and finalized after another expert consensus. The developed instrument Physical Therapy Assessment for Chronic Pelvic Pain Syndrome (PTA-CPPS) lists external and internal groups of muscles for a systematic assessment of myofascial findings. Functional capacity, breathing movements as well as scars and regions of pain are recorded. A manual for the assessment protocol was developed as accompanying material. The developed instrument provides for the first time a physiotherapeutic assessment tool for patients with CPPS for interprofessional clinical and scientific use.

Development, features and application of DIET ASSESS & PLAN (DAP) software in supporting public health nutrition research in Central Eastern European Countries (CEEC).

PubMed

Gurinović, Mirjana; Milešević, Jelena; Kadvan, Agnes; Nikolić, Marina; Zeković, Milica; Djekić-Ivanković, Marija; Dupouy, Eleonora; Finglas, Paul; Glibetić, Maria

2018-01-01

In order to meet growing public health nutrition challenges in Central Eastern European Countries (CEEC) and Balkan countries, development of a Research Infrastructure (RI) and availability of an effective nutrition surveillance system are a prerequisite. The building block of this RI is an innovative tool called DIET ASSESS & PLAN (DAP), which is a platform for standardized and harmonized food consumption collection, comprehensive dietary intake assessment and nutrition planning. Its unique structure enables application of national food composition databases (FCDBs) from the European food composition exchange platform (28 national FCDBs) developed by EuroFIR (http://www.eurofir.org/) and in addition allows communication with other tools. DAP is used for daily menu and/or long-term diet planning in diverse public sector settings, foods design/reformulation, food labelling, nutrient intake assessment and calculation of the dietary diversity indicator, Minimum Dietary Diversity-Women (MDD-W). As a validated tool in different national and international projects, DAP represents an important RI in public health nutrition epidemiology in the CEEC region. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource

Objective Data Assessment (ODA) Methods as Nutritional Assessment Tools.

PubMed

Hamada, Yasuhiro

2015-01-01

Nutritional screening and assessment should be a standard of care for all patients because nutritional management plays an important role in clinical practice. However, there is no gold standard for the diagnosis of malnutrition or undernutrition, although a large number of nutritional screening and assessment tools have been developed. Nutritional screening and assessment tools are classified into two categories, namely, subjective global assessment (SGA) and objective data assessment (ODA). SGA assesses nutritional status based on the features of medical history and physical examination. On the other hand, ODA consists of objective data provided from various analyses, such as anthropometry, bioimpedance analysis (BIA), dual-energy X-ray absorptiometry (DEXA), computed tomography (CT), magnetic resonance imaging (MRI), laboratory tests, and functional tests. This review highlights knowledge on the performance of ODA methods for the assessment of nutritional status in clinical practice. J. Med. Invest. 62: 119-122, August, 2015.

A risk assessment tool applied to the study of shale gas resources.

PubMed

Veiguela, Miguel; Hurtado, Antonio; Eguilior, Sonsoles; Recreo, Fernando; Roqueñi, Nieves; Loredo, Jorge

2016-11-15

The implementation of a risk assessment tool with the capacity to evaluate the risks for health, safety and the environment (HSE) from extraction of non-conventional fossil fuel resources by the hydraulic fracturing (fracking) technique can be a useful tool to boost development and progress of the technology and winning public trust and acceptance of this. At the early project stages, the lack of data related the selection of non-conventional gas deposits makes it difficult the use of existing approaches to risk assessment of fluids injected into geologic formations. The qualitative risk assessment tool developed in this work is based on the approach that shale gas exploitation risk is dependent on both the geologic site and the technological aspects. It follows from the Oldenburg's 'Screening and Ranking Framework (SRF)' developed to evaluate potential geologic carbon dioxide (CO2) storage sites. These two global characteristics: (1) characteristics centered on the natural aspects of the site and (2) characteristics centered on the technological aspects of the Project, have been evaluated through user input of Property values, which define Attributes, which define the Characteristics. In order to carry out an individual evaluation of each of the characteristics and the elements of the model, the tool has been implemented in a spreadsheet. The proposed model has been applied to a site with potential for the exploitation of shale gas in Asturias (northwestern Spain) with tree different technological options to test the approach. Copyright © 2016 Elsevier B.V. All rights reserved.

Consensus modeling to develop the farmers' market readiness assessment and decision instrument.

PubMed

Lee, Eunlye; Dalton, Jarrod; Ngendahimana, David; Bebo, Pat; Davis, Ashley; Remley, Daniel; Smathers, Carol; Freedman, Darcy A

2017-09-01

Nutrition-related policy, system, and environmental (PSE) interventions such as farmers' markets have been recommended as effective strategies for promoting healthy diet for chronic disease prevention. Tools are needed to assess community readiness and capacity factors influencing successful farmers' market implementation among diverse practitioners in different community contexts. We describe a multiphase consensus modeling approach used to develop a diagnostic tool for assessing readiness and capacity to implement farmers' market interventions among public health and community nutrition practitioners working with low-income populations in diverse contexts. Modeling methods included the following: phase 1, qualitative study with community stakeholders to explore facilitators and barriers influencing successful implementation of farmers' market interventions in low-income communities; phase 2, development of indicators based on operationalization of qualitative findings; phase 3, assessment of relevance and importance of indicators and themes through consensus conference with expert panel; phase 4, refinement of indicators based on consensus conference; and phase 5, pilot test of the assessment tool. Findings illuminate a range of implementation factors influencing farmers' market PSE interventions and offer guidance for tailoring intervention delivery based on levels of community, practitioner, and organizational readiness and capacity.

A Framework for Assessing High School Students' Statistical Reasoning.

PubMed

Chan, Shiau Wei; Ismail, Zaleha; Sumintono, Bambang

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students' statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students' statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework's cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments.

A Framework for Assessing High School Students' Statistical Reasoning

PubMed Central

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students’ statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students’ statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework’s cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments. PMID:27812091

Assessment tools for unrecognized myocardial infarction: a cross-sectional analysis of the REasons for geographic and racial differences in stroke population

PubMed Central

2013-01-01

Background Routine electrocardiograms (ECGs) are not recommended for asymptomatic patients because the potential harms are thought to outweigh any benefits. Assessment tools to identify high risk individuals may improve the harm versus benefit profile of screening ECGs. In particular, people with unrecognized myocardial infarction (UMI) have elevated risk for cardiovascular events and death. Methods Using logistic regression, we developed a basic assessment tool among 16,653 participants in the REasons for Geographic and Racial Differences in Stroke (REGARDS) study using demographics, self-reported medical history, blood pressure, and body mass index and an expanded assessment tool using information on 51 potential variables. UMI was defined as electrocardiogram evidence of myocardial infarction without a self-reported history (n = 740). Results The basic assessment tool had a c-statistic of 0.638 (95% confidence interval 0.617 - 0.659) and included age, race, smoking status, body mass index, systolic blood pressure, and self-reported history of transient ischemic attack, deep vein thrombosis, falls, diabetes, and hypertension. A predicted probability of UMI > 3% provided a sensitivity of 80% and a specificity of 30%. The expanded assessment tool had a c-statistic of 0.654 (95% confidence interval 0.634-0.674). Because of the poor performance of these assessment tools, external validation was not pursued. Conclusions Despite examining a large number of potential correlates of UMI, the assessment tools did not provide a high level of discrimination. These data suggest defining groups with high prevalence of UMI for targeted screening will be difficult. PMID:23530553

Development and Validity Testing of the Worksite Health Index: An Assessment Tool to Help and Improve Korean Employees' Health-Related Outcome.

PubMed

Yun, Young Ho; Sim, Jin Ah; Lim, Ye Jin; Lim, Cheol Il; Kang, Sung-Choon; Kang, Joon-Ho; Park, Jun Dong; Noh, Dong Young

2016-06-01

The objective of this study was to develop the Worksite Health Index (WHI) and validate its psychometric properties. The development of the WHI questionnaire included item generation, item construction, and field testing. To assess the instrument's reliability and validity, we recruited 30 different Korean worksites. We developed the WHI questionnaire of 136 items categorized into five domains, namely Governance and Infrastructure, Need Assessment and Planning, Health Prevention and Promotion Program, Occupational Safety, and Monitoring and Feedback. All WHI domains demonstrated a high reliability with good internal consistency. The total WHI scores differentiated worksite groups effectively according to firm size. Each domain was associated significantly with employees' health status, absence, and financial outcome. The WHI can assess comprehensive worksite health programs. This tool is publicly available for addressing the growing need for worksite health programs.

Towards the assessment and management of contaminated dredged materials.

PubMed

Agius, Suzanne J; Porebski, Linda

2008-04-01

Environment Canada's Disposal at Sea Programme hosted the Contaminated Dredged Material Management Decisions Workshop in Montreal, Quebec, Canada, on 28-30 November 2006. The workshop brought together over 50 sediment assessment and management experts from academic, industrial, and regulatory backgrounds and charged them with drafting a potential framework to assess contaminated dredged materials and compare the risks of various disposal alternatives. This article summarizes the recommendations made during the workshop concerning the development of sediment assessment tools, the interpretation of these tools, and the essential attributes of a comparative risk assessment process. The major outcomes of the workshop include a strong recommendation to develop a national dredging or sediment management strategy, a potential decision-making framework for the assessment of dredged materials and comparative risk assessment of disposal options, and the expansion of minimum sediment characterization requirements for nonroutine disposal permit applications.

Developing an Indigenous Proficiency Scale

ERIC Educational Resources Information Center

Kahakalau, Ku

2017-01-01

With an increased interest in the revitalization of Indigenous languages and cultural practices worldwide, there is also an increased need to develop tools to support Indigenous language learners and instructors. The purpose of this article is to presents such a tool called ANA 'OLELO, designed specifically to assess Hawaiian language proficiency.…

Development and Trialling of a Graduated Descriptors Tool for Australian Pharmacy Students

ERIC Educational Resources Information Center

Stupans, Ieva; Owen, Susanne; McKauge, Leigh; Pont, Lisa; Ryan, Greg; Woulfe, Jim

2012-01-01

Profession-derived competency standards are key determinants for curriculum and assessment in many professional university programmes. An Australian Learning and Teaching Council funded project used a participatory action research approach to enable the collaborative development of a graduated (or incremental) descriptors tool related to…

Evaluating the Use of a Strengths-Based Development Tool with Head Teachers

ERIC Educational Resources Information Center

Cooper, Liz; Woods, Kevin

2017-01-01

This exploratory study investigated an educational psychologist's use of a strengths-based development tool with head teachers, in the context of influencing and supporting leaders in school organisations. Nine head teachers completed the "Realise2 Introductory Profile" online strengths assessment and then received a structured debrief…

Supporting Literacy in Preschool: Using a Teacher-Observation Tool to Guide Professional Development

ERIC Educational Resources Information Center

McNerney, Shelly; Nielsen, Diane Corcoran; Clay, Phyllis

2006-01-01

Teachers involved with professional-development opportunities inevitably differ in their content knowledge, access to resources, and instructional practices. The purpose of this study was to investigate how a standardized assessment observation tool, selected to gather summative information for grant-evaluation purposes about preschool teachers'…

Engaging Faculty in the Assessment and Improvement of Students' Critical Thinking Using the Critical Thinking Assessment Test

ERIC Educational Resources Information Center

Stein, Barry; Haynes, Ada

2011-01-01

Many assessment experts believe it is essential to develop faculty-driven assessment tools in order to engage faculty in meaningful assessment that can improve student learning. Tennessee Technological University (TTU) has been involved in an extended effort during the last ten years to develop, refine, and nationally disseminate an instrument to…

A web-based team-oriented medical error communication assessment tool: development, preliminary reliability, validity, and user ratings.

PubMed

Kim, Sara; Brock, Doug; Prouty, Carolyn D; Odegard, Peggy Soule; Shannon, Sarah E; Robins, Lynne; Boggs, Jim G; Clark, Fiona J; Gallagher, Thomas

2011-01-01

Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication. We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure. Using valid data from 78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on the Likert-scale questions and ranged from α=.79 to α=.89 for each set of 7 Likert-type discussion/planning items and from α=.70 to α=.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r=.59 for discussion/planning and r=.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5). Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.

Development and implementation of the Structured Training Trainer Assessment Report (STTAR) in the English National Training Programme for laparoscopic colorectal surgery.

PubMed

Wyles, Susannah M; Miskovic, Danilo; Ni, Zhifang; Darzi, Ara W; Valori, Roland M; Coleman, Mark G; Hanna, George B

2016-03-01

There is a lack of educational tools available for surgical teaching critique, particularly for advanced laparoscopic surgery. The aim was to develop and implement a tool that assesses training quality and structures feedback for trainers in the English National Training Programme for laparoscopic colorectal surgery. Semi-structured interviews were performed and analysed, and items were extracted. Through the Delphi process, essential items pertaining to desirable trainer characteristics, training structure and feedback were determined. An assessment tool (Structured Training Trainer Assessment Report-STTAR) was developed and tested for feasibility, acceptability and educational impact. Interview transcripts (29 surgical trainers, 10 trainees, four educationalists) were analysed, and item lists created and distributed for consensus opinion (11 trainers and seven trainees). The STTAR consisted of 64 factors, and its web-based version, the mini-STTAR, included 21 factors that were categorised into four groups (training structure, training behaviour, trainer attributes and role modelling) and structured around a training session timeline (beginning, middle and end). The STTAR (six trainers, 48 different assessments) demonstrated good internal consistency (α = 0.88) and inter-rater reliability (ICC = 0.75). The mini-STTAR demonstrated good inter-item reliability (α = 0.79) and intra-observer reliability on comparison of 85 different trainer/trainee combinations (r = 0.701, p = <0.001). Both were found to be feasible and acceptable. The educational report for trainers was found to be useful (4.4 out of 5). An assessment tool that evaluates training quality was developed and shown to be reliable, acceptable and of educational value. It has been successfully implemented into the English National Training Programme for laparoscopic colorectal surgery.

Systematic Assessment Through Mathematical Model For Sustainability Reporting In Malaysia Context

NASA Astrophysics Data System (ADS)

Lanang, Wan Nurul Syahirah Wan; Turan, Faiz Mohd; Johan, Kartina

2017-08-01

Sustainability assessment have been studied and increasingly recognized as a powerful and valuable tool to measure the performance of sustainability in a company or industry. Nowadays, there are many existing tools that the users can use for sustainable development. There are various initiatives exists on tools for sustainable development, though most of the tools focused on environmental, economy and social aspects. Using the Green Project Management (GPM) P5 concept that suggests the firms not only needs to engage in mainly 3Ps principle: planet, profit, people responsible behaviours, but also, product and process need to be included in the practices, this study will introduce a new mathematical model for assessing the level of sustainability practice in the company. Based on multiple case studies, involving in-depth interviews with senior directors, feedback from experts, and previous engineering report, a systematic approach is done with the aims to obtain the respective data from the feedbacks and to be developed into a new mathematical model. By reviewing on the methodology of this research it comprises of several phases where it starts with the analyzation of the parameters and criteria selection according to the Malaysian context of industry. Moving on to the next step is data analysis involving regression and finally the normalisation process will be done to determine the result of this research either succeeded or not. Lastly, this study is expected to provide a clear guideline to any company or organization to assimilate the sustainability assessment in their development stage. In future, the better understanding towards the sustainability assessment is attained to be aligned unitedly in order to integrated the process approach into the systematic approach for the sustainability assessment.

Field scale modeling to estimate phosphorus and sediment load reductions using a newly developed graphical user interface for soil and water assessment tool

USDA-ARS?s Scientific Manuscript database

Streams throughout the North Canadian River watershed in northwest Oklahoma, USA have elevated levels of nutrients and sediment. SWAT (Soil and Water Assessment Tool) was used to identify areas that likely contributed disproportionate amounts of phosphorus (P) and sediment to Lake Overholser, the re...

The Assessment of Afterschool Program Practices Tool (APT): Findings from the APT Validation Study

ERIC Educational Resources Information Center

Tracy, Allison; Surr, Wendy; Richer, Amanda

2012-01-01

The Assessment of Afterschool Program Practices Tool ("APT"), developed by the National Institute of Out-of-School Time (NIOST), is an observational instrument designed to measure the aspects of afterschool program quality that research suggests contribute to the 21st century skills, attitudes, and behaviors youth need to be successful…

The Community Barometer: A Breast Health Needs Assessment Tool for Community-Based Organizations

ERIC Educational Resources Information Center

Lounsbury, David; Rapkin, Bruce; Marini, Lisa; Jansky, Elizabeth; Massie, Mary Jane

2006-01-01

This article presents findings from the ACCESS Project focusing on the impact of an outreach initiative that used "data sharing" as a mechanism to establish a wide variety of academic-community partnerships for cancer awareness. The Community Barometer, a brief needs assessment tool developed for this purpose, was used to collect data from…

The Stuttering Treatment Research Evaluation and Assessment Tool (STREAT): Evaluating Treatment Research as Part of Evidence-Based Practice

ERIC Educational Resources Information Center

Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.

2006-01-01

Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…

A Real-Time Plagiarism Detection Tool for Computer-Based Assessments

ERIC Educational Resources Information Center

Jeske, Heimo J.; Lall, Manoj; Kogeda, Okuthe P.

2018-01-01

Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of…

Social Work Admission Assessment Tool for Identifying Patients in Need of Comprehensive Social Work Evaluation

ERIC Educational Resources Information Center

Boutin-Foster, Carla; Euster, Sona; Rolon, Yvette; Motal, Athena; BeLue, Rhonda; Kline, Robin; Charlson, Mary E.

2005-01-01

Early identification of patients who need a social work evaluation is integral to effective discharge planning. This article describes the development and application of the Social Work Admission Assessment Tool (SWAAT), a six-item scale that identifies patients with complicated discharge needs who require a social work evaluation. It addresses…

Development of a Suicidal Ideation Detection Tool for Primary Healthcare Settings: Using Open Access Online Psychosocial Data.

PubMed

Meyer, Denny; Abbott, Jo-Anne; Rehm, Imogen; Bhar, Sunil; Barak, Azy; Deng, Gary; Wallace, Klaire; Ogden, Edward; Klein, Britt

2017-04-01

Suicidal patients often visit healthcare professionals in their last month before suicide, but medical practitioners are unlikely to raise the issue of suicide with patients because of time constraints and uncertainty regarding an appropriate approach. A brief tool called the e-PASS Suicidal Ideation Detector (eSID) was developed for medical practitioners to help detect the presence of suicidal ideation (SI) in their clients. If SI is detected, the system alerts medical practitioners to address this issue with a client. The eSID tool was developed due to the absence of an easy-to-use, evidence-based SI detection tool for general practice. The tool was developed using binary logistic regression analyses of data provided by clients accessing an online psychological assessment function. Ten primary healthcare professionals provided advice regarding the use of the tool. The analysis identified eleven factors in addition to the Kessler-6 for inclusion in the model used to predict the probability of recent SI. The model performed well across gender and age groups 18-64 (AUR 0.834, 95% CI 0.828-0.841, N = 16,703). Healthcare professionals were interviewed; they recommended that the tool be incorporated into existing medical software systems and that additional resources be supplied, tailored to the level of risk identified. The eSID is expected to trigger risk assessments by healthcare professionals when this is necessary. Initial reactions of healthcare professionals to the tool were favorable, but further testing and in situ development are required.

Impact of the Use of a Standardized Guidance Tool on the Development of a Teaching Philosophy in a Pharmacy Residency Teaching and Learning Curriculum Program

PubMed Central

Wesner, Amber R.; Jones, Ryan; Schultz, Karen; Johnson, Mark

2016-01-01

The purpose of this study was to evaluate the impact of a standardized reflection tool on the development of a teaching philosophy statement in a pharmacy residency teaching and learning curriculum program (RTLCP). Pharmacy residents participating in the RTLCP over a two-year period were surveyed using a pre/post method to assess perceptions of teaching philosophy development before and after using the tool. Responses were assessed using a 5-point Likert scale to indicate level of agreement with each statement. For analysis, responses were divided into high (strongly agree/agree) and low (neutral/disagree/strongly disagree) agreement. The level of agreement increased significantly for all items surveyed (p < 0.05), with the exception of one area pertaining to the ability to describe characteristics of outstanding teachers, which was noted to be strong before and after using the tool (p = 0.5027). Overall results were positive, with 81% of participants responding that the reflection tool was helpful in developing a teaching philosophy, and 96% responding that the resulting teaching philosophy statement fully reflected their views on teaching and learning. The standardized reflection tool developed at Shenandoah University assisted pharmacy residents enrolled in a teaching and learning curriculum program to draft a comprehensive teaching philosophy statement, and was well received by participants. PMID:28970382

Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review.

PubMed

Page, Matthew J; McKenzie, Joanne E; Higgins, Julian P T

2018-03-14

Several scales, checklists and domain-based tools for assessing risk of reporting biases exist, but it is unclear how much they vary in content and guidance. We conducted a systematic review of the content and measurement properties of such tools. We searched for potentially relevant articles in Ovid MEDLINE, Ovid Embase, Ovid PsycINFO and Google Scholar from inception to February 2017. One author screened all titles, abstracts and full text articles, and collected data on tool characteristics. We identified 18 tools that include an assessment of the risk of reporting bias. Tools varied in regard to the type of reporting bias assessed (eg, bias due to selective publication, bias due to selective non-reporting), and the level of assessment (eg, for the study as a whole, a particular result within a study or a particular synthesis of studies). Various criteria are used across tools to designate a synthesis as being at 'high' risk of bias due to selective publication (eg, evidence of funnel plot asymmetry, use of non-comprehensive searches). However, the relative weight assigned to each criterion in the overall judgement is unclear for most of these tools. Tools for assessing risk of bias due to selective non-reporting guide users to assess a study, or an outcome within a study, as 'high' risk of bias if no results are reported for an outcome. However, assessing the corresponding risk of bias in a synthesis that is missing the non-reported outcomes is outside the scope of most of these tools. Inter-rater agreement estimates were available for five tools. There are several limitations of existing tools for assessing risk of reporting biases, in terms of their scope, guidance for reaching risk of bias judgements and measurement properties. Development and evaluation of a new, comprehensive tool could help overcome present limitations. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

PubMed

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

A decision-making tool for incorporating sustainability measures into pavement design : research project capsule.

DOT National Transportation Integrated Search

2016-10-01

The objective of the proposed study is to conceive and develop a decision-making tool : for evaluating sustainability of pavement designs based on a cradle-to-grave analysis. : This tool will utilize EPDs to enhance the reliability of the assessment ...

FRAMEWORK FOR RESPONSIBLE DECISION-MAKING (FRED): A TOOL FOR ENVIRONMENTALLY PREFERABLE PRODUCTS

EPA Science Inventory

In support of the Environmentally Preferable Purchasing Program of the USEPA, a decision-making tool based on life cycle assessment has been developed. This tool, the Framework for Responsible Environmental Decision-making or FRED, streamlines LCA by choosing a minimum list of im...

FRAMEWORK FOR ENVIRONMENTAL DECISION-MAKING, FRED: A TOOL FOR ENVIRONMENTALLY-PREFERABLE PURCHASING

EPA Science Inventory

In support of the Environmentally Preferable Purchasing Program of the US EPA, the Systems Analysis Branch has developed a decision-making tool based on life cycle assessment. This tool, the Framework for Responsible Environmental Decision-making or FRED streamlines LCA by choosi...

Exposure Factors Handbook - 2009 Update (External Review ...

EPA Pesticide Factsheets

The mission of National Center for Environmental Assessment (NCEA) of EPA's Office of Research and Development is to provide guidance and risk assessments aimed at protecting human health and the environment. To accomplish this mission, NCEA works to develop and improve the models, databases, tools, assumptions, and extrapolations used in risk assessments. This handbook is a tool developed by NCEA aimed at refining the assumptions used in exposure assessments and reducing uncertainty. This handbook was first published in 1989 and updated in 1997 to provide statistical data on the various human factors used in assessing exposure. This revised version of the handbook provides the up-to-date data on these exposure factors. The recommended values are based solely on our interpretations of the available data. In many situations different values may be appropriate to use in consideration of policy, precedent or other factors. External Review Draft

Review of methods for developing probabilistic risk assessments

Treesearch

D. A. Weinstein; P.B. Woodbury

2010-01-01

We describe methodologies currently in use or those under development containing features for estimating fire occurrence risk assessment. We describe two major categories of fire risk assessment tools: those that predict fire under current conditions, assuming that vegetation, climate, and the interactions between them and fire remain relatively similar to their...

Developing and Improving Modified Achievement Level Descriptors: Rationale, Procedures, and Tools

ERIC Educational Resources Information Center

Quenemoen, Rachel; Albus, Debra; Rogers, Chris; Lazarus, Sheryl

2010-01-01

Some states are developing alternate assessments based on modified achievement standards (AA-MAS) to measure the academic achievement of some students with disabilities (Albus, Lazarus, Thurlow, & Cormier, 2009; Lazarus, Thurlow, Christensen, & Cormier, 2007). These assessments measure the same content as the general assessment for a given…

ENVIRONMENTAL PROTECTION AGENCY'S ENVIRONMENTAL MONITORING AND ASSESSMENT PROGRAM (EMAP) IN THE 21ST CENTURY

EPA Science Inventory

The U.S. Environmental Protection Agancy's Environmental Monitoring and Assessment Program (EMAP) is improving the tools to assess status and trends in the condition of aquatic ecosystems across the U.S. Within the Office of Research and Development, EMAP has developed an approac...

Tool Use Within NASA Software Quality Assurance

NASA Technical Reports Server (NTRS)

Shigeta, Denise; Port, Dan; Nikora, Allen P.; Wilf, Joel

2013-01-01

As space mission software systems become larger and more complex, it is increasingly important for the software assurance effort to have the ability to effectively assess both the artifacts produced during software system development and the development process itself. Conceptually, assurance is a straightforward idea - it is the result of activities carried out by an organization independent of the software developers to better inform project management of potential technical and programmatic risks, and thus increase management's confidence in the decisions they ultimately make. In practice, effective assurance for large, complex systems often entails assessing large, complex software artifacts (e.g., requirements specifications, architectural descriptions) as well as substantial amounts of unstructured information (e.g., anomaly reports resulting from testing activities during development). In such an environment, assurance engineers can benefit greatly from appropriate tool support. In order to do so, an assurance organization will need accurate and timely information on the tool support available for various types of assurance activities. In this paper, we investigate the current use of tool support for assurance organizations within NASA, and describe on-going work at JPL for providing assurance organizations with the information about tools they need to use them effectively.

Child development in primary care: a surveillance proposal.

PubMed

Coelho, Renato; Ferreira, José Paulo; Sukiennik, Ricardo; Halpern, Ricardo

2016-01-01

To evaluate a child development surveillance tool proposal to be used in primary care, with simultaneous use of the Denver II scale. This was a cross-sectional study of 282 infants aged up to 36 months, enrolled in a public daycare in a countryside community in Rio Grande do Sul/Brazil. Child development was assessed using the surveillance tool and the Denver II scale. The prevalence of probable developmental delay was 53%; most of these cases were in the alert group and 24% had normal development, but with risk factors. At the Denver scale, the prevalence of suspected developmental delay was 32%. When risk factors and sociodemographic variables were assessed, no significant difference was observed. The evaluation of this surveillance tool resulted in objective and comparable data, which were adequate for a screening test. It is easily applicable as a screening tool, even though it was originally designed as a surveillance tool. The inclusion of risk factors to the scoring system is an innovation that allows for the identification of children with suspected delay in addition to developmental milestones, although the definition of parameters and choice of indicators should be thoroughly studied. Copyright © 2016 Sociedade Brasileira de Pediatria. Published by Elsevier Editora Ltda. All rights reserved.

Early wound infection identification using the WIRE tool in community health care settings: An audit report.

PubMed

Siaw-Sakyi, Vincent

2017-12-01

Wound infection is proving to be a challenge for health care professionals. The associated complications and cost of wound infection is immense and can lead to death in extreme cases. Current management of wound infection is largely subjective and relies on the knowledge of the health care professional to identify and initiate treatment. In response, we have developed an infection prediction and assessment tool. The Wound Infection Risk-Assessment and Evaluation tool (WIRE) and its management strategy is a tool with the aim to bring objectivity to infection prediction, assessment and management. A local audit carried out indicated a high infection prediction rate. More work is being done to improve its effectiveness.

Towards early software reliability prediction for computer forensic tools (case study).

PubMed

Abu Talib, Manar

2016-01-01

Versatility, flexibility and robustness are essential requirements for software forensic tools. Researchers and practitioners need to put more effort into assessing this type of tool. A Markov model is a robust means for analyzing and anticipating the functioning of an advanced component based system. It is used, for instance, to analyze the reliability of the state machines of real time reactive systems. This research extends the architecture-based software reliability prediction model for computer forensic tools, which is based on Markov chains and COSMIC-FFP. Basically, every part of the computer forensic tool is linked to a discrete time Markov chain. If this can be done, then a probabilistic analysis by Markov chains can be performed to analyze the reliability of the components and of the whole tool. The purposes of the proposed reliability assessment method are to evaluate the tool's reliability in the early phases of its development, to improve the reliability assessment process for large computer forensic tools over time, and to compare alternative tool designs. The reliability analysis can assist designers in choosing the most reliable topology for the components, which can maximize the reliability of the tool and meet the expected reliability level specified by the end-user. The approach of assessing component-based tool reliability in the COSMIC-FFP context is illustrated with the Forensic Toolkit Imager case study.

The potential of a self-assessment tool to identify healthcare professionals' strengths and areas in need of professional development to aid effective facilitation of group-based, person-centered diabetes education.

PubMed

Stenov, Vibeke; Wind, Gitte; Skinner, Timothy; Reventlow, Susanne; Hempler, Nana Folmann

2017-09-18

Healthcare professionals' person-centered communication skills are pivotal for successful group-based diabetes education. However, healthcare professionals are often insufficiently equipped to facilitate person-centeredness and many have never received post-graduate training. Currently, assessing professionals' skills in conducting group-based, person-centered diabetes education primarily focus on experts measuring and coding skills on various scales. However, learner-centered approaches such as adequate self-reflective tools have been shown to emphasize professional autonomy and promote engagement. The aim of this study was to explore the potential of a self-assessment tool to identify healthcare professionals' strengths and areas in need of professional development to aid effective facilitation of group-based, person-centered diabetes education. The study entails of two components: 1) Field observations of five different educational settings including 49 persons with diabetes and 13 healthcare professionals, followed by interviews with 5 healthcare professionals and 28 persons with type 2 diabetes. 2) One professional development workshop involving 14 healthcare professionals. Healthcare professionals were asked to assess their person-centered communication skills using a self-assessment tool based on challenges and skills related to four educator roles: Embracer, Facilitator, Translator, and Initiator. Data were analyzed by hermeneutic analysis. Theories derived from theoretical model 'The Health Education Juggler' and techniques from 'Motivational Interviewing in Groups' were used as a framework to analyze data. Subsequently, the analysis from the field notes and interview transcript were compared with healthcare professionals' self-assessments of strengths and areas in need to effectively facilitate group-based, person-centered diabetes education. Healthcare professionals self-assessed the Translator and the Embracer to be the two most skilled roles whereas the Facilitator and the Initiator were identified to be the most challenged roles. Self-assessments corresponded to observations of professional skills in educational programs and were confirmed in the interviews. Healthcare professionals self-assessed the same professional skills as observed in practice. Thus, a tool to self-assess professional skills in facilitating group-based diabetes education seems to be useful as a starting point to promote self-reflections and identification of healthcare professionals' strengths and areas of need of professional development.

Hebrew Language Assessment Measure for Preschool Children: A Comparison between Typically Developing Children and Children with Specific Language Impairment

ERIC Educational Resources Information Center

Katzenberger, Irit; Meilijson, Sara

2014-01-01

The Katzenberger Hebrew Language Assessment for Preschool Children (henceforth: the KHLA) is the first comprehensive, standardized language assessment tool developed in Hebrew specifically for older preschoolers (4;0-5;11 years). The KHLA is a norm-referenced, Hebrew specific assessment, based on well-established psycholinguistic principles, as…

Investigating the Psychometric Properties of the ACEI Global Guidelines Assessment (GGA) in Four Countries

ERIC Educational Resources Information Center

Hardin, Belinda J.; Bergen, Doris; Hung, Hsuan-Fang

2013-01-01

The ACEI Global Guidelines Assessment (GGA) was developed to provide an international assessment tool that can be used by early childhood educators to develop, assess, and improve program quality worldwide. This pilot study was conducted in four countries to investigate the psychometric properties of the GGA within and across different countries.…

Development and Evaluation of a Questionnaire to Assess Physical Educators' Knowledge of Student Assessment

ERIC Educational Resources Information Center

Emmanouilidou, Kyriaki; Derri, Vassiliki; Aggelousis, Nicolaos; Vassiliadou, Olga

2012-01-01

The purpose of this pilot study was to develop and evaluate an instrument for measuring Greek elementary physical educators' knowledge of student assessment. A multiple-choice questionnaire comprised of items about concepts, methods, tools, and types of student assessment in physical education was designed and tested. The initial 35-item…

Use of Influenza Risk Assessment Tool for Prepandemic Preparedness

PubMed Central

Trock, Susan C.

2018-01-01

In 2010, the Centers for Disease Control and Prevention began to develop an Influenza Risk Assessment Tool (IRAT) to methodically capture and assess information relating to influenza A viruses not currently circulating among humans. The IRAT uses a multiattribute, additive model to generate a summary risk score for each virus. Although the IRAT is not intended to predict the next pandemic influenza A virus, it has provided input into prepandemic preparedness decisions. PMID:29460739

Assessing Army Values in New Soldiers: Development of a Behaviorally Anchored Peer Evaluation Form

DTIC Science & Technology

2015-02-03

evaluation has long been a valuable tool in school and workplace performance assessment, and has sparked military interest as a tool for leader...Values. Adhering to these values can affect Awards, promotions, selection to attend military schools , leadership positions, and desirable assignments (AR...by ratee and/or rater gender . Assessing the psychometric properties of AVBARS-PE The AVBARS-PE was administered to 50 BCT Soldiers (25 male and 25

OfftargetFinder: a web tool for species-specific RNAi design.

PubMed

Good, R T; Varghese, T; Golz, J F; Russell, D A; Papanicolaou, A; Edwards, O; Robin, C

2016-04-15

RNA interference (RNAi) technology is being developed as a weapon for pest insect control. To maximize the specificity that such an approach affords we have developed a bioinformatic web tool that searches the ever-growing arthropod transcriptome databases so that pest-specific RNAi sequences can be identified. This will help technology developers finesse the design of RNAi sequences and suggests which non-target species should be assessed in the risk assessment process. http://rnai.specifly.org crobin@unimelb.edu.au. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men.

PubMed

Hussein, Ahmed A; Sexton, Kevin J; May, Paul R; Meng, Maxwell V; Hosseini, Abolfazl; Eun, Daniel D; Daneshmand, Siamak; Bochner, Bernard H; Peabody, James O; Abaza, Ronney; Skinner, Eila C; Hautmann, Richard E; Guru, Khurshid A

2018-04-13

We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men. A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation. The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains. We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.

Community health assessment tool: a patterns approach to data collection and diagnosis.

PubMed

Kriegler, N F; Harton, M K

1992-01-01

Creation of an assessment tool to apply Gordon's functional patterns to the community as a client was a rewarding and stimulating project. Through use of the CHAT, students developed an appreciation of the complexity and inter-relationship of numerous aspects of the community. They completed the nursing process by developing appropriate nursing diagnoses, and planning, implementing, and evaluating a health promotion project. As the students continue to use this tool in the health promotion course, the diagnoses which they generate are being collected. From this accumulated input the plan is to compile a list of common diagnoses which are appropriate to use when the community is the client.

LICARA nanoSCAN - A tool for the self-assessment of benefits and risks of nanoproducts.

PubMed

van Harmelen, Toon; Zondervan-van den Beuken, Esther K; Brouwer, Derk H; Kuijpers, Eelco; Fransman, Wouter; Buist, Harrie B; Ligthart, Tom N; Hincapié, Ingrid; Hischier, Roland; Linkov, Igor; Nowack, Bernd; Studer, Jennifer; Hilty, Lorenz; Som, Claudia

2016-05-01

The fast penetration of nanoproducts on the market under conditions of significant uncertainty of their environmental properties and risks to humans creates a need for companies to assess sustainability of their products. Evaluation of the potential benefits and risks to build a coherent story for communication with clients, authorities, consumers, and other stakeholders is getting to be increasingly important, but SMEs often lack the knowledge and expertise to assess risks and communicate them appropriately. This paper introduces LICARA nanoSCAN, a modular web based tool that supports SMEs in assessing benefits and risks associated with new or existing nanoproducts. This tool is unique because it is scanning both the benefits and risks over the nanoproducts life cycle in comparison to a reference product with a similar functionality in order to enable the development of sustainable and competitive nanoproducts. SMEs can use data and expert judgment to answer mainly qualitative and semi-quantitative questions as a part of tool application. Risks to public, workers and consumers are assessed, while the benefits are evaluated for economic, environmental and societal opportunities associated with the product use. The tool provides an easy way to visualize results as well as to identify gaps, missing data and associated uncertainties. The LICARA nanoSCAN has been positively evaluated by several companies and was tested in a number of case studies. The tool helps to develop a consistent and comprehensive argument on the weaknesses and strengths of a nanoproduct that may be valuable for the communication with authorities, clients and among stakeholders in the value chain. LICARA nanoSCAN identifies areas for more detailed assessments, product design improvement or application of risk mitigation measures. Copyright © 2016 Elsevier Ltd. All rights reserved.

National Energy Audit Tool for Multifamily Buildings Development Plan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Malhotra, Mini; MacDonald, Michael; Accawi, Gina K

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program (WAP) enables low-income families to reduce their energy costs by providing funds to make their homes more energy efficient. In addition, the program funds Weatherization Training and Technical Assistance (T and TA) activities to support a range of program operations. These activities include measuring and documenting performance, monitoring programs, promoting advanced techniques and collaborations to further improve program effectiveness, and training, including developing tools and information resources. The T and TA plan outlines the tasks, activities, and milestones to support the weatherization network with the program implementation ramp up efforts. Weatherizationmore » of multifamily buildings has been recognized as an effective way to ramp up weatherization efforts. To support this effort, the 2009 National Weatherization T and TA plan includes the task of expanding the functionality of the Weatherization Assistant, a DOE-sponsored family of energy audit computer programs, to perform audits for large and small multifamily buildings This report describes the planning effort for a new multifamily energy audit tool for DOE's WAP. The functionality of the Weatherization Assistant is being expanded to also perform energy audits of small multifamily and large multifamily buildings. The process covers an assessment of needs that includes input from national experts during two national Web conferences. The assessment of needs is then translated into capability and performance descriptions for the proposed new multifamily energy audit, with some description of what might or should be provided in the new tool. The assessment of needs is combined with our best judgment to lay out a strategy for development of the multifamily tool that proceeds in stages, with features of an initial tool (version 1) and a more capable version 2 handled with currently available resources. Additional development in the future is expected to be needed if more capabilities are to be added. A rough schedule for development of the version 1 tool is presented. The components and capabilities described in this plan will serve as the starting point for development of the proposed new multifamily energy audit tool for WAP.« less

Reliable and valid assessment of Lichtenstein hernia repair skills.

PubMed

Carlsen, C G; Lindorff-Larsen, K; Funch-Jensen, P; Lund, L; Charles, P; Konge, L

2014-08-01

Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. The internal consistency of the items was high (Cronbach's alpha = 0.97). The inter-rater reliability was very good with an intra-class correlation coefficient (ICC) = 0.93. Generalizability analysis showed a coefficient above 0.8 even with one rater. The coefficient improved to 0.92 if three raters were used. One-way analysis of variance found a significant difference between the three groups which indicates construct validity, p < 0.001. Lichtenstein hernia repair skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment of trainees performing Lichtenstein hernia repair to ensure that the objectives of competency-based surgical training are met.

Development of the Leadership Influence Self-Assessment (LISA©) instrument.

PubMed

Shillam, Casey R; Adams, Jeffrey M; Bryant, Debbie Chatman; Deupree, Joy P; Miyamoto, Suzanne; Gregas, Matt

This study aims to describe the development and psychometric evaluation of the Leadership Influence Self-Assessment (LISA©) tool. LISA© was designed to help nurse leaders assess and enhance their influence capacity by measuring influence traits and practices and identifying areas of strength and weakness. Concepts identified in the Adams Influence Model and input from content experts guided the development of 145 items for testing. Administered to 165 nurse leaders, the assessment was subjected to exploratory factor analysis (EFA). EFA yielded a four-factor solution that comprised 80 items. Cronbach's alpha for factors ranged between 0.912 and 0.938. All factor loadings were >0.4; the smallest factor contained 14 items. Items grouped together in the theoretical model also clustered together in the EFA. Preliminary psychometric testing supports validity and reliability of the LISA© and its potential use as a tool to assess influence capacity for purposes of leadership development and research. Copyright © 2017 Elsevier Inc. All rights reserved.

Hierarchical Testing with Automated Document Generation for Amanzi, ASCEM's Subsurface Flow and Reactive Transport Simulator

NASA Astrophysics Data System (ADS)

Moulton, J. D.; Steefel, C. I.; Yabusaki, S.; Castleton, K.; Scheibe, T. D.; Keating, E. H.; Freedman, V. L.

2013-12-01

The Advanced Simulation Capabililty for Environmental Management (ASCEM) program is developing an approach and open-source tool suite for standardized risk and performance assessments at legacy nuclear waste sites. These assessments use a graded and iterative approach, beginning with simplified highly abstracted models, and adding geometric and geologic complexity as understanding is gained. To build confidence in this assessment capability, extensive testing of the underlying tools is needed. Since the tools themselves, such as the subsurface flow and reactive-transport simulator, Amanzi, are under active development, testing must be both hierarchical and highly automated. In this presentation we show how we have met these requirements, by leveraging the python-based open-source documentation system called Sphinx with several other open-source tools. Sphinx builds on the reStructured text tool docutils, with important extensions that include high-quality formatting of equations, and integrated plotting through matplotlib. This allows the documentation, as well as the input files for tests, benchmark and tutorial problems, to be maintained with the source code under a version control system. In addition, it enables developers to build documentation in several different formats (e.g., html and pdf) from a single source. We will highlight these features, and discuss important benefits of this approach for Amanzi. In addition, we'll show that some of ASCEM's other tools, such as the sampling provided by the Uncertainty Quantification toolset, are naturally leveraged to enable more comprehensive testing. Finally, we will highlight the integration of this hiearchical testing and documentation framework with our build system and tools (CMake, CTest, and CDash).

The development of an observational screening tool to assess safe, effective and appropriate walking aid use in people with multiple sclerosis.

PubMed

Eitzen, Abby; Finlayson, Marcia; Carolan-Laing, Leanne; Nacionales, Arthur Junn; Walker, Christie; O'Connor, Josephine; Asano, Miho; Coote, Susan

2017-08-01

The purpose of this study was to identify potential items for an observational screening tool to assess safe, effective and appropriate walking aid use among people with multiple sclerosis (MS). Such a tool is needed because of the association between fall risk and mobility aid use in this population. Four individuals with MS were videotaped using a one or two straight canes, crutches or a rollator in different settings. Seventeen health care professionals from Canada, Ireland and the United States were recruited, and viewed the videos, and were then interviewed about the use of the devices by the individuals in the videos. Interview questions addressed safety, effectiveness and appropriateness of the device in the setting. Data were analyzed qualitatively. Coding consistency across raters was evaluated and confirmed. Nineteen codes were identified as possible items for the screening tool. The most frequent issues raised regardless of setting and device were "device used for duration/abandoned", "appropriate device", "balance and stability", "device technique", "environmental modification" and "hands free." With the identification of a number of potential tool items, researchers can now move forward with the development of the tool. This will involve consultation with both healthcare professionals and people with MS. Implications for rehabilitation Falls among people with multiple sclerosis are associated with mobility device use and use of multiple devices is associated with greater falls risk. The ability to assess for safe, effective and efficient use of walking aids is therefore important, no tools currently exist for this purpose. The codes arising from this study will be used to develop a screening tool for safe, effective and efficient walking aid use with the aim of reducing falls risk.

Cognitive screening tools for identification of dementia in illiterate and low-educated older adults, a systematic review and meta-analysis.

PubMed

Paddick, Stella-Maria; Gray, William K; McGuire, Jackie; Richardson, Jenny; Dotchin, Catherine; Walker, Richard W

2017-06-01

The majority of older adults with dementia live in low- and middle-income countries (LMICs). Illiteracy and low educational background are common in older LMIC populations, particularly in rural areas, and cognitive screening tools developed for this setting must reflect this. This study aimed to review published validation studies of cognitive screening tools for dementia in low-literacy settings in order to determine the most appropriate tools for use. A systematic search of major databases was conducted according to PRISMA guidelines. Validation studies of brief cognitive screening tests including illiterate participants or those with elementary education were eligible. Studies were quality assessed using the QUADAS-2 tool. Good or fair quality studies were included in a bivariate random-effects meta-analysis and a hierarchical summary receiver operating characteristic (HSROC) curve constructed. Forty-five eligible studies were quality assessed. A significant proportion utilized a case-control design, resulting in spectrum bias. The area under the ROC (AUROC) curve was 0.937 for community/low prevalence studies, 0.881 for clinic based/higher prevalence studies, and 0.869 for illiterate populations. For the Mini-Mental State Examination (MMSE) (and adaptations), the AUROC curve was 0.853. Numerous tools for assessment of cognitive impairment in low-literacy settings have been developed, and tools developed for use in high-income countries have also been validated in low-literacy settings. Most tools have been inadequately validated, with only MMSE, cognitive abilities screening instrument (CASI), Eurotest, and Fototest having more than one published good or fair quality study in an illiterate or low-literate setting. At present no screening test can be recommended.

Software Tools to Support the Assessment of System Health

NASA Technical Reports Server (NTRS)

Melcher, Kevin J.

2013-01-01

This presentation provides an overview of three software tools that were developed by the NASA Glenn Research Center to support the assessment of system health: the Propulsion Diagnostic Method Evaluation Strategy (ProDIMES), the Systematic Sensor Selection Strategy (S4), and the Extended Testability Analysis (ETA) tool. Originally developed to support specific NASA projects in aeronautics and space, these software tools are currently available to U.S. citizens through the NASA Glenn Software Catalog. The ProDiMES software tool was developed to support a uniform comparison of propulsion gas path diagnostic methods. Methods published in the open literature are typically applied to dissimilar platforms with different levels of complexity. They often address different diagnostic problems and use inconsistent metrics for evaluating performance. As a result, it is difficult to perform a one ]to ]one comparison of the various diagnostic methods. ProDIMES solves this problem by serving as a theme problem to aid in propulsion gas path diagnostic technology development and evaluation. The overall goal is to provide a tool that will serve as an industry standard, and will truly facilitate the development and evaluation of significant Engine Health Management (EHM) capabilities. ProDiMES has been developed under a collaborative project of The Technical Cooperation Program (TTCP) based on feedback provided by individuals within the aircraft engine health management community. The S4 software tool provides a framework that supports the optimal selection of sensors for health management assessments. S4 is structured to accommodate user ]defined applications, diagnostic systems, search techniques, and system requirements/constraints. One or more sensor suites that maximize this performance while meeting other user ]defined system requirements that are presumed to exist. S4 provides a systematic approach for evaluating combinations of sensors to determine the set or sets of sensors that optimally meet the performance goals and the constraints. It identifies optimal sensor suite solutions by utilizing a merit (i.e., cost) function with one of several available optimization approaches. As part of its analysis, S4 can expose fault conditions that are difficult to diagnose due to an incomplete diagnostic philosophy and/or a lack of sensors. S4 was originally developed and applied to liquid rocket engines. It was subsequently used to study the optimized selection of sensors for a simulation ]based aircraft engine diagnostic system. The ETA Tool is a software ]based analysis tool that augments the testability analysis and reporting capabilities of a commercial ]off ]the ]shelf (COTS) package. An initial diagnostic assessment is performed by the COTS software using a user ]developed, qualitative, directed ]graph model of the system being analyzed. The ETA Tool accesses system design information captured within the model and the associated testability analysis output to create a series of six reports for various system engineering needs. These reports are highlighted in the presentation. The ETA Tool was developed by NASA to support the verification of fault management requirements early in the Launch Vehicle process. Due to their early development during the design process, the TEAMS ]based diagnostic model and the ETA Tool were able to positively influence the system design by highlighting gaps in failure detection, fault isolation, and failure recovery.

A Web simulation of medical image reconstruction and processing as an educational tool.

PubMed

Papamichail, Dimitrios; Pantelis, Evaggelos; Papagiannis, Panagiotis; Karaiskos, Pantelis; Georgiou, Evangelos

2015-02-01

Web educational resources integrating interactive simulation tools provide students with an in-depth understanding of the medical imaging process. The aim of this work was the development of a purely Web-based, open access, interactive application, as an ancillary learning tool in graduate and postgraduate medical imaging education, including a systematic evaluation of learning effectiveness. The pedagogic content of the educational Web portal was designed to cover the basic concepts of medical imaging reconstruction and processing, through the use of active learning and motivation, including learning simulations that closely resemble actual tomographic imaging systems. The user can implement image reconstruction and processing algorithms under a single user interface and manipulate various factors to understand the impact on image appearance. A questionnaire for pre- and post-training self-assessment was developed and integrated in the online application. The developed Web-based educational application introduces the trainee in the basic concepts of imaging through textual and graphical information and proceeds with a learning-by-doing approach. Trainees are encouraged to participate in a pre- and post-training questionnaire to assess their knowledge gain. An initial feedback from a group of graduate medical students showed that the developed course was considered as effective and well structured. An e-learning application on medical imaging integrating interactive simulation tools was developed and assessed in our institution.

Seismic hazard assessment of Oregon highway truck routes.

DOT National Transportation Integrated Search

2012-06-01

This research project developed a seismic risk assessment model along the major truck routes in Oregon. The study had adopted federally : developed software tools called Risk for Earthquake Damage to Roadway Systems (REDARS2) and HAZUS-MH. The model ...

Linear modeling of human hand-arm dynamics relevant to right-angle torque tool interaction.

PubMed

Ay, Haluk; Sommerich, Carolyn M; Luscher, Anthony F

2013-10-01

A new protocol was evaluated for identification of stiffness, mass, and damping parameters employing a linear model for human hand-arm dynamics relevant to right-angle torque tool use. Powered torque tools are widely used to tighten fasteners in manufacturing industries. While these tools increase accuracy and efficiency of tightening processes, operators are repetitively exposed to impulsive forces, posing risk of upper extremity musculoskeletal injury. A novel testing apparatus was developed that closely mimics biomechanical exposure in torque tool operation. Forty experienced torque tool operators were tested with the apparatus to determine model parameters and validate the protocol for physical capacity assessment. A second-order hand-arm model with parameters extracted in the time domain met model accuracy criterion of 5% for time-to-peak displacement error in 93% of trials (vs. 75% for frequency domain). Average time-to-peak handle displacement and relative peak handle force errors were 0.69 ms and 0.21%, respectively. Model parameters were significantly affected by gender and working posture. Protocol and numerical calculation procedures provide an alternative method for assessing mechanical parameters relevant to right-angle torque tool use. The protocol more closely resembles tool use, and calculation procedures demonstrate better performance of parameter extraction using time domain system identification methods versus frequency domain. Potential future applications include parameter identification for in situ torque tool operation and equipment development for human hand-arm dynamics simulation under impulsive forces that could be used for assessing torque tools based on factors relevant to operator health (handle dynamics and hand-arm reaction force).

The development of the residential Fire H.E.L.P. tool kit: a resource to protect homebound older adults.

PubMed

Diekman, Shane; Huitric, Michele; Netterville, Linda

2010-01-01

This article describes the development of the Fire H.E.L.P. tool kit for training selected Meals On Wheels (MOW) staff in Texas to implement a fire safety program for homebound older adults. We used a formative evaluation approach during the tool kit's development, testing, and initial implementation stages. The tool kit includes instructional curricula on how to implement Fire H.E.L.P., a home assessment tool to determine a residence's smoke alarm needs, and fire safety educational materials. During the tool kit's pilot test, MOW participants showed enhanced fire safety knowledge and high levels of confidence about applying their newfound training skills. After the pilot test, MOW staff used the tool kit to conduct local training sessions, provide fire safety education, and install smoke alarms in the homes of older adults. We believe the approach used to develop this tool kit can be applied to education efforts for other, related healthy home topics.

Development and validation of a Haitian Creole screening instrument for depression

PubMed Central

Rasmussen, Andrew; Eustache, Eddy; Raviola, Giuseppe; Kaiser, Bonnie; Grelotti, David; Belkin, Gary

2014-01-01

Developing mental health care capacity in post-earthquake Haiti is hampered by the lack of assessments that include culturally bound idioms Haitians use when discussing emotional distress. The current study describes a novel emic-etic approach to developing a depression screening for Partners In Health/Zanmi Lasante. In Study 1 Haitian key informants were asked to classify symptoms and describe categories within a pool of symptoms of common mental disorders. Study 2 tested the symptom set that best approximated depression in a sample of depressed and not depressed Haitians in order to select items for the screening tool. The resulting 13-item instrument produced scores with high internal reliability that were sensitive to culturally-informed diagnoses, and interpretations with construct and concurrent validity (vis-à-vis functional impairment). Discussion focuses on the appropriate use of this tool and integrating emic perspectives into developing psychological assessments globally. The screening tool is provided as an Appendix. PMID:25080426

National policy on physical activity: the development of a policy audit tool.

PubMed

Bull, Fiona C; Milton, Karen; Kahlmeier, Sonja

2014-02-01

Physical inactivity is a leading risk factor for noncommunicable disease worldwide. Increasing physical activity requires large scale actions and relevant, supportive national policy across multiple sectors. The policy audit tool (PAT) was developed to provide a standardized instrument to assess national policy approaches to physical activity. A draft tool, based on earlier work, was developed and pilot-tested in 7 countries. After several rounds of revisions, the final PAT comprises 27 items and collects information on 1) government structure, 2) development and content of identified key policies across multiple sectors, 3) the experience of policy implementation at both the national and local level, and 4) a summary of the PAT completion process. PAT provides a standardized instrument for assessing progress of national policy on physical activity. Engaging a diverse international group of countries in the development helped ensure PAT has applicability across a wide range of countries and contexts. Experiences from the development of the PAT suggests that undertaking an audit of health enhancing physical activity (HEPA) policy can stimulate greater awareness of current policy opportunities and gaps, promote critical debate across sectors, and provide a catalyst for collaboration on policy level actions. The final tool is available online.

Measuring antimicrobial prescribing quality in Australian hospitals: development and evaluation of a national antimicrobial prescribing survey tool.

PubMed

James, Rodney; Upjohn, Lydia; Cotta, Menino; Luu, Susan; Marshall, Caroline; Buising, Kirsty; Thursky, Karin

2015-01-01

Antimicrobial stewardship (AMS) programmes have been developed with the intention of reducing inappropriate and unnecessary use of antimicrobials, while improving the quality of patient care and locally helping prevent the development of antimicrobial resistance. An important aspect of AMS programmes is the qualitative assessment of prescribing through antimicrobial prescribing surveys (APS), which are able to provide information about the prescribing behaviour within institutions. Owing to lack of standardization of audit tools and the resources required, qualitative methods for the assessment of antimicrobial use are not often performed. The aim of this study was to design an audit tool that was appropriate for use in all Australian hospitals, suited to local user requirements and included an assessment of the overall appropriateness of the prescription. In November 2011, a pilot APS was conducted across 32 hospitals to assess the usability and generalizability of a newly designed audit tool. Following participant feedback, this tool was revised to reflect the requirements of the respondents. A second pilot study was then performed in November 2012 across 85 hospitals. These surveys identified several areas that can be targets for quality improvement at a national level, including: documentation of indication; surgical prophylaxis prescribed for >24 h; compliance with prescribing guidelines; and the appropriateness of the prescription. By involving the end users in the design and evaluation, we have been able to provide a practical and relevant APS tool for quantitative and qualitative data collection in a wide range of Australian hospital settings. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

EconoMe-Develop - a calculation tool for multi-risk assessment and benefit-cost-analysis

NASA Astrophysics Data System (ADS)

Bründl, M.

2012-04-01

Public money is used to finance the protection of human life, material assets and the environment against natural hazards. This limited resource should be used in a way that it achieves the maximum possible effect by minimizing as many risks as possible. Hence, decision-makers are facing the question which mitigation measures should be prioritised. Benefit-Cost-Analysis (BCA) is a recognized method for determining the economic efficiency of investments in mitigation measures. In Switzerland, the Federal Office for the Environment (FOEN) judges the benefit-cost-ratio of mitigation projects on the base of the results of the calculation tool "EconoMe" [1]. The check of the economic efficiency of mitigation projects with an investment of more than 1 million CHF (800,000 EUR) by using "EconoMe" is mandatory since 2008 in Switzerland. Within "EconoMe", most calculation parameters cannot be changed by the user allowing for comparable results. Based on the risk guideline "RIKO" [2] an extended version of the operational version of "EconoMe", called "EconoMe-Develop" was developed. "EconoMe-Develop" is able to deal with various natural hazard processes and thus allows multi-risk assessments, since all restrictions of the operational version of "EconoMe" like e.g. the number of scenarios and expositions, vulnerability, spatial probability of processes and probability of presence of objects, are not existing. Additionally, the influences of uncertainty of calculation factors, like e.g. vulnerability, on the final results can be determined. "EconoMe-Develop" offers import and export of data, e.g. results of GIS-analysis. The possibility for adapting the tool to user specific requirements makes EconoMe-Develop an easy-to-use tool for risk assessment and assessment of economic efficiency of mitigation projects for risk experts. In the paper we will present the most important features of the tool and we will illustrate the application by a practical example.

A Method for the Design and Development of Medical or Health Care Information Websites to Optimize Search Engine Results Page Rankings on Google

PubMed Central

Cummins, Niamh Maria; Hannigan, Ailish; Shannon, Bill; Dunne, Colum; Cullen, Walter

2013-01-01

Background The Internet is a widely used source of information for patients searching for medical/health care information. While many studies have assessed existing medical/health care information on the Internet, relatively few have examined methods for design and delivery of such websites, particularly those aimed at the general public. Objective This study describes a method of evaluating material for new medical/health care websites, or for assessing those already in existence, which is correlated with higher rankings on Google's Search Engine Results Pages (SERPs). Methods A website quality assessment (WQA) tool was developed using criteria related to the quality of the information to be contained in the website in addition to an assessment of the readability of the text. This was retrospectively applied to assess existing websites that provide information about generic medicines. The reproducibility of the WQA tool and its predictive validity were assessed in this study. Results The WQA tool demonstrated very high reproducibility (intraclass correlation coefficient=0.95) between 2 independent users. A moderate to strong correlation was found between WQA scores and rankings on Google SERPs. Analogous correlations were seen between rankings and readability of websites as determined by Flesch Reading Ease and Flesch-Kincaid Grade Level scores. Conclusions The use of the WQA tool developed in this study is recommended as part of the design phase of a medical or health care information provision website, along with assessment of readability of the material to be used. This may ensure that the website performs better on Google searches. The tool can also be used retrospectively to make improvements to existing websites, thus, potentially enabling better Google search result positions without incurring the costs associated with Search Engine Optimization (SEO) professionals or paid promotion. PMID:23981848

Using GeoRePORT to report socio-economic potential for geothermal development

DOE Office of Scientific and Technical Information (OSTI.GOV)

Young, Katherine R.; Levine, Aaron

The Geothermal Resource Portfolio Optimization and Reporting Tool (GeoRePORT, http://en.openei.org/wiki/GeoRePORT) was developed for reporting resource grades and project readiness levels, providing the U.S. Department of Energy a consistent and comprehensible means of evaluating projects. The tool helps funding organizations (1) quantitatively identify barriers, (2) develop measureable goals, (3) objectively evaluate proposals, including contribution to goals, (4) monitor progress, and (5) report portfolio performance. GeoRePORT assesses three categories: geological, technical, and socio-economic. Here, we describe GeoRePORT, then focus on the socio-economic assessment and its applications for assessing deployment potential in the U.S. Socio-economic attributes include land access, permitting, transmission, and market.

Supporting family caregivers to identify their own needs in end-of-life care: Qualitative findings from a stepped wedge cluster trial.

PubMed

Aoun, Samar; Deas, Kathleen; Toye, Chris; Ewing, Gail; Grande, Gunn; Stajduhar, Kelli

2015-06-01

The Carer Support Needs Assessment Tool encompasses the physical, psychological, social, practical, financial, and spiritual support needs that government policies in many countries emphasize should be assessed and addressed for family caregivers during end-of-life care. To describe the experience of family caregivers of terminally ill people of the Carer Support Needs Assessment Tool intervention in home-based palliative care. This study was conducted during 2012-2014 in Silver Chain Hospice Care Service in Western Australia. This article reports on one part of a three-part evaluation of a stepped wedge cluster trial. All 233 family caregivers receiving the Carer Support Needs Assessment Tool intervention provided feedback on their experiences via brief end-of-trial semi-structured telephone interviews. Data were subjected to a thematic analysis. The overwhelming majority reported finding the Carer Support Needs Assessment Tool assessment process straightforward and easy. Four key themes were identified: (1) the practicality and usefulness of the systematic assessment; (2) emotional responses to caregiver reflection; (3) validation, reassurance, and empowerment; and (4) accessing support and how this was experienced. Family caregivers appreciated the value of the Carer Support Needs Assessment Tool intervention in engaging them in conversations about their needs, priorities, and solutions. The Carer Support Needs Assessment Tool presented a simple, yet potentially effective intervention to help palliative care providers systematically assess and address family caregivers' needs. The Carer Support Needs Assessment Tool provided a formal structure to facilitate discussions with family caregivers to enable needs to be addressed. Such discussions can also inform an evidence base for the ongoing development of services for family caregivers, ensuring that new or improved services are designed to meet the explicit needs of family caregivers. © The Author(s) 2015.

Market Transformation | Hydrogen and Fuel Cells | NREL

Science.gov Websites

deployment sites Develop techno-economic assessment tools, deployment tools, and business cases for various fuel cell applications Collect and evaluate data from deployment projects to verify the business cases