Development and evaluation of RAMP I - a practitioner's tool for screening of musculoskeletal disorder risk factors in manual handling.

PubMed

Lind, Carl Mikael; Forsman, Mikael; Rose, Linda Maria

2017-10-16

RAMP I is a screening tool developed to support practitioners in screening for work-related musculoskeletal disorder risk factors related to manual handling. RAMP I, which is part of the RAMP tool, is based on research-based studies combined with expert group judgments. More than 80 practitioners participated in the development of RAMP I. The tool consists of dichotomous assessment items grouped into seven categories. Acceptable reliability was found for a majority of the assessment items for 15 practitioners who were given 1 h of training. The usability evaluation points to RAMP I being usable for screening for musculoskeletal disorder risk factors, i.e., usable for assessing risks, being usable as a decision base, having clear results and that the time needed for an assessment is acceptable. It is concluded that RAMP I is a usable tool for practitioners.

BASINs and WEPP Climate Assessment Tools (CAT): Case ...

EPA Pesticide Factsheets

EPA announced the release of the final report, BASINs and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications. This report supports application of two recently developed water modeling tools, the Better Assessment Science Integrating point & Non-point Sources (BASINS) and the Water Erosion Prediction Project Climate Assessment Tool (WEPPCAT). The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments of the potential effects of climate change on streamflow and water quality. This report presents a series of short, illustrative case studies using the BASINS and WEPP climate assessment tools.

A mobile phone based tool to identify symptoms of common childhood diseases in Ghana: development and evaluation of the integrated clinical algorithm in a cross-sectional study.

PubMed

Franke, Konstantin H; Krumkamp, Ralf; Mohammed, Aliyu; Sarpong, Nimako; Owusu-Dabo, Ellis; Brinkel, Johanna; Fobil, Julius N; Marinovic, Axel Bonacic; Asihene, Philip; Boots, Mark; May, Jürgen; Kreuels, Benno

2018-03-27

The aim of this study was the development and evaluation of an algorithm-based diagnosis-tool, applicable on mobile phones, to support guardians in providing appropriate care to sick children. The algorithm was developed on the basis of the Integrated Management of Childhood Illness (IMCI) guidelines and evaluated at a hospital in Ghana. Two hundred and thirty-seven guardians applied the tool to assess their child's symptoms. Data recorded by the tool and health records completed by a physician were compared in terms of symptom detection, disease assessment and treatment recommendation. To compare both assessments, Kappa statistics and predictive values were calculated. The tool detected the symptoms of cough, fever, diarrhoea and vomiting with good agreement to the physicians' findings (kappa = 0.64; 0.59; 0.57 and 0.42 respectively). The disease assessment barely coincided with the physicians' findings. The tool's treatment recommendation correlated with the physicians' assessments in 93 out of 237 cases (39.2% agreement, kappa = 0.11), but underestimated a child's condition in only seven cases (3.0%). The algorithm-based tool achieved reliable symptom detection and treatment recommendations were administered conformably to the physicians' assessment. Testing in domestic environment is envisaged.

Proper Exercise and Nutrition kit: use of obesity screening and assessment tools with underserved populations.

PubMed

Kopp, Mary K; Hornberger, Cynthia

2008-02-01

Additional efforts are needed to assist public health, school, and clinic-based pediatric nurses in identifying the prevalence of obesity among Kansas Medicaid-eligible children, 21 years or younger. A Proper Exercise and Nutrition (PEN) tool kit was mailed to 500 public health nurses who performed KAN Be Healthy (KBH) assessments. KBH nurses were provided an expanded training curriculum on growth, nutrition, and obesity along with appropriate screening tools. Nurses were surveyed about their current assessment practices and general knowledge of obese clients. After the PEN tool kit distribution, nurses reported an increased use of screening tools and standardized referral parameters. This program intervention was successful in changing nursing practice, resulting in evidence-based understanding of obesity screening and assessment.

The Influence of an Internet-Based Formative Assessment Tool on Primary Grades Students' Number Sense Achievement

ERIC Educational Resources Information Center

Polly, Drew; Wang, Chuang; Martin, Christie; Lambert, Richard G.; Pugalee, David K.; Middleton, Catharina Win

2017-01-01

This study examined primary grades students' achievement on number sense tasks administered through an Internet-based formative assessment tool, Assessing Math Concepts Anywhere. Data were analyzed from 2,357 students in teachers' classrooms who had participated in a year-long professional development program on mathematics formative assessment,…

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations

PubMed Central

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2016-01-01

Aim To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. Methods The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. Results A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90–0.97) in Brazil and 0.81 (95% confidence interval 0.66–0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. Conclusions These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective perfor mance measures. PMID:24666718

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations.

PubMed

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2014-10-01

To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90-0.97) in Brazil and 0.81 (95% confidence interval 0.66-0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective performance measures. © 2013 Japan Geriatrics Society.

Use of dietary assessment tools in randomized trials evaluating diet-based interventions in pregnancy: a systematic review of literature.

PubMed

Al Wattar, Bassel H; Mylrea-Lowndes, Bronacha; Morgan, Catrin; Moore, Amanda P; Thangaratinam, Shakila

2016-12-01

Accurate assessment of dietary intake in interventional trials is the key to evaluate changes in dietary behaviour and compliance. We evaluated the use of dietary assessment tools in randomized trials on diet-based interventions in pregnancy by a systematic review. We updated our previous search (until January 2012) on trials of diet and lifestyle interventions in pregnancy using Medline and EMBASE up to December 2015. Two independent reviewers undertook study selection and data extraction. We assessed the characteristics of dietary assessment tools, the timing and frequency of use and any validation undertaken.Two-thirds (39/58, 67%) of the included studies used some form of tools to assess dietary intake. Multiple days' food diaries were the most commonly used (23/39, 59%). Three studies (3/39, 8%) validated the used tools in a pregnant population. Three studies (3/39, 8%) prespecified the criteria for adherence to the intervention. The use of dietary assessment tools was not associated with study quality, year of publication, journal impact factor, type of journal and the study sample size. Although self-reporting dietary assessment tools are widely used in interventional dietary trials in pregnancy, the quality and applicability of existing tools are low.

Exposure assessment in health assessments for hand-arm vibration syndrome.

PubMed

Mason, H J; Poole, K; Young, C

2011-08-01

Assessing past cumulative vibration exposure is part of assessing the risk of hand-arm vibration syndrome (HAVS) in workers exposed to hand-arm vibration and invariably forms part of a medical assessment of such workers. To investigate the strength of relationships between the presence and severity of HAVS and different cumulative exposure metrics obtained from a self-reporting questionnaire. Cumulative exposure metrics were constructed from a tool-based questionnaire applied in a group of HAVS referrals and workplace field studies. These metrics included simple years of vibration exposure, cumulative total hours of all tool use and differing combinations of acceleration magnitudes for specific tools and their daily use, including the current frequency-weighting method contained in ISO 5349-1:2001. Use of simple years of exposure is a weak predictor of HAVS or its increasing severity. The calculation of cumulative hours across all vibrating tools used is a more powerful predictor. More complex calculations based on involving likely acceleration data for specific classes of tools, either frequency weighted or not, did not offer a clear further advantage in this dataset. This may be due to the uncertainty associated with workers' recall of their past tool usage or the variability between tools in the magnitude of their vibration emission. Assessing years of exposure or 'latency' in a worker should be replaced by cumulative hours of tool use. This can be readily obtained using a tool-pictogram-based self-reporting questionnaire and a simple spreadsheet calculation.

Development of computer-based analytical tool for assessing physical protection system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mardhi, Alim, E-mail: alim-m@batan.go.id; Chulalongkorn University, Faculty of Engineering, Nuclear Engineering Department, 254 Phayathai Road, Pathumwan, Bangkok Thailand. 10330; Pengvanich, Phongphaeth, E-mail: ppengvan@gmail.com

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work,more » we have developed a computer–based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system’s detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.« less

Development of computer-based analytical tool for assessing physical protection system

NASA Astrophysics Data System (ADS)

Mardhi, Alim; Pengvanich, Phongphaeth

2016-01-01

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work, we have developed a computer-based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system's detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.

[Progress in standard assessment on competency to stand trial of mentally disordered offenders].

PubMed

Chen, Xiao-Bing; Cai, Wei-Xiong

2012-08-01

Competency to stand trial relates directly to legal rights of the appraised individual as well as whether criminal procedure can be carried out smoothly. Foreign scholars have conducted a large number of theoretical researches, and developed a series of standardized evaluation tools. However, the assessment on competency to stand trial has mainly focused on medical criteria in China for a long time, and most cases were judged by forensic psychiatrists' experience. Recently, Chinese scholars have started the initial research on standardized evaluation. This paper reviews the notion of competency to stand trial, the evaluation criteria, and the assessment tools domestically and abroad. The main focus is on foreign assessment tools, which included three categories. First category includes checklist, self-report questionnaires and sentence-completion tasks. Second category is the interview-based instruments without criterion-based scoring. Last category is the interview-based instruments with criterion-based scoring. This literature may be helpful for further research and standardization on assessment tools of competency to stand trial of mentally disordered offenders.

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Pushing and pulling: an assessment tool for occupational health and safety practitioners.

PubMed

Lind, Carl Mikael

2018-03-01

A tool has been developed for supporting practitioners when assessing manual pushing and pulling operations based on an initiative by two global companies in the manufacturing industry. The aim of the tool is to support occupational health and safety practitioners in risk assessment and risk management of pushing and pulling operations in the manufacturing and logistics industries. The tool is based on a nine-multiplier equation that includes a wide range of factors affecting an operator's health risk and capacity in pushing and pulling. These multipliers are based on psychophysical, physiological and biomechanical studies in combination with judgments from an expert group consisting of senior researchers and ergonomists. In order to consider usability, more than 50 occupational health and safety practitioners (e.g., ergonomists, managers, safety representatives and production personnel) participated in the development of the tool. An evaluation by 22 ergonomists supports that the push/pull tool is user friendly in general.

[Tools to assess the impact on health of public health programmes and community interventions from an equity perspective].

PubMed

Suárez Álvarez, Óscar; Fernández-Feito, Ana; Vallina Crespo, Henar; Aldasoro Unamuno, Elena; Cofiño, Rafael

2018-05-11

It is essential to develop a comprehensive approach to institutionally promoted interventions to assess their impact on health from the perspective of the social determinants of health and equity. Simple, adapted tools must be developed to carry out these assessments. The aim of this paper is to present two tools to assess the impact of programmes and community-based interventions on the social determinants of health. The first tool is intended to assess health programmes through interviews and analysis of information provided by the assessment team. The second tool, by means of online assessments of community-based interventions, also enables a report on inequality issues that includes recommendations for improvement. In addition to reducing health-related social inequities, the implementation of these tools can also help to improve the efficiency of public health interventions. Copyright © 2018 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

An Electronic Competency-Based Evaluation Tool for Assessing Humanitarian Competencies in a Simulated Exercise.

PubMed

Evans, Andrea B; Hulme, Jennifer M; Nugus, Peter; Cranmer, Hilarie H; Coutu, Melanie; Johnson, Kirsten

2017-06-01

The evaluation tool was first derived from the formerly Consortium of British Humanitarian Agencies' (CBHA; United Kingdom), now "Start Network's," Core Humanitarian Competency Framework and formatted in an electronic data capture tool that allowed for offline evaluation. During a 3-day humanitarian simulation event, participants in teams of eight to 10 were evaluated individually at multiple injects by trained evaluators. Participants were assessed on five competencies and a global rating scale. Participants evaluated both themselves and their team members using the same tool at the end of the simulation exercise (SimEx). All participants (63) were evaluated. A total of 1,008 individual evaluations were completed. There were 90 (9.0%) missing evaluations. All 63 participants also evaluated themselves and each of their teammates using the same tool. Self-evaluation scores were significantly lower than peer-evaluations, which were significantly lower than evaluators' assessments. Participants with a medical degree, and those with humanitarian work experience of one month or more, scored significantly higher on all competencies assessed by evaluators compared to other participants. Participants with prior humanitarian experience scored higher on competencies regarding operating safely and working effectively as a team member. This study presents a novel electronic evaluation tool to assess individual performance in five of six globally recognized humanitarian competency domains in a 3-day humanitarian SimEx. The evaluation tool provides a standardized approach to the assessment of humanitarian competencies that cannot be evaluated through knowledge-based testing in a classroom setting. When combined with testing knowledge-based competencies, this presents an approach to a comprehensive competency-based assessment that provides an objective measurement of competency with respect to the competencies listed in the Framework. There is an opportunity to advance the use of this tool in future humanitarian training exercises and potentially in real time, in the field. This could impact the efficiency and effectiveness of humanitarian operations. Evans AB , Hulme JM , Nugus P , Cranmer HH , Coutu M , Johnson K . An electronic competency-based evaluation tool for assessing humanitarian competencies in a simulated exercise. Prehosp Disaster Med. 2017;32(3):253-260.

ADDING GLOBAL SOILS DATA TO THE AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT TOOL (AGWA)

EPA Science Inventory

The Automated Geospatial Watershed Assessment Tool (AGWA) is a GIS-based hydrologic modeling tool that is available as an extension for ArcView 3.x from the USDA-ARS Southwest Watershed Research Center (www.tucson.ars.ag.gov/agwa). AGWA is designed to facilitate the assessment of...

Composite Reliability of a Workplace-Based Assessment Toolbox for Postgraduate Medical Education

ERIC Educational Resources Information Center

Moonen-van Loon, J. M. W.; Overeem, K.; Donkers, H. H. L. M.; van der Vleuten, C. P. M.; Driessen, E. W.

2013-01-01

In recent years, postgraduate assessment programmes around the world have embraced workplace-based assessment (WBA) and its related tools. Despite their widespread use, results of studies on the validity and reliability of these tools have been variable. Although in many countries decisions about residents' continuation of training and…

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017. Published by Elsevier B.V.

Competency-Based Training and Simulation: Making a "Valid" Argument.

PubMed

Noureldin, Yasser A; Lee, Jason Y; McDougall, Elspeth M; Sweet, Robert M

2018-02-01

The use of simulation as an assessment tool is much more controversial than is its utility as an educational tool. However, without valid simulation-based assessment tools, the ability to objectively assess technical skill competencies in a competency-based medical education framework will remain challenging. The current literature in urologic simulation-based training and assessment uses a definition and framework of validity that is now outdated. This is probably due to the absence of awareness rather than an absence of comprehension. The following review article provides the urologic community an updated taxonomy on validity theory as it relates to simulation-based training and assessments and translates our simulation literature to date into this framework. While the old taxonomy considered validity as distinct subcategories and focused on the simulator itself, the modern taxonomy, for which we translate the literature evidence, considers validity as a unitary construct with a focus on interpretation of simulator data/scores.

Showing Up Is Half the Battle: Assessing Different Contextualized Learning Tools to Increase the Performance in Introductory Computer Science Courses

ERIC Educational Resources Information Center

Rolka, Christine; Remshagen, Anja

2015-01-01

Contextualized learning is considered beneficial for student success. In this article, we assess the impact of context-based learning tools on student grade performance in an introductory computer science course. In particular, we investigate two central questions: (1) does the use context-based learning tools, robots and animations, affect…

Family history assessment for colorectal cancer (CRC) risk analysis - comparison of diagram- and questionnaire-based web interfaces.

PubMed

Schultz, Michael; Seo, Steven Bohwan; Holt, Alec; Regenbrecht, Holger

2015-11-18

Colorectal cancer (CRC) has a high incidence, especially in New Zealand. The reasons for this are unknown. While most cancers develop sporadically, a positive family history, determined by the number and age at diagnosis of affected first and second degree relatives with CRC is one of the major factors, which may increase an individual's lifetime risk. Before a patient can be enrolled in a surveillance program a detailed assessment and documentation of the family history is important but time consuming and often inaccurate. The documentation is usually paper-based. Our aim was therefore to develop and validate the usability and efficacy of a web-based family history assessment tool for CRC suitable for the general population. The tool was also to calculate the risk and make a recommendation for surveillance. Two versions of an electronic assessment tool, diagram-based and questionnaire-based, were developed with the risk analysis and recommendations for surveillance based on the New Zealand Guidelines Group recommendations. Accuracy of our tool was tested prior to the study by comparing risk calculations based on family history by experienced gastroenterologists with the electronic assessment. The general public, visiting a local science fair were asked to use and comment on the usability of the two interfaces. Ninety people assessed and commented on the two interfaces. Both interfaces were effective in assessing the risk to develop CRC through their familial history for CRC. However, the questionnaire-based interface performed with significantly better satisfaction (p = 0.001) than the diagram-based interface. There was no difference in efficacy though. We conclude that a web-based questionnaire tool can assist in the accurate documentation and analysis of the family history relevant to determine the individual risk of CRC based on local guidelines. The calculator is now implemented and assessable through the web-page of a local charity for colorectal cancer awareness and integral part of the local general practitioners' e-referral system for colonic imaging.

A web-based rapid assessment tool for production publishing solutions

NASA Astrophysics Data System (ADS)

Sun, Tong

2010-02-01

Solution assessment is a critical first-step in understanding and measuring the business process efficiency enabled by an integrated solution package. However, assessing the effectiveness of any solution is usually a very expensive and timeconsuming task which involves lots of domain knowledge, collecting and understanding the specific customer operational context, defining validation scenarios and estimating the expected performance and operational cost. This paper presents an intelligent web-based tool that can rapidly assess any given solution package for production publishing workflows via a simulation engine and create a report for various estimated performance metrics (e.g. throughput, turnaround time, resource utilization) and operational cost. By integrating the digital publishing workflow ontology and an activity based costing model with a Petri-net based workflow simulation engine, this web-based tool allows users to quickly evaluate any potential digital publishing solutions side-by-side within their desired operational contexts, and provides a low-cost and rapid assessment for organizations before committing any purchase. This tool also benefits the solution providers to shorten the sales cycles, establishing a trustworthy customer relationship and supplement the professional assessment services with a proven quantitative simulation and estimation technology.

The SAFE-T assessment tool: derivation and validation of a web-based application for point-of-care evaluation of gastroenterology fellow performance in colonoscopy.

PubMed

Kumar, Navin L; Kugener, Guillaume; Perencevich, Molly L; Saltzman, John R

2018-01-01

Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise assessment tool to evaluate real-time fellow performance in colonoscopy administered via a web-based application. The Skill Assessment in Fellow Endoscopy Training (SAFE-T) tool was derived as a novel 5-question evaluation tool that captures both summative and formative feedback adapted into a web-based application. A prospective study of 15 gastroenterology fellows (5 fellows each from years 1 to 3 of training) was performed using the SAFE-T tool. An independent reviewer evaluated a subset of these procedures and completed the SAFE-T tool and Mayo Colonoscopy Skills Assessment Tool (MCSAT) for reliability testing. Twenty-six faculty completed 350 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score (year 1, 2.00; year 2, 3.84; year 3, 4.28) differentiated each sequential fellow year of training (P < .0001). The mean SAFE-T overall score decreased with increasing case complexity score, with straightforward cases compared with average cases (4.07 vs 3.50, P < .0001), and average cases compared with challenging cases (3.50 vs 3.08, P = .0134). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a kappa agreement statistic of 0.898 (P < .0001). Correlation of the SAFE-T overall score with the MCSAT overall hands-on and individual motor scores was excellent (each r > 0.90, P < .0001). We developed and validated the SAFE-T assessment tool, a concise and web-based means of assessing real-time gastroenterology fellow performance in colonoscopy. Copyright © 2018 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.

Exposure Assessment Tools by Approaches - Exposure Reconstruction (Biomonitoring and Reverse Dosimetry)

EPA Pesticide Factsheets

This page provides access to a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases,

Evaluating a standardised clinical assessment tool for pre-registration midwifery students: A cross-sectional survey of midwifery students and midwives in Australia.

PubMed

Morrow, Jane; Biggs, Laura; Stelfox, Sara; Phillips, Diane; McKellar, Lois; McLachlan, Helen

2016-02-01

Assessment of clinical competence is a core component of midwifery education. Clinical assessment tools have been developed to help increase consistency and overcome subjectivity of assessment. The study had two main aims. The first was to explore midwifery students and educators/clinical midwives' views and experiences of a common clinical assessment tool used for all preregistration midwifery programmes in Victoria and the University of South Australia. The second was to assess the need for changes to the tool to align with developments in clinical practice and evidence-based care. A cross-sectional, web-based survey including Likert-type scales and open-ended questions was utilised. Students enrolled in all four entry pathways to midwifery at seven Victorian and one South Australian university and educators/clinical midwives across both states. One hundred and ninety-one midwifery students' and 86 educators/clinical midwives responded. Overall, students and educators/clinical midwives were positive about the Clinical Assessment Tool with over 90% reporting that it covered the necessary midwifery skills. Students and educators/clinical midwives reported high levels of satisfaction with the content of the learning tools. Only 4% of educators/clinical midwives and 6% of students rated the Clinical Assessment Tool as poor overall. Changes to some learning tools were necessary in order to reflect recent practice and evidence. A common clinical assessment tool for evaluating midwifery students' clinical practice may facilitate the provision of consistent, reliable and objective assessment of student skills and competency. Copyright © 2015 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

An Integrated Web-Based Assessment Tool for Assessing Pesticide Exposure and Risks

EPA Science Inventory

Background/Question/Methods We have created an integrated web-based tool designed to estimate exposure doses and ecological risks under the Federal Insecticide, Fungicide, and Rodenticide Act (FIFRA) and the Endangered Species Act. This involved combining a number of disparat...

Exposure Assessment Tools by Tiers and Types - Deterministic and Probabilistic Assessments

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Making the Connection: Technological Literacy and Technology Assessment.

ERIC Educational Resources Information Center

Deal, Walter F.

2002-01-01

Technology assessment is the process of identifying, analyzing, and evaluating potential consequences of technology. Tools for assessing and forecasting impact include relevance trees and futures wheels. Activities based on these tools can be used to teach assessment to technology education students. (SK)

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology.

PubMed

Melchiors, Jacob; Henriksen, Mikael Johannes Vuokko; Dikkers, Frederik G; Gavilán, Javier; Noordzij, J Pieter; Fried, Marvin P; Novakovic, Daniel; Fagan, Johannes; Charabi, Birgitte W; Konge, Lars; von Buchwald, Christian

2018-05-01

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. FIFTY PANELISTS COMPLETED THE DELPHI PROCESS. THE MEDIAN AGE OF THE PANELISTS WAS 44 YEARS (RANGE 33-64 YEARS). MEDIAN EXPERIENCE IN OTORHINOLARYNGOLOGY WAS 15 YEARS (RANGE 6-35 YEARS). TWENTY-FIVE WERE SPECIALIZED IN LARYNGOLOGY, 16 WERE HEAD AND NECK SURGEONS, AND NINE WERE GENERAL OTORHINOLARYNGOLOGISTS. AN ASSESSMENT TOOL WAS CREATED CONSISTING OF TWELVE DISTINCT ITEMS.: Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.

Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

PubMed

Cagiltay, Nergiz Ercil; Ozcelik, Erol; Sengul, Gokhan; Berker, Mustafa

2017-11-01

In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is critical for better designing and developing skill assessment surgical simulation tools.

Exposure Assessment Tools by Media - Air

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes - Inhalation

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Chemical Classes

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Food

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes - Ingestion

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Approaches

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes - Dermal

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Developing an Intelligent Diagnosis and Assessment E-Learning Tool for Introductory Programming

ERIC Educational Resources Information Center

Huang, Chenn-Jung; Chen, Chun-Hua; Luo, Yun-Cheng; Chen, Hong-Xin; Chuang, Yi-Ta

2008-01-01

Recently, a lot of open source e-learning platforms have been offered for free in the Internet. We thus incorporate the intelligent diagnosis and assessment tool into an open software e-learning platform developed for programming language courses, wherein the proposed learning diagnosis assessment tools based on text mining and machine learning…

Assessing the Effect of Web-Based Learning Tools on Student Understanding of Stoichiometry Using Knowledge Space Theory

ERIC Educational Resources Information Center

Arasasingham, Ramesh D.; Taagepera, Mare; Potter, Frank; Martorell, Ingrid; Lonjers, Stacy

2005-01-01

Student achievement in web-based learning tools is assessed by using in-class examination, pretests, and posttests. The study reveals that using mastering chemistry web software in large-scale instruction provides an overall benefit to introductory chemistry students.

Toolbox of assessment tools of technical skills in otolaryngology-head and neck surgery: A systematic review.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2017-10-08

To support the development of programs of assessment of technical skills in the operating room (OR), we systematically reviewed the literature to identify assessment tools specific to otolaryngology-head and neck surgery (OTL-HNS) core procedures and summarized their characteristics. We systematically searched Embase, MEDLINE, PubMed, and Cochrane to identify and report on assessment tools that can be used to assess residents' technical surgical skills in the operating room for OTL-HNS core procedures. Of the 736 unique titles retrieved, 16 articles met inclusion criteria, covering 11 different procedures (in otology, rhinology, laryngology, head and neck, and general otolaryngology). The tools were composed of a task-specific checklist and/or global rating scale and were developed in the OR, on human cadavers, or in a simulation setting. Our study reports on published tools for assessing technical skills for OTL-HNS residents during core procedures conducted in the OR. These assessment tools could facilitate the provision of timely feedback to trainees including specific goals for improvement. However, the paucity of publications suggests little agreement on how to best perform work-based direct-observation assessment for core surgical procedures in OTL-HNS. The sparsity of tools specific to OTL-HNS may become a barrier to a fluid transition to competency-based medical education. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Assessing Children for the Presence of a Disability. Resources You Can Use. NICHCY Bibliography. 2nd Edition.

ERIC Educational Resources Information Center

Gutierrez, Mary Kate, Comp.

This resource list is intended to provide school systems with information on assessment of school-aged children for the presence of a disability. The 104 references are broken down into the following categories: general assessment information; assessment tools; critiques of assessment tools; curriculum-based assessment; assessments of different…

Exposure Assessment Tools by Chemical Classes - Nanomaterials

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Chemical Classes - Other Organics

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Lifestages and Populations - Lifestages

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Lifestages and Populations

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Consumer Products

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Water and Sediment

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Tiers and Types

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Soil and Dust

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Chemical Classes - Pesticides

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Aquatic Biota

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Soil and Dust

EPA Pesticide Factsheets

2017-02-13

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Chemical Classes - Other ...

EPA Pesticide Factsheets

2017-02-13

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Operation Reliability Assessment for Cutting Tools by Applying a Proportional Covariate Model to Condition Monitoring Information

PubMed Central

Cai, Gaigai; Chen, Xuefeng; Li, Bing; Chen, Baojia; He, Zhengjia

2012-01-01

The reliability of cutting tools is critical to machining precision and production efficiency. The conventional statistic-based reliability assessment method aims at providing a general and overall estimation of reliability for a large population of identical units under given and fixed conditions. However, it has limited effectiveness in depicting the operational characteristics of a cutting tool. To overcome this limitation, this paper proposes an approach to assess the operation reliability of cutting tools. A proportional covariate model is introduced to construct the relationship between operation reliability and condition monitoring information. The wavelet packet transform and an improved distance evaluation technique are used to extract sensitive features from vibration signals, and a covariate function is constructed based on the proportional covariate model. Ultimately, the failure rate function of the cutting tool being assessed is calculated using the baseline covariate function obtained from a small sample of historical data. Experimental results and a comparative study show that the proposed method is effective for assessing the operation reliability of cutting tools. PMID:23201980

Development and testing of a prototype tool for integrated assessment of chemical status in marine environments.

PubMed

Andersen, Jesper H; Murray, Ciarán; Larsen, Martin M; Green, Norman; Høgåsen, Tore; Dahlgren, Elin; Garnaga-Budrė, Galina; Gustavson, Kim; Haarich, Michael; Kallenbach, Emilie M F; Mannio, Jaakko; Strand, Jakob; Korpinen, Samuli

2016-02-01

We report the development and application of a prototype tool for integrated assessment of chemical status in aquatic environments based on substance- and matrix-specific environmental assessment criteria (thresholds). The Chemical Status Assessment Tool (CHASE) integrates data on hazardous substances in water, sediments and biota as well as bio-effect indicators and is based on a substance- or bio-effect-specific calculation of a 'contamination ratio' being the ratio between an observed concentration and a threshold value. Values <1.0 indicate areas potentially 'unaffected', while values >1.0 indicate areas potentially 'affected'. These ratios are combined within matrices, i.e. for water, sediment and biota and for biological effects. The overall assessment used a 'one out, all out principle' with regard to each matrix. The CHASE tool was tested in the Baltic Sea and the North Sea in 376 assessment units. In the former, the chemical status was >1.0 in practically all areas indicating that all areas assessed were potentially affected. The North Sea included areas classified as unaffected or affected. The CHASE tool can in combination with temporal trend assessments of individual substances be advantageous for use in remedial action plans and, in particular, for the science-based evaluation of the status and for determining which specific substances are responsible for a status as potentially affected.

Teaching Students How to Integrate and Assess Social Networking Tools in Marketing Communications

ERIC Educational Resources Information Center

Schlee, Regina Pefanis; Harich, Katrin R.

2013-01-01

This research is based on two studies that focus on teaching students how to integrate and assess social networking tools in marketing communications. Study 1 examines how students in marketing classes utilize social networking tools and explores their attitudes regarding the use of such tools for marketing communications. Study 2 focuses on an…

Going DEEP: guidelines for building simulation-based team assessments.

PubMed

Grand, James A; Pearce, Marina; Rench, Tara A; Chao, Georgia T; Fernandez, Rosemarie; Kozlowski, Steve W J

2013-05-01

Whether for team training, research or evaluation, making effective use of simulation-based technologies requires robust, reliable and accurate assessment tools. Extant literature on simulation-based assessment practices has primarily focused on scenario and instructional design; however, relatively little direct guidance has been provided regarding the challenging decisions and fundamental principles related to assessment development and implementation. The objective of this manuscript is to introduce a generalisable assessment framework supplemented by specific guidance on how to construct and ensure valid and reliable simulation-based team assessment tools. The recommendations reflect best practices in assessment and are designed to empower healthcare educators, professionals and researchers with the knowledge to design and employ valid and reliable simulation-based team assessments. Information and actionable recommendations associated with creating assessments of team processes (non-technical 'teamwork' activities) and performance (demonstration of technical proficiency) are presented which provide direct guidance on how to Distinguish the underlying competencies one aims to assess, Elaborate the measures used to capture team member behaviours during simulation activities, Establish the content validity of these measures and Proceduralise the measurement tools in a way that is systematically aligned with the goals of the simulation activity while maintaining methodological rigour (DEEP). The DEEP framework targets fundamental principles and critical activities that are important for effective assessment, and should benefit healthcare educators, professionals and researchers seeking to design or enhance any simulation-based assessment effort.

An exploration of inter-organisational partnership assessment tools in the context of Australian Aboriginal-mainstream partnerships: a scoping review of the literature.

PubMed

Tsou, Christina; Haynes, Emma; Warner, Wayne D; Gray, Gordon; Thompson, Sandra C

2015-04-23

The need for better partnerships between Aboriginal organisations and mainstream agencies demands attention on process and relational elements of these partnerships, and improving partnership functioning through transformative or iterative evaluation procedures. This paper presents the findings of a literature review which examines the usefulness of existing partnership tools to the Australian Aboriginal-mainstream partnership (AMP) context. Three sets of best practice principles for successful AMP were selected based on authors' knowledge and experience. Items in each set of principles were separated into process and relational elements and used to guide the analysis of partnership assessment tools. The review and analysis of partnership assessment tools were conducted in three distinct but related parts. Part 1- identify and select reviews of partnership tools; part 2 - identify and select partnership self-assessment tool; part 3 - analysis of selected tools using AMP principles. The focus on relational and process elements in the partnership tools reviewed is consistent with the focus of Australian AMP principles by reconciliation advocates; however, historical context, lived experience, cultural context and approaches of Australian Aboriginal people represent key deficiencies in the tools reviewed. The overall assessment indicated that the New York Partnership Self-Assessment Tool and the VicHealth Partnership Analysis Tools reflect the greatest number of AMP principles followed by the Nuffield Partnership Assessment Tool. The New York PSAT has the strongest alignment with the relational elements while VicHealth and Nuffield tools showed greatest alignment with the process elements in the chosen AMP principles. Partnership tools offer opportunities for providing evidence based support to partnership development. The multiplicity of tools in existence and the reported uniqueness of each partnership, mean the development of a generic partnership analysis for AMP may not be a viable option for future effort.

[Development of HIV infection risk assessment tool for men who have sex with men based on Delphi method].

PubMed

Li, L L; Jiang, Z; Song, W L; Ding, Y Y; Xu, J; He, N

2017-10-10

Objective: To develop a HIV infection risk assessment tool for men who have sex with men (MSM) based on Delphi method. Methods: After an exhaustive literature review, we used Delphi method to determine the specific items and relative risk scores of the assessment tool through two rounds of specialist consultation and overall consideration of the opinions and suggestions of 17 specialists. Results: The positivity coefficient through first and second round specialist consultation was 100.0 % and 94.1 % , respectively. The mean of authority coefficients ( Cr ) was 0.86. Kendall's W coefficient of the specialist consultation was 0.55 for the first round consultation (χ(2)=84.426, P <0.001) and 0.46 for the second round consultation (χ(2)=65.734, P <0.001), respectively, suggesting that the specialists had similar opinions. The final HIV infection risk assessment tool for MSM has 8 items. Conclusions: The HIV infection risk assessment tool for MSM, developed under the Delphi method, can be used in the evaluation of HIV infection risk in MSM and individualized prevention and intervention. However, the reliability and validity of this risk assessment tool need to be further evaluated.

A literature review of the cardiovascular risk-assessment tools: applicability among Asian population.

PubMed

Liau, Siow Yen; Mohamed Izham, M I; Hassali, M A; Shafie, A A

2010-01-01

Cardiovascular diseases, the main causes of hospitalisations and death globally, have put an enormous economic burden on the healthcare system. Several risk factors are associated with the occurrence of cardiovascular events. At the heart of efficient prevention of cardiovascular disease is the concept of risk assessment. This paper aims to review the available cardiovascular risk-assessment tools and its applicability in predicting cardiovascular risk among Asian populations. A systematic search was performed using keywords as MeSH and Boolean terms. A total of 25 risk-assessment tools were identified. Of these, only two risk-assessment tools (8%) were derived from an Asian population. These risk-assessment tools differ in various ways, including characteristics of the derivation sample, type of study, time frame of follow-up, end points, statistical analysis and risk factors included. Very few cardiovascular risk-assessment tools were developed in Asian populations. In order to accurately predict the cardiovascular risk of our population, there is a need to develop a risk-assessment tool based on local epidemiological data.

New approaches in assessing food intake in epidemiology.

PubMed

Conrad, Johanna; Koch, Stefanie A J; Nöthlings, Ute

2018-06-22

A promising direction for improving dietary intake measurement in epidemiologic studies is the combination of short-term and long-term dietary assessment methods using statistical methods. Thereby, web-based instruments are particularly interesting as their application offers several potential advantages such as self-administration and a shorter completion time. The objective of this review is to provide an overview of new web-based short-term instruments and to describe their features. A number of web-based short-term dietary assessment tools for application in different countries and age-groups have been developed so far. Particular attention should be paid to the underlying database and the search function of the tool. Moreover, web-based instruments can improve the estimation of portion sizes by offering several options to the user. Web-based dietary assessment methods are associated with lower costs and reduced burden for participants and researchers, and show a comparable validity with traditional instruments. When there is a need for a web-based tool researcher should consider the adaptation of existing tools rather than developing new instruments. The combination of short-term and long-term instruments seems more feasible with the use of new technology.

Different type 2 diabetes risk assessments predict dissimilar numbers at ‘high risk’: a retrospective analysis of diabetes risk-assessment tools

PubMed Central

Gray, Benjamin J; Bracken, Richard M; Turner, Daniel; Morgan, Kerry; Thomas, Michael; Williams, Sally P; Williams, Meurig; Rice, Sam; Stephens, Jeffrey W

2015-01-01

Background Use of a validated risk-assessment tool to identify individuals at high risk of developing type 2 diabetes is currently recommended. It is under-reported, however, whether a different risk tool alters the predicted risk of an individual. Aim This study explored any differences between commonly used validated risk-assessment tools for type 2 diabetes. Design and setting Cross-sectional analysis of individuals who participated in a workplace-based risk assessment in Carmarthenshire, South Wales. Method Retrospective analysis of 676 individuals (389 females and 287 males) who participated in a workplace-based diabetes risk-assessment initiative. Ten-year risk of type 2 diabetes was predicted using the validated QDiabetes®, Leicester Risk Assessment (LRA), FINDRISC, and Cambridge Risk Score (CRS) algorithms. Results Differences between the risk-assessment tools were apparent following retrospective analysis of individuals. CRS categorised the highest proportion (13.6%) of individuals at ‘high risk’ followed by FINDRISC (6.6%), QDiabetes (6.1%), and, finally, the LRA was the most conservative risk tool (3.1%). Following further analysis by sex, over one-quarter of males were categorised at high risk using CRS (25.4%), whereas a greater percentage of females were categorised as high risk using FINDRISC (7.8%). Conclusion The adoption of a different valid risk-assessment tool can alter the predicted risk of an individual and caution should be used to identify those individuals who really are at high risk of type 2 diabetes. PMID:26541180

Different type 2 diabetes risk assessments predict dissimilar numbers at 'high risk': a retrospective analysis of diabetes risk-assessment tools.

PubMed

Gray, Benjamin J; Bracken, Richard M; Turner, Daniel; Morgan, Kerry; Thomas, Michael; Williams, Sally P; Williams, Meurig; Rice, Sam; Stephens, Jeffrey W

2015-12-01

Use of a validated risk-assessment tool to identify individuals at high risk of developing type 2 diabetes is currently recommended. It is under-reported, however, whether a different risk tool alters the predicted risk of an individual. This study explored any differences between commonly used validated risk-assessment tools for type 2 diabetes. Cross-sectional analysis of individuals who participated in a workplace-based risk assessment in Carmarthenshire, South Wales. Retrospective analysis of 676 individuals (389 females and 287 males) who participated in a workplace-based diabetes risk-assessment initiative. Ten-year risk of type 2 diabetes was predicted using the validated QDiabetes(®), Leicester Risk Assessment (LRA), FINDRISC, and Cambridge Risk Score (CRS) algorithms. Differences between the risk-assessment tools were apparent following retrospective analysis of individuals. CRS categorised the highest proportion (13.6%) of individuals at 'high risk' followed by FINDRISC (6.6%), QDiabetes (6.1%), and, finally, the LRA was the most conservative risk tool (3.1%). Following further analysis by sex, over one-quarter of males were categorised at high risk using CRS (25.4%), whereas a greater percentage of females were categorised as high risk using FINDRISC (7.8%). The adoption of a different valid risk-assessment tool can alter the predicted risk of an individual and caution should be used to identify those individuals who really are at high risk of type 2 diabetes. © British Journal of General Practice 2015.

Exposure Assessment Tools by Approaches - Indirect Estimation (Scenario Evaluation)

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases, mode

Exposure Assessment Tools by Lifestages and Populations - General Population

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Lifestages and Populations - Occupational Workers

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Lifestages and Populations - Residential Consumers

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Tiers and Types - Aggregate and Cumulative

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Chemical Classes - Inorganics and Fibers

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Validity evidence as a key marker of quality of technical skill assessment in OTL-HNS.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2018-01-13

Quality monitoring of assessment practices should be a priority in all residency programs. Validity evidence is one of the main hallmarks of assessment quality and should be collected to support the interpretation and use of assessment data. Our objective was to identify, synthesize, and present the validity evidence reported supporting different technical skill assessment tools in otolaryngology-head and neck surgery (OTL-HNS). We performed a secondary analysis of data generated through a systematic review of all published tools for assessing technical skills in OTL-HNS (n = 16). For each tool, we coded validity evidence according to the five types of evidence described by the American Educational Research Association's interpretation of Messick's validity framework. Descriptive statistical analyses were conducted. All 16 tools included in our analysis were supported by internal structure and relationship to variables validity evidence. Eleven articles presented evidence supporting content. Response process was discussed only in one article, and no study reported on evidence exploring consequences. We present the validity evidence reported for 16 rater-based tools that could be used for work-based assessment of OTL-HNS residents in the operating room. The articles included in our review were consistently deficient in evidence for response process and consequences. Rater-based assessment tools that support high-stakes decisions that impact the learner and programs should include several sources of validity evidence. Thus, use of any assessment should be done with careful consideration of the context-specific validity evidence supporting score interpretation, and we encourage deliberate continual assessment quality-monitoring. NA. Laryngoscope, 2018. © 2018 The American Laryngological, Rhinological and Otological Society, Inc.

Comparison of Dental Students' Self-Directed, Faculty, and Software-Based Assessments of Dental Anatomy Wax-Ups: A Retrospective Study.

PubMed

Garrett, Pauline H; Faraone, Karen L; Patzelt, Sebastian B M; Keaser, Michael L

2015-12-01

Little is known about self-directed and self-reflective assessment in preclinical dental curricula. The aim of this study was to evaluate a visual dental anatomy teaching tool to train dental students to self-assess their dental anatomy wax carving practical examinations. The students self-assessed two waxing practical examinations (tooth #8 and tooth #19) using high-quality digital images in an assessment tool incorporated into a digital testing program. Student self-assessments were compared to the faculty evaluations and the results of a software-based evaluation tool (E4D Compare). Out of a total 130 first-year dental students at one U.S. dental school, wax-ups from 57 participants were available for this study. The assessment data were submitted to statistical analyses (p<0.05). For tooth #8, the student self-assessments were significantly different from the faculty and software assessments at a 400 micrometer level of tolerance (p=0.036), whereas the faculty assessment was not significantly different from the software assessment at a 300 micrometer level of tolerance (p=0.69). The evaluation of tooth #19 resulted in no significant differences between faculty members (p=0.94) or students (p=0.21) and the software at a level of tolerance of 400 micrometers. This study indicates that students can learn to self-assess their work using self-reflection in conjunction with faculty guidance and that it may be possible to use software-based evaluation tools to assist in faculty calibration and as objective grading tools.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Design of capability measurement instruments pedagogic content knowledge (PCK) for prospective mathematics teachers

NASA Astrophysics Data System (ADS)

Aminah, N.; Wahyuni, I.

2018-05-01

The purpose of this study is to find out how the process of designing a tool of measurement Pedagogical Content Knowledge (PCK) capabilities, especially for prospective mathematics teachers are valid and practical. The design study of this measurement appliance uses modified Plomp development step, which consists of (1) initial assessment stage, (2) design stage at this stage, the researcher designs the measuring grille of PCK capability, (3) realization stage that is making measurement tool ability of PCK, (4) test phase, evaluation, and revision that is testing validation of measurement tools conducted by experts. Based on the results obtained that the design of PCK capability measurement tool is valid as indicated by the assessment of expert validator, and the design of PCK capability measurement tool, shown based on the assessment of teachers and lecturers as users of states strongly agree the design of PCK measurement tools can be used.

The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource

Exposure Assessment Tools by Tiers and Types - Screening-Level and Refined

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Approaches - Direct Measurement (Point-of-Contact Measurement)

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases, mode

Free and Easy to Use Web Based Presentation and Classroom Tools

ERIC Educational Resources Information Center

Jensen, Jennifer; Tunon, Johanna

2012-01-01

A number of free Web-based tools are available for distance librarians to create presentations and online assignments. The relative merits of presentation tools like Dabbleboard, Jing, Prezi, Tildee, 280 Slides, and Glogster, and classroom tools like Make Beliefs Comix, Picviewer, Photopeach, and Wordle are assessed for ease of use by distance…

ConMap: Investigating New Computer-Based Approaches to Assessing Conceptual Knowledge Structure in Physics.

ERIC Educational Resources Information Center

Beatty, Ian D.

There is a growing consensus among educational researchers that traditional problem-based assessments are not effective tools for diagnosing a student's knowledge state and for guiding pedagogical intervention, and that new tools grounded in the results of cognitive science research are needed. The ConMap ("Conceptual Mapping") project, described…

Identifying high quality medical education websites in Otolaryngology: a guide for medical students and residents.

PubMed

Yang, Nathan; Hosseini, Sarah; Mascarella, Marco A; Young, Meredith; Posel, Nancy; Fung, Kevin; Nguyen, Lily H P

2017-05-25

Learners often utilize online resources to supplement formalized curricula, and to appropriately support learning, these resources should be of high quality. Thus, the objectives of this study are to develop and provide validity evidence supporting an assessment tool designed to assess the quality of educational websites in Otolaryngology- Head & Neck Surgery (ORL-HNS), and identify those that could support effective web-based learning. METHODS: After a literature review, the Modified Education in Otolaryngology Website (MEOW) assessment tool was designed by a panel of experts based on a previously validated website assessment tool. A search strategy using a Google-based search engine was used subsequently to identify websites. Those that were free of charge and in English were included. Websites were coded for whether their content targeted medical students or residents. Using the MEOW assessment tool, two independent raters scored the websites. Inter-rater and intra-rater reliability were evaluated, and scores were compared to recommendations from a content expert. The MEOW assessment tool included a total of 20 items divided in 8 categories related to authorship, frequency of revision, content accuracy, interactivity, visual presentation, navigability, speed and recommended hyperlinks. A total of 43 out of 334 websites identified by the search met inclusion criteria. The scores generated by our tool appeared to differentiate higher quality websites from lower quality ones: websites that the expert "would recommend" scored 38.4 (out of 56; CI [34.4-42.4]) and "would not recommend" 27.0 (CI [23.2-30.9]). Inter-rater and intra-rater intraclass correlation coefficient were greater than 0.7. Using the MEOW assessment tool, high quality ORL-HNS educational websites were identified.

Role-playing simulation as an educational tool for health care personnel: developing an embedded assessment framework.

PubMed

Libin, Alexander; Lauderdale, Manon; Millo, Yuri; Shamloo, Christine; Spencer, Rachel; Green, Brad; Donnellan, Joyce; Wellesley, Christine; Groah, Suzanne

2010-04-01

Simulation- and video game-based role-playing techniques have been proven effective in changing behavior and enhancing positive decision making in a variety of professional settings, including education, the military, and health care. Although the need for developing assessment frameworks for learning outcomes has been clearly defined, there is a significant gap between the variety of existing multimedia-based instruction and technology-mediated learning systems and the number of reliable assessment algorithms. This study, based on a mixed methodology research design, aims to develop an embedded assessment algorithm, a Knowledge Assessment Module (NOTE), to capture both user interaction with the educational tool and knowledge gained from the training. The study is regarded as the first step in developing an assessment framework for a multimedia educational tool for health care professionals, Anatomy of Care (AOC), that utilizes Virtual Experience Immersive Learning Simulation (VEILS) technology. Ninety health care personnel of various backgrounds took part in online AOC training, choosing from five possible scenarios presenting difficult situations of everyday care. The results suggest that although the simulation-based training tool demonstrated partial effectiveness in improving learners' decision-making capacity, a differential learner-oriented approach might be more effective and capable of synchronizing educational efforts with identifiable relevant individual factors such as sociobehavioral profile and professional background.

A GIS-based approach for the screening assessment of noise and vibration impacts from transit projects.

PubMed

Hamed, Maged; Effat, Waleed

2007-08-01

Urban transportation projects are essential in increasing the efficiency of moving people and goods within a city, and between cities. Environmental impacts from such projects must be evaluated and mitigated, as applicable. Spatial modeling is a valuable tool for quantifying the potential level of environmental consequences within the context of an environmental impact assessment (EIA) study. This paper presents a GIS-based tool for the assessment of airborne-noise and ground-borne vibration from public transit systems, and its application to an actual project. The tool is based on the US Federal Transit Administration's (FTA) approach, and incorporates spatial information, satellite imaging, geostatistical modeling, and software programming. The tool is applied on a case study of initial environmental evaluation of a light rail transit project in an urban city in the Middle East, to evaluate alternative layouts. The tool readily allowed the alternative evaluation and the results were used as input to a multi-criteria analytic framework.

Exposure Assessment Tools by Lifestages and Populations - Highly Exposed or Other Susceptible Population Groups

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

The validity of a professional competence tool for physiotherapy students in simulation-based clinical education: a Rasch analysis.

PubMed

Judd, Belinda K; Scanlan, Justin N; Alison, Jennifer A; Waters, Donna; Gordon, Christopher J

2016-08-05

Despite the recent widespread adoption of simulation in clinical education in physiotherapy, there is a lack of validated tools for assessment in this setting. The Assessment of Physiotherapy Practice (APP) is a comprehensive tool used in clinical placement settings in Australia to measure professional competence of physiotherapy students. The aim of the study was to evaluate the validity of the APP for student assessment in simulation settings. A total of 1260 APPs were collected, 971 from students in simulation and 289 from students in clinical placements. Rasch analysis was used to examine the construct validity of the APP tool in three different simulation assessment formats: longitudinal assessment over 1 week of simulation; longitudinal assessment over 2 weeks; and a short-form (25 min) assessment of a single simulation scenario. Comparison with APPs from 5 week clinical placements in hospital and clinic-based settings were also conducted. The APP demonstrated acceptable fit to the expectations of the Rasch model for the 1 and 2 week clinical simulations, exhibiting unidimensional properties that were able to distinguish different levels of student performance. For the short-form simulation, nine of the 20 items recorded greater than 25 % of scores as 'not-assessed' by clinical educators which impacted on the suitability of the APP tool in this simulation format. The APP was a valid assessment tool when used in longitudinal simulation formats. A revised APP may be required for assessment in short-form simulation scenarios.

Reliable and valid assessment of Lichtenstein hernia repair skills.

PubMed

Carlsen, C G; Lindorff-Larsen, K; Funch-Jensen, P; Lund, L; Charles, P; Konge, L

2014-08-01

Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. The internal consistency of the items was high (Cronbach's alpha = 0.97). The inter-rater reliability was very good with an intra-class correlation coefficient (ICC) = 0.93. Generalizability analysis showed a coefficient above 0.8 even with one rater. The coefficient improved to 0.92 if three raters were used. One-way analysis of variance found a significant difference between the three groups which indicates construct validity, p < 0.001. Lichtenstein hernia repair skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment of trainees performing Lichtenstein hernia repair to ensure that the objectives of competency-based surgical training are met.

Superitem Test: An Alternative Assessment Tool to Assess Students' Algebraic Solving Ability

ERIC Educational Resources Information Center

Lian, Lim Hooi; Yew, Wun Thiam; Idris, Noraini

2010-01-01

Superitem test based on the SOLO model (Structure of the Observing Learning Outcome) has become a powerful alternative assessment tool for monitoring the growth of students' cognitive ability in solving mathematics problems. This article focused on developing a superitem test to assess students' algebraic solving ability through interview method.…

Meta-Assessment in a Project-Based Systems Engineering Course

ERIC Educational Resources Information Center

Wengrowicz, Niva; Dori, Yehudit Judy; Dori, Dov

2017-01-01

Project-based learning (PBL) facilitates significant learning, but it poses a major assessment challenge for assessing individual content knowledge. We developed and implemented an assessment approach and tool for a mandatory undergraduate systems engineering PBL-based course. We call this type of assessment "student-oriented"…

The IDEA Assessment Tool: Assessing the Reporting, Diagnostic Reasoning, and Decision-Making Skills Demonstrated in Medical Students' Hospital Admission Notes.

PubMed

Baker, Elizabeth A; Ledford, Cynthia H; Fogg, Louis; Way, David P; Park, Yoon Soo

2015-01-01

Construct: Clinical skills are used in the care of patients, including reporting, diagnostic reasoning, and decision-making skills. Written comprehensive new patient admission notes (H&Ps) are a ubiquitous part of student education but are underutilized in the assessment of clinical skills. The interpretive summary, differential diagnosis, explanation of reasoning, and alternatives (IDEA) assessment tool was developed to assess students' clinical skills using written comprehensive new patient admission notes. The validity evidence for assessment of clinical skills using clinical documentation following authentic patient encounters has not been well documented. Diagnostic justification tools and postencounter notes are described in the literature (1,2) but are based on standardized patient encounters. To our knowledge, the IDEA assessment tool is the first published tool that uses medical students' H&Ps to rate students' clinical skills. The IDEA assessment tool is a 15-item instrument that asks evaluators to rate students' reporting, diagnostic reasoning, and decision-making skills based on medical students' new patient admission notes. This study presents validity evidence in support of the IDEA assessment tool using Messick's unified framework, including content (theoretical framework), response process (interrater reliability), internal structure (factor analysis and internal-consistency reliability), and relationship to other variables. Validity evidence is based on results from four studies conducted between 2010 and 2013. First, the factor analysis (2010, n = 216) yielded a three-factor solution, measuring patient story, IDEA, and completeness, with reliabilities of .79, .88, and .79, respectively. Second, an initial interrater reliability study (2010) involving two raters demonstrated fair to moderate consensus (κ = .21-.56, ρ =.42-.79). Third, a second interrater reliability study (2011) with 22 trained raters also demonstrated fair to moderate agreement (intraclass correlations [ICCs] = .29-.67). There was moderate reliability for all three skill domains, including reporting skills (ICC = .53), diagnostic reasoning skills (ICC = .64), and decision-making skills (ICC = .63). Fourth, there was a significant correlation between IDEA rating scores (2010-2013) and final Internal Medicine clerkship grades (r = .24), 95% confidence interval (CI) [.15, .33]. The IDEA assessment tool is a novel tool with validity evidence to support its use in the assessment of students' reporting, diagnostic reasoning, and decision-making skills. The moderate reliability achieved supports formative or lower stakes summative uses rather than high-stakes summative judgments.

Supporting family caregivers to identify their own needs in end-of-life care: Qualitative findings from a stepped wedge cluster trial.

PubMed

Aoun, Samar; Deas, Kathleen; Toye, Chris; Ewing, Gail; Grande, Gunn; Stajduhar, Kelli

2015-06-01

The Carer Support Needs Assessment Tool encompasses the physical, psychological, social, practical, financial, and spiritual support needs that government policies in many countries emphasize should be assessed and addressed for family caregivers during end-of-life care. To describe the experience of family caregivers of terminally ill people of the Carer Support Needs Assessment Tool intervention in home-based palliative care. This study was conducted during 2012-2014 in Silver Chain Hospice Care Service in Western Australia. This article reports on one part of a three-part evaluation of a stepped wedge cluster trial. All 233 family caregivers receiving the Carer Support Needs Assessment Tool intervention provided feedback on their experiences via brief end-of-trial semi-structured telephone interviews. Data were subjected to a thematic analysis. The overwhelming majority reported finding the Carer Support Needs Assessment Tool assessment process straightforward and easy. Four key themes were identified: (1) the practicality and usefulness of the systematic assessment; (2) emotional responses to caregiver reflection; (3) validation, reassurance, and empowerment; and (4) accessing support and how this was experienced. Family caregivers appreciated the value of the Carer Support Needs Assessment Tool intervention in engaging them in conversations about their needs, priorities, and solutions. The Carer Support Needs Assessment Tool presented a simple, yet potentially effective intervention to help palliative care providers systematically assess and address family caregivers' needs. The Carer Support Needs Assessment Tool provided a formal structure to facilitate discussions with family caregivers to enable needs to be addressed. Such discussions can also inform an evidence base for the ongoing development of services for family caregivers, ensuring that new or improved services are designed to meet the explicit needs of family caregivers. © The Author(s) 2015.

The Development of a Visual-Perceptual Chemistry Specific (VPCS) Assessment Tool

ERIC Educational Resources Information Center

Oliver-Hoyo, Maria; Sloan, Caroline

2014-01-01

The development of the Visual-Perceptual Chemistry Specific (VPCS) assessment tool is based on items that align to eight visual-perceptual skills considered as needed by chemistry students. This tool includes a comprehensive range of visual operations and presents items within a chemistry context without requiring content knowledge to solve…

Creating Trails: Tool for Real-Time Assessment of Information Literacy Skills

ERIC Educational Resources Information Center

Schloman, Barbara F.; Gedeon, Julie A.

2007-01-01

This article describes Tool for Real-time Assessment of Information Literacy Skills (TRAILS), a freely available, online tool designed to measure the information literacy skills of high school students. It is based on information literacy competencies for ninth-graders found in the "Ohio Academic Content Standards" (Ohio Department of Education…

The promise, practice and state of planning tools to assess site vulnerability to runoff phosphorus loss

USDA-ARS?s Scientific Manuscript database

Over the past 20 years, there has been a proliferation of phosphorus (P) site assessment tools for nutrient management planning, particularly in the United State. These decision support tools, range from the P Index to fate-and-transport models to weather-forecast based risk calculators. All require...

Computational Methods to Assess the Production Potential of Bio-Based Chemicals.

PubMed

Campodonico, Miguel A; Sukumara, Sumesh; Feist, Adam M; Herrgård, Markus J

2018-01-01

Elevated costs and long implementation times of bio-based processes for producing chemicals represent a bottleneck for moving to a bio-based economy. A prospective analysis able to elucidate economically and technically feasible product targets at early research phases is mandatory. Computational tools can be implemented to explore the biological and technical spectrum of feasibility, while constraining the operational space for desired chemicals. In this chapter, two different computational tools for assessing potential for bio-based production of chemicals from different perspectives are described in detail. The first tool is GEM-Path: an algorithm to compute all structurally possible pathways from one target molecule to the host metabolome. The second tool is a framework for Modeling Sustainable Industrial Chemicals production (MuSIC), which integrates modeling approaches for cellular metabolism, bioreactor design, upstream/downstream processes, and economic impact assessment. Integrating GEM-Path and MuSIC will play a vital role in supporting early phases of research efforts and guide the policy makers with decisions, as we progress toward planning a sustainable chemical industry.

Phases of ERA - Tools

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Using Art to Assess Environmental Education Outcomes

ERIC Educational Resources Information Center

Flowers, Ami A.; Carroll, John P.; Green, Gary T.; Larson, Lincoln R.

2015-01-01

Construction of developmentally appropriate tools for assessing the environmental attitudes and awareness of young learners has proven to be challenging. Art-based assessments that encourage creativity and accommodate different modes of expression may be a particularly useful complement to conventional tools (e.g. surveys), but their efficacy and…

EAST: Developing an Electronic Assessment and Storage Tool.

ERIC Educational Resources Information Center

Edwards, Katherine I.; Fernandez, Eugenia; Milionis, Tracey M.; Williamson, David M.

2002-01-01

Describes the purpose, development, analysis, prototyping, and features of the Electronic Assessment and Storage Tool (EAST). The Web-based system aids curriculum assessment at Purdue School of Engineering and Technology at Indiana University Purdue University Indianapolis through the ability to easily store artifacts in electronic form, support…

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED TOOL FOR WATERSHED ASSESSMENT AND PLANNING

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University of Wyoming to automate the parameterization and execu...

A Real-Time Plagiarism Detection Tool for Computer-Based Assessments

ERIC Educational Resources Information Center

Jeske, Heimo J.; Lall, Manoj; Kogeda, Okuthe P.

2018-01-01

Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of…

Development, initial reliability and validity testing of an observational tool for assessing technical skills of operating room nurses.

PubMed

Sevdalis, Nick; Undre, Shabnam; Henry, Janet; Sydney, Elaine; Koutantji, Mary; Darzi, Ara; Vincent, Charles A

2009-09-01

The recent emergence of the Systems Approach to the safety and quality of surgical care has triggered individual and team skills training modules for surgeons and anaesthetists and relevant observational assessment tools have been developed. To develop an observational tool that captures operating room (OR) nurses' technical skill and can be used for assessment and training. The Imperial College Assessment of Technical Skills for Nurses (ICATS-N) assesses (i) gowning and gloving, (ii) setting up instrumentation, (iii) draping, and (iv) maintaining sterility. Three to five observable behaviours have been identified for each skill and are rated on 1-6 scales. Feasibility and aspects of reliability and validity were assessed in 20 simulation-based crisis management training modules for trainee nurses and doctors, carried out in a Simulated Operating Room. The tool was feasible to use in the context of simulation-based training. Satisfactory reliability (Cronbach alpha) was obtained across trainers' and trainees' scores (analysed jointly and separately). Moreover, trainer nurse's ratings of the four skills correlated positively, thus indicating adequate content validity. Trainer's and trainees' ratings did not correlate. Assessment of OR nurses' technical skill is becoming a training priority. The present evidence suggests that the ICATS-N could be considered for use as an assessment/training tool for junior OR nurses.

Assessing participants' perceptions on group-based principles for action in community-based health enhancing physical activity programmes: The APEF tool.

PubMed

Herens, Marion; Wagemakers, Annemarie

2017-12-01

In community-based health enhancing physical activity (CBHEPA) programmes, group-based principles for action such as active participation, enjoyment, and fostering group processes are widely advocated. However, not much is known about participants' perceptions of these principles as there are no assessment tools available. Therefore, this article describes the development of the APEF (Active Participation, Enjoyment, and Fostering group processes) tool and reports on its implementation in a Dutch CBHEPA programme. Indicators for the principles have been identified from literature research, interviews with professionals, and secondary analysis of three group interviews with 11 practitioners. To address the identified indicators, the APEF tool was developed, pretested, and used in 10 focus groups with 76 participants. The APEF tool consists of eight statements about group-based principles for action, on which CBHEPA participants vote, followed by in-depth discussion. The voting procedure engages participants. Spider diagrams visualise participants' perceptions of group-based principles. The APEF tool addresses the challenge of relating group level outcomes to individual outcomes such as physical activity behaviour. The tool facilitates as well as evaluates group-based principles for action, it stimulates dialogue and is culturally sensitive, but it needs strong facilitating skills to manage group dynamics. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Preparing for Euro 2012: developing a hazard risk assessment.

PubMed

Wong, Evan G; Razek, Tarek; Luhovy, Artem; Mogilevkina, Irina; Prudnikov, Yuriy; Klimovitskiy, Fedor; Yutovets, Yuriy; Khwaja, Kosar A; Deckelbaum, Dan L

2015-04-01

Risk assessment is a vital step in the disaster-preparedness continuum as it is the foundation of subsequent phases, including mitigation, response, and recovery. To develop a risk assessment tool geared specifically towards the Union of European Football Associations (UEFA) Euro 2012. In partnership with the Donetsk National Medical University, Donetsk Research and Development Institute of Traumatology and Orthopedics, Donetsk Regional Public Health Administration, and the Ministry of Emergency of Ukraine, a table-based tool was created, which, based on historical evidence, identifies relevant potential threats, evaluates their impacts and likelihoods on graded scales based on previous available data, identifies potential mitigating shortcomings, and recommends further mitigation measures. This risk assessment tool has been applied in the vulnerability-assessment-phase of the UEFA Euro 2012. Twenty-three sub-types of potential hazards were identified and analyzed. Ten specific hazards were recognized as likely to very likely to occur, including natural disasters, bombing and blast events, road traffic collisions, and disorderly conduct. Preventative measures, such as increased stadium security and zero tolerance for impaired driving, were recommended. Mitigating factors were suggested, including clear, incident-specific preparedness plans and enhanced inter-agency communication. This hazard risk assessment tool is a simple aid in vulnerability assessment, essential for disaster preparedness and response, and may be applied broadly to future international events.

Technical skills assessment toolbox: a review using the unitary framework of validity.

PubMed

Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

2015-02-01

The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

Evaluating the Diagnostic Validity of a Facet-Based Formative Assessment System

ERIC Educational Resources Information Center

DeBarger, Angela Haydel; DiBello, Louis; Minstrell, Jim; Feng, Mingyu; Stout, William; Pellegrino, James; Haertel, Geneva; Harris, Christopher; Ructinger, Liliana

2011-01-01

This paper describes methods for an alignment study and psychometric analyses of a formative assessment system, Diagnoser Tools for physics. Diagnoser Tools begin with facet clusters as the interpretive framework for designing questions and instructional activities. Thus each question in the diagnostic assessments includes distractors that…

A Web-Based Course Assessment Tool with Direct Mapping to Student Outcomes

ERIC Educational Resources Information Center

Ibrahim, Walid; Atif, Yacine; Shuaib, Khaled; Sampson, Demetrios

2015-01-01

The assessment of curriculum outcomes is an essential element for continuous academic improvement. However, the collection, aggregation and analysis of assessment data are notoriously complex and time-consuming processes. At the same time, only few developments of supporting electronic processes and tools for continuous academic program assessment…

Informal Assessment as a Tool for Supporting Parent Partnerships

ERIC Educational Resources Information Center

Darragh, Johnna

2009-01-01

Many strategies contribute to forming co-constructed relationships. However, one of the most effective tools that supports co-construction is ongoing assessment, which provides a common base (knowledge of the child) on which families and professionals can build relationships. As a part of this ongoing assessment, informal strategies--including…

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYDROLOGIC MODELING TOOL FOR WATERSHED ASSESSMENT AND ANALYSIS

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University of Wyoming to automate the parameterization and execu...

AUTOMATED GEOSPATICAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYDROLOICAL MODELING TOOL FOR WATERSHED ASSESSMENT AND ANALYSIS

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly developed by the USDA Agricultural Research Service, the U.S. Environmental Protection Agency, the University of Arizona, and the University of Wyoming to automate the parameterization and execut...

Assessing the Clinical Skills of Dental Students: A Review of the Literature

ERIC Educational Resources Information Center

Taylor, Carly L.; Grey, Nick; Satterthwaite, Julian D.

2013-01-01

Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

EPA EcoBox Tools by Stressors - Biological

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Stressors - Physical

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Stressors

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Effects - Aquatic

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Exposure Pathways

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Effects - References

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Stressors - References

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Stressors - Chemical

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Effects

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Receptors - Biota

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Receptors

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Receptors - References

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Effects - Terrestrial

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Entry one: striving for best practice in professional assessment.

PubMed

English, Justin M; Mykyta, Lu

2002-01-01

The aim of this study was to develop a best practice model of professional assessment to ensure efficient and effective delivery of home-based services to frail and disabled elders. In 2000, an innovative model of professional assessment was introduced by one of Australia's largest providers of home-based care in order to reduce multiple assessments and to reduce the utilisation of assessment as a gatekeeping tool for limiting access to services. Data was analysed from a random sample of 1500 clients drawn from a population of 5000 as well as through the use of a survey tool administered to the Organisation's assessment staff and other key stakeholders. Results revealed that, contrary to popular belief, carer advocacy plays a significant role in the professional assessment process to the point that clients with carers received significantly more services and service time that clients without such support. However, if not monitored, assessment can also be used as a gate-keeping tool as opposed to one that can provide significant benefits to the consumers through comprehensive need articulation. We argue that the "professional" approach does not preclude empowerment and that assessment should not be used as a gate-keeping tool.

Assessing and managing breast cancer risk: clinicians' current practice and future needs.

PubMed

Collins, Ian M; Steel, Emma; Mann, G Bruce; Emery, Jon D; Bickerstaffe, Adrian; Trainer, Alison; Butow, Phyllis; Pirotta, Marie; Antoniou, Antonis C; Cuzick, Jack; Hopper, John; Phillips, Kelly-Anne; Keogh, Louise A

2014-10-01

Decision support tools for the assessment and management of breast cancer risk may improve uptake of prevention strategies. End-user input in the design of such tools is critical to increase clinical use. Before developing such a computerized tool, we examined clinicians' practice and future needs. Twelve breast surgeons, 12 primary care physicians and 5 practice nurses participated in 4 focus groups. These were recorded, coded, and analyzed to identify key themes. Participants identified difficulties assessing risk, including a lack of available tools to standardize practice. Most expressed confidence identifying women at potentially high risk, but not moderate risk. Participants felt a tool could especially reassure young women at average risk. Desirable features included: evidence-based, accessible (e.g. web-based), and displaying absolute (not relative) risks in multiple formats. The potential to create anxiety was a concern. Development of future tools should address these issues to optimize translation of knowledge into clinical practice. Copyright © 2014 Elsevier Ltd. All rights reserved.

Creation of a Tool for Assessing Knowledge in Evidence-Based Decision-Making in Practicing Health Care Providers.

PubMed

Spurr, Kathy; Dechman, Gail; Lackie, Kelly; Gilbert, Robert

2016-01-01

Evidence-based decision-making (EBDM) is the process health care providers (HCPs) use to identify and appraise potential evidence. It supports the integration of best research evidence with clinical expertise and patient values into the decision-making process for patient care. Competence in this process is essential to delivery of optimal care. There is no objective tool that assesses EBDM across HCP groups. This research aimed to develop a content valid tool to assess knowledge of the principles of evidence-based medicine and the EBDM process, for use with all HCPs. A Delphi process was used in the creation of the tool. Pilot testing established its content validity with the added benefit of evaluating HCPs' knowledge of EBDM. Descriptive statistics and multivariate mixed models were used to evaluate individual survey responses in total, as well as within each EBDM component. The tool consisted of 26 multiple-choice questions. A total of 12,884 HCPs in Nova Scotia were invited to participate in the web-based validation study, yielding 818 (6.3%) participants, 471 of whom completed all questions. The mean overall score was 68%. Knowledge in one component, integration of evidence with clinical expertise and patient preferences, was identified as needing development across all HCPs surveyed. A content valid tool for assessing HCP EBDM knowledge was created and can be used to support the development of continuing education programs to enhance EBDM competency.

Surgeons' attitude toward a competency-based training and assessment program: results of a multicenter survey.

PubMed

Hopmans, Cornelis J; den Hoed, Pieter T; Wallenburg, Iris; van der Laan, Lijkckle; van der Harst, Erwin; van der Elst, Maarten; Mannaerts, Guido H H; Dawson, Imro; van Lanschot, Jan J B; Ijzermans, Jan N M

2013-01-01

Currently, most surgical training programs are focused on the development and evaluation of professional competencies. Also in the Netherlands, competency-based training and assessment programs were introduced to restructure postgraduate medical training. The current surgical residency program is based on the Canadian Medical Education Directives for Specialists (CanMEDS) competencies and uses assessment tools to evaluate residents' competence progression. In this study, we examined the attitude of surgical residents and attending surgeons toward a competency-based training and assessment program used to restructure general surgical training in the Netherlands in 2009. In 2011, all residents (n = 51) and attending surgeons (n = 108) in 1 training region, consisting of 7 hospitals, were surveyed. Participants were asked to rate the importance of the CanMEDS competencies and the suitability of the adopted assessment tools. Items were rated on a 5-point Likert scale and considered relevant when at least 80% of the respondents rated an item with a score of 4 or 5 (indicating a positive attitude). Reliability was evaluated by calculating the Cronbach's α, and the Mann-Whitney test was applied to assess differences between groups. The response rate was 88% (n = 140). The CanMEDS framework demonstrated good reliability (Cronbach's α = 0.87). However, the importance of the competencies 'Manager' (78%) and 'Health Advocate' (70%) was undervalued. The assessment tools failed to achieve an acceptable reliability (Cronbach's α = 0.55), and individual tools were predominantly considered unsuitable for assessment. Exceptions were the tools 'in-training evaluation report' (91%) and 'objective structured assessment of technical skill' (82%). No significant differences were found between the residents and the attending surgeons. This study has demonstrated that, 2 years after the reform of the general surgical residency program, residents and attending surgeons in a large training region in the Netherlands do not acknowledge the importance of all CanMEDS competencies and consider the assessment tools generally unsuitable for competence evaluation. Copyright © 2013 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

How to Recognize Success and Failure: Practical Assessment of an Evolving, First-Semester Laboratory Program Using Simple, Outcome-Based Tools

ERIC Educational Resources Information Center

Gron, Liz U.; Bradley, Shelly B.; McKenzie, Jennifer R.; Shinn, Sara E.; Teague, M. Warfield

2013-01-01

This paper presents the use of simple, outcome-based assessment tools to design and evaluate the first semester of a new introductory laboratory program created to teach green analytical chemistry using environmental samples. This general chemistry laboratory program, like many introductory courses, has a wide array of stakeholders within and…

ARBOOK: Development and Assessment of a Tool Based on Augmented Reality for Anatomy

ERIC Educational Resources Information Center

Ferrer-Torregrosa, J.; Torralba, J.; Jimenez, M. A.; García, S.; Barcia, J. M.

2015-01-01

The evolution of technologies and the development of new tools with educational purposes are growing up. This work presents the experience of a new tool based on augmented reality (AR) focusing on the anatomy of the lower limb. ARBOOK was constructed and developed based on TC and MRN images, dissections and drawings. For ARBOOK evaluation, a…

Web-enabling Ecological Risk Assessment for Accessibility and Transparency

EPA Science Inventory

Ecological risk methods and tools are necessarily diverse to account for different combinations of receptors, exposure processes, effects estimation, and degree of conservatism/realism necessary to support chemical-based assessments. These tools have been continuously developed s...

EPA EcoBox Tools by Exposure Pathways - Soil

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Exposure Pathways - Food Chains

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Exposure Pathways - References

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Receptors - Habitats and Ecosystems

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Effects - Effects In ERA

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Stressors - Stressors in ERA

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Receptors - Receptors in ERA

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Exposure Pathways - Air

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA ExpoBox: Submit Tool Information

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases, mode

Competency Assessment Tool (CAT). The Evaluation of an Innovative Competency-Based Assessment Experience in Higher Education

ERIC Educational Resources Information Center

Ion, Georgeta; Cano, Elena; Cabrera, Nati

2016-01-01

This article examines an innovation in teaching-learning and assessment processes through the use of a platform called the Competency Assessment Tool (CAT). It allows for the tracking of student blogs with the objective of improving self-reflective processes and providing feedback. The experiment was carried out in six universities in Catalonia,…

An Alternative Grading Tool for Enhancing Assessment Practice and Quality Assurance in Higher Education

ERIC Educational Resources Information Center

Grainger, Peter; Weir, Katie

2016-01-01

Assessing student learning in university courses is commonly done using a rubric that arranges the assessment criteria and standards descriptors in a matrix style or grid format. This paper introduces an alternative style of grading tool known as the continua model of a guide to making judgements, which arranges assessment criteria based on a…

Rater Training to Support High-Stakes Simulation-Based Assessments

ERIC Educational Resources Information Center

Feldman, Moshe; Lazzara, Elizabeth H.; Vanderbilt, Allison A.; DiazGranados, Deborah

2012-01-01

Competency-based assessment and an emphasis on obtaining higher-level outcomes that reflect physicians' ability to demonstrate their skills has created a need for more advanced assessment practices. Simulation-based assessments provide medical education planners with tools to better evaluate the 6 Accreditation Council for Graduate Medical…

Strengthening Chronic Disease Prevention Programming: the Toward Evidence-Informed Practice (TEIP) Program Assessment Tool

PubMed Central

Albert, Dayna; Fortin, Rebecca; Lessio, Anne; Herrera, Christine; Hanning, Rhona; Rush, Brian

2013-01-01

Best practices identified solely on the strength of research evidence may not be entirely relevant or practical for use in community-based public health and the practice of chronic disease prevention. Aiming to bridge the gap between best practices literature and local knowledge and expertise, the Ontario Public Health Association, through the Toward Evidence-Informed Practice initiative, developed a set of resources to strengthen evidence-informed decision making in chronic disease prevention programs. A Program Assessment Tool, described in this article, emphasizes better processes by incorporating review criteria into the program planning and implementation process. In a companion paper, “Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Evidence Tool,” we describe another tool, which emphasizes better evidence by providing guidelines and worksheets to identify, synthesize, and incorporate evidence from a range of sources (eg, peer-reviewed literature, gray literature, local expertise) to strengthen local programs. The Program Assessment Tool uses 19 criteria derived from literature on best and promising practices to assess and strengthen program planning and implementation. We describe the benefits, strengths, and challenges in implementing the tool in 22 community-based chronic disease prevention projects in Ontario, Canada. The Program Assessment Tool helps put best processes into operation to complement adoption and adaptation of evidence-informed practices for chronic disease prevention. PMID:23721789

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYRDOLOGIC MODELING TOOL FOR WATERSHED ASSESSMENT AND ANALYSIS

EPA Science Inventory

The Automated Geospatial Watershed Assessment tool (AGWA) is a GIS interface jointly

developed by the USDA Agricultural Research Service, the U.S. Environmental Protection

Agency, the University of Arizona, and the University of Wyoming to automate the

parame...

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA): A GIS-BASED HYDROLOGICAL MODELING TOOL FOR WATERSHED MANAGEMENT AND LANDSCAPE ASSESSMENT

EPA Science Inventory

The Automated Geospatial Watershed Assessment (http://www.epa.gov/nerlesd1/land-sci/agwa/introduction.htm and www.tucson.ars.ag.gov/agwa) tool is a GIS interface jointly developed by the U.S. Environmental Protection Agency, USDA-Agricultural Research Service, and the University ...

Innovative Assessment Tools for a Short, Fast-Paced, Summer Field Course

ERIC Educational Resources Information Center

Baustian, Melissa M.; Bentley, Samuel J.; Wandersee, James H.

2008-01-01

An experiential science program, such as a summer course at a field station, requires unique assessment tools. Traditional assessment via a pencil-and-paper exam cannot capture the essential skills and concepts learned at a summer field station. Therefore, the authors developed a pre- and postcourse image-based analysis to evaluate student…

The Integrated Medical Model - A Risk Assessment and Decision Support Tool for Human Space Flight Missions

NASA Technical Reports Server (NTRS)

Kerstman, Eric; Minard, Charles G.; Saile, Lynn; FreiredeCarvalho, Mary; Myers, Jerry; Walton, Marlei; Butler, Douglas; Lopez, Vilma

2010-01-01

The Integrated Medical Model (IMM) is a decision support tool that is useful to space flight mission planners and medical system designers in assessing risks and optimizing medical systems. The IMM employs an evidence-based, probabilistic risk assessment (PRA) approach within the operational constraints of space flight.

The potential of a self-assessment tool to identify healthcare professionals' strengths and areas in need of professional development to aid effective facilitation of group-based, person-centered diabetes education.

PubMed

Stenov, Vibeke; Wind, Gitte; Skinner, Timothy; Reventlow, Susanne; Hempler, Nana Folmann

2017-09-18

Healthcare professionals' person-centered communication skills are pivotal for successful group-based diabetes education. However, healthcare professionals are often insufficiently equipped to facilitate person-centeredness and many have never received post-graduate training. Currently, assessing professionals' skills in conducting group-based, person-centered diabetes education primarily focus on experts measuring and coding skills on various scales. However, learner-centered approaches such as adequate self-reflective tools have been shown to emphasize professional autonomy and promote engagement. The aim of this study was to explore the potential of a self-assessment tool to identify healthcare professionals' strengths and areas in need of professional development to aid effective facilitation of group-based, person-centered diabetes education. The study entails of two components: 1) Field observations of five different educational settings including 49 persons with diabetes and 13 healthcare professionals, followed by interviews with 5 healthcare professionals and 28 persons with type 2 diabetes. 2) One professional development workshop involving 14 healthcare professionals. Healthcare professionals were asked to assess their person-centered communication skills using a self-assessment tool based on challenges and skills related to four educator roles: Embracer, Facilitator, Translator, and Initiator. Data were analyzed by hermeneutic analysis. Theories derived from theoretical model 'The Health Education Juggler' and techniques from 'Motivational Interviewing in Groups' were used as a framework to analyze data. Subsequently, the analysis from the field notes and interview transcript were compared with healthcare professionals' self-assessments of strengths and areas in need to effectively facilitate group-based, person-centered diabetes education. Healthcare professionals self-assessed the Translator and the Embracer to be the two most skilled roles whereas the Facilitator and the Initiator were identified to be the most challenged roles. Self-assessments corresponded to observations of professional skills in educational programs and were confirmed in the interviews. Healthcare professionals self-assessed the same professional skills as observed in practice. Thus, a tool to self-assess professional skills in facilitating group-based diabetes education seems to be useful as a starting point to promote self-reflections and identification of healthcare professionals' strengths and areas of need of professional development.

LANDSCAPE ASSESSMENT TOOLS FOR WATERSHED CHARACTERIZATION

EPA Science Inventory

A combination of process-based, empirical and statistical models has been developed to assist states in their efforts to assess water quality, locate impairments over large areas, and calculate TMDL allocations. By synthesizing outputs from a number of these tools, LIPS demonstr...

EPA EcoBox Tools by Exposure Pathways - Water and Sediment

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

EPA EcoBox Tools by Exposure Pathways - Exposure Pathways In ERA

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Development of bilingual tools to assess functional health patterns.

PubMed

Krozy, R E; McCarthy, N C

1999-01-01

The theory and process of developing bilingual assessment tools based on Gordon's 11 functional health patterns. To facilitate assessing the individual, family, and community in a student clinical practicum in a Spanish-speaking country. Multiple family and community health promotion theories; translation theories, Gordon's Manual of Nursing Diagnosis (1982); translation/back-translation involving Ecuadorian faculty and students; student community assessments; faculty and staff workshops in Ecuador. Bilingual, culturally sensitive health assessment tools facilitate history taking, establish nursing diagnoses and interventions, and promote mutual learning. These outcomes demonstrate potential application to other systems in the international nursing community.

Developing a Tool for Increasing the Awareness about Gendered and Intersectional Processes in the Clinical Assessment of Patients--A Study of Pain Rehabilitation.

PubMed

Hammarström, Anne; Wiklund, Maria; Stålnacke, Britt-Marie; Lehti, Arja; Haukenes, Inger; Fjellman-Wiklund, Anncristine

2016-01-01

There is a need for tools addressing gender inequality in the everyday clinical work in health care. The aim of our paper was to develop a tool for increasing the awareness of gendered and intersectional processes in clinical assessment of patients, based on a study of pain rehabilitation. In the overarching project named "Equal care in rehabilitation" we used multiple methods (both quantitative and qualitative) in five sub studies. With a novel approach we used Grounded Theory in order to synthesize the results from our sub studies, in order to develop the gender equality tool. The gender equality tool described and developed in this article is thus based on results from sub studies about the processes of assessment and selection of patients in pain rehabilitation. Inspired by some questions in earlier tools, we posed open ended questions and inductively searched for findings and concepts relating to gendered and social selection processes in pain rehabilitation, in each of our sub studies. Through this process, the actual gender equality tool was developed as 15 questions about the process of assessing and selecting patients to pain rehabilitation. As a more comprehensive way of understanding the tool, we performed a final step of the GT analyses. Here we synthesized the results of the tool into a comprehensive model with two dimensions in relation to several possible discrimination axes. The process of assessing and selecting patients was visualized as a funnel, a top down process governed by gendered attitudes, rules and structures. We found that the clinicians judged inner and outer characteristics and status of patients in a gendered and intersectional way in the process of clinical decision-making which thus can be regarded as (potentially) biased with regard to gender, socio-economic status, ethnicity and age. The clinical implications of our tool are that the tool can be included in the systematic routine of clinical assessment of patients for both awareness raising and as a base for avoiding gender bias in clinical decision-making. The tool could also be used in team education for health professionals as an instrument for critical reflection on gender bias. Thus, tools for clinical assessment can be developed from empirical studies in various clinical settings. However, such a micro-level approach must be understood from a broader societal perspective including gender relations on both the macro- and the meso-level.

Developing a Tool for Increasing the Awareness about Gendered and Intersectional Processes in the Clinical Assessment of Patients – A Study of Pain Rehabilitation

PubMed Central

Hammarström, Anne; Wiklund, Maria; Stålnacke, Britt-Marie; Lehti, Arja; Haukenes, Inger; Fjellman-Wiklund, Anncristine

2016-01-01

Objective There is a need for tools addressing gender inequality in the everyday clinical work in health care. The aim of our paper was to develop a tool for increasing the awareness of gendered and intersectional processes in clinical assessment of patients, based on a study of pain rehabilitation. Methods In the overarching project named “Equal care in rehabilitation” we used multiple methods (both quantitative and qualitative) in five sub studies. With a novel approach we used Grounded Theory in order to synthesize the results from our sub studies, in order to develop the gender equality tool. The gender equality tool described and developed in this article is thus based on results from sub studies about the processes of assessment and selection of patients in pain rehabilitation. Inspired by some questions in earlier tools, we posed open ended questions and inductively searched for findings and concepts relating to gendered and social selection processes in pain rehabilitation, in each of our sub studies. Through this process, the actual gender equality tool was developed as 15 questions about the process of assessing and selecting patients to pain rehabilitation. As a more comprehensive way of understanding the tool, we performed a final step of the GT analyses. Here we synthesized the results of the tool into a comprehensive model with two dimensions in relation to several possible discrimination axes. Results The process of assessing and selecting patients was visualized as a funnel, a top down process governed by gendered attitudes, rules and structures. We found that the clinicians judged inner and outer characteristics and status of patients in a gendered and intersectional way in the process of clinical decision-making which thus can be regarded as (potentially) biased with regard to gender, socio-economic status, ethnicity and age. Implications The clinical implications of our tool are that the tool can be included in the systematic routine of clinical assessment of patients for both awareness raising and as a base for avoiding gender bias in clinical decision-making. The tool could also be used in team education for health professionals as an instrument for critical reflection on gender bias. Conclusions Thus, tools for clinical assessment can be developed from empirical studies in various clinical settings. However, such a micro-level approach must be understood from a broader societal perspective including gender relations on both the macro- and the meso-level. PMID:27055029

Falls risk assessment begins with hello: lessons learned from the use of one home health agency's fall risk tool.

PubMed

Flemming, Patricia J; Ramsay, Katherine

2012-10-01

Identifying older adults at risk for falls is a challenge all home healthcare agencies (HHAs) face. The process of assessing for falls risk begins with the initial home visit. One HHA affiliated with an academic medical center describes its experience in development and use of a Falls Risk Assessment (FRA) tool over a 10-year period. The FRA tool has been modified since initial development to clarify elements of the tool based on research and to reflect changes in the Outcome and Assessment Information Set (OASIS) document. The primary purpose of this article is to share a validated falls risk assessment tool to facilitate identification of fall-related risk factors in the homebound population. A secondary purpose is to share lessons learned by the HHA during the 10 years using the FRA.

Thrombocalc: implementation and uptake of personalized postpartum venous thromboembolism risk assessment in a high-throughput obstetric environment.

PubMed

O'Shaughnessy, Fergal; Donnelly, Jennifer C; Cooley, Sharon M; Deering, Mary; Raman, Ajita; Gannon, Geraldine; Hickey, Jane; Holland, Alan; Hayes, Niamh; Bennett, Kathleen; Ní Áinle, Fionnuala; Cleary, Brian J

2017-11-01

Venous thromboembolism risk assessment (VTERA) is recommended in all pregnant and postpartum women. Our objective was to develop, pilot and implement a user-friendly electronic VTERA tool. We developed "Thrombocalc", an electronic VTERA tool using Microsoft EXCEL ™ . Thrombocalc was designed as a score-based tool to facilitate rapid assessment of all women after childbirth. Calculation of a total score estimated risk of venous thromboembolism in line with consensus guidelines. Recommendations for thromboprophylaxis were included in the VTERA output. Implementation was phased. Uptake of the VTERA tool was assessed prospectively by monitoring the proportion of women who gave birth in our institution and had a completed risk assessment. Factors affecting completion and accuracy of risk assessments were also assessed. Thrombocalc was used prospectively to risk-assess 8380 women between September 2014 and December 2015. Compliance with this tool increased dramatically throughout the study period; over 92% of women were risk-assessed in the last quarter of data collection. Compliance was not adversely affected if delivery took place out of working hours [adjusted odds ratio (aOR) 1.03, 95% confidence interval (CI) 0.93-1.14]. Risk assessment was less likely in the case of cesarean deliveries (aOR 0.66, 95% CI 0.60-0.73) and stillborn infants (aOR 0.48, 95% CI 0.29-0.79). Misclassification of risk factors led to approximately 207 (2.5%) inaccurate thromboprophylaxis recommendations. Our electronic, score-based VTERA tool provides a highly effective mechanism for rapid assessment of individual postpartum venous thromboembolism risk in a high-throughput environment. © 2017 Nordic Federation of Societies of Obstetrics and Gynecology.

Providing Guidance in Virtual Lab Experimentation: The Case of an Experiment Design Tool

ERIC Educational Resources Information Center

Efstathiou, Charalampos; Hovardas, Tasos; Xenofontos, Nikoletta A.; Zacharia, Zacharias C.; deJong, Ton; Anjewierden, Anjo; van Riesen, Siswa A. N.

2018-01-01

The present study employed a quasi-experimental design to assess a computer-based tool, which was intended to scaffold the task of designing experiments when using a virtual lab for the process of experimentation. In particular, we assessed the impact of this tool on primary school students' cognitive processes and inquiry skills before and after…

Cost analysis of objective resident cataract surgery assessments.

PubMed

Nandigam, Kiran; Soh, Jonathan; Gensheimer, William G; Ghazi, Ahmed; Khalifa, Yousuf M

2015-05-01

To compare 8 ophthalmology resident surgical training tools to determine which is most cost effective. University of Rochester Medical Center, Rochester, New York, USA. Retrospective evaluation of technology. A cost-analysis model was created to compile all relevant costs in running each tool in a medium-sized ophthalmology program. Quantitative cost estimates were obtained based on cost of tools, cost of time in evaluations, and supply and maintenance costs. For wet laboratory simulation, Eyesi was the least expensive cataract surgery simulation method; however, it is only capable of evaluating simulated cataract surgery rehearsal and requires supplementation with other evaluative methods for operating room performance and for noncataract wet lab training and evaluation. The most expensive training tool was the Eye Surgical Skills Assessment Test (ESSAT). The 2 most affordable methods for resident evaluation in operating room performance were the Objective Assessment of Skills in Intraocular Surgery (OASIS) and Global Rating Assessment of Skills in Intraocular Surgery (GRASIS). Cost-based analysis of ophthalmology resident surgical training tools are needed so residency programs can implement tools that are valid, reliable, objective, and cost effective. There is no perfect training system at this time. Copyright © 2015 ASCRS and ESCRS. Published by Elsevier Inc. All rights reserved.

Development and Testing of the Church Environment Audit Tool.

PubMed

Kaczynski, Andrew T; Jake-Schoffman, Danielle E; Peters, Nathan A; Dunn, Caroline G; Wilcox, Sara; Forthofer, Melinda

2018-05-01

In this paper, we describe development and reliability testing of a novel tool to evaluate the physical environment of faith-based settings pertaining to opportunities for physical activity (PA) and healthy eating (HE). Tool development was a multistage process including a review of similar tools, stakeholder review, expert feedback, and pilot testing. Final tool sections included indoor opportunities for PA, outdoor opportunities for PA, food preparation equipment, kitchen type, food for purchase, beverages for purchase, and media. Two independent audits were completed at 54 churches. Interrater reliability (IRR) was determined with Kappa and percent agreement. Of 218 items, 102 were assessed for IRR and 116 could not be assessed because they were not present at enough churches. Percent agreement for all 102 items was over 80%. For 42 items, the sample was too homogeneous to assess Kappa. Forty-six of the remaining items had Kappas greater than 0.60 (25 items 0.80-1.00; 21 items 0.60-0.79), indicating substantial to almost perfect agreement. The tool proved reliable and efficient for assessing church environments and identifying potential intervention points. Future work can focus on applications within faith-based partnerships to understand how church environments influence diverse health outcomes.

Objective structured assessment of nontechnical skills: Reliability of a global rating scale for the in-training assessment in the operating room.

PubMed

Dedy, Nicolas J; Szasz, Peter; Louridas, Marisa; Bonrath, Esther M; Husslein, Heinrich; Grantcharov, Teodor P

2015-06-01

Nontechnical skills are critical for patient safety in the operating room (OR). As a result, regulatory bodies for accreditation and certification have mandated the integration of these competencies into postgraduate education. A generally accepted approach to the in-training assessment of nontechnical skills, however, is lacking. The goal of the present study was to develop an evidence-based and reliable tool for the in-training assessment of residents' nontechnical performance in the OR. The Objective Structured Assessment of Nontechnical Skills tool was designed as a 5-point global rating scale with descriptive anchors for each item, based on existing evidence-based frameworks of nontechnical skills, as well as resident training requirements. The tool was piloted on scripted videos and refined in an iterative process. The final version was used to rate residents' performance in recorded OR crisis simulations and during live observations in the OR. A total of 37 simulations and 10 live procedures were rated. Interrater agreement was good for total mean scores, both in simulation and in the real OR, with intraclass correlation coefficients >0.90 in all settings for average and single measures. Internal consistency of the scale was high (Cronbach's alpha = 0.80). The Objective Structured Assessment of Nontechnical Skills global rating scale was developed as an evidence-based tool for the in-training assessment of residents' nontechnical performance in the OR. Unique descriptive anchors allow for a criterion-referenced assessment of performance. Good reliability was demonstrated in different settings, supporting applications in research and education. Copyright © 2015 Elsevier Inc. All rights reserved.

Reciprocal Peer Assessment as a Learning Tool for Secondary School Students in Modeling-Based Learning

ERIC Educational Resources Information Center

Tsivitanidou, Olia E.; Constantinou, Costas P.; Labudde, Peter; Rönnebeck, Silke; Ropohl, Mathias

2018-01-01

The aim of this study was to investigate how reciprocal peer assessment in modeling-based learning can serve as a learning tool for secondary school learners in a physics course. The participants were 22 upper secondary school students from a gymnasium in Switzerland. They were asked to model additive and subtractive color mixing in groups of two,…

Comparison of tools for assessing the methodological quality of primary and secondary studies in health technology assessment reports in Germany.

PubMed

Dreier, Maren; Borutta, Birgit; Stahmeyer, Jona; Krauth, Christian; Walter, Ulla

2010-06-14

HEALTH CARE POLICY BACKGROUND: Findings from scientific studies form the basis for evidence-based health policy decisions. Quality assessments to evaluate the credibility of study results are an essential part of health technology assessment reports and systematic reviews. Quality assessment tools (QAT) for assessing the study quality examine to what extent study results are systematically distorted by confounding or bias (internal validity). The tools can be divided into checklists, scales and component ratings. What QAT are available to assess the quality of interventional studies or studies in the field of health economics, how do they differ from each other and what conclusions can be drawn from these results for quality assessments? A systematic search of relevant databases from 1988 onwards is done, supplemented by screening of the references, of the HTA reports of the German Agency for Health Technology Assessment (DAHTA) and an internet search. The selection of relevant literature, the data extraction and the quality assessment are carried out by two independent reviewers. The substantive elements of the QAT are extracted using a modified criteria list consisting of items and domains specific to randomized trials, observational studies, diagnostic studies, systematic reviews and health economic studies. Based on the number of covered items and domains, more and less comprehensive QAT are distinguished. In order to exchange experiences regarding problems in the practical application of tools, a workshop is hosted. A total of eight systematic methodological reviews is identified as well as 147 QAT: 15 for systematic reviews, 80 for randomized trials, 30 for observational studies, 17 for diagnostic studies and 22 for health economic studies. The tools vary considerably with regard to the content, the performance and quality of operationalisation. Some tools do not only include the items of internal validity but also the items of quality of reporting and external validity. No tool covers all elements or domains. Design-specific generic tools are presented, which cover most of the content criteria. The evaluation of QAT by using content criteria is difficult, because there is no scientific consensus on the necessary elements of internal validity, and not all of the generally accepted elements are based on empirical evidence. Comparing QAT with regard to contents neglects the operationalisation of the respective parameters, for which the quality and precision are important for transparency, replicability, the correct assessment and interrater reliability. QAT, which mix items on the quality of reporting and internal validity, should be avoided. There are different, design-specific tools available which can be preferred for quality assessment, because of its wider coverage of substantive elements of internal validity. To minimise the subjectivity of the assessment, tools with a detailed and precise operationalisation of the individual elements should be applied. For health economic studies, tools should be developed and complemented with instructions, which define the appropriateness of the criteria. Further research is needed to identify study characteristics that influence the internal validity of studies.

Review of quality assessment tools for the evaluation of pharmacoepidemiological safety studies

PubMed Central

Neyarapally, George A; Hammad, Tarek A; Pinheiro, Simone P; Iyasu, Solomon

2012-01-01

Objectives Pharmacoepidemiological studies are an important hypothesis-testing tool in the evaluation of postmarketing drug safety. Despite the potential to produce robust value-added data, interpretation of findings can be hindered due to well-recognised methodological limitations of these studies. Therefore, assessment of their quality is essential to evaluating their credibility. The objective of this review was to evaluate the suitability and relevance of available tools for the assessment of pharmacoepidemiological safety studies. Design We created an a priori assessment framework consisting of reporting elements (REs) and quality assessment attributes (QAAs). A comprehensive literature search identified distinct assessment tools and the prespecified elements and attributes were evaluated. Primary and secondary outcome measures The primary outcome measure was the percentage representation of each domain, RE and QAA for the quality assessment tools. Results A total of 61 tools were reviewed. Most tools were not designed to evaluate pharmacoepidemiological safety studies. More than 50% of the reviewed tools considered REs under the research aims, analytical approach, outcome definition and ascertainment, study population and exposure definition and ascertainment domains. REs under the discussion and interpretation, results and study team domains were considered in less than 40% of the tools. Except for the data source domain, quality attributes were considered in less than 50% of the tools. Conclusions Many tools failed to include critical assessment elements relevant to observational pharmacoepidemiological safety studies and did not distinguish between REs and QAAs. Further, there is a lack of considerations on the relative weights of different domains and elements. The development of a quality assessment tool would facilitate consistent, objective and evidence-based assessments of pharmacoepidemiological safety studies. PMID:23015600

Development of a research ethics knowledge and analytical skills assessment tool.

PubMed

Taylor, Holly A; Kass, Nancy E; Ali, Joseph; Sisson, Stephen; Bertram, Amanda; Bhan, Anant

2012-04-01

The goal of this project was to develop and validate a new tool to evaluate learners' knowledge and skills related to research ethics. A core set of 50 questions from existing computer-based online teaching modules were identified, refined and supplemented to create a set of 74 multiple-choice, true/false and short answer questions. The questions were pilot-tested and item discrimination was calculated for each question. Poorly performing items were eliminated or refined. Two comparable assessment tools were created. These assessment tools were administered as a pre-test and post-test to a cohort of 58 Indian junior health research investigators before and after exposure to a new course on research ethics. Half of the investigators were exposed to the course online, the other half in person. Item discrimination was calculated for each question and Cronbach's α for each assessment tool. A final version of the assessment tool that incorporated the best questions from the pre-/post-test phase was used to assess retention of research ethics knowledge and skills 3 months after course delivery. The final version of the REKASA includes 41 items and had a Cronbach's α of 0.837. The results illustrate, in one sample of learners, the successful, systematic development and use of a knowledge and skills assessment tool in research ethics capable of not only measuring basic knowledge in research ethics and oversight but also assessing learners' ability to apply ethics knowledge to the analytical task of reasoning through research ethics cases, without reliance on essay or discussion-based examination. These promising preliminary findings should be confirmed with additional groups of learners.

Facilitating peer based learning through summative assessment - An adaptation of the Objective Structured Clinical Assessment tool for the blended learning environment.

PubMed

Wikander, Lolita; Bouchoucha, Stéphane L

2018-01-01

Adapting a course from face to face to blended delivery necessitates that assessments are modified accordingly. In Australia the Objective Structured Clinical Assessment tool, as a derivative from the Objective Structured Clinical Examination, has been used in the face-to-face delivery mode as a formative or summative assessment tool in medicine and nursing since 1990. The Objective Structured Clinical Assessment has been used at Charles Darwin University to assess nursing students' simulated clinical skills prior to the commencement of their clinical placements since 2008. Although the majority of the course is delivered online, students attend a one-week intensive clinical simulation block yearly, prior to attending clinical placements. Initially, the Objective Structured Clinical Assessment was introduced as a lecturer assessed summative assessment, over time it was adapted to better suit the blended learning environment. The modification of the tool from an academic to peer assessed assessment tool, was based on the empirical literature, student feedback and a cross-sectional, qualitative study exploring academics' perceptions of the Objective Structured Clinical Assessment (Bouchoucha et al., 2013a, b). This paper presents an overview of the process leading to the successful adaptation of the Objective Structured Clinical Assessment to suit the requirements of a preregistration nursing course delivered through blended learning. This is significant as many universities are moving their curriculum to fully online or blended delivery, yet little attention has been paid to adapting the assessment of simulated clinical skills. The aim is to identify the benefits and drawbacks of using the peer assessed Objective Structured Clinical Assessment and share recommendations for successful implementation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Crash Attenuator Data Collection and Life Cycle Tool Development

DOT National Transportation Integrated Search

2014-06-14

This research study was aimed at data collection and development of a decision support tool for life cycle cost assessment of crash attenuators. Assessing arrenuator life cycle costs based on in-place expected costs and not just the initial cost enha...

EPA EcoBox Tools by Receptors - Endangered, Threatened or Other Species of Concern

EPA Pesticide Factsheets

Eco-Box is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Assessment Tools for Peripheral Neuropathy in Pediatric Oncology: A Systematic Review From the Children's Oncology Group.

PubMed

Smolik, Suzanne; Arland, Lesley; Hensley, Mary Ann; Schissel, Debra; Shepperd, Barbara; Thomas, Kristin; Rodgers, Cheryl

Peripheral neuropathy is a known side effect of several chemotherapy agents, including vinca alkaloids and platinum-based chemotherapy. Early recognition and monitoring of this side effect is an important role of the pediatric oncology nurse. There are a variety of peripheral neuropathy assessment tools currently in use, but the usefulness of these tools in identifying and grading neuropathy in children varies, and there is currently no standardized tool in place to evaluate peripheral neuropathy in pediatric oncology. A systematic review was performed to identify the peripheral neuropathy assessment tools that best evaluate the early onset and progression of peripheral neuropathy in pediatric patients receiving vincristine. Because of the limited information available in pediatric oncology, this review was extended to any pediatric patient with neuropathy. A total of 8 studies were included in the evidence synthesis. Based on available evidence, the pediatric-modified Total Neuropathy Scale (ped-m TNS) and the Total Neuropathy Score-pediatric version (TNS-PV) are recommended for the assessment of vincristine-induced peripheral neuropathy in children 6 years of age and older. In addition, several studies demonstrated that subjective symptoms alone are not adequate to assess for vincristine-induced peripheral neuropathy. Nursing assessment of peripheral neuropathy should be an integral and regular part of patient care throughout the course of chemotherapy treatment.

Spreadsheet Assessment Tool v. 2.4

DOE Office of Scientific and Technical Information (OSTI.GOV)

Allen, David J.; Martinez, Ruben

2016-03-03

The Spreadsheet Assessment Tool (SAT) is an easy to use, blast assessment tool that is intended to estimate the potential risk due to an explosive attack on a blood irradiator. The estimation of risk is based on the methodology, assumptions, and results of a detailed blast effects assessment study that is summarized in Sandia National Laboratories Technical Report SAND2015-6166. Risk as defined in the report and as used in the SAT is: "The potential risk of creating an air blast-induced vent opening at a buildings envelope surface". Vent openings can be created at a buildings envelope through the failure ofmore » an exterior building component—like a wall, window, or door—due to an explosive sabotage of an irradiator within the building. To estimate risk, the tool requires that users obtain and input information pertaining to the building's characteristics and the irradiator location. The tool also suggests several prescriptive mitigation strategies that can be considered to reduce risk. Given the variability in civilian building construction practices, the input parameters used by this tool may not apply to all buildings being assessed. The tool should not be used as a substitute for engineering judgment. The tool is intended for assessment purposes only.« less

Keeping Student Performance Central: The New York Assessment Collection. Studies on Exhibitions.

ERIC Educational Resources Information Center

Allen, David; McDonald, Joseph

This report describes a computer tool used by the state of New York to assess student performance in elementary and secondary grades. Based on the premise that every assessment is a system of interacting elements, the tool examines students on six dimensions: vision, prompt, coaching context, performance, standards, and reflection. Vision, which…

Measuring New Media Literacies: Towards the Development of a Comprehensive Assessment Tool

ERIC Educational Resources Information Center

Literat, Ioana

2014-01-01

This study assesses the psychometric properties of a newly tested self-report assessment tool for media literacy, based on the twelve new media literacy skills (NMLs) developed by Jenkins et al. (2006). The sample (N = 327) consisted of normal volunteers who completed a comprehensive online survey that measured their NML skills, media exposure,…

Pediatric Psychologist Use of Adherence Assessments and Interventions

PubMed Central

Rohan, Jennifer M.; Martin, Staci; Hommel, Kevin; Greenley, Rachel Neff; Loiselle, Kristin; Ambrosino, Jodie; Fredericks, Emily M.

2013-01-01

Objective To document current clinical practices for medical regimen adherence assessment and intervention in the field of pediatric psychology. Methods 113 members of the Society of Pediatric Psychology completed an anonymous online survey that assessed use of adherence assessments and interventions in clinical practice, barriers and facilitators to their use, and preferred resources for obtaining information on adherence assessments and interventions. Results Respondents reported using a range of adherence assessment and intervention strategies, some of which are evidence-based. Barriers to implementing these clinical strategies included time constraints and lack of familiarity with available clinical tools. Respondents reported that education about effective clinical tools would facilitate their use of adherence assessments and interventions. Conclusions Future research and clinical efforts in adherence should consider developing practical tools for clinical practice, making accessible resources to promote dissemination of these tools, and increase understanding of clinician implementation of adherence assessments and interventions. PMID:23658375

Rural Food and Physical Activity Assessment Using an Electronic Tablet-Based Application, New York, 2013-2014.

PubMed

Seguin, Rebecca A; Morgan, Emily H; Connor, Leah M; Garner, Jennifer A; King, Abby C; Sheats, Jylana L; Winter, Sandra J; Buman, Matthew P

2015-07-02

A community's built environment can influence health behaviors. Rural populations experience significant health disparities, yet built environment studies in these settings are limited. We used an electronic tablet-based community assessment tool to conduct built environment audits in rural settings. The primary objective of this qualitative study was to evaluate the usefulness of the tool in identifying barriers and facilitators to healthy eating and active living. The second objective was to understand resident perspectives on community features and opportunities for improvement. Participants were recruited from 4 rural communities in New York State. Using the tool, participants completed 2 audits, which consisted of taking pictures and recording audio narratives about community features perceived as assets or barriers to healthy eating and active living. Follow-up focus groups explored the audit experience, data captured, and opportunities for change. Twenty-four adults (mean age, 69.4 y (standard deviation, 13.2 y), 6 per community, participated in the study. The most frequently captured features related to active living were related to roads, sidewalks, and walkable destinations. Restaurants, nontraditional food stores, and supermarkets were identified in the food environment in relation to the cost, quality, and selection of healthy foods available. In general, participants found the assessment tool to be simple and enjoyable to use. An electronic tablet-based tool can be used to assess rural food and physical activity environments and may be useful in identifying and prioritizing resident-led change initiatives. This resident-led assessment approach may also be helpful for informing and evaluating rural community-based interventions.

Literacy assessment of family health history tools for public health prevention.

PubMed

Wang, C; Gallo, R E; Fleisher, L; Miller, S M

2011-01-01

This study aimed to systematically identify and evaluate the readability and document complexity of currently available family history tools for the general public. Three steps were undertaken to identify family history tools for evaluation: (a) Internet searches, (b) expert consultation, and (c) literature searches. Tools identified were assessed for readability using the Simple Measure of Gobbledygook (SMOG) readability formula. The complexity of documents (i.e., forms collecting family history information) was assessed using the PMOSE/IKIRSCH document readability formula. A total of 78 tools were identified, 47 of which met the criteria for inclusion. SMOG reading grade levels for multimedia-based tools ranged from 10.1 to 18.3, with an average score of 13.6. For print-based tools, SMOG ranged from 8.7 to 14.1, with an average score of 12.0. Document complexity ranged from very low complexity (level 1 proficiency) to high complexity (level 4 proficiency). The majority of tools are written at a reading grade level that is beyond the 8th grade average reading level in the United States. The lack of family history tools that are easy to read or use may compromise their potential effectiveness in identifying individuals at increased risk for chronic diseases in the general population. Copyright © 2010 S. Karger AG, Basel.

A web-based endodontic case difficulty assessment tool.

PubMed

Shah, P K; Chong, B S

2018-07-01

To develop a web-based tool to facilitate identification, evaluation and management of teeth requiring endodontic treatment. Following a literature search and thorough analysis of existing case difficulty assessment forms, the web-based tool was developed using an online survey builder (Qualtrics, Qualtrics Lab, UT, USA). Following feedback from a pilot study, it was refined and improved. A study was performed, using the updated version (EndoApp) on a cohort (n = 53) of dental professionals and dental students. The participants were e-mailed instructions detailing the assessment of five test cases using EndoApp, followed by completion of a structured feedback form. Analysis of the EndoApp responses was used to evaluate usage times, whereas the results of the feedback forms were used to assess user experience and relevance, other potential applications and comments on further improvement/s. The average usage time was 2 min 7 s; the average times needed for the last three (Cases 3-5) were significantly less than the preceding two (Cases 1 & 2) test cases. An overwhelming majority of participants expressed favourable views on user experience and relevance of the web-based case difficulty assessment tool. Only two participants (4%) were unlikely or very unlikely to use EndoApp again. The potential application of EndoApp as an 'educational tool' and for 'primary care triage' was deemed the most popular features and of greater importance than the secondary options of 'fee setting' and as a 'dento-legal justification tool'. Within the study limitations, owing to its ability to quantify the level of difficulty and provide guidance, EndoApp was considered user-friendly and helped facilitate endodontic case difficulty assessment. From the feedback, further improvements and the development of a Smartphone App version are in progress. EndoApp may facilitate treatment planning, improve treatment cost-effectiveness and reduce frequency of procedural errors by providing appropriate guidance on endodontic case management.

OLTARIS: On-Line Tool for the Assessment of Radiation in Space

NASA Technical Reports Server (NTRS)

Singleterry, Robert C., Jr.; Blattnig, Steve R.; Clowdsley, Martha S.; Qualls, Garry D.; Sandridge, Christopher A.; Simonsen, Lisa C.; Norbury, John W.; Slaba, Tony C.; Walker, Steven A.; Badavi, Francis F.;

Perspectives on procedure-based assessments: a thematic analysis of semistructured interviews with 10 UK surgical trainees.

PubMed

Shalhoub, Joseph; Marshall, Dominic C; Ippolito, Kate

2017-03-24

The introduction of competency-based training has necessitated development and implementation of accompanying mechanisms for assessment. Procedure-based assessments (PBAs) are an example of workplace-based assessments that are used to examine focal competencies in the workplace. The primary objective was to understand surgical trainees' perspective on the value of PBA. Semistructured interviews with 10 surgical trainees individually interviewed to explore their views. Interviews were audio-recorded and transcribed; following this, they were open and axial coded. Thematic analysis was then performed. Semistructured interviews yielded several topical and recurring themes. In trainees' experience, the use of PBAs as a summative tool limits their educational value. Trainees reported a lack of support from seniors and variation in the usefulness of the tool based on stage of training. Concerns related to the validity of PBAs for evaluating trainees' performance with reports of 'gaming' the system and trainees completing their own assessments. Trainees did identify the significant value of PBAs when used correctly. Benefits included the identification of additional learning opportunities, standardisation of assessment and their role in providing a measure of progress. The UK surgical trainees interviewed identified both limitations and benefits to PBAs; however, we would argue based on their responses and our experience that their use as a summative tool limits their formative use as an educational opportunity. PBAs should either be used exclusively to support learning or solely as a summative tool; if so, further work is needed to audit, validate and standardise them for this purpose. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A GIS-BASED MODAL MODEL OF AUTOMOBILE EXHAUST EMISSIONS

EPA Science Inventory

The report presents progress toward the development of a computer tool called MEASURE, the Mobile Emission Assessment System for Urban and Regional Evaluation. The tool works toward a goal of providing researchers and planners with a way to assess new mobile emission mitigation s...

Symposium: A New Observation Tool for Looking at Inquiry-Based Teaching and Learning.

ERIC Educational Resources Information Center

Young, M. J.; And Others

This document comprises four papers from a symposium on using an inquiry-based observation tool for assessing teaching and learning on various educational levels. The first paper, "Introduction, and Overview and Use of the Tool for K-12 Science, Mathematics, and Technology Program Evaluation" (M. Jean Young), presents an overview of the tool…

Inter- and intraobserver repeatability of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To evaluate the inter- and intraobserver repeatability of the Salford Gait Tool (SF-GT), a new observation-based gait assessment tool for evaluating sagittal plane cerebral palsy (CP) gait. Masked comparative evaluation. University in the United Kingdom. A convenience sample of 23 pediatric physical therapists with varying degrees of clinical experience recruited from the Greater Manchester area. Participants viewed videotapes of the sagittal plane gait of 13 children and used the SF-GT to analyze their 13 different gait styles on 2 occasions. Eleven children had hemiplegic, diplegic, or quadriplegic CP and 2 were neurologically intact. Inter- and intraobserver repeatability of hip, knee, and ankle joint positions at 6 different phases of the gait cycle. The SF-GT demonstrated good interobserver (77%) and intraobserver (75%) repeatability. We have established that the SF-GT is a repeatable clinical assessment tool with which to guide the diagnosis, treatment planning, and evaluation of interventions by pediatric physical therapists of sagittal plane gait deviations in CP.

Multi Sector Planning Tools for Trajectory-Based Operations

NASA Technical Reports Server (NTRS)

Prevot, Thomas; Mainini, Matthew; Brasil, Connie

2010-01-01

This paper discusses a suite of multi sector planning tools for trajectory-based operations that were developed and evaluated in the Airspace Operations Laboratory (AOL) at the NASA Ames Research Center. The toolset included tools for traffic load and complexity assessment as well as trajectory planning and coordination. The situation assessment tools included an integrated suite of interactive traffic displays, load tables, load graphs, and dynamic aircraft filters. The planning toolset allowed for single and multi aircraft trajectory planning and data communication-based coordination of trajectories between operators. Also newly introduced was a real-time computation of sector complexity into the toolset that operators could use in lieu of aircraft count to better estimate and manage sector workload, especially in situations with convective weather. The tools were used during a joint NASA/FAA multi sector planner simulation in the AOL in 2009 that had multiple objectives with the assessment of the effectiveness of the tools being one of them. Current air traffic control operators who were experienced as area supervisors and traffic management coordinators used the tools throughout the simulation and provided their usefulness and usability ratings in post simulation questionnaires. This paper presents these subjective assessments as well as the actual usage data that was collected during the simulation. The toolset was rated very useful and usable overall. Many elements received high scores by the operators and were used frequently and successfully. Other functions were not used at all, but various requests for new functions and capabilities were received that could be added to the toolset.

Inspection of the Math Model Tools for On-Orbit Assessment of Impact Damage Report. Version 1.0

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Raju, Ivatury S.; Piascik, Robert S.; Kramer White, Julie; Labbe, Steve G.; Rotter, Hank A.

2005-01-01

In Spring of 2005, the NASA Engineering Safety Center (NESC) was engaged by the Space Shuttle Program (SSP) to peer review the suite of analytical tools being developed to support the determination of impact and damage tolerance of the Orbiter Thermal Protection Systems (TPS). The NESC formed an independent review team with the core disciplines of materials, flight sciences, structures, mechanical analysis and thermal analysis. The Math Model Tools reviewed included damage prediction and stress analysis, aeroheating analysis, and thermal analysis tools. Some tools are physics-based and other tools are empirically-derived. Each tool was created for a specific use and timeframe, including certification, real-time pre-launch assessments, and real-time on-orbit assessments. The tools are used together in an integrated strategy for assessing the ramifications of impact damage to tile and RCC. The NESC teams conducted a peer review of the engineering data package for each Math Model Tool. This report contains the summary of the team observations and recommendations from these reviews.

Venous Thromboembolism Prophylaxis in Outpatient Lower Limb Fractures and Injuries.

PubMed

Ajwani, Sanil H; Shaw, Alex; Naiz, Osamah; Bhaskar, Deepu; Charalambous, Charalambos P

2016-05-05

The risk of venous thromboembolism (VTE) is a preventable complication of trauma in ambulatory patients requiring temporary lower limb immobilisation. We introduced a VTE risk assessment and management tool in fracture clinics, to help improve appropriate VTE management of trauma patients that do not require hospitalisation. This was based on guidelines published by the College of Emergency Medicine (UK). Clinicians were asked to follow the screening tool and manage patients as per the pathway. We aimed to determine the rate of VTE risk assessment and management of outpatient fracture patients following the introduction of the new assessment tool. We prospectively evaluated a cohort of lower limb fracture patients presenting to a fracture clinic following the introduction of the new VTE risk assessment group and compared it to a retrospective cohort treated prior to the new tool. Prior to introduction of the new assessment tool only 5 of 30 (16.7%) patients were assessed for VTE risk. After introduction of the VTE screening tool, 27 of 28 patients (96.4%) were assessed for VTE risk (P<0.001). We are able to show that implementing a VTE screening tool in an orthopaedic outpatient fracture clinic to patients with lower limb trauma requiring temporary limb immobilisation can improve VTE risk assessment in accordance with current guidelines.

Interchange Safety Analysis Tool (ISAT) : user manual

DOT National Transportation Integrated Search

2007-06-01

This User Manual describes the usage and operation of the spreadsheet-based Interchange Safety Analysis Tool (ISAT). ISAT provides design and safety engineers with an automated tool for assessing the safety effects of geometric design and traffic con...

Scientific Overview /Regional Analyses and Approaches

EPA Science Inventory

A workshop, Tools for Assessing Stream Dissolved Minerals, will introduce approaches and EPA tools for regional and site specific development of water quality criteria based on observations from Arkansas streams. In this presentation regional approaches and tools are described. ...

Development of the Aboriginal Communication Assessment After Brain Injury (ACAABI): A screening tool for identifying acquired communication disorders in Aboriginal Australians.

PubMed

Armstrong, Elizabeth M; Ciccone, Natalie; Hersh, Deborah; Katzenellebogen, Judith; Coffin, Juli; Thompson, Sandra; Flicker, Leon; Hayward, Colleen; Woods, Deborah; McAllister, Meaghan

2017-06-01

Acquired communication disorders (ACD), following stroke and traumatic brain injury, may not be correctly identified in Aboriginal Australians due to a lack of linguistically and culturally appropriate assessment tools. Within this paper we explore key issues that were considered in the development of the Aboriginal Communication Assessment After Brain Injury (ACAABI) - a screening tool designed to assess the presence of ACD in Aboriginal populations. A literature review and consultation with key stakeholders were undertaken to explore directions needed to develop a new tool, based on existing tools and recommendations for future developments. The literature searches revealed no existing screening tool for ACD in these populations, but identified tools in the areas of cognition and social-emotional wellbeing. Articles retrieved described details of the content and style of these tools, with recommendations for the development and administration of a new tool. The findings from the interview and focus group views were consistent with the approach recommended in the literature. There is a need for a screening tool for ACD to be developed but any tool must be informed by knowledge of Aboriginal language, culture and community input in order to be acceptable and valid.

Employability Skills Assessment Tool Development

ERIC Educational Resources Information Center

Rasul, Mohamad Sattar; Rauf, Rose Amnah Abd; Mansor, Azlin Norhaini; Puvanasvaran, A. P.

2012-01-01

Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

Gaze-Based Assistive Technology - Usefulness in Clinical Assessments.

PubMed

Wandin, Helena

2017-01-01

Gaze-based assistive technology was used in informal clinical assessments. Excerpts of medical journals were analyzed by directed content analysis using a model of communicative competence. The results of this pilot study indicate that gaze-based assistive technology is a useful tool in communication assessments that can generate clinically relevant information.

Laboratory and field measurements and evaluations of vibration at the handles of riveting hammers

PubMed Central

McDOWELL, THOMAS W.; WARREN, CHRISTOPHER; WELCOME, DANIEL E.; DONG, REN G.

2015-01-01

The use of riveting hammers can expose workers to harmful levels of hand-transmitted vibration (HTV). As a part of efforts to reduce HTV exposures through tool selection, the primary objective of this study was to evaluate the applicability of a standardized laboratory-based riveting hammer assessment protocol for screening riveting hammers. The second objective was to characterize the vibration emissions of reduced vibration riveting hammers and to make approximations of the HTV exposures of workers operating these tools in actual work tasks. Eight pneumatic riveting hammers were selected for the study. They were first assessed in a laboratory using the standardized method for measuring vibration emissions at the tool handle. The tools were then further assessed under actual working conditions during three aircraft sheet metal riveting tasks. Although the average vibration magnitudes of the riveting hammers measured in the laboratory test were considerably different from those measured in the field study, the rank orders of the tools determined via these tests were fairly consistent, especially for the lower vibration tools. This study identified four tools that consistently exhibited lower frequency-weighted and unweighted accelerations in both the laboratory and workplace evaluations. These observations suggest that the standardized riveting hammer test is acceptable for identifying tools that could be expected to exhibit lower vibrations in workplace environments. However, the large differences between the accelerations measured in the laboratory and field suggest that the standardized laboratory-based tool assessment is not suitable for estimating workplace riveting hammer HTV exposures. Based on the frequency-weighted accelerations measured at the tool handles during the three work tasks, the sheet metal mechanics assigned to these tasks at the studied workplace are unlikely to exceed the daily vibration exposure action value (2.5 m s−2) using any of the evaluated riveting hammers. PMID:22539561

Initial Validation of the Usage Rating Profile-Assessment for Use within German Language Schools

ERIC Educational Resources Information Center

Briesch, Amy M.; Casale, Gino; Grosche, Michael; Volpe, Robert J.; Hennemann, Thomas

2017-01-01

Modern attempts to explain why some assessment tools are readily adopted by school-based personnel whereas others are not have focused on the concept of usability. Usability encompasses not only the degree to which consumers find an assessment tool to be acceptable, but also the degree to which it is well-understood, believed to be feasible,…

An aquatic multiscale assessment and planning framework approach—forest plan revision case study

Treesearch

Kerry Overton; Ann D. Carlson; Cynthia Tait

2010-01-01

The Aquatic Multiscale Assessment and Planning Framework is a Web-based decision-support tool developed to assist aquatic practitioners in managing fisheries and watershed information. This tool, or framework, was designed to assist resource assessments and planning efforts from the broad scale to the fine scale, to document procedures, and to link directly to relevant...

Speech and Language Disorders in Kenyan Children: Adapting Tools For Regions With Few Assessment Resources

PubMed Central

Carter, Julie Anne; Murira, Grace; Gona, Joseph; Tumaini, Judy; Lees, Janet; Neville, Brian George; Newton, Charles Richard

2013-01-01

This study sought to adapt a battery of Western speech and language assessment tools to a rural Kenyan setting. The tool was developed for children whose first language was KiGiryama, a Bantu language. A total of 539 Kenyan children (males=271, females=268, ethnicity=100% Kigiryama. Data were collected from 303 children admitted to hospital with severe malaria and 206 age-matched children recruited from the village communities. The language assessments were based upon the Content, Form and Use (C/F/U) model. The assessment was based upon the adapted versions of the Peabody Picture Vocabulary Test, Test for the Reception of Grammar, Renfrew Action Picture Test, Pragmatics Profile of Everyday Communication Skills in Children, Test of Word Finding and language specific tests of lexical semantics, higher level language. Preliminary measures of construct validity suggested that the theoretical assumptions behind the construction of the assessments were appropriate and re-test and inter-rater reliability scores were acceptable. These findings illustrate the potential to adapt Western speech and language assessments in other languages and settings, particularly those in which there is a paucity of standardised tools. PMID:24294109

Strategic Planning Tools for Large-Scale Technology-Based Assessments

ERIC Educational Resources Information Center

Koomen, Marten; Zoanetti, Nathan

2018-01-01

Education systems are increasingly being called upon to implement new technology-based assessment systems that generate efficiencies, better meet changing stakeholder expectations, or fulfil new assessment purposes. These assessment systems require coordinated organisational effort to implement and can be expensive in time, skill and other…

Data Center IT Equipment Energy Assessment Tools: Current State of Commercial Tools, Proposal for a Future Set of Assessment Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Radhakrishnan, Ben D.

2012-06-30

This research project, which was conducted during the Summer and Fall of 2011, investigated some commercially available assessment tools with a focus on IT equipment to see if such tools could round out the DC Pro tool suite. In this research, the assessment capabilities of the various tools were compiled to help make “non-biased” information available to the public. This research should not be considered to be exhaustive on all existing vendor tools although a number of vendors were contacted. Large IT equipment OEM’s like IBM and Dell provide their proprietary internal automated software which does not work on anymore » other IT equipment. However, found two companies with products that showed promise in performing automated assessments for IT equipment from different OEM vendors. This report documents the research and provides a list of software products reviewed, contacts and websites, product details, discussions with specific companies, a set of recommendations, and next steps. As a result of this research, a simple 3-level approach to an IT assessment tool is proposed along with an example of an assessment using a simple IT equipment data collection tool (Level 1, spreadsheet). The tool has been reviewed with the Green Grid and LBNL staff. The initial feedback has been positive although further refinement to the tool will be necessary. Proposed next steps include a field trial of at least two vendors’ software in two different data centers with an objective to prove the concept, ascertain the extent of energy and computational assessment, ease of installation and opportunities for continuous improvement. Based on the discussions, field trials (or case studies) are proposed with two vendors – JouleX (expected to be completed in 2012) and Sentilla.« less

Cognitive assessment tools in Asia: a systematic review.

PubMed

Rosli, Roshaslina; Tan, Maw Pin; Gray, William Keith; Subramanian, Pathmawathi; Chin, Ai-Vyrn

2016-02-01

The prevalence of dementia is increasing in Asia than in any other continent. However, the applicability of the existing cognitive assessment tools is limited by differences in educational and cultural factors in this setting. We conducted a systematic review of published studies on cognitive assessments tools in Asia. We aimed to rationalize the results of available studies which evaluated the validity of cognitive tools for the detection of cognitive impairment and to identify the issues surrounding the available cognitive impairment screening tools in Asia. Five electronic databases (CINAHL, MEDLINE, Embase, Cochrane Library, and Science Direct) were searched using the keywords dementia Or Alzheimer Or cognitive impairment And screen Or measure Or test Or tool Or instrument Or assessment, and 2,381 articles were obtained. Thirty-eight articles, evaluating 28 tools in seven Asian languages, were included. Twenty-nine (76%) of the studies had been conducted in East Asia with only four studies conducted in South Asia and no study from northern, western, or central Asia or Indochina. Local language translations of the Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA) were assessed in 15 and six studies respectively. Only three tools (the Korean Dementia Screening Questionnaire, the Picture-based Memory Intelligence Scale, and the revised Hasegawa Dementia Screen) were derived de novo from Asian populations. These tools were assessed in five studies. Highly variable cut-offs were reported for the MMSE (17-29/30) and MoCA (21-26/30), with 13/19 (68%) of studies reporting educational bias. Few cognitive assessment tools have been validated in Asia, with no published validation studies for many Asian nations and languages. In addition, many available tools display educational bias. Future research should include concerted efforts to develop culturally appropriate tools with minimal educational bias.

Computer assisted blast design and assessment tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cameron, A.R.; Kleine, T.H.; Forsyth, W.W.

1995-12-31

In general the software required by a blast designer includes tools that graphically present blast designs (surface and underground), can analyze a design or predict its result, and can assess blasting results. As computers develop and computer literacy continues to rise the development of and use of such tools will spread. An example of the tools that are becoming available includes: Automatic blast pattern generation and underground ring design; blast design evaluation in terms of explosive distribution and detonation simulation; fragmentation prediction; blast vibration prediction and minimization; blast monitoring for assessment of dynamic performance; vibration measurement, display and signal processing;more » evaluation of blast results in terms of fragmentation; and risk and reliability based blast assessment. The authors have identified a set of criteria that are essential in choosing appropriate software blasting tools.« less

Screening tool to evaluate the vulnerability of down-gradient receptors to groundwater contaminants from uncapped landfills

USGS Publications Warehouse

Baker, Ronald J.; Reilly, Timothy J.; Lopez, Anthony R.; Romanok, Kristin M.; Wengrowski, Edward W

2015-01-01

A screening tool for quantifying levels of concern for contaminants detected in monitoring wells on or near landfills to down-gradient receptors (streams, wetlands and residential lots) was developed and evaluated. The tool uses Quick Domenico Multi-scenario (QDM), a spreadsheet implementation of Domenico-based solute transport, to estimate concentrations of contaminants reaching receptors under steady-state conditions from a constant-strength source. Unlike most other available Domenico-based model applications, QDM calculates the time for down-gradient contaminant concentrations to approach steady state and appropriate dispersivity values, and allows for up to fifty simulations on a single spreadsheet. Sensitivity of QDM solutions to critical model parameters was quantified. The screening tool uses QDM results to categorize landfills as having high, moderate and low levels of concern, based on contaminant concentrations reaching receptors relative to regulatory concentrations. The application of this tool was demonstrated by assessing levels of concern (as defined by the New Jersey Pinelands Commission) for thirty closed, uncapped landfills in the New Jersey Pinelands National Reserve, using historic water-quality data from monitoring wells on and near landfills and hydraulic parameters from regional flow models. Twelve of these landfills are categorized as having high levels of concern, indicating a need for further assessment. This tool is not a replacement for conventional numerically-based transport model or other available Domenico-based applications, but is suitable for quickly assessing the level of concern posed by a landfill or other contaminant point source before expensive and lengthy monitoring or remediation measures are taken. In addition to quantifying the level of concern using historic groundwater-monitoring data, the tool allows for archiving model scenarios and adding refinements as new data become available.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

Experts by experience; the views of service user educators providing feedback on medical students' work based assessments.

PubMed

Muir, Delia; Laxton, Julie Clare

2012-02-01

Assessment tools were designed to provide health and social care students with multi-sourced, interprofessional feedback in practice. This includes feedback from service users. Third year medical students at the University of Leeds were given accesses to 4 assessment tools whilst in practice. Completed assessments were then sent to the university where service users and carers worked with university tutors to give further feedback and comment on the overall development of students. Three service users then took part in a focus group and one provided written feedback. Four key themes were identified from the focus group: • Preparation and support • The design of the tools • The process of using the tools in practice • Feedback. We found that the project provided both challenges and rewards for all involved. The service user educators involved were able to bring a different and valuable perspective to formative feedback. The combination of their personal and professional experiences, along with the preparation they had received, helped bridge the gap between service users in practice and university based tutors. The findings from this study went on to inform a review of the assessment tools and revised versions are now being used. Copyright © 2011 Elsevier Ltd. All rights reserved.

Combining multi-criteria decision analysis and mini-health technology assessment: A funding decision-support tool for medical devices in a university hospital setting.

PubMed

Martelli, Nicolas; Hansen, Paul; van den Brink, Hélène; Boudard, Aurélie; Cordonnier, Anne-Laure; Devaux, Capucine; Pineau, Judith; Prognon, Patrice; Borget, Isabelle

2016-02-01

At the hospital level, decisions about purchasing new and oftentimes expensive medical devices must take into account multiple criteria simultaneously. Multi-criteria decision analysis (MCDA) is increasingly used for health technology assessment (HTA). One of the most successful hospital-based HTA approaches is mini-HTA, of which a notable example is the Matrix4value model. To develop a funding decision-support tool combining MCDA and mini-HTA, based on Matrix4value, suitable for medical devices for individual patient use in French university hospitals - known as the IDA tool, short for 'innovative device assessment'. Criteria for assessing medical devices were identified from a literature review and a survey of 18 French university hospitals. Weights for the criteria, representing their relative importance, were derived from a survey of 25 members of a medical devices committee using an elicitation technique involving pairwise comparisons. As a test of its usefulness, the IDA tool was applied to two new drug-eluting beads (DEBs) for transcatheter arterial chemoembolization. The IDA tool comprises five criteria and weights for each of two over-arching categories: risk and value. The tool revealed that the two new DEBs conferred no additional value relative to DEBs currently available. Feedback from participating decision-makers about the IDA tool was very positive. The tool could help to promote a more structured and transparent approach to HTA decision-making in French university hospitals. Copyright © 2015 Elsevier Inc. All rights reserved.

An integrated risk assessment tool for team-based periodontal disease management.

PubMed

Thyvalikakath, Thankam P; Padman, Rema; Gupta, Sugandh

2013-01-01

Mounting evidence suggests a potential association of periodontal disease with systemic diseases such as diabetes, cardiovascular disease, cancer and stroke. The objective of this study is to develop an integrated risk assessment tool that displays a patients' risk for periodontal disease in the context of their systemic disease, social habits and oral health. Such a tool will be used by not just dental professionals but also by care providers who participate in the team-based care for chronic disease management. Displaying relationships between risk factors and its influence on the patient's general health could be a powerful educational and disease management tool for patients and clinicians. It may also improve the coordination of care provided by the provider-members of a chronic care team.

Toward competency-based curriculum: Application of workplace-based assessment tools in the National Saudi Arabian Anesthesia Training Program.

PubMed

Boker, Ama

2016-01-01

The anesthesia training program of the Saudi Commission for health specialties has introduced a developed competency-based anesthesia residency program starting from 2015 with the utilization of the workplace-based assessment (WBA) tools, namely mini-clinical exercises (mini-CEX), direct observation of procedural skills (DOPS), and case-based discussion (CBD). This work aimed to describe the process of development of anesthesia-specific list of mini-CEX, DOPS, and CBD tools within the Saudi Arabian Anesthesia Training Programs. To introduce the main concepts of formative WBA tools and to develop anesthesia-specific applications for each of the selected WBA tools, four 1-day workshops were held at the level of major training committees at eastern (Dammam), western (Jeddah), and central (Riyadh) regions in the Kingdom were conducted. Sixty-seven faculties participated in these workshops. After conduction of the four workshops, the anesthesia-specific applications setting of mini-CEX, DOPS, and CBD tools among the 5-year levels were fully described. The level of the appropriate consultation skills was divided according to the case complexity adopted from the American Society of Anesthesiologists physical classification for adult and obstetric and pediatric patient as well as the type of the targeted anesthetic procedure. WBA anesthesia-specific lists of mini-CEX, DOPS, and CBD forms were easily incorporated first into guidelines to help the first stage of implementation of formative assessment in the Saudi Arabian Anesthesia Residency Program, and this can be helpful to replicate such program within other various training programs in Saudi Arabia and abroad.

Multicomponent Musculoskeletal Movement Assessment Tools: A Systematic Review and Critical Appraisal of Their Development and Applicability to Professional Practice.

PubMed

Bennett, Hunter; Davison, Kade; Arnold, John; Slattery, Flynn; Martin, Max; Norton, Kevin

2017-10-01

Multicomponent movement assessment tools have become commonplace to measure movement quality, proposing to indicate injury risk and performance capabilities. Despite popular use, there has been no attempt to compare the components of each tool reported in the literature, the processes in which they were developed, or the underpinning rationale for their included content. As such, the objective of this systematic review was to provide a comprehensive summary of current movement assessment tools and appraise the evidence supporting their development. A systematic literature search was performed using PRISMA guidelines to identify multicomponent movement assessment tools. Commonalities between tools and the evidence provided to support the content of each tool was identified. Each tool underwent critical appraisal to identify the rigor in which it was developed, and its applicability to professional practice. Eleven tools were identified, of which 5 provided evidence to support their content as assessments of movement quality. One assessment tool (Soccer Injury Movement Screen [SIMS]) received an overall score of above 65% on critical appraisal, with a further 2 tools (Movement Competency Screen [MCS] and modified 4 movement screen [M4-MS]) scoring above 60%. Only the MCS provided clear justification for its developmental process. The remaining 8 tools scored between 40 and 60%. On appraisal, the MCS, M4-MS, and SIMS seem to provide the most practical value for assessing movement quality as they provide the strongest reports of developmental rigor and an identifiable evidence base. In addition, considering the evidence provided, these tools may have the strongest potential for identifying performance capabilities and guiding exercise prescription in athletic and sport-specific populations.

Assessment in Performance-Based Secondary Music Classes

ERIC Educational Resources Information Center

Pellegrino, Kristen; Conway, Colleen M.; Russell, Joshua A.

2015-01-01

After sharing research findings about grading and assessment practices in secondary music ensemble classes, we offer examples of commonly used assessment tools (ratings scale, checklist, rubric) for the performance ensemble. Then, we explore the various purposes of assessment in performance-based music courses: (1) to meet state, national, and…

Computational assessment of hemodynamics-based diagnostic tools using a database of virtual subjects: Application to three case studies.

PubMed

Willemet, Marie; Vennin, Samuel; Alastruey, Jordi

2016-12-08

Many physiological indexes and algorithms based on pulse wave analysis have been suggested in order to better assess cardiovascular function. Because these tools are often computed from in-vivo hemodynamic measurements, their validation is time-consuming, challenging, and biased by measurement errors. Recently, a new methodology has been suggested to assess theoretically these computed tools: a database of virtual subjects generated using numerical 1D-0D modeling of arterial hemodynamics. The generated set of simulations encloses a wide selection of healthy cases that could be encountered in a clinical study. We applied this new methodology to three different case studies that demonstrate the potential of our new tool, and illustrated each of them with a clinically relevant example: (i) we assessed the accuracy of indexes estimating pulse wave velocity; (ii) we validated and refined an algorithm that computes central blood pressure; and (iii) we investigated theoretical mechanisms behind the augmentation index. Our database of virtual subjects is a new tool to assist the clinician: it provides insight into the physical mechanisms underlying the correlations observed in clinical practice. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Periodontal Management by Risk Assessment: A Pragmatic Approach.

PubMed

Mullins, Joanna M; Even, Joshua B; White, Joel M

2016-06-01

An evidence-based periodontal disease risk assessment and diagnosis system has been developed and combined with a clinical decision support and management program to improve treatment and measure patient outcomes. There is little agreement on a universally accepted periodontal risk assessment, periodontal diagnosis, and treatment management tool and their incorporation into dental practice to improve patient care. This article highlights the development and use of a practical periodontal management and risk assessment program that can be implemented in dental settings. The approach taken by Willamette Dental Group to develop a periodontal disease risk assessment, periodontal diagnosis, and treatment management tool is described using evidence-based best practices. With goals of standardized treatment interventions while maintaining personalized care and improved communication, this process is described to facilitate its incorporation into other dental settings. Current electronic health records can be leveraged to enhance patient-centered care through the use of risk assessments and standardized guidelines to more effectively assess, diagnose, and treat patients to improve outcomes. Dental hygienists, and other committed providers, with their emphasis on prevention of periodontal disease can be principal drivers in creation and implementation of periodontal risk assessments and personalized treatment planning. Willamette Dental Group believes that such evidence-based tools can advance dentistry to new diagnostic and treatment standards. Copyright © 2016 Elsevier Inc. All rights reserved.

Developing an SSAC Self-Assessment Tool for Operators and Regulators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Frazar, Sarah L.; Innes-Jones, Gemma; Hamilton, Ian

Enabling an SSAC to understand why it is performing inefficiently can help it allocate resources more effectively to better support IAEA safeguards implementation. In collaboration with international consulting firm, Environmental Resources Management (ERM) and a U.S. based nuclear fuel cycle facility, the Pacific Northwest National Laboratory (PNNL) has been developing a framework for a future self-assessment tool for nuclear operators and regulators. This paper will describe the effort to date, with particular emphasis on the steps the team took to align the framework with relevant IAEA self-assessment tools.

Measuring activities and participation in persons with haemophilia: A systematic review of commonly used instruments.

PubMed

Timmer, M A; Gouw, S C; Feldman, B M; Zwagemaker, A; de Kleijn, P; Pisters, M F; Schutgens, R E G; Blanchette, V; Srivastava, A; David, J A; Fischer, K; van der Net, J

2018-03-01

Monitoring clinical outcome in persons with haemophilia (PWH) is essential in order to provide optimal treatment for individual patients and compare effectiveness of treatment strategies. Experience with measurement of activities and participation in haemophilia is limited and consensus on preferred tools is lacking. The aim of this study was to give a comprehensive overview of the measurement properties of a selection of commonly used tools developed to assess activities and participation in PWH. Electronic databases were searched for articles that reported on reliability, validity or responsiveness of predetermined measurement tools (5 self-reported and 4 performance based measurement tools). Methodological quality of the studies was assessed according to the COSMIN checklist. Best evidence synthesis was used to summarize evidence on the measurement properties. The search resulted in 3453 unique hits. Forty-two articles were included. The self-reported Haemophilia Acitivity List (HAL), Pediatric HAL (PedHAL) and the performance based Functional Independence Score in Haemophilia (FISH) were studied most extensively. Methodological quality of the studies was limited. Measurement error, cross-cultural validity and responsiveness have been insufficiently evaluated. Albeit based on limited evidence, the measurement properties of the PedHAL, HAL and FISH are currently considered most satisfactory. Further research needs to focus on measurement error, responsiveness, interpretability and cross-cultural validity of the self-reported tools and validity of performance based tools which are able to assess limitations in sports and leisure activities. © 2018 The Authors. Haemophilia Published by John Wiley & Sons Ltd.

Inspection of the Math Model Tools for On-Orbit Assessment of Impact Damage Report

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Raju, Ivatury S.; Piascik, Robert S> ; KramerWhite, Julie A.; KramerWhite, Julie A.; Labbe, Steve G.; Rotter, Hank A.

2007-01-01

In Spring of 2005, the NASA Engineering Safety Center (NESC) was engaged by the Space Shuttle Program (SSP) to peer review the suite of analytical tools being developed to support the determination of impact and damage tolerance of the Orbiter Thermal Protection Systems (TPS). The NESC formed an independent review team with the core disciplines of materials, flight sciences, structures, mechanical analysis and thermal analysis. The Math Model Tools reviewed included damage prediction and stress analysis, aeroheating analysis, and thermal analysis tools. Some tools are physics-based and other tools are empirically-derived. Each tool was created for a specific use and timeframe, including certification, real-time pre-launch assessments. In addition, the tools are used together in an integrated strategy for assessing the ramifications of impact damage to tile and RCC. The NESC teams conducted a peer review of the engineering data package for each Math Model Tool. This report contains the summary of the team observations and recommendations from these reviews.

Rural Food and Physical Activity Assessment Using an Electronic Tablet-Based Application, New York, 2013–2014

PubMed Central

Morgan, Emily H.; Connor, Leah M.; Garner, Jennifer A.; King, Abby C.; Sheats, Jylana L.; Winter, Sandra J.; Buman, Matthew P.

2015-01-01

Introduction A community’s built environment can influence health behaviors. Rural populations experience significant health disparities, yet built environment studies in these settings are limited. We used an electronic tablet-based community assessment tool to conduct built environment audits in rural settings. The primary objective of this qualitative study was to evaluate the usefulness of the tool in identifying barriers and facilitators to healthy eating and active living. The second objective was to understand resident perspectives on community features and opportunities for improvement. Methods Participants were recruited from 4 rural communities in New York State. Using the tool, participants completed 2 audits, which consisted of taking pictures and recording audio narratives about community features perceived as assets or barriers to healthy eating and active living. Follow-up focus groups explored the audit experience, data captured, and opportunities for change. Results Twenty-four adults (mean age, 69.4 y [standard deviation, 13.2 y]), 6 per community, participated in the study. The most frequently captured features related to active living were related to roads, sidewalks, and walkable destinations. Restaurants, nontraditional food stores, and supermarkets were identified in the food environment in relation to the cost, quality, and selection of healthy foods available. In general, participants found the assessment tool to be simple and enjoyable to use. Conclusion An electronic tablet–based tool can be used to assess rural food and physical activity environments and may be useful in identifying and prioritizing resident-led change initiatives. This resident-led assessment approach may also be helpful for informing and evaluating rural community-based interventions. PMID:26133645

Estimation of portion size in children's dietary assessment: lessons learnt.

PubMed

Foster, E; Adamson, A J; Anderson, A S; Barton, K L; Wrieden, W L

2009-02-01

Assessing the dietary intake of young children is challenging. In any 1 day, children may have several carers responsible for providing them with their dietary requirements, and once children reach school age, traditional methods such as weighing all items consumed become impractical. As an alternative to weighed records, food portion size assessment tools are available to assist subjects in estimating the amounts of foods consumed. Existing food photographs designed for use with adults and based on adult portion sizes have been found to be inappropriate for use with children. This article presents a review and summary of a body of work carried out to improve the estimation of portion sizes consumed by children. Feasibility work was undertaken to determine the accuracy and precision of three portion size assessment tools; food photographs, food models and a computer-based Interactive Portion Size Assessment System (IPSAS). These tools were based on portion sizes served to children during the National Diet and Nutrition Survey. As children often do not consume all of the food served to them, smaller portions were included in each tool for estimation of leftovers. The tools covered 22 foods, which children commonly consume. Children were served known amounts of each food and leftovers were recorded. They were then asked to estimate both the amount of food that they were served and the amount of any food leftover. Children were found to estimate food portion size with an accuracy approaching that of adults using both the food photographs and IPSAS. Further development is underway to increase the number of food photographs and to develop IPSAS to cover a much wider range of foods and to validate the use of these tools in a 'real life' setting.

Biodiversity in environmental assessment-current practice and tools for prediction

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gontier, Mikael; Balfors, Berit; Moertberg, Ulla

Habitat loss and fragmentation are major threats to biodiversity. Environmental impact assessment and strategic environmental assessment are essential instruments used in physical planning to address such problems. Yet there are no well-developed methods for quantifying and predicting impacts of fragmentation on biodiversity. In this study, a literature review was conducted on GIS-based ecological models that have potential as prediction tools for biodiversity assessment. Further, a review of environmental impact statements for road and railway projects from four European countries was performed, to study how impact prediction concerning biodiversity issues was addressed. The results of the study showed the existing gapmore » between research in GIS-based ecological modelling and current practice in biodiversity assessment within environmental assessment.« less

Development and validation of the TOCO-TURBT tool: a summative assessment tool that measures surgical competency in transurethral resection of bladder tumour.

PubMed

de Vries, Anna H; Muijtjens, Arno M M; van Genugten, Hilde G J; Hendrikx, Ad J M; Koldewijn, Evert L; Schout, Barbara M A; van der Vleuten, Cees P M; Wagner, Cordula; Tjiam, Irene M; van Merriënboer, Jeroen J G

2018-06-05

The current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT). The 'Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n = 15), procedural (n = 21), and completion (n = 15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory. The majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r > 0.5, p < 0.01). Generalizability-theory analysis showed high reliability (coefficient Phi ≥ 0.8) when using the format of two assessors and two cases. This study provides first evidence that the TOCO-TURBT tool is a feasible, valid and reliable assessment tool for measuring competency in TURBT. The tool has the potential to be used for future certification of competencies for residents and urologists. The methodology of CTA might be valuable in the development of assessment tools in other areas of clinical practice.

Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review

PubMed Central

Page, Matthew J; McKenzie, Joanne E; Higgins, Julian P T

2018-01-01

Background Several scales, checklists and domain-based tools for assessing risk of reporting biases exist, but it is unclear how much they vary in content and guidance. We conducted a systematic review of the content and measurement properties of such tools. Methods We searched for potentially relevant articles in Ovid MEDLINE, Ovid Embase, Ovid PsycINFO and Google Scholar from inception to February 2017. One author screened all titles, abstracts and full text articles, and collected data on tool characteristics. Results We identified 18 tools that include an assessment of the risk of reporting bias. Tools varied in regard to the type of reporting bias assessed (eg, bias due to selective publication, bias due to selective non-reporting), and the level of assessment (eg, for the study as a whole, a particular result within a study or a particular synthesis of studies). Various criteria are used across tools to designate a synthesis as being at ‘high’ risk of bias due to selective publication (eg, evidence of funnel plot asymmetry, use of non-comprehensive searches). However, the relative weight assigned to each criterion in the overall judgement is unclear for most of these tools. Tools for assessing risk of bias due to selective non-reporting guide users to assess a study, or an outcome within a study, as ‘high’ risk of bias if no results are reported for an outcome. However, assessing the corresponding risk of bias in a synthesis that is missing the non-reported outcomes is outside the scope of most of these tools. Inter-rater agreement estimates were available for five tools. Conclusion There are several limitations of existing tools for assessing risk of reporting biases, in terms of their scope, guidance for reaching risk of bias judgements and measurement properties. Development and evaluation of a new, comprehensive tool could help overcome present limitations. PMID:29540417

Assessment of driving-related skills for older drivers : traffic tech.

DOT National Transportation Integrated Search

2010-04-01

Relating behind-the-wheel driving performance to performance : on office-based screening tools is challenging. It is : important to use tools that are predictive of poor driving : performance (sensitivity), but also to find tools that do not : have h...

Integrating Diabetes Guidelines into a Telehealth Screening Tool.

PubMed

Gervera, Kelly; Graves, Barbara Ann

2015-01-01

Diabetes is the seventh leading cause of death in the United States and contributes to long-term complications that are costly to healthcare systems. Twenty-five percent of all veterans in the Veterans Health Administration (VHA) have diabetes. The purpose of this article is to describe the development and implementation of a quality improvement project to embed an evidence-based diabetes screening tool, based on Veterans Affairs/Department of Defense diabetes clinical practice guidelines, into the VHA electronic medical record. The objectives of the screening tool were threefold: to promote evidence-based care, to standardize care coordination, and to promote self-management and proper utilization of resources. Record reviews were conducted to evaluate the effectiveness of the screening tool. Results showed an 88 percent increase in the assessment of annual exams and/or labs, a 16.5 percent increase in disease management assessment and offering of services, and a 50 percent increase in goal-setting activity.

Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours

PubMed Central

Wong, William CW; Cheung, Catherine SK; Hart, Graham J

2008-01-01

Background Systematic reviews based on the critical appraisal of observational and analytic studies on HIV prevalence and risk factors for HIV transmission among men having sex with men are very useful for health care decisions and planning. Such appraisal is particularly difficult, however, as the quality assessment tools available for use with observational and analytic studies are poorly established. Methods We reviewed the existing quality assessment tools for systematic reviews of observational studies and developed a concise quality assessment checklist to help standardise decisions regarding the quality of studies, with careful consideration of issues such as external and internal validity. Results A pilot version of the checklist was developed based on epidemiological principles, reviews of study designs, and existing checklists for the assessment of observational studies. The Quality Assessment Tool for Systematic Reviews of Observational Studies (QATSO) Score consists of five items: External validity (1 item), reporting (2 items), bias (1 item) and confounding factors (1 item). Expert opinions were sought and it was tested on manuscripts that fulfil the inclusion criteria of a systematic review. Like all assessment scales, QATSO may oversimplify and generalise information yet it is inclusive, simple and practical to use, and allows comparability between papers. Conclusion A specific tool that allows researchers to appraise and guide study quality of observational studies is developed and can be modified for similar studies in the future. PMID:19014686

Protocol for a prospective, school-based standardisation study of a digital social skills assessment tool for children: The Paediatric Evaluation of Emotions, Relationships, and Socialisation (PEERS) study

PubMed Central

Thompson, Emma J; Beauchamp, Miriam H; Darling, Simone J; Hearps, Stephen J C; Brown, Amy; Charalambous, George; Crossley, Louise; Darby, David; Dooley, Julian J; Greenham, Mardee; Jaimangal, Mohinder; McDonald, Skye; Muscara, Frank; Turkstra, Lyn; Anderson, Vicki A

2018-01-01

Background Humans are by nature a social species, with much of human experience spent in social interaction. Unsurprisingly, social functioning is crucial to well-being and quality of life across the lifespan. While early intervention for social problems appears promising, our ability to identify the specific impairments underlying their social problems (eg, social communication) is restricted by a dearth of accurate, ecologically valid and comprehensive child-direct assessment tools. Current tools are largely limited to parent and teacher ratings scales, which may identify social dysfunction, but not its underlying cause, or adult-based experimental tools, which lack age-appropriate norms. The present study describes the development and standardisation of Paediatric Evaluation of Emotions, Relationships, and Socialisation (PEERS®), an iPad-based social skills assessment tool. Methods The PEERS project is a cross-sectional study involving two groups: (1) a normative group, recruited from early childhood, primary and secondary schools across metropolitan and regional Victoria, Australia; and (2) a clinical group, ascertained from outpatient services at The Royal Children’s Hospital Melbourne (RCH). The project aims to establish normative data for PEERS®, a novel and comprehensive app-delivered child-direct measure of social skills for children and youth. The project involves recruiting and assessing 1000 children aged 4.0–17.11 years. Assessments consist of an intellectual screen, PEERS® subtests, and PEERS-Q, a self-report questionnaire of social skills. Parents and teachers also complete questionnaires relating to participants’ social skills. Main analyses will comprise regression-based continuous norming, factor analysis and psychometric analysis of PEERS® and PEERS-Q. Ethics and dissemination Ethics approval has been obtained through the RCH Human Research Ethics Committee (34046), the Victorian Government Department of Education and Early Childhood Development (002318), and Catholic Education Melbourne (2166). Findings will be disseminated through international conferences and peer-reviewed journals. Following standardisation of PEERS®, the tool will be made commercially available. PMID:29439065

Review on pen-and-paper-based observational methods for assessing ergonomic risk factors of computer work.

PubMed

Rahman, Mohd Nasrull Abdol; Mohamad, Siti Shafika

2017-01-01

Computer works are associated with Musculoskeletal Disorders (MSDs). There are several methods have been developed to assess computer work risk factor related to MSDs. This review aims to give an overview of current techniques available for pen-and-paper-based observational methods in assessing ergonomic risk factors of computer work. We searched an electronic database for materials from 1992 until 2015. The selected methods were focused on computer work, pen-and-paper observational methods, office risk factors and musculoskeletal disorders. This review was developed to assess the risk factors, reliability and validity of pen-and-paper observational method associated with computer work. Two evaluators independently carried out this review. Seven observational methods used to assess exposure to office risk factor for work-related musculoskeletal disorders were identified. The risk factors involved in current techniques of pen and paper based observational tools were postures, office components, force and repetition. From the seven methods, only five methods had been tested for reliability. They were proven to be reliable and were rated as moderate to good. For the validity testing, from seven methods only four methods were tested and the results are moderate. Many observational tools already exist, but no single tool appears to cover all of the risk factors including working posture, office component, force, repetition and office environment at office workstations and computer work. Although the most important factor in developing tool is proper validation of exposure assessment techniques, the existing observational method did not test reliability and validity. Futhermore, this review could provide the researchers with ways on how to improve the pen-and-paper-based observational method for assessing ergonomic risk factors of computer work.

The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom.

PubMed

Murphy, Douglas J; Bruce, David A; Mercer, Stewart W; Eva, Kevin W

2009-05-01

To investigate the reliability and feasibility of six potential workplace-based assessment methods in general practice training: criterion audit, multi-source feedback from clinical and non-clinical colleagues, patient feedback (the CARE Measure), referral letters, significant event analysis, and video analysis of consultations. Performance of GP registrars (trainees) was evaluated with each tool to assess the reliabilities of the tools and feasibility, given raters and number of assessments needed. Participant experience of process determined by questionnaire. 171 GP registrars and their trainers, drawn from nine deaneries (representing all four countries in the UK), participated. The ability of each tool to differentiate between doctors (reliability) was assessed using generalisability theory. Decision studies were then conducted to determine the number of observations required to achieve an acceptably high reliability for "high-stakes assessment" using each instrument. Finally, descriptive statistics were used to summarise participants' ratings of their experience using these tools. Multi-source feedback from colleagues and patient feedback on consultations emerged as the two methods most likely to offer a reliable and feasible opinion of workplace performance. Reliability co-efficients of 0.8 were attainable with 41 CARE Measure patient questionnaires and six clinical and/or five non-clinical colleagues per doctor when assessed on two occasions. For the other four methods tested, 10 or more assessors were required per doctor in order to achieve a reliable assessment, making the feasibility of their use in high-stakes assessment extremely low. Participant feedback did not raise any major concerns regarding the acceptability, feasibility, or educational impact of the tools. The combination of patient and colleague views of doctors' performance, coupled with reliable competence measures, may offer a suitable evidence-base on which to monitor progress and completion of doctors' training in general practice.

Assessing Child Nutrient Intakes Using a Tablet-Based 24-Hour Recall Tool in Rural Zambia.

PubMed

Caswell, Bess L; Talegawkar, Sameera A; Dyer, Brian; Siamusantu, Ward; Klemm, Rolf D W; Palmer, Amanda C

2015-12-01

Detailed dietary intake data in low-income populations are needed for research and program evaluation. However, collection of such data by paper-based 24-hour recall imposes substantial demands for staff time and expertise, training, materials, and data entry. To describe our development and use of a tablet-based 24-hour recall tool for conducting dietary intake surveys in remote settings. We designed a 24-hour recall tool using Open Data Kit software on an Android tablet platform. The tool contains a list of local foods, questions on portion size, cooking method, ingredients, and food source and prompts to guide interviewers. We used this tool to interview caregivers on dietary intakes of children participating in an efficacy trial of provitamin A-biofortified maize conducted in Mkushi, a rural district in central Zambia. Participants were children aged 4 to 8 years not yet enrolled in school (n = 938). Dietary intake data were converted to nutrient intakes using local food composition and recipe tables. We developed a tablet-based 24-hour recall tool and used it to collect dietary data among 928 children. The majority of foods consumed were maize, leafy vegetable, or small fish dishes. Median daily energy intake was 6416 kJ (1469 kcal). Food and nutrient intakes assessed using the tablet-based tool were consistent with those reported in prior research. The tool was easily used by interviewers without prior nutrition training or computing experience. Challenges remain to improve programming, but the tool is an innovation that enables efficient collection of 24-hour recall data in remote settings. © The Author(s) 2015.

On the spot damage detection methodology for highway bridges during natural crises : tech transfer summary.

DOT National Transportation Integrated Search

2010-07-01

The objective of this work was to develop a : low-cost portable damage detection tool to : assess and predict damage areas in highway : bridges. : The proposed tool was based on standard : vibration-based damage identification (VBDI) : techniques but...

The use of behavior change theory in Internet-based asthma self-management interventions: a systematic review.

PubMed

Al-Durra, Mustafa; Torio, Monika-Bianca; Cafazzo, Joseph A

2015-04-02

The high prevalence rate of asthma represents a major societal burden. Advancements in information technology continue to affect the delivery of patient care in all areas of medicine. Internet-based solutions, social media, and mobile technology could address some of the problems associated with increasing asthma prevalence. This review evaluates Internet-based asthma interventions that were published between 2004 and October 2014 with respect to the use of behavioral change theoretical frameworks, applied clinical guidelines, and assessment tools. The search term (Asthma AND [Online or Internet or Mobile or Application or eHealth or App]) was applied to six bibliographic databases (Ovid MEDLINE, PubMed, BioMed Central, ProQuest Computing, Web of Knowledge, and ACM Digital Library) including only English-language articles published between 2004 and October 2014. In total, 3932 articles matched the priori search terms and were reviewed by the primary reviewer based on their titles, index terms, and abstracts. The matching articles were then screened by the primary reviewer for inclusion or exclusion based on their abstract, study type, and intervention objectives with respect to the full set of priori inclusion and exclusion criteria; 331 duplicates were identified and removed. A total of 85 articles were included for in-depth review and the remaining 3516 articles were excluded. The primary and secondary reviewer independently reviewed the complete content of the 85 included articles to identify the applied behavioral change theories, clinical guidelines, and assessment tools. Findings and any disagreement between reviewers were resolved by in-depth discussion and through a consolidation process for each of the included articles. The reviewers identified 17 out of 85 interventions (20%) where at least one model, framework, and/or construct of a behavioral change theory were applied. The review identified six clinical guidelines that were applied across 30 of the 85 interventions (35%) as well as a total of 21 assessment tools that were applied across 32 of the 85 interventions (38%). The findings of this literature review indicate that the majority of published Internet-based interventions do not use any documented behavioral change theory, clinical guidelines, and/or assessment tools to inform their design. Further, it was found that the application of clinical guidelines and assessment tools were more salient across the reviewed interventions. A consequence, as such, is that many Internet-based asthma interventions are designed in an ad hoc manner, without the use of any notable evidence-based theoretical frameworks, clinical guidelines, and/or assessment tools.

Reliability and validity of play-based assessments of motor and cognitive skills for infants and young children: a systematic review.

PubMed

O'Grady, Michael G; Dusing, Stacey C

2015-01-01

Play is vital for development. Infants and children learn through play. Traditional standardized developmental tests measure whether a child performs individual skills within controlled environments. Play-based assessments can measure skill performance during natural, child-driven play. The purpose of this study was to systematically review reliability, validity, and responsiveness of all play-based assessments that quantify motor and cognitive skills in children from birth to 36 months of age. Studies were identified from a literature search using PubMed, ERIC, CINAHL, and PsycINFO databases and the reference lists of included papers. Included studies investigated reliability, validity, or responsiveness of play-based assessments that measured motor and cognitive skills for children to 36 months of age. Two reviewers independently screened 40 studies for eligibility and inclusion. The reviewers independently extracted reliability, validity, and responsiveness data. They examined measurement properties and methodological quality of the included studies. Four current play-based assessment tools were identified in 8 included studies. Each play-based assessment tool measured motor and cognitive skills in a different way during play. Interrater reliability correlations ranged from .86 to .98 for motor development and from .23 to .90 for cognitive development. Test-retest reliability correlations ranged from .88 to .95 for motor development and from .45 to .91 for cognitive development. Structural validity correlations ranged from .62 to .90 for motor development and from .42 to .93 for cognitive development. One study assessed responsiveness to change in motor development. Most studies had small and poorly described samples. Lack of transparency in data management and statistical analysis was common. Play-based assessments have potential to be reliable and valid tools to assess cognitive and motor skills, but higher-quality research is needed. Psychometric properties should be considered for each play-based assessment before it is used in clinical and research practice. © 2015 American Physical Therapy Association.

PORTAAL: A Classroom Observation Tool Assessing Evidence-Based Teaching Practices for Active Learning in Large Science, Technology, Engineering, and Mathematics Classes

ERIC Educational Resources Information Center

Eddy, Sarah L.; Converse, Mercedes; Wenderoth, Mary Pat

2015-01-01

There is extensive evidence that active learning works better than a completely passive lecture. Despite this evidence, adoption of these evidence-based teaching practices remains low. In this paper, we offer one tool to help faculty members implement active learning. This tool identifies 21 readily implemented elements that have been shown to…

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Validating the WHO Maternal Near Miss Tool in a high-income country.

PubMed

Witteveen, Tom; de Koning, Ilona; Bezstarosti, Hans; van den Akker, Thomas; van Roosmalen, Jos; Bloemenkamp, Kitty W

2016-01-01

This study was performed to assess the applicability of the WHO Maternal Near Miss Tool (MNM Tool) and the organ dysfunction criteria in a high-income country. The MNM tool was applied to 2552 women who died of pregnancy-related causes or sustained severe acute maternal morbidity between August 2004 and August 2006 in one of the 98 hospitals with a maternity unit in the Netherlands. Fourteen (0.6%) cases had insufficient data for application. Each case was assessed according to the three main "MNM categories" specified in the MNM tool and their subcategory criteria: five disease-, four intervention- and seven organ dysfunction-based criteria. Potentially life-threatening conditions (disease-based inclusions) and life-threatening cases (organ dysfunction-based inclusions) were differentiated according to WHO methodology. Outcomes were incidence of all (sub)categories and case-fatality rates. Of the 2538 cases, 2308 (90.9%) women fulfilled disease-based, 2116 (83.4%) intervention-based and 1024 (40.3%) organ dysfunction-based criteria. Maternal death occurred in 48 women, of whom 23 (47.9%) fulfilled disease-based, 33 (68.8%) intervention-based and 31 (64.6%) organ dysfunction-based criteria. Case-fatality rates were 23/2308 (1.0%) for cases fulfilling the disease-based criteria, 33/2116 (1.6%) for intervention-based criteria and 31/1024 (3.0%) for women fulfilling the organ dysfunction-based criteria. In the Netherlands, where advanced laboratory and clinical monitoring are available, organ dysfunction-based criteria of the MNM tool failed to identify nearly two-thirds of sustained severe acute maternal morbidity cases and more than one-third of maternal deaths. Disease-based criteria remain important, and using only organ dysfunction-based criteria would lead to underestimating severe acute maternal morbidity. © 2015 Nordic Federation of Societies of Obstetrics and Gynecology.

Assessing Digital Humanities Tools: Use of Scalar at a Research University

ERIC Educational Resources Information Center

Tracy, Daniel G.

2016-01-01

As librarians increasingly support digital publication platforms, they must also understand the user experience of these tools. This case study assesses use of Scalar, a digital humanities publishing platform for media-rich projects, at the University of Illinois at Urbana-Champaign. Based on a survey, interviews, and content analysis, the study…

Automatic Assessment of 3D Modeling Exams

ERIC Educational Resources Information Center

Sanna, A.; Lamberti, F.; Paravati, G.; Demartini, C.

2012-01-01

Computer-based assessment of exams provides teachers and students with two main benefits: fairness and effectiveness in the evaluation process. This paper proposes a fully automatic evaluation tool for the Graphic and Virtual Design (GVD) curriculum at the First School of Architecture of the Politecnico di Torino, Italy. In particular, the tool is…

Integrated Testlets: A New Form of Expert-Student Collaborative Testing

ERIC Educational Resources Information Center

Shiell, Ralph C.; Slepkov, Aaron D.

2015-01-01

Integrated testlets are a new assessment tool that encompass the procedural benefits of multiple-choice testing, the pedagogical advantages of free-response-based tests, and the collaborative aspects of a viva voce or defence examination format. The result is a robust assessment tool that provides a significant formative aspect for students.…

Developing and testing a street audit tool using Google Street View to measure environmental supportiveness for physical activity.

PubMed

Griew, Pippa; Hillsdon, Melvyn; Foster, Charlie; Coombes, Emma; Jones, Andy; Wilkinson, Paul

2013-08-23

Walking for physical activity is associated with substantial health benefits for adults. Increasingly research has focused on associations between walking behaviours and neighbourhood environments including street characteristics such as pavement availability and aesthetics. Nevertheless, objective assessment of street-level data is challenging. This research investigates the reliability of a new street characteristic audit tool designed for use with Google Street View, and assesses levels of agreement between computer-based and on-site auditing. The Forty Area STudy street VIEW (FASTVIEW) tool, a Google Street View based audit tool, was developed incorporating nine categories of street characteristics. Using the tool, desk-based audits were conducted by trained researchers across one large UK town during 2011. Both inter and intra-rater reliability were assessed. On-site street audits were also completed to test the criterion validity of the method. All reliability scores were assessed by percentage agreement and the kappa statistic. Within-rater agreement was high for each category of street characteristic (range: 66.7%-90.0%) and good to high between raters (range: 51.3%-89.1%). A high level of agreement was found between the Google Street View audits and those conducted in-person across the nine categories examined (range: 75.0%-96.7%). The audit tool was found to provide a reliable and valid measure of street characteristics. The use of Google Street View to capture street characteristic data is recommended as an efficient method that could substantially increase potential for large-scale objective data collection.

A decision analysis tool for the assessment of posterior fossa tumour surgery outcomes in children--the "Liverpool Neurosurgical Complication Causality Assessment Tool".

PubMed

Zakaria, Rasheed; Ellenbogen, Jonathan; Graham, Catherine; Pizer, Barry; Mallucci, Conor; Kumar, Ram

2013-08-01

Complications may occur following posterior fossa tumour surgery in children. Such complications are subjectively and inconsistently reported even though they may have significant long-term behavioural and cognitive consequences for the child. This makes comparison of surgeons, programmes and treatments problematic. We have devised a causality tool for assessing if an adverse event after surgery can be classified as a surgical complication using a series of simple questions, based on a tool used in assessing adverse drug reactions. This tool, which we have called the "Liverpool Neurosurgical Complication Causality Assessment Tool", was developed by reviewing a series of ten posterior fossa tumour cases with a panel of neurosurgery, neurology, oncology and neuropsychology specialists working in a multidisciplinary paediatric tumour treatment programme. We have demonstrated its use and hope that it may improve reliability between different assessors both in evaluating the outcomes of existing programmes and treatments as well as aiding in trials which may directly compare the effects of surgical and medical treatments.

Pharmacological mechanism-based drug safety assessment and prediction.

PubMed

Abernethy, D R; Woodcock, J; Lesko, L J

2011-06-01

Advances in cheminformatics, bioinformatics, and pharmacology in the context of biological systems are now at a point that these tools can be applied to mechanism-based drug safety assessment and prediction. The development of such predictive tools at the US Food and Drug Administration (FDA) will complement ongoing efforts in drug safety that are focused on spontaneous adverse event reporting and active surveillance to monitor drug safety. This effort will require the active collaboration of scientists in the pharmaceutical industry, academe, and the National Institutes of Health, as well as those at the FDA, to reach its full potential. Here, we describe the approaches and goals for the mechanism-based drug safety assessment and prediction program.

Nutrition Environment Food Pantry Assessment Tool (NEFPAT): Development and Evaluation.

PubMed

Nikolaus, Cassandra J; Laurent, Emily; Loehmer, Emily; An, Ruopeng; Khan, Naiman; McCaffrey, Jennifer

2018-04-24

To develop and evaluate a nutrition environment assessment tool to assess the consumer nutrition environment and use of recommended practices in food pantries. The Nutrition Environment Food Pantry Assessment Tool (NEFPAT) was developed based on a literature review and guidance from professionals working with food pantries. The tool was pilot-tested at 9 food pantries, an expert panel assessed content validity, and interrater reliability was evaluated by pairs in 3 pantries. After revisions, the NEFPAT was used in 27 pantries. Pilot tests indicated positive appraisal for the NEFPAT and recommendations were addressed. The NEFPAT's 6 objectives and the overall tool were rated as content valid by experts, with an average section rating of 3.85 ± 0.10. Intraclass correlation coefficients for interrater reliability were >0.90. The NEFPAT is content valid with high interrater reliability. It provides baseline data that could be valuable for interventions within the nutrition environment of food pantries. Published by Elsevier Inc.

Combining web-based tools for transparent evaluation of data for risk assessment: developmental effects of bisphenol A on the mammary gland as a case study.

PubMed

Molander, Linda; Hanberg, Annika; Rudén, Christina; Ågerstrand, Marlene; Beronius, Anna

2017-03-01

Different tools have been developed that facilitate systematic and transparent evaluation and handling of toxicity data in the risk assessment process. The present paper sets out to explore the combined use of two web-based tools for study evaluation and identification of reliable data relevant to health risk assessment. For this purpose, a case study was performed using in vivo toxicity studies investigating low-dose effects of bisphenol A on mammary gland development. The reliability of the mammary gland studies was evaluated using the Science in Risk Assessment and Policy (SciRAP) criteria for toxicity studies. The Health Assessment Workspace Collaborative (HAWC) was used for characterizing and visualizing the mammary gland data in terms of type of effects investigated and reported, and the distribution of these effects within the dose interval. It was then investigated whether there was any relationship between study reliability and the type of effects reported and/or their distribution in the dose interval. The combination of the SciRAP and HAWC tools allowed for transparent evaluation and visualization of the studies investigating developmental effects of BPA on the mammary gland. The use of these tools showed that there were no apparent differences in the type of effects and their distribution in the dose interval between the five studies assessed as most reliable and the whole data set. Combining the SciRAP and HAWC tools was found to be a useful approach for evaluating in vivo toxicity studies and identifying reliable and sensitive information relevant to regulatory risk assessment of chemicals. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Competency assessment tools: An exploration of the pedagogical issues facing competency assessment for nurses in the clinical environment.

PubMed

Franklin, Natasha; Melville, Paula

2015-01-01

Competency assessment is a paradigm that is common in the healthcare environment and this being particularly true within the nursing profession. Demonstration of competence is necessary to meet the requirements of healthcare organisations and is a mandated requirement of nurses by the Nursing and Midwifery Board of Australia. Within the nursing education sector, one approach to determine competence, is through the use of competency assessment tools. Despite widespread use of competency assessment tools there remains ongoing concerns relating to the efficacy of competency assessment tools as a mean to demonstrate 'competency' amongst enrolled and registered nurses in the clinical environment. The authors of this paper ascertain that competency assessment tools run a serious risk of being nothing more than a 'quick-fix' means of assessment to demonstrate 'nursing competence' required for key performance indicators and clinical governance and that will provide evidence for accreditation standards. Based on this premise, the authors, provide an alternative approach to the use of competency assessment tools that moves away from a 'tick-box' approach to a 'patient-centred' competency model. This approach increases the reliability and validity of competency assessments, allows for the recognition of the knowledge, skills and experience of individual nurses, offers a more satisfying and rewarding approach to demonstrating 'competency' for nurses and finally, demonstrates 'real-life' competency.

Web-Based Interactive 3D Visualization as a Tool for Improved Anatomy Learning

ERIC Educational Resources Information Center

Petersson, Helge; Sinkvist, David; Wang, Chunliang; Smedby, Orjan

2009-01-01

Despite a long tradition, conventional anatomy education based on dissection is declining. This study tested a new virtual reality (VR) technique for anatomy learning based on virtual contrast injection. The aim was to assess whether students value this new three-dimensional (3D) visualization method as a learning tool and what value they gain…

A New Network Modeling Tool for the Ground-based Nuclear Explosion Monitoring Community

NASA Astrophysics Data System (ADS)

Merchant, B. J.; Chael, E. P.; Young, C. J.

2013-12-01

Network simulations have long been used to assess the performance of monitoring networks to detect events for such purposes as planning station deployments and network resilience to outages. The standard tool has been the SAIC-developed NetSim package. With correct parameters, NetSim can produce useful simulations; however, the package has several shortcomings: an older language (FORTRAN), an emphasis on seismic monitoring with limited support for other technologies, limited documentation, and a limited parameter set. Thus, we are developing NetMOD (Network Monitoring for Optimal Detection), a Java-based tool designed to assess the performance of ground-based networks. NetMOD's advantages include: coded in a modern language that is multi-platform, utilizes modern computing performance (e.g. multi-core processors), incorporates monitoring technologies other than seismic, and includes a well-validated default parameter set for the IMS stations. NetMOD is designed to be extendable through a plugin infrastructure, so new phenomenological models can be added. Development of the Seismic Detection Plugin is being pursued first. Seismic location and infrasound and hydroacoustic detection plugins will follow. By making NetMOD an open-release package, it can hopefully provide a common tool that the monitoring community can use to produce assessments of monitoring networks and to verify assessments made by others.

The SOLUTIONS project: challenges and responses for present and future emerging pollutants in land and water resources management.

PubMed

Brack, Werner; Altenburger, Rolf; Schüürmann, Gerrit; Krauss, Martin; López Herráez, David; van Gils, Jos; Slobodnik, Jaroslav; Munthe, John; Gawlik, Bernd Manfred; van Wezel, Annemarie; Schriks, Merijn; Hollender, Juliane; Tollefsen, Knut Erik; Mekenyan, Ovanes; Dimitrov, Saby; Bunke, Dirk; Cousins, Ian; Posthuma, Leo; van den Brink, Paul J; López de Alda, Miren; Barceló, Damià; Faust, Michael; Kortenkamp, Andreas; Scrimshaw, Mark; Ignatova, Svetlana; Engelen, Guy; Massmann, Gudrun; Lemkine, Gregory; Teodorovic, Ivana; Walz, Karl-Heinz; Dulio, Valeria; Jonker, Michiel T O; Jäger, Felix; Chipman, Kevin; Falciani, Francesco; Liska, Igor; Rooke, David; Zhang, Xiaowei; Hollert, Henner; Vrana, Branislav; Hilscherova, Klara; Kramer, Kees; Neumann, Steffen; Hammerbacher, Ruth; Backhaus, Thomas; Mack, Juliane; Segner, Helmut; Escher, Beate; de Aragão Umbuzeiro, Gisela

2015-01-15

SOLUTIONS (2013 to 2018) is a European Union Seventh Framework Programme Project (EU-FP7). The project aims to deliver a conceptual framework to support the evidence-based development of environmental policies with regard to water quality. SOLUTIONS will develop the tools for the identification, prioritisation and assessment of those water contaminants that may pose a risk to ecosystems and human health. To this end, a new generation of chemical and effect-based monitoring tools is developed and integrated with a full set of exposure, effect and risk assessment models. SOLUTIONS attempts to address legacy, present and future contamination by integrating monitoring and modelling based approaches with scenarios on future developments in society, economy and technology and thus in contamination. The project follows a solutions-oriented approach by addressing major problems of water and chemicals management and by assessing abatement options. SOLUTIONS takes advantage of the access to the infrastructure necessary to investigate the large basins of the Danube and Rhine as well as relevant Mediterranean basins as case studies, and puts major efforts on stakeholder dialogue and support. Particularly, the EU Water Framework Directive (WFD) Common Implementation Strategy (CIS) working groups, International River Commissions, and water works associations are directly supported with consistent guidance for the early detection, identification, prioritisation, and abatement of chemicals in the water cycle. SOLUTIONS will give a specific emphasis on concepts and tools for the impact and risk assessment of complex mixtures of emerging pollutants, their metabolites and transformation products. Analytical and effect-based screening tools will be applied together with ecological assessment tools for the identification of toxicants and their impacts. The SOLUTIONS approach is expected to provide transparent and evidence-based candidates or River Basin Specific Pollutants in the case study basins and to assist future review of priority pollutants under the WFD as well as potential abatement options. Copyright © 2014 Elsevier B.V. All rights reserved.

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

PubMed

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in standardizing the assessment of surgical skills.

The role of the Carer Support Needs Assessment Tool in palliative home care: A qualitative study of practitioners' perspectives of its impact and mechanisms of action.

PubMed

Ewing, Gail; Austin, Lynn; Grande, Gunn

2016-04-01

The importance of supporting family carers is well recognised in healthcare policy. The Carer Support Needs Assessment Tool is an evidence-based, comprehensive measure of carer support needs to facilitate carer support in palliative home care. To examine practitioner perspectives of the role of the Carer Support Needs Assessment Tool intervention in palliative home care to identify its impact and mechanisms of action. Qualitative - practitioner accounts of implementation (interviews, focus groups, reflective audio diaries) plus researcher field notes. A total of 29 staff members from two hospice home-care services - contrasting geographical locations, different service sizes and staff composition. A thematic analysis was conducted. Existing approaches to identification of carer needs were informal and unstructured. Practitioners expressed some concerns, pre-implementation, about negative impacts of the Carer Support Needs Assessment Tool on carers and expectations raised about support available. In contrast, post-implementation, the Carer Support Needs Assessment Tool provided positive impacts when used as part of a carer-led assessment and support process: it made support needs visible, legitimised support for carers and opened up different conversations with carers. The mechanisms of action that enabled the Carer Support Needs Assessment Tool to make a difference were creating space for the separate needs of carers, providing an opportunity for carers to express support needs and responding to carers' self-defined priorities. The Carer Support Needs Assessment Tool delivered benefits through a change in practice to an identifiable, separate assessment process for carers, facilitated by practitioners but carer-led. Used routinely with all carers, the Carer Support Needs Assessment Tool has the potential to normalise carer assessment and support, facilitate delivery of carer-identified support and enable effective targeting of resources. © The Author(s) 2015.

Alternative Model for Administration and Analysis of Research-Based Assessments

ERIC Educational Resources Information Center

Wilcox, Bethany R.; Zwickl, Benjamin M.; Hobbs, Robert D.; Aiken, John M.; Welch, Nathan M.; Lewandowski, H. J.

2016-01-01

Research-based assessments represent a valuable tool for both instructors and researchers interested in improving undergraduate physics education. However, the historical model for disseminating and propagating conceptual and attitudinal assessments developed by the physics education research (PER) community has not resulted in widespread adoption…

The Health Information Technology Competencies Tool: Does It Translate for Nursing Informatics in the United States?

PubMed

Sipes, Carolyn; Hunter, Kathleen; McGonigle, Dee; West, Karen; Hill, Taryn; Hebda, Toni

2017-12-01

Information technology use in healthcare delivery mandates a prepared workforce. The initial Health Information Technology Competencies tool resulted from a 2-year transatlantic effort by experts from the US and European Union to identify approaches to develop skills and knowledge needed by healthcare workers. It was determined that competencies must be identified before strategies are established, resulting in a searchable database of more than 1000 competencies representing five domains, five skill levels, and more than 250 roles. Health Information Technology Competencies is available at no cost and supports role- or competency-based queries. Health Information Technology Competencies developers suggest its use for curriculum planning, job descriptions, and professional development.The Chamberlain College of Nursing informatics research team examined Health Information Technology Competencies for its possible application to our research and our curricular development, comparing it originally with the TIGER-based Assessment of Nursing Informatics Competencies and Nursing Informatics Competency Assessment of Level 3 and Level 4 tools, which examine informatics competencies at four levels of nursing practice. Additional analysis involved the 2015 Nursing Informatics: Scope and Standards of Practice. Informatics is a Health Information Technology Competencies domain, so clear delineation of nursing-informatics competencies was expected. Researchers found TIGER-based Assessment of Nursing Informatics Competencies and Nursing Informatics Competency Assessment of Level 3 and Level 4 differed from Health Information Technology Competencies 2016 in focus, definitions, ascribed competencies, and defined levels of expertise. When Health Information Technology Competencies 2017 was compared against the nursing informatics scope and standards, researchers found an increase in the number of informatics competencies but not to a significant degree. This is not surprising, given that Health Information Technology Competencies includes all healthcare workers, while the TIGER-based Assessment of Nursing Informatics Competencies and Nursing Informatics Competency Assessment of Level 3 and Level 4 tools and the American Nurses Association Nursing Informatics: Scope and Standards of Practice are nurse specific. No clear cross mapping across these tools and the standards of nursing informatics practice exists. Further examination and review are needed to translate Health Information Technology Competencies as a viable tool for nursing informatics use in the US.

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

Stoffenmanager exposure model: company-specific exposure assessments using a Bayesian methodology.

PubMed

van de Ven, Peter; Fransman, Wouter; Schinkel, Jody; Rubingh, Carina; Warren, Nicholas; Tielemans, Erik

2010-04-01

The web-based tool "Stoffenmanager" was initially developed to assist small- and medium-sized enterprises in the Netherlands to make qualitative risk assessments and to provide advice on control at the workplace. The tool uses a mechanistic model to arrive at a "Stoffenmanager score" for exposure. In a recent study it was shown that variability in exposure measurements given a certain Stoffenmanager score is still substantial. This article discusses an extension to the tool that uses a Bayesian methodology for quantitative workplace/scenario-specific exposure assessment. This methodology allows for real exposure data observed in the company of interest to be combined with the prior estimate (based on the Stoffenmanager model). The output of the tool is a company-specific assessment of exposure levels for a scenario for which data is available. The Bayesian approach provides a transparent way of synthesizing different types of information and is especially preferred in situations where available data is sparse, as is often the case in small- and medium sized-enterprises. Real-world examples as well as simulation studies were used to assess how different parameters such as sample size, difference between prior and data, uncertainty in prior, and variance in the data affect the eventual posterior distribution of a Bayesian exposure assessment.

A Comparative Analysis of Life-Cycle Assessment Tools for ...

EPA Pesticide Factsheets

We identified and evaluated five life-cycle assessment tools that community decision makers can use to assess the environmental and economic impacts of end-of-life (EOL) materials management options. The tools evaluated in this report are waste reduction mode (WARM), municipal solid waste-decision support tool (MSW-DST), solid waste optimization life-cycle framework (SWOLF), environmental assessment system for environmental technologies (EASETECH), and waste and resources assessment for the environment (WRATE). WARM, MSW-DST, and SWOLF were developed for US-specific materials management strategies, while WRATE and EASETECH were developed for European-specific conditions. All of the tools (with the exception of WARM) allow specification of a wide variety of parameters (e.g., materials composition and energy mix) to a varying degree, thus allowing users to model specific EOL materials management methods even outside the geographical domain they are originally intended for. The flexibility to accept user-specified input for a large number of parameters increases the level of complexity and the skill set needed for using these tools. The tools were evaluated and compared based on a series of criteria, including general tool features, the scope of the analysis (e.g., materials and processes included), and the impact categories analyzed (e.g., climate change, acidification). A series of scenarios representing materials management problems currently relevant to c

Implementation of Systematic Review Tools in IRIS | Science ...

EPA Pesticide Factsheets

Currently, the number of chemicals present in the environment exceeds the ability of public health scientists to efficiently screen the available data in order to produce well-informed human health risk assessments in a timely manner. For this reason, the US EPA’s Integrated Risk Information System (IRIS) program has started implementing new software tools into the hazard characterization workflow. These automated tools aid in multiple phases of the systematic review process including scoping and problem formulation, literature search, and identification and screening of available published studies. The increased availability of these tools lays the foundation for automating or semi-automating multiple phases of the systematic review process. Some of these software tools include modules to facilitate a structured approach to study quality evaluation of human and animal data, although approaches are generally lacking for assessing complex mechanistic information, in particular “omics”-based evidence tools are starting to become available to evaluate these types of studies. We will highlight how new software programs, online tools, and approaches for assessing study quality can be better integrated to allow for a more efficient and transparent workflow of the risk assessment process as well as identify tool gaps that would benefit future risk assessments. Disclaimer: The views expressed here are those of the authors and do not necessarily represent the view

Improving nutrition surveillance and public health research in Central and Eastern Europe/Balkan Countries using the Balkan Food Platform and dietary tools.

PubMed

Gurinović, Mirjana; Milešević, Jelena; Novaković, Romana; Kadvan, Agnes; Djekić-Ivanković, Marija; Šatalić, Zvonimir; Korošec, Mojca; Spiroski, Igor; Ranić, Marija; Dupouy, Eleonora; Oshaug, Arne; Finglas, Paul; Glibetić, Maria

2016-02-15

The objective of this paper is to share experience and provide updated information on Capacity Development in the Central and Eastern Europe/Balkan Countries (CEE/BC) region relevant to public health nutrition, particularly in creation of food composition databases (FCDBs), applying dietary intake assessment and monitoring tools, and harmonizing methodology for nutrition surveillance. Balkan Food Platform was established by a Memorandum of Understanding among EuroFIR AISBL, Institute for Medical Research, Belgrade, Capacity Development Network in Nutrition in CEE - CAPNUTRA and institutions from nine countries in the region. Inventory on FCDB status identified lack of harmonized and standardized research tools. To strengthen harmonization in CEE/BC in line with European research trends, the Network members collaborated in development of a Regional FCDB, using web-based food composition data base management software following EuroFIR standards. Comprehensive nutrition assessment and planning tool - DIET ASSESS & PLAN could enable synchronization of nutrition surveillance across countries. Copyright © 2015 Elsevier Ltd. All rights reserved.

Reliability, Validity, and Factor Structure of the Current Assessment Practice Evaluation-Revised (CAPER) in a National Sample.

PubMed

Lyon, Aaron R; Pullmann, Michael D; Dorsey, Shannon; Martin, Prerna; Grigore, Alexandra A; Becker, Emily M; Jensen-Doss, Amanda

2018-05-11

Measurement-based care (MBC) is an increasingly popular, evidence-based practice, but there are no tools with established psychometrics to evaluate clinician use of MBC practices in mental health service delivery. The current study evaluated the reliability, validity, and factor structure of scores generated from a brief, standardized tool to measure MBC practices, the Current Assessment Practice Evaluation-Revised (CAPER). Survey data from a national sample of 479 mental health clinicians were used to conduct exploratory and confirmatory factor analyses, as well as reliability and validity analyses (e.g., relationships between CAPER subscales and clinician MBC attitudes). Analyses revealed competing two- and three-factor models. Regardless of the model used, scores from CAPER subscales demonstrated good reliability and convergent and divergent validity with MBC attitudes in the expected directions. The CAPER appears to be a psychometrically sound tool for assessing clinician MBC practices. Future directions for development and application of the tool are discussed.

Developing a Web-Based Mechanism for Assessing Teacher Science Content Knowledge

NASA Astrophysics Data System (ADS)

Byers, Al; Koba, Susan; Sherman, Greg; Scheppke, Joan; Bolus, Roger

2011-04-01

The National Science Teachers Association (NSTA) recently launched a comprehensive electronic professional development (e-PD) online portal, the NSTA Learning Center. This support site for educators currently includes over 6,000 e-PD resources and opportunities available on-demand, as well as various tools designed to help educators maximize the effectiveness of using NSTA resources. One tool, the PD Indexer, helps teachers identify their own areas of content strengths and weaknesses by selecting content-specific assessments. Individual NSTA resources are recommended based on assessment outcomes. This paper presents a detailed description of the procedures employed by NSTA to develop valid and reliable PD Indexer content-specific multiple-choice assessment items.

Application of a faith-based integration tool to assess mental and physical health interventions.

PubMed

Saunders, Donna M; Leak, Jean; Carver, Monique E; Smith, Selina A

2017-01-01

To build on current research involving faith-based interventions (FBIs) for addressing mental and physical health, this study a) reviewed the extent to which relevant publications integrate faith concepts with health and b) initiated analysis of the degree of FBI integration with intervention outcomes. Derived from a systematic search of articles published between 2007 and 2017, 36 studies were assessed with a Faith-Based Integration Assessment Tool (FIAT) to quantify faith-health integration. Basic statistical procedures were employed to determine the association of faith-based integration with intervention outcomes. The assessed studies possessed (on average) moderate, inconsistent integration because of poor use of faith measures, and moderate, inconsistent use of faith practices. Analysis procedures for determining the effect of FBI integration on intervention outcomes were inadequate for formulating practical conclusions. Regardless of integration, interventions were associated with beneficial outcomes. To determine the link between FBI integration and intervention outcomes, additional analyses are needed.

Consensus modeling to develop the farmers' market readiness assessment and decision instrument.

PubMed

Lee, Eunlye; Dalton, Jarrod; Ngendahimana, David; Bebo, Pat; Davis, Ashley; Remley, Daniel; Smathers, Carol; Freedman, Darcy A

2017-09-01

Nutrition-related policy, system, and environmental (PSE) interventions such as farmers' markets have been recommended as effective strategies for promoting healthy diet for chronic disease prevention. Tools are needed to assess community readiness and capacity factors influencing successful farmers' market implementation among diverse practitioners in different community contexts. We describe a multiphase consensus modeling approach used to develop a diagnostic tool for assessing readiness and capacity to implement farmers' market interventions among public health and community nutrition practitioners working with low-income populations in diverse contexts. Modeling methods included the following: phase 1, qualitative study with community stakeholders to explore facilitators and barriers influencing successful implementation of farmers' market interventions in low-income communities; phase 2, development of indicators based on operationalization of qualitative findings; phase 3, assessment of relevance and importance of indicators and themes through consensus conference with expert panel; phase 4, refinement of indicators based on consensus conference; and phase 5, pilot test of the assessment tool. Findings illuminate a range of implementation factors influencing farmers' market PSE interventions and offer guidance for tailoring intervention delivery based on levels of community, practitioner, and organizational readiness and capacity.

A Framework for Assessing High School Students' Statistical Reasoning.

PubMed

Chan, Shiau Wei; Ismail, Zaleha; Sumintono, Bambang

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students' statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students' statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework's cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments.

A Framework for Assessing High School Students' Statistical Reasoning

PubMed Central

2016-01-01

Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students’ statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students’ statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework’s cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments. PMID:27812091

A Data-Driven Framework for Incorporating New Tools for Toxicity, Exposure, and Risk Assessment

EPA Science Inventory

This talk was given during the “Exposure-Based Toxicity Testing” session at the annual meeting of the International Society for Exposure Science. It provided an update on the state of the science and tools that may be employed in risk-based prioritization efforts. It ...

Risk based decision tool for space exploration missions

NASA Technical Reports Server (NTRS)

Meshkat, Leila; Cornford, Steve; Moran, Terrence

2003-01-01

This paper presents an approach and corresponding tool to assess and analyze the risks involved in a mission during the pre-phase A design process. This approach is based on creating a risk template for each subsystem expert involved in the mission design process and defining appropriate interactions between the templates.

Evaluating the Use of a Strengths-Based Development Tool with Head Teachers

ERIC Educational Resources Information Center

Cooper, Liz; Woods, Kevin

2017-01-01

This exploratory study investigated an educational psychologist's use of a strengths-based development tool with head teachers, in the context of influencing and supporting leaders in school organisations. Nine head teachers completed the "Realise2 Introductory Profile" online strengths assessment and then received a structured debrief…

A web-based team-oriented medical error communication assessment tool: development, preliminary reliability, validity, and user ratings.

PubMed

Kim, Sara; Brock, Doug; Prouty, Carolyn D; Odegard, Peggy Soule; Shannon, Sarah E; Robins, Lynne; Boggs, Jim G; Clark, Fiona J; Gallagher, Thomas

2011-01-01

Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication. We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure. Using valid data from 78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on the Likert-scale questions and ranged from α=.79 to α=.89 for each set of 7 Likert-type discussion/planning items and from α=.70 to α=.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r=.59 for discussion/planning and r=.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5). Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.

Development of an Outcome Measurement Tool for a Teen Parent Wraparound Program

ERIC Educational Resources Information Center

Fries, Derrick; Carney, Karen J.; Blackman-Urteaga, Laura; Savas, Sue Ann

2012-01-01

This article chronicles the search for and development of an outcome measurement tool for teen parents receiving community-based wraparound services. The criteria for selecting functional assessment tools available in the literature is presented along with the barriers experienced in using two of these well-cited tools. The rationale for in-house…

Simulation-based ongoing professional practice evaluation in psychiatry: a novel tool for performance assessment.

PubMed

Gorrindo, Tristan; Goldfarb, Elizabeth; Birnbaum, Robert J; Chevalier, Lydia; Meller, Benjamin; Alpert, Jonathan; Herman, John; Weiss, Anthony

2013-07-01

Ongoing professional practice evaluation (OPPE) activities consist of a quantitative, competency-based evaluation of clinical performance. Hospitals must design assessments that measure clinical competencies, are scalable, and minimize impact on the clinician's daily routines. A psychiatry department at a large academic medical center designed and implemented an interactive Web-based psychiatric simulation focusing on violence risk assessment as a tool for a departmentwide OPPE. Of 412 invited clinicians in a large psychiatry department, 410 completed an online simulation in April-May 2012. Participants received scheduled e-mail reminders with instructions describing how to access the simulation. Using the Computer Simulation Assessment Tool, participants viewed an introductory video and were then asked to conduct a risk assessment, acting as a clinician in the encounter by selecting actions from a series of drop-down menus. Each action was paired with a corresponding video segment of a clinical encounter with a standardized patient. Participants were scored on the basis of their actions within the simulation (Measure 1) and by their responses to the open-ended questions in which they were asked to integrate the information from the simulation in a summative manner (Measure 2). Of the 410 clinicians, 381 (92.9%) passed Measure 1,359 (87.6%) passed Measure 2, and 5 (1.2%) failed both measures. Seventy-five (18.3%) participants were referred for focused professional practice evaluation (FPPE) after failing either Measure 1, Measure 2, or both. Overall, Web-based simulation and e-mail engagement tools were a scalable and efficient way to assess a large number of clinicians in OPPE and to identify those who required FPPE.

Automation of a DXA-based finite element tool for clinical assessment of hip fracture risk.

PubMed

Luo, Yunhua; Ahmed, Sharif; Leslie, William D

2018-03-01

Finite element analysis of medical images is a promising tool for assessing hip fracture risk. Although a number of finite element models have been developed for this purpose, none of them have been routinely used in clinic. The main reason is that the computer programs that implement the finite element models have not been completely automated, and heavy training is required before clinicians can effectively use them. By using information embedded in clinical dual energy X-ray absorptiometry (DXA), we completely automated a DXA-based finite element (FE) model that we previously developed for predicting hip fracture risk. The automated FE tool can be run as a standalone computer program with the subject's raw hip DXA image as input. The automated FE tool had greatly improved short-term precision compared with the semi-automated version. To validate the automated FE tool, a clinical cohort consisting of 100 prior hip fracture cases and 300 matched controls was obtained from a local community clinical center. Both the automated FE tool and femoral bone mineral density (BMD) were applied to discriminate the fracture cases from the controls. Femoral BMD is the gold standard reference recommended by the World Health Organization for screening osteoporosis and for assessing hip fracture risk. The accuracy was measured by the area under ROC curve (AUC) and odds ratio (OR). Compared with femoral BMD (AUC = 0.71, OR = 2.07), the automated FE tool had a considerably improved accuracy (AUC = 0.78, OR = 2.61 at the trochanter). This work made a large step toward applying our DXA-based FE model as a routine clinical tool for the assessment of hip fracture risk. Furthermore, the automated computer program can be embedded into a web-site as an internet application. Copyright © 2017 Elsevier B.V. All rights reserved.

Objective Data Assessment (ODA) Methods as Nutritional Assessment Tools.

PubMed

Hamada, Yasuhiro

2015-01-01

Nutritional screening and assessment should be a standard of care for all patients because nutritional management plays an important role in clinical practice. However, there is no gold standard for the diagnosis of malnutrition or undernutrition, although a large number of nutritional screening and assessment tools have been developed. Nutritional screening and assessment tools are classified into two categories, namely, subjective global assessment (SGA) and objective data assessment (ODA). SGA assesses nutritional status based on the features of medical history and physical examination. On the other hand, ODA consists of objective data provided from various analyses, such as anthropometry, bioimpedance analysis (BIA), dual-energy X-ray absorptiometry (DEXA), computed tomography (CT), magnetic resonance imaging (MRI), laboratory tests, and functional tests. This review highlights knowledge on the performance of ODA methods for the assessment of nutritional status in clinical practice. J. Med. Invest. 62: 119-122, August, 2015.

The role of optimization in the next generation of computer-based design tools

NASA Technical Reports Server (NTRS)

Rogan, J. Edward

1989-01-01

There is a close relationship between design optimization and the emerging new generation of computer-based tools for engineering design. With some notable exceptions, the development of these new tools has not taken full advantage of recent advances in numerical design optimization theory and practice. Recent work in the field of design process architecture has included an assessment of the impact of next-generation computer-based design tools on the design process. These results are summarized, and insights into the role of optimization in a design process based on these next-generation tools are presented. An example problem has been worked out to illustrate the application of this technique. The example problem - layout of an aircraft main landing gear - is one that is simple enough to be solved by many other techniques. Although the mathematical relationships describing the objective function and constraints for the landing gear layout problem can be written explicitly and are quite straightforward, an approximation technique has been used in the solution of this problem that can just as easily be applied to integrate supportability or producibility assessments using theory of measurement techniques into the design decision-making process.

The Managing Emergencies in Paediatric Anaesthesia global rating scale is a reliable tool for simulation-based assessment in pediatric anesthesia crisis management.

PubMed

Everett, Tobias C; Ng, Elaine; Power, Daniel; Marsh, Christopher; Tolchard, Stephen; Shadrina, Anna; Bould, Matthew D

2013-12-01

The use of simulation-based assessments for high-stakes physician examinations remains controversial. The Managing Emergencies in Paediatric Anaesthesia course uses simulation to teach evidence-based management of anesthesia crises to trainee anesthetists in the United Kingdom (UK) and Canada. In this study, we investigated the feasibility and reliability of custom-designed scenario-specific performance checklists and a global rating scale (GRS) assessing readiness for independent practice. After research ethics board approval, subjects were videoed managing simulated pediatric anesthesia crises in a single Canadian teaching hospital. Each subject was randomized to two of six different scenarios. All 60 scenarios were subsequently rated by four blinded raters (two in the UK, two in Canada) using the checklists and GRS. The actual and predicted reliability of the tools was calculated for different numbers of raters using the intraclass correlation coefficient (ICC) and the Spearman-Brown prophecy formula. Average measures ICCs ranged from 'substantial' to 'near perfect' (P ≤ 0.001). The reliability of the checklists and the GRS was similar. Single measures ICCs showed more variability than average measures ICC. At least two raters would be required to achieve acceptable reliability. We have established the reliability of a GRS to assess the management of simulated crisis scenarios in pediatric anesthesia, and this tool is feasible within the setting of a research study. The global rating scale allows raters to make a judgement regarding a participant's readiness for independent practice. These tools may be used in the future research examining simulation-based assessment. © 2013 John Wiley & Sons Ltd.

Becoming with Data: Developing Self-Assessing Recursive Pedagogies in Schools and Using Second-Order Cybernetics as a Thinking Tool

ERIC Educational Resources Information Center

Reinertsen, Anne Beate

2014-01-01

This article is about developing school-based self-assessing recursive pedagogies and case/action research practices and/or approaches in schools, and teachers, teacher researchers and researchers simultaneously producing and theorising their own practices using second-order cybernetics as a thinking tool. It is a move towards pragmatic…

The Community Barometer: A Breast Health Needs Assessment Tool for Community-Based Organizations

ERIC Educational Resources Information Center

Lounsbury, David; Rapkin, Bruce; Marini, Lisa; Jansky, Elizabeth; Massie, Mary Jane

2006-01-01

This article presents findings from the ACCESS Project focusing on the impact of an outreach initiative that used "data sharing" as a mechanism to establish a wide variety of academic-community partnerships for cancer awareness. The Community Barometer, a brief needs assessment tool developed for this purpose, was used to collect data from…

Cultural Analysis of School-University Partnerships: Assessing Dynamics and Potential Outcomes.

ERIC Educational Resources Information Center

Selke, Mary J.

This paper has three objectives: (1) to examine culture as it applies to school-university partnerships; (2) to provide an experimental literature-based tool for assessing the readiness of potential or existing school-university partners to engage in a collaborative venture; and (3) to model the application of this tool using data from a…

The Stuttering Treatment Research Evaluation and Assessment Tool (STREAT): Evaluating Treatment Research as Part of Evidence-Based Practice

ERIC Educational Resources Information Center

Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.

2006-01-01

Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…

Teacher Progress Monitoring of Instructional and Behavioral Management Practices: An Evidence-Based Approach to Improving Classroom Practices

ERIC Educational Resources Information Center

Reddy, Linda A.; Dudek, Christopher M.

2014-01-01

In the era of teacher evaluation and effectiveness, assessment tools that identify and monitor educators' instruction and behavioral management practices are in high demand. The Classroom Strategies Scale (CSS) Observer Form is a multidimensional teacher progress monitoring tool designed to assess teachers' usage of instructional and behavioral…

Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

ERIC Educational Resources Information Center

Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

2017-01-01

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

Technological Support for Assignment Assessment: A New Zealand Higher Education Survey

ERIC Educational Resources Information Center

Milne, John; Heinrich, Eva; Morrison, David

2008-01-01

This article presents selected aspects of a large study on the use of e-learning tools in support of assignment assessment, which was comprised of a substantial literature review, an investigation into electronic tools, and interviews with 90 academics at New Zealand tertiary institutions. The article makes two main contributions. Based on the…

Family-Based Benchmarking of Copy Number Variation Detection Software.

PubMed

Nutsua, Marcel Elie; Fischer, Annegret; Nebel, Almut; Hofmann, Sylvia; Schreiber, Stefan; Krawczak, Michael; Nothnagel, Michael

2015-01-01

The analysis of structural variants, in particular of copy-number variations (CNVs), has proven valuable in unraveling the genetic basis of human diseases. Hence, a large number of algorithms have been developed for the detection of CNVs in SNP array signal intensity data. Using the European and African HapMap trio data, we undertook a comparative evaluation of six commonly used CNV detection software tools, namely Affymetrix Power Tools (APT), QuantiSNP, PennCNV, GLAD, R-gada and VEGA, and assessed their level of pair-wise prediction concordance. The tool-specific CNV prediction accuracy was assessed in silico by way of intra-familial validation. Software tools differed greatly in terms of the number and length of the CNVs predicted as well as the number of markers included in a CNV. All software tools predicted substantially more deletions than duplications. Intra-familial validation revealed consistently low levels of prediction accuracy as measured by the proportion of validated CNVs (34-60%). Moreover, up to 20% of apparent family-based validations were found to be due to chance alone. Software using Hidden Markov models (HMM) showed a trend to predict fewer CNVs than segmentation-based algorithms albeit with greater validity. PennCNV yielded the highest prediction accuracy (60.9%). Finally, the pairwise concordance of CNV prediction was found to vary widely with the software tools involved. We recommend HMM-based software, in particular PennCNV, rather than segmentation-based algorithms when validity is the primary concern of CNV detection. QuantiSNP may be used as an additional tool to detect sets of CNVs not detectable by the other tools. Our study also reemphasizes the need for laboratory-based validation, such as qPCR, of CNVs predicted in silico.

A decision-making tool for incorporating sustainability measures into pavement design : research project capsule.

DOT National Transportation Integrated Search

2016-10-01

The objective of the proposed study is to conceive and develop a decision-making tool : for evaluating sustainability of pavement designs based on a cradle-to-grave analysis. : This tool will utilize EPDs to enhance the reliability of the assessment ...

FRAMEWORK FOR RESPONSIBLE DECISION-MAKING (FRED): A TOOL FOR ENVIRONMENTALLY PREFERABLE PRODUCTS

EPA Science Inventory

In support of the Environmentally Preferable Purchasing Program of the USEPA, a decision-making tool based on life cycle assessment has been developed. This tool, the Framework for Responsible Environmental Decision-making or FRED, streamlines LCA by choosing a minimum list of im...

FRAMEWORK FOR ENVIRONMENTAL DECISION-MAKING, FRED: A TOOL FOR ENVIRONMENTALLY-PREFERABLE PURCHASING

EPA Science Inventory

In support of the Environmentally Preferable Purchasing Program of the US EPA, the Systems Analysis Branch has developed a decision-making tool based on life cycle assessment. This tool, the Framework for Responsible Environmental Decision-making or FRED streamlines LCA by choosi...

The development and validity of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To develop the construct, content, and criterion validity of the Salford Gait Tool (SF-GT) and to evaluate agreement between gait observations using the SF-GT and kinematic gait data. Tool development and comparative evaluation. University in the United Kingdom. For designing construct and content validity, convenience samples of 10 children with hemiplegic, diplegic, and quadriplegic cerebral palsy (CP) and 152 physical therapy students and 4 physical therapists were recruited. For developing criterion validity, kinematic gait data of 13 gait clusters containing 56 children with hemiplegic, diplegic, and quadriplegic CP and 11 neurologically intact children was used. For clinical evaluation, a convenience sample of 23 pediatric physical therapists participated. We developed a sagittal plane observational gait assessment tool through a series of design, test, and redesign iterations. The tool's grading system was calibrated using kinematic gait data of 13 gait clusters and was evaluated by comparing the agreement of gait observations using the SF-GT with kinematic gait data. Criterion standard kinematic gait data. There was 58% mean agreement based on grading categories and 80% mean agreement based on degree estimations evaluated with the least significant difference method. The new SF-GT has good concurrent criterion validity.

Screening tool to evaluate the vulnerability of down-gradient receptors to groundwater contaminants from uncapped landfills

DOE Office of Scientific and Technical Information (OSTI.GOV)

Baker, Ronald J.; Reilly, Timothy J.; Lopez, Anthony

2015-09-15

Highlights: • A spreadsheet-based risk screening tool for groundwater affected by landfills is presented. • Domenico solute transport equations are used to estimate downgradient contaminant concentrations. • Landfills are categorized as presenting high, moderate or low risks. • Analysis of parameter sensitivity and examples of the method’s application are given. • The method has value to regulators and those considering redeveloping closed landfills. - Abstract: A screening tool for quantifying levels of concern for contaminants detected in monitoring wells on or near landfills to down-gradient receptors (streams, wetlands and residential lots) was developed and evaluated. The tool uses Quick Domenicomore » Multi-scenario (QDM), a spreadsheet implementation of Domenico-based solute transport, to estimate concentrations of contaminants reaching receptors under steady-state conditions from a constant-strength source. Unlike most other available Domenico-based model applications, QDM calculates the time for down-gradient contaminant concentrations to approach steady state and appropriate dispersivity values, and allows for up to fifty simulations on a single spreadsheet. Sensitivity of QDM solutions to critical model parameters was quantified. The screening tool uses QDM results to categorize landfills as having high, moderate and low levels of concern, based on contaminant concentrations reaching receptors relative to regulatory concentrations. The application of this tool was demonstrated by assessing levels of concern (as defined by the New Jersey Pinelands Commission) for thirty closed, uncapped landfills in the New Jersey Pinelands National Reserve, using historic water-quality data from monitoring wells on and near landfills and hydraulic parameters from regional flow models. Twelve of these landfills are categorized as having high levels of concern, indicating a need for further assessment. This tool is not a replacement for conventional numerically-based transport model or other available Domenico-based applications, but is suitable for quickly assessing the level of concern posed by a landfill or other contaminant point source before expensive and lengthy monitoring or remediation measures are taken. In addition to quantifying the level of concern using historic groundwater-monitoring data, the tool allows for archiving model scenarios and adding refinements as new data become available.« less

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

PubMed

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

Machine learning-based assessment tool for imbalance and vestibular dysfunction with virtual reality rehabilitation system.

PubMed

Yeh, Shih-Ching; Huang, Ming-Chun; Wang, Pa-Chun; Fang, Te-Yung; Su, Mu-Chun; Tsai, Po-Yi; Rizzo, Albert

2014-10-01

Dizziness is a major consequence of imbalance and vestibular dysfunction. Compared to surgery and drug treatments, balance training is non-invasive and more desired. However, training exercises are usually tedious and the assessment tool is insufficient to diagnose patient's severity rapidly. An interactive virtual reality (VR) game-based rehabilitation program that adopted Cawthorne-Cooksey exercises, and a sensor-based measuring system were introduced. To verify the therapeutic effect, a clinical experiment with 48 patients and 36 normal subjects was conducted. Quantified balance indices were measured and analyzed by statistical tools and a Support Vector Machine (SVM) classifier. In terms of balance indices, patients who completed the training process are progressed and the difference between normal subjects and patients is obvious. Further analysis by SVM classifier show that the accuracy of recognizing the differences between patients and normal subject is feasible, and these results can be used to evaluate patients' severity and make rapid assessment. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

WATERSHED BASED SURVEY DESIGNS

EPA Science Inventory

The development of watershed-based design and assessment tools will help to serve the multiple goals for water quality monitoring required under the Clean Water Act, including assessment of regional condition to meet Section 305(b), identification of impaired water bodies or wate...

WATERSHED-BASED SURVEY DESIGNS

EPA Science Inventory

Water-based sampling design and assessment tools help serve the multiple goals for water quality monitoring required under the Clean Water Act, including assessment of regional conditions to meet Section 305(b), identification if impaired water bodies or watersheds to meet Sectio...

Development and Validation of a Parent Report Measure for Assessing Social-Emotional Competencies of Children and Adolescents

ERIC Educational Resources Information Center

Merrell, Kenneth W.; Felver-Gant, Josh C.; Tom, Karalyn M.

2011-01-01

Based on the premises that strength-based assessment of children and adolescents is an important emerging area, and that additional tools for this purpose are needed, this study details development and validation efforts on a new strength-based assessment: the Social-Emotional Assets and Resilience Scale, parent form (SEARS-P). Following careful…

Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review.

PubMed

Page, Matthew J; McKenzie, Joanne E; Higgins, Julian P T

2018-03-14

Several scales, checklists and domain-based tools for assessing risk of reporting biases exist, but it is unclear how much they vary in content and guidance. We conducted a systematic review of the content and measurement properties of such tools. We searched for potentially relevant articles in Ovid MEDLINE, Ovid Embase, Ovid PsycINFO and Google Scholar from inception to February 2017. One author screened all titles, abstracts and full text articles, and collected data on tool characteristics. We identified 18 tools that include an assessment of the risk of reporting bias. Tools varied in regard to the type of reporting bias assessed (eg, bias due to selective publication, bias due to selective non-reporting), and the level of assessment (eg, for the study as a whole, a particular result within a study or a particular synthesis of studies). Various criteria are used across tools to designate a synthesis as being at 'high' risk of bias due to selective publication (eg, evidence of funnel plot asymmetry, use of non-comprehensive searches). However, the relative weight assigned to each criterion in the overall judgement is unclear for most of these tools. Tools for assessing risk of bias due to selective non-reporting guide users to assess a study, or an outcome within a study, as 'high' risk of bias if no results are reported for an outcome. However, assessing the corresponding risk of bias in a synthesis that is missing the non-reported outcomes is outside the scope of most of these tools. Inter-rater agreement estimates were available for five tools. There are several limitations of existing tools for assessing risk of reporting biases, in terms of their scope, guidance for reaching risk of bias judgements and measurement properties. Development and evaluation of a new, comprehensive tool could help overcome present limitations. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Electronic Health Record Tools to Care for At-Risk Older Drivers: A Quality Improvement Project.

PubMed

Casey, Colleen M; Salinas, Katherine; Eckstrom, Elizabeth

2015-06-01

Evaluating driving safety of older adults is an important health topic, but primary care providers (PCP) face multiple barriers in addressing this issue. The study's objectives were to develop an electronic health record (EHR)-based Driving Clinical Support Tool, train PCPs to perform driving assessments utilizing the tool, and systematize documentation of assessment and management of driving safety issues via the tool. The intervention included development of an evidence-based Driving Clinical Support Tool within the EHR, followed by training of internal medicine providers in the tool's content and use. Pre- and postintervention provider surveys and chart review of driving-related patient visits were conducted. Surveys included self-report of preparedness and knowledge to evaluate at-risk older drivers and were analyzed using paired t-test. A chart review of driving-related office visits compared documentation pre- and postintervention including: completeness of appropriate focused history and exam, identification of deficits, patient education, and reporting to appropriate authorities when indicated. Data from 86 providers were analyzed. Pre- and postintervention surveys showed significantly increased self-assessed preparedness (p < .001) and increased driving-related knowledge (p < .001). Postintervention charts showed improved documentation of correct cognitive testing, more referrals/consults, increased patient education about community resources, and appropriate regulatory reporting when deficits were identified. Focused training and an EHR-based clinical support tool improved provider self-reported preparedness and knowledge of how to evaluate at-risk older drivers. The tool improved documentation of driving-related issues and led to improved access to interdisciplinary care coordination. Published by Oxford University Press on behalf of the Gerontological Society of America 2015.

An Assessment Tool of Performance Based Logistics Appropriateness

DTIC Science & Technology

2012-03-01

weighted tool score. The reason might be the willing to use PBL as an acquisition method . There is an 8.51% positive difference is present. Figure 20 shows...performance-based acquisition methods to the maximum extent practicable when acquiring services with little exclusion’ is mandated. Although PBL...determines the factors affecting the success in selecting PBL as an acquisition method . Each factor is examined in detail and built into a spreadsheet tool

Overcoming Student Resistance to a Teaching Innovation

ERIC Educational Resources Information Center

Keeney-Kennicutt, Wendy; Baris Gunersel, Adalet; Simpson, Nancy

2008-01-01

This mixed-methods study investigated student perceptions of an innovative educational tool and the instructor strategies that helped change initial student resistance into acceptance and engagement. The educational tool in this study is Calibrated Peer Review (CPR)™, a web-based program that uses writing as a learning and assessment tool.…

76 FR 31339 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-31

... extension of the currently approved tool for the collection of ambulatory care clinical performance measure...: Medicare Demonstration Ambulatory Care Quality Measure Performance Assessment Tool (``PAT''); Use: This... based system. This system will also provide a platform for developing tools to collect clinical quality...

Assistive Software Tools for Secondary-Level Students with Literacy Difficulties

ERIC Educational Resources Information Center

Lange, Alissa A.; McPhillips, Martin; Mulhern, Gerry; Wylie, Judith

2006-01-01

The present study assessed the compensatory effectiveness of four assistive software tools (speech synthesis, spellchecker, homophone tool, and dictionary) on literacy. Secondary-level students (N = 93) with reading difficulties completed computer-based tests of literacy skills. Training on their respective software followed for those assigned to…

Influence of bone mineral density measurement on fracture risk assessment tool® scores in postmenopausal Indian women.

PubMed

Daswani, Bhavna; Desai, Meena; Mitra, Sumegha; Gavali, Shubhangi; Patil, Anushree; Kukreja, Subhash; Khatkhatay, M Ikram

2016-03-01

Fracture risk assessment tool® calculations can be performed with or without addition of bone mineral density; however, the impact of this addition on fracture risk assessment tool® scores has not been studied in Indian women. Given the limited availability and high cost of bone mineral density testing in India, it is important to know the influence of bone mineral density on fracture risk assessment tool® scores in Indian women. Therefore, our aim was to assess the contribution of bone mineral density in fracture risk assessment tool® outcome in Indian women. Apparently healthy postmenopausal Indian women (n = 506), aged 40-72 years, without clinical risk factors for bone disease, were retrospectively selected, and their fracture risk assessment tool® scores calculated with and without bone mineral density were compared. Based on WHO criteria, 30% women were osteoporotic, 42.9% were osteopenic and 27.1% had normal bone mineral density. Fracture risk assessment tool® scores for risk of both major osteoporotic fracture and hip fracture significantly increased on including bone mineral density (P < 0.0001). When criteria of National Osteoporosis Foundation, US was applied number of participants eligible for medical therapy increased upon inclusion of bone mineral density, (for major osteoporotic fracture risk number of women eligible without bone mineral density was 0 and with bone mineral density was 1, P > 0.05, whereas, for hip fracture risk number of women eligible without bone mineral density was 2 and with bone mineral density was 17, P < 0.0001). Until the establishment of country-specific medication intervention thresholds, bone mineral density should be included while calculating fracture risk assessment tool® scores in Indian women. © The Author(s) 2016.

A Comprehensive Approach in Dissemination of Evidence Based Care for PTSD

DTIC Science & Technology

2010-09-01

evaluate their practices’ capacity to provide evidence-based care and identify potential gaps in the assessment and treatment of PTSD and depression...Project participants will use the PIP tools to evaluate their practices’ capacity to provide evidence-based care and identify potential gaps in the...PIP tools can inform improvement efforts at the clinician-, practice- or systems-level, facilitate detection of potential gaps in evidence-based care

Evaluation of surgical training in the era of simulation

PubMed Central

Shaharan, Shazrinizam; Neary, Paul

2014-01-01

AIM: To assess where we currently stand in relation to simulator-based training within modern surgical training curricula. METHODS: A systematic literature search was performed in PubMed database using keywords “simulation”, “skills assessment” and “surgery”. The studies retrieved were examined according to the inclusion and exclusion criteria. Time period reviewed was 2000 to 2013. The methodology of skills assessment was examined. RESULTS: Five hundred and fifteen articles focussed upon simulator based skills assessment. Fifty-two articles were identified that dealt with technical skills assessment in general surgery. Five articles assessed open skills, 37 assessed laparoscopic skills, 4 articles assessed both open and laparoscopic skills and 6 assessed endoscopic skills. Only 12 articles were found to be integrating simulators in the surgical training curricula. Observational assessment tools, in the form of Objective Structured Assessment of Technical Skills (OSATS) dominated the literature. CONCLUSION: Observational tools such as OSATS remain the top assessment instrument in surgical training especially in open technical skills. Unlike the aviation industry, simulation based assessment has only now begun to cross the threshold of incorporation into mainstream skills training. Over the next decade we expect the promise of simulator-based training to finally take flight and begin an exciting voyage of discovery for surgical trainees. PMID:25228946

Pairing motivational interviewing with a nutrition and physical activity assessment and counseling tool in pediatric clinical practice: a pilot study.

PubMed

Christison, Amy L; Daley, Brendan M; Asche, Carl V; Ren, Jinma; Aldag, Jean C; Ariza, Adolfo J; Lowry, Kelly W

2014-10-01

Recommendations to screen and counsel for lifestyle behaviors can be challenging to implement during well-child visits in the primary care setting. A practice intervention was piloted using the Family Nutrition and Physical Activity (FNPA) Screening Tool paired with a motivational interviewing (MI)-based counseling tool during well-child visits. Acceptability and feasibility of this intervention were assessed. Its impact on parent-reported obesigenic behavior change and provider efficacy in lifestyle counseling were also examined. This was an observational study in a pediatric primary care office. During well-child visits of 100 patients (ages 4-16 years), the FNPA tool was implemented and providers counseled patients in an MI-consistent manner based on its results. Duration of implementation, patient satisfaction of the intervention, and success of stated lifestyle goals were measured. Provider self-efficacy and acceptability were also surveyed. The FNPA assessment was efficient to administer, requiring minutes to complete and score. Patient acceptability was high, ranging from 4.0 to 4.8 on a 5-point scale. Provider acceptability was good, with the exception of duration of counseling; self-efficacy in assessing patient "readiness for change" was improved. Parent-reported success of primary lifestyle goal was 68% at 1 month and 46% at 6 months. The FNPA assessment with an MI-based counseling tool shows promise as an approach to identify and address obesigenic behaviors during pediatric well-child visits. It has the potential to improve provider efficacy in obesity prevention and also influence patient health behaviors, which can possibly impact childhood excessive weight gain. After refinement, this practice intervention will be used in a larger trial.

The accountability of clinical education: its definition and assessment.

PubMed

Murray, E; Gruppen, L; Catton, P; Hays, R; Woolliscroft, J O

2000-10-01

Medical education is not exempt from increasing societal expectations of accountability. Competition for financial resources requires medical educators to demonstrate cost-effective educational practice; health care practitioners, the products of medical education programmes, must meet increasing standards of professionalism; the culture of evidence-based medicine demands an evaluation of the effect educational programmes have on health care and service delivery. Educators cannot demonstrate that graduates possess the required attributes, or that their programmes have the desired impact on health care without appropriate assessment tools and measures of outcome. To determine to what extent currently available assessment approaches can measure potentially relevant medical education outcomes addressing practitioner performance, health care delivery and population health, in order to highlight areas in need of research and development. Illustrative publications about desirable professional behaviour were synthesized to obtain examples of required competencies and health outcomes. A MEDLINE search for available assessment tools and measures of health outcome was performed. There are extensive tools for assessing clinical skills and knowledge. Some work has been done on the use of professional judgement for assessing professional behaviours; scholarship; and multiprofessional team working; but much more is needed. Very little literature exists on assessing group attributes of professionals, such as clinical governance, evidence-based practice and workforce allocation, and even less on examining individual patient or population health indices. The challenge facing medical educators is to develop new tools, many of which will rely on professional judgement, for assessing these broader competencies and outcomes.

Critical insights for a sustainability framework to address integrated community water services: Technical metrics and approaches.

PubMed

Xue, Xiaobo; Schoen, Mary E; Ma, Xin Cissy; Hawkins, Troy R; Ashbolt, Nicholas J; Cashdollar, Jennifer; Garland, Jay

2015-06-15

Planning for sustainable community water systems requires a comprehensive understanding and assessment of the integrated source-drinking-wastewater systems over their life-cycles. Although traditional life cycle assessment and similar tools (e.g. footprints and emergy) have been applied to elements of these water services (i.e. water resources, drinking water, stormwater or wastewater treatment alone), we argue for the importance of developing and combining the system-based tools and metrics in order to holistically evaluate the complete water service system based on the concept of integrated resource management. We analyzed the strengths and weaknesses of key system-based tools and metrics, and discuss future directions to identify more sustainable municipal water services. Such efforts may include the need for novel metrics that address system adaptability to future changes and infrastructure robustness. Caution is also necessary when coupling fundamentally different tools so to avoid misunderstanding and consequently misleading decision-making. Published by Elsevier Ltd.

Evaluation of a welfare assessment tool to examine practices for preventing, recognizing, and managing pain at companion-animal veterinary clinics

PubMed Central

Dawson, Lauren C.; Dewey, Cate E.; Stone, Elizabeth A.; Mosley, Cornelia I.; Guerin, Michele T.; Niel, Lee

2017-01-01

Successful prevention, recognition, and treatment of pain are integral to ensuring veterinary patient welfare. A canine and feline welfare assessment tool, incorporating verbal interviews with veterinarians using open-ended questions, was developed to assess pain management practices that safeguard and improve patient welfare. The tool was evaluated in 30 companion- and mixed-animal veterinary clinics in Ontario in order to assess its reliability, feasibility, and validity, while also benchmarking current practices. Responses were analyzed according to a scoring scheme developed based on published literature and expert opinion. Based on weighted kappa statistics, interview scoring had substantial inter-observer (Kw = 0.83, 0.73) and near-perfect intra-observer (Kw = 0.92) agreement, which suggests that the tool reliably collects information about pain management practices. Interviews were completed at all recruited clinics, which indicates high feasibility for the methods. Validity could not be assessed, as participants were reluctant to share information about analgesic administration from their clinical records. Descriptive results indicated areas for which many veterinarians are acting in accordance with best practices for pain management, such as pre-emptive and post-surgical analgesia for ovariohysterectomy patients, and post-surgical care instructions. Areas that offer opportunity for enhancement were also highlighted, e.g., training veterinary staff to recognize signs of pain and duration of analgesia in ovariohysterectomy patients after discharge. Overall, based on this limited sample, most veterinarians appear to be effectively managing their patients’ pain, although areas with opportunity for enhancement were also identified. Further research is needed to assess trends in a broader sample of participants. PMID:29081584

Evaluation of targeted and untargeted effects-based monitoring tools to assess impacts of contaminants of emerging concern on fish in the South Platte River, CO

EPA Science Inventory

Rivers in the arid Western United States face increasing influences from anthropogenic contaminants due to population growth, urbanization, and drought. To better understand and more effectively track the impacts of these contaminants, biologically-based monitoring tools are incr...

A Standardized Generalized Dimensionality Discrepancy Measure and a Standardized Model-Based Covariance for Dimensionality Assessment for Multidimensional Models

ERIC Educational Resources Information Center

Levy, Roy; Xu, Yuning; Yel, Nedim; Svetina, Dubravka

2015-01-01

The standardized generalized dimensionality discrepancy measure and the standardized model-based covariance are introduced as tools to critique dimensionality assumptions in multidimensional item response models. These tools are grounded in a covariance theory perspective and associated connections between dimensionality and local independence.…

Using exposure prediction tools to link exposure and dosimetry for risk-based decisions: A case study with phthalates

EPA Science Inventory

A few different exposure prediction tools were evaluated for use in the new in vitro-based safety assessment paradigm using di-2-ethylhexyl phthalate (DEHP) and dibutyl phthalate (DnBP) as case compounds. Daily intake of each phthalate was estimated using both high-throughput (HT...

Automated riverine landscape characterization: GIS-based tools for watershed-scale research, assessment, and management.

PubMed

Williams, Bradley S; D'Amico, Ellen; Kastens, Jude H; Thorp, James H; Flotemersch, Joseph E; Thoms, Martin C

2013-09-01

River systems consist of hydrogeomorphic patches (HPs) that emerge at multiple spatiotemporal scales. Functional process zones (FPZs) are HPs that exist at the river valley scale and are important strata for framing whole-watershed research questions and management plans. Hierarchical classification procedures aid in HP identification by grouping sections of river based on their hydrogeomorphic character; however, collecting data required for such procedures with field-based methods is often impractical. We developed a set of GIS-based tools that facilitate rapid, low cost riverine landscape characterization and FPZ classification. Our tools, termed RESonate, consist of a custom toolbox designed for ESRI ArcGIS®. RESonate automatically extracts 13 hydrogeomorphic variables from readily available geospatial datasets and datasets derived from modeling procedures. An advanced 2D flood model, FLDPLN, designed for MATLAB® is used to determine valley morphology by systematically flooding river networks. When used in conjunction with other modeling procedures, RESonate and FLDPLN can assess the character of large river networks quickly and at very low costs. Here we describe tool and model functions in addition to their benefits, limitations, and applications.

Assessment of health risks of policies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ádám, Balázs, E-mail: badam@cmss.sdu.dk; Department of Preventive Medicine, Faculty of Public Health, University of Debrecen, P.O. Box 9, H-4012 Debrecen; Molnár, Ágnes, E-mail: MolnarAg@smh.ca

The assessment of health risks of policies is an inevitable, although challenging prerequisite for the inclusion of health considerations in political decision making. The aim of our project was to develop a so far missing methodological guide for the assessment of the complex impact structure of policies. The guide was developed in a consensual way based on experiences gathered during the assessment of specific national policies selected by the partners of an EU project. Methodological considerations were discussed and summarized in workshops and pilot tested on the EU Health Strategy for finalization. The combined tool, which includes a textual guidancemore » and a checklist, follows the top-down approach, that is, it guides the analysis of causal chains from the policy through related health determinants and risk factors to health outcomes. The tool discusses the most important practical issues of assessment by impact level. It emphasises the transparent identification and prioritisation of factors, the consideration of the feasibility of exposure and outcome assessment with special focus on quantification. The developed guide provides useful methodological instructions for the comprehensive assessment of health risks of policies that can be effectively used in the health impact assessment of policy proposals. - Highlights: • Methodological guide for the assessment of health risks of policies is introduced. • The tool is developed based on the experiences from several case studies. • The combined tool consists of a textual guidance and a checklist. • The top-down approach is followed through the levels of the full impact chain. • The guide provides assistance for the health impact assessment of policy proposals.« less

Assessing adherence to the evidence base in the management of poststroke dysphagia.

PubMed

Burton, Christopher; Pennington, Lindsay; Roddam, Hazel; Russell, Ian; Russell, Daphne; Krawczyk, Karen; Smith, Hilary A

2006-01-01

To evaluate the reliability and responsiveness to change of an audit tool to assess adherence to evidence of effectiveness in the speech and language therapy (SLT) management of poststroke dysphagia. The tool was used to review SLT practice as part of a randomized study of different education strategies. Medical records were audited before and after delivery of the trial intervention. Seventeen SLT departments in the north-west of England participated in the study. The assessment tool was used to assess the medical records of 753 patients before and 717 patients after delivery of the trial intervention across the 17 departments. A target of 10 records per department per month was sought, using systematic sampling with a random start. Inter- and intra-rater reliability were explored, together with the tool's internal consistency and responsiveness to change. The assessment tool had high face validity, although internal consistency was low (ra = 0.37). Composite scores on the tool were however responsive to differences between SLT departments. Both inter- and intra-rater reliability ranged from 'substantial' to 'near perfect' across all items. The audit tool has high face validity and measurement reliability. The use of a composite adherence score should, however, proceed with caution as internal consistency is low.

The AgESGUI geospatial simulation system for environmental model application and evaluation

USDA-ARS?s Scientific Manuscript database

Practical decision making in spatially-distributed environmental assessment and management is increasingly being based on environmental process-based models linked to geographical information systems (GIS). Furthermore, powerful computers and Internet-accessible assessment tools are providing much g...

A new comprehension and communication tool: a valuable resource for internationally educated occupational therapists.

PubMed

Nguyen, Tram; Baptiste, Sue; Jung, Bonny; Wilkins, Seanne

2014-06-01

The need was identified for a way to assess internationally educated occupational therapists’ skills in understanding and communicating professional terminology used in occupational therapy practice. The project aim was to develop and validate such a resource. A scenario-based assessment was developed using a three-phase process for tool development. The development process involved completion of a literature scan of professional terminology used in occupational therapy practice; selection of terms and concepts commonly used in occupational therapy practice; and, creation of practice-based scenarios illustrating key concepts complete with rating rubrics. An advisory group provided oversight, and a sample of internationally educated occupational therapists completed pilot and validity testing. The initial findings showed the assessment to be easy to complete and sensitive to testing understanding of the defined terms. The final outcome is an assessment tool that has broad application for occupational therapists wishing to enter professional practice in a new country. © 2013 Occupational Therapy Australia.

KIPS: An Evidence-Based Tool for Assessing Parenting Strengths and Needs in Diverse Families

ERIC Educational Resources Information Center

Comfort, Marilee; Gordon, Philip R.; Naples, Denise

2011-01-01

The movement toward evidence-based practices has stimulated greater interest in assessing parenting outcomes. The purpose of these studies was to further validate the Keys to Interactive Parenting Scale (KIPS), a structured observational assessment of parenting quality, with 397 diverse families. Factor analysis demonstrated that the 12 KIPS items…

Mobile Formative Assessment Tool Based on Data Mining Techniques for Supporting Web-Based Learning

ERIC Educational Resources Information Center

Chen, Chih-Ming; Chen, Ming-Chuan

2009-01-01

Current trends clearly indicate that online learning has become an important learning mode. However, no effective assessment mechanism for learning performance yet exists for e-learning systems. Learning performance assessment aims to evaluate what learners learned during the learning process. Traditional summative evaluation only considers final…

A standardised equine-based welfare assessment tool used for six years in low and middle income countries

PubMed Central

Brown, Ashleigh F.; Upjohn, Melissa

2018-01-01

The majority of horses, donkeys and mules (equids) are in low- and middle-income countries, where they remain a key source of labour in the construction, agriculture and tourism industries, as well as supporting households daily through transporting people and staple goods. Globally, approximately 600 million people depend on working equids for their livelihood. Safeguarding the welfare of these animals is essential for them to work, as well as for the intrinsic value of the animal’s quality of life. In order to manage animal welfare, it must be measured. Over the past decade, welfare assessment methodologies have emerged for different species, more recently for equids. We present the Standardised Equine-Based Welfare Assessment Tool (SEBWAT) for working equids. The tool is unique, in that it has been applied in practice by a non-governmental organisation (NGO) for six years across Low-Middle-Income Countries (LMICs). We describe the revision of the tool from an original to a second version, the tool methodology and user training process and how data collection and analysis have been conducted. We describe its application at scale, where it has been used more than 71,000 times in 11 countries. Case study examples are given from the tool being used for a needs assessment in Guatemala and monitoring welfare change in Jordan. We conclude by describing the main benefits and limitations for how the tool could be applied by others on working equids in LMICs and how it may develop in the future. PMID:29466391

Development of a Self-Assessment Tool to Facilitate Decision-Making in Choosing a Long Term Care Administration Major

ERIC Educational Resources Information Center

Johs-Artisensi, Jennifer L.; Olson, Douglas M.; Nahm, Abraham Y.

2016-01-01

Long term care administrators need a broad base of knowledge, skills, and interests to provide leadership and be successful in managing a fiscally responsible, quality long term care organization. Researchers developed a tool to help students assess whether a long term care administration major is a compatible fit. With input from professionals in…

Moving beyond Achievement Data: Development of the Student Orientation to School Questionnaire as a Noncognitive Assessment Tool

ERIC Educational Resources Information Center

Burger, John M.; Nadirova, Anna; Keefer, Kateryna V.

2012-01-01

The Student Orientation to School Questionnaire (SOS-Q) is a multidimensional student-centered assessment tool for measuring psychosocial facilitators of student engagement. The SOS-Q is based in research on the self-system models of motivation and direct student input on perceived supports and barriers for high school completion. The current…

In a Search for Meaning: Challenging the Accepted Know-How of Working with Suicide Risk

ERIC Educational Resources Information Center

Reeves, Andrew

2017-01-01

This opinion piece considers the current predominance of assessment tools and strategies in working with people at risk of suicide, and questions their efficacy and how they are privileged in day to day mental health practice. While such tools and an evidence-based "scientific" approach to assessment clearly has its place, the author…

Planning for land use and conservation: Assessing GIS-based conservation software for land use planning

Treesearch

Rob Baldwin; Ryan Scherzinger; Don Lipscomb; Miranda Mockrin; Susan Stein

2014-01-01

Recent advances in planning and ecological software make it possible to conduct highly technical analyses to prioritize conservation investments and inform local land use planning. We review these tools, termed conservation planning tools, and assess the knowledge of a key set of potential users: the land use planning community. We grouped several conservation software...

Integrated performance and reliability specification for digital avionics systems

NASA Technical Reports Server (NTRS)

Brehm, Eric W.; Goettge, Robert T.

1995-01-01

This paper describes an automated tool for performance and reliability assessment of digital avionics systems, called the Automated Design Tool Set (ADTS). ADTS is based on an integrated approach to design assessment that unifies traditional performance and reliability views of system designs, and that addresses interdependencies between performance and reliability behavior via exchange of parameters and result between mathematical models of each type. A multi-layer tool set architecture has been developed for ADTS that separates the concerns of system specification, model generation, and model solution. Performance and reliability models are generated automatically as a function of candidate system designs, and model results are expressed within the system specification. The layered approach helps deal with the inherent complexity of the design assessment process, and preserves long-term flexibility to accommodate a wide range of models and solution techniques within the tool set structure. ADTS research and development to date has focused on development of a language for specification of system designs as a basis for performance and reliability evaluation. A model generation and solution framework has also been developed for ADTS, that will ultimately encompass an integrated set of analytic and simulated based techniques for performance, reliability, and combined design assessment.

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

Software for predictive microbiology and risk assessment: a description and comparison of tools presented at the ICPMF8 Software Fair.

PubMed

Tenenhaus-Aziza, Fanny; Ellouze, Mariem

2015-02-01

The 8th International Conference on Predictive Modelling in Food was held in Paris, France in September 2013. One of the major topics of this conference was the transfer of knowledge and tools between academics and stakeholders of the food sector. During the conference, a "Software Fair" was held to provide information and demonstrations of predictive microbiology and risk assessment software. This article presents an overall description of the 16 software tools demonstrated at the session and provides a comparison based on several criteria such as the modeling approach, the different modules available (e.g. databases, predictors, fitting tools, risk assessment tools), the studied environmental factors (temperature, pH, aw, etc.), the type of media (broth or food) and the number and type of the provided micro-organisms (pathogens and spoilers). The present study is a guide to help users select the software tools which are most suitable to their specific needs, before they test and explore the tool(s) in more depth. Copyright © 2014 Elsevier Ltd. All rights reserved.

The feasibility of sharing simulation-based evaluation scenarios in anesthesiology.

PubMed

Berkenstadt, Haim; Kantor, Gareth S; Yusim, Yakov; Gafni, Naomi; Perel, Azriel; Ezri, Tiberiu; Ziv, Amitai

2005-10-01

We prospectively assessed the feasibility of international sharing of simulation-based evaluation tools despite differences in language, education, and anesthesia practice, in an Israeli study, using validated scenarios from a multi-institutional United States (US) study. Thirty-one Israeli junior anesthesia residents performed four simulation scenarios. Training sessions were videotaped and performance was assessed using two validated scoring systems (Long and Short Forms) by two independent raters. Subjects scored from 37 to 95 (70 +/- 12) of 108 possible points with the "Long Form" and "Short Form" scores ranging from 18 to 35 (28.2 +/- 4.5) of 40 possible points. Scores >70% of the maximal score were achieved by 61% of participants in comparison to only 5% in the original US study. The scenarios were rated as very realistic by 80% of the participants (grade 4 on a 1-4 scale). Reliability of the original assessment tools was demonstrated by internal consistencies of 0.66 for the Long and 0.75 for the Short Form (Cronbach alpha statistic). Values in the original study were 0.72-0.76 for the Long and 0.71-0.75 for the Short Form. The reliability did not change when a revised Israeli version of the scoring was used. Interrater reliability measured by Pearson correlation was 0.91 for the Long and 0.96 for the Short Form (P < 0.01). The high scores for plausibility given to the scenarios and the similar reliability of the original assessment tool support the feasibility of using simulation-based evaluation tools, developed in the US, in Israel. The higher scores achieved by Israeli residents may be related to the fact that most Israeli residents are immigrants with previous training in anesthesia. Simulation-based assessment tools developed in a multi-institutional study in the United States can be used in Israel despite the differences in language, education, and medical system.

Assessing fidelity of cognitive behavioral therapy in rural VA clinics: design of a randomized implementation effectiveness (hybrid type III) trial.

PubMed

Cucciare, Michael A; Curran, Geoffrey M; Craske, Michelle G; Abraham, Traci; McCarthur, Michael B; Marchant-Miros, Kathy; Lindsay, Jan A; Kauth, Michael R; Landes, Sara J; Sullivan, Greer

2016-05-10

Broadly disseminating and implementing evidence-based psychotherapies with high fidelity, particularly cognitive behavioral therapy (CBT), has proved challenging for many health-care systems, including the Department of Veterans Affairs, especially in primary care settings such as small or remote clinics. A computer-based tool (based on the coordinated anxiety learning and management (CALM) program) was designed to support primary care-based mental health providers in delivering CBT. The objectives of this study are to modify the CALM tool to meet the needs of mental health clinicians in veterans affairs (VA) community-based outpatient clinics (CBOCs) and rural "veterans", use external facilitation to implement CBT and determine the effect of the CALM tool versus a manualized version of CALM to improve fidelity to the CBT treatment model, and conduct a needs assessment to understand how best to support future implementation of the CALM tool in routine care. Focus groups will inform the redesign of the CALM tool. Mental health providers at regional VA CBOCs; CBT experts; VA experts in implementation of evidence-based mental health practices; and veterans with generalized anxiety disorder, panic disorder, social anxiety disorder, posttraumatic stress disorder, "with or without" depression will be recruited. A hybrid type III design will be used to examine the effect of receiving CBT training plus either the CALM tool or a manual version of CALM on treatment fidelity. External facilitation will be used as the overarching strategy to implement both CBT delivery methods. Data will also be collected on symptoms of the targeted disorders. To help prepare for the future implementation of the CALM tool in VA CBOCs, we will perform an implementation need assessment with mental health providers participating in the clinical trial and their CBOC directors. This project will help inform strategies for delivering CBT with high fidelity in VA CBOCs to veterans with anxiety disorders and PTSD with or without depression. If successful, results of this study could be used to inform a national rollout of the CALM tool in VA CBOCs including providing recommendations for optimizing the adoption and sustained use of the computerized CALM tool among mental health providers in this setting. ClinicalTrials.gov, NCT02488551.

Above, Beyond, and Over the Side rails: Evaluating the New Memorial Emergency Department Fall-Risk-Assessment Tool.

PubMed

Scott, Robin A; Oman, Kathleen S; Flarity, Kathleen; Comer, Jennifer L

2018-03-06

Patient falls are a significant issue in hospitalized patients and financially costly to hospitals. The Joint Commission requires that patients be assessed for fall risk and interventions in place to mitigate the risk of falls. It is imperative to have a patient population/setting specific fall risk assessment tool to identify patients at risk for falling. The purpose of this study was to evaluate the reliability and validity of the 2013 Memorial ED Fall Risk Assessment tool (MEDFRAT) specifically designed for the ED population. A two-phase prospective design was used for this study. Phase one determined the interrater reliability of the MEDFRAT. Phase two assessed the validity of the MEDFRAT in an emergency department (ED) within a 600-bed academic/teaching institution; Level II Trauma Center with >100,000 annual patient visits. The Memorial ED Fall Risk Assessment Tool was validated in this ED setting. The tool demonstrated positive interrater reliability (k=0.701) and when implemented with a falls prevention strategy and staff education demonstrated a 48% decrease in ED fall rate (0.57 falls/1000 patient visits) post implementation during the study period. The MEDFRAT, an evidenced based ED-specific fall risk tool was implemented on the basis of the risk factors consistently identified in the literature: prior fall history, impaired mobility, altered mental status, altered elimination, and the use of sedative medication. The Memorial ED Fall Risk Assessment Tool demonstrated to be a valid tool for this hospital system. Copyright © 2018 Emergency Nurses Association. Published by Elsevier Inc. All rights reserved.

A comparative assessment of tools for ecosystem services quantification and valuation

USGS Publications Warehouse

Bagstad, Kenneth J.; Semmens, Darius; Waage, Sissel; Winthrop, Robert

2013-01-01

To enter widespread use, ecosystem service assessments need to be quantifiable, replicable, credible, flexible, and affordable. With recent growth in the field of ecosystem services, a variety of decision-support tools has emerged to support more systematic ecosystem services assessment. Despite the growing complexity of the tool landscape, thorough reviews of tools for identifying, assessing, modeling and in some cases monetarily valuing ecosystem services have generally been lacking. In this study, we describe 17 ecosystem services tools and rate their performance against eight evaluative criteria that gauge their readiness for widespread application in public- and private-sector decision making. We describe each of the tools′ intended uses, services modeled, analytical approaches, data requirements, and outputs, as well time requirements to run seven tools in a first comparative concurrent application of multiple tools to a common location – the San Pedro River watershed in southeast Arizona, USA, and northern Sonora, Mexico. Based on this work, we offer conclusions about these tools′ current ‘readiness’ for widespread application within both public- and private-sector decision making processes. Finally, we describe potential pathways forward to reduce the resource requirements for running ecosystem services models, which are essential to facilitate their more widespread use in environmental decision making.

Interventions and assessment tools addressing key concepts people need to know to appraise claims about treatment effects: a systematic mapping review.

PubMed

Austvoll-Dahlgren, Astrid; Nsangi, Allen; Semakula, Daniel

2016-12-29

People's ability to appraise claims about treatment effects is crucial for informed decision-making. Our objective was to systematically map this area of research in order to (a) provide an overview of interventions targeting key concepts that people need to understand to assess treatment claims and (b) to identify assessment tools used to evaluate people's understanding of these concepts. The findings of this review provide a starting point for decisions about which key concepts to address when developing new interventions, and which assessment tools should be considered. We conducted a systematic mapping review of interventions and assessment tools addressing key concepts important for people to be able to assess treatment claims. A systematic literature search was done by a reserach librarian in relevant databases. Judgement about inclusion of studies and data collection was done by at least two researchers. We included all quantitative study designs targeting one or more of the key concepts, and targeting patients, healthy members of the public, and health professionals. The studies were divided into four categories: risk communication and decision aids, evidence-based medicine and critical appraisal, understanding of controlled trials, and science education. Findings were summarised descriptively. We included 415 studies, of which the interventions and assessment tools we identified included only a handful of the key concepts. The most common key concepts in interventions were "Treatments usually have beneficial and harmful effects," "Treatment comparisons should be fair," "Compare like with like," and "Single studies can be misleading." A variety of assessment tools were identified, but only four assessment tools included 10 or more key concepts. There is great potential for developing learning and assessment tools targeting key concepts that people need to understand to assess claims about treatment effects. There is currently no instrument covering assessment of all these key concepts.

Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations.

PubMed

Mustafa, Reem A; Wiercioch, Wojtek; Falavigna, Maicon; Zhang, Yuan; Ivanova, Liudmila; Arevalo-Rodriguez, Ingrid; Cheung, Adrienne; Prediger, Barbara; Ventresca, Matthew; Brozek, Jan; Santesso, Nancy; Bossuyt, Patrick; Garg, Amit X; Lloyd, Nancy; Lelgemann, Monika; Bühler, Diedrich; Schünemann, Holger J

2017-12-01

The objective of this study was to identify and describe critical appraisal tools designed for assessing the quality of evidence (QoE) and/or strength of recommendations (SoRs) related to health care-related tests and diagnostic strategies (HCTDSs). We conducted a systematic review to identify tools applied in guidelines, methodological articles, and systematic reviews to assess HCTDS. We screened 5,534 titles and abstracts, 1,004 full-text articles, and abstracted data from 330 references. We identified 29 tools and 14 modifications of existing tools for assessing QoE and SoR. Twenty-three out of 29 tools acknowledge the importance of assessing the QoE and SoR separately, but in 8, the SoR is based solely on QoE. When making decisions about the use of tests, patient values and preferences and impact on resource utilization were considered in 6 and 8 tools, respectively. There is also confusion about the terminology that describes the various factors that influence the QoE and SoR. Although at least one approach includes all relevant criteria for assessing QoE and determining SoR, more detailed guidance about how to operationalize these assessments and make related judgments will be beneficial. There is a need for a better description of the framework for using evidence to make decisions and develop recommendations about HCTDS. Copyright © 2017 Elsevier Inc. All rights reserved.

Protocol for a prospective, school-based standardisation study of a digital social skills assessment tool for children: The Paediatric Evaluation of Emotions, Relationships, and Socialisation (PEERS) study.

PubMed

Thompson, Emma J; Beauchamp, Miriam H; Darling, Simone J; Hearps, Stephen J C; Brown, Amy; Charalambous, George; Crossley, Louise; Darby, David; Dooley, Julian J; Greenham, Mardee; Jaimangal, Mohinder; McDonald, Skye; Muscara, Frank; Turkstra, Lyn; Anderson, Vicki A

2018-02-08

Humans are by nature a social species, with much of human experience spent in social interaction. Unsurprisingly, social functioning is crucial to well-being and quality of life across the lifespan. While early intervention for social problems appears promising, our ability to identify the specific impairments underlying their social problems (eg, social communication) is restricted by a dearth of accurate, ecologically valid and comprehensive child-direct assessment tools. Current tools are largely limited to parent and teacher ratings scales, which may identify social dysfunction, but not its underlying cause, or adult-based experimental tools, which lack age-appropriate norms. The present study describes the development and standardisation of Paediatric Evaluation of Emotions, Relationships, and Socialisation ( PEERS®), an iPad-based social skills assessment tool. The PEERS project is a cross-sectional study involving two groups: (1) a normative group, recruited from early childhood, primary and secondary schools across metropolitan and regional Victoria, Australia; and (2) a clinical group, ascertained from outpatient services at The Royal Children's Hospital Melbourne (RCH). The project aims to establish normative data for PEERS®, a novel and comprehensive app-delivered child-direct measure of social skills for children and youth. The project involves recruiting and assessing 1000 children aged 4.0-17.11 years. Assessments consist of an intellectual screen, PEERS® subtests, and PEERS-Q, a self-report questionnaire of social skills. Parents and teachers also complete questionnaires relating to participants' social skills. Main analyses will comprise regression-based continuous norming, factor analysis and psychometric analysis of PEERS® and PEERS-Q. Ethics approval has been obtained through the RCH Human Research Ethics Committee (34046), the Victorian Government Department of Education and Early Childhood Development (002318), and Catholic Education Melbourne (2166). Findings will be disseminated through international conferences and peer-reviewed journals. Following standardisation of PEERS®, the tool will be made commercially available. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

OLTARIS: On-Line Tool for the Assessment of Radiation in Space

NASA Technical Reports Server (NTRS)

Singleterry, Robert C., Jr.; Blattnig, Steve R.; Clowdsley, Martha S.; Qualls, Garry D.; Sandridge, Chris A.; Simonsen, Lisa C.; Norbury, John W.; Slaba, Tony C.; Walker, Steve A.; Badavi, Francis F.;

Structured journal club as a tool to teach and assess resident competence in practice-based learning and improvement.

PubMed

Lee, Andrew G; Boldt, H Culver; Golnik, Karl C; Arnold, Anthony C; Oetting, Thomas A; Beaver, Hilary A; Olson, Richard J; Zimmerman, M Bridget; Carter, Keith

2006-03-01

To describe the use of the journal club as a tool to teach and assess competency in practice-based learning (PBL) and improvement among residents in ophthalmology. Interventional case series. Ophthalmology residents. Three academic ophthalmology residency programs in the United States. A survey was performed of self-assessed skills in PBL among residents in ophthalmology training before and after the implementation of a structured review checklist during a traditional resident journal club. The survey had 5 domains, including (A) appraise and assimilate evidence, (B) read a journal article critically, (C) use a systematic and standardized checklist, (D) apply knowledge of study designs and statistical methods, and (E) maintain a self-documented written record of compliance. The respondents scored their ability (range, 1-5). The use of a structured journal club tool was associated with a statistically significant improvement in self-assessed ability in all 5 domains. Although validity, reliability, and long-term efficacy studies are necessary, the structured journal club is one method of teaching and assessing resident competency in PBL and improvement.

Activity and heart rate-based measures for outpatient cardiac rehabilitation.

PubMed

Bidargaddi, N P; Sarela, A

2008-01-01

Derive activity and heart rate (HR) monitor-based clinically relevant measures for outpatient cardiac rehabilitation (CR). We are currently collecting activity/ECG data from patients undergoing cardiac rehabilitation over duration of six weeks. From these data sets, we a) derive various measures which can be used in assessing home-based CR patients remotely and b) investigate the usefulness of continuous ambulatory HR and heart rate variability (HRV) for various core components of CR. The information provided by these measures is interpreted according to the CR guidelines framework by American Association of Cardiovascular and Pulmonary Rehabilitation (AACVPR), thus showing how these tools can be used in assessing the progress of patients' condition. The usefulness and significance of these measures from a health care professional perspective is also presented by evaluating them against the existing hospital-based measures through examples. Hospital-based CR programs, despite their clinical benefits are severely under-utilized and resource-demanding. Ambulatory monitoring technologies, which provide a means for continuous physiological monitoring of patients at home compared to hospital-based tools, can enable home-based CR. The clinically relevant measures derived from these tools not only reflect patients' condition in a similar way as conventional tools but also show the continuous status of functional capacity (FC).

Free web-based modelling platform for managed aquifer recharge (MAR) applications

NASA Astrophysics Data System (ADS)

Stefan, Catalin; Junghanns, Ralf; Glaß, Jana; Sallwey, Jana; Fatkhutdinov, Aybulat; Fichtner, Thomas; Barquero, Felix; Moreno, Miguel; Bonilla, José; Kwoyiga, Lydia

2017-04-01

Managed aquifer recharge represents a valuable instrument for sustainable water resources management. The concept implies purposeful infiltration of surface water into underground for later recovery or environmental benefits. Over decades, MAR schemes were successfully installed worldwide for a variety of reasons: to maximize the natural storage capacity of aquifers, physical aquifer management, water quality management, and ecological benefits. The INOWAS-DSS platform provides a collection of free web-based tools for planning, management and optimization of main components of MAR schemes. The tools are grouped into 13 specific applications that cover most relevant challenges encountered at MAR sites, both from quantitative and qualitative perspectives. The applications include among others the optimization of MAR site location, the assessment of saltwater intrusion, the restoration of groundwater levels in overexploited aquifers, the maximization of natural storage capacity of aquifers, the improvement of water quality, the design and operational optimization of MAR schemes, clogging development and risk assessment. The platform contains a collection of about 35 web-based tools of various degrees of complexity, which are either included in application specific workflows or used as standalone modelling instruments. Among them are simple tools derived from data mining and empirical equations, analytical groundwater related equations, as well as complex numerical flow and transport models (MODFLOW, MT3DMS and SEAWAT). Up to now, the simulation core of the INOWAS-DSS, which is based on the finite differences groundwater flow model MODFLOW, is implemented and runs on the web. A scenario analyser helps to easily set up and evaluate new management options as well as future development such as land use and climate change and compare them to previous scenarios. Additionally simple tools such as analytical equations to assess saltwater intrusion are already running online. Besides the simulation tools, a web-based data base is under development where geospatial and time series data can be stored, managed, and processed. Furthermore, a web-based information system containing user guides for the various developed tools and applications as well as basic information on MAR and related topics is published and will be regularly expanded as new tools are getting implemented. The INOWAS-DSS including its simulation tools, data base and information system provides an extensive framework to manage, plan and optimize MAR facilities. As the INOWAS-DSS is an open-source software accessible via the internet using standard web browsers, it offers new ways for data sharing and collaboration among various partners and decision makers.

Chart-stimulated Recall as a Learning Tool for Improving Radiology Residents' Reports.

PubMed

Nadeem, Naila; Zafar, Abdul Mueed; Haider, Sonia; Zuberi, Rukhsana W; Ahmad, Muhammad Nadeem; Ojili, Vijayanadh

2017-08-01

Workplace-based assessments gauge the highest tier of clinical competence. Chart-stimulated recall (CSR) is a workplace-based assessment method that complements chart audit with an interview based on the residents' notes. It allows evaluation of the residents' knowledge and heuristics while providing opportunities for feedback and self-reflection. We evaluated the utility of CSR for improving the radiology residents' reporting skills. Residents in each year of training were randomly assigned to an intervention group (n = 12) or a control group (n = 13). Five pre-intervention and five post-intervention reports of each resident were independently evaluated by three blinded reviewers using a modified Bristol Radiology Report Assessment Tool. The study intervention comprised a CSR interview tailored to each individual resident's learning needs based on the pre-intervention assessment. The CSR process focused on the clinical relevance of the radiology reports. Student's t test (P < .05) was used to compare pre- and post-intervention scores of each group. A total of 125 pre-intervention and 125 post-intervention reports were evaluated (total 750 assessments). The Cronbach's alpha for the study tool was 0.865. A significant improvement was seen in the cumulative 19-item score (66% versus 73%, P < .001) and the global rating score (59% versus 72%, P < .001) of the intervention group after the CSR. The reports of the control group did not demonstrate any significant improvement. CSR is a feasible workplace-based assessment method for improving reporting skills of the radiology residents. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

Developing an Evaluation Tool for Assessing Clinical Ethics Consultation Skills in Simulation Based Education: The ACES Project.

PubMed

Wasson, Katherine; Parsi, Kayhan; McCarthy, Michael; Siddall, Viva Jo; Kuczewski, Mark

2016-06-01

The American Society for Bioethics and Humanities has created a quality attestation (QA) process for clinical ethics consultants; the pilot phase of reviewing portfolios has begun. One aspect of the QA process which is particularly challenging is assessing the interpersonal skills of individual clinical ethics consultants. We propose that using case simulation to evaluate clinical ethics consultants is an approach that can meet this need provided clear standards for assessment are identified. To this end, we developed the Assessing Clinical Ethics Skills (ACES) tool, which identifies and specifies specific behaviors that a clinical ethics consultant should demonstrate in an ethics case simulation. The aim is for the clinical ethics consultant or student to use a videotaped case simulation, along with the ACES tool scored by a trained rater, to demonstrate their competence as part of their QA portfolio. The development and piloting of the tool is described.

Osteoporosis risk prediction for bone mineral density assessment of postmenopausal women using machine learning.

PubMed

Yoo, Tae Keun; Kim, Sung Kean; Kim, Deok Won; Choi, Joon Yul; Lee, Wan Hyung; Oh, Ein; Park, Eun-Cheol

2013-11-01

A number of clinical decision tools for osteoporosis risk assessment have been developed to select postmenopausal women for the measurement of bone mineral density. We developed and validated machine learning models with the aim of more accurately identifying the risk of osteoporosis in postmenopausal women compared to the ability of conventional clinical decision tools. We collected medical records from Korean postmenopausal women based on the Korea National Health and Nutrition Examination Surveys. The training data set was used to construct models based on popular machine learning algorithms such as support vector machines (SVM), random forests, artificial neural networks (ANN), and logistic regression (LR) based on simple surveys. The machine learning models were compared to four conventional clinical decision tools: osteoporosis self-assessment tool (OST), osteoporosis risk assessment instrument (ORAI), simple calculated osteoporosis risk estimation (SCORE), and osteoporosis index of risk (OSIRIS). SVM had significantly better area under the curve (AUC) of the receiver operating characteristic than ANN, LR, OST, ORAI, SCORE, and OSIRIS for the training set. SVM predicted osteoporosis risk with an AUC of 0.827, accuracy of 76.7%, sensitivity of 77.8%, and specificity of 76.0% at total hip, femoral neck, or lumbar spine for the testing set. The significant factors selected by SVM were age, height, weight, body mass index, duration of menopause, duration of breast feeding, estrogen therapy, hyperlipidemia, hypertension, osteoarthritis, and diabetes mellitus. Considering various predictors associated with low bone density, the machine learning methods may be effective tools for identifying postmenopausal women at high risk for osteoporosis.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools.

PubMed

Shurtz, Suzanne; Foster, Margaret J

2011-07-01

The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed.

Venous thromboembolism prophylaxis risk assessment in a general surgery cohort: a closed-loop audit.

PubMed

McGoldrick, D M; Redmond, H P

2017-08-01

Venous thromboembolism (VTE) is a potential source of morbidity and mortality in surgical in-patients. A number of guidelines exist that advise on prophylactic measures. We aimed to assess VTE prophylaxis prescribing practices and compliance with a kardex-based risk assessment tool in a general surgery population. Data on general surgery in-patients were collected on two separate wards on two separate days. Drug kardexes were assessed for VTE prophylaxis measures and use of the risk assessment tool. NICE and SIGN guidelines were adopted as a gold standard. The audit results and information on the risk assessment tool were presented as an educational intervention at two separate departmental teaching sessions. A re-audit was completed after 3 months. In Audit A, 74 patients were assessed. 70% were emergency admissions. The risk assessment tool was completed in 2.7%. 75 and 97% of patients were correctly prescribed anti-embolic stockings (AES) and low-molecular weight heparin (LMWH), respectively. 30 patients were included in Audit B, 56% of whom were emergency admissions. 66% had a risk assessment performed, a statistically significant improvement (p < 0.0001). Rates of LMWH prescribing were similar (96%), but AES prescribing was lower (36%). Rates of LMWH prescribing are high in this general surgical population, although AES prescribing rates vary. Use of the VTE risk assessment tool increased following the initial audit and intervention.

Grounding formative assessment in high-school chemistry classrooms: Connections between professional development and teacher practice

NASA Astrophysics Data System (ADS)

Cisterna Alburquerque, Dante Igor

This study describes and analyzes the experiences of two high-school chemistry teachers who participated in a team-based professional development program to learn about and enact formative assessment in their classrooms. The overall purpose of this study is to explain how participation in this professional development influenced both teachers' classroom enactment of formative assessment practices. This study focuses on 1) teachers' participation in the professional development program, 2) teachers' enactment of formative assessment, and 3) factors that enabled or hindered enactment of formative assessment. Drawing on cultural-historical activity theory (CHAT) and using evidence from teacher lessons, teacher interviews, professional development meetings as data sources, this single embedded case study analyzes how these two teachers who participated in the same learning team and have similar characteristics (i.e., teaching in the same school, teaching the same courses and population of students, and using the same materials) differentially used the professional development learning about formative assessment as mediating tools to improve their classroom instruction. The learning team experience contributed to both teachers' development of a better understanding of formative assessment---especially in recognizing that their current grading and assessment practices were not appropriate to promote student learning---and the co-creation of artifacts to gather evidence of students' ideas. Although both teachers demonstrated understanding about how formative assessment may serve to promote student learning and had a set of tools available to utilize for formative assessment use, they did not enact these tools in the same way. One teacher appropriated formative assessment as mediating tool to verify if the students were following her explanations, and to check if the students were able to provide the correct response. The other teacher used the mediating tool to promote better understanding of students' ideas and her mindset shifted to place more value on the diversity of students' thinking and help them be more aware of their ideas. This study illustrates the complexities of enacting formative assessment practices in particular classrooms because teachers may interpret and use these tools in different ways. Thus, when teachers enacted these mediating tools, their interaction with the activity system's components produced different instructional outcomes and tensions. Similarly, this study describes how the use of artifacts of practice can be a vehicle between professional development and classrooms, especially in early stages of professional development. This study presents implications for professional development and formative assessment research and practice. Professional development needs to support teachers in reflecting on their practice in terms of activity systems, use a solid and research-based understanding of formative assessment, and promote opportunities to teachers to create, enact, and reflect on formative assessment artifacts and tools.

Face and Content Validity of the MacArthur Competence Assessment Tool for the Treatment of Iranian Patients.

PubMed

Saber, Ali; Tabatabaei, Seyed Mahmoud; Akasheh, Godarz; Sehat, Mojtaba; Zanjani, Zahra; Larijani, Bagher

2017-01-01

There is not a valid Persian tool for measuring the decision-making competency of patients. The aim of this study is to evaluate the face and content validity of the MacArthur Competence Assessment Tool for the treatment of Iranian Persian-speaking patients. To assess the validity of the Persian version of the tool, a self-administrated questionnaire was designed. The Lawshe method was also used for assessing each item. Content validity ratio (CVR) and content validity index (CVI) were used to assess the content validity quantitatively. According to the experts' judgment, questions with a CVR ≥0.62 and CVR <0.62 were maintainable and unmaintainable, respectively. The questions were designed in a manner to achieve the desirable result (CVR ≥0.62). The CVI scale (S-CVI) and CVI (S-CVI/Ave) were 0.94 (higher than 0.79). Thus, the content validity was confirmed. Since capacity assessments are usually based on physician's subjective judgment, they are likely to bias and therefore, with this suitably validated tool, we can improve judgment of physicians and health-care providers in out- and in-patient cases.

Authentic Assessment: Reducing the Fear and Trembling.

ERIC Educational Resources Information Center

Terry, C. Ann; Pantle, Tonya T.

1994-01-01

This discussion of authentic assessment stresses that such assessment should be contextual (based on the context of meaning), collaborative (involves learners), and constructive (supports risk-taking). It compares tools designed for formative assessment including criteria checklists, "kidwatching," profiles, conferences, and portfolios. (DB)

Comparing 2 National Organization-Level Workplace Health Promotion and Improvement Tools, 2013–2015

PubMed Central

Lang, Jason E.; Davis, Whitney D.; Jones-Jack, Nkenge H.; Mukhtar, Qaiser; Lu, Hua; Acharya, Sushama D.; Molloy, Meg E.

2016-01-01

Creating healthy workplaces is becoming more common. Half of employers that have more than 50 employees offer some type of workplace health promotion program. Few employers implement comprehensive evidence-based interventions that reach all employees and achieve desired health and cost outcomes. A few organization-level assessment and benchmarking tools have emerged to help employers evaluate the comprehensiveness and rigor of their health promotion offerings. Even fewer tools exist that combine assessment with technical assistance and guidance to implement evidence-based practices. Our descriptive analysis compares 2 such tools, the Centers for Disease Control and Prevention’s Worksite Health ScoreCard and Prevention Partners’ WorkHealthy America, and presents data from both to describe workplace health promotion practices across the United States. These tools are reaching employers of all types (N = 1,797), and many employers are using a comprehensive approach (85% of those using WorkHealthy America and 45% of those using the ScoreCard), increasing program effectiveness and impact. PMID:27685429

A Prototype Tool to Enable Farmers to Measure and Improve the Welfare Performance of the Farm Animal Enterprise: The Unified Field Index

PubMed Central

Colditz, Ian G.; Ferguson, Drewe M.; Collins, Teresa; Matthews, Lindsay; Hemsworth, Paul H.

2014-01-01

Simple Summary Benchmarking is a tool widely used in agricultural industries that harnesses the experience of farmers to generate knowledge of practices that lead to better on-farm productivity and performance. We propose, by analogy with production performance, a method for measuring the animal welfare performance of an enterprise and describe a tool for farmers to monitor and improve the animal welfare performance of their business. A general framework is outlined for assessing and monitoring risks to animal welfare based on measures of animals, the environment they are kept in and how they are managed. The tool would enable farmers to continually improve animal welfare. Abstract Schemes for the assessment of farm animal welfare and assurance of welfare standards have proliferated in recent years. An acknowledged short-coming has been the lack of impact of these schemes on the welfare standards achieved on farm due in part to sociological factors concerning their implementation. Here we propose the concept of welfare performance based on a broad set of performance attributes of an enterprise and describe a tool based on risk assessment and benchmarking methods for measuring and managing welfare performance. The tool termed the Unified Field Index is presented in a general form comprising three modules addressing animal, resource, and management factors. Domains within these modules accommodate the principle conceptual perspectives for welfare assessment: biological functioning; emotional states; and naturalness. Pan-enterprise analysis in any livestock sector could be used to benchmark welfare performance of individual enterprises and also provide statistics of welfare performance for the livestock sector. An advantage of this concept of welfare performance is its use of continuous scales of measurement rather than traditional pass/fail measures. Through the feedback provided via benchmarking, the tool should help farmers better engage in on-going improvement of farm practices that affect animal welfare. PMID:26480317

Information security system quality assessment through the intelligent tools

NASA Astrophysics Data System (ADS)

Trapeznikov, E. V.

2018-04-01

The technology development has shown the automated system information security comprehensive analysis necessity. The subject area analysis indicates the study relevance. The research objective is to develop the information security system quality assessment methodology based on the intelligent tools. The basis of the methodology is the information security assessment model in the information system through the neural network. The paper presents the security assessment model, its algorithm. The methodology practical implementation results in the form of the software flow diagram are represented. The practical significance of the model being developed is noted in conclusions.

The application of health literacy measurement tools (collective or individual domains) in assessing chronic disease management: a systematic review protocol.

PubMed

Shum, Jessica; Poureslami, Iraj; Doyle-Waters, Mary M; FitzGerald, J Mark

2016-06-07

The term "health literacy" (HL) was first coined in 1974, and its most common definition is currently defined as a person's ability to access, understand, evaluate, communicate, and use health information to make decisions for one's health. The previous systematic reviews assessing the effect of existing HL measurement tools on health outcomes have simply searched for the term "health literacy" only to identify measures instead of incorporating either one or more of the five domains in their search. Furthermore, as the domain "use" is fairly new, few studies have actually assessed this domain. In this protocol, we propose to identify and assess HL measures that applied the mentioned five domains either collectively or individually in assessing chronic disease management, in particular for asthma and chronic obstructive pulmonary disease (COPD). The ultimate goal is to provide recommendations towards the development and validation of a patient-centric HL measurement tool for the two diseases. A comprehensive, electronic search will be conducted to identify potential studies dating from 1974 to 2016 from databases such as Embase, MEDLINE, CINAHL, Cochrane Central Register of Controlled Trials, Web of Science, ERIC, PsycINFO, and HAPI. Database searches will be complemented with grey literature. Two independent reviewers will perform tool selection, study selection, data extraction, and quality assessment using pre-designed study forms. Any disagreement will be resolved through discussion or a third reviewer. Only studies that have developed or validated HL measurement tools (including one or more of the five domains mentioned above) among asthma and COPD patients will be included. Information collected from the studies will include instrument details such as versions, purpose, underlying constructs, administration, mapping of items onto the five domains, internal structure, scoring, response processes, standard error of measurement (SEM), correlation with other variables, clinically important difference, and item response theory (IRT)-based analyses. The identified strengths and weaknesses as well as reliability, validity, responsiveness, and interpretability of the tools from the validation studies will also be assessed using the COSMIN checklist. A synthesis will be presented for all tools in relation to asthma and COPD management. This systematic review will be one of several key contributions central to a global evidence-based strategy funded by the Canadian Institutes of Health Research (CIHR) for measuring HL in patients with asthma and COPD, highlighting the gaps and inconsistencies of domains between existing tools. The knowledge generated from this review will provide the team information on (1) the five-domain model and cross domains, (2) underlying constructs, (3) tool length, (4) time for completion, (5) reading level, and (6) format for development of the proposed tool. Other aspects of the published validation studies such as reliability coefficients, SEM, correlations with other variables, clinically important difference, and IRT-based analyses will be important for comparison purposes when testing, interpreting, and validating the developed tool. PROSPERO CRD42016037532.

The Ottawa Model of Research Use: a guide to clinical innovation in the NICU.

PubMed

Hogan, Debora L; Logan, Jo

2004-01-01

To improve performance of a neonatal transport team by implementing a research-based family assessment instrument. Objectives included providing a structure for evaluating families and fostering the healthcare relationship. Neonatal transports are associated with family crises. Transport teams require a comprehensive framework to accurately assess family responses to adversity and tools to guide their practice toward parental mastery of the event. Currently, there are no assessment tools that merge family nursing expertise with neonatal transport. A family assessment tool grounded in contemporary family nursing theory and research was developed by a clinical nurse specialist. The Ottawa Model of Research Use guided the process of piloting the innovation with members of a transport team. Focus groups, interviews, and surveys were conducted to create profiles of barriers and facilitators to research use by team members. Tailored research transfer strategies were enacted based on the profile results. Formative evaluations demonstrated improvements in team members' perceptions of their knowledge, family centeredness, and ability to assess and intervene with families. The family assessment tool is currently being incorporated into Clinical Practice Guidelines for Transport and thus will be considered standard care. Use of a family assessment tool is an effective way of appraising families and addressing suffering. The Ottawa Model of Research Use provided a framework for implementing the clinical innovation. A key role of the clinical nurse specialist is to influence nursing practice by fostering research use by practitioners. When developing and implementing a clinical innovation, input from end users and consumers is pivotal. Incorporating the innovation into a practice guideline provides a structure to imbed research evidence into practice.

[Personnel marketing in anesthesiology. Perception, use and evaluation by the target group].

PubMed

Berlet, T

2015-09-01

The human resources situation in the healthcare system is characterized by a manpower shortage. Recruiting medical staff is of great importance for hospitals and particularly in anesthesiology. Approaching and recruiting staff usually happens through external personnel marketing (PM); however, up until now the efficacy of these PM measures has barely been empirically investigated. The goal of this empirical study was to examine how familiar hospital physicians at varying career levels are with the different tools employed by external PM and how frequently they used as well as rated these tools in terms of benefits. Based on this information, the preferences of medical staff with respect to detailing the workplace of "hospital physician" as well as factors of the hospital's attractiveness as an employer were evaluated. Another aim was to derive recommendations on how to optimize the marketing instruments used for external PM in the healthcare system. In an internet-based survey, 154 female and male physicians were questioned about their knowledge, use and benefit assessment of a total of 43 PM tools. Conventional methods of addressing applicants were commonly used but ranked behind the more personal and direct targeting tools in terms of benefit assessments. Internet-based tools with a conceptual affinity to conventional methods were also highly rated in terms of benefits. In contrast, unconventional methods of addressing applicants were hardly known and were not viewed as being useful. The PM tools from the field of "overall conditions for cooperation in the company" mainly received high to very high benefit assessments. These referred primarily to non-monetary factors, human resource development measures and also to aspects of remuneration. Image-promoting PM tools were rarely assessed as being useful, with the exception of measures aimed at creating personal contact between the hospital or unit/department and applicants or those allowing personal insight into the department's range of activities. The correlation between familiarity with PM tools and positive benefit assessments was low. The results of this PM study can contribute to the development of an effective and efficient conception of PM measures by hospitals. Addressing applicants through traditional job and internet-based advertisements should be supplemented by personalized targeting of potential applicants and innovative targeting instruments must be systematically developed and promoted in order to become effective. It remains questionable whether the target group of external PM can be reached with exclusively or even predominantly image-cultivating measures on behalf of the healthcare company, such as image campaigns. The most effective PM tools create good working conditions and develop factors contributing to the employer's attractiveness. These two tools should be given priority in human resource development also taking material incentives into consideration, all of which support the effective set-up of an employer branding.

Predicting periodontitis progression?

PubMed

Ferraiolo, Debra M

2016-03-01

Cochrane Library, Ovid, Medline, Embase and LILACS were searched using no language restrictions and included information up to July 2014. Bibliographic references of included articles and related review articles were hand searched. On-line hand searching of recent issues of key periodontal journals was performed (Journal of Clinical Periodontology, Journal of Dental Research, Journal of Periodontal Research, Journal of Periodontology, Oral Health and Preventive Dentistry). Prospective and retrospective cohort studies were used for answering the question of prediction since there were no randomised controlled trials on this topic. Risk of bias was assessed using the validated Newcastle-Ottawa quality assessment scale for non-randomised studies. Cross-sectional studies were included in the summary of currently reported risk assessment tools but not for risk of progression of disease, due to the inability to properly assess bias in these types of studies. Titles and abstracts were scanned by two reviewers independently.Full reports were obtained for those articles meeting inclusion criteria or those with insufficient information in the title to make a decision. Any published risk assessment tool was considered. The tool was defined to include any composite measure of patient-level risk directed towards determining the probability for further disease progression in adults with periodontitis. Periodontitis was defined to include both chronic and aggressive forms in the adult population. Outcomes included changes in attachment levels and/or deepening of periodontal pockets in millimeters in study populations undergoing supportive periodontal therapy. Data extraction was performed independently and in collaboration by two reviewers; completed evidence tables were reviewed by three reviewers. Studies were each given a descriptive summary to assess the quantity of data as well as further assessment of study variations within study characteristics. This also allowed for determining the suitability of data for further quantitative analysis (meta-analysis). Unfortunately, the heterogeneity of the data did not allow. After screening, 19 studies fitted the inclusion criteria of identifying five different patient-based periodontal risk assessment tools. DenPlan Excel/Previsor Patient Assessment (DEP-PA) and its modifications were used in five studies. The HIDEP model, the dentition risk system (DRS) and the risk assessment-based individualised treatment (RABIT) were each used in one study. Lastly, the periodontal risk assessment (PRA) and its modifications were found in 12 publications.PRA uses the following factors to assess risk of recurrence of disease: Percentage of bleeding on probing, loss of teeth from a total of 28 teeth, loss of periodontal support in relation to the patient's age, prevalence of residual pockets greater than 4 mm (3-5 mm), systemic and genetic conditions and environmental factors, such as cigarette smoking.Ten included studies had cohort designs (N= 2130) spanning three to 12 years with different follow-up times. Generally, these studies reflected that different assessment tools were able to separate subjects with differing probability of disease progression and tooth loss. The observed effect was dose dependent (the higher the estimation of risk the higher the level of observed disease or tooth loss).Six cross sectional studies (N=1078) reported the comparison of different assessment tools, adjusted or unadjusted associations with periodontal disease and subjective risk assessments provided by the tools. There were three articles noted in the flow diagram as articles proposing the tool. Qualitative analysis reflects that parameters are similar across the studies but differences are present in how these parameters were assessed. In treated populations, results of patient-based risk assessments predicted periodontitis progression and tooth loss in various populations. Additional research on the utility of risk assessment and results in improving patient management are needed.

Motion based parsing for video from observational psychology

NASA Astrophysics Data System (ADS)

Kokaram, Anil; Doyle, Erika; Lennon, Daire; Joyeux, Laurent; Fuller, Ray

2006-01-01

In Psychology it is common to conduct studies involving the observation of humans undertaking some task. The sessions are typically recorded on video and used for subjective visual analysis. The subjective analysis is tedious and time consuming, not only because much useless video material is recorded but also because subjective measures of human behaviour are not necessarily repeatable. This paper presents tools using content based video analysis that allow automated parsing of video from one such study involving Dyslexia. The tools rely on implicit measures of human motion that can be generalised to other applications in the domain of human observation. Results comparing quantitative assessment of human motion with subjective assessment are also presented, illustrating that the system is a useful scientific tool.

A Program Evaluation Tool for Dual Enrollment Transition Programs

ERIC Educational Resources Information Center

Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

2012-01-01

This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

A Revenue Planning Tool for Charter School Operators

ERIC Educational Resources Information Center

Keller, Eric; Hayes, Cheryl D.

2009-01-01

This revenue planning tool aims to help charter school operators develop a sound revenue base that can meet their school's current and future funding needs. It helps identify and assess potential public (federal, state, and local) and private funding sources. The tool incorporates a four-step revenue planning process which includes: (1)…

Proposals for enhanced health risk assessment and stratification in an integrated care scenario

PubMed Central

Dueñas-Espín, Ivan; Vela, Emili; Pauws, Steffen; Bescos, Cristina; Cano, Isaac; Cleries, Montserrat; Contel, Joan Carles; de Manuel Keenoy, Esteban; Garcia-Aymerich, Judith; Gomez-Cabrero, David; Kaye, Rachelle; Lahr, Maarten M H; Lluch-Ariet, Magí; Moharra, Montserrat; Monterde, David; Mora, Joana; Nalin, Marco; Pavlickova, Andrea; Piera, Jordi; Ponce, Sara; Santaeugenia, Sebastià; Schonenberg, Helen; Störk, Stefan; Tegner, Jesper; Velickovski, Filip; Westerteicher, Christoph; Roca, Josep

2016-01-01

Objectives Population-based health risk assessment and stratification are considered highly relevant for large-scale implementation of integrated care by facilitating services design and case identification. The principal objective of the study was to analyse five health-risk assessment strategies and health indicators used in the five regions participating in the Advancing Care Coordination and Telehealth Deployment (ACT) programme (http://www.act-programme.eu). The second purpose was to elaborate on strategies toward enhanced health risk predictive modelling in the clinical scenario. Settings The five ACT regions: Scotland (UK), Basque Country (ES), Catalonia (ES), Lombardy (I) and Groningen (NL). Participants Responsible teams for regional data management in the five ACT regions. Primary and secondary outcome measures We characterised and compared risk assessment strategies among ACT regions by analysing operational health risk predictive modelling tools for population-based stratification, as well as available health indicators at regional level. The analysis of the risk assessment tool deployed in Catalonia in 2015 (GMAs, Adjusted Morbidity Groups) was used as a basis to propose how population-based analytics could contribute to clinical risk prediction. Results There was consensus on the need for a population health approach to generate health risk predictive modelling. However, this strategy was fully in place only in two ACT regions: Basque Country and Catalonia. We found marked differences among regions in health risk predictive modelling tools and health indicators, and identified key factors constraining their comparability. The research proposes means to overcome current limitations and the use of population-based health risk prediction for enhanced clinical risk assessment. Conclusions The results indicate the need for further efforts to improve both comparability and flexibility of current population-based health risk predictive modelling approaches. Applicability and impact of the proposals for enhanced clinical risk assessment require prospective evaluation. PMID:27084274

A Management Tool for Assessing Aquaculture Environmental Impacts in Chilean Patagonian Fjords: Integrating Hydrodynamic and Pellets Dispersion Models

NASA Astrophysics Data System (ADS)

Tironi, Antonio; Marin, Víctor H.; Campuzano, Francisco J.

2010-05-01

This article introduces a management tool for salmon farming, with a scope in the local sustainability of salmon aquaculture of the Aysen Fjord, Chilean Patagonia. Based on Integrated Coastal Zone Management (ICZM) principles, the tool combines a large 3-level nested hydrodynamic model, a particle tracking module and a GIS application into an assessment tool for particulate waste dispersal of salmon farming activities. The model offers an open source alternative to particulate waste modeling and evaluation, contributing with valuable information for local decision makers in the process of locating new facilities and monitoring stations.

A comparative evaluation of five hazard screening tools.

PubMed

Panko, J M; Hitchcock, K; Fung, M; Spencer, P J; Kingsbury, T; Mason, A M

2017-01-01

An increasing number of hazard assessment tools and approaches are being used in the marketplace as a means to differentiate products and ingredients with lower versus higher hazards or to certify what some call greener chemical ingredients in consumer products. Some leading retailers have established policies for product manufacturers and their suppliers to disclose chemical ingredients and their related hazard characteristics often specifying what tools to use. To date, no data exists that show a tool's reliability to provide consistent, credible screening-level hazard scores that can inform greener product selection. We conducted a small pilot study to understand and compare the hazard scoring of several hazard screening tools to determine if hazard and toxicity profiles for chemicals differ. Seven chemicals were selected that represent both natural and man-made chemistries as well as a range of toxicological activity. We conducted the assessments according to each tool provider's guidelines, which included factors such as endpoints, weighting preferences, sources of information, and treatment of data gaps. The results indicate the tools varied in the level of discrimination seen in the scores for these 7 chemicals and that tool classifications of the same chemical varied widely between the tools, ranging from little or no hazard or toxicity to very high hazard or toxicity. The results also highlight the need for transparency in describing the basis for the tool's hazard scores and suggest possible enhancements. Based on this pilot study, tools should not be generalized to fit all situations because their evaluations are context-specific. Before choosing a tool or approach, it is critical that the assessment rationale be clearly defined and matches the selected tool or approach. Integr Environ Assess Manag 2017;13:139-154. © 2016 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of SETAC. © 2016 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of SETAC.

Validation of a novel duplex ultrasound objective structured assessment of technical skills (DUOSATS) for arterial stenosis detection.

PubMed

Jaffer, U; Singh, P; Pandey, V A; Aslam, M; Standfield, N J

2014-01-01

Duplex ultrasound facilitates bedside diagnosis and hence timely patient care. Its uptake has been hampered by training and accreditation issues. We have developed an assessment tool for Duplex arterial stenosis measurement for both simulator and patient based training. A novel assessment tool: duplex ultrasound assessment of technical skills was developed. A modified duplex ultrasound assessment of technical skills was used for simulator training. Novice, intermediate experience and expert users of duplex ultrasound were invited to participate. Participants viewed an instructional video and were allowed ample time to familiarize with the equipment. Participants' attempts were recorded and independently assessed by four experts using the modified duplex ultrasound assessment of technical skills. 'Global' assessment was also done on a four point Likert scale. Content, construct and concurrent validity as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. The simulator had good satisfaction rating from participants: median 4; range 3-5. Receiver operator characteristic analysis has established a cut point of 22/ 34 and 25/ 40 were most appropriate for simulator and patient based assessment respectively. We have validated a novel assessment tool for duplex arterial stenosis detection. Further work is underway to establish transference validity of simulator training to improved skill in scanning patients. We have developed and validated duplex ultrasound assessment of technical skills for simulator training.

Testing and refining the Science in Risk Assessment and Policy (SciRAP) web-based platform for evaluating the reliability and relevance of in vivo toxicity studies.

PubMed

Beronius, Anna; Molander, Linda; Zilliacus, Johanna; Rudén, Christina; Hanberg, Annika

2018-05-28

The Science in Risk Assessment and Policy (SciRAP) web-based platform was developed to promote and facilitate structure and transparency in the evaluation of ecotoxicity and toxicity studies for hazard and risk assessment of chemicals. The platform includes sets of criteria and a colour-coding tool for evaluating the reliability and relevance of individual studies. The SciRAP method for evaluating in vivo toxicity studies was first published in 2014 and the aim of the work presented here was to evaluate and develop that method further. Toxicologists and risk assessors from different sectors and geographical areas were invited to test the SciRAP criteria and tool on a specific set of in vivo toxicity studies and to provide feedback concerning the scientific soundness and user-friendliness of the SciRAP approach. The results of this expert assessment were used to refine and improve both the evaluation criteria and the colour-coding tool. It is expected that the SciRAP web-based platform will continue to be developed and enhanced to keep up to date with the needs of end-users. Copyright © 2018 John Wiley & Sons, Ltd.

Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Review of Currently Available Instruments

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

An extensive list of published and unpublished instruments used to investigate or evaluate sleep issues in children was collected and assessed based on the fundamental operational principles of instrument development (11 steps). Of all the available tools identified, only a few were validated and standardized using appropriate psychometric criteria. In fact, only 2 fulfill all desirable criteria and approximately 11 instruments seem to adhere to most of the psychometric tool development requirements, and were therefore assessed in greater detail. Notwithstanding, in the rapidly developing scientific world of pediatric sleep, there are too many tools being used that have not undergone careful and methodical psychometric evaluation, and as such may be fraught with biased or invalid findings. It is hoped that this initial effort in categorizing and assessing available tools for pediatric sleep will serve as recognition of the relatively early developmental stage of our field, and provide the necessary impetus for future tool development using multicentered approaches and adequate methodologies. PMID:20934896

HEPS Inventory Tool: An Inventory Tool Including Quality Assessment of School Interventions on Healthy Eating and Physical Activity

ERIC Educational Resources Information Center

Dadaczynski, Kevin; Paulus, Peter; de Vries, Nanne; de Ruiter, Silvia; Buijs, Goof

2010-01-01

The HEPS Inventory Tool aims to support stakeholders working in school health promotion to promote high quality interventions on healthy eating and physical activity. As a tool it provides a step-by-step approach on how to develop a national or regional inventory of existing school based interventions on healthy eating and physical activity. It…

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review.

PubMed

Mani, Suresh; Sharma, Shobha; Omar, Baharudin; Paungmali, Aatit; Joseph, Leonard

2017-04-01

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.

The risk of bias in systematic reviews tool showed fair reliability and good construct validity.

PubMed

Bühn, Stefanie; Mathes, Tim; Prengel, Peggy; Wegewitz, Uta; Ostermann, Thomas; Robens, Sibylle; Pieper, Dawid

2017-11-01

There is a movement from generic quality checklists toward a more domain-based approach in critical appraisal tools. This study aimed to report on a first experience with the newly developed risk of bias in systematic reviews (ROBIS) tool and compare it with A Measurement Tool to Assess Systematic Reviews (AMSTAR), that is, the most common used tool to assess methodological quality of systematic reviews while assessing validity, reliability, and applicability. Validation study with four reviewers based on 16 systematic reviews in the field of occupational health. Interrater reliability (IRR) of all four raters was highest for domain 2 (Fleiss' kappa κ = 0.56) and lowest for domain 4 (κ = 0.04). For ROBIS, median IRR was κ = 0.52 (range 0.13-0.88) for the experienced pair of raters compared to κ = 0.32 (range 0.12-0.76) for the less experienced pair of raters. The percentage of "yes" scores of each review of ROBIS ratings was strongly correlated with the AMSTAR ratings (r s  = 0.76; P = 0.01). ROBIS has fair reliability and good construct validity to assess the risk of bias in systematic reviews. More validation studies are needed to investigate reliability and applicability, in particular. Copyright © 2017 Elsevier Inc. All rights reserved.

ADHD in the Schools: Assessment and Intervention Strategies. Second Edition

ERIC Educational Resources Information Center

DuPaul, George J.; Stoner, Gary

2004-01-01

This popular reference and text provides essential guidance for school-based professionals meeting the challenges of ADHD at any grade level. Comprehensive and practical, the book includes several reproducible assessment tools and handouts. A team-based approach to intervention is emphasized in chapters offering research-based guidelines for: (1)…

Flood- and drought-related natural hazards activities of the U.S. Geological Survey in New England

USGS Publications Warehouse

Lombard, Pamela J.

2016-03-23

Tools for natural hazard assessment and mitigation • Light detection and ranging (lidar) remote sensing technology • StreamStats Web-based tool for streamflow statistics • Flood inundation mapper

Assessing the health workforce implications of health policy and programming: how a review of grey literature informed the development of a new impact assessment tool.

PubMed

Nove, Andrea; Cometto, Giorgio; Campbell, James

2017-11-09

In their adoption of WHA resolution 69.19, World Health Organization Member States requested all bilateral and multilateral initiatives to conduct impact assessments of their funding to human resources for health. The High-Level Commission for Health Employment and Economic Growth similarly proposed that official development assistance for health, education, employment and gender are best aligned to creating decent jobs in the health and social workforce. No standard tools exist for assessing the impact of global health initiatives on the health workforce, but tools exist from other fields. The objectives of this paper are to describe how a review of grey literature informed the development of a draft health workforce impact assessment tool and to introduce the tool. A search of grey literature yielded 72 examples of impact assessment tools and guidance from a wide variety of fields including gender, health and human rights. These examples were reviewed, and information relevant to the development of a health workforce impact assessment was extracted from them using an inductive process. A number of good practice principles were identified from the review. These informed the development of a draft health workforce impact assessment tool, based on an established health labour market framework. The tool is designed to be applied before implementation. It consists of a relatively short and focused screening module to be applied to all relevant initiatives, followed by a more in-depth assessment to be applied only to initiatives for which the screening module indicates that significant implications for HRH are anticipated. It thus aims to strike a balance between maximising rigour and minimising administrative burden. The application of the new tool will help to ensure that health workforce implications are incorporated into global health decision-making processes from the outset and to enhance positive HRH impacts and avoid, minimise or offset negative impacts.

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

Development and Assessment of a Chemistry-Based Computer Video Game as a Learning Tool

ERIC Educational Resources Information Center

Martinez-Hernandez, Kermin Joel

2010-01-01

The chemistry-based computer video game is a multidisciplinary collaboration between chemistry and computer graphics and technology fields developed to explore the use of video games as a possible learning tool. This innovative approach aims to integrate elements of commercial video game and authentic chemistry context environments into a learning…

Spatial Visualization Learning in Engineering: Traditional Methods vs. a Web-Based Tool

ERIC Educational Resources Information Center

Pedrosa, Carlos Melgosa; Barbero, Basilio Ramos; Miguel, Arturo Román

2014-01-01

This study compares an interactive learning manager for graphic engineering to develop spatial vision (ILMAGE_SV) to traditional methods. ILMAGE_SV is an asynchronous web-based learning tool that allows the manipulation of objects with a 3D viewer, self-evaluation, and continuous assessment. In addition, student learning may be monitored, which…

Availability and Accessibility of ICT-Based Instructional Tools in Medical Colleges in Ogun State, Nigeria

ERIC Educational Resources Information Center

Nwosu, Jonathan Chinaka; John, Henry Chukwudi; Akorede, O. J.

2018-01-01

This study assessed the availability and use of ICT-based Instructional tools in selected medical colleges in Ogun State, Nigeria. This study adopted a descriptive survey research design. The population to be studied is medical lecturers (328), clinical instructors (42) and laboratory technologist (92) from Ben Carson Snr. Medical School, Babcock…

Mississippi Curriculum Framework for Machine Tool Operation/Machine Shop (Program CIP: 48.0503--Machine Shop Assistant). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for machine tool operation/machine shop I and II. Presented first are a…

Competency-based tool for evaluation of community-based training in undergraduate medical education in India - a Delphi approach.

PubMed

Shewade, Hemant Deepak; Jeyashree, Kathiresan; Kalaiselvi, Selvaraj; Palanivel, Chinnakali; Panigrahi, Krishna Chandra

2017-01-01

A community-based training (CBT) program, where teaching and training are carried out in the community outside of the teaching hospital, is a vital part of undergraduate medical education. Worldwide, there is a shift to competency-based training, and CBT is no exception. We attempted to develop a tool that uses a competency-based approach for assessment of CBT. Based on a review on competencies, we prepared a preliminary list of major domains with items under each domain. We used the Delphi technique to arrive at a consensus on this assessment tool. The Delphi panel consisted of eight purposively selected experts from the field of community medicine. The panel rated each item for its relevance, sensitivity, specificity, and understandability on a scale of 0-4. Median ratings were calculated at the end of each round and shared with the panel. Consensus was predefined as when 70% of the experts gave a rating of 3 or above for an item under relevance, sensitivity, and specificity. If an item failed to achieve consensus after being rated in 2 consecutive rounds, it was excluded. Anonymity of responses was maintained. The panel arrived at a consensus at the end of 3 rounds. The final version of the self-assessment tool consisted of 7 domains and 74 items. The domains (number of items) were Public health - epidemiology and research methodology (13), Public health - biostatistics (6), Public health administration at primary health center level (17), Family medicine (24), Cultural competencies (3), Community development and advocacy (2), and Generic competence (9). Each item was given a maximum score of 5 and minimum score of 1. This is the first study worldwide to develop a tool for competency-based evaluation of CBT in undergraduate medical education. The competencies identified in the 74-item questionnaire may provide the base for development of authentic curricula for CBT.

Use of electronic dietary assessment tools in primary care: an interdisciplinary perspective.

PubMed

Bonilla, Carolina; Brauer, Paula; Royall, Dawna; Keller, Heather; Hanning, Rhona M; DiCenso, Alba

2015-02-25

Dietary assessment can be challenging for many reasons, including the wide variety of foods, eating patterns and nutrients to be considered. In team-based primary care practice, various disciplines may be involved in assessing diet. Electronic-based dietary assessment (e-DA) instruments available now through mobile apps or websites can potentially facilitate dietary assessment. Providers views of facilitators and barriers related to e-DA instruments and their recommendations for improvement can inform the further development of these tools. The objective of this study was to explore provider perspectives on e-DA tools in mobile apps and websites. The exploratory sequential mixed methods design included interdisciplinary focus groups followed by a web-based survey sent to Family Health Teams throughout Ontario, Canada. Descriptive and bivariate analyses were completed. Focus group transcripts contributed to web-survey content, while interpretive themes added depth and context. 11 focus groups with 50 providers revealed varying perspectives on the use of e-DA for: 1) improving patients' eating habits; 2) improving the quality of dietary assessment; and, 3) integrating e-DA into the care process. In the web-survey 191 respondents from nine disciplines in 73 FHTs completed the survey. Dietitians reported greater use of e-DA than other providers (63% vs.19%; p = .000) respectively. There was strong interest among disciplines in the use of e-DA tools for the management of obesity, diabetes and heart disease, especially for patient self-monitoring. Barriers identified were: patients' lack of comfort with using technology, misinterpretation of e-DA results by patients, time and education for providers to interpret results, and time for providers to offer counselling. e-DA tools in mobile apps and websites may improve dietary counselling over time. Addressing the identified facilitators and barriers can potentially promote the uptake of e-DA into clinical practice.

Assessing physiotherapists' communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool.

PubMed

Murray, Aileen; Hall, Amanda; Williams, Geoffrey C; McDonough, Suzanne M; Ntoumanis, Nikos; Taylor, Ian; Jackson, Ben; Copsey, Bethan; Hurley, Deirdre A; Matthews, James

2018-02-27

To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson's r correlations with a reference standard, the Health Care Climate Questionnaire. The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7-0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool. Implications for Rehabilitation Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy. This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings. This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase. The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.

Nutrition screening tools: an analysis of the evidence.

PubMed

Skipper, Annalynn; Ferguson, Maree; Thompson, Kyle; Castellanos, Victoria H; Porcari, Judy

2012-05-01

In response to questions about tools for nutrition screening, an evidence analysis project was developed to identify the most valid and reliable nutrition screening tools for use in acute care and hospital-based ambulatory care settings. An oversight group defined nutrition screening and literature search criteria. A trained analyst conducted structured searches of the literature for studies of nutrition screening tools according to predetermined criteria. Eleven nutrition screening tools designed to detect undernutrition in patients in acute care and hospital-based ambulatory care were identified. Trained analysts evaluated articles for quality using criteria specified by the American Dietetic Association's Evidence Analysis Library. Members of the oversight group assigned quality grades to the tools based on the quality of the supporting evidence, including reliability and validity data. One tool, the NRS-2002, received a grade I, and 4 tools-the Simple Two-Part Tool, the Mini-Nutritional Assessment-Short Form (MNA-SF), the Malnutrition Screening Tool (MST), and Malnutrition Universal Screening Tool (MUST)-received a grade II. The MST was the only tool shown to be both valid and reliable for identifying undernutrition in the settings studied. Thus, validated nutrition screening tools that are simple and easy to use are available for application in acute care and hospital-based ambulatory care settings.

Updating Assessment Styles: Website Development Rather than Report Writing for Project Based Learning Courses

ERIC Educational Resources Information Center

Brown, Nicola

2017-01-01

While teaching methods tend to be updated frequently, the implementation of new innovative assessment tools is much slower. For example project based learning has become popular as a teaching technique, however, the assessment tends to be via traditional reports. This paper reports on the implementation and evaluation of using website development…

Motor Skill Assessment of Children: Is There an Association between Performance-Based, Child-Report, and Parent-Report Measures of Children's Motor Skills?

ERIC Educational Resources Information Center

Kennedy, Johanna; Brown, Ted; Chien, Chi-Wen

2012-01-01

Client-centered practice requires therapists to actively seek the perspectives of children and families. Several assessment tools are available to facilitate this process. However, when evaluating motor skill performance, therapists typically concentrate on performance-based assessment. To improve understanding of the information provided by the…

An Overview of Ecological Footprinting and Other Tools and Their Application to the Development of Sustainability Process: Audit and Methodology at Holme Lacy College, UK

ERIC Educational Resources Information Center

Dawe, Gerald F. M.; Vetter, Arnie; Martin, Stephen

2004-01-01

A sustainability audit of Holme Lacy College is described. The approach adopted a "triple bottom line" assessment, comprising a number of key steps: a scoping review utilising a revised Royal Institution of Chartered Surveyors project appraisal tool; an environmental impact assessment based on ecological footprinting and a social and…

Extending LMS to Support IRT-Based Assessment Test Calibration

NASA Astrophysics Data System (ADS)

Fotaris, Panagiotis; Mastoras, Theodoros; Mavridis, Ioannis; Manitsaris, Athanasios

Developing unambiguous and challenging assessment material for measuring educational attainment is a time-consuming, labor-intensive process. As a result Computer Aided Assessment (CAA) tools are becoming widely adopted in academic environments in an effort to improve the assessment quality and deliver reliable results of examinee performance. This paper introduces a methodological and architectural framework which embeds a CAA tool in a Learning Management System (LMS) so as to assist test developers in refining items to constitute assessment tests. An Item Response Theory (IRT) based analysis is applied to a dynamic assessment profile provided by the LMS. Test developers define a set of validity rules for the statistical indices given by the IRT analysis. By applying those rules, the LMS can detect items with various discrepancies which are then flagged for review of their content. Repeatedly executing the aforementioned procedure can improve the overall efficiency of the testing process.

Tools for assessing fall risk in the elderly: a systematic review and meta-analysis.

PubMed

Park, Seong-Hi

2018-01-01

The prevention of falls among the elderly is arguably one of the most important public health issues in today's aging society. The aim of this study was to assess which tools best predict the risk of falls in the elderly. Electronic searches were performed using Medline, EMBASE, the Cochrane Library, CINAHL, etc., using the following keywords: "fall risk assessment", "elderly fall screening", and "elderly mobility scale". The QUADAS-2 was applied to assess the internal validity of the diagnostic studies. Selected studies were meta-analyzed with MetaDisc 1.4. A total of 33 studies were eligible out of the 2,321 studies retrieved from selected databases. Twenty-six assessment tools for fall risk were used in the selected articles, and they tended to vary based on the setting. The fall risk assessment tools currently used for the elderly did not show sufficiently high predictive validity for differentiating high and low fall risks. The Berg Balance scale and Mobility Interaction Fall chart showed stable and high specificity, while the Downton Fall Risk Index, Hendrich II Fall Risk Model, St. Thomas's Risk Assessment Tool in Falling elderly inpatients, Timed Up and Go test, and Tinetti Balance scale showed the opposite results. We concluded that rather than a single measure, two assessment tools used together would better evaluate the characteristics of falls by the elderly that can occur due to a multitude of factors and maximize the advantages of each for predicting the occurrence of falls.

Clinical Parameters and Tools for Home-Based Assessment of Parkinson's Disease: Results from a Delphi study.

PubMed

Ferreira, Joaquim J; Santos, Ana T; Domingos, Josefa; Matthews, Helen; Isaacs, Tom; Duffen, Joy; Al-Jawad, Ahmed; Larsen, Frank; Artur Serrano, J; Weber, Peter; Thoms, Andrea; Sollinger, Stefan; Graessner, Holm; Maetzler, Walter

2015-01-01

Parkinson's disease (PD) is a neurodegenerative disorder with fluctuating symptoms. To aid the development of a system to evaluate people with PD (PwP) at home (SENSE-PARK system) there was a need to define parameters and tools to be applied in the assessment of 6 domains: gait, bradykinesia/hypokinesia, tremor, sleep, balance and cognition. To identify relevant parameters and assessment tools of the 6 domains, from the perspective of PwP, caregivers and movement disorders specialists. A 2-round Delphi study was conducted to select a core of parameters and assessment tools to be applied. This process included PwP, caregivers and movement disorders specialists. Two hundred and thirty-three PwP, caregivers and physicians completed the first round questionnaire, and 50 the second. Results allowed the identification of parameters and assessment tools to be added to the SENSE-PARK system. The most consensual parameters were: Falls and Near Falls; Capability to Perform Activities of Daily Living; Interference with Activities of Daily Living; Capability to Process Tasks; and Capability to Recall and Retrieve Information. The most cited assessment strategies included Walkers; the Evaluation of Performance Doing Fine Motor Movements; Capability to Eat; Assessment of Sleep Quality; Identification of Circumstances and Triggers for Loose of Balance and Memory Assessment. An agreed set of measuring parameters, tests, tools and devices was achieved to be part of a system to evaluate PwP at home. A pattern of different perspectives was identified for each stakeholder.

A real-time web-based optimal Biomass Site Assessment Tool (BioSAT): Module 1. An economic assessment of mill residues for the southern U.S.

Treesearch

Timothy M. Young; James H. Perdue; Andy Hartsell; Robert C. Abt; Donald Hodges; Timothy G. Rials

2009-01-01

Optimal locations for biomass facilities that use mill residues are identified for 13 southern U.S. states. The Biomass Site Assessment Tool (BioSAT) model is used to identify the top 20 locations for 13 southern U.S. states. The trucking cost model of BioSAT is used with Timber Mart South 2009 price data to estimate the total cost, average cost, and marginal costs for...

Application of a faith-based integration tool to assess mental and physical health interventions

PubMed Central

Saunders, Donna M.; Leak, Jean; Carver, Monique E.; Smith, Selina A.

2017-01-01

Background To build on current research involving faith-based interventions (FBIs) for addressing mental and physical health, this study a) reviewed the extent to which relevant publications integrate faith concepts with health and b) initiated analysis of the degree of FBI integration with intervention outcomes. Methods Derived from a systematic search of articles published between 2007 and 2017, 36 studies were assessed with a Faith-Based Integration Assessment Tool (FIAT) to quantify faith-health integration. Basic statistical procedures were employed to determine the association of faith-based integration with intervention outcomes. Results The assessed studies possessed (on average) moderate, inconsistent integration because of poor use of faith measures, and moderate, inconsistent use of faith practices. Analysis procedures for determining the effect of FBI integration on intervention outcomes were inadequate for formulating practical conclusions. Conclusions Regardless of integration, interventions were associated with beneficial outcomes. To determine the link between FBI integration and intervention outcomes, additional analyses are needed. PMID:29354795

A Systematic Approach to Capacity Strengthening of Laboratory Systems for Control of Neglected Tropical Diseases in Ghana, Kenya, Malawi and Sri Lanka

PubMed Central

Njelesani, Janet; Dacombe, Russell; Palmer, Tanith; Smith, Helen; Koudou, Benjamin; Bockarie, Moses; Bates, Imelda

2014-01-01

Background The lack of capacity in laboratory systems is a major barrier to achieving the aims of the London Declaration (2012) on neglected tropical diseases (NTDs). To counter this, capacity strengthening initiatives have been carried out in NTD laboratories worldwide. Many of these initiatives focus on individuals' skills or institutional processes and structures ignoring the crucial interactions between the laboratory and the wider national and international context. Furthermore, rigorous methods to assess these initiatives once they have been implemented are scarce. To address these gaps we developed a set of assessment and monitoring tools that can be used to determine the capacities required and achieved by laboratory systems at the individual, organizational, and national/international levels to support the control of NTDs. Methodology and principal findings We developed a set of qualitative and quantitative assessment and monitoring tools based on published evidence on optimal laboratory capacity. We implemented the tools with laboratory managers in Ghana, Malawi, Kenya, and Sri Lanka. Using the tools enabled us to identify strengths and gaps in the laboratory systems from the following perspectives: laboratory quality benchmarked against ISO 15189 standards, the potential for the laboratories to provide support to national and regional NTD control programmes, and the laboratory's position within relevant national and international networks and collaborations. Conclusion We have developed a set of mixed methods assessment and monitoring tools based on evidence derived from the components needed to strengthen the capacity of laboratory systems to control NTDs. Our tools help to systematically assess and monitor individual, organizational, and wider system level capacity of laboratory systems for NTD control and can be applied in different country contexts. PMID:24603407

Teledermatology as an educational tool for teaching dermatology to residents and medical students.

PubMed

Boyers, Lindsay N; Schultz, Amanda; Baceviciene, Rasa; Blaney, Susan; Marvi, Natasha; Dellavalle, Robert P; Dunnick, Cory A

2015-04-01

Although teledermatology (TD) is regarded as a tool to improve patient access to specialty healthcare, little has been done to evaluate its role in medical education. We describe the TD program at the Denver (CO) Department of Veterans Affairs Medical Center and evaluate its use as an educational tool for teaching dermatology to dermatology residents and medical students. Dermatology residents manage TD consultations and review all cases with a faculty preceptor; medical students participate as observers when possible. This study assessed dermatology resident (n=14) and medical student (n=16) perceptions of TD and its usefulness in teaching six core clinical competencies. Both residents (79%) and medical students (88%) "strongly agree" or "agree" that TD is an important educational tool. In general, medical students were slightly more satisfied than residents across all of the core competencies assessed except for patient care. Medical students and residents were most satisfied with the competencies of practice-based learning and improvement and medical knowledge, whereas they were least satisfied with those of interpersonal and communication skills and professionalism. Overall, TD is valued as a teaching tool for dermatology in the areas of patient care, medical knowledge, practice-based learning and improvement, and systems-based practice.

Geriatric Assessment and Tools for Predicting Treatment Toxicity in Older Adults With Cancer.

PubMed

Li, Daneng; Soto-Perez-de-Celis, Enrique; Hurria, Arti

Cancer is a disease of older adults, and the majority of new cancer cases and deaths occur in people 65 years or older. However, fewer data are available regarding the risks and benefits of cancer treatment in older adults, and commonly used assessments in oncology fail to adequately evaluate factors that affect treatment efficacy and outcomes in the older patients. The geriatric assessment is a multidisciplinary evaluation that provides detailed information about a patient's functional status, comorbidities, psychological state, social support, nutritional status, and cognitive function. Among older patients with cancer, geriatric assessment has been shown to identify patients at risk of poorer overall survival, and geriatric assessment-based tools are significantly more effective in predicting chemotherapy toxicity than other currently utilized measures. In this review, we summarize the components of the geriatric assessment and provide information about existing tools used to predict treatment toxicity in older patients with cancer.

The reliability of a modified Kalamazoo Consensus Statement Checklist for assessing the communication skills of multidisciplinary clinicians in the simulated environment.

PubMed

Peterson, Eleanor B; Calhoun, Aaron W; Rider, Elizabeth A

2014-09-01

With increased recognition of the importance of sound communication skills and communication skills education, reliable assessment tools are essential. This study reports on the psychometric properties of an assessment tool based on the Kalamazoo Consensus Statement Essential Elements Communication Checklist. The Gap-Kalamazoo Communication Skills Assessment Form (GKCSAF), a modified version of an existing communication skills assessment tool, the Kalamazoo Essential Elements Communication Checklist-Adapted, was used to assess learners in a multidisciplinary, simulation-based communication skills educational program using multiple raters. 118 simulated conversations were available for analysis. Internal consistency and inter-rater reliability were determined by calculating a Cronbach's alpha score and intra-class correlation coefficients (ICC), respectively. The GKCSAF demonstrated high internal consistency with a Cronbach's alpha score of 0.844 (faculty raters) and 0.880 (peer observer raters), and high inter-rater reliability with an ICC of 0.830 (faculty raters) and 0.89 (peer observer raters). The Gap-Kalamazoo Communication Skills Assessment Form is a reliable method of assessing the communication skills of multidisciplinary learners using multi-rater methods within the learning environment. The Gap-Kalamazoo Communication Skills Assessment Form can be used by educational programs that wish to implement a reliable assessment and feedback system for a variety of learners. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Drinking Water Consequences Tools. A Literature Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pasqualini, Donatella

2016-05-12

In support of the goals of Department of Homeland Security’s (DHS) National Protection and Programs Directorate and the Federal Emergency Management Agency, the DHS Office of Science and Technology is seeking to develop and/or modify consequence assessment tools to enable drinking water systems owner/operators to estimate the societal and economic consequences of drinking water disruption due to the threats and hazards. This work will expand the breadth of consequence estimation methods and tools using the best-available data describing water distribution infrastructure, owner/assetlevel economic losses, regional-scale economic activity, and health. In addition, this project will deploy the consequence methodology and capabilitymore » within a Web-based platform. This report is intended to support DHS effort providing a review literature review of existing assessment tools of water and wastewater systems consequences to disruptions. The review includes tools that assess water systems resilience, vulnerability, and risk. This will help to understand gaps and limitations of these tools in order to plan for the development of the next-generation consequences tool for water and waste water systems disruption.« less

The Assessment of Bipolar Disorder in Children and Adolescents

PubMed Central

Youngstrom, Eric A.; Freeman, Andrew J.; Jenkins, Melissa McKeown

2010-01-01

The overarching goal of this review is to examine the current best evidence for assessing bipolar disorder in children and adolescents and provide a comprehensive, evidence-based approach to diagnosis. Evidence-based assessment strategies are organized around the “3 Ps” of clinical assessment: Predict important criteria or developmental trajectories, Prescribe a change in treatment choice, and inform Process of treating the youth and his/her family. The review characterizes bipolar disorder in youths - specifically addressing bipolar diagnoses and clinical subtypes; then provides an actuarial approach to assessment - using prevalence of disorder, risk factors, and questionnaires; discusses treatment thresholds; and identifies practical measures of process and outcomes. The clinical tools and risk factors selected for inclusion in this review represent the best empirical evidence in the literature. By the end of the review, clinicians will have a framework and set of clinically useful tools with which to effectively make evidence-based decisions regarding the diagnosis of bipolar disorder in children and adolescents. PMID:19264268

Advanced MR Imaging of the Placenta: Exploring the in utero placenta-brain connection

PubMed Central

Andescavage, Nickie Niforatos; DuPlessis, Adre; Limperopoulos, Catherine

2015-01-01

The placenta is a vital organ necessary for the healthy neurodevelopment of the fetus. Despite the known associations between placental dysfunction and neurologic impairment, there is a paucity of tools available to reliably assess in vivo placental health and function. Existing clinical tools for placental assessment remain insensitive in predicting and assessing placental well-being. Advanced MRI techniques hold significant promise for the dynamic, non-invasive, real-time assessment of placental health and identification of early placental-based disorders. In this review, we summarize the available clinical tools for placental assessment including ultrasound, Doppler, and conventional MRI. We then explore the emerging role of advanced placental MR imaging techniques for supporting the developing fetus, appraise the strengths and limitations of quantitative MRI in identifying early markers of placental dysfunction for improved pregnancy monitoring and fetal outcomes. PMID:25765905

An international road map to improve pain assessment in people with impaired cognition: the development of the Pain Assessment in Impaired Cognition (PAIC) meta-tool.

PubMed

Corbett, Anne; Achterberg, Wilco; Husebo, Bettina; Lobbezoo, Frank; de Vet, Henrica; Kunz, Miriam; Strand, Liv; Constantinou, Marios; Tudose, Catalina; Kappesser, Judith; de Waal, Margot; Lautenbacher, Stefan

2014-12-10

Pain is common in people with dementia, yet identification is challenging. A number of pain assessment tools exist, utilizing observation of pain-related behaviours, vocalizations and facial expressions. Whilst they have been developed robustly, these often lack sufficient evidence of psychometric properties, like reliability, face and construct validity, responsiveness and usability, and are not internationally implemented. The EU-COST initiative "Pain in impaired cognition, especially dementia" aims to combine the expertise of clinicians and researchers to address this important issue by building on previous research in the area, identifying existing pain assessment tools for dementia, and developing consensus for items for a new universal meta-tool for use in research and clinical settings. This paper reports on the initial phase of this collaboration task. All existing observational pain behaviour tools were identified and elements categorised using a three-step reduction process. Selection and refinement of items for the draft Pain Assessment in Impaired Cognition (PAIC) meta-tool was achieved through scrutiny of the evidence, consensus of expert opinion, frequency of use and alignment with the American Geriatric Society guidelines. The main aim of this process was to identify key items with potential empirical, rather than theoretical value to take forward for testing. 12 eligible assessment tools were identified, and pain items categorised according to behaviour, facial expression and vocalisation according to the AGS guidelines (Domains 1 - 3). This has been refined to create the PAIC meta-tool for validation and further refinement. A decision was made to create a supporting comprehensive toolkit to support the core assessment tool to provide additional resources for the assessment of overlapping symptoms in dementia, including AGS domains four to six, identification of specific types of pain and assessment of duration and location of pain. This multidisciplinary, cross-cultural initiative has created a draft meta-tool for capturing pain behaviour to be used across languages and culture, based on the most promising items used in existing tools. The draft PAIC meta-tool will now be taken forward for evaluation according to COSMIN guidelines and the EU-COST protocol in order to exclude invalid items, refine included items and optimise the meta-tool.

Risk Acceptance Personality Paradigm: How We View What We Don't Know We Don't Know

NASA Technical Reports Server (NTRS)

Massie, Michael J.; Morris, A. Terry

2011-01-01

The purpose of integrated hazard analyses, probabilistic risk assessments, failure modes and effects analyses, fault trees and many other similar tools is to give managers of a program some idea of the risks associated with their program. All risk tools establish a set of undesired events and then try to evaluate the risk to the program by assessing the severity of the undesired event and the likelihood of that event occurring. Some tools provide qualitative results, some provide quantitative results and some do both. However, in the end the program manager and his/her team must decide which risks are acceptable and which are not. Even with a wide array of analysis tools available, risk acceptance is often a controversial and difficult decision making process. And yet, today's space exploration programs are moving toward more risk based design approaches. Thus, risk identification and good risk assessment is becoming even more vital to the engineering development process. This paper explores how known and unknown information influences risk-based decisions by looking at how the various parts of our personalities are affected by what they know and what they don't know. This paper then offers some criteria for consideration when making risk-based decisions.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Eto, Joseph H.; Parashar, Manu; Lewis, Nancy Jo

The Real Time System Operations (RTSO) 2006-2007 project focused on two parallel technical tasks: (1) Real-Time Applications of Phasors for Monitoring, Alarming and Control; and (2) Real-Time Voltage Security Assessment (RTVSA) Prototype Tool. The overall goal of the phasor applications project was to accelerate adoption and foster greater use of new, more accurate, time-synchronized phasor measurements by conducting research and prototyping applications on California ISO's phasor platform - Real-Time Dynamics Monitoring System (RTDMS) -- that provide previously unavailable information on the dynamic stability of the grid. Feasibility assessment studies were conducted on potential application of this technology for small-signal stabilitymore » monitoring, validating/improving existing stability nomograms, conducting frequency response analysis, and obtaining real-time sensitivity information on key metrics to assess grid stress. Based on study findings, prototype applications for real-time visualization and alarming, small-signal stability monitoring, measurement based sensitivity analysis and frequency response assessment were developed, factory- and field-tested at the California ISO and at BPA. The goal of the RTVSA project was to provide California ISO with a prototype voltage security assessment tool that runs in real time within California ISO?s new reliability and congestion management system. CERTS conducted a technical assessment of appropriate algorithms, developed a prototype incorporating state-of-art algorithms (such as the continuation power flow, direct method, boundary orbiting method, and hyperplanes) into a framework most suitable for an operations environment. Based on study findings, a functional specification was prepared, which the California ISO has since used to procure a production-quality tool that is now a part of a suite of advanced computational tools that is used by California ISO for reliability and congestion management.« less

Minimal Data and Site Specific Approaches

EPA Science Inventory

As part of a workshop, Tools for Assessing Stream Dissolved Minerals, approaches and EPA tools are described for site specific development of water quality criteria based on observations from Arkansas streams using minimal data. Discussion topics will include site-specific appro...

Children's estimates of food portion size: the development and evaluation of three portion size assessment tools for use with children.

PubMed

Foster, E; Matthews, J N S; Lloyd, J; Marshall, L; Mathers, J C; Nelson, M; Barton, K L; Wrieden, W L; Cornelissen, P; Harris, J; Adamson, A J

2008-01-01

A number of methods have been developed to assist subjects in providing an estimate of portion size but their application in improving portion size estimation by children has not been investigated systematically. The aim was to develop portion size assessment tools for use with children and to assess the accuracy of children's estimates of portion size using the tools. The tools were food photographs, food models and an interactive portion size assessment system (IPSAS). Children (n 201), aged 4-16 years, were supplied with known quantities of food to eat, in school. Food leftovers were weighed. Children estimated the amount of each food using each tool, 24 h after consuming the food. The age-specific portion sizes represented were based on portion sizes consumed by children in a national survey. Significant differences were found between the accuracy of estimates using the three tools. Children of all ages performed well using the IPSAS and food photographs. The accuracy and precision of estimates made using the food models were poor. For all tools, estimates of the amount of food served were more accurate than estimates of the amount consumed. Issues relating to reporting of foods left over which impact on estimates of the amounts of foods actually consumed require further study. The IPSAS has shown potential for assessment of dietary intake with children. Before practical application in assessment of dietary intake of children the tool would need to be expanded to cover a wider range of foods and to be validated in a 'real-life' situation.

Systematic Omics Analysis Review (SOAR) Tool to Support Risk Assessment

PubMed Central

McConnell, Emma R.; Bell, Shannon M.; Cote, Ila; Wang, Rong-Lin; Perkins, Edward J.; Garcia-Reyero, Natàlia; Gong, Ping; Burgoon, Lyle D.

2014-01-01

Environmental health risk assessors are challenged to understand and incorporate new data streams as the field of toxicology continues to adopt new molecular and systems biology technologies. Systematic screening reviews can help risk assessors and assessment teams determine which studies to consider for inclusion in a human health assessment. A tool for systematic reviews should be standardized and transparent in order to consistently determine which studies meet minimum quality criteria prior to performing in-depth analyses of the data. The Systematic Omics Analysis Review (SOAR) tool is focused on assisting risk assessment support teams in performing systematic reviews of transcriptomic studies. SOAR is a spreadsheet tool of 35 objective questions developed by domain experts, focused on transcriptomic microarray studies, and including four main topics: test system, test substance, experimental design, and microarray data. The tool will be used as a guide to identify studies that meet basic published quality criteria, such as those defined by the Minimum Information About a Microarray Experiment standard and the Toxicological Data Reliability Assessment Tool. Seven scientists were recruited to test the tool by using it to independently rate 15 published manuscripts that study chemical exposures with microarrays. Using their feedback, questions were weighted based on importance of the information and a suitability cutoff was set for each of the four topic sections. The final validation resulted in 100% agreement between the users on four separate manuscripts, showing that the SOAR tool may be used to facilitate the standardized and transparent screening of microarray literature for environmental human health risk assessment. PMID:25531884

Survey of Ambient Air Pollution Health Risk Assessment Tools.

PubMed

Anenberg, Susan C; Belova, Anna; Brandt, Jørgen; Fann, Neal; Greco, Sue; Guttikunda, Sarath; Heroux, Marie-Eve; Hurley, Fintan; Krzyzanowski, Michal; Medina, Sylvia; Miller, Brian; Pandey, Kiran; Roos, Joachim; Van Dingenen, Rita

2016-09-01

Designing air quality policies that improve public health can benefit from information about air pollution health risks and impacts, which include respiratory and cardiovascular diseases and premature death. Several computer-based tools help automate air pollution health impact assessments and are being used for a variety of contexts. Expanding information gathered for a May 2014 World Health Organization expert meeting, we survey 12 multinational air pollution health impact assessment tools, categorize them according to key technical and operational characteristics, and identify limitations and challenges. Key characteristics include spatial resolution, pollutants and health effect outcomes evaluated, and method for characterizing population exposure, as well as tool format, accessibility, complexity, and degree of peer review and application in policy contexts. While many of the tools use common data sources for concentration-response associations, population, and baseline mortality rates, they vary in the exposure information source, format, and degree of technical complexity. We find that there is an important tradeoff between technical refinement and accessibility for a broad range of applications. Analysts should apply tools that provide the appropriate geographic scope, resolution, and maximum degree of technical rigor for the intended assessment, within resources constraints. A systematic intercomparison of the tools' inputs, assumptions, calculations, and results would be helpful to determine the appropriateness of each for different types of assessment. Future work would benefit from accounting for multiple uncertainty sources and integrating ambient air pollution health impact assessment tools with those addressing other related health risks (e.g., smoking, indoor pollution, climate change, vehicle accidents, physical activity). © 2016 Society for Risk Analysis.

Helping coaches apply the principles of representative learning design: validation of a tennis specific practice assessment tool.

PubMed

Krause, Lyndon; Farrow, Damian; Reid, Machar; Buszard, Tim; Pinder, Ross

2018-06-01

Representative Learning Design (RLD) is a framework for assessing the degree to which experimental or practice tasks simulate key aspects of specific performance environments (i.e. competition). The key premise being that when practice replicates the performance environment, skills are more likely to transfer. In applied situations, however, there is currently no simple or quick method for coaches to assess the key concepts of RLD (e.g. during on-court tasks). The aim of this study was to develop a tool for coaches to efficiently assess practice task design in tennis. A consensus-based tool was developed using a 4-round Delphi process with 10 academic and 13 tennis-coaching experts. Expert consensus was reached for the inclusion of seven items, each consisting of two sub-questions related to (i) the task goal and (ii) the relevance of the task to competition performance. The Representative Practice Assessment Tool (RPAT) is proposed for use in assessing and enhancing practice task designs in tennis to increase the functional coupling between information and movement, and to maximise the potential for skill transfer to competition contexts.

Assessing Changes in High School Students' Conceptual Understanding through Concept Maps before and after the Computer-Based Predict-Observe-Explain (CB-POE) Tasks on Acid-Base Chemistry at the Secondary Level

ERIC Educational Resources Information Center

Yaman, Fatma; Ayas, Alipasa

2015-01-01

Although concept maps have been used as alternative assessment methods in education, there has been an ongoing debate on how to evaluate students' concept maps. This study discusses how to evaluate students' concept maps as an assessment tool before and after 15 computer-based Predict-Observe-Explain (CB-POE) tasks related to acid-base chemistry.…

Lightning Tracking Tool for Assessment of Total Cloud Lightning within AWIPS II

NASA Technical Reports Server (NTRS)

Burks, Jason E.; Stano, Geoffrey T.; Sperow, Ken

2014-01-01

Total lightning (intra-cloud and cloud-to-ground) has been widely researched and shown to be a valuable tool to aid real-time warning forecasters in the assessment of severe weather potential of convective storms. The trend of total lightning has been related to the strength of a storm's updraft. Therefore a rapid increase in total lightning signifies the strengthening of the parent thunderstorm. The assessment of severe weather potential occurs in a time limited environment and therefore constrains the use of total lightning. A tool has been developed at NASA's Short-term Prediction Research and Transition (SPoRT) Center to assist in quickly analyzing the total lightning signature of multiple storms. The development of this tool comes as a direct result of forecaster feedback from numerous assessments requesting a real-time display of the time series of total lightning. This tool also takes advantage of the new architecture available within the AWIPS II environment. SPoRT's lightning tracking tool has been tested in the Hazardous Weather Testbed (HWT) Spring Program and significant changes have been made based on the feedback. In addition to the updates in response to the HWT assessment, the lightning tracking tool may also be extended to incorporate other requested displays, such as the intra-cloud to cloud-to-ground ratio as well as incorporate the lightning jump algorithm.

Expert Systems Based Clinical Assessment and Tutorial Project.

ERIC Educational Resources Information Center

Papa, Frank; Shores, Jay

This project at the Texas College of Osteopathic Medicine (Fort Worth) evaluated the use of an artificial-intelligence-derived measure, "Knowledge-Based Inference Tool" (KBIT), as the basis for assessing medical students' diagnostic capabilities and designing instruction to improve diagnostic skills. The instrument was designed to…

Evaluating the use of mobile phone technology to enhance cardiovascular disease screening by community health workers.

PubMed

Surka, Sam; Edirippulige, Sisira; Steyn, Krisela; Gaziano, Thomas; Puoane, Thandi; Levitt, Naomi

2014-09-01

Primary prevention of cardiovascular disease (CVD),by identifying individuals at risk is a well-established, but costly strategy when based on measurements that depend on laboratory analyses. A non-laboratory, paper-based CVD risk assessment chart tool has previously been developed to make screening more affordable in developing countries. Task shifting to community health workers (CHWs) is being investigated to further scale CVD risk screening. This study aimed to develop a mobile phone CVD risk assessment application and to evaluate its impact on CHW training and the duration of screening for CVD in the community by CHWs. A feature phone application was developed using the open source online platform, CommCare(©). CHWs (n=24) were trained to use both paper-based and mobile phone CVD risk assessment tools. They were randomly allocated to using one of the risk tools to screen 10-20 community members and then crossed over to screen the same number, using the alternate risk tool. The impact on CHW training time, screening time and margin of error in calculating risk scores was recorded. A focus group discussion evaluated experiences of CHWs using the two tools. The training time was 12.3h for the paper-based chart tool and 3h for the mobile phone application. 537 people were screened. The mean screening time was 36 min (SD=12.6) using the paper-base chart tool and 21 min (SD=8.71) using the mobile phone application, p=<0.0001. Incorrect calculations (4.3% of average systolic BP measurements, 10.4% of BMI and 3.8% of CVD risk score) were found when using the paper-based chart tool while all the mobile phone calculations were correct. Qualitative findings from the focus group discussion corresponded with the findings of the pilot study. The reduction in CHW training time, CVD risk screening time, lack of errors in calculation of a CVD risk score and end user satisfaction when using a mobile phone application, has implications in terms of adoption and sustainability of this primary prevention strategy to identify people with high CVD risk who can be referred for appropriate diagnoses and treatment. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Evaluating the use of mobile phone technology to enhance cardiovascular disease screening by community health workers

PubMed Central

Surka, Sam; Edirippulige, Sisira; Steyn, Krisela; Gaziano, Thomas; Puoane, Thandi; Levitt, Naomi

2014-01-01

Background Primary prevention of cardiovascular disease (CVD),by identifying individuals at risk is a well-established, but costly strategy when based on measurements that depend on laboratory analyses. A non-laboratory, paper-based CVD risk assessment chart tool has previously been developed to make screening more affordable in developing countries. Task shifting to community health workers (CHWs) is being investigated to further scale CVD risk screening. This study aimed to develop a mobile phone CVD risk assessment application and to evaluate it’s impact on CHW training and the duration of screening for CVD in the community by CHWs. Methods A feature phone application was developed using the open source online platform, CommCare©. CHWs (n=24) were trained to use both paper-based and mobile phone CVD risk assessment tools. They were randomly allocated to using one of the risk tools to screen 10-20 community members and then crossed over to screen the same number, using the alternate risk tool. The impact on CHW training time, screening time and margin of error in calculating risk scores was recorded. A focus group discussion evaluated experiences of CHWs using the two tools. Results The training time was 12.3 hrs for the paper-based chart tool and 3 hours for the mobile phone application. 537 people were screened. The mean screening time was 36 minutes (SD=12.6) using the paper-base chart tool and 21 minutes (SD=8.71) using the mobile phone application , p = <0.0001. Incorrect calculations (4.3 % of average systolic BP measurements, 10.4 % of BMI and 3.8% of CVD risk score) were found when using the paper-based chart tool while all the mobile phone calculations were correct. Qualitative findings from the focus group discussion corresponded with the findings of the pilot study. Conclusion The reduction in CHW training time, CVD risk screening time, lack of errors in calculation of a CVD risk score and end user satisfaction when using a mobile phone application, has implications in terms of adoption and sustainability of this primary prevention strategy to identify people with high CVD risk who can be referred for appropriate diagnoses and treatment. PMID:25002305

Tools for observational gait analysis in patients with stroke: a systematic review.

PubMed

Ferrarello, Francesco; Bianchi, Valeria Anna Maria; Baccini, Marco; Rubbieri, Gaia; Mossello, Enrico; Cavallini, Maria Chiara; Marchionni, Niccolò; Di Bari, Mauro

2013-12-01

Stroke severely affects walking ability, and assessment of gait kinematics is important in defining diagnosis, planning treatment, and evaluating interventions in stroke rehabilitation. Although observational gait analysis is the most common approach to evaluate gait kinematics, tools useful for this purpose have received little attention in the scientific literature and have not been thoroughly reviewed. The aims of this systematic review were to identify tools proposed to conduct observational gait analysis in adults with a stroke, to summarize evidence concerning their quality, and to assess their implementation in rehabilitation research and clinical practice. An extensive search was performed of original articles reporting on visual/observational tools developed to investigate gait kinematics in adults with a stroke. Two reviewers independently selected studies, extracted data, assessed quality of the included studies, and scored the metric properties and clinical utility of each tool. Rigor in reporting metric properties and dissemination of the tools also was evaluated. Five tools were identified, not all of which had been tested adequately for their metric properties. Evaluation of content validity was partially satisfactory. Reliability was poorly investigated in all but one tool. Concurrent validity and sensitivity to change were shown for 3 and 2 tools, respectively. Overall, adequate levels of quality were rarely reached. The dissemination of the tools was poor. Based on critical appraisal, the Gait Assessment and Intervention Tool shows a good level of quality, and its use in stroke rehabilitation is recommended. Rigorous studies are needed for the other tools in order to establish their usefulness.

EVALUATING POLLUTION PREVENTION PROGRESS (P2P) III: AN ENVIRONMENTAL TOOL FOR SCREENING IN PRODUCT LIFE CYCLE ASSESSMENT AND CHEMICAL PROCESS DESIGN

EPA Science Inventory

P2P is a computer-based tool that supports the comparison of process and product alternatives in terms of environmental impacts. This tool provides screening-level information for use in process design and in product LCA. Twenty one impact categories and data for approximately ...

Implementing a geriatric assessment in cooperative group clinical cancer trials: CALGB 360401.

PubMed

Hurria, Arti; Cirrincione, Constance T; Muss, Hyman B; Kornblith, Alice B; Barry, William; Artz, Andrew S; Schmieder, Linda; Ansari, Rafat; Tew, William P; Weckstein, Douglas; Kirshner, Jeffrey; Togawa, Kayo; Hansen, Kurt; Katheria, Vani; Stone, Richard; Galinsky, Ilene; Postiglione, John; Cohen, Harvey Jay

2011-04-01

Factors captured in a geriatric assessment can predict morbidity and mortality in older adults, but are not routinely measured in cancer clinical trials. This study evaluated the implementation of a geriatric assessment tool in the cooperative group setting. Patients age ≥ 65 with cancer, who enrolled on cooperative group cancer trials, were eligible to enroll on Cancer and Leukemia Group B (CALGB) 360401. They completed a geriatric assessment tool before initiation of protocol therapy, consisting of valid and reliable geriatric assessment measures which are primarily self-administered and require minimal resources and time by healthcare providers. The assessment measures functional status, comorbidity, cognitive function, psychological state, social support, and nutritional status. The protocol specified criteria for incorporation of the tool in future cooperative group trials was based on the time to completion and percent of patients who could complete their portion without assistance. Patient satisfaction with the tool was captured. Of the 93 patients who enrolled in this study, five (5%) met criteria for cognitive impairment and three did not complete the cognitive screen, leaving 85 assessable patients (median age, 72 years). The median time to complete the geriatric assessment tool was 22 minutes, 87% of patients (n = 74) completed their portion without assistance, 92% (n = 78) were satisfied with the questionnaire length, 95% (n = 81) reported no difficult questions, and 96% (n = 82) reported no upsetting questions. One hundred percent of health care professionals completed their portion. This brief, primarily self-administered geriatric assessment tool met the protocol specified criteria for inclusion in future cooperative group clinical trials.

A web-based screening tool for near-port air quality assessments

PubMed Central

Isakov, Vlad; Barzyk, Timothy M.; Smith, Elizabeth R.; Arunachalam, Saravanan; Naess, Brian; Venkatram, Akula

2018-01-01

The Community model for near-PORT applications (C-PORT) is a screening tool with an intended purpose of calculating differences in annual averaged concentration patterns and relative contributions of various source categories over the spatial domain within about 10 km of the port. C-PORT can inform decision-makers and concerned citizens about local air quality due to mobile source emissions related to commercial port activities. It allows users to visualize and evaluate different planning scenarios, helping them identify the best alternatives for making long-term decisions that protect community health and sustainability. The web-based, easy-to-use interface currently includes data from 21 seaports primarily in the Southeastern U.S., and has a map-based interface based on Google Maps. The tool was developed to visualize and assess changes in air quality due to changes in emissions and/or meteorology in order to analyze development scenarios, and is not intended to support or replace any regulatory models or programs. PMID:29681760

Comparison of Three Cognitive Screening Tools in Older Urban and Regional Aboriginal Australians.

PubMed

Radford, Kylie; Mack, Holly A; Draper, Brian; Chalkley, Simon; Delbaere, Kim; Daylight, Gail; Cumming, Robert G; Bennett, Hayley; Broe, Gerald A

2015-01-01

Validated cognitive screening tools for use in urban and regional Aboriginal populations in Australia are lacking. In a cross-sectional community-based study, 235 participants were assessed on the Mini-Mental State Examination (MMSE), the Rowland Universal Dementia Assessment Scale (RUDAS) and an urban modification of the Kimberley Indigenous Cognitive Assessment (mKICA). Performance on these cognitive screening tools was compared to dementia diagnosis by clinical consensus. All tests were culturally acceptable with good psychometric properties. Receiver operating characteristic curve analyses revealed that the MMSE and mKICA were the most accurate. The MMSE is an effective cognitive screening tool in urban Aboriginal populations. The mKICA is a good alternative when illiteracy, language or cultural considerations deem it appropriate. The RUDAS also has adequate validity in this population. © 2015 S. Karger AG, Basel.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bartoletti, T.

SPI/U3.1 consists of five tools used to assess and report the security posture of computers running the UNIX operating system. The tools are: Access Control Test: A rule-based system which identifies sequential dependencies in UNIX access controls. Binary Inspector Tool: Evaluates the release status of system binaries by comparing a crypto-checksum to provide table entries. Change Detection Tool: Maintains and applies a snapshot of critical system files and attributes for purposes of change detection. Configuration Query Language: Accepts CQL-based scripts (provided) to evaluate queries over the status of system files, configuration of services and many other elements of UNIX systemmore » security. Password Security Inspector: Tests for weak or aged passwords. The tools are packaged with a forms-based user interface providing on-line context-sensistive help, job scheduling, parameter management and output report management utilities. Tools may be run independent of the UI.« less

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bartoletti, Tony

SPI/U3.2 consists of five tools used to assess and report the security posture of computers running the UNIX operating system. The tools are: Access Control Test: A rule-based system which identifies sequential dependencies in UNIX access controls. Binary Authentication Tool: Evaluates the release status of system binaries by comparing a crypto-checksum to provide table entries. Change Detection Tool: Maintains and applies a snapshot of critical system files and attributes for purposes of change detection. Configuration Query Language: Accepts CQL-based scripts (provided) to evaluate queries over the status of system files, configuration of services and many other elements of UNIX systemmore » security. Password Security Inspector: Tests for weak or aged passwords. The tools are packaged with a forms-based user interface providing on-line context-sensistive help, job scheduling, parameter management and output report management utilities. Tools may be run independent of the UI.« less

SPI/U3.2. Security Profile Inspector for UNIX Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bartoletti, A.

1994-08-01

SPI/U3.2 consists of five tools used to assess and report the security posture of computers running the UNIX operating system. The tools are: Access Control Test: A rule-based system which identifies sequential dependencies in UNIX access controls. Binary Authentication Tool: Evaluates the release status of system binaries by comparing a crypto-checksum to provide table entries. Change Detection Tool: Maintains and applies a snapshot of critical system files and attributes for purposes of change detection. Configuration Query Language: Accepts CQL-based scripts (provided) to evaluate queries over the status of system files, configuration of services and many other elements of UNIX systemmore » security. Password Security Inspector: Tests for weak or aged passwords. The tools are packaged with a forms-based user interface providing on-line context-sensistive help, job scheduling, parameter management and output report management utilities. Tools may be run independent of the UI.« less

Validation of a novel venous duplex ultrasound objective structured assessment of technical skills for the assessment of venous reflux.

PubMed

Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J

2015-01-01

Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Introducing the fit-criteria assessment plot - A visualisation tool to assist class enumeration in group-based trajectory modelling.

PubMed

Klijn, Sven L; Weijenberg, Matty P; Lemmens, Paul; van den Brandt, Piet A; Lima Passos, Valéria

2017-10-01

Background and objective Group-based trajectory modelling is a model-based clustering technique applied for the identification of latent patterns of temporal changes. Despite its manifold applications in clinical and health sciences, potential problems of the model selection procedure are often overlooked. The choice of the number of latent trajectories (class-enumeration), for instance, is to a large degree based on statistical criteria that are not fail-safe. Moreover, the process as a whole is not transparent. To facilitate class enumeration, we introduce a graphical summary display of several fit and model adequacy criteria, the fit-criteria assessment plot. Methods An R-code that accepts universal data input is presented. The programme condenses relevant group-based trajectory modelling output information of model fit indices in automated graphical displays. Examples based on real and simulated data are provided to illustrate, assess and validate fit-criteria assessment plot's utility. Results Fit-criteria assessment plot provides an overview of fit criteria on a single page, placing users in an informed position to make a decision. Fit-criteria assessment plot does not automatically select the most appropriate model but eases the model assessment procedure. Conclusions Fit-criteria assessment plot is an exploratory, visualisation tool that can be employed to assist decisions in the initial and decisive phase of group-based trajectory modelling analysis. Considering group-based trajectory modelling's widespread resonance in medical and epidemiological sciences, a more comprehensive, easily interpretable and transparent display of the iterative process of class enumeration may foster group-based trajectory modelling's adequate use.

More effective assessment of adverse effects and comorbidities in epilepsy: results of a Phase II communication study.

PubMed

Stern, John M; Labiner, David M; Gilliam, Frank G; Penovich, Patricia E; Onofrey, Meaghan; Eagan, Corey A; Holmes, Gregory L

2011-11-01

Research was conducted to evaluate conversations about epilepsy between community-based neurologists and patients. Adverse effects of antiepileptic drugs and mood/behavioral issues were infrequently discussed, and neurologists and patients disagreed about these issues postvisit. Follow-up research was conducted to assess the impact of a previsit assessment tool on discussions of epilepsy. Twenty neurologists reviewed a tool incorporating questions from validated instruments (Adverse Events Profile [AEP] and Neurological Disorders Depression Inventory for Epilepsy [NDDI-E]). Naturally occurring interactions between neurologists and 60 patients were recorded. Neurologists and patients were interviewed separately. All components were transcribed and analyzed using sociolinguistics. Using the previsit assessment tool increased the number of discussions about adverse effects and mood/behavioral issues and increased neurologist-patient agreement about issues postvisit. Visit length did not increase significantly when the tool was used. Ten months after follow-up research, 50% of neurologists reported continuing to use the tool in everyday practice with patients with epilepsy. Copyright © 2011 Elsevier Inc. All rights reserved.

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

PubMed

Wroe, Emily B; McBain, Ryan K; Michaelis, Annie; Dunbar, Elizabeth L; Hirschhorn, Lisa R; Cancedda, Corrado

2017-08-01

Despite rapid growth in the number of physicians and academic institutions entering the field of global health, there are few tools that inform global health curricula and assess physician readiness for this field. To address this gap, we describe the development and pilot testing of a new tool to assess nontechnical competencies and values in global health. Competencies assessed include systems-based practice, interpersonal and cross-cultural communication, professionalism and self-care, patient care, mentoring, teaching, management, and personal motivation and experience. The Global Health Delivery Competency Assessment Tool presents 15 case vignettes and open-ended questions related to situations a global health practitioner might encounter, and grades the quality of responses on a 6-point ordinal scale. We interviewed 17 of 18 possible global health residents (94%), matched with 17 residents not training in global health, for a total of 34 interviews. A second reviewer independently scored recordings of 13 interviews for reliability. Pilot testing indicated a high degree of discriminant validity, as measured by the instrument's ability to distinguish between residents who were and were not enrolled in a global health program ( P  < .001). It also demonstrated acceptable consistency, as assessed by interrater reliability (κ = 0.53), with a range of item-level agreement from 84%-96%. The tool has potential applicability to a variety of academic and programmatic activities, including evaluation of candidates for global health positions and evaluating the success of training programs in equipping practitioners for entry into this field.

Development and testing of a DVT risk assessment tool: providing evidence of validity and reliability.

PubMed

McCaffrey, Ruth; Bishop, Mary; Adonis-Rizzo, Marie; Williamson, Ellen; McPherson, Melanie; Cruikshank, Alice; Carrier, Vicki Jo; Sands, Simone; Pigano, Diane; Girard, Patricia; Lauzon, Cathy

2007-01-01

Hospital-acquired deep vein thrombosis (DVT) and pulmonary embolisms (PE) are preventable problems that can increase mortality. Early assessment and recognition of risk as well as initiating appropriate prevention measures can prevent DVT or PE. The purpose of this research project was to develop a DVT risk assessment tool and test the tool for validity and reliability. Three phases were undertaken in developing and testing the JFK Medical Center DVT risk assessment tool. Investigation and clarification of risk and predisposing factors for DVT were identified from the literature, expert nursing knowledge, and medical staff input. Second, item development and weighting were undertaken. Third, parametric testing for content validity measured the differences in mean assessment tool scores between a group of patients who developed DVT in the hospital and a demographically similar group who did not develop DVT. Interrater reliability was measured by having three different nurses score each patient and compare the differences in scores among the three. The DVT group had significantly higher scores on the JFK DVT assessment scale than did those who did not experience DVT. Interrater reliability showed a strong correlation among the scores of the three nurses (.98). Providing a valid and reliable tool for measuring the risk for DVT or PE in hospitalized patients will enable nurses to intervene early in patients at risk. Basing DVT risk assessment on the evidence provided in this study will assist nurses in becoming more confident in recognizing the necessity for interventions in hospitalized patients and decreasing risk. Nurses can now evaluate patients at risk for DVT or PE using the JFK Medial Center's risk assessment tool.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

Using Hi-FAME (High Feedback-Assessment-Multimedia-Environment) Instructional Model in WBI: A Case Study for Biology Teacher Education.

ERIC Educational Resources Information Center

Wang, Tzu-Hua; Wang, Wei-Lung; Wang, Kuo-Hua; Huang, Shih-Chieh

The study attempted to adapt two web tools, FFS system (Frontpage Feedback System) and WATA system (Web-based Assessment and Test Analysis System), to construct a Hi-FAME (High Feedback-Assessment-Multimedia-Environment) Model in WBI (Web-based Instruction) to facilitate pre-service teacher training. Participants were 30 junior pre-service…

User manual and spreadsheet tool for implementing performance planning for rural planning organizations.

DOT National Transportation Integrated Search

2017-03-01

The performance-planning tool developed as part of this project is intended for use with the guidebook for establishing and using rural performance based transportation system assessment, monitoring, planning, and programming to support the rural pla...

A tool for assessing the economic impact of spending on public transit.

DOT National Transportation Integrated Search

2013-07-01

In this project, an Excel-based template tool was developed for transit agencies, local governments, and other stakeholders of public transit to estimate the economic impacts of spending on public transit. Features include the following: : Uses i...

Analytical tools for identifying bicycle route suitability, coverage, and continuity.

DOT National Transportation Integrated Search

2012-05-01

This report presents new tools created to assess bicycle suitability using geographic information systems (GIS). Bicycle suitability is a rating of how appropriate a roadway is for bicycle travel based on attributes of the roadway, such as vehi...

Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff.

PubMed

Guru, Khurshid A; Esfahani, Ehsan T; Raza, Syed J; Bhat, Rohit; Wang, Katy; Hammond, Yana; Wilding, Gregory; Peabody, James O; Chowriappa, Ashirwad J

2015-01-01

To investigate the utility of cognitive assessment during robot-assisted surgery (RAS) to define skills in terms of cognitive engagement, mental workload, and mental state; while objectively differentiating between novice and expert surgeons. In all, 10 surgeons with varying operative experience were assigned to beginner (BG), combined competent and proficient (CPG), and expert (EG) groups based on the Dreyfus model. The participants performed tasks for basic, intermediate and advanced skills on the da Vinci Surgical System. Participant performance was assessed using both tool-based and cognitive metrics. Tool-based metrics showed significant differences between the BG vs CPG and the BG vs EG, in basic skills. While performing intermediate skills, there were significant differences only on the instrument-to-instrument collisions between the BG vs CPG (2.0 vs 0.2, P = 0.028), and the BG vs EG (2.0 vs 0.1, P = 0.018). There were no significant differences between the CPG and EG for both basic and intermediate skills. However, using cognitive metrics, there were significant differences between all groups for the basic and intermediate skills. In advanced skills, there were no significant differences between the CPG and the EG except time (1116 vs 599.6 s), using tool-based metrics. However, cognitive metrics revealed significant differences between both groups. Cognitive assessment of surgeons may aid in defining levels of expertise performing complex surgical tasks once competence is achieved. Cognitive assessment may be used as an adjunct to the traditional methods for skill assessment during RAS. © 2014 The Authors. BJU International © 2014 BJU International.

Gaussian process regression for tool wear prediction

NASA Astrophysics Data System (ADS)

Kong, Dongdong; Chen, Yongjie; Li, Ning

2018-05-01

To realize and accelerate the pace of intelligent manufacturing, this paper presents a novel tool wear assessment technique based on the integrated radial basis function based kernel principal component analysis (KPCA_IRBF) and Gaussian process regression (GPR) for real-timely and accurately monitoring the in-process tool wear parameters (flank wear width). The KPCA_IRBF is a kind of new nonlinear dimension-increment technique and firstly proposed for feature fusion. The tool wear predictive value and the corresponding confidence interval are both provided by utilizing the GPR model. Besides, GPR performs better than artificial neural networks (ANN) and support vector machines (SVM) in prediction accuracy since the Gaussian noises can be modeled quantitatively in the GPR model. However, the existence of noises will affect the stability of the confidence interval seriously. In this work, the proposed KPCA_IRBF technique helps to remove the noises and weaken its negative effects so as to make the confidence interval compressed greatly and more smoothed, which is conducive for monitoring the tool wear accurately. Moreover, the selection of kernel parameter in KPCA_IRBF can be easily carried out in a much larger selectable region in comparison with the conventional KPCA_RBF technique, which helps to improve the efficiency of model construction. Ten sets of cutting tests are conducted to validate the effectiveness of the presented tool wear assessment technique. The experimental results show that the in-process flank wear width of tool inserts can be monitored accurately by utilizing the presented tool wear assessment technique which is robust under a variety of cutting conditions. This study lays the foundation for tool wear monitoring in real industrial settings.

Do Bedside Visual Tools Improve Patient and Caregiver Satisfaction? A Systematic Review of the Literature.

PubMed

Goyal, Anupama A; Tur, Komalpreet; Mann, Jason; Townsend, Whitney; Flanders, Scott A; Chopra, Vineet

2017-11-01

Although common, the impact of low-cost bedside visual tools, such as whiteboards, on patient care is unclear. To systematically review the literature and assess the influence of bedside visual tools on patient satisfaction. Medline, Embase, SCOPUS, Web of Science, CINAHL, and CENTRAL. Studies of adult or pediatric hospitalized patients reporting physician identification, understanding of provider roles, patient-provider communication, and satisfaction with care from the use of visual tools were included. Outcomes were categorized as positive, negative, or neutral based on survey responses for identification, communication, and satisfaction. Two reviewers screened studies, extracted data, and assessed the risk of study bias. Sixteen studies met the inclusion criteria. Visual tools included whiteboards (n = 4), physician pictures (n = 7), whiteboard and picture (n = 1), electronic medical record-based patient portals (n = 3), and formatted notepads (n = 1). Tools improved patients' identification of providers (13/13 studies). The impact on understanding the providers' roles was largely positive (8/10 studies). Visual tools improved patient-provider communication (4/5 studies) and satisfaction (6/8 studies). In adults, satisfaction varied between positive with the use of whiteboards (2/5 studies) and neutral with pictures (1/5 studies). Satisfaction related to pictures in pediatric patients was either positive (1/3 studies) or neutral (1/3 studies). Differences in tool format (individual pictures vs handouts with pictures of all providers) and study design (randomized vs cohort) may explain variable outcomes. The use of bedside visual tools appears to improve patient recognition of providers and patient-provider communication. Future studies that include better design and outcome assessment are necessary before widespread use can be recommended. © 2017 Society of Hospital Medicine

Quality assessment of expert answers to lay questions about cystic fibrosis from various language zones in Europe: the ECORN-CF project.

PubMed

d'Alquen, Daniela; De Boeck, Kris; Bradley, Judy; Vávrová, Věra; Dembski, Birgit; Wagner, Thomas O F; Pfalz, Annette; Hebestreit, Helge

2012-02-06

The European Centres of Reference Network for Cystic Fibrosis (ECORN-CF) established an Internet forum which provides the opportunity for CF patients and other interested people to ask experts questions about CF in their mother language. The objectives of this study were to: 1) develop a detailed quality assessment tool to analyze quality of expert answers, 2) evaluate the intra- and inter-rater agreement of this tool, and 3) explore changes in the quality of expert answers over the time frame of the project. The quality assessment tool was developed by an expert panel. Five experts within the ECORN-CF project used the quality assessment tool to analyze the quality of 108 expert answers published on ECORN-CF from six language zones. 25 expert answers were scored at two time points, one year apart. Quality of answers was also assessed at an early and later period of the project. Individual rater scores and group mean scores were analyzed for each expert answer. A scoring system and training manual were developed analyzing two quality categories of answers: content and formal quality. For content quality, the grades based on group mean scores for all raters showed substantial agreement between two time points, however this was not the case for the grades based on individual rater scores. For formal quality the grades based on group mean scores showed only slight agreement between two time points and there was also poor agreement between time points for the individual grades. The inter-rater agreement for content quality was fair (mean kappa value 0.232 ± 0.036, p < 0.001) while only slight agreement was observed for the grades of the formal quality (mean kappa value 0.105 ± 0.024, p < 0.001). The quality of expert answers was rated high (four language zones) or satisfactory (two language zones) and did not change over time. The quality assessment tool described in this study was feasible and reliable when content quality was assessed by a group of raters. Within ECORN-CF, the tool will help ensure that CF patients all over Europe have equal possibility of access to high quality expert advice on their illness. © 2012 d’Alquen et al; licensee BioMed Central Ltd.

Evolution of a Simulation Testbed into an Operational Tool

NASA Technical Reports Server (NTRS)

Sheth, Kapil; Bilimoria, Karl D.; Sridhar, Banavar; Sterenchuk, Mike; Niznik, Tim; O'Neill, Tom; Clymer, Alexis; Gutierrez Nolasco, Sebastian; Edholm, Kaj; Shih, Fu-Tai

2017-01-01

This paper describes the evolution over a 20-year period of the Future ATM (Air Traffic Management) Concepts Evaluation Tool (FACET) from a National Airspace System (NAS) based simulation testbed into an operational tool. FACET was developed as a testbed for assessing futuristic ATM concepts, e.g., automated conflict detection and resolution. NAS Constraint Evaluation and Notification Tool (NASCENT) is an application, within FACET, for alerting airspace users of inefficiencies in flight operations and advising time- and fuel-saving reroutes.It is currently in use at American Airlines Integrated Operations Center in Fort Worth, TX. The concepts assessed,research conducted, and the operational capability developed, along with the NASA support and achievements are presented in this paper.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools

PubMed Central

Foster, Margaret J

2011-01-01

Objective: The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. Methods: The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Results: Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. Conclusions: As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed. PMID:21753917

Rationale and methods of the iFightDepression study: A double-blind, randomized controlled trial evaluating the efficacy of an internet-based self-management tool for moderate to mild depression.

PubMed

Justicia, Azucena; Elices, Matilde; Cebria, Ana Isabel; Palao, Diego J; Gorosabel, Jesús; Puigdemont, Dolors; de Diego-Adeliño, Javier; Gabilondo, Andrea; Iruin, Alvaro; Hegerl, Ulrich; Pérez, Víctor

2017-04-19

During the last decade online interventions have emerged as a promising approach for patients with mild/moderate depressive symptoms, reaching at large populations and representing cost-effective alternatives. The main objective of this double-blind, randomized controlled trial is to examine the efficacy of an internet-based self-management tool (iFightDepression) for mild to moderate depression as an add-on to treatment as usual (TAU) versus internet-based psychoeducation plus TAU. A total of 310 participants with major depression disorder (MDD) will be recruited at four different mental-health facilities in Spain. Participants will be randomly allocated to one of two study arms: iFightDepression (iFD) tool + TAU vs. internet-based psychoeducation + TAU. Both interventions last for 8 weeks and there is a 12 weeks follow up. The primary outcome measure is changes in depressive symptoms assessed with the Hamilton Depression Rating Scale. Additionally, pre-post interventions assessments will include socio-demographic data, a brief medical and clinical history and self-reported measures of depressive symptoms, quality of life, functional impairments and satisfaction with the iFD tool. iFightDepression is an easy-prescribed tool that could increase the efficacy of conventional treatment and potentially reach untreated patients, shortening waiting lists to receive psychological treatment. Confirming the efficacy of the iFD internet-based self-management tool as an add-on treatment for individuals with mild to moderate depression will be clinically-relevant. Registration number NCT02312583 . Clinicaltrials.gov . December 4, 2014.

Performance of a computer-based assessment of cognitive function measures in two cohorts of seniors

USDA-ARS?s Scientific Manuscript database

Computer-administered assessment of cognitive function is being increasingly incorporated in clinical trials, however its performance in these settings has not been systematically evaluated. The Seniors Health and Activity Research Program (SHARP) pilot trial (N=73) developed a computer-based tool f...

A tiered approach to incorporate exposure and pharmacokinetics considerations in in vitro based safety assessment

EPA Science Inventory

Application of in vitro based safety assessment requires reconciling chemical concentrations sufficient to produce bioactivity in vitro with those that trigger a molecular initiating event at the relevant in vivo target site. To address such need, computational tools such as phy...

Parameters for Pesticide QSAR and PBPK/PD Models to inform Human Risk Assessments

EPA Science Inventory

Physiologically-based pharmacokinetic and pharmacodynamic (PBPK/PD) modeling has emerged as an important computational approach supporting quantitative risk assessment of agrochemicals. However, before complete regulatory acceptance of this tool, an assessment of assets and liabi...

Feasibility, reliability, and validity of a smartphone based application for the assessment of cognitive function in the elderly.

PubMed

Brouillette, Robert M; Foil, Heather; Fontenot, Stephanie; Correro, Anthony; Allen, Ray; Martin, Corby K; Bruce-Keller, Annadora J; Keller, Jeffrey N

2013-01-01

While considerable knowledge has been gained through the use of established cognitive and motor assessment tools, there is a considerable interest and need for the development of a battery of reliable and validated assessment tools that provide real-time and remote analysis of cognitive and motor function in the elderly. Smartphones appear to be an obvious choice for the development of these "next-generation" assessment tools for geriatric research, although to date no studies have reported on the use of smartphone-based applications for the study of cognition in the elderly. The primary focus of the current study was to assess the feasibility, reliability, and validity of a smartphone-based application for the assessment of cognitive function in the elderly. A total of 57 non-demented elderly individuals were administered a newly developed smartphone application-based Color-Shape Test (CST) in order to determine its utility in measuring cognitive processing speed in the elderly. Validity of this novel cognitive task was assessed by correlating performance on the CST with scores on widely accepted assessments of cognitive function. Scores on the CST were significantly correlated with global cognition (Mini-Mental State Exam: r = 0.515, p<0.0001) and multiple measures of processing speed and attention (Digit Span: r = 0.427, p<0.0001; Trail Making Test: r = -0.651, p<0.00001; Digit Symbol Test: r = 0.508, p<0.0001). The CST was not correlated with naming and verbal fluency tasks (Boston Naming Test, Vegetable/Animal Naming) or memory tasks (Logical Memory Test). Test re-test reliability was observed to be significant (r = 0.726; p = 0.02). Together, these data are the first to demonstrate the feasibility, reliability, and validity of using a smartphone-based application for the purpose of assessing cognitive function in the elderly. The importance of these findings for the establishment of smartphone-based assessment batteries of cognitive and motor function in the elderly is discussed.

Implementing disability evaluation and welfare services based on the framework of the international classification of functioning, disability and health: experiences in Taiwan

PubMed Central

2013-01-01

Background Before 2007, the disability evaluation was based on the medical model in Taiwan. According to the People with Disabilities Rights Protection Act, from 2012 the assessment of a person’s eligibility for disability benefits has to be determined based on the International Classification of Functioning, Disability, and Health (ICF) framework nationwide. The purposes of this study were to: 1) design the evaluation tools for disability eligibility system based on the ICF/ICF-Children and Youth; 2) compare the differences of grades of disability between the old and new evaluation systems; 3) analyse the outcome of the new disability evaluation system. Methods To develop evaluation tools and procedure for disability determination, we formed an implementation taskforce, including 199 professional experts, and conducted a small-scale field trial to examine the feasibility of evaluation tools in Phase I. To refine the evaluation tools and process and to compare the difference of the grades of disability between new and old systems, 7,329 persons with disabilities were randomly recruited in a national population-based study in Phase II. To implement the new system smoothly and understand the impact of the new system, the collaboration mechanism was established and data of 168,052 persons who applied for the disability benefits was extracted from the information system and analysed in Phase III. Results The measures of the 43 categories for body function/structure components, the Functioning Scale of Disability Evaluation System for activities/participation components, and the needs assessment have been developed and used in the field after several revisions. In Phase II, there was 49.7% agreement of disability grades between the old and new systems. In Phase III, 110,667 persons with a disability received their welfare services through the new system. Among them, 77% received basic social welfare support, 89% financial support, 24% allowance for assistive technology, 7% caregiver support, 8% nursing care and rehabilitation services at home, and 47% were issued parking permits for persons with disability. Conclusion This study demonstrated that disability evaluation system based on the ICF could provide a common language between disability assessment, needs assessment and welfare services. However, the proposed assessment protocol and tools require additional testing and validation. PMID:24125482

Model-Based Approaches for Teaching and Practicing Personality Assessment.

PubMed

Blais, Mark A; Hopwood, Christopher J

2017-01-01

Psychological assessment is a complex professional skill. Competence in assessment requires an extensive knowledge of personality, neuropsychology, social behavior, and psychopathology, a background in psychometrics, familiarity with a range of multimethod tools, cognitive flexibility, skepticism, and interpersonal sensitivity. This complexity makes assessment a challenge to teach and learn, particularly as the investment of resources and time in assessment has waned in psychological training programs over the last few decades. In this article, we describe 3 conceptual models that can assist teaching and learning psychological assessments. The transtheoretical model of personality provides a personality systems-based framework for understanding how multimethod assessment data relate to major personality systems and can be combined to describe and explain complex human behavior. The quantitative psychopathology-personality trait model is an empirical model based on the hierarchical organization of individual differences. Application of this model can help students understand diagnostic comorbidity and symptom heterogeneity, focus on more meaningful high-order domains, and identify the most effective assessment tools for addressing a given question. The interpersonal situation model is rooted in interpersonal theory and can help students connect test data to here-and-now interactions with patients. We conclude by demonstrating the utility of these models using a case example.

Sensors vs. experts - a performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients.

PubMed

Marschollek, Michael; Rehwald, Anja; Wolf, Klaus-Hendrik; Gietzelt, Matthias; Nemitz, Gerhard; zu Schwabedissen, Hubertus Meyer; Schulze, Mareike

2011-06-28

Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data. In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched. Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores. Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach.

Sensors vs. experts - A performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients

PubMed Central

2011-01-01

Background Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data. Methods In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched. Results Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores. Conclusions Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach. PMID:21711504

The Desired Concept Maps and Goal Setting for Assessing Professionalism in Medicine.

PubMed

Guraya, Salman Y; Guraya, Shaista S; Mahabbat, Nehal Anam; Fallatah, Khulood Yahya; Al-Ahmadi, Bashaer Ahmad; Alalawi, Hadeel Hadi

2016-05-01

Due to the multi-dimensional characteristics of professionalism, no single assessment modality has shown to reliably assess professionalism. This review aims to describe some of the popular assessment tools that are being used to assess professionalism with a view to formulate a framework of assessment of professionalism in medicine. In December 2015, the online research databases of MEDLINE, the Educational Resources Information Center (ERIC), Elton Bryson Stephens Company (EBSCO), SCOPUS, OVID and PsychINFO were searched for full-text English language articles published during 2000 to 2015. MeSH terms "professionalism" AND "duty" AND "assessment" OR "professionalism behavioural" AND "professionalism-cognitive" were used. The research articles that assessed professionalism across medical fields along with other areas of competencies were included. A final list of 35 articles were selected for this review. Several assessment tools are available for assessing professionalism that includes, but not limited to, mini clinical evaluation exercise, standardised direct observation of procedural skills, professionalism mini-evaluation exercise, multi-source feedback and 360 degree evaluation, and case based discussions. Because professionalism is a complex construct, it is less likely that a single assessment strategy will adequately measure it. Since every single assessment tool has its own weaknesses, triangulation involving multiple tools can compensate the shortcomings associated with any single approach. Assessment of professionalism necessitates a combination of modalities at individual, interpersonal, societal, and institutional levels and should be accompanied by feedback and motivational reflection that will, in turn, lead to behaviour and identity formation. The assessment of professionalism in medicine should meet the criteria of validity, reliability, feasibility and acceptability. Educators are urged to enhance the depth and quality of assessment instruments in the existing medical curricula for ensuring validity and reliability of assessment tools for professionalism.

Use of web based systems to support postgraduate medical education.

PubMed

Tochel, C; Beggs, K; Haig, A; Roberts, J; Scott, H; Walker, K; Watson, M

2011-12-01

BACKGROUND To meet the demands of delivering the Foundation programme across a geographically diverse country, two web based systems (ePortfolio and eLearning) were developed to promote accessibility to training material and assessment tools on standardised platforms. This study evaluated the use of both tools throughout an entire academic year. METHODS All Scottish Foundation trainees' online learning and assessment data in 2007/08 were analysed, providing a national breakdown of post specialty, completion rates of mandatory assessments (including summary analysis of anonymised scores), and trainees' use of non-mandatory learning tools. Independent verification of competence data was sought from Deaneries. RESULTS There were high levels of engagement with both the ePortfolio (75-97% assessment completion) and eLearning systems (89-98% induction course completion), and the majority of trainees completed all required elements. There was extensive use of ePortfolio beyond mandatory levels for recording of learning events, including almost 20 000 personal learning records submitted by second year trainees. There was evidence that ePortfolio was used to record achievement of clinical competence rather than to track improvements towards competence (median workplace based assessment scores were 'high' or 'very high'). Online learning modules received positive feedback and its flexible format suited the trainees' working environment. External verification of formal assessment data revealed good correlation with locally stored outcomes, both indicating approximately 99% programme completion rates. CONCLUSIONS Core components of the Foundation programme have been delivered successfully to thousands of trainees across Scotland using web based systems to deliver and support education and assessment. There is great potential for further exploration of this carefully managed, rich dataset at individual, regional, and national levels to inform the future of medical education.

Outcome Measures in Myasthenia Gravis: Incorporation Into Clinical Practice.

PubMed

Muppidi, Srikanth

2017-03-01

The development of validated assessment tools for evaluating disease status and response to interventions in patients with myasthenia gravis (MG) has been driven by clinical studies of emerging MG therapies. However, only a small proportion of MG-focused neurology practices have adopted these assessment tools for routine clinical use. This article reviews the suitability of 5 assessment instruments for incorporation into clinical practice, which should be driven by their ability to contribute to improved patient outcomes, and to be implemented within practice personnel and resource constraints. It is recommended that assessments based on both physician-evaluated and patient-reported outcomes be selected, to adequately evaluate both point-in-time symptom load and functional impact of MG symptoms over time. Provider resource allocation and reimbursement issues may be the most significant roadblocks to successful ongoing use of these tools; to that end, the addition of regular assessments to MG standards of care is recommended.

Assessment of a computer-based Taenia solium health education tool 'The Vicious Worm' on knowledge uptake among professionals and their attitudes towards the program.

PubMed

Ertel, Rebekka Lund; Braae, Uffe Christian; Ngowi, Helena Aminiel; Johansen, Maria Vang

2017-01-01

Health education has been recognised as a specific intervention tool for control of Taenia solium taeniosis/cysticercosis but evaluation of the efficacy of the tool remains. The aim of our study was to assess the effect of a computer-based T. solium health education tool 'The Vicious Worm' on knowledge uptake among professionals and investigate attitudes towards the program. The study was carried out between March and May 2014 in Mbeya Region, Tanzania, where T. solium is endemic. The study was a pre and post assessment of a health education tool based on questionnaire surveys and focus group discussions to investigate knowledge and attitudes. A total of 79 study subjects participated in the study including study subjects from both health- and agriculture sector. The health education consisted of 1½h individual practice with the computer program. The baseline questionnaire showed an overall knowledge on aspects of acquisition and transmission of T. solium infections (78%), porcine cysticercosis treatment (77%), human tapeworm in general (72%), neurocysticercosis in general (49%), and porcine cysticercosis diagnosis (48%). However, there was a lack of knowledge on acquisition of neurocysticercosis (15%), prevention of T. solium taeniosis/cysticercosis (28%), and relation between porcine cysticercosis, human cysticercosis, and taeniosis (32%). Overall, the study subject's knowledge was significantly improved both immediately after (p=0.001) and two weeks after (p<0.001) the health education and knowledge regarding specific aspects was significantly improved in most aspects immediately after and two weeks after the health education. The focus group discussions showed positive attitudes towards the program and the study subjects found 'The Vicious Worm' efficient, simple, and appealing. The study revealed a good effect of 'The Vicious Worm' suggesting that it could be a useful health education tool, which should be further assessed and thereafter integrated in T. solium taeniosis/cysticercosis control. Copyright © 2016. Published by Elsevier B.V.

Medical student web-based formative assessment tool for renal pathology.

PubMed

Bijol, Vanesa; Byrne-Dugan, Cathryn J; Hoenig, Melanie P

2015-01-01

Background Web-based formative assessment tools have become widely recognized in medical education as valuable resources for self-directed learning. Objectives To explore the educational value of formative assessment using online quizzes for kidney pathology learning in our renal pathophysiology course. Methods Students were given unrestricted and optional access to quizzes. Performance on quizzed and non-quizzed materials of those who used ('quizzers') and did not use the tool ('non-quizzers') was compared. Frequency of tool usage was analyzed and satisfaction surveys were utilized at the end of the course. Results In total, 82.6% of the students used quizzes. The greatest usage was observed on the day before the final exam. Students repeated interactive and more challenging quizzes more often. Average means between final exam scores for quizzed and unrelated materials were almost equal for 'quizzers' and 'non-quizzers', but 'quizzers' performed statistically better than 'non-quizzers' on both, quizzed (p=0.001) and non-quizzed (p=0.024) topics. In total, 89% of surveyed students thought quizzes improved their learning experience in this course. Conclusions Our new computer-assisted learning tool is popular, and although its use can predict the final exam outcome, it does not provide strong evidence for direct improvement in academic performance. Students who chose to use quizzes did well on all aspects of the final exam and most commonly used quizzes to practice for final exam. Our efforts to revitalize the course material and promote learning by adding interactive online formative assessments improved students' learning experience overall.

Test Accuracy of Informant-Based Cognitive Screening Tests for Diagnosis of Dementia and Multidomain Cognitive Impairment in Stroke.

PubMed

McGovern, Aine; Pendlebury, Sarah T; Mishra, Nishant K; Fan, Yuhua; Quinn, Terence J

2016-02-01

Poststroke cognitive assessment can be performed using standardized questionnaires designed for family or care givers. We sought to describe the test accuracy of such informant-based assessments for diagnosis of dementia/multidomain cognitive impairment in stroke. We performed a systematic review using a sensitive search strategy across multidisciplinary electronic databases. We created summary test accuracy metrics and described reporting and quality using STARDdem and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tools, respectively. From 1432 titles, we included 11 studies. Ten papers used the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). Four studies described IQCODE for diagnosis of poststroke dementia (n=1197); summary sensitivity: 0.81 (95% confidence interval, 0.60-0.93); summary specificty: 0.83 (95% confidence interval, 0.64-0.93). Five studies described IQCODE as tool for predicting future dementia (n=837); summary sensitivity: 0.60 (95% confidence interval, 0.32-0.83); summary specificity: 0.97 (95% confidence interval, 0.70-1.00). All papers had issues with at least 1 aspect of study reporting or quality. There is a limited literature on informant cognitive assessments in stroke. IQCODE as a diagnostic tool has test properties similar to other screening tools, IQCODE as a prognostic tool is specific but insensitive. We found no papers describing test accuracy of informant tests for diagnosis of prestroke cognitive decline, few papers on poststroke dementia and all included papers had issues with potential bias. © 2015 American Heart Association, Inc.

Proposal for a new categorization of aseptic processing facilities based on risk assessment scores.

PubMed

Katayama, Hirohito; Toda, Atsushi; Tokunaga, Yuji; Katoh, Shigeo

2008-01-01

Risk assessment of aseptic processing facilities was performed using two published risk assessment tools. Calculated risk scores were compared with experimental test results, including environmental monitoring and media fill run results, in three different types of facilities. The two risk assessment tools used gave a generally similar outcome. However, depending on the tool used, variations were observed in the relative scores between the facilities. For the facility yielding the lowest risk scores, the corresponding experimental test results showed no contamination, indicating that these ordinal testing methods are insufficient to evaluate this kind of facility. A conventional facility having acceptable aseptic processing lines gave relatively high risk scores. The facility showing a rather high risk score demonstrated the usefulness of conventional microbiological test methods. Considering the significant gaps observed in calculated risk scores and in the ordinal microbiological test results between advanced and conventional facilities, we propose a facility categorization based on risk assessment. The most important risk factor in aseptic processing is human intervention. When human intervention is eliminated from the process by advanced hardware design, the aseptic processing facility can be classified into a new risk category that is better suited for assuring sterility based on a new set of criteria rather than on currently used microbiological analysis. To fully benefit from advanced technologies, we propose three risk categories for these aseptic facilities.

A Technology-Based Statistical Reasoning Assessment Tool in Descriptive Statistics for Secondary School Students

ERIC Educational Resources Information Center

Chan, Shiau Wei; Ismail, Zaleha

2014-01-01

The focus of assessment in statistics has gradually shifted from traditional assessment towards alternative assessment where more attention has been paid to the core statistical concepts such as center, variability, and distribution. In spite of this, there are comparatively few assessments that combine the significant three types of statistical…

The Effects of Autonomy Support on Student Engagement in Peer Assessment

ERIC Educational Resources Information Center

Yuan, Jiangmei; Kim, ChanMin

2018-01-01

Although peer assessment is widely implemented in higher education, not all students are highly engaged in it. To enhance student engagement in peer assessment, we designed and developed a web-based tool, autonomy-supportive peer assessment (ASPA), to support students' need for autonomy when they conducted peer assessment. Students' sense of…

Nucleic acids-based tools for ballast water surveillance, monitoring, and research

EPA Science Inventory

Understanding the risks of biological invasion posed by ballast water—whether in the context of compliance testing, routine monitoring, or basic research—is fundamentally an exercise in biodiversity assessment, and as such should take advantage of the best tools avail...

The Desired Concept Maps and Goal Setting for Assessing Professionalism in Medicine

PubMed Central

Guraya, Shaista S.; Mahabbat, Nehal Anam; Fallatah, Khulood Yahya; Al-Ahmadi, Bashaer Ahmad; Alalawi, Hadeel Hadi

2016-01-01

Due to the multi-dimensional characteristics of professionalism, no single assessment modality has shown to reliably assess professionalism. This review aims to describe some of the popular assessment tools that are being used to assess professionalism with a view to formulate a framework of assessment of professionalism in medicine. In December 2015, the online research databases of MEDLINE, the Educational Resources Information Center (ERIC), Elton Bryson Stephens Company (EBSCO), SCOPUS, OVID and PsychINFO were searched for full-text English language articles published during 2000 to 2015. MeSH terms “professionalism” AND “duty” AND “assessment” OR “professionalism behavioural” AND “professionalism–cognitive” were used. The research articles that assessed professionalism across medical fields along with other areas of competencies were included. A final list of 35 articles were selected for this review. Several assessment tools are available for assessing professionalism that includes, but not limited to, mini clinical evaluation exercise, standardised direct observation of procedural skills, professionalism mini-evaluation exercise, multi-source feedback and 360 degree evaluation, and case based discussions. Because professionalism is a complex construct, it is less likely that a single assessment strategy will adequately measure it. Since every single assessment tool has its own weaknesses, triangulation involving multiple tools can compensate the shortcomings associated with any single approach. Assessment of professionalism necessitates a combination of modalities at individual, interpersonal, societal, and institutional levels and should be accompanied by feedback and motivational reflection that will, in turn, lead to behaviour and identity formation. The assessment of professionalism in medicine should meet the criteria of validity, reliability, feasibility and acceptability. Educators are urged to enhance the depth and quality of assessment instruments in the existing medical curricula for ensuring validity and reliability of assessment tools for professionalism. PMID:27437247

Quasi-experimental study designs series-paper 6: risk of bias assessment.

PubMed

Waddington, Hugh; Aloe, Ariel M; Becker, Betsy Jane; Djimeu, Eric W; Hombrados, Jorge Garcia; Tugwell, Peter; Wells, George; Reeves, Barney

2017-09-01

Rigorous and transparent bias assessment is a core component of high-quality systematic reviews. We assess modifications to existing risk of bias approaches to incorporate rigorous quasi-experimental approaches with selection on unobservables. These are nonrandomized studies using design-based approaches to control for unobservable sources of confounding such as difference studies, instrumental variables, interrupted time series, natural experiments, and regression-discontinuity designs. We review existing risk of bias tools. Drawing on these tools, we present domains of bias and suggest directions for evaluation questions. The review suggests that existing risk of bias tools provide, to different degrees, incomplete transparent criteria to assess the validity of these designs. The paper then presents an approach to evaluating the internal validity of quasi-experiments with selection on unobservables. We conclude that tools for nonrandomized studies of interventions need to be further developed to incorporate evaluation questions for quasi-experiments with selection on unobservables. Copyright © 2017 Elsevier Inc. All rights reserved.

Comparison between two statistically based methods, and two physically based models developed to compute daily mean streamflow at ungaged locations in the Cedar River Basin, Iowa

USGS Publications Warehouse

Linhart, S. Mike; Nania, Jon F.; Christiansen, Daniel E.; Hutchinson, Kasey J.; Sanders, Curtis L.; Archfield, Stacey A.

2013-01-01

A variety of individuals from water resource managers to recreational users need streamflow information for planning and decisionmaking at locations where there are no streamgages. To address this problem, two statistically based methods, the Flow Duration Curve Transfer method and the Flow Anywhere method, were developed for statewide application and the two physically based models, the Precipitation Runoff Modeling-System and the Soil and Water Assessment Tool, were only developed for application for the Cedar River Basin. Observed and estimated streamflows for the two methods and models were compared for goodness of fit at 13 streamgages modeled in the Cedar River Basin by using the Nash-Sutcliffe and the percent-bias efficiency values. Based on median and mean Nash-Sutcliffe values for the 13 streamgages the Precipitation Runoff Modeling-System and Soil and Water Assessment Tool models appear to have performed similarly and better than Flow Duration Curve Transfer and Flow Anywhere methods. Based on median and mean percent bias values, the Soil and Water Assessment Tool model appears to have generally overestimated daily mean streamflows, whereas the Precipitation Runoff Modeling-System model and statistical methods appear to have underestimated daily mean streamflows. The Flow Duration Curve Transfer method produced the lowest median and mean percent bias values and appears to perform better than the other models.

Comparison of a Web-Based Teaching Tool and Traditional Didactic Learning for In Vitro Fertilization Patients: A Preliminary Randomized Controlled Trial.

PubMed

Vause, Tannys Dawn Reiko; Allison, David J; Vause, Tricia; Tekok-Kilic, Ayda; Ditor, David S; Min, Jason K

2018-05-01

The objective of this prospective RCT was to compare the efficacy of a web-based teaching tool to traditional didactic teaching in IVF patients. Forty women undergoing their first IVF cycle were randomly allocated to an interactive web-based teaching session or a nurse-led didactic teaching session. The primary outcome measure was participant knowledge regarding the IVF process, risks, and logistics assessed before and after the respective teaching session. Secondary outcomes included patient stress, assessed before and after the respective teaching session, and patient satisfaction, assessed following the respective teaching session and on the day of embryo transfer (following implementation of the teaching protocol). Both groups demonstrated similar and significant improvements in knowledge and stress after exposure to their respective teaching sessions. The web-based group was significantly more satisfied than the didactic teaching group. Web-based teaching was also shown to be equally effective for participants of high versus low income and education status for knowledge, stress, and satisfaction. This study provides preliminary support for the use of web-based teaching as an equally effective tool for increasing knowledge and reducing stress compared to traditional didactic teaching in IVF patients, with the added benefit of increased patient satisfaction. Copyright © 2018 Society of Obstetricians and Gynaecologists of Canada. Published by Elsevier Inc. All rights reserved.

Evaluating online diagnostic decision support tools for the clinical setting.

PubMed

Pryor, Marie; White, David; Potter, Bronwyn; Traill, Roger

2012-01-01

Clinical decision support tools available at the point of care are an effective adjunct to support clinicians to make clinical decisions and improve patient outcomes. We developed a methodology and applied it to evaluate commercially available online clinical diagnostic decision support (DDS) tools for use at the point of care. We identified 11 commercially available DDS tools and assessed these against an evaluation instrument that included 6 categories; general information, content, quality control, search, clinical results and other features. We developed diagnostically challenging clinical case scenarios based on real patient experience that were commonly missed by junior medical staff. The evaluation was divided into 2 phases; an initial evaluation of all identified and accessible DDS tools conducted by the Clinical Information Access Portal (CIAP) team and a second phase that further assessed the top 3 tools identified in the initial evaluation phase. An evaluation panel consisting of senior and junior medical clinicians from NSW Health conducted the second phase. Of the eleven tools that were assessed against the evaluation instrument only 4 tools completely met the DDS definition that was adopted for this evaluation and were able to produce a differential diagnosis. From the initial phase of the evaluation 4 DDS tools scored 70% or more (maximum score 96%) for the content category, 8 tools scored 65% or more (maximum 100%) for the quality control category, 5 tools scored 65% or more (maximum 94%) for the search category, and 4 tools score 70% or more (maximum 81%) for the clinical results category. The second phase of the evaluation was focused on assessing diagnostic accuracy for the top 3 tools identified in the initial phase. Best Practice ranked highest overall against the 6 clinical case scenarios used. Overall the differentiating factor between the top 3 DDS tools was determined by diagnostic accuracy ranking, ease of use and the confidence and credibility of the clinical information. The evaluation methodology used here to assess the quality and comprehensiveness of clinical DDS tools was effective in identifying the most appropriate tool for the clinical setting. The use of clinical case scenarios is fundamental in determining the diagnostic accuracy and usability of the tools.

Early Grade Writing Assessment: An Instrument Model

ERIC Educational Resources Information Center

Jiménez, Juan E.

2017-01-01

The United Nations Educational, Scientific, and Cultural Organization promoted the creation of a model instrument for individual assessment of students' foundational writing skills in the Spanish language that was based on a literature review and existing writing tools and assessments. The purpose of the "Early Grade Writing Assessment"…

User Perceptions and Reactions to an Online Cancer Risk Assessment Tool: a Process Evaluation of Cancer Risk Check.

PubMed

Hovick, Shelly R; Bevers, Therese B; Vidrine, Jennifer Irvin; Kim, Stephanie; Dailey, Phokeng M; Jones, Lovell A; Peterson, Susan K

2017-03-01

Online cancer risk assessment tools, which provide personalized cancer information and recommendations based on personal data input by users, are a promising cancer education approach; however, few tools have been evaluated. A randomized controlled study was conducted to compare user impressions of one tool, Cancer Risk Check (CRC), to non-personalized educational information delivered online as series of self-advancing slides (the control). CRC users (N = 1452) rated the tool to be as interesting as the control (p > .05), but users were more likely to report that the information was difficult to understand and not applicable to them (p < .05). Information seeking and sharing also were lower among CRC users; thus, although impressions of CRC were favorable, it was not shown to be superior to existing approaches. We hypothesized CRC was less effective because it contained few visual and graphical elements; therefore, CRC was compared to a text-based control (online PDF file) post hoc. CRC users rated the information to be more interesting, less difficult to understand, and better able to hold their attention (p < .05). Post hoc results suggest the visual presentation of risk is critical to tool success.

A decision framework for identifying models to estimate forest ecosystem services gains from restoration

USGS Publications Warehouse

Christin, Zachary; Bagstad, Kenneth J.; Verdone, Michael

2016-01-01

Restoring degraded forests and agricultural lands has become a global conservation priority. A growing number of tools can quantify ecosystem service tradeoffs associated with forest restoration. This evolving “tools landscape” presents a dilemma: more tools are available, but selecting appropriate tools has become more challenging. We present a Restoration Ecosystem Service Tool Selector (RESTS) framework that describes key characteristics of 13 ecosystem service assessment tools. Analysts enter information about their decision context, services to be analyzed, and desired outputs. Tools are filtered and presented based on five evaluative criteria: scalability, cost, time requirements, handling of uncertainty, and applicability to benefit-cost analysis. RESTS uses a spreadsheet interface but a web-based interface is planned. Given the rapid evolution of ecosystem services science, RESTS provides an adaptable framework to guide forest restoration decision makers toward tools that can help quantify ecosystem services in support of restoration.

Safety analysis of interchanges

DOT National Transportation Integrated Search

2007-06-01

The objectives of this research are to synthesize the current state of knowledge concerning the safety assessment of new or modified interchanges; develop a spreadsheet-based computational tool for performing safety assessments of interchanges; and i...

Adaptation of the animal welfare assessment grid (AWAG) for monitoring animal welfare in zoological collections.

PubMed

Justice, W S M; O'Brien, M F; Szyszka, O; Shotton, J; Gilmour, J E M; Riordan, P; Wolfensohn, S

2017-08-05

Animal welfare monitoring is an essential part of zoo management and a legal requirement in many countries. Historically, a variety of welfare audits have been proposed to assist zoo managers. Unfortunately, there are a number of issues with these assessments, including lack of species information, validated tests and the overall complexity of these audits which make them difficult to implement in practice. The animal welfare assessment grid (AWAG) has previously been proposed as an animal welfare monitoring tool for animals used in research programmes. This computer-based system was successfully adapted for use in a zoo setting with two taxonomic groups: primates and birds. This tool is simple to use and provides continuous monitoring based on cumulative lifetime assessment. It is suggested as an alternative, practical method for welfare monitoring in zoos. British Veterinary Association.

Impact of workplace based assessment on doctors' education and performance: a systematic review.

PubMed

Miller, Alice; Archer, Julian

2010-09-24

To investigate the literature for evidence that workplace based assessment affects doctors' education and performance. Systematic review. The primary data sources were the databases Journals@Ovid, Medline, Embase, CINAHL, PsycINFO, and ERIC. Evidence based reviews (Bandolier, Cochrane Library, DARE, HTA Database, and NHS EED) were accessed and searched via the Health Information Resources website. Reference lists of relevant studies and bibliographies of review articles were also searched. Review methods Studies of any design that attempted to evaluate either the educational impact of workplace based assessment, or the effect of workplace based assessment on doctors' performance, were included. Studies were excluded if the sampled population was non-medical or the study was performed with medical students. Review articles, commentaries, and letters were also excluded. The final exclusion criterion was the use of simulated patients or models rather than real life clinical encounters. Sixteen studies were included. Fifteen of these were non-comparative descriptive or observational studies; the other was a randomised controlled trial. Study quality was mixed. Eight studies examined multisource feedback with mixed results; most doctors felt that multisource feedback had educational value, although the evidence for practice change was conflicting. Some junior doctors and surgeons displayed little willingness to change in response to multisource feedback, whereas family physicians might be more prepared to initiate change. Performance changes were more likely to occur when feedback was credible and accurate or when coaching was provided to help subjects identify their strengths and weaknesses. Four studies examined the mini-clinical evaluation exercise, one looked at direct observation of procedural skills, and three were concerned with multiple assessment methods: all these studies reported positive results for the educational impact of workplace based assessment tools. However, there was no objective evidence of improved performance with these tools. Considering the emphasis placed on workplace based assessment as a method of formative performance assessment, there are few published articles exploring its impact on doctors' education and performance. This review shows that multisource feedback can lead to performance improvement, although individual factors, the context of the feedback, and the presence of facilitation have a profound effect on the response. There is no evidence that alternative workplace based assessment tools (mini-clinical evaluation exercise, direct observation of procedural skills, and case based discussion) lead to improvement in performance, although subjective reports on their educational impact are positive.

Floristic Quality Assessment Across the Nation: Status, Opportunities, and Challenges

EPA Science Inventory

Floristic Quality Assessment (FQA) will be considered in the USEPA National Wetland Condition Assessment (NWCA). FQA is a powerful tool to describe wetland ecological condition, and is based on Coefficients of Conservatism (CC) of individual native plant species. CCs rank sensiti...

AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT: A GIS-BASED HYDROLOGIC MODELING TOOL

EPA Science Inventory

Planning and assessment in land and water resource management are evolving toward complex, spatially explicit regional assessments. These problems have to be addressed with distributed models that can compute runoff and erosion at different spatial and temporal scales. The extens...

Interactive Assessment as a Research Tool.

ERIC Educational Resources Information Center

Haywood, H. Carl; Wingenfeld, Sabine A.

1992-01-01

This paper discusses dynamic/interactive approaches to psychological assessment based on the concept of induced change as a research tactic. Studies are reviewed showing how interactive assessment has yielded new knowledge in psychopathology; neuropsychology; learning disabilities; intelligence testing (in normal, deaf, and immigrant children);…

Assessing Clinical Trial-Associated Workload in Community-Based Research Programs Using the ASCO Clinical Trial Workload Assessment Tool.

PubMed

Good, Marjorie J; Hurley, Patricia; Woo, Kaitlin M; Szczepanek, Connie; Stewart, Teresa; Robert, Nicholas; Lyss, Alan; Gönen, Mithat; Lilenbaum, Rogerio

2016-05-01

Clinical research program managers are regularly faced with the quandary of determining how much of a workload research staff members can manage while they balance clinical practice and still achieve clinical trial accrual goals, maintain data quality and protocol compliance, and stay within budget. A tool was developed to measure clinical trial-associated workload, to apply objective metrics toward documentation of work, and to provide clearer insight to better meet clinical research program challenges and aid in balancing staff workloads. A project was conducted to assess the feasibility and utility of using this tool in diverse research settings. Community-based research programs were recruited to collect and enter clinical trial-associated monthly workload data into a web-based tool for 6 consecutive months. Descriptive statistics were computed for self-reported program characteristics and workload data, including staff acuity scores and number of patient encounters. Fifty-one research programs that represented 30 states participated. Median staff acuity scores were highest for staff with patients enrolled in studies and receiving treatment, relative to staff with patients in follow-up status. Treatment trials typically resulted in higher median staff acuity, relative to cancer control, observational/registry, and prevention trials. Industry trials exhibited higher median staff acuity scores than trials sponsored by the National Institutes of Health/National Cancer Institute, academic institutions, or others. The results from this project demonstrate that trial-specific acuity measurement is a better measure of workload than simply counting the number of patients. The tool was shown to be feasible and useable in diverse community-based research settings. Copyright © 2016 by American Society of Clinical Oncology.

Assessing Clinical Trial–Associated Workload in Community-Based Research Programs Using the ASCO Clinical Trial Workload Assessment Tool

PubMed Central

Hurley, Patricia; Woo, Kaitlin M.; Szczepanek, Connie; Stewart, Teresa; Robert, Nicholas; Lyss, Alan; Gönen, Mithat; Lilenbaum, Rogerio

2016-01-01

Purpose: Clinical research program managers are regularly faced with the quandary of determining how much of a workload research staff members can manage while they balance clinical practice and still achieve clinical trial accrual goals, maintain data quality and protocol compliance, and stay within budget. A tool was developed to measure clinical trial–associated workload, to apply objective metrics toward documentation of work, and to provide clearer insight to better meet clinical research program challenges and aid in balancing staff workloads. A project was conducted to assess the feasibility and utility of using this tool in diverse research settings. Methods: Community-based research programs were recruited to collect and enter clinical trial–associated monthly workload data into a web-based tool for 6 consecutive months. Descriptive statistics were computed for self-reported program characteristics and workload data, including staff acuity scores and number of patient encounters. Results: Fifty-one research programs that represented 30 states participated. Median staff acuity scores were highest for staff with patients enrolled in studies and receiving treatment, relative to staff with patients in follow-up status. Treatment trials typically resulted in higher median staff acuity, relative to cancer control, observational/registry, and prevention trials. Industry trials exhibited higher median staff acuity scores than trials sponsored by the National Institutes of Health/National Cancer Institute, academic institutions, or others. Conclusion: The results from this project demonstrate that trial-specific acuity measurement is a better measure of workload than simply counting the number of patients. The tool was shown to be feasible and useable in diverse community-based research settings. PMID:27006354

A Novel EEG Based Spectral Analysis of Persistent Brain Function Alteration in Athletes with Concussion History.

PubMed

Munia, Tamanna T K; Haider, Ali; Schneider, Charles; Romanick, Mark; Fazel-Rezai, Reza

2017-12-08

The neurocognitive sequelae of a sport-related concussion and its management are poorly defined. Detecting deficits are vital in making a decision about the treatment plan as it can persist one year or more following a brain injury. The reliability of traditional cognitive assessment tools is debatable, and thus attention has turned to assessments based on electroencephalogram (EEG) to evaluate subtle post-concussive alterations. In this study, we calculated neurocognitive deficits combining EEG analysis with three standard post-concussive assessment tools. Data were collected for all testing modalities from 21 adolescent athletes (seven concussive and fourteen healthy) in three different trials. For EEG assessment, along with linear frequency-based features, we introduced a set of time-frequency (Hjorth Parameters) and nonlinear features (approximate entropy and Hurst exponent) for the first time to explore post-concussive deficits. Besides traditional frequency-band analysis, we also presented a new individual frequency-based approach for EEG assessment. While EEG analysis exhibited significant discrepancies between the groups, none of the cognitive assessment resulted in significant deficits. Therefore, the evidence from the study highlights that our proposed EEG analysis and markers are more efficient at deciphering post-concussion residual neurocognitive deficits and thus has a potential clinical utility of proper concussion assessment and management.

Exploring Design Features to Enhance Computer-Based Assessment: Learners' Views on Using a Confidence-Indicator Tool and Computer-Based Feedback

ERIC Educational Resources Information Center

Nix, Ingrid; Wyllie, Ali

2011-01-01

Many institutions encourage formative computer-based assessment (CBA), yet competing priorities mean that learners are necessarily selective about what they engage in. So how can we motivate them to engage? Can we facilitate learners to take more control of shaping their learning experience? To explore this, the Learning with Interactive…

Methodological Quality of Systematic Reviews in Subfertility: A Comparison of Two Different Approaches

PubMed Central

Popovich, Ivor; Windsor, Bethany; Jordan, Vanessa; Showell, Marian; Shea, Bev; Farquhar, Cynthia M.

2012-01-01

Background Systematic reviews are used widely to guide health care decisions. Several tools have been created to assess systematic review quality. The measurement tool for assessing the methodological quality of systematic reviews known as the AMSTAR tool applies a yes/no score to eleven relevant domains of review methodology. This tool has been reworked so that each domain is scored based on a four point scale, producing R-AMSTAR. Methods and Findings We aimed to compare the AMSTAR and R-AMSTAR tools in assessing systematic reviews in the field of assisted reproduction for subfertility. All published systematic reviews on assisted reproductive technology, with the latest search for studies taking place from 2007–2011, were considered. Reviews that contained no included studies or considered diagnostic outcomes were excluded. Thirty each of Cochrane and non-Cochrane reviews were randomly selected from a search of relevant databases. Both tools were then applied to all sixty reviews. The results were converted to percentage scores and all reviews graded and ranked based on this. AMSTAR produced a much wider variation in percentage scores and achieved higher inter-rater reliability than R-AMSTAR according to kappa statistics. The average rating for Cochrane reviews was consistent between the two tools (88.3% for R-AMSTAR versus 83.6% for AMSTAR) but inconsistent for non-Cochrane reviews (63.9% R-AMSTAR vs. 38.5% AMSTAR). In comparing the rankings generated between the two tools Cochrane reviews changed an average of 4.2 places, compared to 2.9 for non-Cochrane. Conclusion R-AMSTAR provided greater guidance in the assessment of domains and produced quantitative results. However, there were many problems with the construction of its criteria and AMSTAR was much easier to apply consistently. We recommend that AMSTAR incorporates the findings of this study and produces additional guidance for its application in order to improve its reliability and usefulness. PMID:23300526

A GIS-based methodology for the estimation of potential volcanic damage and its application to Tenerife Island, Spain

NASA Astrophysics Data System (ADS)

Scaini, C.; Felpeto, A.; Martí, J.; Carniel, R.

2014-05-01

This paper presents a GIS-based methodology to estimate damages produced by volcanic eruptions. The methodology is constituted by four parts: definition and simulation of eruptive scenarios, exposure analysis, vulnerability assessment and estimation of expected damages. Multi-hazard eruptive scenarios are defined for the Teide-Pico Viejo active volcanic complex, and simulated through the VORIS tool. The exposure analysis identifies the elements exposed to the hazard at stake and focuses on the relevant assets for the study area. The vulnerability analysis is based on previous studies on the built environment and complemented with the analysis of transportation and urban infrastructures. Damage assessment is performed associating a qualitative damage rating to each combination of hazard and vulnerability. This operation consists in a GIS-based overlap, performed for each hazardous phenomenon considered and for each element. The methodology is then automated into a GIS-based tool using an ArcGIS® program. Given the eruptive scenarios and the characteristics of the exposed elements, the tool produces expected damage maps. The tool is applied to the Icod Valley (North of Tenerife Island) which is likely to be affected by volcanic phenomena in case of eruption from both the Teide-Pico Viejo volcanic complex and North-West basaltic rift. Results are thematic maps of vulnerability and damage that can be displayed at different levels of detail, depending on the user preferences. The aim of the tool is to facilitate territorial planning and risk management in active volcanic areas.

Comparing the Efficacy of an Engineered-Based System (College Livetext) with an Off-the-Shelf General Tool (Hyperstudio) for Developing Electronic Portfolios in Teacher Education

ERIC Educational Resources Information Center

Johnson-Leslie, Natalie A.

2009-01-01

In teacher education, electronic portfolios provide an authentic form of assessment documenting students' personal and professional growth. Using the engineered-based system, College LiveText, and an off-the-shelf general tool, HyperStudio, pre-service teachers constructed e-portfolios as part of their teacher preparation requirements. This case…

ThinTool: a spreadsheet model to evaluate fuel reduction thinning cost, net energy output, and nutrient impacts

Treesearch

Sang-Kyun Han; Han-Sup Han; William J. Elliot; Edward M. Bilek

2017-01-01

We developed a spreadsheet-based model, named ThinTool, to evaluate the cost of mechanical fuel reduction thinning including biomass removal, to predict net energy output, and to assess nutrient impacts from thinning treatments in northern California and southern Oregon. A combination of literature reviews, field-based studies, and contractor surveys was used to...

Multi-criteria decision analysis of breast cancer control in low- and middle- income countries: development of a rating tool for policy makers.

PubMed

Venhorst, Kristie; Zelle, Sten G; Tromp, Noor; Lauer, Jeremy A

2014-01-01

The objective of this study was to develop a rating tool for policy makers to prioritize breast cancer interventions in low- and middle- income countries (LMICs), based on a simple multi-criteria decision analysis (MCDA) approach. The definition and identification of criteria play a key role in MCDA, and our rating tool could be used as part of a broader priority setting exercise in a local setting. This tool may contribute to a more transparent priority-setting process and fairer decision-making in future breast cancer policy development. First, an expert panel (n = 5) discussed key considerations for tool development. A literature review followed to inventory all relevant criteria and construct an initial set of criteria. A Delphi study was then performed and questionnaires used to discuss a final list of criteria with clear definitions and potential scoring scales. For this Delphi study, multiple breast cancer policy and priority-setting experts from different LMICs were selected and invited by the World Health Organization. Fifteen international experts participated in all three Delphi rounds to assess and evaluate each criterion. This study resulted in a preliminary rating tool for assessing breast cancer interventions in LMICs. The tool consists of 10 carefully crafted criteria (effectiveness, quality of the evidence, magnitude of individual health impact, acceptability, cost-effectiveness, technical complexity, affordability, safety, geographical coverage, and accessibility), with clear definitions and potential scoring scales. This study describes the development of a rating tool to assess breast cancer interventions in LMICs. Our tool can offer supporting knowledge for the use or development of rating tools as part of a broader (MCDA based) priority setting exercise in local settings. Further steps for improving the tool are proposed and should lead to its useful adoption in LMICs.

Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Evidence Tool

PubMed Central

Albert, Dayna; Fortin, Rebecca; Herrera, Christine; Hanning, Rhona; Lessio, Anne; Rush, Brian

2013-01-01

In public health and chronic disease prevention there is increasing priority for effective use of evidence in practice. In Ontario, Canada, despite various models being advanced, public health practitioners are seeking ways to identify and apply evidence in their work in practical and meaningful ways. In a companion article, “Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Assessment Tool,” we describe use of a tool to assess and strengthen program planning and implementation processes using 19 criteria derived from best and promising practices literature. In this article, we describe use of a complementary Program Evidence Tool to identify, synthesize, and apply a range of evidence sources to strengthen the content of chronic disease prevention programming. The Program Evidence Tool adapts tools of evidence-based medicine to the unique contexts of community-based health promotion and chronic disease prevention. Knowledge management tools and a guided dialogue process known as an Evidence Forum enable community stakeholders to make appropriate use of evidence in diverse social, political, and structural contexts. Practical guidelines and worksheets direct users through 5 steps: 1) define an evidence question, 2) develop a search strategy, 3) collect and synthesize evidence, 4) interpret and adapt evidence, and 5) implement and evaluate. We describe the Program Evidence Tool’s benefits, strengths, challenges, and what was learned from its application in 4 Ontario public health departments. The Program Evidence Tool contributes to the development and understanding of the complex use of evidence in community-based chronic disease prevention. PMID:23721788

An Evaluation of the Performance Diagnostic Checklist-Human Services to Assess an Employee Performance Problem in a Center-Based Autism Treatment Facility

ERIC Educational Resources Information Center

Ditzian, Kyle; Wilder, David A.; King, Allison; Tanz, Jeanine

2015-01-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to assess the environmental variables that contribute to poor employee performance in human services settings. We administered the PDC-HS to 3 supervisors to assess the variables that contributed to poor performance by 4 staff members when securing…

Assessing Conceptual Understanding via Literacy-Infused, Inquiry-Based Science among Middle School English Learners and Economically-Challenged Students

ERIC Educational Resources Information Center

Lara-Alecio, Rafael; Irby, Beverly J.; Tong, Fuhui; Guerrero, Cindy; Koch, Janice; Sutton-Jones, Kara L.

2018-01-01

The overarching purpose of our study was to compare performances of treatment and control condition students who completed a literacy-infused, inquiry-based science intervention through sixth grade as measured by a big idea assessment tool which we refer to as the Big Ideas in Science Assessment (BISA). First, we determine the concurrent validity…

Evidence of the Validity of "Teaching Strategies GOLD[R]" Assessment Tool for English Language Learners and Children with Disabilities

ERIC Educational Resources Information Center

Kim, Do-Hong; Lambert, Richard G.; Burts, Diane C.

2013-01-01

Research Findings: This study examined the measurement equivalence of the "Teaching Strategies GOLD[R]" assessment system across subgroups of children based on their primary language and disability status. This study is based on teacher-collected assessment data for 3-, 4-, and 5-year-old children for the fall of 2010, winter of 2010, and spring…

Automated Writing Evaluation for Formative Assessment of Second Language Writing: Investigating the Accuracy and Usefulness of Feedback as Part of Argument-Based Validation

ERIC Educational Resources Information Center

Ranalli, Jim; Link, Stephanie; Chukharev-Hudilainen, Evgeny

2017-01-01

An increasing number of studies on the use of tools for automated writing evaluation (AWE) in writing classrooms suggest growing interest in their potential for formative assessment. As with all assessments, these applications should be validated in terms of their intended interpretations and uses. A recent argument-based validation framework…

Part 2: pressure ulcer assessment: implementation and revision of CALCULATE.

PubMed

Richardson, Annette; Straughan, Christine

2015-11-01

Critically ill patients are a vulnerable group at very high risk of developing pressure ulcers, and the incidence varies within critical care. A number of strategies were used to implement the pressure ulcer assessment tool CALCULATE across four adult critical care units. Strategies included, nursing leadership, the provision of definitions for each risk factor, information laid out on posters at each patient's bedside, changes to pre-printed nursing documentation and a 30-min focused training package. Two local audits were conducted to measure the number and types of risk factors occurring in patients with pressure ulcers, and to assess the frequency of assessments and gain feedback on the usability of the tool in practice. Critical care acquired pressure ulcer incidence was 3.4%. The two most commonly occurring risk factors were impaired circulation (82%) and mechanical ventilation (75%). Patients had a mean score of 4, and 65% had 4 or more reported risk factors. Feedback on the usability of the tool was mainly positive. The tool CALCULATE was relatively straightforward to implement and was likely to be due to the design and the various change strategies used to implement the new approach. The seven point tool was revised to an eight point score based on nurses' clinical feedback. Research is required to further enhance and develop pressure ulcer assessment. Meanwhile CALCULATE offers an easy to use and appropriate tool to assist in the identification of patients at an elevated risk of pressure ulcer damage. Careful choice of change management strategies are needed when implementing a new assessment tool. CALCULATE should be considered for use in critical care for pressure ulcer assessment, but used alongside nurses' clinical judgement and observations of skin. © 2015 British Association of Critical Care Nurses.

Suicide Risk Screening Tools and the Youth Population.

PubMed

Patterson, Sharon

2016-08-01

The use of suicide risk screening tools is a critical component of a comprehensive approach to suicide risk assessment. Since nurses frequently spend more time with patients than any other healthcare professional, they are in key positions to detect and prevent suicidal behavior in youth. To inform nurses about suicide risk screening tools for the youth population. Suicide risk screening tools are research-based standardized instruments that are used to identify people who may be at risk for suicide. A literature search was performed using the Athabasca University Library Resource, the databases of the Cumulative Index to Nursing and Allied Health Literature, ScienceDirect, and Google Scholar. Nurses are cautioned to utilize suicide risk screening tools as only part of the suicide risk assessment in youth populations and avoid the danger of relying on tools that may result in a blind application of evidence to the detriment of clinical experience and judgement. © 2016 Wiley Periodicals, Inc.

The Systems SOAP Note: A Systems Learning Tool.

PubMed

Mitsuishi, Fumi; Young, John Q; Leary, Mark; Dilley, James; Mangurian, Christina

2016-02-01

Systems-based practice (SBP) is the only Accreditation Council for Graduate Medical Education (ACGME) competency concerned with public health and is relatively neglected in residency curricula. A tool was developed and pilot-tested to improve SBP learning on inpatient psychiatry rotations. A four-step approach was used: (1) literature review, (2) expert consultation, (3) tool development, and (4) pilot testing on four cases and evaluation for completion time and preliminary efficacy. Out of 51 SBP articles, six (12%) focused on psychiatric residency programs, and none had a practical SBP learning tool. The "systems SOAP (subjective, objective, assessment, plan) note" (S-SOAP) was structured after a clinical SOAP note and was easy to use (mean completion time = 60 min), and residents self-reported more insight into systems issues. The S-SOAP tool was effectively integrated into clinical experience and provided insight into systemic complexities. Future research should assess SBP knowledge acquisition after the use of such tools.

Impact and Penetration Simulations for Composite Wing-like Structures

NASA Technical Reports Server (NTRS)

Knight, Norman F.

1998-01-01

The goal of this research project was to develop methodologies for the analysis of wing-like structures subjected to impact loadings. Low-speed impact causing either no damage or only minimal damage and high-speed impact causing severe laminate damage and possible penetration of the structure were to be considered during this research effort. To address this goal, an assessment of current analytical tools for impact analysis was performed. Assessment of the analytical tools for impact and penetration simulations with regard to accuracy, modeling, and damage modeling was considered as well as robustness, efficient, and usage in a wing design environment. Following a qualitative assessment, selected quantitative evaluations will be performed using the leading simulation tools. Based on this assessment, future research thrusts for impact and penetration simulation of composite wing-like structures were identified.

Behavioral Health Support of NASA Astronauts for International Space Station Missions

NASA Technical Reports Server (NTRS)

Sipes, Walter

2000-01-01

Two areas of focus for optimizing behavioral health and human performance during International Space Station missions are 1) sleep and circadian assessment and 2) behavioral medicine. The Mir experience provided the opportunity to examine the use and potential effectiveness of tools and procedures to support the behavioral health of the crew. The experience of NASA has shown that on-orbit performance can be better maintained if behavioral health, sleep, and circadian issues are effectively monitored and properly addressed. For example, schedules can be tailored based upon fatigue level of crews and other behavioral and cognitive indicators to maximize performance. Previous research and experience with long duration missions has resulted in the development and upgrade of tools used to monitor fatigue, stress, cognitive function, and behavioral health. Self-assessment and objective tools such as the Spaceflight Cognitive Assessment Tool have been developed and refined to effectively address behavioral medicine countermeasures in space.

Treatment thresholds for osteoporosis and reimbursability criteria: perspectives associated with fracture risk-assessment tools.

PubMed

Adami, Silvano; Bertoldo, Francesco; Gatti, Davide; Minisola, Giovanni; Rossini, Maurizio; Sinigaglia, Luigi; Varenna, Massimo

2013-09-01

The definition of osteoporosis was based for several years on bone mineral density values, which were used by most guidelines for defining treatment thresholds. The availability of tools for the estimation of fracture risk, such as FRAX™ or its adapted Italian version, DeFRA, is providing a way to grade osteoporosis severity. By applying these new tools, the criteria identified in Italy for treatment reimbursability (e.g., "Nota 79") are confirmed as extremely conservative. The new fracture risk-assessment tools provide continuous risk values that can be used by health authorities (or "payers") for identifying treatment thresholds. FRAX estimates the risk for "major osteoporotic fractures," which are not counted in registered fracture trials. Here, we elaborate an algorithm to convert vertebral and nonvertebral fractures to the "major fractures" of FRAX, and this allows a cost-effectiveness assessment for each drug.

The ELPAT living organ donor Psychosocial Assessment Tool (EPAT): from 'what' to 'how' of psychosocial screening - a pilot study.

PubMed

Massey, Emma K; Timmerman, Lotte; Ismail, Sohal Y; Duerinckx, Nathalie; Lopes, Alice; Maple, Hannah; Mega, Inês; Papachristou, Christina; Dobbels, Fabienne

2018-01-01

Thorough psychosocial screening of donor candidates is required in order to minimize potential negative consequences and to strive for optimal safety within living donation programmes. We aimed to develop an evidence-based tool to standardize the psychosocial screening process. Key concepts of psychosocial screening were used to structure our tool: motivation and decision-making, personal resources, psychopathology, social resources, ethical and legal factors and information and risk processing. We (i) discussed how each item per concept could be measured, (ii) reviewed and rated available validated tools, (iii) where necessary developed new items, (iv) assessed content validity and (v) pilot-tested the new items. The resulting ELPAT living organ donor Psychosocial Assessment Tool (EPAT) consists of a selection of validated questionnaires (28 items in total), a semi-structured interview (43 questions) and a Red Flag Checklist. We outline optimal procedures and conditions for implementing this tool. The EPAT and user manual are available from the authors. Use of this tool will standardize the psychosocial screening procedure ensuring that no psychosocial issues are overlooked and ensure that comparable selection criteria are used and facilitate generation of comparable psychosocial data on living donor candidates. © 2017 Steunstichting ESOT.

Teledermatology as an Educational Tool for Teaching Dermatology to Residents and Medical Students

PubMed Central

Boyers, Lindsay N.; Schultz, Amanda; Baceviciene, Rasa; Blaney, Susan; Marvi, Natasha; Dellavalle, Robert P.

2015-01-01

Abstract Although teledermatology (TD) is regarded as a tool to improve patient access to specialty healthcare, little has been done to evaluate its role in medical education. We describe the TD program at the Denver (CO) Department of Veterans Affairs Medical Center and evaluate its use as an educational tool for teaching dermatology to dermatology residents and medical students. Dermatology residents manage TD consultations and review all cases with a faculty preceptor; medical students participate as observers when possible. This study assessed dermatology resident (n=14) and medical student (n=16) perceptions of TD and its usefulness in teaching six core clinical competencies. Both residents (79%) and medical students (88%) “strongly agree” or “agree” that TD is an important educational tool. In general, medical students were slightly more satisfied than residents across all of the core competencies assessed except for patient care. Medical students and residents were most satisfied with the competencies of practice-based learning and improvement and medical knowledge, whereas they were least satisfied with those of interpersonal and communication skills and professionalism. Overall, TD is valued as a teaching tool for dermatology in the areas of patient care, medical knowledge, practice-based learning and improvement, and systems-based practice. PMID:25635528

Measuring laboratory-based influenza surveillance capacity: development of the 'International Influenza Laboratory Capacity Review' Tool.

PubMed

Muir-Paulik, S A; Johnson, L E A; Kennedy, P; Aden, T; Villanueva, J; Reisdorf, E; Humes, R; Moen, A C

2016-01-01

The 2005 International Health Regulations (IHR 2005) emphasized the importance of laboratory capacity to detect emerging diseases including novel influenza viruses. To support IHR 2005 requirements and the need to enhance influenza laboratory surveillance capacity, the Association of Public Health Laboratories (APHL) and the Centers for Disease Control and Prevention (CDC) Influenza Division developed the International Influenza Laboratory Capacity Review (Tool). Data from 37 assessments were reviewed and analyzed to verify that the quantitative analysis results accurately depicted a laboratory's capacity and capabilities. Subject matter experts in influenza and laboratory practice used an iterative approach to develop the Tool incorporating feedback and lessons learnt through piloting and implementation. To systematically analyze assessment data, a quantitative framework for analysis was added to the Tool. The review indicated that changes in scores consistently reflected enhanced or decreased capacity. The review process also validated the utility of adding a quantitative analysis component to the assessments and the benefit of establishing a baseline from which to compare future assessments in a standardized way. Use of the Tool has provided APHL, CDC and each assessed laboratory with a standardized analysis of the laboratory's capacity. The information generated is used to improve laboratory systems for laboratory testing and enhance influenza surveillance globally. We describe the development of the Tool and lessons learnt. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Delirium monitoring and patient outcomes in a general intensive care unit.

PubMed

Andrews, Lois; Silva, Susan G; Kaplan, Susan; Zimbro, Kathie

2015-01-01

Use of an evidence-based tool for routine assessment for delirium by bedside nurses in the intensive care unit is recommended. However, little is known about patient outcomes after implementation of such a tool. To evaluate the implementation and effects of the Confusion Assessment Method for the Intensive Care Unit as a bedside assessment for delirium in a general intensive care unit in a tertiary care hospital. Charts of patients admitted to the unit during a 3-month period before implementation of the assessment tool and 1 year after implementation were reviewed retrospectively. Patient outcomes were incidence of delirium diagnosis, duration of mechanical ventilation, length of stay in the intensive care unit, and time spent in restraints. The 2 groups of patients did not differ in demographics, clinical characteristics, or predisposing factors. The groups also did not differ significantly in delirium diagnosis, duration of mechanical ventilation, length of stay in the intensive care unit, or time spent in restraints. Barriers to use of the tool included nurses' lack of confidence in performing the assessment, concerns about use of the tool in patients receiving mechanical ventilation, and lack of interdisciplinary response to findings obtained with the tool. No change in patient outcomes or diagnosis of delirium occurred 1 year after implementation of the Confusion Assessment Method for the Intensive Care Unit. Lessons learned and barriers to adoption and use, however, were identified. ©2015 American Association of Critical-Care Nurses.

Fracture prediction and calibration of a Canadian FRAX® tool: a population-based report from CaMos

PubMed Central

Fraser, L.-A.; Langsetmo, L.; Berger, C.; Ioannidis, G.; Goltzman, D.; Adachi, J. D.; Papaioannou, A.; Josse, R.; Kovacs, C. S.; Olszynski, W. P.; Towheed, T.; Hanley, D. A.; Kaiser, S. M.; Prior, J.; Jamal, S.; Kreiger, N.; Brown, J. P.; Johansson, H.; Oden, A.; McCloskey, E.; Kanis, J. A.

2016-01-01

Summary A new Canadian WHO fracture risk assessment (FRAX®) tool to predict 10-year fracture probability was compared with observed 10-year fracture outcomes in a large Canadian population-based study (CaMos). The Canadian FRAX tool showed good calibration and discrimination for both hip and major osteoporotic fractures. Introduction The purpose of this study was to validate a new Canadian WHO fracture risk assessment (FRAX®) tool in a prospective, population-based cohort, the Canadian Multi-centre Osteoporosis Study (CaMos). Methods A FRAX tool calibrated to the Canadian population was developed by the WHO Collaborating Centre for Metabolic Bone Diseases using national hip fracture and mortality data. Ten-year FRAX probabilities with and without bone mineral density (BMD) were derived for CaMos women (N=4,778) and men (N=1,919) and compared with observed fracture outcomes to 10 years (Kaplan–Meier method). Cox proportional hazard models were used to investigate the contribution of individual FRAX variables. Results Mean overall 10-year FRAX probability with BMD for major osteoporotic fractures was not significantly different from the observed value in men [predicted 5.4% vs. observed 6.4% (95%CI 5.2–7.5%)] and only slightly lower in women [predicted 10.8% vs. observed 12.0% (95%CI 11.0–12.9%)]. FRAX was well calibrated for hip fracture assessment in women [predicted 2.7% vs. observed 2.7% (95%CI 2.2–3.2%)] but underestimated risk in men [predicted 1.3% vs. observed 2.4% (95%CI 1.7–3.1%)]. FRAX with BMD showed better fracture discrimination than FRAX without BMD or BMD alone. Age, body mass index, prior fragility fracture and femoral neck BMD were significant independent predictors of major osteoporotic fractures; sex, age, prior fragility fracture and femoral neck BMD were significant independent predictors of hip fractures. Conclusion The Canadian FRAX tool provides predictions consistent with observed fracture rates in Canadian women and men, thereby providing a valuable tool for Canadian clinicians assessing patients at risk of fracture. PMID:21161508

Evaluating Standards-Based Assessment Rubrics in a Postgraduate Public Health Subject

ERIC Educational Resources Information Center

Kite, James; Phongsavan, Philayrath

2017-01-01

Standards-based assessment rubrics are recognised as an important tool for ensuring clear criteria in higher education. Most of the available evidence on rubrics comes from studies with face-to-face undergraduate students. Our study evaluated the introduction of rubrics into a postgraduate subject that included both online and face-to-face…

Creating an Outcomes-Based Tool for Learning Barrier Assessment in an Outpatient Education Program.

ERIC Educational Resources Information Center

Hernandez, Teri L.; Rupnow, Jana M.; Currie, Kristi A.; Procious, James K.; Adams, Jenny

2003-01-01

An outcomes-based assessment instrument was devised to screen patients for learning problems that would impede patient education in cardiac rehabilitation. Criteria for seven barriers were established: hearing, language, cultural, religious, vision, cognitive, emotional). Points of data collection and a rationale for collection were identified.…

Defining Strategic and Excellence Bases for the Development of Portuguese Higher Education

ERIC Educational Resources Information Center

Rosa, Maria Joao; Saraiva, Pedro M.; Diz, Henrique

2005-01-01

A self-assessment model was developed for the Portuguese higher education institutions (HEIs) which was based on an empirical study aiming at better understanding their strategic and quality management and innovation practices and tools and on the study of several quality assessment models developed both for HEIs and business organisations. From…

High-Functioning Autism/Asperger Syndrome in Schools: Assessment and Intervention. Practical Intervention in the Schools Series

ERIC Educational Resources Information Center

Sansosti, Frank J.; Powell-Smith, Kelly A.; Cowan, Richard J.

2010-01-01

Meeting a growing need for school-based practitioners, this book provides vital tools for improving the academic, behavioral, and social outcomes of students with high-functioning autism or Asperger syndrome (HFA/AS). Research-based best practices are presented for conducting meaningful assessments; collaborating with teachers, students, and…

Reliability, Compliance, and Security in Web-Based Course Assessments

ERIC Educational Resources Information Center

Bonham, Scott

2008-01-01

Pre- and postcourse assessment has become a very important tool for education research in physics and other areas. The web offers an attractive alternative to in-class paper administration, but concerns about web-based administration include reliability due to changes in medium, student compliance rates, and test security, both question leakage…

Using the Journal Club to teach and assess competence in practice-based learning and improvement: a literature review and recommendation for implementation.

PubMed

Lee, Andrew G; Boldt, H Culver; Golnik, Karl C; Arnold, Anthony C; Oetting, Thomas A; Beaver, Hilary A; Olson, Richard J; Carter, Keith

2005-01-01

The traditional journal club has historically been used to teach residents about critically reading and reviewing the literature in order to improve patient care. The Accreditation Council for Graduate Medical Education competencies mandate requires that ophthalmology residency programs both teach and assess practice-based learning and improvement. A systematically conducted review of the literature regarding the use of the journal club in resident medical education was performed to define specific recommendations for implementation of a journal club tool. Selected best practices for a successful journal club were gleaned from the existing medical literature. These include the following: 1) the use of a structured review checklist, 2) explicit written learning objectives, and 3) a formalized meeting structure and process. The journal club might prove to be an excellent tool for the assessment of competencies like practice-based learning which may be difficult to assess by other means. Future study is necessary to determine if journal club can improve educational outcomes and promote lifelong competence in practice-based learning.

The Tracking Meteogram, an AWIPS II Tool for Time-Series Analysis

NASA Technical Reports Server (NTRS)

Burks, Jason Eric; Sperow, Ken

2015-01-01

A new tool has been developed for the National Weather Service (NWS) Advanced Weather Interactive Processing System (AWIPS) II through collaboration between NASA's Short-term Prediction Research and Transition (SPoRT) and the NWS Meteorological Development Laboratory (MDL). Referred to as the "Tracking Meteogram", the tool aids NWS forecasters in assessing meteorological parameters associated with moving phenomena. The tool aids forecasters in severe weather situations by providing valuable satellite and radar derived trends such as cloud top cooling rates, radial velocity couplets, reflectivity, and information from ground-based lightning networks. The Tracking Meteogram tool also aids in synoptic and mesoscale analysis by tracking parameters such as the deepening of surface low pressure systems, changes in surface or upper air temperature, and other properties. The tool provides a valuable new functionality and demonstrates the flexibility and extensibility of the NWS AWIPS II architecture. In 2014, the operational impact of the tool was formally evaluated through participation in the NOAA/NWS Operations Proving Ground (OPG), a risk reduction activity to assess performance and operational impact of new forecasting concepts, tools, and applications. Performance of the Tracking Meteogram Tool during the OPG assessment confirmed that it will be a valuable asset to the operational forecasters. This presentation reviews development of the Tracking Meteogram tool, performance and feedback acquired during the OPG activity, and future goals for continued support and extension to other application areas.