Assessment of competence in video-assisted thoracoscopic surgery lobectomy: A Danish nationwide study.

PubMed

Petersen, René Horsleben; Gjeraa, Kirsten; Jensen, Katrine; Møller, Lars Borgbjerg; Hansen, Henrik Jessen; Konge, Lars

2018-04-18

Competence in video-assisted thoracoscopic surgery lobectomy has previously been established on the basis of numbers of procedures performed, but this approach does not ensure competence. Specific assessment tools, such as the newly developed video-assisted thoracoscopic surgery lobectomy assessment tool, allow for structured and objective assessment of competence. Our aim was to provide validity evidence for the video-assisted thoracoscopic surgery lobectomy assessment tool. Video recordings of 60 video-assisted thoracoscopic surgery lobectomies performed by 18 thoracic surgeons were rated using the video-assisted thoracoscopic surgery lobectomy assessment tool. All 4 centers of thoracic surgery in Denmark participated in the study. Two video-assisted thoracoscopic surgery experts rated the videos. They were blinded to surgeon and center. The total internal consistency reliability Cronbach's alpha was 0.93. Inter-rater reliability between the 2 raters was Pearson's r = 0.71 (P < .001). The mean video-assisted thoracoscopic surgery lobectomy assessment tool scores for the 10 procedures performed by beginners were 22.1 (standard deviation [SD], 8.6) for the 28 procedures performed by the intermediate surgeons, 31.2 (SD, 4.4), and for the 20 procedures performed by experts 35.9 (SD, 2.9) (P < .001). Bonferroni post hoc tests showed that experts were significantly better than intermediates (P < .008) and beginners (P < .001). Intermediates' mean scores were significantly better than beginners (P < .001). The pass/fail standard calculated using the contrasting group's method was 31 points. One of the beginners passed, and 2 experts failed the test. Validity evidence was provided for a newly developed assessment tool for video-assisted thoracoscopic surgery lobectomy (video-assisted thoracoscopic surgery lobectomy assessment tool) in a clinical setting. The discriminatory ability among expert surgeons, intermediate surgeons, and beginners proved highly significant. The video-assisted thoracoscopic surgery lobectomy assessment tool could be an important aid in the future training and certification of thoracic surgeons. Copyright © 2018 The American Association for Thoracic Surgery. Published by Elsevier Inc. All rights reserved.

Assessing Teachers' Skills in Detecting and Identifying Effective Interactions in the Classroom: Theory and Measurement

ERIC Educational Resources Information Center

Jamil, Faiza M.; Sabol, Terri J.; Hamre, Bridget K.; Pianta, Robert C.

2015-01-01

Contemporary education reforms focus on assessing teachers' performance and developing selection mechanisms for hiring effective teachers. Tools that enable the prediction of teachers' classroom performance promote schools' ability to hire teachers more likely to be successful in the classroom. In addition, these assessment tools can be used for…

Assessment of driving-related skills for older drivers : traffic tech.

DOT National Transportation Integrated Search

2010-04-01

Relating behind-the-wheel driving performance to performance : on office-based screening tools is challenging. It is : important to use tools that are predictive of poor driving : performance (sensitivity), but also to find tools that do not : have h...

Showing Up Is Half the Battle: Assessing Different Contextualized Learning Tools to Increase the Performance in Introductory Computer Science Courses

ERIC Educational Resources Information Center

Rolka, Christine; Remshagen, Anja

2015-01-01

Contextualized learning is considered beneficial for student success. In this article, we assess the impact of context-based learning tools on student grade performance in an introductory computer science course. In particular, we investigate two central questions: (1) does the use context-based learning tools, robots and animations, affect…

Issues in developing valid assessments of speech pathology students' performance in the workplace.

PubMed

McAllister, Sue; Lincoln, Michelle; Ferguson, Alison; McAllister, Lindy

2010-01-01

Workplace-based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be 'the gold standard', but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace-based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. This paper reviews important conceptual issues in the design of valid and reliable workplace-based assessments of competence including assessment content, process, impact on learning, measurement issues, and validation strategies. It then goes on to share what has been learned about quality assessment and validation of a workplace-based performance assessment using competency-based ratings. The outcomes of a four-year national development and validation of an assessment tool are described. A literature review of issues in conceptualizing, designing, and validating workplace-based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling, and data analysis in the validation stages of the development process. This paper provides an accessible overview of factors to consider in the design and validation of workplace-based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS, used in an every speech pathology programme in Australia, New Zealand, and Singapore. The paper also describes Rasch analysis, a model-based statistical approach which is useful for establishing validity and reliability of assessment tools. Through careful attention to conceptual and design issues in the development and trialling of workplace-based assessments, it has been possible to develop the world's first valid and reliable national assessment tool for the assessment of performance in speech pathology.

Reliable and valid assessment of Lichtenstein hernia repair skills.

PubMed

Carlsen, C G; Lindorff-Larsen, K; Funch-Jensen, P; Lund, L; Charles, P; Konge, L

2014-08-01

Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. The internal consistency of the items was high (Cronbach's alpha = 0.97). The inter-rater reliability was very good with an intra-class correlation coefficient (ICC) = 0.93. Generalizability analysis showed a coefficient above 0.8 even with one rater. The coefficient improved to 0.92 if three raters were used. One-way analysis of variance found a significant difference between the three groups which indicates construct validity, p < 0.001. Lichtenstein hernia repair skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment of trainees performing Lichtenstein hernia repair to ensure that the objectives of competency-based surgical training are met.

Performance Contracting as a Performance Management Tool in the Public Sector in Kenya: Lessons of learning

ERIC Educational Resources Information Center

Hope, Kempe Ronald, Sr.

2013-01-01

The purpose of this article is to provide an assessment and analysis of public sector performance contracting as a performance management tool in Kenya. It aims to demonstrate that performance contracting remains a viable and important tool for improving public sector performance as a key element of the on-going public sector transformation…

Integrated performance and reliability specification for digital avionics systems

NASA Technical Reports Server (NTRS)

Brehm, Eric W.; Goettge, Robert T.

1995-01-01

This paper describes an automated tool for performance and reliability assessment of digital avionics systems, called the Automated Design Tool Set (ADTS). ADTS is based on an integrated approach to design assessment that unifies traditional performance and reliability views of system designs, and that addresses interdependencies between performance and reliability behavior via exchange of parameters and result between mathematical models of each type. A multi-layer tool set architecture has been developed for ADTS that separates the concerns of system specification, model generation, and model solution. Performance and reliability models are generated automatically as a function of candidate system designs, and model results are expressed within the system specification. The layered approach helps deal with the inherent complexity of the design assessment process, and preserves long-term flexibility to accommodate a wide range of models and solution techniques within the tool set structure. ADTS research and development to date has focused on development of a language for specification of system designs as a basis for performance and reliability evaluation. A model generation and solution framework has also been developed for ADTS, that will ultimately encompass an integrated set of analytic and simulated based techniques for performance, reliability, and combined design assessment.

The SAFE-T assessment tool: derivation and validation of a web-based application for point-of-care evaluation of gastroenterology fellow performance in colonoscopy.

PubMed

Kumar, Navin L; Kugener, Guillaume; Perencevich, Molly L; Saltzman, John R

2018-01-01

Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise assessment tool to evaluate real-time fellow performance in colonoscopy administered via a web-based application. The Skill Assessment in Fellow Endoscopy Training (SAFE-T) tool was derived as a novel 5-question evaluation tool that captures both summative and formative feedback adapted into a web-based application. A prospective study of 15 gastroenterology fellows (5 fellows each from years 1 to 3 of training) was performed using the SAFE-T tool. An independent reviewer evaluated a subset of these procedures and completed the SAFE-T tool and Mayo Colonoscopy Skills Assessment Tool (MCSAT) for reliability testing. Twenty-six faculty completed 350 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score (year 1, 2.00; year 2, 3.84; year 3, 4.28) differentiated each sequential fellow year of training (P < .0001). The mean SAFE-T overall score decreased with increasing case complexity score, with straightforward cases compared with average cases (4.07 vs 3.50, P < .0001), and average cases compared with challenging cases (3.50 vs 3.08, P = .0134). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a kappa agreement statistic of 0.898 (P < .0001). Correlation of the SAFE-T overall score with the MCSAT overall hands-on and individual motor scores was excellent (each r > 0.90, P < .0001). We developed and validated the SAFE-T assessment tool, a concise and web-based means of assessing real-time gastroenterology fellow performance in colonoscopy. Copyright © 2018 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.

Usability of Operational Performance Support Tools - Findings from Sea Test II

NASA Technical Reports Server (NTRS)

Byrne, Vicky; Litaker, Harry; McGuire, Kerry

2014-01-01

Sea Test II, aka NASA Extreme Environment Mission Operations 17(NEEMO 17) took place in the Florida Aquarius undersea habitat. This confined underwater environment provides a excellent analog for space habitation providing similarities to space habitation such as hostile environment, difficult logistics, autonomous operations, and remote communications. This study collected subjective feedback on the usability of two performance support tools during the Sea Test II mission, Sept 10-14, 2013; Google Glass and iPAD. The two main objectives: - Assess the overall functionality and usability of each performance support tool in a mission analog environment. - Assess the advantages and disadvantages of each tool when performing operational procedures and Just-In-Time-Training (JITT).

Validation of an explanatory tool for data-fused displays for high-technology future aircraft

NASA Astrophysics Data System (ADS)

Fletcher, Georgina C. L.; Shanks, Craig R.; Selcon, Stephen J.

1996-05-01

As the number of sensor and data sources in the military cockpit increases, pilots will suffer high levels of workload which could result in reduced performance and the loss of situational awareness. A DRA research program has been investigating the use of data-fused displays in decision support and has developed and laboratory-tested an explanatory tool for displaying information in air combat scenarios. The tool has been designed to provide pictorial explanations of data that maintain situational awareness by involving the pilot in the hostile aircraft threat assessment task. This paper reports a study carried out to validate the success of the explanatory tool in a realistic flight simulation facility. Aircrew were asked to perform a threat assessment task, either with or without the explanatory tool providing information in the form of missile launch success zone envelopes, while concurrently flying a waypoint course within set flight parameters. The results showed that there was a significant improvement (p less than 0.01) in threat assessment accuracy of 30% when using the explanatory tool. This threat assessment performance advantage was achieved without a trade-off with flying task performance. Situational awareness measures showed no general differences between the explanatory and control conditions, but significant learning effects suggested that the explanatory tool makes the task initially more intuitive and hence less demanding on the pilots' attentional resources. The paper concludes that DRA's data-fused explanatory tool is successful at improving threat assessment accuracy in a realistic simulated flying environment, and briefly discusses the requirements for further research in the area.

A Prototype Tool to Enable Farmers to Measure and Improve the Welfare Performance of the Farm Animal Enterprise: The Unified Field Index

PubMed Central

Colditz, Ian G.; Ferguson, Drewe M.; Collins, Teresa; Matthews, Lindsay; Hemsworth, Paul H.

2014-01-01

Simple Summary Benchmarking is a tool widely used in agricultural industries that harnesses the experience of farmers to generate knowledge of practices that lead to better on-farm productivity and performance. We propose, by analogy with production performance, a method for measuring the animal welfare performance of an enterprise and describe a tool for farmers to monitor and improve the animal welfare performance of their business. A general framework is outlined for assessing and monitoring risks to animal welfare based on measures of animals, the environment they are kept in and how they are managed. The tool would enable farmers to continually improve animal welfare. Abstract Schemes for the assessment of farm animal welfare and assurance of welfare standards have proliferated in recent years. An acknowledged short-coming has been the lack of impact of these schemes on the welfare standards achieved on farm due in part to sociological factors concerning their implementation. Here we propose the concept of welfare performance based on a broad set of performance attributes of an enterprise and describe a tool based on risk assessment and benchmarking methods for measuring and managing welfare performance. The tool termed the Unified Field Index is presented in a general form comprising three modules addressing animal, resource, and management factors. Domains within these modules accommodate the principle conceptual perspectives for welfare assessment: biological functioning; emotional states; and naturalness. Pan-enterprise analysis in any livestock sector could be used to benchmark welfare performance of individual enterprises and also provide statistics of welfare performance for the livestock sector. An advantage of this concept of welfare performance is its use of continuous scales of measurement rather than traditional pass/fail measures. Through the feedback provided via benchmarking, the tool should help farmers better engage in on-going improvement of farm practices that affect animal welfare. PMID:26480317

Estimating learning outcomes from pre- and posttest student self-assessments: a longitudinal study.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Beißbarth, Tim; Anders, Sven; Pukrop, Tobias; Raupach, Tobias

2013-03-01

Learning outcome is an important measure for overall teaching quality and should be addressed by comprehensive evaluation tools. The authors evaluated the validity of a novel evaluation tool based on student self-assessments, which may help identify specific strengths and weaknesses of a particular course. In 2011, the authors asked 145 fourth-year students at Göttingen Medical School to self-assess their knowledge on 33 specific learning objectives in a pretest and posttest as part of a cardiorespiratory module. The authors compared performance gain calculated from self-assessments with performance gain derived from formative examinations that were closely matched to these 33 learning objectives. Eighty-three students (57.2%) completed the assessment. There was good agreement between performance gain derived from subjective data and performance gain derived from objective examinations (Pearson r=0.78; P<.0001) on the group level. The association between the two measures was much weaker when data were analyzed on the individual level. Further analysis determined a quality cutoff for performance gain derived from aggregated student self-assessments. When using this cutoff, the evaluation tool was highly sensitive in identifying specific learning objectives with favorable or suboptimal objective performance gains. The tool is easy to implement, takes initial performance levels into account, and does not require extensive pre-post testing. By providing valid estimates of actual performance gain obtained during a teaching module, it may assist medical teachers in identifying strengths and weaknesses of a particular course on the level of specific learning objectives.

Assessing does not mean threatening: the purpose of assessment as a key determinant of girls' and boys' performance in a science class.

PubMed

Souchal, Carine; Toczek, Marie-Christine; Darnon, Céline; Smeding, Annique; Butera, Fabrizio; Martinot, Delphine

2014-03-01

Is it possible to reach performance equality between boys and girls in a science class? Given the stereotypes targeting their groups in scientific domains, diagnostic contexts generally lower girls' performance and non-diagnostic contexts may harm boys' performance. The present study tested the effectiveness of a mastery-oriented assessment, allowing both boys and girls to perform at an optimal level in a science class. Participants were 120 boys and 72 girls (all high-school students). Participants attended a science lesson while expecting a performance-oriented assessment (i.e., an assessment designed to compare and select students), a mastery-oriented assessment (i.e., an assessment designed to help students in their learning), or no assessment of this lesson. In the mastery-oriented assessment condition, both boys and girls performed at a similarly high level, whereas the performance-oriented assessment condition reduced girls' performance and the no-assessment condition reduced boys' performance. One way to increase girls' performance on a science test without harming boys' performance is to present assessment as a tool for improving mastery rather than as a tool for comparing performances. © 2013 The British Psychological Society.

Technical skills assessment toolbox: a review using the unitary framework of validity.

PubMed

Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

2015-02-01

The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

Personnel Performance Assessment in Information Systems Outsourcing Environments

ERIC Educational Resources Information Center

Casado-Lumbreras, Cristina; Soto-Acosta, Pedro; Colomo-Palacios, Ricardo; de Pablos, Patricia Ordonez

2011-01-01

Purpose: The aim of this paper is to present a tool which uses semantic technologies for personnel performance and workplace learning assessment in outsourced information technology environments. Design/methodology/approach: The paper presents the tool from a technical perspective and introduces a use case that depicts the main features related to…

Window Selection Tool | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Helping coaches apply the principles of representative learning design: validation of a tennis specific practice assessment tool.

PubMed

Krause, Lyndon; Farrow, Damian; Reid, Machar; Buszard, Tim; Pinder, Ross

2018-06-01

Representative Learning Design (RLD) is a framework for assessing the degree to which experimental or practice tasks simulate key aspects of specific performance environments (i.e. competition). The key premise being that when practice replicates the performance environment, skills are more likely to transfer. In applied situations, however, there is currently no simple or quick method for coaches to assess the key concepts of RLD (e.g. during on-court tasks). The aim of this study was to develop a tool for coaches to efficiently assess practice task design in tennis. A consensus-based tool was developed using a 4-round Delphi process with 10 academic and 13 tennis-coaching experts. Expert consensus was reached for the inclusion of seven items, each consisting of two sub-questions related to (i) the task goal and (ii) the relevance of the task to competition performance. The Representative Practice Assessment Tool (RPAT) is proposed for use in assessing and enhancing practice task designs in tennis to increase the functional coupling between information and movement, and to maximise the potential for skill transfer to competition contexts.

Assess/Mitigate Risk through the Use of Computer-Aided Software Engineering (CASE) Tools

NASA Technical Reports Server (NTRS)

Aguilar, Michael L.

2013-01-01

The NASA Engineering and Safety Center (NESC) was requested to perform an independent assessment of the mitigation of the Constellation Program (CxP) Risk 4421 through the use of computer-aided software engineering (CASE) tools. With the cancellation of the CxP, the assessment goals were modified to capture lessons learned and best practices in the use of CASE tools. The assessment goal was to prepare the next program for the use of these CASE tools. The outcome of the assessment is contained in this document.

Reliability of the ECHOWS Tool for Assessment of Patient Interviewing Skills.

PubMed

Boissonnault, Jill S; Evans, Kerrie; Tuttle, Neil; Hetzel, Scott J; Boissonnault, William G

2016-04-01

History taking is an important component of patient/client management. Assessment of student history-taking competency can be achieved via a standardized tool. The ECHOWS tool has been shown to be valid with modest intrarater reliability in a previous study but did not demonstrate sufficient power to definitively prove its stability. The purposes of this study were: (1) to assess the reliability of the ECHOWS tool for student assessment of patient interviewing skills and (2) to determine whether the tool discerns between novice and experienced skill levels. A reliability and construct validity assessment was conducted. Three faculty members from the United States and Australia scored videotaped histories from standardized patients taken by students and experienced clinicians from each of these countries. The tapes were scored twice, 3 to 6 weeks apart. Reliability was assessed using interclass correlation coefficients (ICCs) and repeated measures. Analysis of variance models assessed the ability of the tool to discern between novice and experienced skill levels. The ECHOWS tool showed excellent intrarater reliability (ICC [3,1]=.74-.89) and good interrater reliability (ICC [2,1]=.55) as a whole. The summary of performance (S) section showed poor interrater reliability (ICC [2,1]=.27). There was no statistical difference in performance on the tool between novice and experienced clinicians. A possible ceiling effect may occur when standardized patients are not coached to provide complex and obtuse responses to interviewer questions. Variation in familiarity with the ECHOWS tool and in use of the online training may have influenced scoring of the S section. The ECHOWS tool demonstrates excellent intrarater reliability and moderate interrater reliability. Sufficient training with the tool prior to student assessment is recommended. The S section must evolve in order to provide a more discerning measure of interviewing skills. © 2016 American Physical Therapy Association.

Development and validation of the TOCO-TURBT tool: a summative assessment tool that measures surgical competency in transurethral resection of bladder tumour.

PubMed

de Vries, Anna H; Muijtjens, Arno M M; van Genugten, Hilde G J; Hendrikx, Ad J M; Koldewijn, Evert L; Schout, Barbara M A; van der Vleuten, Cees P M; Wagner, Cordula; Tjiam, Irene M; van Merriënboer, Jeroen J G

2018-06-05

The current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT). The 'Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n = 15), procedural (n = 21), and completion (n = 15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory. The majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r > 0.5, p < 0.01). Generalizability-theory analysis showed high reliability (coefficient Phi ≥ 0.8) when using the format of two assessors and two cases. This study provides first evidence that the TOCO-TURBT tool is a feasible, valid and reliable assessment tool for measuring competency in TURBT. The tool has the potential to be used for future certification of competencies for residents and urologists. The methodology of CTA might be valuable in the development of assessment tools in other areas of clinical practice.

Data and Tools | Energy Analysis | NREL

Science.gov Websites

and Tools Energy Analysis Data and Tools NREL develops energy analysis data and tools to assess collections. Data Products Technology and Performance Analysis Tools Energy Systems Analysis Tools Economic and Financial Analysis Tools

EPA EcoBox

EPA Pesticide Factsheets

This tool box of ecological risk assessment (Eco-box) includes over 400+ links to tools, models, and databases found within EPA and our Government partners designed that can aid risk assessors with performing exposure assessments.

Developing an Objective Structured Assessment of Technical Skills for Laparoscopic Suturing and Intracorporeal Knot Tying.

PubMed

Chang, Olivia H; King, Louise P; Modest, Anna M; Hur, Hye-Chun

2016-01-01

To develop a teaching and assessment tool for laparoscopic suturing and intracorporeal knot tying. We designed an Objective Structured Assessment of Technical Skills (OSATS) tool that includes a procedure-specific checklist (PSC) and global rating scale (GRS) to assess laparoscopic suturing and intracorporeal knot-tying performance. Obstetrics and Gynecology residents at our institution were videotaped while performing a laparoscopic suturing and intracorporeal knot-tying task at a surgical simulation workshop. A total of 2 expert reviewers assessed resident performance using the OSATS tool during live performance and 1 month later using the videotaped recordings. OSATS scores were analyzed using the Wilcoxon rank-sum test. Data are presented as median scores (interquartile range [IQR]). Intrarater and interrater reliabilities were assessed using a Spearman correlation and are presented as an r correlation coefficient and p value. An r ≥ 0.8 was considered as a high correlation. After testing, we received feedback from residents and faculty to improve the OSATS tool as part of an iterative design process. In all, 14 of 21 residents (66.7%) completed the study, with 9 junior residents and 5 senior residents. Junior residents had a lower score on the PSC than senior residents did; however, this was not statistically significant (median = 6.0 [IQR: 4.0-10.0] and median = 13.0 [IQR: 10.0-13.0]; p = 0.09). There was excellent intrarater reliability with our OSATS tool (for PSC component, r = 0.88 for Rater 1 and 0.93 for Rater 2, both p < 0.0001; for GRS component, r = 0.85 for Rater 1 and 0.88 for Rater 2, both p ≤ 0.0002). The PSC also has high interrater reliability during live evaluation (r = 0.92; p < 0.0001), and during the videotape scoring with r = 0.77 (p = 0.001). Our OSATS tool may be a useful assessment and teaching tool for laparoscopic suturing and intracorporeal knot-tying skills. Overall, good intrarater reliability was demonstrated, suggesting that this tool may be useful for longitudinal assessment of surgical skills. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Broadening Perspectives on Clinical Performance Assessment: Rethinking the Nature of In-Training Assessment

ERIC Educational Resources Information Center

Govaerts, Marjan J. B.; van der Vleuten, Cees P. M.; Schuwirth, Lambert W. T.; Muijtjens, Arno M. M.

2007-01-01

Context: In-training assessment (ITA), defined as multiple assessments of performance in the setting of day-to-day practice, is an invaluable tool in assessment programmes which aim to assess professional competence in a comprehensive and valid way. Research on clinical performance ratings, however, consistently shows weaknesses concerning…

Performance Standards for Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

The Dutch Health Care Performance Report: seven years of health care performance assessment in the Netherlands.

PubMed

van den Berg, Michael J; Kringos, Dionne S; Marks, Lisanne K; Klazinga, Niek S

2014-01-09

In 2006, the first edition of a monitoring tool for the performance of the Dutch health care system was released: the Dutch Health Care Performance Report (DHCPR). The Netherlands was among the first countries in the world developing such a comprehensive tool for reporting performance on quality, access, and affordability of health care. The tool contains 125 performance indicators; the choice for specific indicators resulted from a dialogue between researchers and policy makers. In the 'policy cycle', the DHCPR can rationally be placed between evaluation (accountability) and agenda-setting (for strategic decision making). In this paper, we reflect on important lessons learned after seven years of health care system performance assessment. These lessons entail the importance of a good conceptual framework for health system performance assessment, the importance of repeated measurement, the strength of combining multiple perspectives (e.g., patient, professional, objective, subjective) on the same issue, the importance of a central role for the patients' perspective in performance assessment, how to deal with the absence of data in relevant domains, the value of international benchmarking and the continuous exchange between researchers and policy makers.

Assessing team performance in the operating room: development and use of a "black-box" recorder and other tools for the intraoperative environment.

PubMed

Guerlain, Stephanie; Adams, Reid B; Turrentine, F Beth; Shin, Thomas; Guo, Hui; Collins, Stephen R; Calland, J Forrest

2005-01-01

The objective of this research was to develop a digital system to archive the complete operative environment along with the assessment tools for analysis of this data, allowing prospective studies of operative performance, intraoperative errors, team performance, and communication. Ability to study this environment will yield new insights, allowing design of systems to avoid preventable errors that contribute to perioperative complications. A multitrack, synchronized, digital audio-visual recording system (RATE tool) was developed to monitor intraoperative performance, including software to synchronize data and allow assignment of independent observational scores. Cases were scored for technical performance, participants' situational awareness (knowledge of critical information), and their comfort and satisfaction with the conduct of the procedure. Laparoscopic cholecystectomy (n = 10) was studied. Technical performance of the RATE tool was excellent. The RATE tool allowed real time, multitrack data collection of all aspects of the operative environment, while permitting digital recording of the objective assessment data in a time synchronized and annotated fashion during the procedure. The mean technical performance score was 73% +/- 28% of maximum (perfect) performance. Situational awareness varied widely among team members, with the attending surgeon typically the only team member having comprehensive knowledge of critical case information. The RATE tool allows prospective analysis of performance measures such as technical judgments, team performance, and communication patterns, offers the opportunity to conduct prospective intraoperative studies of human performance, and allows for postoperative discussion, review, and teaching. This study also suggests that gaps in situational awareness might be an underappreciated source of operative adverse events. Future uses of this system will aid teaching, failure or adverse event analysis, and intervention research.

Assessment Tools for the Evaluation of Risk

EPA Science Inventory

ASTER (Assessment Tools for the Evaluation of Risk) was developed by the U.S. EPA Mid-Continent Ecology Division, Duluth, MN to assist regulators in performing ecological risk assessments. ASTER is an integration of the ECOTOXicology Database (ECOTOX; Behavioral Health Support of NASA Astronauts for International Space Station Missions

NASA Technical Reports Server (NTRS)

Sipes, Walter

2000-01-01

Two areas of focus for optimizing behavioral health and human performance during International Space Station missions are 1) sleep and circadian assessment and 2) behavioral medicine. The Mir experience provided the opportunity to examine the use and potential effectiveness of tools and procedures to support the behavioral health of the crew. The experience of NASA has shown that on-orbit performance can be better maintained if behavioral health, sleep, and circadian issues are effectively monitored and properly addressed. For example, schedules can be tailored based upon fatigue level of crews and other behavioral and cognitive indicators to maximize performance. Previous research and experience with long duration missions has resulted in the development and upgrade of tools used to monitor fatigue, stress, cognitive function, and behavioral health. Self-assessment and objective tools such as the Spaceflight Cognitive Assessment Tool have been developed and refined to effectively address behavioral medicine countermeasures in space.

Team performance in resuscitation teams: Comparison and critique of two recently developed scoring tools☆

PubMed Central

McKay, Anthony; Walker, Susanna T.; Brett, Stephen J.; Vincent, Charles; Sevdalis, Nick

2012-01-01

Background and aim Following high profile errors resulting in patient harm and attracting negative publicity, the healthcare sector has begun to focus on training non-technical teamworking skills as one way of reducing the rate of adverse events. Within the area of resuscitation, two tools have been developed recently aiming to assess these skills – TEAM and OSCAR. The aims of the study reported here were:1.To determine the inter-rater reliability of the tools in assessing performance within the context of resuscitation.2.To correlate scores of the same resuscitation teams episodes using both tools, thereby determining their concurrent validity within the context of resuscitation.3.To carry out a critique of both tools and establish how best each one may be utilised. Methods The study consisted of two phases – reliability assessment; and content comparison, and correlation. Assessments were made by two resuscitation experts, who watched 24 pre-recorded resuscitation simulations, and independently rated team behaviours using both tools. The tools were critically appraised, and correlation between overall score surrogates was assessed. Results Both OSCAR and TEAM achieved high levels of inter-rater reliability (in the form of adequate intra-class coefficients) and minor significant differences between Wilcoxon tests. Comparison of the scores from both tools demonstrated a high degree of correlation (and hence concurrent validity). Finally, critique of each tool highlighted differences in length and complexity. Conclusion Both OSCAR and TEAM can be used to assess resuscitation teams in a simulated environment, with the tools correlating well with one another. We envisage a role for both tools – with TEAM giving a quick, global assessment of the team, but OSCAR enabling more detailed breakdown of the assessment, facilitating feedback, and identifying areas of weakness for future training. PMID:22561464

SmartWay 2.0 Partner Assessment Tools and Data Management System

EPA Science Inventory

A set of calculator tools used by SmartWay partners to assess their envirnomental performance, including calculation of their annual emissions of CO2, NOx, and PM, and a data system to manage the information. Different tools are available for carrier partners in the four main tr...

Warfighter Integrated Physical Ergonomics Tool Development: Needs Analysis and State of the Art Review

DTIC Science & Technology

2011-03-01

Humansystems® Warfighter Integrated Physical Ergonomics Tool Development Page 14 e) Forces: Griffon seat design assessments include questions of vibration...the suitability of alternative designs . Humansystems® Warfighter Integrated Physical Ergonomics Tool Development Page 5 e) Performance Measures...configurations to assess Humansystems® Warfighter Integrated Physical Ergonomics Tool Development Page 8 design and acquisition decisions, and more

Movement skill assessment of typically developing preschool children: a review of seven movement skill assessment tools.

PubMed

Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

2009-06-01

The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child's physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools' usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool's test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool's normative data samples would benefit from frequent movement skill performance follow-up of today's children. MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: Körper-Koordinationtest für Kinder, TGDM: Test of Gross Motor Development, MMT: Maastrichtse Motoriektest, BOTMP: Bruininks-Oseretsky Test of Motor Proficiency. ICC: intraclass correlation coefficient, NR: not reported, GM: gross motor, LV: long version, SV: short version, LF: long form, SF: short form, STV: subtest version, SEMs: standard errors of measurement, TMQ: Total Motor Quotient, TMC: Total Motor Composite, CSSA: Comprehensive Scales of Student Abilities MSEL: Mullen Scales of Early learning: AGS Edition AUC: Areas under curve BC: Battery composite ROC: Receiver operating characteristic.

The Tracking Meteogram, an AWIPS II Tool for Time-Series Analysis

NASA Technical Reports Server (NTRS)

Burks, Jason Eric; Sperow, Ken

2015-01-01

A new tool has been developed for the National Weather Service (NWS) Advanced Weather Interactive Processing System (AWIPS) II through collaboration between NASA's Short-term Prediction Research and Transition (SPoRT) and the NWS Meteorological Development Laboratory (MDL). Referred to as the "Tracking Meteogram", the tool aids NWS forecasters in assessing meteorological parameters associated with moving phenomena. The tool aids forecasters in severe weather situations by providing valuable satellite and radar derived trends such as cloud top cooling rates, radial velocity couplets, reflectivity, and information from ground-based lightning networks. The Tracking Meteogram tool also aids in synoptic and mesoscale analysis by tracking parameters such as the deepening of surface low pressure systems, changes in surface or upper air temperature, and other properties. The tool provides a valuable new functionality and demonstrates the flexibility and extensibility of the NWS AWIPS II architecture. In 2014, the operational impact of the tool was formally evaluated through participation in the NOAA/NWS Operations Proving Ground (OPG), a risk reduction activity to assess performance and operational impact of new forecasting concepts, tools, and applications. Performance of the Tracking Meteogram Tool during the OPG assessment confirmed that it will be a valuable asset to the operational forecasters. This presentation reviews development of the Tracking Meteogram tool, performance and feedback acquired during the OPG activity, and future goals for continued support and extension to other application areas.

User manual and spreadsheet tool for implementing performance planning for rural planning organizations.

DOT National Transportation Integrated Search

2017-03-01

The performance-planning tool developed as part of this project is intended for use with the guidebook for establishing and using rural performance based transportation system assessment, monitoring, planning, and programming to support the rural pla...

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

76 FR 31339 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-31

... extension of the currently approved tool for the collection of ambulatory care clinical performance measure...: Medicare Demonstration Ambulatory Care Quality Measure Performance Assessment Tool (``PAT''); Use: This... based system. This system will also provide a platform for developing tools to collect clinical quality...

A literature review of the cardiovascular risk-assessment tools: applicability among Asian population.

PubMed

Liau, Siow Yen; Mohamed Izham, M I; Hassali, M A; Shafie, A A

2010-01-01

Cardiovascular diseases, the main causes of hospitalisations and death globally, have put an enormous economic burden on the healthcare system. Several risk factors are associated with the occurrence of cardiovascular events. At the heart of efficient prevention of cardiovascular disease is the concept of risk assessment. This paper aims to review the available cardiovascular risk-assessment tools and its applicability in predicting cardiovascular risk among Asian populations. A systematic search was performed using keywords as MeSH and Boolean terms. A total of 25 risk-assessment tools were identified. Of these, only two risk-assessment tools (8%) were derived from an Asian population. These risk-assessment tools differ in various ways, including characteristics of the derivation sample, type of study, time frame of follow-up, end points, statistical analysis and risk factors included. Very few cardiovascular risk-assessment tools were developed in Asian populations. In order to accurately predict the cardiovascular risk of our population, there is a need to develop a risk-assessment tool based on local epidemiological data.

Assessment in Performance-Based Secondary Music Classes

ERIC Educational Resources Information Center

Pellegrino, Kristen; Conway, Colleen M.; Russell, Joshua A.

2015-01-01

After sharing research findings about grading and assessment practices in secondary music ensemble classes, we offer examples of commonly used assessment tools (ratings scale, checklist, rubric) for the performance ensemble. Then, we explore the various purposes of assessment in performance-based music courses: (1) to meet state, national, and…

Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

PubMed

Cagiltay, Nergiz Ercil; Ozcelik, Erol; Sengul, Gokhan; Berker, Mustafa

2017-11-01

In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is critical for better designing and developing skill assessment surgical simulation tools.

Validation of the tool assessment of clinical education (AssCE): A study using Delphi method and clinical experts.

PubMed

Löfmark, Anna; Mårtensson, Gunilla

2017-03-01

The aim of the present study was to establish the validity of the tool Assessment of Clinical Education (AssCE). The tool is widely used in Sweden and some Nordic countries for assessing nursing students' performance in clinical education. It is important that the tools in use be subjected to regular audit and critical reviews. The validation process, performed in two stages, was concluded with a high level of congruence. In the first stage, Delphi technique was used to elaborate the AssCE tool using a group of 35 clinical nurse lecturers. After three rounds, we reached consensus. In the second stage, a group of 46 clinical nurse lecturers representing 12 universities in Sweden and Norway audited the revised version of the AssCE in relation to learning outcomes from the last clinical course at their respective institutions. Validation of the revised AssCE was established with high congruence between the factors in the AssCE and examined learning outcomes. The revised AssCE tool seems to meet its objective to be a validated assessment tool for use in clinical nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Automated classification of focal breast lesions according to S-detect: validation and role as a clinical and teaching tool.

PubMed

Di Segni, Mattia; de Soccio, Valeria; Cantisani, Vito; Bonito, Giacomo; Rubini, Antonello; Di Segni, Gabriele; Lamorte, Sveva; Magri, Valentina; De Vito, Corrado; Migliara, Giuseppe; Bartolotta, Tommaso Vincenzo; Metere, Alessio; Giacomelli, Laura; de Felice, Carlo; D'Ambrosio, Ferdinando

2018-06-01

To assess the diagnostic performance and the potential as a teaching tool of S-detect in the assessment of focal breast lesions. 61 patients (age 21-84 years) with benign breast lesions in follow-up or candidate to pathological sampling or with suspicious lesions candidate to biopsy were enrolled. The study was based on a prospective and on a retrospective phase. In the prospective phase, after completion of baseline US by an experienced breast radiologist and S-detect assessment, 5 operators with different experience and dedication to breast radiology performed elastographic exams. In the retrospective phase, the 5 operators performed a retrospective assessment and categorized lesions with BI-RADS 2013 lexicon. Integration of S-detect to in-training operators evaluations was performed by giving priority to S-detect analysis in case of disagreement. 2 × 2 contingency tables and ROC analysis were used to assess the diagnostic performances; inter-rater agreement was measured with Cohen's k; Bonferroni's test was used to compare performances. A significance threshold of p = 0.05 was adopted. All operators showed sensitivity > 90% and varying specificity (50-75%); S-detect showed sensitivity > 90 and 70.8% specificity, with inter-rater agreement ranging from moderate to good. Lower specificities were improved by the addition of S-detect. The addition of elastography did not lead to any improvement of the diagnostic performance. S-detect is a feasible tool for the characterization of breast lesions; it has a potential as a teaching tool for the less experienced operators.

Innovative Approaches to Assessment of Results of Higher School Students Training

ERIC Educational Resources Information Center

Vaganova, Olga I.; Medvedeva, Tatiana Yu.; Kirdyanova, Elena R.; Kazantseva, Galina A.; Karpukova, Albina A.

2016-01-01

The basis of assessment tools selection for performance of control and evaluation of training results subject to requirements of modular-competence approach has been disclosed. The experience in implementation of assessment tools during "General and professional pedagogy" course has been observed. The objective of the study is rationale…

Development of RAD-Score: A Tool to Assess the Procedural Competence of Diagnostic Radiology Residents.

PubMed

Isupov, Inga; McInnes, Matthew D F; Hamstra, Stan J; Doherty, Geoffrey; Gupta, Ashish; Peddle, Susan; Jibri, Zaid; Rakhra, Kawan; Hibbert, Rebecca M

2017-04-01

The purpose of this study is to develop a tool to assess the procedural competence of radiology trainees, with sources of evidence gathered from five categories to support the construct validity of tool: content, response process, internal structure, relations to other variables, and consequences. A pilot form for assessing procedural competence among radiology residents, known as the RAD-Score tool, was developed by evaluating published literature and using a modified Delphi procedure involving a group of local content experts. The pilot version of the tool was tested by seven radiology department faculty members who evaluated procedures performed by 25 residents at one institution between October 2014 and June 2015. Residents were evaluated while performing multiple procedures in both clinical and simulation settings. The main outcome measure was the percentage of residents who were considered ready to perform procedures independently, with testing conducted to determine differences between levels of training. A total of 105 forms (for 52 procedures performed in a clinical setting and 53 procedures performed in a simulation setting) were collected for a variety of procedures (eight vascular or interventional, 42 body, 12 musculoskeletal, 23 chest, and 20 breast procedures). A statistically significant difference was noted in the percentage of trainees who were rated as being ready to perform a procedure independently (in postgraduate year [PGY] 2, 12% of residents; in PGY3, 61%; in PGY4, 85%; and in PGY5, 88%; p < 0.05); this difference persisted in the clinical and simulation settings. User feedback and psychometric analysis were used to create a final version of the form. This prospective study describes the successful development of a tool for assessing the procedural competence of radiology trainees with high levels of construct validity in multiple domains. Implementation of the tool in the radiology residency curriculum is planned and can play an instrumental role in the transition to competency-based radiology training.

A quality assessment tool for markup-based clinical guidelines.

PubMed

Shalom, Erez; Shahar, Yuval; Taieb-Maimon, Meirav; Lunenfeld, Eitan

2008-11-06

We introduce a tool for quality assessment of procedural and declarative knowledge. We developed this tool for evaluating the specification of mark-up-based clinical GLs. Using this graphical tool, the expert physician and knowledge engineer collaborate to perform scoring, using pre-defined scoring scale, each of the knowledge roles of the mark-ups, comparing it to a gold standard. The tool enables scoring the mark-ups simultaneously at different sites by different users at different locations.

Accuracy of Nutritional Screening Tools in Assessing the Risk of Undernutrition in Hospitalized Children.

PubMed

Huysentruyt, Koen; Devreker, Thierry; Dejonckheere, Joachim; De Schepper, Jean; Vandenplas, Yvan; Cools, Filip

2015-08-01

The aim of the present study was to evaluate the predictive accuracy of screening tools for assessing nutritional risk in hospitalized children in developed countries. The study involved a systematic review of literature (MEDLINE, EMBASE, and Cochrane Central databases up to January 17, 2014) of studies on the diagnostic performance of pediatric nutritional screening tools. Methodological quality was assessed using a modified QUADAS tool. Sensitivity and specificity were calculated for each screening tool per validation method. A meta-analysis was performed to estimate the risk ratio of different screening result categories of being truly at nutritional risk. A total of 11 studies were included on ≥1 of the following screening tools: Pediatric Nutritional Risk Score, Screening Tool for the Assessment of Malnutrition in Paediatrics, Paediatric Yorkhill Malnutrition Score, and Screening Tool for Risk on Nutritional Status and Growth. Because of variation in reference standards, a direct comparison of the predictive accuracy of the screening tools was not possible. A meta-analysis was performed on 1629 children from 7 different studies. The risk ratio of being truly at nutritional risk was 0.349 (95% confidence interval [CI] 0.16-0.78) for children in the low versus moderate screening category and 0.292 (95% CI 0.19-0.44) in the moderate versus high screening category. There is insufficient evidence to choose 1 nutritional screening tool over another based on their predictive accuracy. The estimated risk of being at "true nutritional risk" increases with each category of screening test result. Each screening category should be linked to a specific course of action, although further research is needed.

ESH assessment of advanced lithography materials and processes

NASA Astrophysics Data System (ADS)

Worth, Walter F.; Mallela, Ram

2004-05-01

The ESH Technology group at International SEMATECH is conducting environment, safety, and health (ESH) assessments in collaboration with the lithography technologists evaluating the performance of an increasing number of new materials and technologies being considered for advanced lithography such as 157nm photresist and extreme ultraviolet (EUV). By performing data searches for 75 critical data types, emissions characterizations, and industrial hygiene (IH) monitoring during the use of the resist candidates, it has been shown that the best performing resist formulations, so far, appear to be free of potential ESH concerns. The ESH assessment of the EUV lithography tool that is being developed for SEMATECH has identified several features of the tool that are of ESH concern: high energy consumption, poor energy conversion efficiency, tool complexity, potential ergonomic and safety interlock issues, use of high powered laser(s), generation of ionizing radiation (soft X-rays), need for adequate shielding, and characterization of the debris formed by the extreme temperature of the plasma. By bringing these ESH challenges to the attention of the technologists and tool designers, it is hoped that the processes and tools can be made more ESH friendly.

Using the arthroscopic surgery skill evaluation tool as a pass-fail examination.

PubMed

Koehler, Ryan J; Nicandri, Gregg T

2013-12-04

Examination of arthroscopic skill requires evaluation tools that are valid and reliable with clear criteria for passing. The Arthroscopic Surgery Skill Evaluation Tool was developed as a video-based assessment of technical skill with criteria for passing established by a panel of experts. The purpose of this study was to test the validity and reliability of the Arthroscopic Surgery Skill Evaluation Tool as a pass-fail examination of arthroscopic skill. Twenty-eight residents and two sports medicine faculty members were recorded performing diagnostic knee arthroscopy on a left and right cadaveric specimen in our arthroscopic skills laboratory. Procedure videos were evaluated with use of the Arthroscopic Surgery Skill Evaluation Tool by two raters blind to subject identity. Subjects were considered to pass the Arthroscopic Surgery Skill Evaluation Tool when they attained scores of ≥ 3 on all eight assessment domains. The raters agreed on a pass-fail rating for fifty-five of sixty videos rated with an interclass correlation coefficient value of 0.83. Ten of thirty participants were assigned passing scores by both raters for both diagnostic arthroscopies performed in the laboratory. Receiver operating characteristic analysis demonstrated that logging more than eighty arthroscopic cases or performing more than thirty-five arthroscopic knee cases was predictive of attaining a passing Arthroscopic Surgery Skill Evaluation Tool score on both procedures performed in the laboratory. The Arthroscopic Surgery Skill Evaluation Tool is valid and reliable as a pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. This study demonstrates that the Arthroscopic Surgery Skill Evaluation Tool may be a useful tool for pass-fail examination of diagnostic arthroscopy of the knee in the simulation laboratory. Further study is necessary to determine whether the Arthroscopic Surgery Skill Evaluation Tool can be used for the assessment of multiple arthroscopic procedures and whether it can be used to evaluate arthroscopic procedures performed in the operating room.

Assessing resident performance and training of colonoscopy in a general surgery training program.

PubMed

Hope, William W; Hooks, W Borden; Kilbourne, S Nicole; Adams, Ashley; Kotwall, Cyrus A; Clancy, Thomas V

2013-05-01

Recently, the adequacy of endoscopy training in general surgery residency programs has been questioned. Efforts to improve resident endoscopic training and to judge competency are ongoing but not well studied. We assessed resident performance using two assessment tools in colonoscopy in a general surgery residency program. Prospectively collected data were reviewed from consecutive colonoscopies by a single surgeon: September 2008 to June 2011. Colonoscopies performed without residents were excluded. Data included patient demographics, procedural data, and outcomes. Following the colonoscopy, residents were graded by the attending surgeon using up two different assessment tools. Descriptive statistics were calculated and outcomes were compared. Colonoscopies were performed by residents in 100 patients. Average age was 52 (range, 22-79) years. Females made up 66 % of patients, and 63 % were Caucasian. Postgraduate level (PG-Y) 3 level residents performed 72 % of colonoscopies. The average resident participation was 73 % of the procedure. Biopsies were performed in 35 %; adenomatous polyps were found in 17 % and invasive cancer in 1 %. Bowel preparation was deemed good in 76 % of patients. Colonoscopy was completed in 90 % of patients. Reasons for incomplete exam were technical (7 patients), inability to pass a stricture (2 patients), and poor prep (1 patient). For completed full colonoscopies, the average time to reach the cecum was 22 min, and withdrawal time was 13 min. Resident assessments were made in 89 of the colonoscopies using 2 separate assessment tools. There were no mortalities; the morbidity rate was 3 %. Morbidities included a perforation related to a biopsy requiring surgery and partial colectomy, a postpolypectomy bleed requiring repeat colonoscopy with clipping of the bleeding vessel, and a patient with transient bradycardia requiring atropine during the procedure. Using objective assessment tools, overall resident skill and knowledge in performing colonoscopy appears to improve based on increasing PG-Y level, although this was not evident with all categories measured. Methods to assess competency continue to evolve and should be the focus of future research.

Assessing the security vulnerabilities of correctional facilities

NASA Astrophysics Data System (ADS)

Spencer, Debra D.; Morrison, G. Steve

1998-12-01

The National Institute of Justice has tasked their satellite facility at Sandia National Laboratories and their Southeast Regional Technology Center in Charleston, South Carolina to devise new procedures and tools for helping correctional facilities to assess their security vulnerabilities. Thus, a team is visiting selected correctional facilities and performing vulnerability assessments. A vulnerability assessment helps identify the easiest paths for inmate escape, for introduction of contraband such as drugs or weapons, for unexpected intrusion from outside of the facility, and for the perpetration of violent acts on other inmates and correctional employees. In addition, the vulnerability assessment helps to quantify the security risks for the facility. From these assessments will come better procedures for performing vulnerability assessments in general at other correctional facilities, as well as the development of tools to assist with the performance of such vulnerability assessments.

Design Considerations | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Gas Fills | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Understanding Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Books & Publications | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Efficient Windows Collaborative | Home

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Resources | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Provide Views | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Links | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Reducing Condensation | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Reduced Fading | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

EWC Membership | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Visible Transmittance | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

EWC Members | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Financing & Incentives | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

A Direct Assessment of “Obesogenic” Built Environments: Challenges and Recommendations

PubMed Central

Gasevic, Danijela; Vukmirovich, Ina; Yusuf, Salim; Teo, Koon; Chow, Clara; Dagenais, Gilles; Lear, Scott A.

2011-01-01

This paper outlines the challenges faced during direct built environment (BE) assessments of 42 Canadian communities of various income and urbanization levels. In addition, we recommend options for overcoming such challenges during BE community assessments. Direct BE assessments were performed utilizing two distinct audit methods: (1) modified version of Irvine-Minnesota Inventory in which a paper version of an audit tool was used to assess BE features and (2) a Physical Activity and Nutrition Features audit tool, where the presence and positions of all environmental features of interest were recorded using a Global-Positioning-System (GPS) unit. This paper responds to the call for the need of creators and users of environmental audit tools to share experiences regarding the usability of tools for BE assessments. The outlined BE assessment challenges plus recommendations for overcoming them can help improve and refine the existing audit tools and aid researchers in future assessments of the BE. PMID:22174727

Overcoming redundancies in bedside nursing assessments by validating a parsimonious meta-tool: findings from a methodological exercise study.

PubMed

Palese, Alvisa; Marini, Eva; Guarnier, Annamaria; Barelli, Paolo; Zambiasi, Paola; Allegrini, Elisabetta; Bazoli, Letizia; Casson, Paola; Marin, Meri; Padovan, Marisa; Picogna, Michele; Taddia, Patrizia; Chiari, Paolo; Salmaso, Daniele; Marognolli, Oliva; Canzan, Federica; Ambrosi, Elisa; Saiani, Luisa; Grassetti, Luca

2016-10-01

There is growing interest in validating tools aimed at supporting the clinical decision-making process and research. However, an increased bureaucratization of clinical practice and redundancies in the measures collected have been reported by clinicians. Redundancies in clinical assessments affect negatively both patients and nurses. To validate a meta-tool measuring the risks/problems currently estimated by multiple tools used in daily practice. A secondary analysis of a database was performed, using a cross-validation and a longitudinal study designs. In total, 1464 patients admitted to 12 medical units in 2012 were assessed at admission with the Brass, Barthel, Conley and Braden tools. Pertinent outcomes such as the occurrence of post-discharge need for resources and functional decline at discharge, as well as falls and pressure sores, were measured. Explorative factor analysis of each tool, inter-tool correlations and a conceptual evaluation of the redundant/similar items across tools were performed. Therefore, the validation of the meta-tool was performed through explorative factor analysis, confirmatory factor analysis and the structural equation model to establish the ability of the meta-tool to predict the outcomes estimated by the original tools. High correlations between the tools have emerged (from r 0.428 to 0.867) with a common variance from 18.3% to 75.1%. Through a conceptual evaluation and explorative factor analysis, the items were reduced from 42 to 20, and the three factors that emerged were confirmed by confirmatory factor analysis. According to the structural equation model results, two out of three emerged factors predicted the outcomes. From the initial 42 items, the meta-tool is composed of 20 items capable of predicting the outcomes as with the original tools. © 2016 John Wiley & Sons, Ltd.

Objective structured assessment of nontechnical skills: Reliability of a global rating scale for the in-training assessment in the operating room.

PubMed

Dedy, Nicolas J; Szasz, Peter; Louridas, Marisa; Bonrath, Esther M; Husslein, Heinrich; Grantcharov, Teodor P

2015-06-01

Nontechnical skills are critical for patient safety in the operating room (OR). As a result, regulatory bodies for accreditation and certification have mandated the integration of these competencies into postgraduate education. A generally accepted approach to the in-training assessment of nontechnical skills, however, is lacking. The goal of the present study was to develop an evidence-based and reliable tool for the in-training assessment of residents' nontechnical performance in the OR. The Objective Structured Assessment of Nontechnical Skills tool was designed as a 5-point global rating scale with descriptive anchors for each item, based on existing evidence-based frameworks of nontechnical skills, as well as resident training requirements. The tool was piloted on scripted videos and refined in an iterative process. The final version was used to rate residents' performance in recorded OR crisis simulations and during live observations in the OR. A total of 37 simulations and 10 live procedures were rated. Interrater agreement was good for total mean scores, both in simulation and in the real OR, with intraclass correlation coefficients >0.90 in all settings for average and single measures. Internal consistency of the scale was high (Cronbach's alpha = 0.80). The Objective Structured Assessment of Nontechnical Skills global rating scale was developed as an evidence-based tool for the in-training assessment of residents' nontechnical performance in the OR. Unique descriptive anchors allow for a criterion-referenced assessment of performance. Good reliability was demonstrated in different settings, supporting applications in research and education. Copyright © 2015 Elsevier Inc. All rights reserved.

Benefits of Efficient Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Increased Light & View | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Windows for New Construction | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Air Leakage (AL) | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

State Fact Sheets | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Fact Sheets & Publications | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Condensation Resistance (CR) | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Low Conductance Spacers | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Energy & Cost Savings | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

U-Factor (U-value) | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Clinical Parameters and Tools for Home-Based Assessment of Parkinson's Disease: Results from a Delphi study.

PubMed

Ferreira, Joaquim J; Santos, Ana T; Domingos, Josefa; Matthews, Helen; Isaacs, Tom; Duffen, Joy; Al-Jawad, Ahmed; Larsen, Frank; Artur Serrano, J; Weber, Peter; Thoms, Andrea; Sollinger, Stefan; Graessner, Holm; Maetzler, Walter

2015-01-01

Parkinson's disease (PD) is a neurodegenerative disorder with fluctuating symptoms. To aid the development of a system to evaluate people with PD (PwP) at home (SENSE-PARK system) there was a need to define parameters and tools to be applied in the assessment of 6 domains: gait, bradykinesia/hypokinesia, tremor, sleep, balance and cognition. To identify relevant parameters and assessment tools of the 6 domains, from the perspective of PwP, caregivers and movement disorders specialists. A 2-round Delphi study was conducted to select a core of parameters and assessment tools to be applied. This process included PwP, caregivers and movement disorders specialists. Two hundred and thirty-three PwP, caregivers and physicians completed the first round questionnaire, and 50 the second. Results allowed the identification of parameters and assessment tools to be added to the SENSE-PARK system. The most consensual parameters were: Falls and Near Falls; Capability to Perform Activities of Daily Living; Interference with Activities of Daily Living; Capability to Process Tasks; and Capability to Recall and Retrieve Information. The most cited assessment strategies included Walkers; the Evaluation of Performance Doing Fine Motor Movements; Capability to Eat; Assessment of Sleep Quality; Identification of Circumstances and Triggers for Loose of Balance and Memory Assessment. An agreed set of measuring parameters, tests, tools and devices was achieved to be part of a system to evaluate PwP at home. A pattern of different perspectives was identified for each stakeholder.

The Learning Loss Scale as an Assessment Tool: An Empirical Examination of Convergent Validity with Performative Measures

ERIC Educational Resources Information Center

Hooker, John; Denker, Katherine

2014-01-01

Higher education has placed an increasingly greater value on assessment. The Learning Loss Scale may be an appropriate tool to assess learning across disciplines. In this paper, we review the culture of assessment, conceptualizations of cognitive learning, the Learning Loss Scale, and a theoretical explanation, and then we test this measure to…

Establishing pass/fail criteria for bronchoscopy performance.

PubMed

Konge, Lars; Clementsen, Paul; Larsen, Klaus Richter; Arendrup, Henrik; Buchwald, Christian; Ringsted, Charlotte

2012-01-01

Several tools have been created to assess competence in bronchoscopy. However, educational guidelines still use an arbitrary number of performed procedures to decide when basic competency is acquired. The purpose of this study was to define pass/fail scores for two bronchoscopy assessment tools, and investigate how these scores relate to physicians' experience regarding the number of bronchoscopy procedures performed. We studied two assessment tools and used two standard setting methods to create cut scores: the contrasting-groups method and the extended Angoff method. In the first we compared bronchoscopy performance scores of 14 novices with the scores of 14 experienced consultants to find the score that best discriminated between the two groups. In the second we asked an expert group of 7 experienced bronchoscopists to judge how a borderline trainee would perform on each item of the test. Using the contrasting-groups method we found a standard that would fail all novices and pass all consultants. A clear pass related to prior experience of 75 procedures. The consequences of using the extended Angoff method were also acceptable: all trainees who had performed less than 50 bronchoscopies failed the test and all consultants passed. A clear pass related to 80 procedures. Our proposed pass/fail scores for these two methods seem appropriate in terms of consequences. Prior experience with the performance of 75 and 80 bronchoscopies, respectively, seemed to ensure basic competency. In the future objective assessment tools could become an important aid in the certification of physicians performing bronchoscopies. Copyright © 2011 S. Karger AG, Basel.

Mixed Methods Design Study Investigating the Use of a Music Authentic Performance Assessment Tool by High School Band Directors to Measure Student Musical Growth

ERIC Educational Resources Information Center

Beason, Christine F.

2017-01-01

This research project was designed to determine if the Model Cornerstone Assessment for Performance, Proficient level, published by the National Association for Music Education would be an appropriate tool to use to demonstrate student growth as one element of teacher evaluations, specifically the T-TESS. This study focused on four main research…

Relationships between academic performance of medical students and their workplace performance as junior doctors.

PubMed

Carr, Sandra E; Celenza, Antonio; Puddey, Ian B; Lake, Fiona

2014-07-30

Little recent published evidence explores the relationship between academic performance in medical school and performance as a junior doctor. Although many forms of assessment are used to demonstrate a medical student's knowledge or competence, these measures may not reliably predict performance in clinical practice following graduation. This descriptive cohort study explores the relationship between academic performance of medical students and workplace performance as junior doctors, including the influence of age, gender, ethnicity, clinical attachment, assessment type and summary score measures (grade point average) on performance in the workplace as measured by the Junior Doctor Assessment Tool. There were two hundred participants. There were significant correlations between performance as a Junior Doctor (combined overall score) and the grade point average (r = 0.229, P = 0.002), the score from the Year 6 Emergency Medicine attachment (r = 0.361, P < 0.001) and the Written Examination in Year 6 (r = 0.178, P = 0.014). There was no significant effect of any individual method of assessment in medical school, gender or ethnicity on the overall combined score of performance of the junior doctor. Performance on integrated assessments from medical school is correlated to performance as a practicing physician as measured by the Junior Doctor Assessment Tool. These findings support the value of combining undergraduate assessment scores to assess competence and predict future performance.

Cost analysis of objective resident cataract surgery assessments.

PubMed

Nandigam, Kiran; Soh, Jonathan; Gensheimer, William G; Ghazi, Ahmed; Khalifa, Yousuf M

2015-05-01

To compare 8 ophthalmology resident surgical training tools to determine which is most cost effective. University of Rochester Medical Center, Rochester, New York, USA. Retrospective evaluation of technology. A cost-analysis model was created to compile all relevant costs in running each tool in a medium-sized ophthalmology program. Quantitative cost estimates were obtained based on cost of tools, cost of time in evaluations, and supply and maintenance costs. For wet laboratory simulation, Eyesi was the least expensive cataract surgery simulation method; however, it is only capable of evaluating simulated cataract surgery rehearsal and requires supplementation with other evaluative methods for operating room performance and for noncataract wet lab training and evaluation. The most expensive training tool was the Eye Surgical Skills Assessment Test (ESSAT). The 2 most affordable methods for resident evaluation in operating room performance were the Objective Assessment of Skills in Intraocular Surgery (OASIS) and Global Rating Assessment of Skills in Intraocular Surgery (GRASIS). Cost-based analysis of ophthalmology resident surgical training tools are needed so residency programs can implement tools that are valid, reliable, objective, and cost effective. There is no perfect training system at this time. Copyright © 2015 ASCRS and ESCRS. Published by Elsevier Inc. All rights reserved.

Systematic Omics Analysis Review (SOAR) Tool to Support Risk Assessment

PubMed Central

McConnell, Emma R.; Bell, Shannon M.; Cote, Ila; Wang, Rong-Lin; Perkins, Edward J.; Garcia-Reyero, Natàlia; Gong, Ping; Burgoon, Lyle D.

2014-01-01

Environmental health risk assessors are challenged to understand and incorporate new data streams as the field of toxicology continues to adopt new molecular and systems biology technologies. Systematic screening reviews can help risk assessors and assessment teams determine which studies to consider for inclusion in a human health assessment. A tool for systematic reviews should be standardized and transparent in order to consistently determine which studies meet minimum quality criteria prior to performing in-depth analyses of the data. The Systematic Omics Analysis Review (SOAR) tool is focused on assisting risk assessment support teams in performing systematic reviews of transcriptomic studies. SOAR is a spreadsheet tool of 35 objective questions developed by domain experts, focused on transcriptomic microarray studies, and including four main topics: test system, test substance, experimental design, and microarray data. The tool will be used as a guide to identify studies that meet basic published quality criteria, such as those defined by the Minimum Information About a Microarray Experiment standard and the Toxicological Data Reliability Assessment Tool. Seven scientists were recruited to test the tool by using it to independently rate 15 published manuscripts that study chemical exposures with microarrays. Using their feedback, questions were weighted based on importance of the information and a suitability cutoff was set for each of the four topic sections. The final validation resulted in 100% agreement between the users on four separate manuscripts, showing that the SOAR tool may be used to facilitate the standardized and transparent screening of microarray literature for environmental human health risk assessment. PMID:25531884

Process for Upgrading Cognitive Assessment Capabilities Onboard the International Space Station

NASA Technical Reports Server (NTRS)

Picano, J. J.; Seaton, K. A.; Holland, A. W.

2016-01-01

MOTIVATION: Spaceflight poses varied and unique risks to the brain and cognitive functioning including radiation exposure, sleep disturbance, fatigue, fluid shifts (increased intracranial pressure), toxin exposure, elevated carbon dioxide, and traumatic brain injury, among others. These potential threats to cognitive functioning are capable of degrading performance and compromising mission success. Furthermore, the threats may increase in severity, and new types of threats may emerge for longer duration exploration missions. This presentation will describe the process used to identify gaps in our current approach, evaluate best practices in cognitive assessment, and transition new cognitive assessment tools to operational use. OVERVIEW: Risks to brain health and performance posed by spaceflight missions require sensitive tools to assess cognitive functioning of astronauts in flight. The Spaceflight Cognitive Assessment Tool for Windows (WinSCAT) is the automated cognitive assessment tool currently deployed onboard the International Space Station (ISS). WinSCAT provides astronauts and flight surgeons with objective data to monitor neurocognitive functioning. WinSCAT assesses 5 discrete cognitive domains, is sensitive to changes in cognitive functioning, and was designed to be completed in less than 15 minutes. However, WinSCAT does not probe other areas of cognitive functioning that might be important to mission success. Researchers recently have developed batteries that may expand current capabilities, such as increased sensitivity to subtle fluctuations in cognitive functioning. Therefore, we engaged in a systematic process review in order to improve upon our current capabilities and incorporate new advances in cognitive assessment. This process included a literature review on newer measures of neurocognitive assessment, surveys of operational flight surgeons at NASA regarding needs and gaps in our capabilities, and expert panel review of candidate cognitive measures and assessment issues and procedures. SIGNIFICANCE: Our process and the results that flowed from it may be helpful to aeromedical professionals charged with transitioning research findings to operational use. Our specific findings regarding cognitive assessment tools are of significance to professionals who must assess readiness to perform in mission critical situations in environments involving threats to cognition and performance

Selection Process for New Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Design Guidance for New Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Selection Process for Replacement Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Design Guidance for Replacement Windows | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Solar Heat Gain Coefficient (SHGC) | Efficient Windows Collaborative

Science.gov Websites

Foundry Foundry New Construction Windows Window Selection Tool Selection Process Design Guidance Installation Replacement Windows Window Selection Tool Assessing Options Selection Process Design Guidance Installation Understanding Windows Benefits Design Considerations Measuring Performance Performance Standards

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

Proper Exercise and Nutrition kit: use of obesity screening and assessment tools with underserved populations.

PubMed

Kopp, Mary K; Hornberger, Cynthia

2008-02-01

Additional efforts are needed to assist public health, school, and clinic-based pediatric nurses in identifying the prevalence of obesity among Kansas Medicaid-eligible children, 21 years or younger. A Proper Exercise and Nutrition (PEN) tool kit was mailed to 500 public health nurses who performed KAN Be Healthy (KBH) assessments. KBH nurses were provided an expanded training curriculum on growth, nutrition, and obesity along with appropriate screening tools. Nurses were surveyed about their current assessment practices and general knowledge of obese clients. After the PEN tool kit distribution, nurses reported an increased use of screening tools and standardized referral parameters. This program intervention was successful in changing nursing practice, resulting in evidence-based understanding of obesity screening and assessment.

The importance of performance assessment in local government decisions to fund health and human services nonprofit organizations.

PubMed

Vaughan, Shannon K

2010-01-01

In times of fiscal crisis, demand for health and human services increases while revenues shrink, causing funders to focus more intently on identifying the most successful organizations in which to invest scarce resources. This research grew out of interest in enhancing performance assessment of nonprofit organizations expressed by local government managers. A survey of Alliance for Innovation Members explores two primary research questions: 1) what is a successful nonprofit; and 2) what type(s) of performance assessment tools are the most useful. The results strengthen our understanding of what information city and county managers want and why they prefer certain evaluation tools.

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

PubMed

Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

2016-07-01

To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

State-of-the-Art for Hygrothermal Simulation Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boudreaux, Philip R.; New, Joshua Ryan; Shrestha, Som S.

2017-02-01

The hygrothermal (heat and moisture) performance of buildings can be assessed by utilizing simulation tools. There are currently a number of available hygrothermal calculation tools available which vary in their degree of sophistication and runtime requirements. This report investigates three of the most commonly used models (WUFI, HAMT, and EMPD) to assess their limitations and potential to generate physically realistic results to prioritize improvements for EnergyPlus (which uses HAMT and EMPD). The outcome of the study shows that, out of these three tools, WUFI has the greatest hygrothermal capabilities. Limitations of these tools were also assessed including: WUFI’s inability tomore » properly account for air leakage and transfer at surface boundaries; HAMT’s inability to handle air leakage, precipitationrelated moisture problems, or condensation problems from high relative humidity; and multiple limitations for EMPD as a simplified method to estimate indoor temperature and humidity levels and generally not used to estimate the hygrothermal performance of the building envelope materials. In conclusion, out of the three investigated simulation tools, HAMT has the greatest modeling potential, is open source, and we have prioritized specific features that can enable EnergyPlus to model all relevant heat and moisture transfer mechanisms that impact the performance of building envelope components.« less

Objective assessment of technique in laparoscopic colorectal surgery: what are the existing tools?

PubMed

Foster, J D; Francis, N K

2015-01-01

Assessment can improve the effectiveness of surgical training and enable valid judgments of competence. Laparoscopic colon resection surgery is now taught within surgical residency programs, and assessment tools are increasingly used to stimulate formative feedback and enhance learning. Formal assessment of technical performance in laparoscopic colon resection has been successfully applied at the specialist level in the English "LAPCO" National Training Program. Objective assessment tools need to be developed for training and assessment in laparoscopic rectal cancer resection surgery. Simulation may have a future role in assessment and accreditation in laparoscopic colorectal surgery; however, existing virtual reality models are not ready to be used for assessment of this advanced surgery.

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

PubMed

Raupach, Tobias; Schiekirka, Sarah; Münscher, Christian; Beißbarth, Tim; Himmel, Wolfgang; Burckhardt, Gerhard; Pukrop, Tobias

2012-01-01

Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical phase of a medical curriculum and address differences between the novel tool and traditional evaluation methods. Student self-assessments before and after completion of a teaching module were used to compute performance gains for specific learning objectives. Mean performance gains in each module were compared to student expectations before the module and data derived from a traditional evaluation tool using overall course ratings at the end of the module. A ranking of the 21 modules according to computed performance gains yielded entirely different results than module rankings based on overall course ratings. There was no significant correlation between performance gain and overall ratings. However, the latter were significantly correlated to student expectations before entering the module as well as structural and procedural parameters (Pearson's r 0.7-0.9). Performance gain computed from comparative self-assessments adds an important new dimension to course evaluation in medical education. In contrast to overall course ratings, the novel tool is less heavily confounded by construct-irrelevant factors. Thus, it appears to be more appropriate than overall course ratings in determining teaching quality and developing algorithms to guide performance-oriented resource allocation in medical education.

An Evaluation of the Performance Diagnostic Checklist-Human Services to Assess an Employee Performance Problem in a Center-Based Autism Treatment Facility

ERIC Educational Resources Information Center

Ditzian, Kyle; Wilder, David A.; King, Allison; Tanz, Jeanine

2015-01-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to assess the environmental variables that contribute to poor employee performance in human services settings. We administered the PDC-HS to 3 supervisors to assess the variables that contributed to poor performance by 4 staff members when securing…

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

Development of task network models of human performance in microgravity

NASA Technical Reports Server (NTRS)

Diaz, Manuel F.; Adam, Susan

1992-01-01

This paper discusses the utility of task-network modeling for quantifying human performance variability in microgravity. The data are gathered for: (1) improving current methodologies for assessing human performance and workload in the operational space environment; (2) developing tools for assessing alternative system designs; and (3) developing an integrated set of methodologies for the evaluation of performance degradation during extended duration spaceflight. The evaluation entailed an analysis of the Remote Manipulator System payload-grapple task performed on many shuttle missions. Task-network modeling can be used as a tool for assessing and enhancing human performance in man-machine systems, particularly for modeling long-duration manned spaceflight. Task-network modeling can be directed toward improving system efficiency by increasing the understanding of basic capabilities of the human component in the system and the factors that influence these capabilities.

Dyspraxia in a patient with corticobasal degeneration: the role of visual and tactile inputs to action

PubMed Central

Graham, N.; Zeman, A.; Young, A.; Patterson, K.; Hodges, J.

1999-01-01

OBJECTIVES—To investigate the roles of visual and tactile information in a dyspraxic patient with corticobasal degeneration (CBD) who showed dramatic facilitation in miming the use of a tool or object when he was given a tool to manipulate; and to study the nature of the praxic and neuropsychological deficits in CBD.
METHODS—The subject had clinically diagnosed CBD, and exhibited alien limb behaviour and striking ideomotor dyspraxia. General neuropsychological evaluation focused on constructional and visuospatial abilities, calculation, verbal fluency, episodic and semantic memory, plus spelling and writing because impairments in this domain were presenting complaints. Four experiments assessed the roles of visual and tactile information in the facilitation of motor performance by tools. Experiment 1 evaluated the patient's performance of six limb transitive actions under six conditions: (1) after he described the relevant tool from memory, (2) after he was shown a line drawing of the tool, (3) after he was shown a real exemplar of the tool, (4) after he watched the experimenter perform the action, (5) while he was holding the tool, and (6) immediately after he had performed the action with the tool but with the tool removed from his grasp. Experiment 2 evaluated the use of the same six tools when the patient had tactile but no visual information (while he was blindfolded). Experiments 3 and 4 assessed performance of actions appropriate to the same six tools when the patient had either neutral or inappropriate tactile feedback—that is, while he was holding a non-tool object or a different tool.
RESULTS—Miming of tool use was not facilitated by visual input; moreover, lack of visual information in the blindfolded condition did not reduce performance. The principal positive finding was a dramatic facilitation of the patient's ability to demonstrate object use when he was holding either the appropriate tool or a neutral object. Tools inappropriate to the requested action produced involuntary performance of the stimulus relevant action.
CONCLUSIONS—Tactile stimulation was paramount in the facilitation of motor performance in tool use by this patient with CBD. This outcome suggests that tactile information should be included in models which hypothesise modality specific inputs to the action production system. Significant impairments in spelling and letter production that have not previously been reported in CBD have also been documented.

 PMID:10449556

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

Impact and Penetration Simulations for Composite Wing-like Structures

NASA Technical Reports Server (NTRS)

Knight, Norman F.

1998-01-01

The goal of this research project was to develop methodologies for the analysis of wing-like structures subjected to impact loadings. Low-speed impact causing either no damage or only minimal damage and high-speed impact causing severe laminate damage and possible penetration of the structure were to be considered during this research effort. To address this goal, an assessment of current analytical tools for impact analysis was performed. Assessment of the analytical tools for impact and penetration simulations with regard to accuracy, modeling, and damage modeling was considered as well as robustness, efficient, and usage in a wing design environment. Following a qualitative assessment, selected quantitative evaluations will be performed using the leading simulation tools. Based on this assessment, future research thrusts for impact and penetration simulation of composite wing-like structures were identified.

Primary care physicians' perspectives on computer-based health risk assessment tools for chronic diseases: a mixed methods study.

PubMed

Voruganti, Teja R; O'Brien, Mary Ann; Straus, Sharon E; McLaughlin, John R; Grunfeld, Eva

2015-09-24

Health risk assessment tools compute an individual's risk of developing a disease. Routine use of such tools by primary care physicians (PCPs) is potentially useful in chronic disease prevention. We sought physicians' awareness and perceptions of the usefulness, usability and feasibility of performing assessments with computer-based risk assessment tools in primary care settings. Focus groups and usability testing with a computer-based risk assessment tool were conducted with PCPs from both university-affiliated and community-based practices. Analysis was derived from grounded theory methodology. PCPs (n = 30) were aware of several risk assessment tools although only select tools were used routinely. The decision to use a tool depended on how use impacted practice workflow and whether the tool had credibility. Participants felt that embedding tools in the electronic medical records (EMRs) system might allow for health information from the medical record to auto-populate into the tool. User comprehension of risk could also be improved with computer-based interfaces that present risk in different formats. In this study, PCPs chose to use certain tools more regularly because of usability and credibility. Despite there being differences in the particular tools a clinical practice used, there was general appreciation for the usefulness of tools for different clinical situations. Participants characterised particular features of an ideal tool, feeling strongly that embedding risk assessment tools in the EMR would maximise accessibility and use of the tool for chronic disease management. However, appropriate practice workflow integration and features that facilitate patient understanding at point-of-care are also essential.

A multisource feedback tool to assess ward round leadership skills of senior paediatric trainees: (2) Testing reliability and practicability.

PubMed

Goodyear, Helen M; Lakshminarayana, Indumathy; Wall, David; Bindal, Taruna

2015-05-01

A five-domain multisource feedback (MSF) tool was previously developed in 2009-2010 by the authors to assess senior paediatric trainees' ward round leadership skills. To determine whether this MSF tool is practicable and reliable, whether individuals' feedback varies over time and trainees' views of the tool. The MSF tool was piloted (April-July 2011) and field tested (September 2011-February 2013) with senior paediatric trainees. A focus group held at the end of field testing obtained trainees' views of the tool. In field testing, 96/115 (84%) trainees returned 633 individual assessments from three different ward rounds over 18 months. The MSF tool had high reliability (Cronbach's α 0.84, G coefficient 0.8 for three raters). In all five domains, data were shifted to the right with scores of 3 (good) and 4 (excellent). Consultants gave significantly lower scores (p<0.001), as did trainees for self-assessment (p<0.001). There was no significant change in MSF scores over 18 months but comments showed that trainees' performance improved. Trainees valued these comments and the MSF tool but had concerns about time taken for feedback and confusion about tool use and the paediatric assessment strategy. A five-domain MSF tool was found to be reliable on pilot and field testing, practicable to use and liked by trainees. Comments on performance were more helpful than scores in giving trainees feedback. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Measuring Medical Housestaff Teamwork Performance Using Multiple Direct Observation Instruments: Comparing Apples and Apples.

PubMed

Weingart, Saul N; Yaghi, Omar; Wetherell, Matthew; Sweeney, Megan

2018-04-10

To examine the composition and concordance of existing instruments used to assess medical teams' performance. A trained observer joined 20 internal medicine housestaff teams for morning work rounds at Tufts Medical Center, a 415-bed Boston teaching hospital, from October through December 2015. The observer rated each team's performance using 9 teamwork observation instruments that examined domains including team structure, leadership, situation monitoring, mutual support, and communication. Observations recorded on paper forms were stored electronically. Scores were normalized from 1 (low) to 5 (high) to account for different rating scales. Overall mean scores were calculated and graphed; weighted scores adjusted for the number of items in each teamwork domain. Teamwork scores were analyzed using t-tests, pair-wise correlations, and the Kruskal-Wallis statistic, and team performance was compared across instruments by domain. The 9 tools incorporated 5 major domains, with 5-35 items per instrument for a total of 161 items per observation session. In weighted and unweighted analyses, the overall teamwork performance score for a given team on a given day varied by instrument. While all of the tools identified the same low outlier, high performers on some instruments were low performers on others. Inconsistent scores for a given team across instruments persisted in domain-level analyses. There was substantial variation in the rating of individual teams assessed concurrently by a single observer using multiple instruments. Since existing teamwork observation tools do not yield concordant assessments, researchers should create better tools for measuring teamwork performance.

A web-based rapid assessment tool for production publishing solutions

NASA Astrophysics Data System (ADS)

Sun, Tong

2010-02-01

Solution assessment is a critical first-step in understanding and measuring the business process efficiency enabled by an integrated solution package. However, assessing the effectiveness of any solution is usually a very expensive and timeconsuming task which involves lots of domain knowledge, collecting and understanding the specific customer operational context, defining validation scenarios and estimating the expected performance and operational cost. This paper presents an intelligent web-based tool that can rapidly assess any given solution package for production publishing workflows via a simulation engine and create a report for various estimated performance metrics (e.g. throughput, turnaround time, resource utilization) and operational cost. By integrating the digital publishing workflow ontology and an activity based costing model with a Petri-net based workflow simulation engine, this web-based tool allows users to quickly evaluate any potential digital publishing solutions side-by-side within their desired operational contexts, and provides a low-cost and rapid assessment for organizations before committing any purchase. This tool also benefits the solution providers to shorten the sales cycles, establishing a trustworthy customer relationship and supplement the professional assessment services with a proven quantitative simulation and estimation technology.

Validation of an organizational communication climate assessment toolkit.

PubMed

Wynia, Matthew K; Johnson, Megan; McCoy, Thomas P; Griffin, Leah Passmore; Osborn, Chandra Y

2010-01-01

Effective communication is critical to providing quality health care and can be affected by a number of modifiable organizational factors. The authors performed a prospective multisite validation study of an organizational communication climate assessment tool in 13 geographically and ethnically diverse health care organizations. Communication climate was measured across 9 discrete domains. Patient and staff surveys with matched items in each domain were developed using a national consensus process, which then underwent psychometric field testing and assessment of domain coherence. The authors found meaningful within-site and between-site performance score variability in all domains. In multivariable models, most communication domains were significant predictors of patient-reported quality of care and trust. The authors conclude that these assessment tools provide a valid empirical assessment of organizational communication climate in 9 domains. Assessment results may be useful to track organizational performance, to benchmark, and to inform tailored quality improvement interventions.

Performance Indicators and Rational Management Tools: A Comparative Assessment of Projects in North America and Europe. AIR 1993 Annual Forum Paper.

ERIC Educational Resources Information Center

Nedwek, Brian P.; Neal, John E.

This study developed a classification scheme to critically compare performance assessment projects at higher education universities in North America and Europe. Performance indicators and assessment initiatives were compared using nine basic dimensions: (1) locus of control, (2) degree of governmental involvement, (3) focus of performance…

Motor Skill Assessment of Children: Is There an Association between Performance-Based, Child-Report, and Parent-Report Measures of Children's Motor Skills?

ERIC Educational Resources Information Center

Kennedy, Johanna; Brown, Ted; Chien, Chi-Wen

2012-01-01

Client-centered practice requires therapists to actively seek the perspectives of children and families. Several assessment tools are available to facilitate this process. However, when evaluating motor skill performance, therapists typically concentrate on performance-based assessment. To improve understanding of the information provided by the…

[Performance assessment employing slide sets: A tool for the classification of senior microscopists from Colombia´s Malaria Control Program].

PubMed

Mendoza, Nohora Marcela; González, Nohora Elizabeth

2015-01-01

One of the most important activities for quality assurance of malaria diagnosis is performance assessment. In Colombia, performance assessment of malaria microscopists has been done through the external performance assessment and indirect external performance assessment programs. To assess the performance of malaria microscopists of public reference laboratories using slide sets, and to describe the methodology used for this purpose. This was a retrospective study to evaluate the concordance of senior microscopists regarding parasite detection, species identification and parasite count based on the results of the assessment of competences using two sets, one comprising 40 slides, and another one with 17 slides. The concordance for parasite detection was 96.9% (95% CI: 96.0-97.5) and 88.7% (95% CI: 86.6-90.5) for species identification. The average percentage of concordant slides in the group evaluated was 89.7% (95% CI: 87.5-91.6). Most of the senior microscopists in Colombia were classified in the two top categories in the performance assessment using slide sets. The most common difficulty encountered was the identification of parasite species. The use of this tool to assess individual performance of microscopists in the evaluation of samples with different degrees of difficulty allows for characterizing the members of the malaria diagnosis network and strengthening the abilities of those who require it.

Developing and Using Dashboard Indicators in Student Affairs Assessment

ERIC Educational Resources Information Center

Mitchell, Joshua J.; Ryder, Andrew J.

2013-01-01

Dashboard systems are increasingly popular as assessment and performance management tools in higher education. This chapter examines the use of dashboards in student affairs, including examples of key indicators and considerations for developing and implementing these tools. The chapter begins with an overview of the origins of dashboards, from…

A new framework for modeling decentralized low impact developments using Soil and Water Assessment Tool

USDA-ARS?s Scientific Manuscript database

Assessing the performance of Low Impact Development (LID) practices at a catchment scale is important in managing urban watersheds. Few modeling tools exist that are capable of explicitly representing the hydrological mechanisms of LIDs while considering the diverse land uses of urban watersheds. ...

Pain assessment tools: is the content appropriate for use in palliative care?

PubMed

Hølen, Jacob Chr; Hjermstad, Marianne Jensen; Loge, Jon Håvard; Fayers, Peter M; Caraceni, Augusto; De Conno, Franco; Forbes, Karen; Fürst, Carl Johan; Radbruch, Lukas; Kaasa, Stein

2006-12-01

Inadequate pain assessment prevents optimal treatment in palliative care. The content of pain assessment tools might limit their usefulness for proper pain assessment, but data on the content validity of the tools are scarce. The objective of this study was to examine the content of the existing pain assessment tools, and to evaluate the appropriateness of different dimensions and items for pain assessment in palliative care. A systematic search was performed to find pain assessment tools for patients with advanced cancer who were receiving palliative care. An ad hoc search with broader search criteria supplemented the systematic search. The items of the identified tools were allocated to appropriate dimensions. This was reviewed by an international panel of experts, who also evaluated the relevance of the different dimensions for pain assessment in palliative care. The systematic literature search generated 16 assessment tools while the ad hoc search generated 64. Ten pain dimensions containing 1,011 pain items were identified by the experts. The experts ranked intensity, temporal pattern, treatment and exacerbating/relieving factors, location, and interference with health-related quality of life as the most important dimensions. None of the assessment tools covered these dimensions satisfactorily. Most items were related to interference (231) and intensity (138). Temporal pattern (which includes breakthrough pain), ranked as the second most important dimension, was covered by 29 items only. Many tools include dimensions and items of limited relevance for patients with advanced cancer. This might reduce compliance and threaten the validity of the assessment. New tools should reflect the clinical relevance of different dimensions and be user-friendly.

Laboratory, Field, and Analytical Procedures for Using ...

EPA Pesticide Factsheets

Regardless of the remedial technology invoked to address contaminated sediments in the environment, there is a critical need to have tools for assessing the effectiveness of the remedy. In the past, these tools have included chemical and biomonitoring of the water column and sediments, toxicity testing and bioaccumulation studies performed on site sediments, and application of partitioning, transport and fate modeling. All of these tools served as lines of evidence for making informed environmental management decisions at contaminated sediment sites. In the last ten years, a new tool for assessing remedial effectiveness has gained a great deal of attention. Passive sampling offers a tool capable of measuring the freely dissolved concentration (Cfree) of legacy contaminants in water and sediments. In addition to assessing the effectiveness of the remedy, passive sampling can be applied for a variety of other contaminated sediments site purposes involved with performing the preliminary assessment and site inspection, conducting the remedial investigation and feasibility study, preparing the remedial design, and assessing the potential for contaminant bioaccumulation. While there is a distinct need for using passive sampling at contaminated sediments sites and several previous documents and research articles have discussed various aspects of passive sampling, there has not been definitive guidance on the laboratory, field and analytical procedures for using pas

Use of the Home Safety Self-Assessment Tool (HSSAT) within Community Health Education to Improve Home Safety.

PubMed

Horowitz, Beverly P; Almonte, Tiffany; Vasil, Andrea

2016-10-01

This exploratory research examined the benefits of a health education program utilizing the Home Safety Self-Assessment Tool (HSSAT) to increase perceived knowledge of home safety, recognition of unsafe activities, ability to safely perform activities, and develop home safety plans of 47 older adults. Focus groups in two senior centers explored social workers' perspectives on use of the HSSAT in community practice. Results for the health education program found significant differences between reported knowledge of home safety (p = .02), ability to recognize unsafe activities (p = .01), safely perform activities (p = .04), and develop a safety plan (p = .002). Social workers identified home safety as a major concern and the HSSAT a promising assessment tool. Research has implications for reducing environmental fall risks.

Comparative assessment of methods for the fusion transcripts detection from RNA-Seq data

PubMed Central

Kumar, Shailesh; Vo, Angie Duy; Qin, Fujun; Li, Hui

2016-01-01

RNA-Seq made possible the global identification of fusion transcripts, i.e. “chimeric RNAs”. Even though various software packages have been developed to serve this purpose, they behave differently in different datasets provided by different developers. It is important for both users, and developers to have an unbiased assessment of the performance of existing fusion detection tools. Toward this goal, we compared the performance of 12 well-known fusion detection software packages. We evaluated the sensitivity, false discovery rate, computing time, and memory usage of these tools in four different datasets (positive, negative, mixed, and test). We conclude that some tools are better than others in terms of sensitivity, positive prediction value, time consumption and memory usage. We also observed small overlaps of the fusions detected by different tools in the real dataset (test dataset). This could be due to false discoveries by various tools, but could also be due to the reason that none of the tools are inclusive. We have found that the performance of the tools depends on the quality, read length, and number of reads of the RNA-Seq data. We recommend that users choose the proper tools for their purpose based on the properties of their RNA-Seq data. PMID:26862001

The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom.

PubMed

Murphy, Douglas J; Bruce, David A; Mercer, Stewart W; Eva, Kevin W

2009-05-01

To investigate the reliability and feasibility of six potential workplace-based assessment methods in general practice training: criterion audit, multi-source feedback from clinical and non-clinical colleagues, patient feedback (the CARE Measure), referral letters, significant event analysis, and video analysis of consultations. Performance of GP registrars (trainees) was evaluated with each tool to assess the reliabilities of the tools and feasibility, given raters and number of assessments needed. Participant experience of process determined by questionnaire. 171 GP registrars and their trainers, drawn from nine deaneries (representing all four countries in the UK), participated. The ability of each tool to differentiate between doctors (reliability) was assessed using generalisability theory. Decision studies were then conducted to determine the number of observations required to achieve an acceptably high reliability for "high-stakes assessment" using each instrument. Finally, descriptive statistics were used to summarise participants' ratings of their experience using these tools. Multi-source feedback from colleagues and patient feedback on consultations emerged as the two methods most likely to offer a reliable and feasible opinion of workplace performance. Reliability co-efficients of 0.8 were attainable with 41 CARE Measure patient questionnaires and six clinical and/or five non-clinical colleagues per doctor when assessed on two occasions. For the other four methods tested, 10 or more assessors were required per doctor in order to achieve a reliable assessment, making the feasibility of their use in high-stakes assessment extremely low. Participant feedback did not raise any major concerns regarding the acceptability, feasibility, or educational impact of the tools. The combination of patient and colleague views of doctors' performance, coupled with reliable competence measures, may offer a suitable evidence-base on which to monitor progress and completion of doctors' training in general practice.

Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools

PubMed Central

Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

2009-01-01

The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child’s physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools’ usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool’s test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool’s normative data samples would benefit from frequent movement skill performance follow-up of today’s children. Abbreviations MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: Körper-Koordinationtest für Kinder, TGDM: Test of Gross Motor Development, MMT: Maastrichtse Motoriektest, BOTMP: Bruininks-Oseretsky Test of Motor Proficiency. ICC: intraclass correlation coefficient, NR: not reported, GM: gross motor, LV: long version, SV: short version, LF: long form, SF: short form, STV: subtest version, SEMs: standard errors of measurement, TMQ: Total Motor Quotient, TMC: Total Motor Composite, CSSA: Comprehensive Scales of Student Abilities MSEL: Mullen Scales of Early learning: AGS Edition AUC: Areas under curve BC: Battery composite ROC: Receiver operating characteristic PMID:24149522

Mastoidectomy performance assessment of virtual simulation training using final-product analysis.

PubMed

Andersen, Steven A W; Cayé-Thomasen, Per; Sørensen, Mads S

2015-02-01

The future development of integrated automatic assessment in temporal bone virtual surgical simulators calls for validation against currently established assessment tools. This study aimed to explore the relationship between mastoidectomy final-product performance assessment in virtual simulation and traditional dissection training. Prospective trial with blinding. A total of 34 novice residents performed a mastoidectomy on the Visible Ear Simulator and on a cadaveric temporal bone. Two blinded senior otologists assessed the final-product performance using a modified Welling scale. The simulator gathered basic metrics on time, steps, and volumes in relation to the on-screen tutorial and collisions with vital structures. Substantial inter-rater reliability (kappa = 0.77) for virtual simulation and moderate inter-rater reliability (kappa = 0.59) for dissection final-product assessment was found. The simulation and dissection performance scores had significant correlation (P = .014). None of the basic simulator metrics correlated significantly with the final-product score except for number of steps completed in the simulator. A modified version of a validated final-product performance assessment tool can be used to assess mastoidectomy on virtual temporal bones. Performance assessment of virtual mastoidectomy could potentially save the use of cadaveric temporal bones for more advanced training when a basic level of competency in simulation has been achieved. NA. © 2014 The American Laryngological, Rhinological and Otological Society, Inc.

Developing an SSAC Self-Assessment Tool for Operators and Regulators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Frazar, Sarah L.; Innes-Jones, Gemma; Hamilton, Ian

Enabling an SSAC to understand why it is performing inefficiently can help it allocate resources more effectively to better support IAEA safeguards implementation. In collaboration with international consulting firm, Environmental Resources Management (ERM) and a U.S. based nuclear fuel cycle facility, the Pacific Northwest National Laboratory (PNNL) has been developing a framework for a future self-assessment tool for nuclear operators and regulators. This paper will describe the effort to date, with particular emphasis on the steps the team took to align the framework with relevant IAEA self-assessment tools.

Comparison of seven fall risk assessment tools in community-dwelling Korean older women.

PubMed

Kim, Taekyoung; Xiong, Shuping

2017-03-01

This study aimed to compare seven widely used fall risk assessment tools in terms of validity and practicality, and to provide a guideline for choosing appropriate fall risk assessment tools for elderly Koreans. Sixty community-dwelling Korean older women (30 fallers and 30 matched non-fallers) were evaluated. Performance measures of all tools were compared between the faller and non-faller groups through two sample t-tests. Receiver Operating Characteristic curves were generated with odds ratios for discriminant analysis. Results showed that four tools had significant discriminative power, and the shortened version of Falls Efficacy Scale (SFES) showed excellent discriminant validity, followed by Berg Balance Scale (BBS) with acceptable discriminant validity. The Mini Balance Evaluation System Test and Timed Up and Go, however, had limited discriminant validities. In terms of practicality, SFES was also excellent. These findings suggest that SFES is the most suitable tool for assessing the fall risks of community-dwelling Korean older women, followed by BBS. Practitioner Summary: There is no general guideline on which fall risk assessment tools are suitable for community-dwelling Korean older women. This study compared seven widely used assessment tools in terms of validity and practicality. Results suggested that the short Falls Efficacy Scale is the most suitable tool, followed by Berg Balance Scale.

360-degree physician performance assessment.

PubMed

Dubinsky, Isser; Jennings, Kelly; Greengarten, Moshe; Brans, Amy

2010-01-01

Few jurisdictions have a robust common approach to assessing the quantitative and qualitative dimensions of physician performance. In this article, we examine the need for 360-degree physician performance assessment and review the literature supporting comprehensive physician assessment. An evidence-based, "best practice" approach to the development of a 360-degree physician performance assessment framework is presented, including an overview of a tool kit to support implementation. The focus of the framework is to support physician career planning and to enhance the quality of patient care. Finally, the legal considerations related to implementing 360-degree physician performance assessment are explored.

A Study of the Effect of HyperCard and Pen-Paper Performance Assessment Methods on Expert-Novice Chemistry Problem Solving.

ERIC Educational Resources Information Center

Kumar, David D.; And Others

1994-01-01

Investigates HyperCard as a tool for assessment in science education and determines whether or not a HyperCard assessment instrument could differentiate between expert and novice student performance on balancing stoichiometric equations in science education. (ZWH)

Computer assisted blast design and assessment tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cameron, A.R.; Kleine, T.H.; Forsyth, W.W.

1995-12-31

In general the software required by a blast designer includes tools that graphically present blast designs (surface and underground), can analyze a design or predict its result, and can assess blasting results. As computers develop and computer literacy continues to rise the development of and use of such tools will spread. An example of the tools that are becoming available includes: Automatic blast pattern generation and underground ring design; blast design evaluation in terms of explosive distribution and detonation simulation; fragmentation prediction; blast vibration prediction and minimization; blast monitoring for assessment of dynamic performance; vibration measurement, display and signal processing;more » evaluation of blast results in terms of fragmentation; and risk and reliability based blast assessment. The authors have identified a set of criteria that are essential in choosing appropriate software blasting tools.« less

A New Network Modeling Tool for the Ground-based Nuclear Explosion Monitoring Community

NASA Astrophysics Data System (ADS)

Merchant, B. J.; Chael, E. P.; Young, C. J.

2013-12-01

Network simulations have long been used to assess the performance of monitoring networks to detect events for such purposes as planning station deployments and network resilience to outages. The standard tool has been the SAIC-developed NetSim package. With correct parameters, NetSim can produce useful simulations; however, the package has several shortcomings: an older language (FORTRAN), an emphasis on seismic monitoring with limited support for other technologies, limited documentation, and a limited parameter set. Thus, we are developing NetMOD (Network Monitoring for Optimal Detection), a Java-based tool designed to assess the performance of ground-based networks. NetMOD's advantages include: coded in a modern language that is multi-platform, utilizes modern computing performance (e.g. multi-core processors), incorporates monitoring technologies other than seismic, and includes a well-validated default parameter set for the IMS stations. NetMOD is designed to be extendable through a plugin infrastructure, so new phenomenological models can be added. Development of the Seismic Detection Plugin is being pursued first. Seismic location and infrasound and hydroacoustic detection plugins will follow. By making NetMOD an open-release package, it can hopefully provide a common tool that the monitoring community can use to produce assessments of monitoring networks and to verify assessments made by others.

Rapid Benefit Indicator (RBI) Checklist Tool - Quick Start ...

EPA Pesticide Factsheets

The Rapid Benefits Indicators (RBI) approach consists of five steps and is outlined in Assessing the Benefits of Wetland Restoration – A Rapid Benefits Indicators Approach for Decision Makers. This checklist tool is intended to be used to record information as you answer the questions in that guide. When performing a Rapid Benefits Indicator (RBI) assessment on wetlands restoration site(s) results can be recorded and reviewed using this VBA enabled MS Excel Checklist Tool.

Minnesota's Comprehensive Assessments: 1998 and 1999 Participation and Performance of Students with Disabilities. State Assessment Series, Minnesota Report 32.

ERIC Educational Resources Information Center

Walz, Lynn; Thompson, Sandra; Thurlow, Martha; Spicuzza, Richard

This report focuses on the participation and performance of students with disabilities on the initial administration of Minnesota's Comprehensive Assessments (MCAs). The MCAs are criterion-referenced tests used for district accountability purposes and as tools for making decisions about curriculum and instruction. Assessments in mathematics and…

Using Performance Task Data to Improve Instruction

ERIC Educational Resources Information Center

Abbott, Amy L.; Wren, Douglas G.

2016-01-01

Two well-accepted ideas among educators are (a) performance assessment is an effective means of assessing higher-order thinking skills and (b) data-driven instruction planning is a valuable tool for optimizing student learning. This article describes a locally developed performance task (LDPT) designed to measure critical thinking, problem…

Evaluation of the Langmuir model in the Soil and Water Assessment Tool for high soil phosphorus condition

USDA-ARS?s Scientific Manuscript database

Phosphorus adsorption by a water treatment residual was tested through Langmuir and linear sorption isotherms and applied in the Soil and Water Assessment Tool (SWAT). The objective of this study was to use laboratory and greenhouse experimental phosphorus data to evaluate the performance of a modi...

Measuring pain in patients undergoing hemodialysis: a review of pain assessment tools

PubMed Central

Upadhyay, Chandani; Cameron, Karen; Murphy, Laura; Battistella, Marisa

2014-01-01

Background Patients undergoing hemodialysis frequently report pain with multifactorial causes, not limited to that experienced directly from hemodialysis treatment. Their pain may be nociceptive, neuropathic, somatic or visceral in nature. Despite this, pain in this population remains under-recognized and under-treated. Although several tools have been used to measure pain in patients undergoing hemodialysis as reported in the literature, none of them have been validated specifically in this population. The objective for this review was to compare and contrast these pain assessment tools and discuss their clinical utility in this patient population. Methods To identify pain assessment tools studied in patients undergoing hemodialysis, a literature search was performed in PubMed and Medline. An expert panel of dialysis and pain clinicians reviewed each tool. Each pain assessment tool was assessed on how it is administered and scored, its psychometric properties such as reliability, validity and responsiveness to change, and its clinical utility in a hemodialysis population. Brief Pain Inventory, McGill Pain Questionnaire, Pain Management Index, Edmonton Symptom Assessment System, Visual Analogue Scale and Faces Pain Scale were evaluated and compared. Results This assessment will help clinicians practicing in nephrology to determine which of these pain assessment tools is best suited for use in their individual clinical practice. PMID:25852910

Method and apparatus for characterizing and enhancing the dynamic performance of machine tools

DOEpatents

Barkman, William E; Babelay, Jr., Edwin F

2013-12-17

Disclosed are various systems and methods for assessing and improving the capability of a machine tool. The disclosure applies to machine tools having at least one slide configured to move along a motion axis. Various patterns of dynamic excitation commands are employed to drive the one or more slides, typically involving repetitive short distance displacements. A quantification of a measurable merit of machine tool response to the one or more patterns of dynamic excitation commands is typically derived for the machine tool. Examples of measurable merits of machine tool performance include dynamic one axis positional accuracy of the machine tool, dynamic cross-axis stability of the machine tool, and dynamic multi-axis positional accuracy of the machine tool.

Falls risk assessment in older patients in hospital.

PubMed

Matarese, Maria; Ivziku, Dhurata

2016-07-27

Falls are the most frequent adverse event reported in hospitals, usually affecting older patients. All hospitals in NHS organisations develop risk prevention policies that include falls risk assessment. Falls risk assessment involves the use of risk screening tools, aimed at identifying patients at increased risk of falls, and risk assessment tools, which identify a patient's risk factors for falls. Various risk screening tools have been used in clinical practice, but no single tool is able to identify all patients at risk of falls or to accurately exclude all those who are not at risk of falls. Guidelines recommend that patients aged 65 years and over who are admitted to hospital should be considered at high risk of falls and that a multifactorial falls risk assessment should be performed. Therefore, falls risk assessment tools should be used to identify the risk factors for each inpatient aged 65 years or over, in order to determine the most appropriate care plan for falls prevention and to maximise patient mobility and independence.

Development of the TeamOBS-PPH - targeting clinical performance in postpartum hemorrhage.

PubMed

Brogaard, Lise; Hvidman, Lone; Hinshaw, Kim; Kierkegaard, Ole; Manser, Tanja; Musaeus, Peter; Arafeh, Julie; Daniels, Kay I; Judy, Amy E; Uldbjerg, Niels

2018-06-01

This study aimed to develop a valid and reliable TeamOBS-PPH tool for assessing clinical performance in the management of postpartum hemorrhage (PPH). The tool was evaluated using video-recordings of teams managing PPH in both real-life and simulated settings. A Delphi panel consisting of 12 obstetricians from the UK, Norway, Sweden, Iceland, and Denmark achieved consensus on (i) the elements to include in the assessment tool, (ii) the weighting of each element, and (iii) the final tool. The validity and reliability were evaluated according to Cook and Beckman. (Level 1) Four raters scored four video-recordings of in situ simulations of PPH. (Level 2) Two raters scored 85 video-recordings of real-life teams managing patients with PPH ≥1000 mL in two Danish hospitals. (Level 3) Two raters scored 15 video-recordings of in situ simulations of PPH from a US hospital. The tool was designed with scores from 0 to 100. (Level 1) Teams of novices had a median score of 54 (95% CI 48-60), whereas experienced teams had a median score of 75 (95% CI 71-79; p < 0.001). (Level 2) The intra-rater [intra-class correlation (ICC) = 0.96] and inter-rater (ICC = 0.83) agreements for real-life PPH were strong. The tool was applicable in all cases: atony, retained placenta, and lacerations. (Level 3) The tool was easily adapted to in situ simulation settings in the USA (ICC = 0.86). The TeamOBS-PPH tool appears to be valid and reliable for assessing clinical performance in real-life and simulated settings. The tool will be shared as the free TeamOBS App. © 2018 Nordic Federation of Societies of Obstetrics and Gynecology.

Embedded performance validity testing in neuropsychological assessment: Potential clinical tools.

PubMed

Rickards, Tyler A; Cranston, Christopher C; Touradji, Pegah; Bechtold, Kathleen T

2018-01-01

The article aims to suggest clinically-useful tools in neuropsychological assessment for efficient use of embedded measures of performance validity. To accomplish this, we integrated available validity-related and statistical research from the literature, consensus statements, and survey-based data from practicing neuropsychologists. We provide recommendations for use of 1) Cutoffs for embedded performance validity tests including Reliable Digit Span, California Verbal Learning Test (Second Edition) Forced Choice Recognition, Rey-Osterrieth Complex Figure Test Combination Score, Wisconsin Card Sorting Test Failure to Maintain Set, and the Finger Tapping Test; 2) Selecting number of performance validity measures to administer in an assessment; and 3) Hypothetical clinical decision-making models for use of performance validity testing in a neuropsychological assessment collectively considering behavior, patient reporting, and data indicating invalid or noncredible performance. Performance validity testing helps inform the clinician about an individual's general approach to tasks: response to failure, task engagement and persistence, compliance with task demands. Data-driven clinical suggestions provide a resource to clinicians and to instigate conversation within the field to make more uniform, testable decisions to further the discussion, and guide future research in this area.

A Novel Tool for Assessment of Emergency Medicine Resident Skill in Determining Diagnosis and Management for Emergent Electrocardiograms: A Multicenter Study.

PubMed

Hartman, Nicholas D; Wheaton, Natasha B; Williamson, Kelly; Quattromani, Erin N; Branzetti, Jeremy B; Aldeen, Amer Z

2016-12-01

Reading emergent electrocardiograms (ECGs) is one of the emergency physician's most crucial tasks, yet no well-validated tool exists to measure resident competence in this skill. To assess validity of a novel tool measuring emergency medicine resident competency for interpreting, and responding to, critical ECGs. In addition, we aim to observe trends in this skill for resident physicians at different levels of training. This is a multi-center, prospective study of postgraduate year (PGY) 1-4 residents at five emergency medicine (EM) residency programs in the United States. An assessment tool was created that asks the physician to identify either the ECG diagnosis or the best immediate management. One hundred thirteen EM residents from five EM residency programs submitted completed assessment surveys, including 43 PGY-1s, 33 PGY-2s, and 37 PGY-3/4s. PGY-3/4s averaged 74.6% correct (95% confidence interval [CI] 70.9-78.4) and performed significantly better than PGY-1s, who averaged 63.2% correct (95% CI 58.0-68.3). PGY-2s averaged 69.0% (95% CI 62.2-73.7). Year-to-year differences were more pronounced in management than in diagnosis. Residency training in EM seems to be associated with improved ability to interpret "critical" ECGs as measured by our assessment tool. This lends validity evidence for the tool by correlating with a previously observed association between residency training and improved ECG interpretation. Resident skill in ECG interpretation remains less than ideal. Creation of this sort of tool may allow programs to assess resident performance as well as evaluate interventions designed to improve competency. Copyright © 2016 Elsevier Inc. All rights reserved.

Measurement tools and process indicators of patient safety culture in primary care. A mixed methods study by the LINNEAUS collaboration on patient safety in primary care.

PubMed

Parker, Dianne; Wensing, Michel; Esmail, Aneez; Valderas, Jose M

2015-09-01

There is little guidance available to healthcare practitioners about what tools they might use to assess the patient safety culture. To identify useful tools for assessing patient safety culture in primary care organizations in Europe; to identify those aspects of performance that should be assessed when investigating the relationship between safety culture and performance in primary care. Two consensus-based studies were carried out, in which subject matter experts and primary healthcare professionals from several EU states rated (a) the applicability to their healthcare system of several existing safety culture assessment tools and (b) the appropriateness and usefulness of a range of potential indicators of a positive patient safety culture to primary care settings. The safety culture tools were field-tested in four countries to ascertain any challenges and issues arising when used in primary care. The two existing tools that received the most favourable ratings were the Manchester patient safety framework (MaPsAF primary care version) and the Agency for healthcare research and quality survey (medical office version). Several potential safety culture process indicators were identified. The one that emerged as offering the best combination of appropriateness and usefulness related to the collection of data on adverse patient events. Two tools, one quantitative and one qualitative, were identified as applicable and useful in assessing patient safety culture in primary care settings in Europe. Safety culture indicators in primary care should focus on the processes rather than the outcomes of care.

Measurement tools and process indicators of patient safety culture in primary care. A mixed methods study by the LINNEAUS collaboration on patient safety in primary care

PubMed Central

Parker, Dianne; Wensing, Michel; Esmail, Aneez; Valderas, Jose M

2015-01-01

ABSTRACT Background: There is little guidance available to healthcare practitioners about what tools they might use to assess the patient safety culture. Objective: To identify useful tools for assessing patient safety culture in primary care organizations in Europe; to identify those aspects of performance that should be assessed when investigating the relationship between safety culture and performance in primary care. Methods: Two consensus-based studies were carried out, in which subject matter experts and primary healthcare professionals from several EU states rated (a) the applicability to their healthcare system of several existing safety culture assessment tools and (b) the appropriateness and usefulness of a range of potential indicators of a positive patient safety culture to primary care settings. The safety culture tools were field-tested in four countries to ascertain any challenges and issues arising when used in primary care. Results: The two existing tools that received the most favourable ratings were the Manchester patient safety framework (MaPsAF primary care version) and the Agency for healthcare research and quality survey (medical office version). Several potential safety culture process indicators were identified. The one that emerged as offering the best combination of appropriateness and usefulness related to the collection of data on adverse patient events. Conclusion: Two tools, one quantitative and one qualitative, were identified as applicable and useful in assessing patient safety culture in primary care settings in Europe. Safety culture indicators in primary care should focus on the processes rather than the outcomes of care. PMID:26339832

Evacuation performance evaluation tool.

PubMed

Farra, Sharon; Miller, Elaine T; Gneuhs, Matthew; Timm, Nathan; Li, Gengxin; Simon, Ashley; Brady, Whittney

2016-01-01

Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation. Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed. Large pediatric hospital and medical center in the Midwest. The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU). The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952). The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

Method and apparatus for characterizing and enhancing the functional performance of machine tools

DOEpatents

Barkman, William E; Babelay, Jr., Edwin F; Smith, Kevin Scott; Assaid, Thomas S; McFarland, Justin T; Tursky, David A; Woody, Bethany; Adams, David

2013-04-30

Disclosed are various systems and methods for assessing and improving the capability of a machine tool. The disclosure applies to machine tools having at least one slide configured to move along a motion axis. Various patterns of dynamic excitation commands are employed to drive the one or more slides, typically involving repetitive short distance displacements. A quantification of a measurable merit of machine tool response to the one or more patterns of dynamic excitation commands is typically derived for the machine tool. Examples of measurable merits of machine tool performance include workpiece surface finish, and the ability to generate chips of the desired length.

Evaluation tools to support ITS planning process : development of a sketch planning tool in FSUTMS/cube environment.

DOT National Transportation Integrated Search

2008-12-15

Intelligent Transportation Systems (ITS) planning requires the use of tools to assess the performance of ITS deployment alternatives relative to each other and to other types of transportation system improvement alternatives. This research project in...

Medical student web-based formative assessment tool for renal pathology.

PubMed

Bijol, Vanesa; Byrne-Dugan, Cathryn J; Hoenig, Melanie P

2015-01-01

Background Web-based formative assessment tools have become widely recognized in medical education as valuable resources for self-directed learning. Objectives To explore the educational value of formative assessment using online quizzes for kidney pathology learning in our renal pathophysiology course. Methods Students were given unrestricted and optional access to quizzes. Performance on quizzed and non-quizzed materials of those who used ('quizzers') and did not use the tool ('non-quizzers') was compared. Frequency of tool usage was analyzed and satisfaction surveys were utilized at the end of the course. Results In total, 82.6% of the students used quizzes. The greatest usage was observed on the day before the final exam. Students repeated interactive and more challenging quizzes more often. Average means between final exam scores for quizzed and unrelated materials were almost equal for 'quizzers' and 'non-quizzers', but 'quizzers' performed statistically better than 'non-quizzers' on both, quizzed (p=0.001) and non-quizzed (p=0.024) topics. In total, 89% of surveyed students thought quizzes improved their learning experience in this course. Conclusions Our new computer-assisted learning tool is popular, and although its use can predict the final exam outcome, it does not provide strong evidence for direct improvement in academic performance. Students who chose to use quizzes did well on all aspects of the final exam and most commonly used quizzes to practice for final exam. Our efforts to revitalize the course material and promote learning by adding interactive online formative assessments improved students' learning experience overall.

Systematic Sustainability Assessment (SSA) Tool for Hydroelectric Project in Malaysia

NASA Astrophysics Data System (ADS)

Turan, Faiz Mohd; Johan, Kartina

2017-08-01

Sustainably developed and managed hydropower has enormous potential to contribute to global sustainability goals. It is known that hydroelectricity contributing small amounts to greenhouse gas emissions and other atmospheric pollutants. However, developing the remaining hydroelectric potential offers many challenges, and public pressure and expectations on the environmental and social performance of hydroelectric tend to increase over time. This paper aims to develop Systematic Sustainability Assessment (SSA) Tool that promotes and guides more sustainable hydroelectric projects in the context of Malaysia. The proposed SSA tool which not only provide a quality and quantitative report of sustainability performance but also act as Self-Assessment Report (SAR) to provide roadmap to achieve greater level of sustainability in project management for continuous improvement. It is expected to provide a common language that allow government, civil society, financial institutions and the hydroelectric sector to talk about and evaluate sustainability issues. The advantage of SSA tool is it can be used at any stage of hydroelectric development, from the earliest planning stages right through to operation.

An Assessment Tool of Performance Based Logistics Appropriateness

DTIC Science & Technology

2012-03-01

weighted tool score. The reason might be the willing to use PBL as an acquisition method . There is an 8.51% positive difference is present. Figure 20 shows...performance-based acquisition methods to the maximum extent practicable when acquiring services with little exclusion’ is mandated. Although PBL...determines the factors affecting the success in selecting PBL as an acquisition method . Each factor is examined in detail and built into a spreadsheet tool

Development and Validation of Performance Assessment Tools for Interprofessional Communication and Teamwork (PACT)

ERIC Educational Resources Information Center

Chiu, Chia-Ju

2014-01-01

Background: Medical errors caused by breakdowns in teamwork and interprofessional communication contribute to many deaths in the United States each year. Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS®) is an evidence-based teamwork system developed to improve communication and teamwork skills among health care…

Data Center IT Equipment Energy Assessment Tools: Current State of Commercial Tools, Proposal for a Future Set of Assessment Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Radhakrishnan, Ben D.

2012-06-30

This research project, which was conducted during the Summer and Fall of 2011, investigated some commercially available assessment tools with a focus on IT equipment to see if such tools could round out the DC Pro tool suite. In this research, the assessment capabilities of the various tools were compiled to help make “non-biased” information available to the public. This research should not be considered to be exhaustive on all existing vendor tools although a number of vendors were contacted. Large IT equipment OEM’s like IBM and Dell provide their proprietary internal automated software which does not work on anymore » other IT equipment. However, found two companies with products that showed promise in performing automated assessments for IT equipment from different OEM vendors. This report documents the research and provides a list of software products reviewed, contacts and websites, product details, discussions with specific companies, a set of recommendations, and next steps. As a result of this research, a simple 3-level approach to an IT assessment tool is proposed along with an example of an assessment using a simple IT equipment data collection tool (Level 1, spreadsheet). The tool has been reviewed with the Green Grid and LBNL staff. The initial feedback has been positive although further refinement to the tool will be necessary. Proposed next steps include a field trial of at least two vendors’ software in two different data centers with an objective to prove the concept, ascertain the extent of energy and computational assessment, ease of installation and opportunities for continuous improvement. Based on the discussions, field trials (or case studies) are proposed with two vendors – JouleX (expected to be completed in 2012) and Sentilla.« less

The development and assessment of an evaluation tool for pediatric resident competence in leading simulated pediatric resuscitations.

PubMed

Grant, Estée C; Grant, Vincent J; Bhanji, Farhan; Duff, Jonathan P; Cheng, Adam; Lockyer, Jocelyn M

2012-07-01

It is critical that competency in pediatric resuscitation is achieved and assessed during residency or post graduate medical training. The purpose of this study was to create and evaluate a tool to measure all elements of pediatric resuscitation team leadership competence. An initial set of items, derived from a literature review and a brainstorming session, were refined to a 26 item assessment tool through the use of Delphi methodology. The tool was tested using videos of standardized resuscitations. A psychometric assessment of the evidence for instrument validity and reliability was undertaken. The performance of 30 residents on two videotaped scenarios was assessed by 4 pediatricians using the tool, with 12 items assessing 'leadership and communication skills' (LCS) and 14 items assessing 'knowledge and clinical skills' (KCS). The instrument showed evidence of reliability; the Cronbach's alpha and generalizability co-efficients for the overall instrument were α=0.818 and Ep(2)=0.76, for LCS were α=0.827 and Ep(2)=0.844, and for KCS were α=0.673 and Ep(2)=0.482. While validity was initially established through literature review and brainstorming by the panel of experts, it was further built through the high strength of correlation between global scores and scores for overall performance (r=0.733), LCS (r=0.718) and KCS (r=0.662) as well as the factor analysis which accounted for 40.2% of the variance. The results of the study demonstrate that the instrument is a valid and reliable tool to evaluate pediatric resuscitation team leader competence. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Mobile Formative Assessment Tool Based on Data Mining Techniques for Supporting Web-Based Learning

ERIC Educational Resources Information Center

Chen, Chih-Ming; Chen, Ming-Chuan

2009-01-01

Current trends clearly indicate that online learning has become an important learning mode. However, no effective assessment mechanism for learning performance yet exists for e-learning systems. Learning performance assessment aims to evaluate what learners learned during the learning process. Traditional summative evaluation only considers final…

Reducing waste in evaluation studies on fall risk assessment tools for older people.

PubMed

Meyer, Gabriele; Möhler, Ralph; Köpke, Sascha

2018-05-18

To critically appraise the recognition of methodological challenges in evaluation studies on assessment tools and nurses' clinical judgement on fall risk in older people and suggest how to reduce respective research waste. Opinion paper and narrative review covering systematic reviews on studies assessing diagnostic accuracy and impact of assessment tools and/or nurses' clinical judgement. Eighteen reviews published in the last 15 years were analysed. Only one reflects potentially important factors threatening the accuracy of assessments using delayed verification with fall events as reference after a certain period of time, i.e. natural course, preventive measures and treatment paradox where accurate assessment leads to prevention of falls, i.e. influencing the reference standard and falsely indicating low diagnostic accuracy. Also, only one review mentions randomised controlled trials as appropriate study design for the investigation of the impact of fall risk assessment tools on patient-important outcomes. Until now, only one randomised controlled trial dealing with this question has been performed showing no effect on falls and injuries. Instead of investigating the diagnostic accuracy of fall assessment tools, the focus of future research should be on the effectiveness of the implementation of fall assessment tools at reducing falls and injuries. Copyright © 2018. Published by Elsevier Inc.

The Use of the Performance Diagnostic Checklist-Human Services to Assess and Improve the Job Performance of Individuals with Intellectual Disabilities.

PubMed

Smith, Madison; Wilder, David A

2018-06-01

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an informant-based tool designed to identify the variables responsible for performance problems. To date, the PDC-HS has not been examined with individuals with intellectual disabilities. In the current study, two supervisors with intellectual disabilities completed the PDC-HS to assess the productivity of two supervisees with disabilities who performed a pricing task in a thrift store. The PDC-HS suggested that performance deficits were due to a lack of training; a PDC-HS-indicated intervention was effective to increase accurate pricing. • The PDC-HS is an informant-based tool designed to identify the variables responsible for employee performance problems in human service settings. • The PDC-HS can be completed by some individuals with intellectual disabilities in a supervisory position to identify the variables responsible for problematic job performance among their supervisees. • A PDC-HS indicated intervention was demonstrated to be effective to improve the job performance of individuals with disabilities. • The PDC-HS may be a useful tool to support performance improvement and job maintenance among individuals with intellectual disabilities.

Learning to Write: Progress-Monitoring Tools for Beginning and at-Risk Writers

ERIC Educational Resources Information Center

Ritchey, Kristen D.

2006-01-01

Teachers now have a wide range of tools to help assess the beginning reading performance of kindergarten and first-grade children. However, validated procedures for assessing the beginning writing skills of kindergarten and first-grade children are less widely available. Learning to write, like learning to read, is a complex task. The ability to…

District Self-Assessment Tool: For Modification of Collective Bargaining Agreements to Achieve Flexible Conditions for School Turnaround

ERIC Educational Resources Information Center

Mass Insight Education (NJ1), 2011

2011-01-01

The District Self-Assessment Tool is designed to support districts, unions and Lead Partners, when analyzing their existing collective bargaining agreement (CBA) with the intention of making targeted modifications to support the implementation of dramatic reform in the district's lowest-performing schools. By outlining objectives and suggested…

Nutrition screening tools: does one size fit all? A systematic review of screening tools for the hospital setting.

PubMed

van Bokhorst-de van der Schueren, Marian A E; Guaitoli, Patrícia Realino; Jansma, Elise P; de Vet, Henrica C W

2014-02-01

Numerous nutrition screening tools for the hospital setting have been developed. The aim of this systematic review is to study construct or criterion validity and predictive validity of nutrition screening tools for the general hospital setting. A systematic review of English, French, German, Spanish, Portuguese and Dutch articles identified via MEDLINE, Cinahl and EMBASE (from inception to the 2nd of February 2012). Additional studies were identified by checking reference lists of identified manuscripts. Search terms included key words for malnutrition, screening or assessment instruments, and terms for hospital setting and adults. Data were extracted independently by 2 authors. Only studies expressing the (construct, criterion or predictive) validity of a tool were included. 83 studies (32 screening tools) were identified: 42 studies on construct or criterion validity versus a reference method and 51 studies on predictive validity on outcome (i.e. length of stay, mortality or complications). None of the tools performed consistently well to establish the patients' nutritional status. For the elderly, MNA performed fair to good, for the adults MUST performed fair to good. SGA, NRS-2002 and MUST performed well in predicting outcome in approximately half of the studies reviewed in adults, but not in older patients. Not one single screening or assessment tool is capable of adequate nutrition screening as well as predicting poor nutrition related outcome. Development of new tools seems redundant and will most probably not lead to new insights. New studies comparing different tools within one patient population are required. Copyright © 2013 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

Measuring activities and participation in persons with haemophilia: A systematic review of commonly used instruments.

PubMed

Timmer, M A; Gouw, S C; Feldman, B M; Zwagemaker, A; de Kleijn, P; Pisters, M F; Schutgens, R E G; Blanchette, V; Srivastava, A; David, J A; Fischer, K; van der Net, J

2018-03-01

Monitoring clinical outcome in persons with haemophilia (PWH) is essential in order to provide optimal treatment for individual patients and compare effectiveness of treatment strategies. Experience with measurement of activities and participation in haemophilia is limited and consensus on preferred tools is lacking. The aim of this study was to give a comprehensive overview of the measurement properties of a selection of commonly used tools developed to assess activities and participation in PWH. Electronic databases were searched for articles that reported on reliability, validity or responsiveness of predetermined measurement tools (5 self-reported and 4 performance based measurement tools). Methodological quality of the studies was assessed according to the COSMIN checklist. Best evidence synthesis was used to summarize evidence on the measurement properties. The search resulted in 3453 unique hits. Forty-two articles were included. The self-reported Haemophilia Acitivity List (HAL), Pediatric HAL (PedHAL) and the performance based Functional Independence Score in Haemophilia (FISH) were studied most extensively. Methodological quality of the studies was limited. Measurement error, cross-cultural validity and responsiveness have been insufficiently evaluated. Albeit based on limited evidence, the measurement properties of the PedHAL, HAL and FISH are currently considered most satisfactory. Further research needs to focus on measurement error, responsiveness, interpretability and cross-cultural validity of the self-reported tools and validity of performance based tools which are able to assess limitations in sports and leisure activities. © 2018 The Authors. Haemophilia Published by John Wiley & Sons Ltd.

The utility of clinical decision tools for diagnosing osteoporosis in postmenopausal women with rheumatoid arthritis

PubMed Central

Brand, Caroline; Lowe, Adrian; Hall, Stephen

2008-01-01

Background Patients with rheumatoid arthritis have a higher risk of low bone mineral density than normal age matched populations. There is limited evidence to support cost effectiveness of population screening in rheumatoid arthritis and case finding strategies have been proposed as a means to increase cost effectiveness of diagnostic screening for osteoporosis. This study aimed to assess the performance attributes of generic and rheumatoid arthritis specific clinical decision tools for diagnosing osteoporosis in a postmenopausal population with rheumatoid arthritis who attend ambulatory specialist rheumatology clinics. Methods A cross-sectional study of 127 ambulatory post-menopausal women with rheumatoid arthritis was performed. Patients currently receiving or who had previously received bone active therapy were excluded. Eligible women underwent clinical assessment and dual-energy-xray absorptiometry (DXA) bone mineral density assessment. Clinical decision tools, including those specific for rheumatoid arthritis, were compared to seven generic post-menopausal tools to predict osteoporosis (defined as T score < -2.5). Sensitivity, specificity, positive predictive and negative predictive values and area under the curve were assessed. The diagnostic attributes of the clinical decision tools were compared by examination of the area under the receiver-operator-curve. Results One hundred and twenty seven women participated. The median age was 62 (IQR 56–71) years. Median disease duration was 108 (60–168) months. Seventy two (57%) women had no record of a previous DXA examination. Eighty (63%) women had T scores at femoral neck or lumbar spine less than -1. The area under the ROC curve for clinical decision tool prediction of T score <-2.5 varied between 0.63 and 0.76. The rheumatoid arthritis specific decision tools did not perform better than generic tools, however, the National Osteoporosis Foundation score could potentially reduce the number of unnecessary DXA tests by approximately 45% in this population. Conclusion There was limited utility of clinical decision tools for predicting osteoporosis in this patient population. Fracture prediction tools that include risk factors independent of BMD are needed. PMID:18230132

How Do Countries' Health Information Systems Perform in Assessing Asylum Seekers' Health Situation? Developing a Health Information Assessment Tool on Asylum Seekers (HIATUS) and Piloting It in Two European Countries.

PubMed

Bozorgmehr, Kayvan; Goosen, Simone; Mohsenpour, Amir; Kuehne, Anna; Razum, Oliver; Kunst, Anton E

2017-08-08

Background: Accurate data on the health status, health behaviour and access to health care of asylum seekers is essential, but such data is lacking in many European countries. We hence aimed to: (a) develop and pilot-test an instrument that can be used to compare and benchmark the country health information systems (HIS) with respect to the ability to assess the health status and health care situation of asylum seekers and (b) present the results of that pilot for The Netherlands (NL) and Germany (DE). Materials and Methods : Reviewing and adapting existing tools, we developed a Health Information Assessment Tool on Asylum Seekers (HIATUS) with 50 items to assess HIS performance across three dimensions: (1) availability and detail of data across potential data sources; (2) HIS resources and monitoring capacity; (3) general coverage and timeliness of publications on selected indicators. We piloted HIATUS by applying the tool to the HIS in DE and NL. Two raters per country independently assessed the performance of country HIS and the inter-rater reliability was analysed by Pearson's rho and the intra-class correlation (ICC). We then applied a consensus-based group rating to obtain the final ratings which were transformed into a weighted summary score (range: 0-97). We assessed HIS performance by calculating total and domain-specific HIATUS scores by country as well as absolute and relative gaps in scores within and between countries. Results : In the independent rating, Pearson's rho was 0.14 (NL) and 0.30 (DE), the ICC yielded an estimated reliability of 0.29 (NL) and 0.83 (DE) respectively. In the final consensus-based rating, the total HIATUS score was 47 in NL and 15 in DE, translating into a relative gap in HIS capacity of 52% (NL) and 85% (DE) respectively. Shortfalls in HIS capacity in both countries relate to the areas of HIS coordination, planning and policies, and to limited coverage of specific indicators such as self-reported health, mental health, socio-economic status and health behaviour. The relative gap in the HIATUS component "data sources and availability" was much higher in Germany (92%) than in NL (28%). Conclusions : The standardised tool (HIATUS) proved useful for assessment of country HIS performance in two countries by consensus-based rating. HIATUS revealed substantial limitations in HIS capacity to assess the health situation of asylum seekers in both countries. The tool allowed for between-country comparisons, revealing that capacities were lower in DE relative to NL. Monitoring and benchmarking gaps in HIS capacity in further European countries can help to strengthen HIS in the future.

Do Press Ganey Scores Correlate With Total Knee Arthroplasty-Specific Outcome Questionnaires in Postsurgical Patients?

PubMed

Chughtai, Morad; Patel, Nirav K; Gwam, Chukwuweike U; Khlopas, Anton; Bonutti, Peter M; Delanois, Ronald E; Mont, Michael A

2017-09-01

The purpose of this study was to assess whether Center for Medicaid and Medicare services-implemented satisfaction (Press Ganey [PG]) survey results correlate with established total knee arthroplasty (TKA) assessment tools. Data from 736 patients who underwent TKA and received a PG survey between November 2009 and January 2015 were analyzed. The PG survey overall hospital rating scores were correlated with standardized validated outcome assessment tools for TKA (Short form-12 and 36 Health Survey; Knee Society Score; Western Ontario and McMaster Universities Arthritis Index; University of California, Los Angeles; and visual analog scale) at a mean follow-up of 1154 days post-TKA. There was no correlation between PG survey overall hospital rating score and the above-mentioned outcome assessment tools. Our study shows that there is no statistically significant relationship between established arthroplasty assessment tools and the PG overall hospital rating. Therefore, PG surveys may not be an appropriate tool to determine reimbursement for orthopedists performing TKAs. Copyright © 2017 Elsevier Inc. All rights reserved.

PC tools for project management: Programs and the state-of-the-practice

NASA Technical Reports Server (NTRS)

Bishop, Peter C.; Freedman, Glenn B.; Dede, Christopher J.; Lidwell, William; Learned, David

1990-01-01

The use of microcomputer tools for NASA project management; which features are the most useful; the impact of these tools on job performance and individual style; and the prospects for new features in project management tools and related tools are addressed. High, mid, and low end PM tools are examined. The pro's and con's of the tools are assessed relative to various tasks. The strengths and weaknesses of the tools are presented through cases and demonstrations.

A Clinical Assessment Tool for Advanced Theory of Mind Performance in 5 to 12 Year Olds

ERIC Educational Resources Information Center

O'Hare, Anne E.; Bremner, Lynne; Nash, Marysia; Happe, Francesca; Pettigrew, Luisa M.

2009-01-01

One hundred forty typically developing 5- to 12-year-old children were assessed with a test of advanced theory of mind employing Happe's strange stories. There was no significant difference in performance between boys and girls. The stories discriminated performance across the different ages with the lowest performance being in the younger…

Training and Assessment of Hysteroscopic Skills: A Systematic Review.

PubMed

Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars; Tolsgaard, Martin G; Bjerrum, Flemming

2016-01-01

The aim of this systematic review was to identify studies on hysteroscopic training and assessment. PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%). This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Integration of tablet technologies in the e-laboratory of cytology: a health technology assessment.

PubMed

Giansanti, Daniele; Pochini, Marco; Giovagnoli, Maria Rosaria

2014-10-01

Although tablet systems are becoming a powerful technology, particularly useful in every application of medical imaging, to date no one has investigated the acceptance and performance of this technology in digital cytology. The specific aims of the work were (1) to design a health technology assessment (HTA) tool to assess, in terms of performance and acceptance, the introduction of tablet technologies (wearable, portable, and non portable) in the e-laboratories of cytology and (2) to test the tool in a first significant application of digital cytology. An HTA tool was proposed operating on a domain of five dimensions of investigation comprising the basic information of the product of digital cytology, the perceived subjective quality of images, the assessment of the virtual navigation on the e-slide, the assessment of the information and communication technologies features, and the diagnostic power. Six e-slides regarding studies of cervicovaginal cytology digitalized by means of an Aperio ( www.aperio.com ) scanner and uploaded onto the www.digitalslide.it Web site were used for testing the methodology on three different network connections. Three experts of cytology successfully tested the methodology on seven tablets found suitable for the study in their own standard configuration. Specific indexes furnished by the tool indicated both a high degree of performance and subjective acceptance of the investigated technology. The HTA tool thus could be useful to investigate new tablet technologies in digital cytology and furnish stakeholders with useful information that may help them make decisions involving the healthcare system. From a global point of view the study demonstrates the feasibility of using the tablet technology in digital cytology.

Prospective Comparison of Live Evaluation and Video Review in the Evaluation of Operator Performance in a Pediatric Emergency Airway Simulation

PubMed Central

House, Joseph B.; Dooley-Hash, Suzanne; Kowalenko, Terry; Sikavitsas, Athina; Seeyave, Desiree M.; Younger, John G.; Hamstra, Stanley J.; Nypaver, Michele M.

2012-01-01

Introduction Real-time assessment of operator performance during procedural simulation is a common practice that requires undivided attention by 1 or more reviewers, potentially over many repetitions of the same case. Objective To determine whether reviewers display better interrater agreement of procedural competency when observing recorded, rather than live, performance; and to develop an assessment tool for pediatric rapid sequence intubation (pRSI). Methods A framework of a previously established Objective Structured Assessment of Technical Skills (OSATS) tool was modified for pRSI. Emergency medicine residents (postgraduate year 1–4) were prospectively enrolled in a pRSI simulation scenario and evaluated by 2 live raters using the modified tool. Sessions were videotaped and reviewed by the same raters at least 4 months later. Raters were blinded to their initial rating. Interrater agreement was determined by using the Krippendorff generalized concordance method. Results Overall interrater agreement for live review was 0.75 (95% confidence interval [CI], 0.72–0.78) and for video was 0.79 (95% CI, 0.73–0.82). Live review was significantly superior to video review in only 1 of the OSATS domains (Preparation) and was equivalent in the other domains. Intrarater agreement between the live and video evaluation was very good, greater than 0.75 for all raters, with a mean of 0.81 (95% CI, 0.76–0.85). Conclusion The modified OSATS assessment tool demonstrated some evidence of validity in discriminating among levels of resident experience and high interreviewer reliability. With this tool, intrareviewer reliability was high between live and 4-months' delayed video review of the simulated procedure, which supports feasibility of delayed video review in resident assessment. PMID:23997874

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

PubMed

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients. This tool has three main components: the nursing process, communication skills, and safety management. Copyright © 2018 Elsevier Ltd. All rights reserved.

Toolbox of assessment tools of technical skills in otolaryngology-head and neck surgery: A systematic review.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2017-10-08

To support the development of programs of assessment of technical skills in the operating room (OR), we systematically reviewed the literature to identify assessment tools specific to otolaryngology-head and neck surgery (OTL-HNS) core procedures and summarized their characteristics. We systematically searched Embase, MEDLINE, PubMed, and Cochrane to identify and report on assessment tools that can be used to assess residents' technical surgical skills in the operating room for OTL-HNS core procedures. Of the 736 unique titles retrieved, 16 articles met inclusion criteria, covering 11 different procedures (in otology, rhinology, laryngology, head and neck, and general otolaryngology). The tools were composed of a task-specific checklist and/or global rating scale and were developed in the OR, on human cadavers, or in a simulation setting. Our study reports on published tools for assessing technical skills for OTL-HNS residents during core procedures conducted in the OR. These assessment tools could facilitate the provision of timely feedback to trainees including specific goals for improvement. However, the paucity of publications suggests little agreement on how to best perform work-based direct-observation assessment for core surgical procedures in OTL-HNS. The sparsity of tools specific to OTL-HNS may become a barrier to a fluid transition to competency-based medical education. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Assessing Army Values in New Soldiers: Development of a Behaviorally Anchored Peer Evaluation Form

DTIC Science & Technology

2015-02-03

evaluation has long been a valuable tool in school and workplace performance assessment, and has sparked military interest as a tool for leader...Values. Adhering to these values can affect Awards, promotions, selection to attend military schools , leadership positions, and desirable assignments (AR...by ratee and/or rater gender . Assessing the psychometric properties of AVBARS-PE The AVBARS-PE was administered to 50 BCT Soldiers (25 male and 25

API REST Web service and backend system Of Lecturer’s Assessment Information System on Politeknik Negeri Bali

NASA Astrophysics Data System (ADS)

Manuaba, I. B. P.; Rudiastini, E.

2018-01-01

Assessment of lecturers is a tool used to measure lecturer performance. Lecturer’s assessment variable can be measured from three aspects : teaching activities, research and community service. Broad aspect to measure the performance of lecturers requires a special framework, so that the system can be developed in a sustainable manner. Issues of this research is to create a API web service data tool, so the lecturer assessment system can be developed in various frameworks. The research was developed with web service and php programming language with the output of json extension data. The conclusion of this research is API web service data application can be developed using several platforms such as web, mobile application

Blinded evaluation of interrater reliability of an operative competency assessment tool for direct laryngoscopy and rigid bronchoscopy.

PubMed

Ishman, Stacey L; Benke, James R; Johnson, Kaalan Erik; Zur, Karen B; Jacobs, Ian N; Thorne, Marc C; Brown, David J; Lin, Sandra Y; Bhatti, Nasir; Deutsch, Ellen S

2012-10-01

OBJECTIVES To confirm interrater reliability using blinded evaluation of a skills-assessment instrument to assess the surgical performance of resident and fellow trainees performing pediatric direct laryngoscopy and rigid bronchoscopy in simulated models. DESIGN Prospective, paired, blinded observational validation study. SUBJECTS Paired observers from multiple institutions simultaneously evaluated residents and fellows who were performing surgery in an animal laboratory or using high-fidelity manikins. The evaluators had no previous affiliation with the residents and fellows and did not know their year of training. INTERVENTIONS One- and 2-page versions of an objective structured assessment of technical skills (OSATS) assessment instrument composed of global and a task-specific surgical items were used to evaluate surgical performance. RESULTS Fifty-two evaluations were completed by 17 attending evaluators. The instrument agreement for the 2-page assessment was 71.4% when measured as a binary variable (ie, competent vs not competent) (κ = 0.38; P = .08). Evaluation as a continuous variable revealed a 42.9% percentage agreement (κ = 0.18; P = .14). The intraclass correlation was 0.53, considered substantial/good interrater reliability (69% reliable). For the 1-page instrument, agreement was 77.4% when measured as a binary variable (κ = 0.53, P = .0015). Agreement when evaluated as a continuous measure was 71.0% (κ = 0.54, P < .001). The intraclass correlation was 0.73, considered high interrater reliability (85% reliable). CONCLUSIONS The OSATS assessment instrument is an effective tool for evaluating surgical performance among trainees with acceptable interrater reliability in a simulator setting. Reliability was good for both the 1- and 2-page OSATS checklists, and both serve as excellent tools to provide immediate formative feedback on operational competency.

Integrated Campaign Probabilistic Cost, Schedule, Performance, and Value for Program Office Support

NASA Technical Reports Server (NTRS)

Cornelius, David; Sasamoto, Washito; Daugherty, Kevin; Deacon, Shaun

2012-01-01

This paper describes an integrated assessment tool developed at NASA Langley Research Center that incorporates probabilistic analysis of life cycle cost, schedule, launch performance, on-orbit performance, and value across a series of planned space-based missions, or campaign. Originally designed as an aid in planning the execution of missions to accomplish the National Research Council 2007 Earth Science Decadal Survey, it utilizes Monte Carlo simulation of a series of space missions for assessment of resource requirements and expected return on investment. Interactions between simulated missions are incorporated, such as competition for launch site manifest, to capture unexpected and non-linear system behaviors. A novel value model is utilized to provide an assessment of the probabilistic return on investment. A demonstration case is discussed to illustrate the tool utility.

Performance of Fourth-Grade Students in the 2012 NAEP Computer-Based Writing Pilot Assessment: Scores, Text Length, and Use of Editing Tools. Working Paper Series. NCES 2015-119

ERIC Educational Resources Information Center

White, Sheida; Kim, Young Yee; Chen, Jing; Liu, Fei

2015-01-01

This study examined whether or not fourth-graders could fully demonstrate their writing skills on the computer and factors associated with their performance on the National Assessment of Educational Progress (NAEP) computer-based writing assessment. The results suggest that high-performing fourth-graders (those who scored in the upper 20 percent…

A surgical skills laboratory improves residents' knowledge and performance of episiotomy repair.

PubMed

Banks, Erika; Pardanani, Setul; King, Mary; Chudnoff, Scott; Damus, Karla; Freda, Margaret Comerford

2006-11-01

This study was undertaken to assess whether a surgical skills laboratory improves residents' knowledge and performance of episiotomy repair. Twenty-four first- and second-year residents were randomly assigned to either a surgical skills laboratory on episiotomy repair or traditional teaching alone. Pre- and posttests assessed basic knowledge. Blinded attending physicians assessed performance, evaluating residents on second-degree laceration/episiotomy repairs in the clinical setting with 3 validated tools: a task-specific checklist, global rating scale, and a pass-fail grade. Postgraduate year 1 (PGY-1) residents participating in the laboratory scored significantly better on all 3 surgical assessment tools: the checklist, the global score, and the pass/fail analysis. All the residents who had the teaching laboratory demonstrated significant improvements on knowledge and the skills checklist. PGY-2 residents did not benefit as much as PGY-1 residents. A surgical skills laboratory improved residents' knowledge and performance in the clinical setting. Improvement was greatest for PGY-1 residents.

Development and validation of an observation tool for the assessment of nursing pain management practices in intensive care unit in a standardized clinical simulation setting.

PubMed

Gosselin, Emilie; Bourgault, Patricia; Lavoie, Stephan; Coleman, Robin-Marie; Méziat-Burdin, Anne

2014-12-01

Pain management in the intensive care unit is often inadequate. There is no tool available to assess nursing pain management practices. The aim of this study was to develop and validate a measuring tool to assess nursing pain management in the intensive care unit during standardized clinical simulation. A literature review was performed to identify relevant components demonstrating optimal pain management in adult intensive care units and to integrate them in an observation tool. This tool was submitted to an expert panel and pretested. It was then used to assess pain management practice during 26 discrete standardized clinical simulation sessions with intensive care nurses. The Nursing Observation Tool for Pain Management (NOTPaM) contains 28 statements grouped into 8 categories, which are grouped into 4 dimensions: subjective assessment, objective assessment, interventions, and reassessment. The tool's internal consistency was calculated at a Cronbach's alpha of 0.436 for the whole tool; the alpha varies from 0.328 to 0.518 for each dimension. To evaluate the inter-rater reliability, intra-class correlation coefficient was used, which was calculated at 0.751 (p < .001) for the whole tool, with variations from 0.619 to 0.920 (p < .01) between dimensions. The expert panel was satisfied with the content and face validity of the tool. The psychometric qualities of the NOTPaM developed in this study are satisfactory. However, the tool could be improved with slight modifications. Nevertheless, it was useful in assessing intensive care nurses' pain management in a standardized clinical simulation. The NOTPaM is the first tool created for this purpose. Copyright © 2014 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Teamwork Assessment Tools in Modern Surgical Practice: A Systematic Review

PubMed Central

Whittaker, George; Abboudi, Hamid; Khan, Muhammed Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-01-01

Introduction. Deficiencies in teamwork skills have been shown to contribute to the occurrence of adverse events during surgery. Consequently, several teamwork assessment tools have been developed to evaluate trainee nontechnical performance. This paper aims to provide an overview of these instruments and review the validity of each tool. Furthermore, the present paper aims to review the deficiencies surrounding training and propose several recommendations to address these issues. Methods. A systematic literature search was conducted to identify teamwork assessment tools using MEDLINE (1946 to August 2015), EMBASE (1974 to August 2015), and PsycINFO (1806 to August 2015) databases. Results. Eight assessment tools which encompass aspects of teamwork were identified. The Nontechnical Skills for Surgeons (NOTSS) assessment was found to possess the highest level of validity from a variety of sources; reliability and acceptability have also been established for this tool. Conclusions. Deficits in current surgical training pathways have prompted several recommendations to meet the evolving requirements of surgeons. Recommendations from the current paper include integration of teamwork training and assessment into medical school curricula, standardised formal training of assessors to ensure accurate evaluation of nontechnical skill acquisition, and integration of concurrent technical and nontechnical skills training throughout training. PMID:26425732

Competency assessment tools: An exploration of the pedagogical issues facing competency assessment for nurses in the clinical environment.

PubMed

Franklin, Natasha; Melville, Paula

2015-01-01

Competency assessment is a paradigm that is common in the healthcare environment and this being particularly true within the nursing profession. Demonstration of competence is necessary to meet the requirements of healthcare organisations and is a mandated requirement of nurses by the Nursing and Midwifery Board of Australia. Within the nursing education sector, one approach to determine competence, is through the use of competency assessment tools. Despite widespread use of competency assessment tools there remains ongoing concerns relating to the efficacy of competency assessment tools as a mean to demonstrate 'competency' amongst enrolled and registered nurses in the clinical environment. The authors of this paper ascertain that competency assessment tools run a serious risk of being nothing more than a 'quick-fix' means of assessment to demonstrate 'nursing competence' required for key performance indicators and clinical governance and that will provide evidence for accreditation standards. Based on this premise, the authors, provide an alternative approach to the use of competency assessment tools that moves away from a 'tick-box' approach to a 'patient-centred' competency model. This approach increases the reliability and validity of competency assessments, allows for the recognition of the knowledge, skills and experience of individual nurses, offers a more satisfying and rewarding approach to demonstrating 'competency' for nurses and finally, demonstrates 'real-life' competency.

In response to 'Can sugars be produced from fatty acids? A test case for pathway analysis tools'.

PubMed

Faust, Karoline; Croes, Didier; van Helden, Jacques

2009-12-01

In their article entitled 'Can sugars be produced from fatty acids? A test case for pathway analysis tools' de Figueiredo and co-authors assess the performance of three pathway prediction tools (METATOOL, PathFinding and Pathway Hunter Tool) using the synthesis of glucose-6-phosphate (G6P) from acetyl-CoA in humans as a test case. We think that this article is biased for three reasons: (i) the metabolic networks used as input for the respective tools were of very different sizes; (ii) the 'assessment' is restricted to two study cases; (iii) developers are inherently more skilled to use their own tools than those developed by other people. We extended the analyses led by de Figueiredo and clearly show that the apparent superior performance of their tool (METATOOL) is partly due to the differences in input network sizes. We also see a conceptual problem in the comparison of tools that serve different purposes. In our opinion, metabolic path finding and elementary mode analysis are answering different biological questions, and should be considered as complementary rather than competitive approaches. Supplementary data are available at Bioinformatics online.

Model Performance Evaluation and Scenario Analysis (MPESA)

EPA Pesticide Factsheets

Model Performance Evaluation and Scenario Analysis (MPESA) assesses the performance with which models predict time series data. The tool was developed Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM)

Predicting Airport Screening Officers' Visual Search Competency With a Rapid Assessment.

PubMed

Mitroff, Stephen R; Ericson, Justin M; Sharpe, Benjamin

2018-03-01

Objective The study's objective was to assess a new personnel selection and assessment tool for aviation security screeners. A mobile app was modified to create a tool, and the question was whether it could predict professional screeners' on-job performance. Background A variety of professions (airport security, radiology, the military, etc.) rely on visual search performance-being able to detect targets. Given the importance of such professions, it is necessary to maximize performance, and one means to do so is to select individuals who excel at visual search. A critical question is whether it is possible to predict search competency within a professional search environment. Method Professional searchers from the USA Transportation Security Administration (TSA) completed a rapid assessment on a tablet-based X-ray simulator (XRAY Screener, derived from the mobile technology app Airport Scanner; Kedlin Company). The assessment contained 72 trials that were simulated X-ray images of bags. Participants searched for prohibited items and tapped on them with their finger. Results Performance on the assessment significantly related to on-job performance measures for the TSA officers such that those who were better XRAY Screener performers were both more accurate and faster at the actual airport checkpoint. Conclusion XRAY Screener successfully predicted on-job performance for professional aviation security officers. While questions remain about the underlying cognitive mechanisms, this quick assessment was found to significantly predict on-job success for a task that relies on visual search performance. Application It may be possible to quickly assess an individual's visual search competency, which could help organizations select new hires and assess their current workforce.

Development and Validation of a Family Meeting Assessment Tool (FMAT).

PubMed

Hagiwara, Yuya; Healy, Jennifer; Lee, Shuko; Ross, Jeanette; Fischer, Dixie; Sanchez-Reilly, Sandra

2018-01-01

A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Objective Data Assessment (ODA) Methods as Nutritional Assessment Tools.

PubMed

Hamada, Yasuhiro

2015-01-01

Nutritional screening and assessment should be a standard of care for all patients because nutritional management plays an important role in clinical practice. However, there is no gold standard for the diagnosis of malnutrition or undernutrition, although a large number of nutritional screening and assessment tools have been developed. Nutritional screening and assessment tools are classified into two categories, namely, subjective global assessment (SGA) and objective data assessment (ODA). SGA assesses nutritional status based on the features of medical history and physical examination. On the other hand, ODA consists of objective data provided from various analyses, such as anthropometry, bioimpedance analysis (BIA), dual-energy X-ray absorptiometry (DEXA), computed tomography (CT), magnetic resonance imaging (MRI), laboratory tests, and functional tests. This review highlights knowledge on the performance of ODA methods for the assessment of nutritional status in clinical practice. J. Med. Invest. 62: 119-122, August, 2015.

Assessment of learning powered mobility use--applying grounded theory to occupational performance.

PubMed

Nilsson, Lisbeth; Durkin, Josephine

2014-01-01

Collaboration by two grounded theory researchers, who each had developed a learning continuum instrument, led to the emergence of a new tool for assessment of learning powered mobility use. We undertook a rigorous process of comparative reanalysis that included merging, modifying, and expanding our previous research findings. A new instrument together with its facilitating strategies emerged in the course of revisits to our existing rich account of data taken from real environment powered mobility practice over an extensive time period. Instrument descriptors, categories, phases, and stages allow a facilitator to assess actual phase and plot actual occupational performance and provide a learner with the just right challenge through the learning process. Facilitating strategies are described for each of the phases and provide directions for involvement during learner performance. The learning approach is led by a belief system that the intervention is user-led, working in partnership and empowering the learner. The new assessment tool is inclusive of every potential powered mobility user because it focuses on the whole continuum of the learning process of powered mobility use from novice to expert. The new tool was appraised by clinicians and has been used successfully in clinical practice in the United Kingdom and Sweden.

Analysis of Online Quizzes as a Teaching and Assessment Tool

ERIC Educational Resources Information Center

Salas-Morera, Lorenzo; Arauzo-Azofra, Antonio; García-Hernández, Laura

2012-01-01

This article deals with the integrated use of online quizzes as a teaching and assessment tool in the general program of the subject Proyectos in the third course of Ingeniero Técnico en Informática de Gestión over five consecutive years. The research undertaken aimed to test quizzes effectiveness on student performance when used, not only as an…

Additional Support for the Information Systems Analyst Exam as a Valid Program Assessment Tool

ERIC Educational Resources Information Center

Carpenter, Donald A.; Snyder, Johnny; Slauson, Gayla Jo; Bridge, Morgan K.

2011-01-01

This paper presents a statistical analysis to support the notion that the Information Systems Analyst (ISA) exam can be used as a program assessment tool in addition to measuring student performance. It compares ISA exam scores earned by students in one particular Computer Information Systems program with scores earned by the same students on the…

Assessing hand hygiene resources and practices at a large african teaching hospital.

PubMed

Owusu-Ofori, Alex; Jennings, Rebecca; Burgess, Jennifer; Prasad, Priya A; Acheampong, Faustina; Coffin, Susan E

2010-08-01

To gather baseline data on hand hygiene (HH) practices in an African hospital with a newly established infection prevention and control team. Cross-sectional, observational study. Setting. Komfo Anokye Teaching Hospital, a large teaching hospital in Ghana with approximately 1,000 beds. All hospital staff with patient contact were eligible for assessment of HH practices. HH observations were conducted using a standardized data collection tool and method based on the World Health Organization's "5 Moments of Hand Hygiene." Small-group interviews were conducted to gather additional information on perceptions of HH and barriers to its use. HH resource needs were also assessed using a standardized tool. HH was attempted in 12% of the opportunities and was performed appropriately in 4% of the opportunities. Most main wards (89%) had at least 1 functional HH station. The most commonly identified barriers to HH were limited resources and lack of knowledge on appropriate times to perform HH. We developed and applied tools to evaluate HH resources and practices in a large African hospital. These assessments were undertaken to guide future efforts to improve HH at this hospital but can also serve as a model of the way to perform a systematic assessment at acute care hospitals in developing countries.

Validation of the National Aeronautics and Space Administration Task Load Index as a tool to evaluate the learning curve for endoscopy training.

PubMed

Mohamed, Rachid; Raman, Maitreyi; Anderson, John; McLaughlin, Kevin; Rostom, Alaa; Coderre, Sylvain

2014-03-01

Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking. To validate such a workload tool and use it to map the progression of novice trainees in gastroenterology in performing their first endoscopies. The National Aeronautics and Space Administration Task Load Index (NASA-TLX) workload assessment tool was completed by eight novice trainees in gastroenterology and 10 practicing gastroenterologists⁄surgeons. An exploratory factor analysis was performed to construct a streamlined endoscopy-specific task load index, which was subsequently validated. The 'Endoscopy Task Load Index' was used to monitor progression of trainee exertion and self-assessed performance over their first 40 procedures. From the factor analysis of the NASA-TLX, two principal components emerged: a measure of exertion and a measure of self-efficacy. These items became the components of the newly validated Endoscopy Task Load Index. There was a steady decline in self-perceived exertion over the training period, which was more rapid for gastroscopy than colonoscopy. The self-efficacy scores for gastroscopy rapidly increased over the first few procedures, reaching a plateau after this period of time. For colonoscopy, there was a progressive increase in reported self-efficacy over the first three quartiles of procedures, followed by a drop in self-efficacy scores over the final quartile. The present study validated an Endoscopy Task Load Index that can be completed in <1 min. Practical implications of such a tool in endoscopy education include identifying periods of higher perceived exertion among novice endoscopists, facilitating appropriate levels of guidance from trainers.

Dental Students' Perceptions of Digital Assessment Software for Preclinical Tooth Preparation Exercises.

PubMed

Park, Carly F; Sheinbaum, Justin M; Tamada, Yasushi; Chandiramani, Raina; Lian, Lisa; Lee, Cliff; Da Silva, John; Ishikawa-Nagai, Shigemi

2017-05-01

Objective self-assessment is essential to learning and continued competence in dentistry. A computer-assisted design/computer-assisted manufacturing (CAD/CAM) learning software (prepCheck, Sirona) allows students to objectively assess their performance in preclinical prosthodontics. The aim of this study was to evaluate students' perceptions of CAD/CAM learning software for preclinical prosthodontics exercises. In 2014, all third-year dental students at Harvard School of Dental Medicine (n=36) were individually instructed by a trained faculty member in using prepCheck. Each student completed a preclinical formative exercise (#18) and summative examination (#30) for ceramometal crown preparation and evaluated the preparation using five assessment tools (reduction, margin width, surface finish, taper, and undercut) in prepCheck. The students then rated each of the five tools for usefulness, user-friendliness, and frequency of use on a scale from 1=lowest to 5=highest. Faculty members graded the tooth preparations as pass (P), marginal-pass (MP), or fail (F). The survey response rate was 100%. The tools for undercut and taper had the highest scores for usefulness, user-friendliness, and frequency of use. The reduction tool score was significantly lower in all categories (p<0.01). There were significant differences in usefulness (p<0.05) and user-friendliness (p<0.05) scores among the P, MP, and F groups. These results suggest that the prepCheck taper and undercut tools were useful for the students' learning process in a preclinical exercise. The students' perceptions of prepCheck and their preclinical performance were related, and those students who performed poorest rated the software as significantly more useful.

Simulation for Prediction of Entry Article Demise (SPEAD): An Analysis Tool for Spacecraft Safety Analysis and Ascent/Reentry Risk Assessment

NASA Technical Reports Server (NTRS)

Ling, Lisa

2014-01-01

For the purpose of performing safety analysis and risk assessment for a potential off-nominal atmospheric reentry resulting in vehicle breakup, a synthesis of trajectory propagation coupled with thermal analysis and the evaluation of node failure is required to predict the sequence of events, the timeline, and the progressive demise of spacecraft components. To provide this capability, the Simulation for Prediction of Entry Article Demise (SPEAD) analysis tool was developed. The software and methodology have been validated against actual flights, telemetry data, and validated software, and safety/risk analyses were performed for various programs using SPEAD. This report discusses the capabilities, modeling, validation, and application of the SPEAD analysis tool.

Virtual reality and neuropsychological assessment: The reliability of a virtual kitchen to assess daily-life activities in victims of traumatic brain injury.

PubMed

Besnard, Jeremy; Richard, Paul; Banville, Frederic; Nolin, Pierre; Aubin, Ghislaine; Le Gall, Didier; Richard, Isabelle; Allain, Phillippe

2016-01-01

Traumatic brain injury (TBI) causes impairments affecting instrumental activities of daily living (IADL). However, few studies have considered virtual reality as an ecologically valid tool for the assessment of IADL in patients who have sustained a TBI. The main objective of the present study was to examine the use of the Nonimmersive Virtual Coffee Task (NI-VCT) for IADL assessment in patients with TBI. We analyzed the performance of 19 adults suffering from TBI and 19 healthy controls (HCs) in the real and virtual tasks of making coffee with a coffee machine, as well as in global IQ and executive functions. Patients performed worse than HCs on both real and virtual tasks and on all tests of executive functions. Correlation analyses revealed that NI-VCT scores were related to scores on the real task. Moreover, regression analyses demonstrated that performance on NI-VCT matched real-task performance. Our results support the idea that the virtual kitchen is a valid tool for IADL assessment in patients who have sustained a TBI.

The accountability of clinical education: its definition and assessment.

PubMed

Murray, E; Gruppen, L; Catton, P; Hays, R; Woolliscroft, J O

2000-10-01

Medical education is not exempt from increasing societal expectations of accountability. Competition for financial resources requires medical educators to demonstrate cost-effective educational practice; health care practitioners, the products of medical education programmes, must meet increasing standards of professionalism; the culture of evidence-based medicine demands an evaluation of the effect educational programmes have on health care and service delivery. Educators cannot demonstrate that graduates possess the required attributes, or that their programmes have the desired impact on health care without appropriate assessment tools and measures of outcome. To determine to what extent currently available assessment approaches can measure potentially relevant medical education outcomes addressing practitioner performance, health care delivery and population health, in order to highlight areas in need of research and development. Illustrative publications about desirable professional behaviour were synthesized to obtain examples of required competencies and health outcomes. A MEDLINE search for available assessment tools and measures of health outcome was performed. There are extensive tools for assessing clinical skills and knowledge. Some work has been done on the use of professional judgement for assessing professional behaviours; scholarship; and multiprofessional team working; but much more is needed. Very little literature exists on assessing group attributes of professionals, such as clinical governance, evidence-based practice and workforce allocation, and even less on examining individual patient or population health indices. The challenge facing medical educators is to develop new tools, many of which will rely on professional judgement, for assessing these broader competencies and outcomes.

Validity evidence for the Simulated Colonoscopy Objective Performance Evaluation scoring system.

PubMed

Trinca, Kristen D; Cox, Tiffany C; Pearl, Jonathan P; Ritter, E Matthew

2014-02-01

Low-cost, objective systems to assess and train endoscopy skills are needed. The aim of this study was to evaluate the ability of Simulated Colonoscopy Objective Performance Evaluation to assess the skills required to perform endoscopy. Thirty-eight subjects were included in this study, all of whom performed 4 tasks. The scoring system measured performance by calculating precision and efficiency. Data analysis assessed the relationship between colonoscopy experience and performance on each task and the overall score. Endoscopic trainees' Simulated Colonoscopy Objective Performance Evaluation scores correlated significantly with total colonoscopy experience (r = .61, P = .003) and experience in the past 12 months (r = .63, P = .002). Significant differences were seen among practicing endoscopists, nonendoscopic surgeons, and trainees (P < .0001). When the 4 tasks were analyzed, each showed significant correlation with colonoscopy experience (scope manipulation, r = .44, P = .044; tool targeting, r = .45, P = .04; loop management, r = .47, P = .032; mucosal inspection, r = .65, P = .001) and significant differences in performance between the endoscopist groups, except for mucosal inspection (scope manipulation, P < .0001; tool targeting, P = .002; loop management, P = .0008; mucosal inspection, P = .27). Simulated Colonoscopy Objective Performance Evaluation objectively assesses the technical skills required to perform endoscopy and shows promise as a platform for proficiency-based skills training. Published by Elsevier Inc.

[Validation of a nutritional screening tool for hospitalized pediatric patients].

PubMed

Lama More, R A; Moráis López, A; Herrero Álvarez, M; Caraballo Chicano, S; Galera Martínez, R; López Ruzafa, E; Rodríguez Martínez, G; de la Mano Hernández, A; Rivero de la Rosa, M C

2012-01-01

Malnutrition among hospitalized patients has clinical implications, and interest has arisen to find screening tools able to identify subjects under risk. At present, there is no consensus about the most suitable nutrition screening tool for pediatric patients. To validate STAMP (Screening Tool for the Assessment of Malnutrition in Pediatrics) pediatric screening tool in Spain. Descriptive cross-sectional study of patients admitted to a 3rd level children's hospital with both medical and surgical specialities. During the first 24 hours of admission, STAMP screening tool was applied. For its validation, results were compared with those obtained from a nutritional assessment performed by specialist staff, which included clinical, anthropometric and body composition data. A sample of 250 children was studied. Nutritional assessment identified 64 patients (25.6%) under risk, 40 of whom were malnourished (16%). STAMP classified 48.4% of the patients as being under nutritional risk. This tool showed 75% sensitivity and 60.8% specificity when identifying patients under risk according to nutritional assessment. It showed 90% sensitivity and 59.5% specificity when identifying malnourished patients. Malnutrition was less frequent than that reported in other European countries, although diagnosis technique was different. STAMP is a simple and useful tool for nutritional screening, avoiding the need to assess all patients on admission in order to identify those under nutritional risk.

Performance comparison of SNP detection tools with illumina exome sequencing data—an assessment using both family pedigree information and sample-matched SNP array data

PubMed Central

Yi, Ming; Zhao, Yongmei; Jia, Li; He, Mei; Kebebew, Electron; Stephens, Robert M.

2014-01-01

To apply exome-seq-derived variants in the clinical setting, there is an urgent need to identify the best variant caller(s) from a large collection of available options. We have used an Illumina exome-seq dataset as a benchmark, with two validation scenarios—family pedigree information and SNP array data for the same samples, permitting global high-throughput cross-validation, to evaluate the quality of SNP calls derived from several popular variant discovery tools from both the open-source and commercial communities using a set of designated quality metrics. To the best of our knowledge, this is the first large-scale performance comparison of exome-seq variant discovery tools using high-throughput validation with both Mendelian inheritance checking and SNP array data, which allows us to gain insights into the accuracy of SNP calling through such high-throughput validation in an unprecedented way, whereas the previously reported comparison studies have only assessed concordance of these tools without directly assessing the quality of the derived SNPs. More importantly, the main purpose of our study was to establish a reusable procedure that applies high-throughput validation to compare the quality of SNP discovery tools with a focus on exome-seq, which can be used to compare any forthcoming tool(s) of interest. PMID:24831545

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method.

PubMed

Kunz, Derek; Pariyadath, Manoj; Wittler, Mary; Askew, Kim; Manthey, David; Hartman, Nicholas

2017-06-01

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality. We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States. We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency. Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts. © 2017 by the American Institute of Ultrasound in Medicine.

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

PubMed

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in standardizing the assessment of surgical skills.

Impact of workplace based assessment on doctors' education and performance: a systematic review.

PubMed

Miller, Alice; Archer, Julian

2010-09-24

To investigate the literature for evidence that workplace based assessment affects doctors' education and performance. Systematic review. The primary data sources were the databases Journals@Ovid, Medline, Embase, CINAHL, PsycINFO, and ERIC. Evidence based reviews (Bandolier, Cochrane Library, DARE, HTA Database, and NHS EED) were accessed and searched via the Health Information Resources website. Reference lists of relevant studies and bibliographies of review articles were also searched. Review methods Studies of any design that attempted to evaluate either the educational impact of workplace based assessment, or the effect of workplace based assessment on doctors' performance, were included. Studies were excluded if the sampled population was non-medical or the study was performed with medical students. Review articles, commentaries, and letters were also excluded. The final exclusion criterion was the use of simulated patients or models rather than real life clinical encounters. Sixteen studies were included. Fifteen of these were non-comparative descriptive or observational studies; the other was a randomised controlled trial. Study quality was mixed. Eight studies examined multisource feedback with mixed results; most doctors felt that multisource feedback had educational value, although the evidence for practice change was conflicting. Some junior doctors and surgeons displayed little willingness to change in response to multisource feedback, whereas family physicians might be more prepared to initiate change. Performance changes were more likely to occur when feedback was credible and accurate or when coaching was provided to help subjects identify their strengths and weaknesses. Four studies examined the mini-clinical evaluation exercise, one looked at direct observation of procedural skills, and three were concerned with multiple assessment methods: all these studies reported positive results for the educational impact of workplace based assessment tools. However, there was no objective evidence of improved performance with these tools. Considering the emphasis placed on workplace based assessment as a method of formative performance assessment, there are few published articles exploring its impact on doctors' education and performance. This review shows that multisource feedback can lead to performance improvement, although individual factors, the context of the feedback, and the presence of facilitation have a profound effect on the response. There is no evidence that alternative workplace based assessment tools (mini-clinical evaluation exercise, direct observation of procedural skills, and case based discussion) lead to improvement in performance, although subjective reports on their educational impact are positive.

A tool for assessment of heart failure prescribing quality: A systematic review and meta-analysis.

PubMed

El Hadidi, Seif; Darweesh, Ebtissam; Byrne, Stephen; Bermingham, Margaret

2018-04-16

Heart failure (HF) guidelines aim to standardise patient care. Internationally, prescribing practice in HF may deviate from guidelines and so a standardised tool is required to assess prescribing quality. A systematic review and meta-analysis were performed to identify a quantitative tool for measuring adherence to HF guidelines and its clinical implications. Eleven electronic databases were searched to include studies reporting a comprehensive tool for measuring adherence to prescribing guidelines in HF patients aged ≥18 years. Qualitative studies or studies measuring prescription rates alone were excluded. Study quality was assessed using the Good ReseArch for Comparative Effectiveness Checklist. In total, 2455 studies were identified. Sixteen eligible full-text articles were included (n = 14 354 patients, mean age 69 ± 8 y). The Guideline Adherence Index (GAI), and its modified versions, was the most frequently cited tool (n = 13). Other tools identified were the Individualised Reconciled Evidence Recommendations, the Composite Heart Failure Performance, and the Heart Failure Scale. The meta-analysis included the GAI studies of good to high quality. The average GAI-3 was 62%. Compared to low GAI, high GAI patients had lower mortality rate (7.6% vs 33.9%) and lower rehospitalisation rates (23.5% vs 24.5%); both P ≤ .05. High GAI was associated with reduced risk of mortality (hazard ratio = 0.29, 95% confidence interval, 0.06-0.51) and rehospitalisation (hazard ratio = 0.64, 95% confidence interval, 0.41-1.00). No tool was used to improve prescribing quality. The GAI is the most frequently used tool to assess guideline adherence in HF. High GAI is associated with improved HF outcomes. Copyright © 2018 John Wiley & Sons, Ltd.

Using a Personal Development Plan for Different Purposes: Its Influence on Undertaking Learning Activities and Job Performance

ERIC Educational Resources Information Center

Beausaert, Simon A. J.; Segers, Mien S. R.; Gijselaers, Wim H.

2011-01-01

Today, organizations are increasingly implementing assessment tools such as Personal Development Plans. Although the true power of the tool lies in supporting the employee's continuing professional development, organizations implement the tool for various different purposes, professional development purposes on the one hand and promotion/salary…

Automated near-real-time clinical performance feedback for anesthesiology residents: one piece of the milestones puzzle.

PubMed

Ehrenfeld, Jesse M; McEvoy, Matthew D; Furman, William R; Snyder, Dylan; Sandberg, Warren S

2014-01-01

Anesthesiology residencies are developing trainee assessment tools to evaluate 25 milestones that map to the six core competencies. The effort will be facilitated by development of automated methods to capture, assess, and report trainee performance to program directors, the Accreditation Council for Graduate Medical Education and the trainees themselves. The authors leveraged a perioperative information management system to develop an automated, near-real-time performance capture and feedback tool that provides objective data on clinical performance and requires minimal administrative effort. Before development, the authors surveyed trainees about satisfaction with clinical performance feedback and about preferences for future feedback. Resident performance on 24,154 completed cases has been incorporated into the authors' automated dashboard, and trainees now have access to their own performance data. Eighty percent (48 of 60) of the residents responded to the feedback survey. Overall, residents "agreed/strongly agreed" that they desire frequent updates on their clinical performance on defined quality metrics and that they desired to see how they compared with the residency as a whole. Before deployment of the new tool, they "disagreed" that they were receiving feedback in a timely manner. Survey results were used to guide the format of the feedback tool that has been implemented. The authors demonstrate the implementation of a system that provides near-real-time feedback concerning resident performance on an extensible series of quality metrics, and which is responsive to requests arising from resident feedback about desired reporting mechanisms.

Automated Near Real-Time Clinical Performance Feedback for Anesthesiology Residents: One Piece of the Milestones Puzzle

PubMed Central

Ehrenfeld, Jesse M.; McEvoy, Matthew D.; Furman, William R.; Snyder, Dylan; Sandberg, Warren S.

2014-01-01

Background Anesthesiology residencies are developing trainee assessment tools to evaluate 25 milestones that map to the 6 core competencies. The effort will be facilitated by development of automated methods to capture, assess, and report trainee performance to program directors, the Accreditation Council for Graduate Medical Education and the trainees themselves. Methods We leveraged a perioperative information management system to develop an automated, near-real-time performance capture and feedback tool that provides objective data on clinical performance and requires minimal administrative effort. Prior to development, we surveyed trainees about satisfaction with clinical performance feedback and about preferences for future feedback. Results Resident performance on 24,154 completed cases has been incorporated into our automated dashboard, and trainees now have access to their own performance data. Eighty percent (48 of 60) of our residents responded to the feedback survey. Overall, residents ‘agreed/strongly agreed’ that they desire frequent updates on their clinical performance on defined quality metrics and that they desired to see how they compared to the residency as a whole. Prior to deployment of the new tool, they ‘disagreed’ that they were receiving feedback in a timely manner. Survey results were used to guide the format of the feedback tool that has been implemented. Conclusions We demonstrate the implementation of a system that provides near real-time feedback concerning resident performance on an extensible series of quality metrics, and which is responsive to requests arising from resident feedback about desired reporting mechanisms. PMID:24398735

Thermal Performance Data Services (TPDS)

NASA Technical Reports Server (NTRS)

French, Richard T.; Wright, Michael J.

2013-01-01

Initiated as a NASA Engineering and Safety Center (NESC) assessment in 2009, the Thermal Performance Database (TPDB) was a response to the need for a centralized thermal performance data archive. The assessment was renamed Thermal Performance Data Services (TPDS) in 2012; the undertaking has had two fronts of activity: the development of a repository software application and the collection of historical thermal performance data sets from dispersed sources within the thermal performance community. This assessment has delivered a foundational tool on which additional features should be built to increase efficiency, expand the protection of critical Agency investments, and provide new discipline-advancing work opportunities. This report contains the information from the assessment.

The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource

Thoracic ultrasound: Potential new tool for physiotherapists in respiratory management. A narrative review.

PubMed

Le Neindre, Aymeric; Mongodi, Silvia; Philippart, François; Bouhemad, Bélaïd

2016-02-01

The use of diagnostic ultrasound by physiotherapists is not a new concept; it is frequently performed in musculoskeletal physiotherapy. Physiotherapists currently lack accurate, reliable, sensitive, and valid measurements for the assessment of the indications and effectiveness of chest physiotherapy. Thoracic ultrasound may be a promising tool for the physiotherapist and could be routinely performed at patients' bedsides to provide real-time and accurate information on the status of pleura, lungs, and diaphragm; this would allow for assessment of lung aeration from interstitial syndrome to lung consolidation with much better accuracy than chest x-rays or auscultation. Diaphragm excursion and contractility may also be assessed by ultrasound. This narrative review refers to lung and diaphragm ultrasound semiology and describes how physiotherapists could use this tool in their clinical decision-making processes in various cases of respiratory disorders. The use of thoracic ultrasound semiology alongside typical examinations may allow for the guiding, monitoring, and evaluating of chest physiotherapy treatments. Thoracic ultrasound is a potential new tool for physiotherapists. Copyright © 2015 Elsevier Inc. All rights reserved.

An Examination of Pennsylvania's Classroom Diagnostic Testing as a Predictive Model of Pennsylvania System of School Assessment Performance

ERIC Educational Resources Information Center

Matsanka, Christopher

2017-01-01

The purpose of this non-experimental quantitative study was to investigate the relationship between Pennsylvania's Classroom Diagnostic Tools (CDT) interim assessments and the state-mandated Pennsylvania System of School Assessment (PSSA) and to create linear regression equations that could be used as models to predict student performance on the…

Performance of a computer-based assessment of cognitive function measures in two cohorts of seniors

USDA-ARS?s Scientific Manuscript database

Computer-administered assessment of cognitive function is being increasingly incorporated in clinical trials, however its performance in these settings has not been systematically evaluated. The Seniors Health and Activity Research Program (SHARP) pilot trial (N=73) developed a computer-based tool f...

Making It Personal: Performance-Based Assessments, Ubiquitous Technology, and Advanced Learners

ERIC Educational Resources Information Center

Arispe, Kelly; Burston, Jack

2017-01-01

This pedagogical implementation study advocates for performance-driven assessments to help learners become aware of and improve upon presentational speaking skills at the advanced level. A social media content creation tool, Adobe Spark Video, enabled learners to practice oral skills outside of class. The task design, implementation, and…

Assessing Performance When the Stakes are High.

ERIC Educational Resources Information Center

Crawford, William R.

This paper is concerned with measuring achievement levels of medical students. Precise tools are needed to assess the readiness of an individual to practice. The basic question then becomes, what can this candidate do, at a given time, under given circumstances. Given the definition of the circumstances, and the candidate's performance, the…

Development and Usefulness of a District Health Systems Tool for Performance Improvement in Essential Public Health Functions in Botswana and Mozambique.

PubMed

Bishai, David; Sherry, Melissa; Pereira, Claudia C; Chicumbe, Sergio; Mbofana, Francisco; Boore, Amy; Smith, Monica; Nhambi, Leonel; Borse, Nagesh N

2016-01-01

This study describes the development of a self-audit tool for public health and the associated methodology for implementing a district health system self-audit tool that can provide quantitative data on how district governments perceive their performance of the essential public health functions. Development began with a consensus-building process to engage Ministry of Health and provincial health officers in Mozambique and Botswana. We then worked with lists of relevant public health functions as determined by these stakeholders to adapt a self-audit tool describing essential public health functions to each country's health system. We then piloted the tool across districts in both countries and conducted interviews with district health personnel to determine health workers' perception of the usefulness of the approach. Country stakeholders were able to develop consensus around 11 essential public health functions that were relevant in each country. Pilots of the self-audit tool enabled the tool to be effectively shortened. Pilots also disclosed a tendency to upcode during self-audits that was checked by group deliberation. Convening sessions at the district enabled better attendance and representative deliberation. Instant feedback from the audit was a feature that 100% of pilot respondents found most useful. The development of metrics that provide feedback on public health performance can be used as an aid in the self-assessment of health system performance at the district level. Measurements of practice can open the door to future applications for practice improvement and research into the determinants and consequences of better public health practice. The current tool can be assessed for its usefulness to district health managers in improving their public health practice. The tool can also be used by the Ministry of Health or external donors in the African region for monitoring the district-level performance of the essential public health functions.

Development and Usefulness of a District Health Systems Tool for Performance Improvement in Essential Public Health Functions in Botswana and Mozambique

PubMed Central

Bishai, David; Sherry, Melissa; Pereira, Claudia C.; Chicumbe, Sergio; Mbofana, Francisco; Boore, Amy; Smith, Monica; Nhambi, Leonel; Borse, Nagesh N.

2018-01-01

Introduction This study describes the development of a self-audit tool for public health and the associated methodology for implementing a district health system self-audit tool that can provide quantitative data on how district governments perceive their own performance of the essential public health functions. Methods Development began with a consensus building process to engage Ministry of Health and provincial health officers in Mozambique and Botswana. We then worked with lists of relevant public health functions as determined by these stakeholders to adapt a self-audit tool describing essential public health functions to each country’s health system. We then piloted the tool across districts in both countries and conducted interviews with district health personnel to determine health workers’ perception of the usefulness of the approach. Results Country stakeholders were able to develop consensus around eleven essential public health functions that were relevant in each country. Pilots of the self-audit tool enabled the tool to be effectively shortened. Pilots also disclosed a tendency to up code during self-audits that was checked by group deliberation. Convening sessions at the district enabled better attendance and representative deliberation. Instant feedback from the audit was a feature that 100% of pilot respondents found most useful. Conclusions The development of metrics that provide feedback on public health performance can be used as an aid in the self-assessment of health system performance at the district level. Measurements of practice can open the door to future applications for practice improvement and research into the determinants and consequences of better public health practice. The current tool can be assessed for its usefulness to district health managers in improving their public health practice. The tool can also be used by ministry of health or external donors in the African region for monitoring the district level performance of the essential public health functions. PMID:27682727

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites

PubMed Central

Steinwachs, Donald; Rubin, Haya R

2003-01-01

Background Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness. Objective This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality. Methods An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness. Results Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80. Conclusions Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information. PMID:14713658

The Surgical Safety Checklist and Teamwork Coaching Tools: a study of inter-rater reliability.

PubMed

Huang, Lyen C; Conley, Dante; Lipsitz, Stu; Wright, Christopher C; Diller, Thomas W; Edmondson, Lizabeth; Berry, William R; Singer, Sara J

2014-08-01

To assess the inter-rater reliability (IRR) of two novel observation tools for measuring surgical safety checklist performance and teamwork. Data surgical safety checklists can promote adherence to standards of care and improve teamwork in the operating room. Their use has been associated with reductions in mortality and other postoperative complications. However, checklist effectiveness depends on how well they are performed. Authors from the Safe Surgery 2015 initiative developed a pair of novel observation tools through literature review, expert consultation and end-user testing. In one South Carolina hospital participating in the initiative, two observers jointly attended 50 surgical cases and independently rated surgical teams using both tools. We used descriptive statistics to measure checklist performance and teamwork at the hospital. We assessed IRR by measuring percent agreement, Cohen's κ, and weighted κ scores. The overall percent agreement and κ between the two observers was 93% and 0.74 (95% CI 0.66 to 0.79), respectively, for the Checklist Coaching Tool and 86% and 0.84 (95% CI 0.77 to 0.90) for the Surgical Teamwork Tool. Percent agreement for individual sections of both tools was 79% or higher. Additionally, κ scores for six of eight sections on the Checklist Coaching Tool and for two of five domains on the Surgical Teamwork Tool achieved the desired 0.7 threshold. However, teamwork scores were high and variation was limited. There were no significant changes in the percent agreement or κ scores between the first 10 and last 10 cases observed. Both tools demonstrated substantial IRR and required limited training to use. These instruments may be used to observe checklist performance and teamwork in the operating room. However, further refinement and calibration of observer expectations, particularly in rating teamwork, could improve the utility of the tools. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Sensors vs. experts - a performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients.

PubMed

Marschollek, Michael; Rehwald, Anja; Wolf, Klaus-Hendrik; Gietzelt, Matthias; Nemitz, Gerhard; zu Schwabedissen, Hubertus Meyer; Schulze, Mareike

2011-06-28

Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data. In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched. Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores. Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach.

Sensors vs. experts - A performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients

PubMed Central

2011-01-01

Background Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data. Methods In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched. Results Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores. Conclusions Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach. PMID:21711504

Assessment tools for unrecognized myocardial infarction: a cross-sectional analysis of the REasons for geographic and racial differences in stroke population

PubMed Central

2013-01-01

Background Routine electrocardiograms (ECGs) are not recommended for asymptomatic patients because the potential harms are thought to outweigh any benefits. Assessment tools to identify high risk individuals may improve the harm versus benefit profile of screening ECGs. In particular, people with unrecognized myocardial infarction (UMI) have elevated risk for cardiovascular events and death. Methods Using logistic regression, we developed a basic assessment tool among 16,653 participants in the REasons for Geographic and Racial Differences in Stroke (REGARDS) study using demographics, self-reported medical history, blood pressure, and body mass index and an expanded assessment tool using information on 51 potential variables. UMI was defined as electrocardiogram evidence of myocardial infarction without a self-reported history (n = 740). Results The basic assessment tool had a c-statistic of 0.638 (95% confidence interval 0.617 - 0.659) and included age, race, smoking status, body mass index, systolic blood pressure, and self-reported history of transient ischemic attack, deep vein thrombosis, falls, diabetes, and hypertension. A predicted probability of UMI > 3% provided a sensitivity of 80% and a specificity of 30%. The expanded assessment tool had a c-statistic of 0.654 (95% confidence interval 0.634-0.674). Because of the poor performance of these assessment tools, external validation was not pursued. Conclusions Despite examining a large number of potential correlates of UMI, the assessment tools did not provide a high level of discrimination. These data suggest defining groups with high prevalence of UMI for targeted screening will be difficult. PMID:23530553

Development and Initial Validation of the NyTid Test: A Movement Assessment Tool for Compulsory School Pupils

ERIC Educational Resources Information Center

Tidén, Anna; Lundqvist, Carolina; Nyberg, Marie

2015-01-01

This study presents the development process and initial validation of the NyTid test, a process-oriented movement assessment tool for compulsory school pupils. A sample of 1,260 (627 girls and 633 boys; mean age of 14.39) Swedish school children participated in the study. In the first step, exploratory factor analyses (EFAs) were performed in…

Floristic Quality Index of Restored Wetlands in Coastal Louisiana

DTIC Science & Technology

2017-08-01

been used to monitor and assess project performance, resilience, and adaptive management needs. An emerging tool for performing bioassessments in...condition have been used to monitor and assess project performance, resilience, and adaptive management needs. There are three basic levels of wetland...result of saltwater intrusion and rapid subsidence; nevertheless, multiple hydrologic restoration projects (Naomi Outfall Management BA-03c and

Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer's disease.

PubMed

Vallejo, Vanessa; Wyss, Patric; Rampa, Luca; Mitache, Andrei V; Müri, René M; Mosimann, Urs P; Nef, Tobias

2017-01-01

Despite growing interest in developing ecological assessment of difficulties in patients with Alzheimer's disease new methods assessing the cognitive difficulties related to functional activities are missing. To complete current evaluation, the use of Serious Games can be a promising approach as it offers the possibility to recreate a virtual environment with daily living activities and a precise and complete cognitive evaluation. The aim of the present study was to evaluate the usability and the screening potential of a new ecological tool for assessment of cognitive functions in patients with Alzheimer's disease. Eighteen patients with Alzheimer's disease and twenty healthy controls participated to the study. They were asked to complete six daily living virtual tasks assessing several cognitive functions: three navigation tasks, one shopping task, one cooking task and one table preparation task following a one-day scenario. Usability of the game was evaluated through a questionnaire and through the analysis of the computer interactions for the two groups. Furthermore, the performances in terms of time to achieve the task and percentage of completion on the several tasks were recorded. Results indicate that both groups subjectively found the game user friendly and they were objectively able to play the game without computer interactions difficulties. Comparison of the performances between the two groups indicated a significant difference in terms of percentage of achievement of the several tasks and in terms of time they needed to achieve the several tasks. This study suggests that this new Serious Game based assessment tool is a user-friendly and ecological method to evaluate the cognitive abilities related to the difficulties patients can encounter in daily living activities and can be used as a screening tool as it allowed to distinguish Alzheimer's patient's performance from healthy controls.

Using a virtual reality game to assess goal-directed hand movements in children: A pilot feasibility study.

PubMed

Gabyzon, M Elboim; Engel-Yeger, B; Tresser, S; Springer, S

2016-01-01

Virtual reality gaming environments may be used as a supplement to the motor performance assessment tool box by providing clinicians with quantitative information regarding motor performance in terms of movement accuracy and speed, as well as sensory motor integration under different levels of dual tasking. To examine the feasibility of using the virtual reality game `Timocco' as an assessment tool for evaluating goal-directed hand movements among typically developing children. In this pilot study, 47 typically-developing children were divided into two age groups, 4-6 years old and 6-8 years old. Performance was measured using two different virtual environment games (Bubble Bath and Falling Fruit), each with two levels of difficulty. Discriminative validity (age effect) was examined by comparing the performance of the two groups, and by comparing the performance between levels of the games for each group (level effect). Test-retest reliability was examined by reassessing the older children 3-7 days after the first session. The older children performed significantly better in terms of response time, action time, game duration, and efficiency in both games compared to the younger children. Both age groups demonstrated poorer performance at the higher game level in the Bubble Bath game compared to the lower level. A similar level effect was found in the Falling Fruit game for both age groups in response time and efficiency, but not in action time. The performance of the older children was not significantly different between the two sessions at both game levels. The discriminative validity and test-retest reliability indicate the feasibility of using the Timocco virtual reality game as a tool for assessing goal-directed hand movements in children. Further studies should examine its feasibility for use in children with disabilities.

Towards early software reliability prediction for computer forensic tools (case study).

PubMed

Abu Talib, Manar

2016-01-01

Versatility, flexibility and robustness are essential requirements for software forensic tools. Researchers and practitioners need to put more effort into assessing this type of tool. A Markov model is a robust means for analyzing and anticipating the functioning of an advanced component based system. It is used, for instance, to analyze the reliability of the state machines of real time reactive systems. This research extends the architecture-based software reliability prediction model for computer forensic tools, which is based on Markov chains and COSMIC-FFP. Basically, every part of the computer forensic tool is linked to a discrete time Markov chain. If this can be done, then a probabilistic analysis by Markov chains can be performed to analyze the reliability of the components and of the whole tool. The purposes of the proposed reliability assessment method are to evaluate the tool's reliability in the early phases of its development, to improve the reliability assessment process for large computer forensic tools over time, and to compare alternative tool designs. The reliability analysis can assist designers in choosing the most reliable topology for the components, which can maximize the reliability of the tool and meet the expected reliability level specified by the end-user. The approach of assessing component-based tool reliability in the COSMIC-FFP context is illustrated with the Forensic Toolkit Imager case study.

Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff.

PubMed

Guru, Khurshid A; Esfahani, Ehsan T; Raza, Syed J; Bhat, Rohit; Wang, Katy; Hammond, Yana; Wilding, Gregory; Peabody, James O; Chowriappa, Ashirwad J

2015-01-01

To investigate the utility of cognitive assessment during robot-assisted surgery (RAS) to define skills in terms of cognitive engagement, mental workload, and mental state; while objectively differentiating between novice and expert surgeons. In all, 10 surgeons with varying operative experience were assigned to beginner (BG), combined competent and proficient (CPG), and expert (EG) groups based on the Dreyfus model. The participants performed tasks for basic, intermediate and advanced skills on the da Vinci Surgical System. Participant performance was assessed using both tool-based and cognitive metrics. Tool-based metrics showed significant differences between the BG vs CPG and the BG vs EG, in basic skills. While performing intermediate skills, there were significant differences only on the instrument-to-instrument collisions between the BG vs CPG (2.0 vs 0.2, P = 0.028), and the BG vs EG (2.0 vs 0.1, P = 0.018). There were no significant differences between the CPG and EG for both basic and intermediate skills. However, using cognitive metrics, there were significant differences between all groups for the basic and intermediate skills. In advanced skills, there were no significant differences between the CPG and the EG except time (1116 vs 599.6 s), using tool-based metrics. However, cognitive metrics revealed significant differences between both groups. Cognitive assessment of surgeons may aid in defining levels of expertise performing complex surgical tasks once competence is achieved. Cognitive assessment may be used as an adjunct to the traditional methods for skill assessment during RAS. © 2014 The Authors. BJU International © 2014 BJU International.

Assessing the Integration of Audience Response System Technology in Teaching of Anatomical Sciences

PubMed Central

Alexander, Cara J.; Crescini, Weronika M.; Juskewitch, Justin E.; Lachman, Nirusha; Pawlina, Wojciech

2009-01-01

The goals of our study were to determine the predictive value and usability of an audience response system (ARS) as a knowledge assessment tool in an undergraduate medical curriculum. Over a three year period (2006–2008), data were collected from first year didactic blocks in Genetics/Histology and Anatomy/Radiology (n=42–50 per class). During each block, students answered clinically oriented multiple choice questions using the ARS. Students’ performances were recorded and cumulative ARS scores were compared with final examination performances. Correlation coefficients between these variables were calculated to assess the existence and direction of an association between ARS and final examination score. If associations existed, univariate models were then constructed using ARS as a predictor of final examination score. Student and faculty perception of ARS difficulty, usefulness, effect on performance, and preferred use were evaluated using a questionnaire. There was a statistically significant positive correlation between ARS and final examination scores in all didactic blocks and predictive univariate models were constructed for each relationship (all P < 0.0001). Students and faculty agreed that ARS was easy to use and are liable tool for providing real-time feedback that improved their performance and participation. In conclusion, we found ARS to be an effective assessment tool benefiting the faculty and the students in a curriculum focused on interaction and self-directed learning. PMID:19670428

Assessing the integration of audience response system technology in teaching of anatomical sciences.

PubMed

Alexander, Cara J; Crescini, Weronika M; Juskewitch, Justin E; Lachman, Nirusha; Pawlina, Wojciech

2009-01-01

The goals of our study were to determine the predictive value and usability of an audience response system (ARS) as a knowledge assessment tool in an undergraduate medical curriculum. Over a three year period (2006-2008), data were collected from first year didactic blocks in Genetics/Histology and Anatomy/Radiology (n = 42-50 per class). During each block, students answered clinically oriented multiple choice questions using the ARS. Students' performances were recorded and cumulative ARS scores were compared with final examination performances. Correlation coefficients between these variables were calculated to assess the existence and direction of an association between ARS and final examination score. If associations existed, univariate models were then constructed using ARS as a predictor of final examination score. Student and faculty perception of ARS difficulty, usefulness, effect on performance, and preferred use were evaluated using a questionnaire. There was a statistically significant positive correlation between ARS and final examination scores in all didactic blocks and predictive univariate models were constructed for each relationship (all P < 0.0001). Students and faculty agreed that ARS was easy to use and a reliable tool for providing real-time feedback that improved their performance and participation. In conclusion, we found ARS to be an effective assessment tool benefiting the faculty and the students in a curriculum focused on interaction and self-directed learning. 2009 American Association of Anatomists

The validity of a professional competence tool for physiotherapy students in simulation-based clinical education: a Rasch analysis.

PubMed

Judd, Belinda K; Scanlan, Justin N; Alison, Jennifer A; Waters, Donna; Gordon, Christopher J

2016-08-05

Despite the recent widespread adoption of simulation in clinical education in physiotherapy, there is a lack of validated tools for assessment in this setting. The Assessment of Physiotherapy Practice (APP) is a comprehensive tool used in clinical placement settings in Australia to measure professional competence of physiotherapy students. The aim of the study was to evaluate the validity of the APP for student assessment in simulation settings. A total of 1260 APPs were collected, 971 from students in simulation and 289 from students in clinical placements. Rasch analysis was used to examine the construct validity of the APP tool in three different simulation assessment formats: longitudinal assessment over 1 week of simulation; longitudinal assessment over 2 weeks; and a short-form (25 min) assessment of a single simulation scenario. Comparison with APPs from 5 week clinical placements in hospital and clinic-based settings were also conducted. The APP demonstrated acceptable fit to the expectations of the Rasch model for the 1 and 2 week clinical simulations, exhibiting unidimensional properties that were able to distinguish different levels of student performance. For the short-form simulation, nine of the 20 items recorded greater than 25 % of scores as 'not-assessed' by clinical educators which impacted on the suitability of the APP tool in this simulation format. The APP was a valid assessment tool when used in longitudinal simulation formats. A revised APP may be required for assessment in short-form simulation scenarios.

Applications of an architecture design and assessment system (ADAS)

NASA Technical Reports Server (NTRS)

Gray, F. Gail; Debrunner, Linda S.; White, Tennis S.

1988-01-01

A new Architecture Design and Assessment System (ADAS) tool package is introduced, and a range of possible applications is illustrated. ADAS was used to evaluate the performance of an advanced fault-tolerant computer architecture in a modern flight control application. Bottlenecks were identified and possible solutions suggested. The tool was also used to inject faults into the architecture and evaluate the synchronization algorithm, and improvements are suggested. Finally, ADAS was used as a front end research tool to aid in the design of reconfiguration algorithms in a distributed array architecture.

Development of Sustainability Assessment Tool for Malaysian hydropower industry: A case study

NASA Astrophysics Data System (ADS)

Turan, Faiz Mohd; Johan, Kartina; Abu Sofian, Muhammad Irfan

2018-04-01

This research deals with the development of sustainability assessment tools as a medium to assess the performance of a hydropower project compliances towards sustainability practice. Since the increasing needs of implementing sustainability practice, developed countries are utilizing sustainability tools to achieve sustainable development goals. Its inception within ASEAN countries including Malaysia is still low. The problem with most tools developed from other countries is that it is not very comprehensive as well as its implementation factors are not suitable for the local environment that is not quantified. Hence, there is a need to develop a suitable sustainable assessment tool for the Malaysian hydropower industry to comply with the sustainable development goals as a bridging gap between the governor and the practitioner. The steps of achieving this goal is separated into several parts. The first part is to identify sustainable parameters from established tools as a model for comparison to enhance new parameters. The second stage is to convert equivalent quantification value from the model to the new developed tools. The last stage is to develop software program as a mean of gaining energy company feedback with systematic sustainable reporting from the surveyor so as to be able to integrate sustainability assessment, monitoring and reporting for self-improved reporting.

Advanced Engineering Technology for Measuring Performance.

PubMed

Rutherford, Drew N; D'Angelo, Anne-Lise D; Law, Katherine E; Pugh, Carla M

2015-08-01

The demand for competency-based assessments in surgical training is growing. Use of advanced engineering technology for clinical skills assessment allows for objective measures of hands-on performance. Clinical performance can be assessed in several ways via quantification of an assessee's hand movements (motion tracking), direction of visual attention (eye tracking), levels of stress (physiologic marker measurements), and location and pressure of palpation (force measurements). Innovations in video recording technology and qualitative analysis tools allow for a combination of observer- and technology-based assessments. Overall the goal is to create better assessments of surgical performance with robust validity evidence. Copyright © 2015 Elsevier Inc. All rights reserved.

The back squat: A proposed assessment of functional deficits and technical factors that limit performance

PubMed Central

Myer, Gregory D.; Kushner, Adam M.; Brent, Jensen L.; Schoenfeld, Brad J.; Hugentobler, Jason; Lloyd, Rhodri S.; Vermeil, Al; Chu, Donald A.; Harbin, Jason; McGill, Stuart M.

2014-01-01

Fundamental movement competency is essential for participation in physical activity and for mitigating the risk of injury, which are both key elements of health throughout life. The squat movement pattern is arguably one of the most primal and critical fundamental movements necessary to improve sport performance, to reduce injury risk and to support lifelong physical activity. Based on current evidence, this first (1 of 2) report deconstructs the technical performance of the back squat as a foundation training exercise and presents a novel dynamic screening tool that incorporates identification techniques for functional deficits that limit squat performance and injury resilience. The follow-up report will outline targeted corrective methodology for each of the functional deficits presented in the assessment tool. PMID:25506270

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

NASA Technical Reports Server (NTRS)

Houchin, Scott; Porter, Brian; Graybill, Justin; Slingerland, Philip

2017-01-01

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

A flexible tool for hydraulic and water quality performance analysis of green infrastructure

NASA Astrophysics Data System (ADS)

Massoudieh, A.; Alikhani, J.

2017-12-01

Models that allow for design considerations of green infrastructure (GI) practices to control stormwater runoff and associated contaminants have received considerable attention in recent years. To be used to evaluate the effect design configurations on the long-term performance of GIs, models should be able to consider processes within GIs with good fidelity. In this presentation, a sophisticated, yet flexible tool for hydraulic and water quality assessment of GIs will be introduced. The tool can be used by design engineers and researchers to capture and explore the effect of design factors and properties of the media employed in the performance of GI systems at a relatively small scale. We deemed it essential to have a flexible GI modeling tool that is capable of simulating GI system components and specific biogeochemical processes affecting contaminants such as evapotranspiration, plant uptake, reactions, and particle-associated transport accurately while maintaining a high degree of flexibility to account for the myriad of GI alternatives. The mathematical framework for a stand-alone GI performance assessment tool has been developed and will be demonstrated. The process-based model framework developed here can be used to model a diverse range of GI practices such as stormwater ponds, green roofs, retention ponds, bioretention systems, infiltration trench, permeable pavement and other custom-designed combinatory systems. An example of the application of the system to evaluate the performance of a rain-garden system will be demonstrated.

Influence of bone mineral density measurement on fracture risk assessment tool® scores in postmenopausal Indian women.

PubMed

Daswani, Bhavna; Desai, Meena; Mitra, Sumegha; Gavali, Shubhangi; Patil, Anushree; Kukreja, Subhash; Khatkhatay, M Ikram

2016-03-01

Fracture risk assessment tool® calculations can be performed with or without addition of bone mineral density; however, the impact of this addition on fracture risk assessment tool® scores has not been studied in Indian women. Given the limited availability and high cost of bone mineral density testing in India, it is important to know the influence of bone mineral density on fracture risk assessment tool® scores in Indian women. Therefore, our aim was to assess the contribution of bone mineral density in fracture risk assessment tool® outcome in Indian women. Apparently healthy postmenopausal Indian women (n = 506), aged 40-72 years, without clinical risk factors for bone disease, were retrospectively selected, and their fracture risk assessment tool® scores calculated with and without bone mineral density were compared. Based on WHO criteria, 30% women were osteoporotic, 42.9% were osteopenic and 27.1% had normal bone mineral density. Fracture risk assessment tool® scores for risk of both major osteoporotic fracture and hip fracture significantly increased on including bone mineral density (P < 0.0001). When criteria of National Osteoporosis Foundation, US was applied number of participants eligible for medical therapy increased upon inclusion of bone mineral density, (for major osteoporotic fracture risk number of women eligible without bone mineral density was 0 and with bone mineral density was 1, P > 0.05, whereas, for hip fracture risk number of women eligible without bone mineral density was 2 and with bone mineral density was 17, P < 0.0001). Until the establishment of country-specific medication intervention thresholds, bone mineral density should be included while calculating fracture risk assessment tool® scores in Indian women. © The Author(s) 2016.

U.S. Team Green Building Challenge 2002

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

2002-09-01

Flier about the U.S. Team and its projects participating in the International Green Building Challenge. Along with many other countries, the United States accepted the Green Building Challenge (GBC), an international effort to evaluate and improve the performance of buildings worldwide. GBC started out in 1996 as a competition to determine which country had the greenest buildings; it evolved into a cooperative process among the countries to measure the performance of green buildings. Although the auto industry can easily measure efficiency in terms of miles per gallon, the buildings industry has no standard way to quantify energy and environmental performance.more » The Green Building Challenge participants hope that better tools for measuring the energy and environmental performance of buildings will be an outcome of their efforts and that these tools will lead to higher and better performance levels in buildings around the world. The ultimate goal is to design, construct, and operate buildings that contribute to global sustainability by conserving and/or regenerating natural resources and minimizing nonrenewable energy use. The United States' Green Building Challenge Team '02 selected five buildings from around the country to serve as case studies; each of the five U.S. building designs (as well as all international case studies) were assessed using an in-depth evaluation tool, called the Green Building Assessment Tool (GBTool). The GBTool was specifically created and refined by international teams, for the GBC efforts. The goal of this collaborative effort is to improve this evaluation software tool so that it can be used globally, while taking into account regional and national conditions. The GBTool was used by the U.S. Team to assess and evaluate the energy and environmental performance of these five buildings: (1) Retail (in operation): BigHorn Home Improvement Center, Silverthorne, Colorado; (2) Office (in operation), Philip Merrill Environmental; (3) School (in construction), Clearview Elementary School, Hanover, Pennsylvania; (4) Multi-family residential (in construction), Twenty River Terrace, Battery Park City, New York; and (5) Office/lab (in design), National Oceanic Atmospheric Administration, Honolulu, Hawaii. These projects were selected, not only because they were good examples of high-performance buildings and had interested owners/design team members, but also because building data was available as inputs to test the software tool. Both the tool and the process have been repeatedly refined and enhanced since the first Green Building Challenge event in 1998; participating countries are continuously providing feedback to further improve the tool and global process for the greatest positive effect.« less

A comparative assessment of tools for ecosystem services quantification and valuation

USGS Publications Warehouse

Bagstad, Kenneth J.; Semmens, Darius; Waage, Sissel; Winthrop, Robert

2013-01-01

To enter widespread use, ecosystem service assessments need to be quantifiable, replicable, credible, flexible, and affordable. With recent growth in the field of ecosystem services, a variety of decision-support tools has emerged to support more systematic ecosystem services assessment. Despite the growing complexity of the tool landscape, thorough reviews of tools for identifying, assessing, modeling and in some cases monetarily valuing ecosystem services have generally been lacking. In this study, we describe 17 ecosystem services tools and rate their performance against eight evaluative criteria that gauge their readiness for widespread application in public- and private-sector decision making. We describe each of the tools′ intended uses, services modeled, analytical approaches, data requirements, and outputs, as well time requirements to run seven tools in a first comparative concurrent application of multiple tools to a common location – the San Pedro River watershed in southeast Arizona, USA, and northern Sonora, Mexico. Based on this work, we offer conclusions about these tools′ current ‘readiness’ for widespread application within both public- and private-sector decision making processes. Finally, we describe potential pathways forward to reduce the resource requirements for running ecosystem services models, which are essential to facilitate their more widespread use in environmental decision making.

NATIONAL URBAN DATABASE AND ACCESS PROTAL TOOL

EPA Science Inventory

Current mesoscale weather prediction and microscale dispersion models are limited in their ability to perform accurate assessments in urban areas. A project called the National Urban Database with Access Portal Tool (NUDAPT) is beginning to provide urban data and improve the para...

Validation of the National Aeronautics and Space Administration Task Load Index as a tool to evaluate-the learning curve for endoscopy training

PubMed Central

Mohamed, Rachid; Raman, Maitreyi; Anderson, John; McLaughlin, Kevin; Rostom, Alaa; Coderre, Sylvain

2014-01-01

BACKGROUND: Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking. OBJECTIVE: To validate such a workload tool and use it to map the progression of novice trainees in gastroenterology in performing their first endoscopies. METHODS: The National Aeronautics and Space Administration Task Load Index (NASA-TLX) workload assessment tool was completed by eight novice trainees in gastroenterology and 10 practicing gastroenterologists/surgeons. An exploratory factor analysis was performed to construct a streamlined endoscopy-specific task load index, which was subsequently validated. The ‘Endoscopy Task Load Index’ was used to monitor progression of trainee exertion and self-assessed performance over their first 40 procedures. RESULTS: From the factor analysis of the NASA-TLX, two principal components emerged: a measure of exertion and a measure of self-efficacy. These items became the components of the newly validated Endoscopy Task Load Index. There was a steady decline in self-perceived exertion over the training period, which was more rapid for gastroscopy than colonoscopy. The self-efficacy scores for gastroscopy rapidly increased over the first few procedures, reaching a plateau after this period of time. For colonoscopy, there was a progressive increase in reported self-efficacy over the first three quartiles of procedures, followed by a drop in self-efficacy scores over the final quartile. DISCUSSION: The present study validated an Endoscopy Task Load Index that can be completed in <1 min. Practical implications of such a tool in endoscopy education include identifying periods of higher perceived exertion among novice endoscopists, facilitating appropriate levels of guidance from trainers. PMID:24619638

Rapid assessment of infrastructure of primary health care facilities - a relevant instrument for health care systems management.

PubMed

Scholz, Stefan; Ngoli, Baltazar; Flessa, Steffen

2015-05-01

Health care infrastructure constitutes a major component of the structural quality of a health system. Infrastructural deficiencies of health services are reported in literature and research. A number of instruments exist for the assessment of infrastructure. However, no easy-to-use instruments to assess health facility infrastructure in developing countries are available. Present tools are not applicable for a rapid assessment by health facility staff. Therefore, health information systems lack data on facility infrastructure. A rapid assessment tool for the infrastructure of primary health care facilities was developed by the authors and pilot-tested in Tanzania. The tool measures the quality of all infrastructural components comprehensively and with high standardization. Ratings use a 2-1-0 scheme which is frequently used in Tanzanian health care services. Infrastructural indicators and indices are obtained from the assessment and serve for reporting and tracing of interventions. The tool was pilot-tested in Tanga Region (Tanzania). The pilot test covered seven primary care facilities in the range between dispensary and district hospital. The assessment encompassed the facilities as entities as well as 42 facility buildings and 80 pieces of technical medical equipment. A full assessment of facility infrastructure was undertaken by health care professionals while the rapid assessment was performed by facility staff. Serious infrastructural deficiencies were revealed. The rapid assessment tool proved a reliable instrument of routine data collection by health facility staff. The authors recommend integrating the rapid assessment tool in the health information systems of developing countries. Health authorities in a decentralized health system are thus enabled to detect infrastructural deficiencies and trace the effects of interventions. The tool can lay the data foundation for district facility infrastructure management.

Assessing hospital disaster preparedness: a comparison of an on-site survey, directly observed drill performance, and video analysis of teamwork.

PubMed

Kaji, Amy H; Langford, Vinette; Lewis, Roger J

2008-09-01

There is currently no validated method for assessing hospital disaster preparedness. We determine the degree of correlation between the results of 3 methods for assessing hospital disaster preparedness: administration of an on-site survey, drill observation using a structured evaluation tool, and video analysis of team performance in the hospital incident command center. This was a prospective, observational study conducted during a regional disaster drill, comparing the results from an on-site survey, a structured disaster drill evaluation tool, and a video analysis of teamwork, performed at 6 911-receiving hospitals in Los Angeles County, CA. The on-site survey was conducted separately from the drill and assessed hospital disaster plan structure, vendor agreements, modes of communication, medical and surgical supplies, involvement of law enforcement, mutual aid agreements with other facilities, drills and training, surge capacity, decontamination capability, and pharmaceutical stockpiles. The drill evaluation tool, developed by Johns Hopkins University under contract from the Agency for Healthcare Research and Quality, was used to assess various aspects of drill performance, such as the availability of the hospital disaster plan, the geographic configuration of the incident command center, whether drill participants were identifiable, whether the noise level interfered with effective communication, and how often key information (eg, number of available staffed floor, intensive care, and isolation beds; number of arriving victims; expected triage level of victims; number of potential discharges) was received by the incident command center. Teamwork behaviors in the incident command center were quantitatively assessed, using the MedTeams analysis of the video recordings obtained during the disaster drill. Spearman rank correlations of the results between pair-wise groupings of the 3 assessment methods were calculated. The 3 evaluation methods demonstrated qualitatively different results with respect to each hospital's level of disaster preparedness. The Spearman rank correlation coefficient between the results of the on-site survey and the video analysis of teamwork was -0.34; between the results of the on-site survey and the structured drill evaluation tool, 0.15; and between the results of the video analysis and the drill evaluation tool, 0.82. The disparate results obtained from the 3 methods suggest that each measures distinct aspects of disaster preparedness, and perhaps no single method adequately characterizes overall hospital preparedness.

Review of the tactical evaluation tools for youth players, assessing the tactics in team sports: football.

PubMed

González-Víllora, Sixto; Serra-Olivares, Jaime; Pastor-Vicedo, Juan Carlos; da Costa, Israel Teoldo

2015-01-01

For sports assessment to be comprehensive, it must address all variables of sports development, such as psychological, social-emotional, physical and physiological, technical and tactical. Tactical assessment has been a neglected variable until the 1980s or 1990s. In the last two decades (1995-2015), the evolution of tactical assessment has grown considerably, given its importance in game performance. The aim of this paper is to compile and analyze different tactical measuring tools in team sports, particularly in soccer, through a bibliographical review. Six tools have been selected on five different criteria: (1) Instruments which assess tactics, (2) The studies have an evolution approach related to the tactical principles, (3) With a valid and reliable method, (4) The existence of publications mentioning the tool in the method, v. Applicable in different sports contexts. All six tools are structured around seven headings: introduction, objective(s), tactical principles, materials, procedures, instructions/rules of the game and published studies. In conclusion, the teaching-learning processes more tactical oriented have useful tactical assessment instrument in the literature. The selection of one or another depends some context information, like age and level of expertise of the players.

Development of computer-based analytical tool for assessing physical protection system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mardhi, Alim, E-mail: alim-m@batan.go.id; Chulalongkorn University, Faculty of Engineering, Nuclear Engineering Department, 254 Phayathai Road, Pathumwan, Bangkok Thailand. 10330; Pengvanich, Phongphaeth, E-mail: ppengvan@gmail.com

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work,more » we have developed a computer–based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system’s detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.« less

Development of computer-based analytical tool for assessing physical protection system

NASA Astrophysics Data System (ADS)

Mardhi, Alim; Pengvanich, Phongphaeth

2016-01-01

Assessment of physical protection system effectiveness is the priority for ensuring the optimum protection caused by unlawful acts against a nuclear facility, such as unauthorized removal of nuclear materials and sabotage of the facility itself. Since an assessment based on real exercise scenarios is costly and time-consuming, the computer-based analytical tool can offer the solution for approaching the likelihood threat scenario. There are several currently available tools that can be used instantly such as EASI and SAPE, however for our research purpose it is more suitable to have the tool that can be customized and enhanced further. In this work, we have developed a computer-based analytical tool by utilizing the network methodological approach for modelling the adversary paths. The inputs are multi-elements in security used for evaluate the effectiveness of the system's detection, delay, and response. The tool has capability to analyze the most critical path and quantify the probability of effectiveness of the system as performance measure.

National Energy Audit Tool for Multifamily Buildings Development Plan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Malhotra, Mini; MacDonald, Michael; Accawi, Gina K

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program (WAP) enables low-income families to reduce their energy costs by providing funds to make their homes more energy efficient. In addition, the program funds Weatherization Training and Technical Assistance (T and TA) activities to support a range of program operations. These activities include measuring and documenting performance, monitoring programs, promoting advanced techniques and collaborations to further improve program effectiveness, and training, including developing tools and information resources. The T and TA plan outlines the tasks, activities, and milestones to support the weatherization network with the program implementation ramp up efforts. Weatherizationmore » of multifamily buildings has been recognized as an effective way to ramp up weatherization efforts. To support this effort, the 2009 National Weatherization T and TA plan includes the task of expanding the functionality of the Weatherization Assistant, a DOE-sponsored family of energy audit computer programs, to perform audits for large and small multifamily buildings This report describes the planning effort for a new multifamily energy audit tool for DOE's WAP. The functionality of the Weatherization Assistant is being expanded to also perform energy audits of small multifamily and large multifamily buildings. The process covers an assessment of needs that includes input from national experts during two national Web conferences. The assessment of needs is then translated into capability and performance descriptions for the proposed new multifamily energy audit, with some description of what might or should be provided in the new tool. The assessment of needs is combined with our best judgment to lay out a strategy for development of the multifamily tool that proceeds in stages, with features of an initial tool (version 1) and a more capable version 2 handled with currently available resources. Additional development in the future is expected to be needed if more capabilities are to be added. A rough schedule for development of the version 1 tool is presented. The components and capabilities described in this plan will serve as the starting point for development of the proposed new multifamily energy audit tool for WAP.« less

Human Factors Tools for Improving Simulation Activities in Continuing Medical Education

ERIC Educational Resources Information Center

Seagull, F. Jacob

2012-01-01

Human factors (HF) is a discipline often drawn upon when there is a need to train people to perform complex, high-stakes tasks and effectively assess their performance. Complex tasks often present unique challenges for training and assessment. HF has developed specialized techniques that have been effective in overcoming several of these…

Correlation of United States Medical Licensing Examination and Internal Medicine In-Training Examination Performance

ERIC Educational Resources Information Center

Perez, Jose A., Jr.; Greer, Sharon

2009-01-01

The Internal Medicine In-Training Examination (ITE) is administered during residency training in the United States as a self-assessment and program assessment tool. Performance on this exam correlates with outcome on the American Board of Internal Medicine Certifying examination. Internal Medicine Program Directors use the United States Medical…

Driving and Low Vision: Validity of Assessments for Predicting Performance of Drivers

ERIC Educational Resources Information Center

Strong, J. Graham; Jutai, Jeffrey W.; Russell-Minda, Elizabeth; Evans, Mal

2008-01-01

The authors conducted a systematic review to examine whether vision-related assessments can predict the driving performance of individuals who have low vision. The results indicate that measures of visual field, contrast sensitivity, cognitive and attention-based tests, and driver screening tools have variable utility for predicting real-world…

Assessing the nutritional status of hospitalized elderly.

PubMed

Abd Aziz, Nur Adilah Shuhada; Teng, Nur Islami Mohd Fahmi; Abdul Hamid, Mohd Ramadan; Ismail, Nazrul Hadi

2017-01-01

The increasing number of elderly people worldwide throughout the years is concerning due to the health problems often faced by this population. This review aims to summarize the nutritional status among hospitalized elderly and the role of the nutritional assessment tools in this issue. A literature search was performed on six databases using the terms "malnutrition", "hospitalised elderly", "nutritional assessment", "Mini Nutritional Assessment (MNA)", "Geriatric Nutrition Risk Index (GNRI)", and "Subjective Global Assessment (SGA)". According to the previous studies, the prevalence of malnutrition among hospitalized elderly shows an increasing trend not only locally but also across the world. Under-recognition of malnutrition causes the number of malnourished hospitalized elderly to remain high throughout the years. Thus, the development of nutritional screening and assessment tools has been widely studied, and these tools are readily available nowadays. SGA, MNA, and GNRI are the nutritional assessment tools developed specifically for the elderly and are well validated in most countries. However, to date, there is no single tool that can be considered as the universal gold standard for the diagnosis of nutritional status in hospitalized patients. It is important to identify which nutritional assessment tool is suitable to be used in this group to ensure that a structured assessment and documentation of nutritional status can be established. An early and accurate identification of the appropriate treatment of malnutrition can be done as soon as possible, and thus, the malnutrition rate among this group can be minimized in the future.

Evaluation of operational, economic, and environmental performance of mixed and selective collection of municipal solid waste: Porto case study.

PubMed

Teixeira, Carlos A; Russo, Mário; Matos, Cristina; Bentes, Isabel

2014-12-01

This article describes an accurate methodology for an operational, economic, and environmental assessment of municipal solid waste collection. The proposed methodological tool uses key performance indicators to evaluate independent operational and economic efficiency and performance of municipal solid waste collection practices. These key performance indicators are then used in life cycle inventories and life cycle impact assessment. Finally, the life cycle assessment environmental profiles provide the environmental assessment. We also report a successful application of this tool through a case study in the Portuguese city of Porto. Preliminary results demonstrate the applicability of the methodological tool to real cases. Some of the findings focus a significant difference between average mixed and selective collection effective distance (2.14 km t(-1); 16.12 km t(-1)), fuel consumption (3.96 L t(-1); 15.37 L t(-1)), crew productivity (0.98 t h(-1) worker(-1); 0.23 t h(-1) worker(-1)), cost (45.90 € t(-1); 241.20 € t(-1)), and global warming impact (19.95 kg CO2eq t(-1); 57.47 kg CO2eq t(-1)). Preliminary results consistently indicate: (a) higher global performance of mixed collection as compared with selective collection; (b) dependency of collection performance, even in urban areas, on the waste generation rate and density; (c) the decline of selective collection performances with decreasing source-separated material density and recycling collection rate; and (d) that the main threats to collection route efficiency are the extensive collection distances, high fuel consumption vehicles, and reduced crew productivity. © The Author(s) 2014.

Values of a Patient and Observer Scar Assessment Scale to Evaluate the Facial Skin Graft Scar.

PubMed

Chae, Jin Kyung; Kim, Jeong Hee; Kim, Eun Jung; Park, Kun

2016-10-01

The patient and observer scar assessment scale (POSAS) recently emerged as a promising method, reflecting both observer's and patient's opinions in evaluating scar. This tool was shown to be consistent and reliable in burn scar assessment, but it has not been tested in the setting of skin graft scar in skin cancer patients. To evaluate facial skin graft scar applied to POSAS and to compare with objective scar assessment tools. Twenty three patients, who diagnosed with facial cutaneous malignancy and transplanted skin after Mohs micrographic surgery, were recruited. Observer assessment was performed by three independent rates using the observer component of the POSAS and Vancouver scar scale (VSS). Patient self-assessment was performed using the patient component of the POSAS. To quantify scar color and scar thickness more objectively, spectrophotometer and ultrasonography was applied. Inter-observer reliability was substantial with both VSS and the observer component of the POSAS (average measure intraclass coefficient correlation, 0.76 and 0.80, respectively). The observer component consistently showed significant correlations with patients' ratings for the parameters of the POSAS (all p -values<0.05). The correlation between subjective assessment using POSAS and objective assessment using spectrophotometer and ultrasonography showed low relationship. In facial skin graft scar assessment in skin cancer patients, the POSAS showed acceptable inter-observer reliability. This tool was more comprehensive and had higher correlation with patient's opinion.

Framework for e-learning assessment in dental education: a global model for the future.

PubMed

Arevalo, Carolina R; Bayne, Stephen C; Beeley, Josie A; Brayshaw, Christine J; Cox, Margaret J; Donaldson, Nora H; Elson, Bruce S; Grayden, Sharon K; Hatzipanagos, Stylianos; Johnson, Lynn A; Reynolds, Patricia A; Schönwetter, Dieter J

2013-05-01

The framework presented in this article demonstrates strategies for a global approach to e-curricula in dental education by considering a collection of outcome assessment tools. By combining the outcomes for overall assessment, a global model for a pilot project that applies e-assessment tools to virtual learning environments (VLE), including haptics, is presented. Assessment strategies from two projects, HapTEL (Haptics in Technology Enhanced Learning) and UDENTE (Universal Dental E-learning), act as case-user studies that have helped develop the proposed global framework. They incorporate additional assessment tools and include evaluations from questionnaires and stakeholders' focus groups. These measure each of the factors affecting the classical teaching/learning theory framework as defined by Entwistle in a standardized manner. A mathematical combinatorial approach is proposed to join these results together as a global assessment. With the use of haptic-based simulation learning, exercises for tooth preparation assessing enamel and dentine were compared to plastic teeth in manikins. Equivalence for student performance for haptic versus traditional preparation methods was established, thus establishing the validity of the haptic solution for performing these exercises. Further data collected from HapTEL are still being analyzed, and pilots are being conducted to validate the proposed test measures. Initial results have been encouraging, but clearly the need persists to develop additional e-assessment methods for new learning domains.

Venous thromboembolism prophylaxis risk assessment in a general surgery cohort: a closed-loop audit.

PubMed

McGoldrick, D M; Redmond, H P

2017-08-01

Venous thromboembolism (VTE) is a potential source of morbidity and mortality in surgical in-patients. A number of guidelines exist that advise on prophylactic measures. We aimed to assess VTE prophylaxis prescribing practices and compliance with a kardex-based risk assessment tool in a general surgery population. Data on general surgery in-patients were collected on two separate wards on two separate days. Drug kardexes were assessed for VTE prophylaxis measures and use of the risk assessment tool. NICE and SIGN guidelines were adopted as a gold standard. The audit results and information on the risk assessment tool were presented as an educational intervention at two separate departmental teaching sessions. A re-audit was completed after 3 months. In Audit A, 74 patients were assessed. 70% were emergency admissions. The risk assessment tool was completed in 2.7%. 75 and 97% of patients were correctly prescribed anti-embolic stockings (AES) and low-molecular weight heparin (LMWH), respectively. 30 patients were included in Audit B, 56% of whom were emergency admissions. 66% had a risk assessment performed, a statistically significant improvement (p < 0.0001). Rates of LMWH prescribing were similar (96%), but AES prescribing was lower (36%). Rates of LMWH prescribing are high in this general surgical population, although AES prescribing rates vary. Use of the VTE risk assessment tool increased following the initial audit and intervention.

Risk assessment model for development of advanced age-related macular degeneration.

PubMed

Klein, Michael L; Francis, Peter J; Ferris, Frederick L; Hamon, Sara C; Clemons, Traci E

2011-12-01

To design a risk assessment model for development of advanced age-related macular degeneration (AMD) incorporating phenotypic, demographic, environmental, and genetic risk factors. We evaluated longitudinal data from 2846 participants in the Age-Related Eye Disease Study. At baseline, these individuals had all levels of AMD, ranging from none to unilateral advanced AMD (neovascular or geographic atrophy). Follow-up averaged 9.3 years. We performed a Cox proportional hazards analysis with demographic, environmental, phenotypic, and genetic covariates and constructed a risk assessment model for development of advanced AMD. Performance of the model was evaluated using the C statistic and the Brier score and externally validated in participants in the Complications of Age-Related Macular Degeneration Prevention Trial. The final model included the following independent variables: age, smoking history, family history of AMD (first-degree member), phenotype based on a modified Age-Related Eye Disease Study simple scale score, and genetic variants CFH Y402H and ARMS2 A69S. The model did well on performance measures, with very good discrimination (C statistic = 0.872) and excellent calibration and overall performance (Brier score at 5 years = 0.08). Successful external validation was performed, and a risk assessment tool was designed for use with or without the genetic component. We constructed a risk assessment model for development of advanced AMD. The model performed well on measures of discrimination, calibration, and overall performance and was successfully externally validated. This risk assessment tool is available for online use.

Objective assessment of laparoscopic skills using a virtual reality stimulator.

PubMed

Eriksen, J R; Grantcharov, T

2005-09-01

Virtual reality simulation has a great potential as a training and assessment tool of laparoscopic skills. The study was carried out to investigate whether the LapSim system (Surgical Science Ltd., Gothenburg, Sweden) was able to differentiate between subjects with different laparoscopic experience and thus to demonstrate its construct validity. Subjects 24 were divided into two groups: experienced (performed > 100 laparoscopic procedures, n = 10) and beginners (performed <10 laparoscopic procedures, n = 14). Assessment of laparoscopic skills was based on parameters measured by the computer system. Experienced surgeons performed consistently better than the residents. Significant differences in the parameters time and economy of motion existed between the two groups in seven of seven tasks. Regarding error parameters, differences existed in most but not all tasks. LapSim was able to differentiate between subjects with different laparoscopic experience. This indicates that the system measures skills relevant for laparoscopic surgery and can be used in training programs as a valid assessment tool.

Evaluation of medical management during a mass casualty incident exercise: an objective assessment tool to enhance direct observation.

PubMed

Ingrassia, Pier Luigi; Prato, Federico; Geddo, Alessandro; Colombo, Davide; Tengattini, Marco; Calligaro, Sara; La Mura, Fabrizio; Franc, Jeffrey Michael; Della Corte, Francesco

2010-11-01

Functional exercises represent an important link between disaster planning and disaster response. Although these exercises are widely performed, no standardized method exists for their evaluation. To describe a simple and objective method to assess medical performance during functional exercise events. An evaluation tool comprising three data fields (triage, clinical maneuvers, and radio usage), accompanied by direct anecdotal observational methods, was used to evaluate a large functional mass casualty incident exercise. Seventeen medical responders managed 112 victims of a simulated building explosion. Although 81% of the patients were assigned the appropriate triage codes, evacuation from the site did not follow in priority. Required maneuvers were performed correctly in 85.2% of airway maneuvers and 78.7% of breathing maneuvers, however, significant under-treatment occurred, possibly due to equipment shortages. Extensive use of radio communication was documented. In evaluating this tool, the structured markers were informative, but further information provided by direct observation was invaluable. A three-part tool (triage, medical maneuvers, and radio usage) can provide a method to evaluate functional mass casualty incident exercises, and is easily implemented. For the best results, it should be used in conjunction with direct observation. The evaluation tool has great potential as a reproducible and internationally recognized tool for evaluating disaster management exercises. Copyright © 2010 Elsevier Inc. All rights reserved.

Safety analysis of interchanges

DOT National Transportation Integrated Search

2007-06-01

The objectives of this research are to synthesize the current state of knowledge concerning the safety assessment of new or modified interchanges; develop a spreadsheet-based computational tool for performing safety assessments of interchanges; and i...

A Program Manager's Guide for Program Improvement in Ongoing Psychological Health and Traumatic Brain Injury Programs.

PubMed

Ryan, Gery W; Farmer, Carrie M; Adamson, David M; Weinick, Robin M

2014-01-01

Between 2001 and 2011, the U.S. Department of Defense has implemented numerous programs to support service members and their families in coping with the stressors from a decade of the longstanding conflicts in Iraq and Afghanistan. These programs, which address both psychological health and traumatic brain injury (TBI), number in the hundreds and vary in their size, scope, and target population. To ensure that resources are wisely invested and maximize the benefits of such programs, RAND developed a tool to help assess program performance, consider options for improvement, implement solutions, then assess whether the changes worked, with the intention of helping those responsible for managing or implementing programs to conduct assessments of how well the program is performing and to implement solutions for improving performance. Specifically, the tool is intended to provide practical guidance in program improvement and continuous quality improvement for all programs.

Technology assessment and requirements analysis: a process to facilitate decision making in picture archiving and communications system implementation.

PubMed

Radvany, M G; Chacko, A K; Richardson, R R; Grazdan, G W

1999-05-01

In a time of decreasing resources, managers need a tool to manage their resources effectively, support clinical requirements, and replace aging equipment in order to ensure adequate clinical care. To do this successfully, one must be able to perform technology assessment and capital equipment asset management. The lack of a commercial system that adequately performed technology needs assessment and addressed the unique needs of the military led to the development of an in-house Technology Assessment and Requirements Analysis (TARA) program. The TARA is a tool that provides an unbiased review of clinical operations and the resulting capital equipment requirements for military hospitals. The TARA report allows for the development of acquisition strategies for new equipment, enhances personnel management, and improves and streamlines clinical operations and processes.

Implementing Lumberjacks and Black Swans Into Model-Based Tools to Support Human-Automation Interaction.

PubMed

Sebok, Angelia; Wickens, Christopher D

2017-03-01

The objectives were to (a) implement theoretical perspectives regarding human-automation interaction (HAI) into model-based tools to assist designers in developing systems that support effective performance and (b) conduct validations to assess the ability of the models to predict operator performance. Two key concepts in HAI, the lumberjack analogy and black swan events, have been studied extensively. The lumberjack analogy describes the effects of imperfect automation on operator performance. In routine operations, an increased degree of automation supports performance, but in failure conditions, increased automation results in more significantly impaired performance. Black swans are the rare and unexpected failures of imperfect automation. The lumberjack analogy and black swan concepts have been implemented into three model-based tools that predict operator performance in different systems. These tools include a flight management system, a remotely controlled robotic arm, and an environmental process control system. Each modeling effort included a corresponding validation. In one validation, the software tool was used to compare three flight management system designs, which were ranked in the same order as predicted by subject matter experts. The second validation compared model-predicted operator complacency with empirical performance in the same conditions. The third validation compared model-predicted and empirically determined time to detect and repair faults in four automation conditions. The three model-based tools offer useful ways to predict operator performance in complex systems. The three tools offer ways to predict the effects of different automation designs on operator performance.

Phase Two Feasibility Study for Software Safety Requirements Analysis Using Model Checking

NASA Technical Reports Server (NTRS)

Turgeon, Gregory; Price, Petra

2010-01-01

A feasibility study was performed on a representative aerospace system to determine the following: (1) the benefits and limitations to using SCADE , a commercially available tool for model checking, in comparison to using a proprietary tool that was studied previously [1] and (2) metrics for performing the model checking and for assessing the findings. This study was performed independently of the development task by a group unfamiliar with the system, providing a fresh, external perspective free from development bias.

NC roadway lighting needs assessment, maintenance prioritization tool and performance measures.

DOT National Transportation Integrated Search

2013-05-01

The objectives of this project are to 1) develop an assessment report and summary of accumulated modernization / replacement needs, 2) assess current lighting needs and develop a method to allocate funds at NCDOT Division level, 3) research and docum...

Situation Awareness and Workload Measures for SAFOR

NASA Technical Reports Server (NTRS)

DeMaio, Joe; Hart, Sandra G.; Allen, Ed (Technical Monitor)

1999-01-01

The present research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale (DRAWS), and a situation awareness measurement tool in which the crews self-evaluation of performance is compared against actual performance. These two measurement tools were evaluated in the context of a test of an innovative approach to alerting the crew by way of a helmet mounted display. The DRAWS was found to be usable, but it offered no advantages over extant scales, and it had only limited resolution. The performance self-evaluation metric of situation awareness was found to be highly effective.

Summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

Powell, Danny H; Elwood Jr, Robert H

2011-01-01

An effective risk assessment system is needed to address the threat posed by an active or passive insider who, acting alone or in collusion, could attempt diversion or theft of nuclear material. The material control and accountability (MC&A) system effectiveness tool (MSET) is a self-assessment or inspection tool utilizing probabilistic risk assessment (PRA) methodology to calculate the system effectiveness of a nuclear facility's material protection, control, and accountability (MPC&A) system. The MSET process is divided into four distinct and separate parts: (1) Completion of the questionnaire that assembles information about the operations of every aspect of the MPC&A system; (2)more » Conversion of questionnaire data into numeric values associated with risk; (3) Analysis of the numeric data utilizing the MPC&A fault tree and the SAPHIRE computer software; and (4) Self-assessment using the MSET reports to perform the effectiveness evaluation of the facility's MPC&A system. The process should lead to confirmation that mitigating features of the system effectively minimize the threat, or it could lead to the conclusion that system improvements or upgrades are necessary to achieve acceptable protection against the threat. If the need for system improvements or upgrades is indicated when the system is analyzed, MSET provides the capability to evaluate potential or actual system improvements or upgrades. A facility's MC&A system can be evaluated at a point in time. The system can be reevaluated after upgrades are implemented or after other system changes occur. The total system or specific subareas within the system can be evaluated. Areas of potential system improvement can be assessed to determine where the most beneficial and cost-effective improvements should be made. Analyses of risk importance factors show that sustainability is essential for optimal performance and reveals where performance degradation has the greatest impact on total system risk. The risk importance factors show the amount of risk reduction achievable with potential upgrades and the amount of risk reduction achieved after upgrades are completed. Applying the risk assessment tool gives support to budget prioritization by showing where budget support levels must be sustained for MC&A functions most important to risk. Results of the risk assessment are also useful in supporting funding justifications for system improvements that significantly reduce system risk. The functional model, the system risk assessment tool, and the facility evaluation questionnaire are valuable educational tools for MPC&A personnel. These educational tools provide a framework for ongoing dialogue between organizations regarding the design, development, implementation, operation, assessment, and sustainability of MPC&A systems. An organization considering the use of MSET as an analytical tool for evaluating the effectiveness of its MPC&A system will benefit from conducting a complete MSET exercise at an existing nuclear facility.« less

Tool-specific performance of vibration-reducing gloves for attenuating palm-transmitted vibrations in three orthogonal directions

PubMed Central

Dong, Ren G.; Welcome, Daniel E.; Peterson, Donald R.; Xu, Xueyan S.; McDowell, Thomas W.; Warren, Christopher; Asaki, Takafumi; Kudernatsch, Simon; Brammer, Antony

2015-01-01

Vibration-reducing (VR) gloves have been increasingly used to help reduce vibration exposure, but it remains unclear how effective these gloves are. The purpose of this study was to estimate tool-specific performances of VR gloves for reducing the vibrations transmitted to the palm of the hand in three orthogonal directions (3-D) in an attempt to assess glove effectiveness and aid in the appropriate selection of these gloves. Four typical VR gloves were considered in this study, two of which can be classified as anti-vibration (AV) gloves according to the current AV glove test standard. The average transmissibility spectrum of each glove in each direction was synthesized based on spectra measured in this study and other spectra collected from reported studies. More than seventy vibration spectra of various tools or machines were considered in the estimations, which were also measured in this study or collected from reported studies. The glove performance assessments were based on the percent reduction of frequency-weighted acceleration as is required in the current standard for assessing the risk of vibration exposures. The estimated tool-specific vibration reductions of the gloves indicate that the VR gloves could slightly reduce (<5%) or marginally amplify (<10%) the vibrations generated from low-frequency (<25 Hz) tools or those vibrating primarily along the axis of the tool handle. With other tools, the VR gloves could reduce palm-transmitted vibrations in the range of 5%–58%, primarily depending on the specific tool and its vibration spectra in the three directions. The two AV gloves were not more effective than the other gloves with some of the tools considered in this study. The implications of the results are discussed. Relevance to industry Hand-transmitted vibration exposure may cause hand-arm vibration syndrome. Vibration-reducing gloves are considered as an alternative approach to reduce the vibration exposure. This study provides useful information on the effectiveness of the gloves when used with many tools for reducing the vibration transmitted to the palm in three directions. The results can aid in the appropriate selection and use of these gloves. PMID:26726275

Cockpit System Situational Awareness Modeling Tool

NASA Technical Reports Server (NTRS)

Keller, John; Lebiere, Christian; Shay, Rick; Latorella, Kara

2004-01-01

This project explored the possibility of predicting pilot situational awareness (SA) using human performance modeling techniques for the purpose of evaluating developing cockpit systems. The Improved Performance Research Integration Tool (IMPRINT) was combined with the Adaptive Control of Thought-Rational (ACT-R) cognitive modeling architecture to produce a tool that can model both the discrete tasks of pilots and the cognitive processes associated with SA. The techniques for using this tool to predict SA were demonstrated using the newly developed Aviation Weather Information (AWIN) system. By providing an SA prediction tool to cockpit system designers, cockpit concepts can be assessed early in the design process while providing a cost-effective complement to the traditional pilot-in-the-loop experiments and data collection techniques.

Propensity score to detect baseline imbalance in cluster randomized trials: the role of the c-statistic.

PubMed

Leyrat, Clémence; Caille, Agnès; Foucher, Yohann; Giraudeau, Bruno

2016-01-22

Despite randomization, baseline imbalance and confounding bias may occur in cluster randomized trials (CRTs). Covariate imbalance may jeopardize the validity of statistical inferences if they occur on prognostic factors. Thus, the diagnosis of a such imbalance is essential to adjust statistical analysis if required. We developed a tool based on the c-statistic of the propensity score (PS) model to detect global baseline covariate imbalance in CRTs and assess the risk of confounding bias. We performed a simulation study to assess the performance of the proposed tool and applied this method to analyze the data from 2 published CRTs. The proposed method had good performance for large sample sizes (n =500 per arm) and when the number of unbalanced covariates was not too small as compared with the total number of baseline covariates (≥40% of unbalanced covariates). We also provide a strategy for pre selection of the covariates needed to be included in the PS model to enhance imbalance detection. The proposed tool could be useful in deciding whether covariate adjustment is required before performing statistical analyses of CRTs.

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology.

PubMed

Melchiors, Jacob; Henriksen, Mikael Johannes Vuokko; Dikkers, Frederik G; Gavilán, Javier; Noordzij, J Pieter; Fried, Marvin P; Novakovic, Daniel; Fagan, Johannes; Charabi, Birgitte W; Konge, Lars; von Buchwald, Christian

2018-05-01

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. FIFTY PANELISTS COMPLETED THE DELPHI PROCESS. THE MEDIAN AGE OF THE PANELISTS WAS 44 YEARS (RANGE 33-64 YEARS). MEDIAN EXPERIENCE IN OTORHINOLARYNGOLOGY WAS 15 YEARS (RANGE 6-35 YEARS). TWENTY-FIVE WERE SPECIALIZED IN LARYNGOLOGY, 16 WERE HEAD AND NECK SURGEONS, AND NINE WERE GENERAL OTORHINOLARYNGOLOGISTS. AN ASSESSMENT TOOL WAS CREATED CONSISTING OF TWELVE DISTINCT ITEMS.: Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.

Comparison of Three Cognitive Screening Tools in Older Urban and Regional Aboriginal Australians.

PubMed

Radford, Kylie; Mack, Holly A; Draper, Brian; Chalkley, Simon; Delbaere, Kim; Daylight, Gail; Cumming, Robert G; Bennett, Hayley; Broe, Gerald A

2015-01-01

Validated cognitive screening tools for use in urban and regional Aboriginal populations in Australia are lacking. In a cross-sectional community-based study, 235 participants were assessed on the Mini-Mental State Examination (MMSE), the Rowland Universal Dementia Assessment Scale (RUDAS) and an urban modification of the Kimberley Indigenous Cognitive Assessment (mKICA). Performance on these cognitive screening tools was compared to dementia diagnosis by clinical consensus. All tests were culturally acceptable with good psychometric properties. Receiver operating characteristic curve analyses revealed that the MMSE and mKICA were the most accurate. The MMSE is an effective cognitive screening tool in urban Aboriginal populations. The mKICA is a good alternative when illiteracy, language or cultural considerations deem it appropriate. The RUDAS also has adequate validity in this population. © 2015 S. Karger AG, Basel.

Validation of the Virtual MET as an assessment tool for executive functions.

PubMed

Rand, Debbie; Basha-Abu Rukan, Soraya; Weiss, Patrice L Tamar; Katz, Noomi

2009-08-01

The purpose of this study was to establish ecological validity and initial construct validity of a Virtual Multiple Errands Test (VMET) as an assessment tool for executive functions. It was implemented within the Virtual Mall (VMall), a novel functional video-capture virtual shopping environment. The main objectives were (1) to examine the relationships between the performance of three groups of participants in the Multiple Errands Test (MET) carried out in a real shopping mall and their performance in the VMET, (2) to assess the relationships between the MET and VMET of the post-stroke participant's level of executive functioning and independence in instrumental activities of daily living, and (3) to compare the performance of post-stroke participants to those of healthy young and older controls in both the MET and VMET. The study population included three groups; post-stroke participants (n = 9), healthy young participants (n = 20), and healthy older participants (n = 20). The VMET was able to differentiate between two age groups of healthy participants and between healthy and post-stroke participants thus demonstrating that it is sensitive to brain injury and ageing and supports construct validity between known groups. In addition, significant correlations were found between the MET and the VMET for both the post-stroke participants and older healthy participants. This provides initial support for the ecological validity of the VMET as an assessment tool of executive functions. However, further psychometric data on temporal stability are needed, namely test-retest reliability and responsiveness, before it is ready for clinical application. Further research using the VMET as an assessment tool within the VMall with larger groups and in additional populations is also recommended.

Tools for assessing fall risk in the elderly: a systematic review and meta-analysis.

PubMed

Park, Seong-Hi

2018-01-01

The prevention of falls among the elderly is arguably one of the most important public health issues in today's aging society. The aim of this study was to assess which tools best predict the risk of falls in the elderly. Electronic searches were performed using Medline, EMBASE, the Cochrane Library, CINAHL, etc., using the following keywords: "fall risk assessment", "elderly fall screening", and "elderly mobility scale". The QUADAS-2 was applied to assess the internal validity of the diagnostic studies. Selected studies were meta-analyzed with MetaDisc 1.4. A total of 33 studies were eligible out of the 2,321 studies retrieved from selected databases. Twenty-six assessment tools for fall risk were used in the selected articles, and they tended to vary based on the setting. The fall risk assessment tools currently used for the elderly did not show sufficiently high predictive validity for differentiating high and low fall risks. The Berg Balance scale and Mobility Interaction Fall chart showed stable and high specificity, while the Downton Fall Risk Index, Hendrich II Fall Risk Model, St. Thomas's Risk Assessment Tool in Falling elderly inpatients, Timed Up and Go test, and Tinetti Balance scale showed the opposite results. We concluded that rather than a single measure, two assessment tools used together would better evaluate the characteristics of falls by the elderly that can occur due to a multitude of factors and maximize the advantages of each for predicting the occurrence of falls.

Developing hospital accreditation standards in Uganda.

PubMed

Galukande, Moses; Katamba, Achilles; Nakasujja, Noeline; Baingana, Rhona; Bateganya, Moses; Hagopian, Amy; Tavrow, Paula; Barnhart, Scott; Luboga, Sam

2016-07-01

Whereas accreditation is widely used as a tool to improve quality of healthcare in the developed world, it is a concept not well adapted in most developing countries for a host of reasons, including insufficient incentives, insufficient training and a shortage of human and material resources. The purpose of this paper is to describe refining use and outcomes of a self-assessment hospital accreditation tool developed for a resource-limited context. We invited 60 stakeholders to review a set of standards (from which a self-assessment tool was developed), and subsequently refined them to include 485 standards in 7 domains. We then invited 60 hospitals to test them. A study team traveled to each of the 40 hospitals that agreed to participate providing training and debrief the self-assessment. The study was completed in 8 weeks. Hospital self-assessments revealed hospitals were remarkably open to frank rating of their performance and willing to rank all 485 measures. Good performance was measured in outreach programs, availability of some types of equipment and running water, 24-h staff calls systems, clinical guidelines and waste segregation. Poor performance was measured in care for the vulnerable, staff living quarters, physician performance reviews, patient satisfaction surveys and sterilizing equipment. We have demonstrated the feasibility of a self-assessment approach to hospital standards in low-income country setting. This low-cost approach may be used as a good precursor to establishing a national accreditation body, as indicated by the Ministry's efforts to take the next steps. Copyright © 2015 John Wiley & Sons, Ltd. Copyright © 2015 John Wiley & Sons, Ltd.

The impact of leadership and team behavior on standard of care delivered during human patient simulation: a pilot study for undergraduate medical students.

PubMed

Carlson, Jim; Min, Elana; Bridges, Diane

2009-01-01

Methodology to train team behavior during simulation has received increased attention, but standard performance measures are lacking, especially at the undergraduate level. Our purposes were to develop a reliable team behavior measurement tool and explore the relationship between team behavior and the delivery of an appropriate standard of care specific to the simulated case. Authors developed a unique team measurement tool based on previous work. Trainees participated in a simulated event involving the presentation of acute dyspnea. Performance was rated by separate raters using the team behavior measurement tool. Interrater reliability was assessed. The relationship between team behavior and the standard of care delivered was explored. The instrument proved to be reliable for this case and group of raters. Team behaviors had a positive relationship with the standard of medical care delivered specific to the simulated case. The methods used provide a possible method for training and assessing team performance during simulation.

Test Accuracy of Informant-Based Cognitive Screening Tests for Diagnosis of Dementia and Multidomain Cognitive Impairment in Stroke.

PubMed

McGovern, Aine; Pendlebury, Sarah T; Mishra, Nishant K; Fan, Yuhua; Quinn, Terence J

2016-02-01

Poststroke cognitive assessment can be performed using standardized questionnaires designed for family or care givers. We sought to describe the test accuracy of such informant-based assessments for diagnosis of dementia/multidomain cognitive impairment in stroke. We performed a systematic review using a sensitive search strategy across multidisciplinary electronic databases. We created summary test accuracy metrics and described reporting and quality using STARDdem and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tools, respectively. From 1432 titles, we included 11 studies. Ten papers used the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). Four studies described IQCODE for diagnosis of poststroke dementia (n=1197); summary sensitivity: 0.81 (95% confidence interval, 0.60-0.93); summary specificty: 0.83 (95% confidence interval, 0.64-0.93). Five studies described IQCODE as tool for predicting future dementia (n=837); summary sensitivity: 0.60 (95% confidence interval, 0.32-0.83); summary specificity: 0.97 (95% confidence interval, 0.70-1.00). All papers had issues with at least 1 aspect of study reporting or quality. There is a limited literature on informant cognitive assessments in stroke. IQCODE as a diagnostic tool has test properties similar to other screening tools, IQCODE as a prognostic tool is specific but insensitive. We found no papers describing test accuracy of informant tests for diagnosis of prestroke cognitive decline, few papers on poststroke dementia and all included papers had issues with potential bias. © 2015 American Heart Association, Inc.

Modeling and performance assessment in QinetiQ of EO and IR airborne reconnaissance systems

NASA Astrophysics Data System (ADS)

Williams, John W.; Potter, Gary E.

2002-11-01

QinetiQ are the technical authority responsible for specifying the performance requirements for the procurement of airborne reconnaissance systems, on behalf of the UK MoD. They are also responsible for acceptance of delivered systems, overseeing and verifying the installed system performance as predicted and then assessed by the contractor. Measures of functional capability are central to these activities. The conduct of these activities utilises the broad technical insight and wide range of analysis tools and models available within QinetiQ. This paper focuses on the tools, methods and models that are applicable to systems based on EO and IR sensors. The tools, methods and models are described, and representative output for systems that QinetiQ has been responsible for is presented. The principle capability applicable to EO and IR airborne reconnaissance systems is the STAR (Simulation Tools for Airborne Reconnaissance) suite of models. STAR generates predictions of performance measures such as GRD (Ground Resolved Distance) and GIQE (General Image Quality) NIIRS (National Imagery Interpretation Rating Scales). It also generates images representing sensor output, using the scene generation software CAMEO-SIM and the imaging sensor model EMERALD. The simulated image 'quality' is fully correlated with the predicted non-imaging performance measures. STAR also generates image and table data that is compliant with STANAG 7023, which may be used to test ground station functionality.

Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men.

PubMed

Hussein, Ahmed A; Sexton, Kevin J; May, Paul R; Meng, Maxwell V; Hosseini, Abolfazl; Eun, Daniel D; Daneshmand, Siamak; Bochner, Bernard H; Peabody, James O; Abaza, Ronney; Skinner, Eila C; Hautmann, Richard E; Guru, Khurshid A

2018-04-13

We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men. A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation. The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains. We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.

BeadArray Expression Analysis Using Bioconductor

PubMed Central

Ritchie, Matthew E.; Dunning, Mark J.; Smith, Mike L.; Shi, Wei; Lynch, Andy G.

2011-01-01

Illumina whole-genome expression BeadArrays are a popular choice in gene profiling studies. Aside from the vendor-provided software tools for analyzing BeadArray expression data (GenomeStudio/BeadStudio), there exists a comprehensive set of open-source analysis tools in the Bioconductor project, many of which have been tailored to exploit the unique properties of this platform. In this article, we explore a number of these software packages and demonstrate how to perform a complete analysis of BeadArray data in various formats. The key steps of importing data, performing quality assessments, preprocessing, and annotation in the common setting of assessing differential expression in designed experiments will be covered. PMID:22144879

Median of patient results as a tool for assessment of analytical stability.

PubMed

Jørgensen, Lars Mønster; Hansen, Steen Ingemann; Petersen, Per Hyltoft; Sölétormos, György

2015-06-15

In spite of the well-established external quality assessment and proficiency testing surveys of analytical quality performance in laboratory medicine, a simple tool to monitor the long-term analytical stability as a supplement to the internal control procedures is often needed. Patient data from daily internal control schemes was used for monthly appraisal of the analytical stability. This was accomplished by using the monthly medians of patient results to disclose deviations from analytical stability, and by comparing divergences with the quality specifications for allowable analytical bias based on biological variation. Seventy five percent of the twenty analytes achieved on two COBASs INTEGRA 800 instruments performed in accordance with the optimum and with the desirable specifications for bias. Patient results applied in analytical quality performance control procedures are the most reliable sources of material as they represent the genuine substance of the measurements and therefore circumvent the problems associated with non-commutable materials in external assessment. Patient medians in the monthly monitoring of analytical stability in laboratory medicine are an inexpensive, simple and reliable tool to monitor the steadiness of the analytical practice. Copyright © 2015 Elsevier B.V. All rights reserved.

Integration of tools for the Design and Assessment of High-Performance, Highly Reliable Computing Systems (DAHPHRS), phase 1

NASA Technical Reports Server (NTRS)

Scheper, C.; Baker, R.; Frank, G.; Yalamanchili, S.; Gray, G.

1992-01-01

Systems for Space Defense Initiative (SDI) space applications typically require both high performance and very high reliability. These requirements present the systems engineer evaluating such systems with the extremely difficult problem of conducting performance and reliability trade-offs over large design spaces. A controlled development process supported by appropriate automated tools must be used to assure that the system will meet design objectives. This report describes an investigation of methods, tools, and techniques necessary to support performance and reliability modeling for SDI systems development. Models of the JPL Hypercubes, the Encore Multimax, and the C.S. Draper Lab Fault-Tolerant Parallel Processor (FTPP) parallel-computing architectures using candidate SDI weapons-to-target assignment algorithms as workloads were built and analyzed as a means of identifying the necessary system models, how the models interact, and what experiments and analyses should be performed. As a result of this effort, weaknesses in the existing methods and tools were revealed and capabilities that will be required for both individual tools and an integrated toolset were identified.

TEMPORALLY-RESOLVED AMMONIA EMISSION INVENTORIES: CURRENT ESTIMATES, EVALUATION TOOLS, AND MEASUREMENT NEEDS

EPA Science Inventory

In this study, we evaluate the suitability of a three-dimensional chemical transport model (CTM) as a tool for assessing ammonia emission inventories, calculate the improvement in CTM performance owing to recent advances in temporally-varying ammonia emission estimates, and ident...

Vehicle/Track Interaction Assessment Techniques. Volume 1, Part 1.

DOT National Transportation Integrated Search

1984-03-01

This report describes Vehicle/Track Interaction Assessment Techniques (IAT) which are developed to provide standardized procedures and tools in order to: Investigate the dynamic performance of railroad vehicles, and systematically identify and cure d...

Vehicle/Track Interaction Assessment Techniques. Volume 2, Part 2.

DOT National Transportation Integrated Search

1984-03-01

This report describes Vehicle/Track Interaction Assessment Techniques (IAT) which are developed to provide standardized procedures and tools in order to: Investigate the dynamic performance of railroad vehicles, and systematically identify and cure d...

Vehicle/Track Interaction Assessment Techniques. Volume 3, Part 2.

DOT National Transportation Integrated Search

1984-03-01

This report describes Vehicle/Track Interaction Assessment Techniques (IAT) which are developed to provide standardized procedures and tools in order to: Investigate the dynamic performance of railroad vehicles, and systematically identify and cure d...

Supportive supervision and constructive relationships with healthcare workers support CHW performance: Use of a qualitative framework to evaluate CHW programming in Uganda.

PubMed

Ludwick, Teralynn; Turyakira, Eleanor; Kyomuhangi, Teddy; Manalili, Kimberly; Robinson, Sheila; Brenner, Jennifer L

2018-02-13

While evidence supports community health worker (CHW) capacity to improve maternal and newborn health in less-resourced countries, key implementation gaps remain. Tools for assessing CHW performance and evidence on what programmatic components affect performance are lacking. This study developed and tested a qualitative evaluative framework and tool to assess CHW team performance in a district program in rural Uganda. A new assessment framework was developed to collect and analyze qualitative evidence based on CHW perspectives on seven program components associated with effectiveness (selection; training; community embeddedness; peer support; supportive supervision; relationship with other healthcare workers; retention and incentive structures). Focus groups were conducted with four high/medium-performing CHW teams and four low-performing CHW teams selected through random, stratified sampling. Content analysis involved organizing focus group transcripts according to the seven program effectiveness components, and assigning scores to each component per focus group. Four components, 'supportive supervision', 'good relationships with other healthcare workers', 'peer support', and 'retention and incentive structures' received the lowest overall scores. Variances in scores between 'high'/'medium'- and 'low'-performing CHW teams were largest for 'supportive supervision' and 'good relationships with other healthcare workers.' Our analysis suggests that in the Bushenyi intervention context, CHW team performance is highly correlated with the quality of supervision and relationships with other healthcare workers. CHWs identified key performance-related issues of absentee supervisors, referral system challenges, and lack of engagement/respect by health workers. Other less-correlated program components warrant further study and may have been impacted by relatively consistent program implementation within our limited study area. Applying process-oriented measurement tools are needed to better understand CHW performance-related factors and build a supportive environment for CHW program effectiveness and sustainability. Findings from a qualitative, multi-component tool developed and applied in this study suggest that factors related to (1) supportive supervision and (2) relationships with other healthcare workers may be strongly associated with variances in performance outcomes within a program. Careful consideration of supervisory structure and health worker orientation during program implementation are among strategies proposed to increase CHW performance.

Methodology to Assess No Touch Audit Software Using Simulated Building Utility Data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cheung, Howard; Braun, James E.; Langner, M. Rois

This report describes a methodology developed for assessing the performance of no touch building audit tools and presents results for an available tool. Building audits are conducted in many commercial buildings to reduce building energy costs and improve building operation. Because the audits typically require significant input obtained by building engineers, they are usually only affordable for larger commercial building owners. In an effort to help small building and business owners gain the benefits of an audit at a lower cost, no touch building audit tools have been developed to remotely analyze a building's energy consumption.

Does a surgical simulator improve resident operative performance of laparoscopic tubal ligation?

PubMed

Banks, Erika H; Chudnoff, Scott; Karmin, Ira; Wang, Cuiling; Pardanani, Setul

2007-11-01

The purpose of this study was to assess whether a surgical skills simulator laboratory improves resident knowledge and operative performance of laparoscopic tubal ligation. Twenty postgraduate year 1 residents were assigned randomly to either a surgical simulator laboratory on laparoscopic tubal ligation together with apprenticeship teaching in the operating room or to apprenticeship teaching alone. Tests that were given before and after the training assessed basic knowledge. Attending physicians who were blinded to resident randomization status evaluated postgraduate year 1 performance on a laparoscopic tubal ligation in the operating room with 3 validated tools: a task-specific checklist, global rating scale, and pass/fail grade. Postgraduate year 1 residents who were assigned randomly to the surgical simulator laboratory performed significantly better than control subjects on all 3 surgical assessment tools (the checklist, the global score, and the pass/fail analysis) and scored significantly better on the knowledge posttest (all P < .0005). Compared with apprenticeship teaching alone, a surgical simulator laboratory on laparoscopic tubal ligation improved resident knowledge and performance in the operating room.

Effects of Imagery Training on Cognitive Performance and Use of Physiological Measures as an Assessment Tool of Mental Effort

ERIC Educational Resources Information Center

Papadelis, Christos; Kourtidou-Papadeli, Chrysoula; Bamidis, Panagiotis; Albani, Maria

2007-01-01

The effectiveness of motor imagery training on cognitive performance was examined and the physiological mechanisms involved in the contribution of mental practice to motor learning were considered. The subject's mental effort during motor imagery was assessed by using psychophysiological measures and particularly eye blink activity as an…

Cognitive Readiness Assessment and Reporting: An Open Source Mobile Framework for Operational Decision Support and Performance Improvement

ERIC Educational Resources Information Center

Heric, Matthew; Carter, Jenn

2011-01-01

Cognitive readiness (CR) and performance for operational time-critical environments are continuing points of focus for military and academic communities. In response to this need, we designed an open source interactive CR assessment application as a highly adaptive and efficient open source testing administration and analysis tool. It is capable…

Health smart home: towards an assistant tool for automatic assessment of the dependence of elders.

PubMed

Le, Xuan Hoa Binh; Di Mascolo, Maria; Gouin, Alexia; Noury, Norbert

2007-01-01

In order to help elders living alone to age in place independently and safely, it can be useful to have an assistant tool that can automatically assess their dependence and issue an alert if there is any loss of autonomy. The dependence can be assessed by the degree of performance, by the elders, of activities of daily living. This article presents an approach enabling the activity recognition for an elder living alone in a Health Smart Home equipped with noninvasive sensors.

Human Factors Virtual Analysis Techniques for NASA's Space Launch System Ground Support using MSFC's Virtual Environments Lab (VEL)

NASA Technical Reports Server (NTRS)

Searcy, Brittani

2017-01-01

Using virtual environments to assess complex large scale human tasks provides timely and cost effective results to evaluate designs and to reduce operational risks during assembly and integration of the Space Launch System (SLS). NASA's Marshall Space Flight Center (MSFC) uses a suite of tools to conduct integrated virtual analysis during the design phase of the SLS Program. Siemens Jack is a simulation tool that allows engineers to analyze human interaction with CAD designs by placing a digital human model into the environment to test different scenarios and assess the design's compliance to human factors requirements. Engineers at MSFC are using Jack in conjunction with motion capture and virtual reality systems in MSFC's Virtual Environments Lab (VEL). The VEL provides additional capability beyond standalone Jack to record and analyze a person performing a planned task to assemble the SLS at Kennedy Space Center (KSC). The VEL integrates Vicon Blade motion capture system, Siemens Jack, Oculus Rift, and other virtual tools to perform human factors assessments. By using motion capture and virtual reality, a more accurate breakdown and understanding of how an operator will perform a task can be gained. By virtual analysis, engineers are able to determine if a specific task is capable of being safely performed by both a 5% (approx. 5ft) female and a 95% (approx. 6'1) male. In addition, the analysis will help identify any tools or other accommodations that may to help complete the task. These assessments are critical for the safety of ground support engineers and keeping launch operations on schedule. Motion capture allows engineers to save and examine human movements on a frame by frame basis, while virtual reality gives the actor (person performing a task in the VEL) an immersive view of the task environment. This presentation will discuss the need of human factors for SLS and the benefits of analyzing tasks in NASA MSFC's VEL.

Measuring competence in endoscopic sinus surgery.

PubMed

Syme-Grant, J; White, P S; McAleer, J P G

2008-02-01

Competence based education is currently being introduced into higher surgical training in the UK. Valid and reliable performance assessment tools are essential to ensure competencies are achieved. No such tools have yet been reported in the UK literature. We sought to develop and pilot test an Endoscopic Sinus Surgery Competence Assessment Tool (ESSCAT). The ESSCAT was designed for in-theatre assessment of higher surgical trainees in the UK. The ESSCAT rating matrix was developed through task analysis of ESS procedures. All otolaryngology consultants and specialist registrars in Scotland were given the opportunity to contribute to its refinement. Two cycles of in-theatre testing were used to ensure utility and gather quantitative data on validity and reliability. Videos of trainees performing surgery were used in establishing inter-rater reliability. National consultation, the consensus derived minimum standard of performance, Cronbach's alpha = 0.89 and demonstration of trainee learning (p = 0.027) during the in vivo application of the ESSCAT suggest a high level of validity. Inter-rater reliability was moderate for competence decisions (Cohen's Kappa = 0.5) and good for total scores (Intra-Class Correlation Co-efficient = 0.63). Intra-rater reliability was good for both competence decisions (Kappa = 0.67) and total scores (Kendall's Tau-b = 0.73). The ESSCAT generates a valid and reliable assessment of trainees' in-theatre performance of endoscopic sinus surgery. In conjunction with ongoing evaluation of the instrument we recommend the use of the ESSCAT in higher specialist training in otolaryngology in the UK.

Assessment of Age-Related Differences in Functional Capacity Using the Virtual Reality Functional Capacity Assessment Tool (VRFCAT)

PubMed Central

Atkins, A.S.; Stroescu, I.; Spagnola, N.B.; Davis, V.G.; Patterson, T.D.; Narasimhan, M.; Harvey, P.D.; Keefe, R.S.E.

2015-01-01

Clinical trials for primary prevention and early intervention in preclinical AD require measures of functional capacity with improved sensitivity to deficits in healthier, non-demented individuals. To this end, the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) was developed as a direct performance-based assessment of functional capacity that is sensitive to changes in function across multiple populations. Using a realistic virtual reality environment, the VRFCAT assesses a subject's ability to complete instrumental activities associated with a shopping trip. The present investigation represents an initial evaluation of the VRFCAT as a potential co-primary measure of functional capacity in healthy aging and preclinical MCI/AD by examining test-retest reliability and associations with cognitive performance in healthy young and older adults. The VRFCAT was compared and contrasted with the UPSA-2-VIM, a traditional performance-based assessment utilizing physical props. Results demonstrated strong age-related differences in performance on each VRFCAT outcome measure, including total completion time, total errors, and total forced progressions. VRFCAT performance showed strong correlations with cognitive performance across both age groups. VRFCAT Total Time demonstrated good test-retest reliability (ICC=.80 in young adults; ICC=.64 in older adults) and insignificant practice effects, indicating the measure is suitable for repeated testing in healthy populations. Taken together, these results provide preliminary support for the VRFCAT as a potential measure of functionally relevant change in primary prevention and preclinical AD/MCI trials. PMID:26618145

National trends in safety performance of electronic health record systems in children's hospitals.

PubMed

Chaparro, Juan D; Classen, David C; Danforth, Melissa; Stockwell, David C; Longhurst, Christopher A

2017-03-01

To evaluate the safety of computerized physician order entry (CPOE) and associated clinical decision support (CDS) systems in electronic health record (EHR) systems at pediatric inpatient facilities in the US using the Leapfrog Group's pediatric CPOE evaluation tool. The Leapfrog pediatric CPOE evaluation tool, a previously validated tool to assess the ability of a CPOE system to identify orders that could potentially lead to patient harm, was used to evaluate 41 pediatric hospitals over a 2-year period. Evaluation of the last available test for each institution was performed, assessing performance overall as well as by decision support category (eg, drug-drug, dosing limits). Longitudinal analysis of test performance was also carried out to assess the impact of testing and the overall trend of CPOE performance in pediatric hospitals. Pediatric CPOE systems were able to identify 62% of potential medication errors in the test scenarios, but ranged widely from 23-91% in the institutions tested. The highest scoring categories included drug-allergy interactions, dosing limits (both daily and cumulative), and inappropriate routes of administration. We found that hospitals with longer periods since their CPOE implementation did not have better scores upon initial testing, but after initial testing there was a consistent improvement in testing scores of 4 percentage points per year. Pediatric computerized physician order entry (CPOE) systems on average are able to intercept a majority of potential medication errors, but vary widely among implementations. Prospective and repeated testing using the Leapfrog Group's evaluation tool is associated with improved ability to intercept potential medication errors. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Children's estimates of food portion size: the development and evaluation of three portion size assessment tools for use with children.

PubMed

Foster, E; Matthews, J N S; Lloyd, J; Marshall, L; Mathers, J C; Nelson, M; Barton, K L; Wrieden, W L; Cornelissen, P; Harris, J; Adamson, A J

2008-01-01

A number of methods have been developed to assist subjects in providing an estimate of portion size but their application in improving portion size estimation by children has not been investigated systematically. The aim was to develop portion size assessment tools for use with children and to assess the accuracy of children's estimates of portion size using the tools. The tools were food photographs, food models and an interactive portion size assessment system (IPSAS). Children (n 201), aged 4-16 years, were supplied with known quantities of food to eat, in school. Food leftovers were weighed. Children estimated the amount of each food using each tool, 24 h after consuming the food. The age-specific portion sizes represented were based on portion sizes consumed by children in a national survey. Significant differences were found between the accuracy of estimates using the three tools. Children of all ages performed well using the IPSAS and food photographs. The accuracy and precision of estimates made using the food models were poor. For all tools, estimates of the amount of food served were more accurate than estimates of the amount consumed. Issues relating to reporting of foods left over which impact on estimates of the amounts of foods actually consumed require further study. The IPSAS has shown potential for assessment of dietary intake with children. Before practical application in assessment of dietary intake of children the tool would need to be expanded to cover a wider range of foods and to be validated in a 'real-life' situation.

OLTARIS: On-Line Tool for the Assessment of Radiation in Space

NASA Technical Reports Server (NTRS)

Singleterry, Robert C., Jr.; Blattnig, Steve R.; Clowdsley, Martha S.; Qualls, Garry D.; Sandridge, Christopher A.; Simonsen, Lisa C.; Norbury, John W.; Slaba, Tony C.; Walker, Steven A.; Badavi, Francis F.;

Tools for observational gait analysis in patients with stroke: a systematic review.

PubMed

Ferrarello, Francesco; Bianchi, Valeria Anna Maria; Baccini, Marco; Rubbieri, Gaia; Mossello, Enrico; Cavallini, Maria Chiara; Marchionni, Niccolò; Di Bari, Mauro

2013-12-01

Stroke severely affects walking ability, and assessment of gait kinematics is important in defining diagnosis, planning treatment, and evaluating interventions in stroke rehabilitation. Although observational gait analysis is the most common approach to evaluate gait kinematics, tools useful for this purpose have received little attention in the scientific literature and have not been thoroughly reviewed. The aims of this systematic review were to identify tools proposed to conduct observational gait analysis in adults with a stroke, to summarize evidence concerning their quality, and to assess their implementation in rehabilitation research and clinical practice. An extensive search was performed of original articles reporting on visual/observational tools developed to investigate gait kinematics in adults with a stroke. Two reviewers independently selected studies, extracted data, assessed quality of the included studies, and scored the metric properties and clinical utility of each tool. Rigor in reporting metric properties and dissemination of the tools also was evaluated. Five tools were identified, not all of which had been tested adequately for their metric properties. Evaluation of content validity was partially satisfactory. Reliability was poorly investigated in all but one tool. Concurrent validity and sensitivity to change were shown for 3 and 2 tools, respectively. Overall, adequate levels of quality were rarely reached. The dissemination of the tools was poor. Based on critical appraisal, the Gait Assessment and Intervention Tool shows a good level of quality, and its use in stroke rehabilitation is recommended. Rigorous studies are needed for the other tools in order to establish their usefulness.

Benchmarking of software tools for optical proximity correction

NASA Astrophysics Data System (ADS)

Jungmann, Angelika; Thiele, Joerg; Friedrich, Christoph M.; Pforr, Rainer; Maurer, Wilhelm

1998-06-01

The point when optical proximity correction (OPC) will become a routine procedure for every design is not far away. For such a daily use the requirements for an OPC tool go far beyond the principal functionality of OPC that was proven by a number of approaches and is documented well in literature. In this paper we first discuss the requirements for a productive OPC tool. Against these requirements a benchmarking was performed with three different OPC tools available on market (OPRX from TVT, OPTISSIMO from aiss and PROTEUS from TMA). Each of these tools uses a different approach to perform the correction (rules, simulation or model). To assess the accuracy of the correction, a test chip was fabricated, which contains corrections done by each software tool. The advantages and weakness of the several solutions are discussed.

Multi-modal virtual environment research at Armstrong Laboratory

NASA Technical Reports Server (NTRS)

Eggleston, Robert G.

1995-01-01

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Professional Development through Organizational Assessment: Using APPA's Facilities Management Evaluation Program

ERIC Educational Resources Information Center

Medlin, E. Lander; Judd, R. Holly

2013-01-01

APPA's Facilities Management Evaluation Program (FMEP) provides an integrated system to optimize organizational performance. The criteria for evaluation not only provide a tool for organizational continuous improvement, they serve as a compelling leadership development tool essential for today's facilities management professional. The senior…

Social-Emotional Assessment, Performance, and Standards

ERIC Educational Resources Information Center

McKown, Clark

2017-01-01

In the push to boost young people's social and emotional learning (SEL), assessment has lagged behind policy and practice. We have few usable, feasible, and scalable tools to assess children's SEL. And without good assessments, teachers, administrators, parents, and policymakers can't get the data they need to make informed decisions about SEL.…

Speaking Self-Assessment: Mismatches between Learners' and Teachers' Criteria

ERIC Educational Resources Information Center

Babaii, Esmat; Taghaddomi, Shahin; Pashmforoosh, Roya

2016-01-01

Perceptual (mis)matches between teachers and learners are said to affect learning success or failure. Self-assessment, as a formative assessment tool, may, inter alia, be considered a means to minimize such mismatches. Therefore, the present study investigated the extent to which learners' assessment of their own speaking performance, before and…

Sigma metrics as a tool for evaluating the performance of internal quality control in a clinical chemistry laboratory.

PubMed

Kumar, B Vinodh; Mohan, Thuthi

2018-01-01

Six Sigma is one of the most popular quality management system tools employed for process improvement. The Six Sigma methods are usually applied when the outcome of the process can be measured. This study was done to assess the performance of individual biochemical parameters on a Sigma Scale by calculating the sigma metrics for individual parameters and to follow the Westgard guidelines for appropriate Westgard rules and levels of internal quality control (IQC) that needs to be processed to improve target analyte performance based on the sigma metrics. This is a retrospective study, and data required for the study were extracted between July 2015 and June 2016 from a Secondary Care Government Hospital, Chennai. The data obtained for the study are IQC - coefficient of variation percentage and External Quality Assurance Scheme (EQAS) - Bias% for 16 biochemical parameters. For the level 1 IQC, four analytes (alkaline phosphatase, magnesium, triglyceride, and high-density lipoprotein-cholesterol) showed an ideal performance of ≥6 sigma level, five analytes (urea, total bilirubin, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level and for level 2 IQCs, same four analytes of level 1 showed a performance of ≥6 sigma level, and four analytes (urea, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level. For all analytes <6 sigma level, the quality goal index (QGI) was <0.8 indicating the area requiring improvement to be imprecision except cholesterol whose QGI >1.2 indicated inaccuracy. This study shows that sigma metrics is a good quality tool to assess the analytical performance of a clinical chemistry laboratory. Thus, sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the efficiency of existing laboratory processes.

Fostering significant learning in graduate nursing education.

PubMed

Marrocco, Geraldine F

2014-03-01

Faculty who want to energize graduate students with creative classes that lead to long-lasting learning will benefit by designing course objectives, learning activities, and assessment tools using Fink's taxonomy of significant learning and Wiggins's insights on performance-based or educative assessments. Research shows that course designs relying on content-driven lectures and written examinations do not promote significant learning among adult learners. This article reviews six types of significant learning using Fink's taxonomy and examines Wiggins's "backward" approach to designing courses using performance-based assessments that gauge true learning and learning that promotes a lasting change. When designing courses, educators should ask: "What do I really want students to get out of this course?" The answers will direct the design of objectives, learning activities, and assessment tools. Designing graduate courses using Fink's taxonomy and Wiggins's backward approach can lead to significant learning to better prepare nurse practitioners for the future of health care. Copyright 2014, SLACK Incorporated.

Assessment of Proficiency and Competency in Laboratory Animal Biomethodologies

PubMed Central

Clifford, Paula; Melfi, Natasha; Bogdanske, John; Johnson, Elizabeth J; Kehler, James; Baran, Szczepan W

2013-01-01

Personnel working with laboratory animals are required by laws and guidelines to be trained and qualified to perform biomethodologic procedures. The assessment of competency and proficiency is a vital component of a laboratory animal training program, because this process confirms that the trainees have met the learning objectives for a particular procedure. The approach toward qualification assessment differs between organizations because laws and guidelines do not outline how the assessment should be performed or which methods and tools should be used. Assessment of clinical and surgical medicine has received considerable attention over the last few decades and has progressed from simple subjective methods to well-defined and objective methods of assessing competency. Although biomethodology competency and proficiency assessment is discussed in the literature, a standard and objective assessment method has not yet been developed. The development and implementation of an objective and standardized biomethodologic assessment program can serve as a tool to improve standards, ensure consistent training, and decrease research variables yet ensure animal welfare. Here we review the definition and goals of training and assessment, review assessment methods, and propose a method to develop a standard and objective assessment program for the laboratory animal science field, particularly training departments and IACUC. PMID:24351758

Crowd-sourced assessment of technical skills: an adjunct to urology resident surgical simulation training.

PubMed

Holst, Daniel; Kowalewski, Timothy M; White, Lee W; Brand, Timothy C; Harper, Jonathan D; Sorenson, Mathew D; Kirsch, Sarah; Lendvay, Thomas S

2015-05-01

Crowdsourcing is the practice of obtaining services from a large group of people, typically an online community. Validated methods of evaluating surgical video are time-intensive, expensive, and involve participation of multiple expert surgeons. We sought to obtain valid performance scores of urologic trainees and faculty on a dry-laboratory robotic surgery task module by using crowdsourcing through a web-based grading tool called Crowd Sourced Assessment of Technical Skill (CSATS). IRB approval was granted to test the technical skills grading accuracy of Amazon.com Mechanical Turk™ crowd-workers compared to three expert faculty surgeon graders. The two groups assessed dry-laboratory robotic surgical suturing performances of three urology residents (PGY-2, -4, -5) and two faculty using three performance domains from the validated Global Evaluative Assessment of Robotic Skills assessment tool. After an average of 2 hours 50 minutes, each of the five videos received 50 crowd-worker assessments. The inter-rater reliability (IRR) between the surgeons and crowd was 0.91 using Cronbach's alpha statistic (confidence intervals=0.20-0.92), indicating an agreement level between the two groups of "excellent." The crowds were able to discriminate the surgical level, and both the crowds and the expert faculty surgeon graders scored one senior trainee's performance above a faculty's performance. Surgery-naive crowd-workers can rapidly assess varying levels of surgical skill accurately relative to a panel of faculty raters. The crowds provided rapid feedback and were inexpensive. CSATS may be a valuable adjunct to surgical simulation training as requirements for more granular and iterative performance tracking of trainees become mandated and commonplace.

Assessment Tools for Peripheral Neuropathy in Pediatric Oncology: A Systematic Review From the Children's Oncology Group.

PubMed

Smolik, Suzanne; Arland, Lesley; Hensley, Mary Ann; Schissel, Debra; Shepperd, Barbara; Thomas, Kristin; Rodgers, Cheryl

Peripheral neuropathy is a known side effect of several chemotherapy agents, including vinca alkaloids and platinum-based chemotherapy. Early recognition and monitoring of this side effect is an important role of the pediatric oncology nurse. There are a variety of peripheral neuropathy assessment tools currently in use, but the usefulness of these tools in identifying and grading neuropathy in children varies, and there is currently no standardized tool in place to evaluate peripheral neuropathy in pediatric oncology. A systematic review was performed to identify the peripheral neuropathy assessment tools that best evaluate the early onset and progression of peripheral neuropathy in pediatric patients receiving vincristine. Because of the limited information available in pediatric oncology, this review was extended to any pediatric patient with neuropathy. A total of 8 studies were included in the evidence synthesis. Based on available evidence, the pediatric-modified Total Neuropathy Scale (ped-m TNS) and the Total Neuropathy Score-pediatric version (TNS-PV) are recommended for the assessment of vincristine-induced peripheral neuropathy in children 6 years of age and older. In addition, several studies demonstrated that subjective symptoms alone are not adequate to assess for vincristine-induced peripheral neuropathy. Nursing assessment of peripheral neuropathy should be an integral and regular part of patient care throughout the course of chemotherapy treatment.

Assessing the Effects of Multi-Node Sensor Network Configurations on the Operational Tempo

DTIC Science & Technology

2014-09-01

receiver, nP is the noise power of the receiver, and iL is the implementation loss of the receiver due to hardware manufacturing. The received...13. ABSTRACT (maximum 200 words) The LPISimNet software tool provides the capability to quantify the performance of sensor network configurations by...INTENTIONALLY LEFT BLANK v ABSTRACT The LPISimNet software tool provides the capability to quantify the performance of sensor network configurations

Values of a Patient and Observer Scar Assessment Scale to Evaluate the Facial Skin Graft Scar

PubMed Central

Chae, Jin Kyung; Kim, Eun Jung; Park, Kun

2016-01-01

Background The patient and observer scar assessment scale (POSAS) recently emerged as a promising method, reflecting both observer's and patient's opinions in evaluating scar. This tool was shown to be consistent and reliable in burn scar assessment, but it has not been tested in the setting of skin graft scar in skin cancer patients. Objective To evaluate facial skin graft scar applied to POSAS and to compare with objective scar assessment tools. Methods Twenty three patients, who diagnosed with facial cutaneous malignancy and transplanted skin after Mohs micrographic surgery, were recruited. Observer assessment was performed by three independent rates using the observer component of the POSAS and Vancouver scar scale (VSS). Patient self-assessment was performed using the patient component of the POSAS. To quantify scar color and scar thickness more objectively, spectrophotometer and ultrasonography was applied. Results Inter-observer reliability was substantial with both VSS and the observer component of the POSAS (average measure intraclass coefficient correlation, 0.76 and 0.80, respectively). The observer component consistently showed significant correlations with patients' ratings for the parameters of the POSAS (all p-values<0.05). The correlation between subjective assessment using POSAS and objective assessment using spectrophotometer and ultrasonography showed low relationship. Conclusion In facial skin graft scar assessment in skin cancer patients, the POSAS showed acceptable inter-observer reliability. This tool was more comprehensive and had higher correlation with patient's opinion. PMID:27746642

Measuring antimicrobial prescribing quality in Australian hospitals: development and evaluation of a national antimicrobial prescribing survey tool.

PubMed

James, Rodney; Upjohn, Lydia; Cotta, Menino; Luu, Susan; Marshall, Caroline; Buising, Kirsty; Thursky, Karin

2015-01-01

Antimicrobial stewardship (AMS) programmes have been developed with the intention of reducing inappropriate and unnecessary use of antimicrobials, while improving the quality of patient care and locally helping prevent the development of antimicrobial resistance. An important aspect of AMS programmes is the qualitative assessment of prescribing through antimicrobial prescribing surveys (APS), which are able to provide information about the prescribing behaviour within institutions. Owing to lack of standardization of audit tools and the resources required, qualitative methods for the assessment of antimicrobial use are not often performed. The aim of this study was to design an audit tool that was appropriate for use in all Australian hospitals, suited to local user requirements and included an assessment of the overall appropriateness of the prescription. In November 2011, a pilot APS was conducted across 32 hospitals to assess the usability and generalizability of a newly designed audit tool. Following participant feedback, this tool was revised to reflect the requirements of the respondents. A second pilot study was then performed in November 2012 across 85 hospitals. These surveys identified several areas that can be targets for quality improvement at a national level, including: documentation of indication; surgical prophylaxis prescribed for >24 h; compliance with prescribing guidelines; and the appropriateness of the prescription. By involving the end users in the design and evaluation, we have been able to provide a practical and relevant APS tool for quantitative and qualitative data collection in a wide range of Australian hospital settings. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

A streamlined sustainability assessment tool for improved decision making in the urban water industry.

PubMed

Schulz, Matthias; Short, Michael D; Peters, Gregory M

2012-01-01

Water supply is a key consideration in sustainable urban planning. Ideally, detailed quantitative sustainability assessments are undertaken during the planning stage to inform the decision-making process. In reality, however, the significant time and cost associated with undertaking such detailed environmental and economic assessments is often cited as a barrier to wider implementation of these key decision support tools, particularly for decisions made at the local or regional government level. In an attempt to overcome this barrier of complexity, 4 water service providers in Melbourne, Australia, funded the development of a publicly available streamlined Environmental Sustainability Assessment Tool, which is aimed at a wide range of decision makers to assist them in broadening the type and number of water servicing options that can be considered for greenfield or backlog developments. The Environmental Sustainability Assessment Tool consists of a simple user interface and draws on life cycle inventory data to allow for rapid estimation of the environmental and economic performance of different water servicing scenarios. Scenario options can then be further prioritized by means of an interactive multicriteria analysis. The intent of this article is to identify the key issues to be considered in a streamlined sustainability assessment tool for the urban water industry, and to demonstrate the feasibility of generating accurate life cycle assessments and life cycle costings, using such a tool. We use a real-life case study example consisting of 3 separate scenarios for a planned urban development to show that this kind of tool can emulate life cycle assessments and life cycle costings outcomes obtained through more detailed studies. This simplified approach is aimed at supporting "sustainability thinking" early in the decision-making process, thereby encouraging more sustainable water and sewerage infrastructure solutions. Copyright © 2011 SETAC.

Development of a research ethics knowledge and analytical skills assessment tool.

PubMed

Taylor, Holly A; Kass, Nancy E; Ali, Joseph; Sisson, Stephen; Bertram, Amanda; Bhan, Anant

2012-04-01

The goal of this project was to develop and validate a new tool to evaluate learners' knowledge and skills related to research ethics. A core set of 50 questions from existing computer-based online teaching modules were identified, refined and supplemented to create a set of 74 multiple-choice, true/false and short answer questions. The questions were pilot-tested and item discrimination was calculated for each question. Poorly performing items were eliminated or refined. Two comparable assessment tools were created. These assessment tools were administered as a pre-test and post-test to a cohort of 58 Indian junior health research investigators before and after exposure to a new course on research ethics. Half of the investigators were exposed to the course online, the other half in person. Item discrimination was calculated for each question and Cronbach's α for each assessment tool. A final version of the assessment tool that incorporated the best questions from the pre-/post-test phase was used to assess retention of research ethics knowledge and skills 3 months after course delivery. The final version of the REKASA includes 41 items and had a Cronbach's α of 0.837. The results illustrate, in one sample of learners, the successful, systematic development and use of a knowledge and skills assessment tool in research ethics capable of not only measuring basic knowledge in research ethics and oversight but also assessing learners' ability to apply ethics knowledge to the analytical task of reasoning through research ethics cases, without reliance on essay or discussion-based examination. These promising preliminary findings should be confirmed with additional groups of learners.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

Suicide Risk Screening Tools and the Youth Population.

PubMed

Patterson, Sharon

2016-08-01

The use of suicide risk screening tools is a critical component of a comprehensive approach to suicide risk assessment. Since nurses frequently spend more time with patients than any other healthcare professional, they are in key positions to detect and prevent suicidal behavior in youth. To inform nurses about suicide risk screening tools for the youth population. Suicide risk screening tools are research-based standardized instruments that are used to identify people who may be at risk for suicide. A literature search was performed using the Athabasca University Library Resource, the databases of the Cumulative Index to Nursing and Allied Health Literature, ScienceDirect, and Google Scholar. Nurses are cautioned to utilize suicide risk screening tools as only part of the suicide risk assessment in youth populations and avoid the danger of relying on tools that may result in a blind application of evidence to the detriment of clinical experience and judgement. © 2016 Wiley Periodicals, Inc.

Evaluation of virtual reality bronchoscopy as a learning and assessment tool.

PubMed

Moorthy, K; Smith, S; Brown, T; Bann, S; Darzi, A

2003-01-01

Conventional training in bronchoscopy involves a trainee performing on a real patient under supervision. This method of training is not only expensive, but there is also potential for increased patient discomfort. Simulators permit the acquisition of necessary technical skills required for the procedure. Virtual reality (VR) has been an integral part of training in aviation, and the application of this technology in medical training needs to be evaluated. This study was conducted to evaluate the efficacy of a VR bronchoscopy simulator as a learning and assessment tool. The bronchoscopic simulator (HT Medical Systems, Maryland, USA) is a VR computer programme. The simulator has the ability to assess competence by a set of parameters, which formed the data for the study. Nine novices without previous bronchoscopic experience formed the study group (group 1). Nine experienced bronchoscopists having performed between 200 and 1000 bronchoscopies formed the other group (group 2). We assessed the efficacy of the system as a learning tool by studying whether there was a significant difference between the first and subsequent sessions of the subjects from group 1 and by comparing the performance of the two groups. Statistical analysis was done using the Mann-Whitney U test and the Wilcoxon signed ranks test. There was a significant difference in performance between the first attempt of group 1 and the performance of the experts in terms of percentage of segments visualised and number of wall collisions and the economy of performance. Among the subjects from group 1, there was a significant improvement in percentage of segments visualised by the third attempt (p = 0.04), in the economy of performance by the sixth attempt (0.008) and in the number of wall collisions by the sixth attempt (0.024). When each attempt of the novices was compared with the performance of group 2, the significance in the difference of the percentage of segments studied (p = 0.09) and the economy of performance disappeared by the third attempt (0.06), while the difference in the number of wall collisions disappeared by the fifth attempt (p = 0.06). This study has been able to establish the face, construct and content validity of the simulator and the potential for it to be an effective training tool. Copyright 2003 S. Karger AG, Basel

Clinical Assessment of Risk Management: an INtegrated Approach (CARMINA).

PubMed

Tricarico, Pierfrancesco; Tardivo, Stefano; Sotgiu, Giovanni; Moretti, Francesca; Poletti, Piera; Fiore, Alberto; Monturano, Massimo; Mura, Ida; Privitera, Gaetano; Brusaferro, Silvio

2016-08-08

Purpose - The European Union recommendations for patient safety calls for shared clinical risk management (CRM) safety standards able to guide organizations in CRM implementation. The purpose of this paper is to develop a self-evaluation tool to measure healthcare organization performance on CRM and guide improvements over time. Design/methodology/approach - A multi-step approach was implemented including: a systematic literature review; consensus meetings with an expert panel from eight Italian leader organizations to get to an agreement on the first version; field testing to test instrument feasibility and flexibility; Delphi strategy with a second expert panel for content validation and balanced scoring system development. Findings - The self-assessment tool - Clinical Assessment of Risk Management: an INtegrated Approach includes seven areas (governance, communication, knowledge and skills, safe environment, care processes, adverse event management, learning from experience) and 52 standards. Each standard is evaluated according to four performance levels: minimum; monitoring; outcomes; and improvement actions, which resulted in a feasible, flexible and valid instrument to be used throughout different organizations. Practical implications - This tool allows practitioners to assess their CRM activities compared to minimum levels, monitor performance, benchmarking with other institutions and spreading results to different stakeholders. Originality/value - The multi-step approach allowed us to identify core minimum CRM levels in a field where no consensus has been reached. Most standards may be easily adopted in other countries.

Cross-cultural adaptation to Portuguese of tools for assessing the nutritional status of patients on dialysis.

PubMed

Fetter, Renata Lemos; Bigogno, Fernanda Guedes; de Oliveira, Fernanda Galvão Pasculli; Avesani, Carla Maria

2014-01-01

The 7 point subjective global assessment (7p-SGA) and the malnutrition inflammation score (MIS) are tools commonly applied for the assessment of nutritional status in dialyzed patients. Both were developed in English and require translation to Portuguese to be applied in Brazil. The cross-cultural equivalence process ensures semantic and measurement equivalence of a translated tool. To perform the cross-cultural adaptation to Portuguese of the 7p-SGA and MIS. Semantic equivalence was performed by the back-translation method and by assessing the degree of similarity between the original instrument and that back-translated from Portuguese to English (Back-translation). The assessment of the equivalence measurement was made by evaluating the intern reliability (Cronbach's α) and interobserver reliability (two observers). One-hundred and one elderly patients on hemodialysis (HD) were included. Both instruments showed a high degree of semantic similarity with results close to the maximum value (7p-SGA 96.8 ± 7.8 and MIS 99.6 ± 1.4). The intern consistency showed a Cronbach's α value for 7p-SGA of 0.72 and of 0.53 for MIS. The interobserver reproducibility of 7p-SGA was moderate (intraclass coefficient [ICC] = 0.74 [95% CI: 0.58; 0.84]), while for MIS was strong (ICC = 0.88 [95% CI: 0.81; 0.93]). The 7p-SGA and MIS translated into Portuguese can be applied for assessing the nutritional status of elderly patients on HD. Studies testing the applicability of these instruments in adult patients on HD and in peritoneal dialysis should yet be performed.

Logistics Company Carrier Partner 2.0.15 Tool: Technical Documentation 2015 Data Year - United States Version

EPA Pesticide Factsheets

This SmartWay Logistics 2.0.15 Tool is intended to help logistics companies estimate and assess their emission performance levels as well as their total emissions associated with goods movement in the U.S. freight rail, barge, air and t

Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

ERIC Educational Resources Information Center

Lafave, Mark; Katz, Larry; Butterwick, Dale

2008-01-01

Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

Evaluating trauma team performance in a Level I trauma center: Validation of the trauma team communication assessment (TTCA-24).

PubMed

DeMoor, Stephanie; Abdel-Rehim, Shady; Olmsted, Richard; Myers, John G; Parker-Raley, Jessica

2017-07-01

Nontechnical skills (NTS), such as team communication, are well-recognized determinants of trauma team performance and good patient care. Measuring these competencies during trauma resuscitations is essential, yet few valid and reliable tools are available. We aimed to demonstrate that the Trauma Team Communication Assessment (TTCA-24) is a valid and reliable instrument that measures communication effectiveness during activations. Two tools with adequate psychometric strength (Trauma Nontechnical Skills Scale [T-NOTECHS], Team Emergency Assessment Measure [TEAM]) were identified during a systematic review of medical literature and compared with TTCA-24. Three coders used each tool to evaluate 35 stable and 35 unstable patient activations (defined according to Advanced Trauma Life Support criteria). Interrater reliability was calculated between coders using the intraclass correlation coefficient. Spearman rank correlation coefficient was used to establish concurrent validity between TTCA-24 and the other two validated tools. Coders achieved an intraclass correlation coefficient of 0.87 for stable patient activations and 0.78 for unstable activations scoring excellent on the interrater agreement guidelines. The median score for each assessment showed good team communication for all 70 videos (TEAM, 39.8 of 54; T-NOTECHS, 17.4 of 25; and TTCA-24, 87.4 of 96). A significant correlation between TTTC-24 and T-NOTECHS was revealed (p = 0.029), but no significant correlation between TTCA-24 and TEAM (p = 0.77). Team communication was rated slightly better across all assessments for stable versus unstable patient activations, but not statistically significant. TTCA-24 correlated with T-NOTECHS, an instrument measuring nontechnical skills for trauma teams, but not TEAM, a tool that assesses communication in generic emergency settings. TTCA-24 is a reliable and valid assessment that can be a useful adjunct when evaluating interpersonal and team communication during trauma activations. Diagnostic tests or criteria, level II.

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

PubMed

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

Self Adapted Testing as Formative Assessment: Effects of Feedback and Scoring on Engagement and Performance

ERIC Educational Resources Information Center

Arieli-Attali, Meirav

2016-01-01

This dissertation investigated the feasibility of self-adapted testing (SAT) as a formative assessment tool with the focus on learning. Under two different orientation goals--to excel on a test (performance goal) or to learn from the test (learning goal)--I examined the effect of different scoring rules provided as interactive feedback, on test…

The Reliability of Classification Decisions for the Furtado-Gallagher Computerized Observational Movement Pattern Assessment System--FG-COMPASS

ERIC Educational Resources Information Center

Furtado, Ovande, Jr.; Gallagher, Jere D.

2012-01-01

Mastery of fundamental movement skills (FMS) is an important factor in preventing weight gain and increasing physical activity. To master FMS, performance evaluation is necessary. In this study, we investigated the reliability of a new observational assessment tool. In Phase I, 110 video clips of children performing five locomotor, and six…

The Development of SAH Reading Passage Compendium: A Tool for the Assessment of Reading Performance Related to Visual Function

ERIC Educational Resources Information Center

Chen, Ai-Hong; Buari, Noor Halilah; Jufri, Shauqiah

2017-01-01

Passages with continuous sentences are commonly used for the assessment of reading performance related to visual function, and rehabilitation in optometric practices. Passages created in native languages are crucial for a reliable interpretation in a real scenario. This study aimed to report the development of SAH Reading Passage Compendium…

Using Mobile Devices and the Adobe Connect Web Conferencing Tool in the Assessment of EFL Student Teacher Performance

ERIC Educational Resources Information Center

Bolona Lopez, Maria del Carmen; Ortiz, Margarita Elizabeth; Allen, Christopher

2015-01-01

This paper describes a project to use mobile devices and video conferencing technology in the assessment of student English as a Foreign Language (EFL) teacher performance on teaching practice in Ecuador. With the increasing availability of mobile devices with video recording facilities, it has become easier for trainers to capture teacher…

Validity evidence as a key marker of quality of technical skill assessment in OTL-HNS.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2018-01-13

Quality monitoring of assessment practices should be a priority in all residency programs. Validity evidence is one of the main hallmarks of assessment quality and should be collected to support the interpretation and use of assessment data. Our objective was to identify, synthesize, and present the validity evidence reported supporting different technical skill assessment tools in otolaryngology-head and neck surgery (OTL-HNS). We performed a secondary analysis of data generated through a systematic review of all published tools for assessing technical skills in OTL-HNS (n = 16). For each tool, we coded validity evidence according to the five types of evidence described by the American Educational Research Association's interpretation of Messick's validity framework. Descriptive statistical analyses were conducted. All 16 tools included in our analysis were supported by internal structure and relationship to variables validity evidence. Eleven articles presented evidence supporting content. Response process was discussed only in one article, and no study reported on evidence exploring consequences. We present the validity evidence reported for 16 rater-based tools that could be used for work-based assessment of OTL-HNS residents in the operating room. The articles included in our review were consistently deficient in evidence for response process and consequences. Rater-based assessment tools that support high-stakes decisions that impact the learner and programs should include several sources of validity evidence. Thus, use of any assessment should be done with careful consideration of the context-specific validity evidence supporting score interpretation, and we encourage deliberate continual assessment quality-monitoring. NA. Laryngoscope, 2018. © 2018 The American Laryngological, Rhinological and Otological Society, Inc.

Assessment for Learning: Shifting Our Focus

ERIC Educational Resources Information Center

Rosemartin, Dennis S.

2013-01-01

The use of assessments in public schools in the United States to link student test scores to school performance has arguably transformed assessments into accountability tools. Dennis S. Rosemartin, a former elementary classroom teacher, is currently a PhD candidate at the University of Arizona. His area of specialization is teacher preparation and…

A Self-Assessment Checklist for Undergraduate Students' Argumentative Writing

ERIC Educational Resources Information Center

Nimehchisalem, Vahid; Chye, David Yoong Soon; Jaswant Singh, Sheena Kaur A/P; Zainuddin, Siti Zaidah; Norouzi, Sara; Khalid, Sheren

2014-01-01

With a growing emphasis on students' ability to assess their own written works in teaching English as a Second Language (ESL) writing courses, self-assessment checklists are today regarded as useful tools. These checklists can help learners diagnose their own weaknesses and improve their writing performance. This necessitates development of…

The integrated landscape assessment project

Treesearch

Miles A. Hemstrom; Janine Salwasser; Joshua Halofsky; Jimmy Kagan; Cyndi Comfort

2012-01-01

The Integrated Landscape Assessment Project (ILAP) is a three-year effort that produces information, models, data, and tools to help land managers, policymakers, and others examine mid- to broad-scale (e.g., watersheds to states and larger areas) prioritization of land management actions, perform landscape assessments, and estimate potential effects of management...

Assessment Rubrics: Thinking inside the Boxes

ERIC Educational Resources Information Center

Bennett, Cary

2016-01-01

Assessment rubrics are being promoted and introduced into tertiary teaching practices on the grounds that they are an efficient and reliable tool to evaluate student performance effectively and promote student learning. However, there has been little discussion on the value of using assessment rubrics in higher education. Rather, they are being…

How Can You Support RIDM/CRM/RM Through the Use of PRA

NASA Technical Reports Server (NTRS)

DoVemto. Tpmu

2011-01-01

Probabilistic Risk Assessment (PRA) is one of key Risk Informed Decision Making (RIDM) tools. It is a scenario-based methodology aimed at identifying and assessing Safety and Technical Performance risks in complex technological systems.

Assessing the nutritional status of hospitalized elderly

PubMed Central

Abd Aziz, Nur Adilah Shuhada; Teng, Nur Islami Mohd Fahmi; Abdul Hamid, Mohd Ramadan; Ismail, Nazrul Hadi

2017-01-01

Purpose The increasing number of elderly people worldwide throughout the years is concerning due to the health problems often faced by this population. This review aims to summarize the nutritional status among hospitalized elderly and the role of the nutritional assessment tools in this issue. Methods A literature search was performed on six databases using the terms “malnutrition”, “hospitalised elderly”, “nutritional assessment”, “Mini Nutritional Assessment (MNA)”, “Geriatric Nutrition Risk Index (GNRI)”, and “Subjective Global Assessment (SGA)”. Results According to the previous studies, the prevalence of malnutrition among hospitalized elderly shows an increasing trend not only locally but also across the world. Under-recognition of malnutrition causes the number of malnourished hospitalized elderly to remain high throughout the years. Thus, the development of nutritional screening and assessment tools has been widely studied, and these tools are readily available nowadays. SGA, MNA, and GNRI are the nutritional assessment tools developed specifically for the elderly and are well validated in most countries. However, to date, there is no single tool that can be considered as the universal gold standard for the diagnosis of nutritional status in hospitalized patients. Conclusion It is important to identify which nutritional assessment tool is suitable to be used in this group to ensure that a structured assessment and documentation of nutritional status can be established. An early and accurate identification of the appropriate treatment of malnutrition can be done as soon as possible, and thus, the malnutrition rate among this group can be minimized in the future. PMID:29042762

Pilot Use of a Novel Tool to Assess Neurosurgical Capacity in Uganda.

PubMed

Ploss, Brittany; Abdelgadir, Jihad; Smith, Emily R; Fuller, Anthony; Nickenig Vissoci, Joao Ricardo; Muhindo, Alex; Galukande, Moses; Haglund, Michael M

2017-12-01

There is a significant burden of unmet surgical need in many low- and middle-income countries (>80% in parts of Africa). This need is even larger for specialties such as neurosurgery. Surgical capacity tools have been developed and used to assess needs and plan for resource allocation. This study piloted a new tool to assess neurosurgical capacity and describes its use. A surgical capacity tool was adapted to assess neurosurgical capacity. An expert panel of neurosurgeons and researchers reviewed the Surgeons OverSeas PIPES (personnel, infrastructure, procedures, equipment, and supplies) assessment and added additional items essential to perform common neurosurgery procedures. This tool was then piloted at 3 public hospitals in Uganda and each hospital was given a score of neurosurgical capacity. At 1 hospital, 3 respondents were asked to answer the survey to assess reliability. The hospital with the largest neurosurgery caseload and 5 neurosurgeons scored the highest on our survey, followed by a regional hospital with 1 practicing neurosurgeon. The third hospital, without a neurosurgeon, scored the lowest on the scale. At the hospital that completed the reliability assessment, scores were varied between respondents. NeuroPIPES survey scores were in keeping with the number of neurosurgeons and respective caseloads of each hospital. However, the variation in scores between respondents at the same hospital suggests that adaptations could be made to the tool that may improve reliability and validity. The methodology used to create NeuroPIPES may be successfully applied to a variety of other surgical subspecialties for similar assessments. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and validation of a Malawian version of the primary care assessment tool.

PubMed

Dullie, Luckson; Meland, Eivind; Hetlevik, Øystein; Mildestvedt, Thomas; Gjesdal, Sturla

2018-05-16

Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability. Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.

Assessment of olfactory function after traumatic brain injury: comparison of single odour tool with detailed assessment tool.

PubMed

Humphries, Thomas; Singh, Rajiv

2018-01-01

Olfactory disturbance (OD) is common after traumatic brain injury (TBI). Screening for OD can be performed by several different methods. While odour identification tools are considered more accurate, they are time consuming. The predominant method in clinical practice remains the use of a single odour. This study aimed to compare a brief single-odour identification tool (BSOIT) with a more detailed 12-odour assessment tool. One hundred seventy consecutive patients with TBI had their olfaction assessed using BSOIT and a 12-item tool at a single time point. The sensitivity and specificity of the BSOIT were calculated. The sensitivity and specificity of the BSOIT as compared to the Burghart tool were 57.5% and 100%, respectively, for all ODs (anosmia and hyposmia). The sensitivity and specificity for anosmia only were 93.5% and 96.7%, respectively. For the two tools, the Cohen's kappa coefficient showed moderate agreement when both anosmia and hyposmia were considered (k = 0.619, p < 0.001) but a very strong agreement when only anosmia was considered (k = 0.844, p < 0.001). For both the tools, anosmia had a significant association with TBI severity (p < 0.001). However, hyposmia showed no such association. The BSOIT is very effective at identifying anosmia but not hyposmia, producing comparable results to a more detailed test. It can be effective in clinical practice and takes considerably less time.

Daily functioning profile of children with attention deficit hyperactive disorder: A pilot study using an ecological assessment.

PubMed

Rosenblum, Sara; Frisch, Carmit; Deutsh-Castel, Tsofia; Josman, Naomi

2015-01-01

Children with attention-deficit hyperactivity disorder (ADHD) often present with activities of daily living (ADL) performance deficits. This study aimed to compare the performance characteristics of children with ADHD to those of controls based on the Do-Eat assessment tool, and to establish the tool's validity. Participants were 23 children with ADHD and 24 matched controls, aged 6-9 years. In addition to the Do-Eat, the Children Activity Scale-Parent (ChAS-P) and the Behavioral Rating Inventory of Executive Function (BRIEF) were used to measure sensorimotor abilities and executive function (EF). Significant differences were found in the Do-Eat scores between children with ADHD and controls. Significant moderate correlations were found between the Do-Eat sensorimotor scores, the ChAS-P and the BRIEF scores in the ADHD group. Significant correlations were found between performance on the Do-Eat and the ChAS-P questionnaire scores, verifying the tool's ecological validity. A single discriminant function described primarily by four Do-Eat variables, correctly classified 95.5% of the study participants into their respective study groups, establishing the tool's predictive validity within this population. These preliminary findings indicate that the Do-Eat may serve as a reliable and valid tool that provides insight into the daily functioning characteristics of children with ADHD. However, further research on larger samples is indicated.

Biodiversity in environmental assessment-current practice and tools for prediction

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gontier, Mikael; Balfors, Berit; Moertberg, Ulla

Habitat loss and fragmentation are major threats to biodiversity. Environmental impact assessment and strategic environmental assessment are essential instruments used in physical planning to address such problems. Yet there are no well-developed methods for quantifying and predicting impacts of fragmentation on biodiversity. In this study, a literature review was conducted on GIS-based ecological models that have potential as prediction tools for biodiversity assessment. Further, a review of environmental impact statements for road and railway projects from four European countries was performed, to study how impact prediction concerning biodiversity issues was addressed. The results of the study showed the existing gapmore » between research in GIS-based ecological modelling and current practice in biodiversity assessment within environmental assessment.« less

Predictive Validity of Measures of the Pathfinder Scaling Algorithm on Programming Performance: Alternative Assessment Strategy for Programming Education

ERIC Educational Resources Information Center

Lau, Wilfred W. F.; Yuen, Allan H. K.

2009-01-01

Recent years have seen a shift in focus from assessment of learning to assessment for learning and the emergence of alternative assessment methods. However, the reliability and validity of these methods as assessment tools are still questionable. In this article, we investigated the predictive validity of measures of the Pathfinder Scaling…

A Successful ED Fall Risk Program Using the KINDER 1 Fall RiskAssessment Tool.

PubMed

Townsend, Ann B; Valle-Ortiz, Marisol; Sansweet, Tracy

2016-11-01

Emergency nurses did not perform falls risk assessments routinely on our ED patients; the instrument used was aimed at inpatients. We identified a need to revise fall assessment practices specific to our emergency department. The purpose of the performance improvement project was to reduce ED falls and evaluate the use of an ED-specific fall risk tool, the KINDER 1 Fall Risk Assessment. The plan was to establish fall risk assessment practices at point of ED entry and to decrease total falls. We retrospectively reviewed ED fall data for each quarter of 2013, which included risk assessments scores, the total number of falls, and the circumstances of each fall. Using Kotter's framework to guide a successful change process, we implemented the KINDER 1 to assess fall risk. During the first 4 weeks of the project, 937 patients (27%) were identified as high risk for falls using the KINDER 1. During the subsequent 3 quarters, the total number of falls decreased; reported falls without injuries dropped from 0.21 to 0.07 per 1000 patients, and falls with injuries were reduced from 0.21 to 0.0 per 1000 patients. The results of this project represented a valuable step toward achieving our goal to keep ED patients safe from injuries as a result of falls. The findings add to the body of nursing knowledge on the application of clinical-based performance improvement projects to improve patient outcomes and to provide data on the use of the KINDER 1 tool, which has not been extensively tested. Copyright © 2016 Emergency Nurses Association. Published by Elsevier Inc. All rights reserved.

HiC-bench: comprehensive and reproducible Hi-C data analysis designed for parameter exploration and benchmarking.

PubMed

Lazaris, Charalampos; Kelly, Stephen; Ntziachristos, Panagiotis; Aifantis, Iannis; Tsirigos, Aristotelis

2017-01-05

Chromatin conformation capture techniques have evolved rapidly over the last few years and have provided new insights into genome organization at an unprecedented resolution. Analysis of Hi-C data is complex and computationally intensive involving multiple tasks and requiring robust quality assessment. This has led to the development of several tools and methods for processing Hi-C data. However, most of the existing tools do not cover all aspects of the analysis and only offer few quality assessment options. Additionally, availability of a multitude of tools makes scientists wonder how these tools and associated parameters can be optimally used, and how potential discrepancies can be interpreted and resolved. Most importantly, investigators need to be ensured that slight changes in parameters and/or methods do not affect the conclusions of their studies. To address these issues (compare, explore and reproduce), we introduce HiC-bench, a configurable computational platform for comprehensive and reproducible analysis of Hi-C sequencing data. HiC-bench performs all common Hi-C analysis tasks, such as alignment, filtering, contact matrix generation and normalization, identification of topological domains, scoring and annotation of specific interactions using both published tools and our own. We have also embedded various tasks that perform quality assessment and visualization. HiC-bench is implemented as a data flow platform with an emphasis on analysis reproducibility. Additionally, the user can readily perform parameter exploration and comparison of different tools in a combinatorial manner that takes into account all desired parameter settings in each pipeline task. This unique feature facilitates the design and execution of complex benchmark studies that may involve combinations of multiple tool/parameter choices in each step of the analysis. To demonstrate the usefulness of our platform, we performed a comprehensive benchmark of existing and new TAD callers exploring different matrix correction methods, parameter settings and sequencing depths. Users can extend our pipeline by adding more tools as they become available. HiC-bench consists an easy-to-use and extensible platform for comprehensive analysis of Hi-C datasets. We expect that it will facilitate current analyses and help scientists formulate and test new hypotheses in the field of three-dimensional genome organization.

Software Tools to Support the Assessment of System Health

NASA Technical Reports Server (NTRS)

Melcher, Kevin J.

2013-01-01

This presentation provides an overview of three software tools that were developed by the NASA Glenn Research Center to support the assessment of system health: the Propulsion Diagnostic Method Evaluation Strategy (ProDIMES), the Systematic Sensor Selection Strategy (S4), and the Extended Testability Analysis (ETA) tool. Originally developed to support specific NASA projects in aeronautics and space, these software tools are currently available to U.S. citizens through the NASA Glenn Software Catalog. The ProDiMES software tool was developed to support a uniform comparison of propulsion gas path diagnostic methods. Methods published in the open literature are typically applied to dissimilar platforms with different levels of complexity. They often address different diagnostic problems and use inconsistent metrics for evaluating performance. As a result, it is difficult to perform a one ]to ]one comparison of the various diagnostic methods. ProDIMES solves this problem by serving as a theme problem to aid in propulsion gas path diagnostic technology development and evaluation. The overall goal is to provide a tool that will serve as an industry standard, and will truly facilitate the development and evaluation of significant Engine Health Management (EHM) capabilities. ProDiMES has been developed under a collaborative project of The Technical Cooperation Program (TTCP) based on feedback provided by individuals within the aircraft engine health management community. The S4 software tool provides a framework that supports the optimal selection of sensors for health management assessments. S4 is structured to accommodate user ]defined applications, diagnostic systems, search techniques, and system requirements/constraints. One or more sensor suites that maximize this performance while meeting other user ]defined system requirements that are presumed to exist. S4 provides a systematic approach for evaluating combinations of sensors to determine the set or sets of sensors that optimally meet the performance goals and the constraints. It identifies optimal sensor suite solutions by utilizing a merit (i.e., cost) function with one of several available optimization approaches. As part of its analysis, S4 can expose fault conditions that are difficult to diagnose due to an incomplete diagnostic philosophy and/or a lack of sensors. S4 was originally developed and applied to liquid rocket engines. It was subsequently used to study the optimized selection of sensors for a simulation ]based aircraft engine diagnostic system. The ETA Tool is a software ]based analysis tool that augments the testability analysis and reporting capabilities of a commercial ]off ]the ]shelf (COTS) package. An initial diagnostic assessment is performed by the COTS software using a user ]developed, qualitative, directed ]graph model of the system being analyzed. The ETA Tool accesses system design information captured within the model and the associated testability analysis output to create a series of six reports for various system engineering needs. These reports are highlighted in the presentation. The ETA Tool was developed by NASA to support the verification of fault management requirements early in the Launch Vehicle process. Due to their early development during the design process, the TEAMS ]based diagnostic model and the ETA Tool were able to positively influence the system design by highlighting gaps in failure detection, fault isolation, and failure recovery.

A Process-Centered Tool for Evaluating Patient Safety Performance and Guiding Strategic Improvement

DTIC Science & Technology

2005-01-01

next patient safety steps in individual health care organizations. The low priority given to Category 3 (Focus on patients , other customers , and...presents a patient safety applicator tool for implementing and assessing patient safety systems in health care institutions. The applicator tool consists...the survey rounds. The study addressed three research questions: 1. What critical processes should be included in health care patient safety systems

Non-Simultaneous Relative Importance-Performance Analysis: Meta-Results from 80 College Choice Surveys with 55,276 Respondents.

ERIC Educational Resources Information Center

Chapman, Randall G.

1993-01-01

A study investigated the utility of importance-performance analysis, a marketing tool for assessing marketing position and performance, in learning how college applicants perceive their chosen college in comparison with others. Findings reflect the complexity of student decisions and suggest the "average" college performs above average…

The Readiness to Change for Bariatric Surgery Assessment Tool: Validity, Factor Structure, and Reliability.

PubMed

Carlson, Susan M S

2017-11-01

Currently, there is no guideline or standard of practice for performing the psychiatric/psychological evaluation that is a requirement for approval for bariatric surgery. The Readiness to Change for Bariatric Surgery Assessment Tool (RCB-SAT) establishes a means for psychiatric evaluators to objectively assess the patient's cognition, beliefs, and motivation around the bariatric diet and lifestyle changes. Development of a clinical decision-making tool for assessing readiness to change in bariatric patients will be useful regarding The Strategic Plan for NIH Obesity Research. The strategic plan outlines 6 overarching themes, with the last 3 centering around creation of such a clinical decision-making tool to assess a bariatric patient's readiness to change: evaluate promising strategies for obesity prevention and treatment in realworld settings and diverse populations, harness technology and tools to advance obesity research and improve health care delivery, and facilitate integration of research results into community programs and medical practice (National Institutes of Health, 2011). The pilot tool was administered to 153 potential bariatric patients, with 61 patients completing the survey a second time. Face and content validity of the items were established through an expert review process. Principle axis factoring by means of varimax rotation with Kaiser normalization identified 15 items loading on 3 factors associated with Prochaska and DiClemente's transtheoretical model of health behavior change: precontemplation, contemplation, and action (DiClemente & Prochaska, 1998). Test-retest reliability was also established for the tool. The proposed RCB-SAT demonstrates potential for assessing a patient's readiness to change regarding the bariatric diet and lifestyle.

Methods for assessing fracture risk prediction models: experience with FRAX in a large integrated health care delivery system.

PubMed

Pressman, Alice R; Lo, Joan C; Chandra, Malini; Ettinger, Bruce

2011-01-01

Area under the receiver operating characteristics (AUROC) curve is often used to evaluate risk models. However, reclassification tests provide an alternative assessment of model performance. We performed both evaluations on results from FRAX (World Health Organization Collaborating Centre for Metabolic Bone Diseases, University of Sheffield, UK), a fracture risk tool, using Kaiser Permanente Northern California women older than 50yr with bone mineral density (BMD) measured during 1997-2003. We compared FRAX performance with and without BMD in the model. Among 94,489 women with mean follow-up of 6.6yr, 1579 (1.7%) sustained a hip fracture. Overall, AUROCs were 0.83 and 0.84 for FRAX without and with BMD, suggesting that BMD did not contribute to model performance. AUROC decreased with increasing age, and BMD contributed significantly to higher AUROC among those aged 70yr and older. Using an 81% sensitivity threshold (optimum level from receiver operating characteristic curve, corresponding to 1.2% cutoff), 35% of those categorized above were reassigned below when BMD was added. In contrast, only 10% of those categorized below were reassigned to the higher risk category when BMD was added. The net reclassification improvement was 5.5% (p<0.01). Two versions of this risk tool have similar AUROCs, but alternative assessments indicate that addition of BMD improves performance. Multiple methods should be used to evaluate risk tool performance with less reliance on AUROC alone. Copyright © 2011 The International Society for Clinical Densitometry. Published by Elsevier Inc. All rights reserved.

A numerical tool for reproducing driver behaviour: experiments and predictive simulations.

PubMed

Casucci, M; Marchitto, M; Cacciabue, P C

2010-03-01

This paper presents the simulation tool called SDDRIVE (Simple Simulation of Driver performance), which is the numerical computerised implementation of the theoretical architecture describing Driver-Vehicle-Environment (DVE) interactions, contained in Cacciabue and Carsten [Cacciabue, P.C., Carsten, O. A simple model of driver behaviour to sustain design and safety assessment of automated systems in automotive environments, 2010]. Following a brief description of the basic algorithms that simulate the performance of drivers, the paper presents and discusses a set of experiments carried out in a Virtual Reality full scale simulator for validating the simulation. Then the predictive potentiality of the tool is shown by discussing two case studies of DVE interactions, performed in the presence of different driver attitudes in similar traffic conditions.

The Fishery Performance Indicators: A Management Tool for Triple Bottom Line Outcomes

PubMed Central

Anderson, James L.; Anderson, Christopher M.; Chu, Jingjie; Meredith, Jennifer; Asche, Frank; Sylvia, Gil; Smith, Martin D.; Anggraeni, Dessy; Arthur, Robert; Guttormsen, Atle; McCluney, Jessica K.; Ward, Tim; Akpalu, Wisdom; Eggert, Håkan; Flores, Jimely; Freeman, Matthew A.; Holland, Daniel S.; Knapp, Gunnar; Kobayashi, Mimako; Larkin, Sherry; MacLauchlin, Kari; Schnier, Kurt; Soboil, Mark; Tveteras, Sigbjorn; Uchida, Hirotsugu; Valderrama, Diego

2015-01-01

Pursuit of the triple bottom line of economic, community and ecological sustainability has increased the complexity of fishery management; fisheries assessments require new types of data and analysis to guide science-based policy in addition to traditional biological information and modeling. We introduce the Fishery Performance Indicators (FPIs), a broadly applicable and flexible tool for assessing performance in individual fisheries, and for establishing cross-sectional links between enabling conditions, management strategies and triple bottom line outcomes. Conceptually separating measures of performance, the FPIs use 68 individual outcome metrics—coded on a 1 to 5 scale based on expert assessment to facilitate application to data poor fisheries and sectors—that can be partitioned into sector-based or triple-bottom-line sustainability-based interpretative indicators. Variation among outcomes is explained with 54 similarly structured metrics of inputs, management approaches and enabling conditions. Using 61 initial fishery case studies drawn from industrial and developing countries around the world, we demonstrate the inferential importance of tracking economic and community outcomes, in addition to resource status. PMID:25946194

Good veterinary governance: definition, measurement and challenges.

PubMed

Msellati, L; Commault, J; Dehove, A

2012-08-01

Good veterinary governance assumes the provision of veterinary services that are sustainably financed, universally available, and provided efficiently without waste or duplication, in a manner that is transparent and free of fraud or corruption. Good veterinary governance is a necessary condition for sustainable economic development insomuch as it promotes the effective delivery of services and improves the overall performance of animal health systems. This article defines governance in Veterinary Services and proposes a framework for its measurement. It also discusses the role of Veterinary Services and analyses the governance dimensions of the performance-assessment tools developed by the World Organisation for Animal Health (OIE). These tools (OIE PVS Tool and PVS Gap Analysis) track the performance of Veterinary Services across countries (a harmonised tool) and over time (the PVS Pathway). The article shows the usefulness of the OIE PVS Tool for measuring governance, but also points to two shortcomings, namely (i) the lack of clear outcome indicators, which is an impediment to a comprehensive assessment of the performance of Veterinary Services, and (ii) the lack of specific measures for assessing the extent of corruption within Veterinary Services and the extent to which demand for better governance is being strengthened within the animal health system. A discussion follows on the drivers of corruption and instruments for perception-based assessments of country governance and corruption. Similarly, the article introduces the concept of social accountability, which is an approach to enhancing government transparency and accountability, and shows how supply-side and demand-side mechanisms complement each other in improving the governance of service delivery. It further elaborates on two instruments--citizen report card surveys and grievance redress mechanisms--because of their wider relevance and their possible applications in many settings, including Veterinary Services. Also, central to improving transparency and accountability is access to information and a discussion on the appropriate level of decentralisation of Veterinary Services. Bringing Veterinary Services into compliance with OIE international standards would contribute to improving governance and providing economic benefits through increased animal productivity, the expansion of trade and improved food security. It would also help to increase public health benefits, through greater food safety and better prevention and control of zoonoses.

Field Assessment of Energy Audit Tools for Retrofit Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Edwards, J.; Bohac, D.; Nelson, C.

2013-07-01

This project focused on the use of home energy ratings as a tool to promote energy retrofits in existing homes. A home energy rating provides a quantitative appraisal of a home’s energy performance, usually compared to a benchmark such as the average energy use of similar homes in the same region. Rating systems based on energy performance models, the focus of this report, can establish a home’s achievable energy efficiency potential and provide a quantitative assessment of energy savings after retrofits are completed, although their accuracy needs to be verified by actual measurement or billing data. Ratings can also showmore » homeowners where they stand compared to their neighbors, thus creating social pressure to conform to or surpass others. This project field-tested three different building performance models of varying complexity, in order to assess their value as rating systems in the context of a residential retrofit program: Home Energy Score, SIMPLE, and REM/Rate.« less

Auralization of Hybrid Wing Body Aircraft Flyover Noise from System Noise Predictions

NASA Technical Reports Server (NTRS)

Rizzi, Stephen A.; Aumann, Aric R.; Lopes, Leonvard V.; Burley, Casey L.

2013-01-01

System noise assessments of a state-of-the-art reference aircraft (similar to a Boeing 777-200ER with GE90-like turbofan engines) and several hybrid wing body (HWB) aircraft configurations were recently performed using NASA engine and aircraft system analysis tools. The HWB aircraft were sized to an equivalent mission as the reference aircraft and assessments were performed using measurements of airframe shielding from a series of propulsion airframe aeroacoustic experiments. The focus of this work is to auralize flyover noise from the reference aircraft and the best HWB configuration using source noise predictions and shielding data based largely on the earlier assessments. For each aircraft, three flyover conditions are auralized. These correspond to approach, sideline, and cutback operating states, but flown in straight and level flight trajectories. The auralizations are performed using synthesis and simulation tools developed at NASA. Audio and visual presentations are provided to allow the reader to experience the flyover from the perspective of a listener in the simulated environment.

National Center for Farmworker Health

MedlinePlus

... Access Data Health Centers Population Estimates Resources Performance Management & Governance Tool Box > Administrative Governance Human Resources Needs Assessment Service Delivery Emergency Preparedness Call for ...

Sarcopenia in daily practice: assessment and management.

PubMed

Beaudart, Charlotte; McCloskey, Eugène; Bruyère, Olivier; Cesari, Matteo; Rolland, Yves; Rizzoli, René; Araujo de Carvalho, Islène; Amuthavalli Thiyagarajan, Jotheeswaran; Bautmans, Ivan; Bertière, Marie-Claude; Brandi, Maria Luisa; Al-Daghri, Nasser M; Burlet, Nansa; Cavalier, Etienne; Cerreta, Francesca; Cherubini, Antonio; Fielding, Roger; Gielen, Evelien; Landi, Francesco; Petermans, Jean; Reginster, Jean-Yves; Visser, Marjolein; Kanis, John; Cooper, Cyrus

2016-10-05

Sarcopenia is increasingly recognized as a correlate of ageing and is associated with increased likelihood of adverse outcomes including falls, fractures, frailty and mortality. Several tools have been recommended to assess muscle mass, muscle strength and physical performance in clinical trials. Whilst these tools have proven to be accurate and reliable in investigational settings, many are not easily applied to daily practice. This paper is based on literature reviews performed by members of the European Society for Clinical and Economic Aspects of Osteoporosis and Osteoarthritis (ESCEO) working group on frailty and sarcopenia. Face-to-face meetings were afterwards organized for the whole group to make amendments and discuss further recommendations. This paper proposes some user-friendly and inexpensive methods that can be used to assess sarcopenia in real-life settings. Healthcare providers, particularly in primary care, should consider an assessment of sarcopenia in individuals at increased risk; suggested tools for assessing risk include the Red Flag Method, the SARC-F questionnaire, the SMI method or different prediction equations. Management of sarcopenia should primarily be patient centered and involve the combination of both resistance and endurance based activity programmes with or without dietary interventions. Development of a number of pharmacological interventions is also in progress. Assessment of sarcopenia in individuals with risk factors, symptoms and/or conditions exposing them to the risk of disability will become particularly important in the near future.

Manual on performance of traffic signal systems: assessment of operations and maintenance : [summary].

DOT National Transportation Integrated Search

2017-05-01

In this project, Florida Atlantic University researchers developed a methodology and software tools that allow objective, quantitative analysis of the performance of signal systems. : The researchers surveyed the state of practice for traffic signal ...

Assessing Lymphatic Filariasis Data Quality in Endemic Communities in Ghana, Using the Neglected Tropical Diseases Data Quality Assessment Tool for Preventive Chemotherapy.

PubMed

de Souza, Dziedzom K; Yirenkyi, Eric; Otchere, Joseph; Biritwum, Nana-Kwadwo; Ameme, Donne K; Sackey, Samuel; Ahorlu, Collins; Wilson, Michael D

2016-03-01

The activities of the Global Programme for the Elimination of Lymphatic Filariasis have been in operation since the year 2000, with Mass Drug Administration (MDA) undertaken yearly in disease endemic communities. Information collected during MDA-such as population demographics, age, sex, drugs used and remaining, and therapeutic and geographic coverage-can be used to assess the quality of the data reported. To assist country programmes in evaluating the information reported, the WHO, in collaboration with NTD partners, including ENVISION/RTI, developed an NTD Data Quality Assessment (DQA) tool, for use by programmes. This study was undertaken to evaluate the tool and assess the quality of data reported in some endemic communities in Ghana. A cross sectional study, involving review of data registers and interview of drug distributors, disease control officers, and health information officers using the NTD DQA tool, was carried out in selected communities in three LF endemic Districts in Ghana. Data registers for service delivery points were obtained from District health office for assessment. The assessment verified reported results in comparison with recounted values for five indicators: number of tablets received, number of tablets used, number of tablets remaining, MDA coverage, and population treated. Furthermore, drug distributors, disease control officers, and health information officers (at the first data aggregation level), were interviewed, using the DQA tool, to determine the performance of the functional areas of the data management system. The results showed that over 60% of the data reported were inaccurate, and exposed the challenges and limitations of the data management system. The DQA tool is a very useful monitoring and evaluation (M&E) tool that can be used to elucidate and address data quality issues in various NTD control programmes.

Assessment of the predictive accuracy of five in silico prediction tools, alone or in combination, and two metaservers to classify long QT syndrome gene mutations.

PubMed

Leong, Ivone U S; Stuckey, Alexander; Lai, Daniel; Skinner, Jonathan R; Love, Donald R

2015-05-13

Long QT syndrome (LQTS) is an autosomal dominant condition predisposing to sudden death from malignant arrhythmia. Genetic testing identifies many missense single nucleotide variants of uncertain pathogenicity. Establishing genetic pathogenicity is an essential prerequisite to family cascade screening. Many laboratories use in silico prediction tools, either alone or in combination, or metaservers, in order to predict pathogenicity; however, their accuracy in the context of LQTS is unknown. We evaluated the accuracy of five in silico programs and two metaservers in the analysis of LQTS 1-3 gene variants. The in silico tools SIFT, PolyPhen-2, PROVEAN, SNPs&GO and SNAP, either alone or in all possible combinations, and the metaservers Meta-SNP and PredictSNP, were tested on 312 KCNQ1, KCNH2 and SCN5A gene variants that have previously been characterised by either in vitro or co-segregation studies as either "pathogenic" (283) or "benign" (29). The accuracy, sensitivity, specificity and Matthews Correlation Coefficient (MCC) were calculated to determine the best combination of in silico tools for each LQTS gene, and when all genes are combined. The best combination of in silico tools for KCNQ1 is PROVEAN, SNPs&GO and SIFT (accuracy 92.7%, sensitivity 93.1%, specificity 100% and MCC 0.70). The best combination of in silico tools for KCNH2 is SIFT and PROVEAN or PROVEAN, SNPs&GO and SIFT. Both combinations have the same scores for accuracy (91.1%), sensitivity (91.5%), specificity (87.5%) and MCC (0.62). In the case of SCN5A, SNAP and PROVEAN provided the best combination (accuracy 81.4%, sensitivity 86.9%, specificity 50.0%, and MCC 0.32). When all three LQT genes are combined, SIFT, PROVEAN and SNAP is the combination with the best performance (accuracy 82.7%, sensitivity 83.0%, specificity 80.0%, and MCC 0.44). Both metaservers performed better than the single in silico tools; however, they did not perform better than the best performing combination of in silico tools. The combination of in silico tools with the best performance is gene-dependent. The in silico tools reported here may have some value in assessing variants in the KCNQ1 and KCNH2 genes, but caution should be taken when the analysis is applied to SCN5A gene variants.

Delirium monitoring and patient outcomes in a general intensive care unit.

PubMed

Andrews, Lois; Silva, Susan G; Kaplan, Susan; Zimbro, Kathie

2015-01-01

Use of an evidence-based tool for routine assessment for delirium by bedside nurses in the intensive care unit is recommended. However, little is known about patient outcomes after implementation of such a tool. To evaluate the implementation and effects of the Confusion Assessment Method for the Intensive Care Unit as a bedside assessment for delirium in a general intensive care unit in a tertiary care hospital. Charts of patients admitted to the unit during a 3-month period before implementation of the assessment tool and 1 year after implementation were reviewed retrospectively. Patient outcomes were incidence of delirium diagnosis, duration of mechanical ventilation, length of stay in the intensive care unit, and time spent in restraints. The 2 groups of patients did not differ in demographics, clinical characteristics, or predisposing factors. The groups also did not differ significantly in delirium diagnosis, duration of mechanical ventilation, length of stay in the intensive care unit, or time spent in restraints. Barriers to use of the tool included nurses' lack of confidence in performing the assessment, concerns about use of the tool in patients receiving mechanical ventilation, and lack of interdisciplinary response to findings obtained with the tool. No change in patient outcomes or diagnosis of delirium occurred 1 year after implementation of the Confusion Assessment Method for the Intensive Care Unit. Lessons learned and barriers to adoption and use, however, were identified. ©2015 American Association of Critical-Care Nurses.

[Assessment of a supervision grid being used in the laboratories of cutaneous leishmaniasis in Morocco].

PubMed

El Mansouri, Bouchra; Amarir, Fatima; Hajli, Yamina; Fellah, Hajiba; Sebti, Faiza; Delouane, Bouchra; Sadak, Abderrahim; Adlaoui, El Bachir; Rhajaoui, Mohammed

2017-01-01

The aim of our study was to assess a standardized supervisory grid as a new supervision tool being used in the laboratories of leishmaniasis. We conducted a pilot trial to evaluate the ongoing performances of seven provincial laboratories, in four provinces in Morocco, over a period of two years, between 2006 and 2014. This study detailed the situation in provincial laboratories before and after the implementation of the supervisory grid. A total of twenty-one grids were analyzed. In 2006, the results clearly showed a poor performance of laboratories: need for training (41.6%), staff performing skin biopsy (25%), shortage of materials and reagents (65%), non-compliant document and local management (85%). Several corrective actions were conducted by the National Reference Laboratory (LNRL) of Leishmaniasis during the study period. In 2014, the LNRL recorded a net improvement of the performances of the laboratories. The need for training, the quality of the biopsy, the supply of tools and reagents were met and an effective coordination activity was established between the LNRL and the provincial laboratories. This trial shows the effectiveness of the grid as a high quality supervisory tool and as a cornerstone of making progress on fight programs against leishmaniases.

Navigation and Guidance for Low-Thrust Trajectories, LOTNAV

NASA Astrophysics Data System (ADS)

Cano, J. L.; Bello, M.; Rodriguez-Canabal, J.

A number of interplanetary low-thrust missions have already been flown by many space agencies. Examples of already flown missions based on the use of electric propulsion are Deep Space 1, Hayabusa and SMART-1. Many others are already in the assessment phase or in the development phase itself. In such perspective, it is required by the space agencies the procurement and utilisation of assessment tools for fast prototyping in the areas of mission design and navigation. The Low-Thrust Interplanetary Navigation Tool, which is the subject of this paper, allows the mission analyst performing such type of quick assessment studies for the early phases in the development of low-thrust missions. A number of test cases on low-thrust missions are also presented along with the utilities composing the LOTNAV tool.

Relations between mental health team characteristics and work role performance.

PubMed

Fleury, Marie-Josée; Grenier, Guy; Bamvita, Jean-Marie; Farand, Lambert

2017-01-01

Effective mental health care requires a high performing, interprofessional team. Among 79 mental health teams in Quebec (Canada), this exploratory study aims to 1) determine the association between work role performance and a wide range of variables related to team effectiveness according to the literature, and to 2) using structural equation modelling, assess the covariance between each of these variables as well as the correlation with other exogenous variables. Work role performance was measured with an adapted version of a work role questionnaire. Various independent variables including team manager characteristics, user characteristics, team profiles, clinical activities, organizational culture, network integration strategies and frequency/satisfaction of interactions with other teams or services were analyzed under the structural equation model. The later provided a good fit with the data. Frequent use of standardized procedures and evaluation tools (e.g. screening and assessment tools for mental health disorders) and team manager seniority exerted the most direct effect on work role performance. While network integration strategies had little effect on work role performance, there was a high covariance between this variable and those directly affecting work role performance among mental health teams. The results suggest that the mental healthcare system should apply standardized procedures and evaluation tools and, to a lesser extent, clinical approaches to improve work role performance in mental health teams. Overall, a more systematic implementation of network integration strategies may contribute to improved work role performance in mental health care.

Relations between mental health team characteristics and work role performance

PubMed Central

Grenier, Guy; Bamvita, Jean-Marie; Farand, Lambert

2017-01-01

Effective mental health care requires a high performing, interprofessional team. Among 79 mental health teams in Quebec (Canada), this exploratory study aims to 1) determine the association between work role performance and a wide range of variables related to team effectiveness according to the literature, and to 2) using structural equation modelling, assess the covariance between each of these variables as well as the correlation with other exogenous variables. Work role performance was measured with an adapted version of a work role questionnaire. Various independent variables including team manager characteristics, user characteristics, team profiles, clinical activities, organizational culture, network integration strategies and frequency/satisfaction of interactions with other teams or services were analyzed under the structural equation model. The later provided a good fit with the data. Frequent use of standardized procedures and evaluation tools (e.g. screening and assessment tools for mental health disorders) and team manager seniority exerted the most direct effect on work role performance. While network integration strategies had little effect on work role performance, there was a high covariance between this variable and those directly affecting work role performance among mental health teams. The results suggest that the mental healthcare system should apply standardized procedures and evaluation tools and, to a lesser extent, clinical approaches to improve work role performance in mental health teams. Overall, a more systematic implementation of network integration strategies may contribute to improved work role performance in mental health care. PMID:28991923

Measurement tools and outcome measures used in transitional patient safety; a systematic review.

PubMed

van Melle, Marije A; van Stel, Henk F; Poldervaart, Judith M; de Wit, Niek J; Zwart, Dorien L M

2018-01-01

Patients are at risk for harm when treated simultaneously by healthcare providers from different healthcare organisations. To assess current practice and improvements of transitional patient safety, valid measurement tools are needed. To identify and appraise all measurement tools and outcomes that measure aspects of transitional patient safety, PubMed, Cinahl, Embase and Psychinfo were systematically searched. Two researchers performed the title and abstract and full-text selection. First, publications about validation of measurement tools were appraised for quality following COSMIN criteria. Second, we inventoried all measurement tools and outcome measures found in our search that assessed current transitional patient safety or the effect of interventions targeting transitional patient safety. The initial search yielded 8288 studies, of which 18 assessed validity of measurement tools of different aspects of transitional safety, and 191 assessed current transitional patient safety or effect of interventions. In the validated measurement tools, the overall quality of content and structural validity was acceptable; other COSMIN criteria, such as reliability, measurement error and responsiveness, were mostly poor or not reported. In our outcome inventory, the most frequently used validated outcome measure was the Care Transition Measure (n = 9). The most frequently used non-validated outcome measures were: medication discrepancies (n = 98), hospital readmissions (n = 55), adverse events (n = 34), emergency department visits (n = 33), (mental or physical) health status (n = 28), quality and timeliness of discharge summary, and patient satisfaction (n = 23). Although no validated measures exist that assess all aspects of transitional patient safety, we found validated measurement tools on specific aspects. Reporting of validity of transitional measurement tools was incomplete. Numerous outcome measures with unknown measurement properties are used in current studies on safety of care transitions, which makes interpretation or comparison of their results uncertain.

Impact of design-parameters on the optical performance of a high-power adaptive mirror

NASA Astrophysics Data System (ADS)

Koek, Wouter D.; Nijkerk, David; Smeltink, Jeroen A.; van den Dool, Teun C.; van Zwet, Erwin J.; van Baars, Gregor E.

2017-02-01

TNO is developing a High Power Adaptive Mirror (HPAM) to be used in the CO2 laser beam path of an Extreme Ultra- Violet (EUV) light source for next-generation lithography. In this paper we report on a developed methodology, and the necessary simulation tools, to assess the performance and associated sensitivities of this deformable mirror. Our analyses show that, given the current limited insight concerning the process window of EUV generation, the HPAM module should have an actuator pitch of <= 4 mm. Furthermore we have modelled the sensitivity of performance with respect to dimpling and actuator noise. For example, for a deformable mirror with an actuator pitch of 4 mm, and if the associated performance impact is to be limited to smaller than 5%, the actuator noise should be smaller than 45 nm (rms). Our tools assist in the detailed design process by assessing the performance impact of various design choices, including for example those that affect the shape and spectral content of the influence function.

Development of a Mass Casualty Triage Performance Assessment Tool

DTIC Science & Technology

2015-02-01

mass casualty triage and interviews with members of the unit, the triage assessment development involved three steps: (1) identification of key...Unlimited c. THIS PAGE Unlimited Unlimited Unclassified 35 19b. TELEPHONE NUMBER (include area code ) i Technical...in this report was initiated by ARI-FHRU to develop a prototype measure of performance for one of the three collective tasks identified in the

Ceramic tools insert assesment based on vickers indentation methodology

NASA Astrophysics Data System (ADS)

Husni; Rizal, Muhammad; Aziz M, M.; Wahyu, M.

2018-05-01

In the interrupted cutting process, the risk of tool chipping or fracture is higher than continues cutting. Therefore, the selection of suitable ceramic tools for interrupted cutting application become an important issue to assure that the cutting process is running effectively. At present, the performance of ceramics tools is assessed by conducting some cutting tests, which is required time and cost consuming. In this study, the performance of ceramic tools evaluated using hardness tester machine. The technique, in general, has a certain advantage compare with the more conventional methods; the experimental is straightforward involving minimal specimen preparation and the amount of material needed is small. Three types of ceramic tools AS10, CC650 and K090 have been used, each tool was polished then Vickers indentation test were performed with the load were 0.2, 0.5, 1, 2.5, 5 and 10 kgf. The results revealed that among the load used in the tests, the indentation loads of 5 kgf always produce well cracks as compared with others. Among the cutting tool used in the tests, AS10 has produced the shortest crack length and follow by CC 670, and K090. It is indicated that the shortest crack length of AS10 reflected that the tool has a highest dynamic load resistance among others insert.

Enhancing Classroom Effectiveness through Social Networking Tools

ERIC Educational Resources Information Center

Kurthakoti, Raghu; Boostrom, Robert E., Jr.; Summey, John H.; Campbell, David A.

2013-01-01

To determine the usefulness of social networking Web sites such as Ning.com as a communication tool in marketing courses, a study was designed with special concern for social network use in comparison to Blackboard. Students from multiple marketing courses were surveyed. Assessments of Ning.com and Blackboard were performed both to understand how…

Proposal of an environmental performance index to assess solid waste treatment technologies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goulart Coelho, Hosmanny Mauro, E-mail: hosmanny@hotmail.com; Lange, Lisete Celina; Coelho, Lineker Max Goulart

2012-07-15

Highlights: Black-Right-Pointing-Pointer Proposal of a new concept in waste management: Cleaner Treatment. Black-Right-Pointing-Pointer Development of an index to assess quantitatively waste treatment technologies. Black-Right-Pointing-Pointer Delphi Method was carried out so as to define environmental indicators. Black-Right-Pointing-Pointer Environmental performance evaluation of waste-to-energy plants. - Abstract: Although the concern with sustainable development and environment protection has considerably grown in the last years it is noted that the majority of decision making models and tools are still either excessively tied to economic aspects or geared to the production process. Moreover, existing models focus on the priority steps of solid waste management, beyond wastemore » energy recovery and disposal. So, in order to help the lack of models and tools aiming at the waste treatment and final disposal, a new concept is proposed: the Cleaner Treatment, which is based on the Cleaner Production principles. This paper focuses on the development and validation of the Cleaner Treatment Index (CTI), to assess environmental performance of waste treatment technologies based on the Cleaner Treatment concept. The index is formed by aggregation (summation or product) of several indicators that consists in operational parameters. The weights of the indicator were established by Delphi Method and Brazilian Environmental Laws. In addition, sensitivity analyses were carried out comparing both aggregation methods. Finally, index validation was carried out by applying the CTI to 10 waste-to-energy plants data. From sensitivity analysis and validation results it is possible to infer that summation model is the most suitable aggregation method. For summation method, CTI results were superior to 0.5 (in a scale from 0 to 1) for most facilities evaluated. So, this study demonstrates that CTI is a simple and robust tool to assess and compare the environmental performance of different treatment plants being an excellent quantitative tool to support Cleaner Treatment implementation.« less

Zone calculation as a tool for assessing performance outcome in laparoscopic suturing.

PubMed

Buckley, Christina E; Kavanagh, Dara O; Nugent, Emmeline; Ryan, Donncha; Traynor, Oscar J; Neary, Paul C

2015-06-01

Simulator performance is measured by metrics, which are valued as an objective way of assessing trainees. Certain procedures such as laparoscopic suturing, however, may not be suitable for assessment under traditionally formulated metrics. Our aim was to assess if our new metric is a valid method of assessing laparoscopic suturing. A software program was developed to order to create a new metric, which would calculate the percentage of time spent operating within pre-defined areas called "zones." Twenty-five candidates (medical students N = 10, surgical residents N = 10, and laparoscopic experts N = 5) performed the laparoscopic suturing task on the ProMIS III(®) simulator. New metrics of "in-zone" and "out-zone" scores as well as traditional metrics of time, path length, and smoothness were generated. Performance was also assessed by two blinded observers using the OSATS and FLS rating scales. This novel metric was evaluated by comparing it to both traditional metrics and subjective scores. There was a significant difference in the average in-zone and out-zone scores between all three experience groups (p < 0.05). The new zone metrics scores correlated significantly with the subjective-blinded observer scores of OSATS and FLS (p = 0.0001). The new zone metric scores also correlated significantly with the traditional metrics of path length, time, and smoothness (p < 0.05). The new metric is a valid tool for assessing laparoscopic suturing objectively. This could be incorporated into a competency-based curriculum to monitor resident progression in the simulated setting.

Measurement of Instrumental and Vocal Undergraduate Performance Juries Using a Multidimensional Assessment Rubric

ERIC Educational Resources Information Center

Ciorba, Charles R.; Smith, Neal Y.

2009-01-01

Recent policy initiatives instituted by major accrediting bodies require the implementation of specific assessment tools to provide evidence of student achievement in a number of areas, including applied music study. The purpose of this research was to investigate the effectiveness of a multidimensional assessment rubric, which was administered to…

Emergent Literacy Performance across Two Languages: Assessing Four-Year-Old Bilingual Children

ERIC Educational Resources Information Center

Westerveld, Marleen F.

2014-01-01

There are few emergent literacy assessments available for bilingual children. This study investigated the usefulness of a screening battery of oral language and print-related measures as an assessment tool for bilingual Samoan-English speaking children. A total of 18 children were recruited from three Samoan language immersion kindergartens (Aoga…

Assessing wildfire risks at multiple spatial scales

Treesearch

Justin Fitch

2008-01-01

In continuation of the efforts to advance wildfire science and develop tools for wildland fire managers, a spatial wildfire risk assessment was carried out using Classification and Regression Tree analysis (CART) and Geographic Information Systems (GIS). The analysis was performed at two scales. The small-scale assessment covered the entire state of New Mexico, while...

Test-Enhanced Learning in an Immunology and Infectious Disease Medicinal Chemistry/Pharmacology Course.

PubMed

Hernick, Marcy

2015-09-25

Objective. To develop a series of active-learning modules that would improve pharmacy students' performance on summative assessments. Design. A series of optional online active-learning modules containing questions with multiple formats for topics in a first-year (P1) course was created using a test-enhanced learning approach. A subset of module questions was modified and included on summative assessments. Assessment. Student performance on module questions improved with repeated attempts and was predictive of student performance on summative assessments. Performance on examination questions was higher for students with access to modules than for those without access to modules. Module use appeared to have the most impact on low performing students. Conclusion. Test-enhanced learning modules with immediate feedback provide pharmacy students with a learning tool that improves student performance on summative assessments and also may improve metacognitive and test-taking skills.

Test-Enhanced Learning in an Immunology and Infectious Disease Medicinal Chemistry/Pharmacology Course

PubMed Central

2015-01-01

Objective. To develop a series of active-learning modules that would improve pharmacy students’ performance on summative assessments. Design. A series of optional online active-learning modules containing questions with multiple formats for topics in a first-year (P1) course was created using a test-enhanced learning approach. A subset of module questions was modified and included on summative assessments. Assessment. Student performance on module questions improved with repeated attempts and was predictive of student performance on summative assessments. Performance on examination questions was higher for students with access to modules than for those without access to modules. Module use appeared to have the most impact on low performing students. Conclusion. Test-enhanced learning modules with immediate feedback provide pharmacy students with a learning tool that improves student performance on summative assessments and also may improve metacognitive and test-taking skills. PMID:27168610

VASSAR: Value assessment of system architectures using rules

NASA Astrophysics Data System (ADS)

Selva, D.; Crawley, E. F.

A key step of the mission development process is the selection of a system architecture, i.e., the layout of the major high-level system design decisions. This step typically involves the identification of a set of candidate architectures and a cost-benefit analysis to compare them. Computational tools have been used in the past to bring rigor and consistency into this process. These tools can automatically generate architectures by enumerating different combinations of decisions and options. They can also evaluate these architectures by applying cost models and simplified performance models. Current performance models are purely quantitative tools that are best fit for the evaluation of the technical performance of mission design. However, assessing the relative merit of a system architecture is a much more holistic task than evaluating performance of a mission design. Indeed, the merit of a system architecture comes from satisfying a variety of stakeholder needs, some of which are easy to quantify, and some of which are harder to quantify (e.g., elegance, scientific value, political robustness, flexibility). Moreover, assessing the merit of a system architecture at these very early stages of design often requires dealing with a mix of: a) quantitative and semi-qualitative data; objective and subjective information. Current computational tools are poorly suited for these purposes. In this paper, we propose a general methodology that can used to assess the relative merit of several candidate system architectures under the presence of objective, subjective, quantitative, and qualitative stakeholder needs. The methodology called VASSAR (Value ASsessment for System Architectures using Rules). The major underlying assumption of the VASSAR methodology is that the merit of a system architecture can assessed by comparing the capabilities of the architecture with the stakeholder requirements. Hence for example, a candidate architecture that fully satisfies all critical sta- eholder requirements is a good architecture. The assessment process is thus fundamentally seen as a pattern matching process where capabilities match requirements, which motivates the use of rule-based expert systems (RBES). This paper describes the VASSAR methodology and shows how it can be applied to a large complex space system, namely an Earth observation satellite system. Companion papers show its applicability to the NASA space communications and navigation program and the joint NOAA-DoD NPOESS program.

External validation of Global Evaluative Assessment of Robotic Skills (GEARS).

PubMed

Aghazadeh, Monty A; Jayaratna, Isuru S; Hung, Andrew J; Pan, Michael M; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2015-11-01

We demonstrate the construct validity, reliability, and utility of Global Evaluative Assessment of Robotic Skills (GEARS), a clinical assessment tool designed to measure robotic technical skills, in an independent cohort using an in vivo animal training model. Using a cross-sectional observational study design, 47 voluntary participants were categorized as experts (>30 robotic cases completed as primary surgeon) or trainees. The trainee group was further divided into intermediates (≥5 but ≤30 cases) or novices (<5 cases). All participants completed a standardized in vivo robotic task in a porcine model. Task performance was evaluated by two expert robotic surgeons and self-assessed by the participants using the GEARS assessment tool. Kruskal-Wallis test was used to compare the GEARS performance scores to determine construct validity; Spearman's rank correlation measured interobserver reliability; and Cronbach's alpha was used to assess internal consistency. Performance evaluations were completed on nine experts and 38 trainees (14 intermediate, 24 novice). Experts demonstrated superior performance compared to intermediates and novices overall and in all individual domains (p < 0.0001). In comparing intermediates and novices, the overall performance difference trended toward significance (p = 0.0505), while the individual domains of efficiency and autonomy were significantly different between groups (p = 0.0280 and 0.0425, respectively). Interobserver reliability between expert ratings was confirmed with a strong correlation observed (r = 0.857, 95 % CI [0.691, 0.941]). Experts and participant scoring showed less agreement (r = 0.435, 95 % CI [0.121, 0.689] and r = 0.422, 95 % CI [0.081, 0.0672]). Internal consistency was excellent for experts and participants (α = 0.96, 0.98, 0.93). In an independent cohort, GEARS was able to differentiate between different robotic skill levels, demonstrating excellent construct validity. As a standardized assessment tool, GEARS maintained consistency and reliability for an in vivo robotic surgical task and may be applied for skills evaluation in a broad range of robotic procedures.

Development and testing of the cancer multidisciplinary team meeting observational tool (MDT-MOT)

PubMed Central

Harris, Jenny; Taylor, Cath; Sevdalis, Nick; Jalil, Rozh; Green, James S.A.

2016-01-01

Abstract Objective To develop a tool for independent observational assessment of cancer multidisciplinary team meetings (MDMs), and test criterion validity, inter-rater reliability/agreement and describe performance. Design Clinicians and experts in teamwork used a mixed-methods approach to develop and refine the tool. Study 1 observers rated pre-determined optimal/sub-optimal MDM film excerpts and Study 2 observers independently rated video-recordings of 10 MDMs. Setting Study 2 included 10 cancer MDMs in England. Participants Testing was undertaken by 13 health service staff and a clinical and non-clinical observer. Intervention None. Main Outcome Measures Tool development, validity, reliability/agreement and variability in MDT performance. Results Study 1: Observers were able to discriminate between optimal and sub-optimal MDM performance (P ≤ 0.05). Study 2: Inter-rater reliability was good for 3/10 domains. Percentage of absolute agreement was high (≥80%) for 4/10 domains and percentage agreement within 1 point was high for 9/10 domains. Four MDTs performed well (scored 3+ in at least 8/10 domains), 5 MDTs performed well in 6–7 domains and 1 MDT performed well in only 4 domains. Leadership and chairing of the meeting, the organization and administration of the meeting, and clinical decision-making processes all varied significantly between MDMs (P ≤ 0.01). Conclusions MDT-MOT demonstrated good criterion validity. Agreement between clinical and non-clinical observers (within one point on the scale) was high but this was inconsistent with reliability coefficients and warrants further investigation. If further validated MDT-MOT might provide a useful mechanism for the routine assessment of MDMs by the local workforce to drive improvements in MDT performance. PMID:27084499

Development and testing of the cancer multidisciplinary team meeting observational tool (MDT-MOT).

PubMed

Harris, Jenny; Taylor, Cath; Sevdalis, Nick; Jalil, Rozh; Green, James S A

2016-06-01

To develop a tool for independent observational assessment of cancer multidisciplinary team meetings (MDMs), and test criterion validity, inter-rater reliability/agreement and describe performance. Clinicians and experts in teamwork used a mixed-methods approach to develop and refine the tool. Study 1 observers rated pre-determined optimal/sub-optimal MDM film excerpts and Study 2 observers independently rated video-recordings of 10 MDMs. Study 2 included 10 cancer MDMs in England. Testing was undertaken by 13 health service staff and a clinical and non-clinical observer. None. Tool development, validity, reliability/agreement and variability in MDT performance. Study 1: Observers were able to discriminate between optimal and sub-optimal MDM performance (P ≤ 0.05). Study 2: Inter-rater reliability was good for 3/10 domains. Percentage of absolute agreement was high (≥80%) for 4/10 domains and percentage agreement within 1 point was high for 9/10 domains. Four MDTs performed well (scored 3+ in at least 8/10 domains), 5 MDTs performed well in 6-7 domains and 1 MDT performed well in only 4 domains. Leadership and chairing of the meeting, the organization and administration of the meeting, and clinical decision-making processes all varied significantly between MDMs (P ≤ 0.01). MDT-MOT demonstrated good criterion validity. Agreement between clinical and non-clinical observers (within one point on the scale) was high but this was inconsistent with reliability coefficients and warrants further investigation. If further validated MDT-MOT might provide a useful mechanism for the routine assessment of MDMs by the local workforce to drive improvements in MDT performance. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

PRELIMINARY EXPOSURE ASSESSMENT FINDINGS FROM THE TAMPA ASTHMATIC CHILDREN'S STUDY

EPA Science Inventory

The Tampa Asthmatic Children's Study (TACS) was a pilot study that focused on developing and evaluating air pollution exposure assessment methods and participant recruiting tools. The four-week study was performed in October and November, 2003. The study involved repeated daily...

EXPOSURE ASSESSMENT FINDINGS FROM THE TAMPA ASTHMATIC CHILDREN'S STUDY (TACS)

EPA Science Inventory

The Tampa Asthmatic Children's Study (TACS) was a pilot study that focused on developing and evaluating air pollution exposure assessment methods and participant recruiting tools. The four-week study was performed in October and November, 2003. The study involved repeated daily...

Predictive models to assess risk of type 2 diabetes, hypertension and comorbidity: machine-learning algorithms and validation using national health data from Kuwait--a cohort study.

PubMed

Farran, Bassam; Channanath, Arshad Mohamed; Behbehani, Kazem; Thanaraj, Thangavel Alphonse

2013-05-14

We build classification models and risk assessment tools for diabetes, hypertension and comorbidity using machine-learning algorithms on data from Kuwait. We model the increased proneness in diabetic patients to develop hypertension and vice versa. We ascertain the importance of ethnicity (and natives vs expatriate migrants) and of using regional data in risk assessment. Retrospective cohort study. Four machine-learning techniques were used: logistic regression, k-nearest neighbours (k-NN), multifactor dimensionality reduction and support vector machines. The study uses fivefold cross validation to obtain generalisation accuracies and errors. Kuwait Health Network (KHN) that integrates data from primary health centres and hospitals in Kuwait. 270 172 hospital visitors (of which, 89 858 are diabetic, 58 745 hypertensive and 30 522 comorbid) comprising Kuwaiti natives, Asian and Arab expatriates. Incident type 2 diabetes, hypertension and comorbidity. Classification accuracies of >85% (for diabetes) and >90% (for hypertension) are achieved using only simple non-laboratory-based parameters. Risk assessment tools based on k-NN classification models are able to assign 'high' risk to 75% of diabetic patients and to 94% of hypertensive patients. Only 5% of diabetic patients are seen assigned 'low' risk. Asian-specific models and assessments perform even better. Pathological conditions of diabetes in the general population or in hypertensive population and those of hypertension are modelled. Two-stage aggregate classification models and risk assessment tools, built combining both the component models on diabetes (or on hypertension), perform better than individual models. Data on diabetes, hypertension and comorbidity from the cosmopolitan State of Kuwait are available for the first time. This enabled us to apply four different case-control models to assess risks. These tools aid in the preliminary non-intrusive assessment of the population. Ethnicity is seen significant to the predictive models. Risk assessments need to be developed using regional data as we demonstrate the applicability of the American Diabetes Association online calculator on data from Kuwait.

Improving health, safety and energy efficiency in New Zealand through measuring and applying basic housing standards.

PubMed

Gillespie-Bennett, Julie; Keall, Michael; Howden-Chapman, Philippa; Baker, Michael G

2013-08-02

Substandard housing is a problem in New Zealand. Historically there has been little recognition of the important aspects of housing quality that affect people's health and safety. In this viewpoint article we outline the importance of assessing these factors as an essential step to improving the health and safety of New Zealanders and household energy efficiency. A practical risk assessment tool adapted to New Zealand conditions, the Healthy Housing Index (HHI), measures the physical characteristics of houses that affect the health and safety of the occupants. This instrument is also the only tool that has been validated against health and safety outcomes and reported in the international peer-reviewed literature. The HHI provides a framework on which a housing warrant of fitness (WOF) can be based. The HHI inspection takes about one hour to conduct and is performed by a trained building inspector. To maximise the effectiveness of this housing quality assessment we envisage the output having two parts. The first would be a pass/fail WOF assessment showing whether or not the house meets basic health, safety and energy efficiency standards. The second component would rate each main assessment area (health, safety and energy efficiency), potentially on a five-point scale. This WOF system would establish a good minimum standard for rental accommodation as well encouraging improved housing performance over time. In this article we argue that the HHI is an important, validated, housing assessment tool that will improve housing quality, leading to better health of the occupants, reduced home injuries, and greater energy efficiency. If required, this tool could be extended to also cover resilience to natural hazards, broader aspects of sustainability, and the suitability of the dwelling for occupants with particular needs.

Perspectives on procedure-based assessments: a thematic analysis of semistructured interviews with 10 UK surgical trainees.

PubMed

Shalhoub, Joseph; Marshall, Dominic C; Ippolito, Kate

2017-03-24

The introduction of competency-based training has necessitated development and implementation of accompanying mechanisms for assessment. Procedure-based assessments (PBAs) are an example of workplace-based assessments that are used to examine focal competencies in the workplace. The primary objective was to understand surgical trainees' perspective on the value of PBA. Semistructured interviews with 10 surgical trainees individually interviewed to explore their views. Interviews were audio-recorded and transcribed; following this, they were open and axial coded. Thematic analysis was then performed. Semistructured interviews yielded several topical and recurring themes. In trainees' experience, the use of PBAs as a summative tool limits their educational value. Trainees reported a lack of support from seniors and variation in the usefulness of the tool based on stage of training. Concerns related to the validity of PBAs for evaluating trainees' performance with reports of 'gaming' the system and trainees completing their own assessments. Trainees did identify the significant value of PBAs when used correctly. Benefits included the identification of additional learning opportunities, standardisation of assessment and their role in providing a measure of progress. The UK surgical trainees interviewed identified both limitations and benefits to PBAs; however, we would argue based on their responses and our experience that their use as a summative tool limits their formative use as an educational opportunity. PBAs should either be used exclusively to support learning or solely as a summative tool; if so, further work is needed to audit, validate and standardise them for this purpose. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Simulation-based ongoing professional practice evaluation in psychiatry: a novel tool for performance assessment.

PubMed

Gorrindo, Tristan; Goldfarb, Elizabeth; Birnbaum, Robert J; Chevalier, Lydia; Meller, Benjamin; Alpert, Jonathan; Herman, John; Weiss, Anthony

2013-07-01

Ongoing professional practice evaluation (OPPE) activities consist of a quantitative, competency-based evaluation of clinical performance. Hospitals must design assessments that measure clinical competencies, are scalable, and minimize impact on the clinician's daily routines. A psychiatry department at a large academic medical center designed and implemented an interactive Web-based psychiatric simulation focusing on violence risk assessment as a tool for a departmentwide OPPE. Of 412 invited clinicians in a large psychiatry department, 410 completed an online simulation in April-May 2012. Participants received scheduled e-mail reminders with instructions describing how to access the simulation. Using the Computer Simulation Assessment Tool, participants viewed an introductory video and were then asked to conduct a risk assessment, acting as a clinician in the encounter by selecting actions from a series of drop-down menus. Each action was paired with a corresponding video segment of a clinical encounter with a standardized patient. Participants were scored on the basis of their actions within the simulation (Measure 1) and by their responses to the open-ended questions in which they were asked to integrate the information from the simulation in a summative manner (Measure 2). Of the 410 clinicians, 381 (92.9%) passed Measure 1,359 (87.6%) passed Measure 2, and 5 (1.2%) failed both measures. Seventy-five (18.3%) participants were referred for focused professional practice evaluation (FPPE) after failing either Measure 1, Measure 2, or both. Overall, Web-based simulation and e-mail engagement tools were a scalable and efficient way to assess a large number of clinicians in OPPE and to identify those who required FPPE.

External Validation of a Decision Tool To Guide Post-Operative Management of Patients with Secondary Peritonitis.

PubMed

Atema, Jasper J; Ram, Kim; Schultz, Marcus J; Boermeester, Marja A

Timely identification of patients in need of an intervention for abdominal sepsis after initial surgical management of secondary peritonitis is vital but complex. The aim of this study was to validate a decision tool for this purpose and to evaluate its potential to guide post-operative management. A prospective cohort study was conducted on consecutive adult patients undergoing surgery for secondary peritonitis in a single hospital. Assessments using the decision tool, based on one intra-operative and five post-operative variables, were performed on the second and third post-operative days and when the patients' clinical status deteriorated. Scores were compared with the clinical reference standard of persistent sepsis based on the clinical course or findings at imaging or surgery. Additionally, the potential of the decision tool to guide management in terms of diagnostic imaging in three previously defined score categories (low, intermediate, and high) was evaluated. A total of 161 assessments were performed in 69 patients. The majority of cases of secondary peritonitis (68%) were caused by perforation of the gastrointestinal tract. Post-operative persistent sepsis occurred in 28 patients. The discriminative capacity of the decision tool score was fair (area under the curve of the receiver operating characteristic = 0.79). The incidence rate differed significantly between the three score categories (p < 0.001). The negative predictive value of a decision tool score categorized as low probability was 89% (95% confidence interval [CI] 82-94) and 65% (95% CI 47-79) for an intermediate score. Diagnostic imaging was performed more frequently when there was an intermediate score than when the score was categorized as low (46% vs. 24%; p < 0.001). In patients operated on for secondary peritonitis, the decision tool score predicts with fair accuracy whether persistent sepsis is present.

Eddy current NDE performance demonstrations using simulation tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maurice, L.; Costan, V.; Guillot, E.

2013-01-25

To carry out performance demonstrations of the Eddy-Current NDE processes applied on French nuclear power plants, EDF studies the possibility of using simulation tools as an alternative to measurements on steam generator tube mocks-up. This paper focuses on the strategy led by EDF to assess and use code{sub C}armel3D and Civa, on the case of Eddy-Current NDE on wears problem which may appear in the U-shape region of steam generator tubes due to the rubbing of anti-vibration bars.

Student Monitoring through Performance Matters and the Florida Comprehensive Assessment Exam: A Regression Analysis of Student Reading Achievement

ERIC Educational Resources Information Center

Cassidy-Floyd, Juliet

2017-01-01

Florida, from 1971 to 2014 has used the Florida Comprehensive Assessment Test (FCAT) as a yearly accountability tool throughout the education system in the state (Bureau of K-12 Assessment, 2005). Schools use their own assessments to determine if students are making progress throughout the year. In one school district within Florida, Performance…

Validating Appetite Assessment Tools among Patients Receiving Hemodialysis

PubMed Central

Molfino, Alessio; Kaysen, George A.; Chertow, Glenn M.; Doyle, Julie; Delgado, Cynthia; Dwyer, Tjien; Laviano, Alessandro; Fanelli, Filippo Rossi; Johansen, Kirsten L.

2016-01-01

Objective To test the performance of appetite assessment tools among patients receiving hemodialysis. Design Cross-sectional. Setting Seven dialysis facilities in Northern California. Subjects 221 patients receiving hemodialysis. Intervention We assessed five appetite assessment tools [self-assessment of appetite, subjective assessment of appetite, visual analogue scale (VAS), Functional Assessment of Anorexia/Cachexia Therapy (FAACT) score and the Anorexia Questionnaire (AQ)]. Main outcome measures Reported food intake, normalized protein catabolic rate (nPCR), and change in body weight were used as criterion measures, and we assessed associations among the appetite tools and biomarkers associated with nutrition and inflammation. Patients were asked to report their appetite and the percentage of food eaten (from 0% to 100%) during the last meal compared to usual intake. Results Fifty-eight (26%) patients reported food intake ≤50% (defined as poor appetite). The prevalence of anorexia was 12% by self-assessment of appetite, 6% by subjective assessment of appetite, 24% by VAS, 17% by FAACT score, and 12% by AQ. All tools were significantly associated with food intake ≤50% (p<0.001), except self-assessment of appetite. The FAACT score and the VAS had the strongest association with food intake ≤50% (c-statistic 0.80 and 0.76). Patients with food intake ≤50% reported weight loss more frequently than patients without low intake (36% vs 22%) and weight gain less frequently (19% vs 35%; p=0.03). nPCR was lower among anorexic patients based on the VAS (1.1 ± 0.3 vs 1.2 ± 0.3, p=0.03). Ln IL-6 correlated inversely with food intake (p=0.03), but neither IL-6 nor CRP correlated with any of the appetite tools. Furthermore, only the self-assessment of appetite was significantly associated with serum albumin (p=0.02), prealbumin (p=0.02) and adiponectin concentrations (p=0.03). Conclusions Alternative appetite assessment tools yielded widely different estimates of the prevalence of anorexia in hemodialysis. When considering self-reported food intake as the criterion standard for anorexia, the FAACT score and VAS discriminated patients reasonably well. PMID:26522141

Validating Appetite Assessment Tools Among Patients Receiving Hemodialysis.

PubMed

Molfino, Alessio; Kaysen, George A; Chertow, Glenn M; Doyle, Julie; Delgado, Cynthia; Dwyer, Tjien; Laviano, Alessandro; Rossi Fanelli, Filippo; Johansen, Kirsten L

2016-03-01

To test the performance of appetite assessment tools among patients receiving hemodialysis (HD). Cross-sectional. Two hundred twenty-one patients receiving HD enrolled in seven dialysis facilities in Northern California. We assessed 5 appetite assessment tools (self-assessment of appetite, subjective assessment of appetite, visual analog scale [VAS], Functional Assessment of Anorexia/Cachexia Therapy [FAACT] score, and the Anorexia Questionnaire [AQ]). Reported food intake, normalized protein catabolic rate, and change in body weight were used as criterion measures, and we assessed associations among the appetite tools and biomarkers associated with nutrition and inflammation. Patients were asked to report their appetite and the percentage of food eaten (from 0% to 100%) during the last meal compared to usual intake. Fifty-eight (26%) patients reported food intake ≤ 50% (defined as poor appetite). The prevalence of anorexia was 12% by self-assessment of appetite, 6% by subjective assessment of appetite, 24% by VAS, 17% by FAACT score, and 12% by AQ. All the tools were significantly associated with food intake ≤ 50% (P < .001), except self-assessment of appetite. The FAACT score and the VAS had the strongest association with food intake ≤ 50% (C-statistic 0.80 and 0.76). Patients with food intake ≤ 50% reported weight loss more frequently than patients without low intake (36% vs 22%) and weight gain less frequently (19% vs 35%; P = .03). Normalized protein catabolic rate was lower among anorexic patients based on the VAS (1.1 ± 0.3 vs 1.2 ± 0.3, P = .03). Ln interleukin-6 correlated inversely with food intake (P = .03), but neither interleukin-6 nor C-reactive protein correlated with any of the appetite tools. Furthermore, only the self-assessment of appetite was significantly associated with serum albumin (P = .02), prealbumin (P = .02) and adiponectin concentrations (P = .03). Alternative appetite assessment tools yielded widely different estimates of the prevalence of anorexia in HD. When considering self-reported food intake as the criterion standard for anorexia, the FAACT score and VAS discriminated patients reasonably well. Copyright © 2016 National Kidney Foundation, Inc. Published by Elsevier Inc. All rights reserved.

Friction Stir Welding of Magnesium Alloy Type AZ 31

NASA Astrophysics Data System (ADS)

Kupec, Tomáš; Behúlová, Mária; Turňa, Milan; Sahul, Miroslav

The paper deals with welding of Mg alloy of the type AZ 31 by Friction Stir Welding technology (FSW). The FSW technology is at present predominantly used for welding light metals and alloys, as aluminium, magnesium and their alloys. Experimental part consists of performing the simulation and fabrication of welded joints on a new-installed welding equipment available at the Welding Research Institute — Industrial Institute of SR Bratislava. Welding tools made of tool steel type H 13 were used for welding experiments. Geometry of welding tools was designed on the base of literature knowledge. Suitable welding parameters and conditions were determined using numerical simulation. Main emphasis was laid upon the tool revolutions, welding speed and tool bevel angle. The effect of welding parameters on the quality of welded joints was assessed. Assessment of welded joints was carried out by radiography, light microscopy, hardness measurement and EDX microanalysis. Static tensile test was employed for mechanical testing.

Assessment of motor functioning in the preschool period.

PubMed

Piek, Jan P; Hands, Beth; Licari, Melissa K

2012-12-01

The assessment of motor functioning in young children has become increasingly important in recent years with the acknowledgement that motor impairment is linked with cognitive, language, social and emotional difficulties. However, there is no one gold standard assessment tool to investigate motor ability in children. The aim of the current paper was to discuss the issues related to the assessment of motor ability in young pre-school children and to provide guidelines on the best approach for motor assessment. The paper discusses the maturational changes in brain development at the preschool level in relation to motor ability. Other issues include sex differences in motor ability at this young age, and evidence for this in relation to sociological versus biological influences. From the previous literature it is unclear what needs to be assessed in relation to motor functioning. Should the focus be underlying motor processes or movement skill assessment? Several key assessment tools are discussed that produce a general measure of motor performance followed by a description of tools that assess specific skills, such as fine and gross motor, ball and graphomotor skills. The paper concludes with recommendations on the best approach in assessing motor function in pre-school children.

Nutritional screening in hospitalized pediatric patients: a systematic review.

PubMed

Teixeira, Adriana Fonseca; Viana, Kátia Danielle Araújo Lourenço

2016-01-01

This systematic review aimed to verify the available scientific evidence on the clinical performance and diagnostic accuracy of nutritional screening tools in hospitalized pediatric patients. A search was performed in the Medline (National Library of Medicine United States), LILACS (Latin American and Caribbean Health Sciences), PubMed (US National Library of Medicine National Institutes of Health), in the SCIELO (Scientific Electronic Library Online), through CAPES portal (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior), bases Scopus e Web of Science. The descriptors used in accordance with the Descriptors in Health Sciences (DeCS)/Medical Subject Headings (MeSH) list were "malnutrition", "screening", and "pediatrics", as well as the equivalent words in Portuguese. The authors identified 270 articles published between 2004 and 2014. After applying the selection criteria, 35 were analyzed in full and eight articles were included in the systematic review. We evaluated the methodological quality of the studies using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS). Five nutritional screening tools in pediatrics were identified. Among these, the Screening Tool for the Assessment of Malnutrition in Pediatrics (STAMP) showed high sensitivity, almost perfect inter-rater agreement and between the screening and the reference standard; the Screening Tool Risk on Nutritional Status and Growth (STRONGkids) showed high sensitivity, lower percentage of specificity, substantial intra-rater agreement, and ease of use in clinical practice. The studies included in this systematic review showed good performance of the nutritional screening tools in pediatrics, especially STRONGkids and STAMP. The authors emphasize the need to perform for more studies in this area. Only one tool was translated and adapted to the Brazilian pediatric population, and it is essential to carry out studies of tool adaptation and validation for this population. Copyright © 2016 Sociedade Brasileira de Pediatria. Published by Elsevier Editora Ltda. All rights reserved.

Issues in the development of cross-cultural assessments of speech and language for children.

PubMed

Carter, Julie A; Lees, Janet A; Murira, Gladys M; Gona, Joseph; Neville, Brian G R; Newton, Charles R J C

2005-01-01

There is an increasing demand for the assessment of speech and language in clinical and research situations in countries where there are few assessment resources. Due to the nature of cultural variation and the potential for cultural bias, new assessment tools need to be developed or existing tools require adaptation. However, there are few guidelines on how to develop 'culturally appropriate' assessment tools. To review the literature on cross-cultural assessment in order to identify the major issues in the development and adaptation of speech and language assessments for children and to illustrate these issues with practical examples from our own research programme in Kenya. Five broad categories pertaining to cross-cultural assessment development were identified: the influence of culture on performance, familiarity with the testing situation, the effect of formal education, language issues and picture recognition. It was outlined how some of these issues were addressed in our research. The results of the review were integrated to produce a list of ten guidelines highlighting the importance of collaboration with mother tongue speakers; piloting; familiar assessment materials; assessment location; and practice items and prompts. There are few clinicians and assessors, whether in the UK or abroad, who do not assess or treat children from a culture different to their own. Awareness of cultural variation and bias and cooperative efforts to develop and administer culturally appropriate assessment tools are the foundation of effective, valid treatment programmes.

A dynamic quality assessment tool for laparoscopic hysterectomy to measure surgical outcomes.

PubMed

Driessen, Sara R C; Van Zwet, Erik W; Haazebroek, Pascal; Sandberg, Evelien M; Blikkendaal, Mathijs D; Twijnstra, Andries R H; Jansen, Frank Willem

2016-12-01

The current health care system has an urgent need for tools to measure quality. A wide range of quality indicators have been developed in an attempt to differentiate between high-quality and low-quality health care processes. However, one of the main issues of currently used indicators is the lack of case-mix correction and improvement possibilities. Case-mix is defined as specific (patient) characteristics that are known to potentially affect (surgical) outcome. If these characteristics are not taken into consideration, comparisons of outcome among health care providers may not be valid. The objective of the study was to develop and test a quality assessment tool for laparoscopic hysterectomy, which can serve as a new outcome quality indicator. This is a prospective, international, multicenter implementation study. A web-based application was developed with 3 main goals: (1) to measure the surgeon's performance using 3 primary outcomes (blood loss, operative time, and complications); (2) to provide immediate individual feedback using cumulative observed-minus-expected graphs; and (3) to detect consistently suboptimal performance after correcting for case-mix characteristics. All gynecologists who perform laparoscopic hysterectomies were requested to register their procedures in the application. A patient safety risk factor checklist was used by the surgeon for reflection. Thereafter a prospective implementation study was performed, and the application was tested using a survey that included the System Usability Scale. A total of 2066 laparoscopic hysterectomies were registered by 81 gynecologists. Mean operative time was 100 ± 39 minutes, blood loss 127 ± 163 mL, and the complication rate 6.1%. The overall survey response rate was 75%, and the mean System Usability Scale was 76.5 ± 13.6, which indicates that the application was good to excellent. The majority of surgeons reported that the application made them more aware of their performance, the outcomes, and patient safety, and they noted that the application provided motivation for improving future performance. We report the development and test of a real-time, dynamic, quality assessment tool for measuring individual surgical outcome for laparoscopic hysterectomy. Importantly, this tool provides opportunities for improving surgical performance. Our study provides a foundation for helping clinicians develop evidence-based quality indicators for other surgical procedures. Copyright © 2016 Elsevier Inc. All rights reserved.

Screening and detection of delirium in older ED patients: performance of the modified Confusion Assessment Method for the Emergency Department (mCAM-ED). A two-step tool.

PubMed

Hasemann, Wolfgang; Grossmann, Florian F; Stadler, Rahel; Bingisser, Roland; Breil, Dieter; Hafner, Martina; Kressig, Reto W; Nickel, Christian H

2017-12-30

Delirium is frequent in older Emergency Department (ED) patients, but detection rates for delirium in the ED are low. To aid in identifying delirium, we developed and implemented a two-step systematic delirium screening and assessment tool in our ED: the modified Confusion Assessment Method for the Emergency Department (mCAM-ED). Components of the mCAM-ED include: (1) screening for inattention, the main feature of delirium, which was performed with the Months Backwards Test (MBT); (2) delirium assessment based on a structured interview with questions from the Mental Status Questionnaire by Kahn et al. and the Comprehension Test by Hart et al. The aims of our study are (1) to investigate the performance criteria of the mCAM-ED tool in a consecutive sample of older ED patients, (2) to evaluate the performance of the mCAM-ED in patients with and without dementia and (3) to test whether this tool is efficient in keeping evaluation time to a minimum and reducing screening and assessment burden on the patient. For this prospective validation study, we recruited a consecutive sample of ED patients aged 65 and older during an 11-day period in November 2015. Trained nurses assessed patients with the mCAM-ED. Results were compared to the reference standard [i.e. the geriatricians' delirium diagnosis based on the criteria of the Text Revision of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR)]. Performance criteria were computed. We included 286 consecutive ED patients aged 65 and older. The median age was 80.02 (Q 1  = 72.15; Q 3  = 86.76), 58.7% of included patients were female, 14.3% had dementia. We found a delirium prevalence of 7.0%. In patients with dementia, specificity and positive likelihood ratio were lower. When compared to the reference standard, delirium assessment with the mCAM-ED has a 0.98 specificity and a 39.9 positive likelihood ratio. In 80.0% of all cases, the first step of the mCAM-ED, i.e. screening for inattention with the MBT, took less than 30 s. On average, the complete mCAM-ED assessment required 3.2 (SD 2.0), 5.6 (SD 3.2), and 6.2 (SD 2.3) minutes in cognitively unimpaired patients, patients with dementia and patients with dementia or delirium, respectively. The mCAM-ED is able to efficiently rule out delirium as well as confirm the diagnosis of delirium in elderly patients with and without dementia and applies minimal screening and assessment burden on the patient.

The development and discussion of computerized visual perception assessment tool for Chinese characters structures - Concurrent estimation of the overall ability and the domain ability in item response theory approach.

PubMed

Wu, Huey-Min; Lin, Chin-Kai; Yang, Yu-Mao; Kuo, Bor-Chen

2014-11-12

Visual perception is the fundamental skill required for a child to recognize words, and to read and write. There was no visual perception assessment tool developed for preschool children based on Chinese characters in Taiwan. The purposes were to develop the computerized visual perception assessment tool for Chinese Characters Structures and to explore the psychometrical characteristic of assessment tool. This study adopted purposive sampling. The study evaluated 551 kindergarten-age children (293 boys, 258 girls) ranging from 46 to 81 months of age. The test instrument used in this study consisted of three subtests and 58 items, including tests of basic strokes, single-component characters, and compound characters. Based on the results of model fit analysis, the higher-order item response theory was used to estimate the performance in visual perception, basic strokes, single-component characters, and compound characters simultaneously. Analyses of variance were used to detect significant difference in age groups and gender groups. The difficulty of identifying items in a visual perception test ranged from -2 to 1. The visual perception ability of 4- to 6-year-old children ranged from -1.66 to 2.19. Gender did not have significant effects on performance. However, there were significant differences among the different age groups. The performance of 6-year-olds was better than that of 5-year-olds, which was better than that of 4-year-olds. This study obtained detailed diagnostic scores by using a higher-order item response theory model to understand the visual perception of basic strokes, single-component characters, and compound characters. Further statistical analysis showed that, for basic strokes and compound characters, girls performed better than did boys; there also were differences within each age group. For single-component characters, there was no difference in performance between boys and girls. However, again the performance of 6-year-olds was better than that of 4-year-olds, but there were no statistical differences between the performance of 5-year-olds and 6-year-olds. Results of tests with basic strokes, single-component characters and compound characters tests had good reliability and validity. Therefore, it can be apply to diagnose the problem of visual perception at preschool. Copyright © 2014 Elsevier Ltd. All rights reserved.

Considerations in the use of reflective writing for student assessment: issues of reliability and validity.

PubMed

Moniz, Tracy; Arntfield, Shannon; Miller, Kristina; Lingard, Lorelei; Watling, Chris; Regehr, Glenn

2015-09-01

Reflective writing is a popular tool to support the growth of reflective capacity in undergraduate medical learners. Its popularity stems from research suggesting that reflective capacity may lead to improvements in skills such as empathy, communication, collaboration and professionalism. This has led to assumptions that reflective writing can also serve as a tool for student assessment. However, evidence to support the reliability and validity of reflective writing as a meaningful assessment strategy is lacking. Using a published instrument for measuring 'reflective capacity' (the Reflection Evaluation for Learners' Enhanced Competencies Tool [REFLECT]), four trained raters independently scored four samples of writing from each of 107 undergraduate medical students to determine the reliability of reflective writing scores. REFLECT scores were then correlated with scores on a Year 4 objective structured clinical examination (OSCE) and Year 2 multiple-choice question (MCQ) examinations to examine, respectively, convergent and divergent validity. Across four writing samples, four-rater Cronbach's α-values ranged from 0.72 to 0.82, demonstrating reasonable inter-rater reliability with four raters using the REFLECT rubric. However, inter-sample reliability was fairly low (four-sample Cronbach's α = 0.54, single-sample intraclass correlation coefficient: 0.23), which suggests that performance on one reflective writing sample was not strongly indicative of performance on the next. Approximately 14 writing samples are required to achieve reasonable inter-sample reliability. The study found weak, non-significant correlations between reflective writing scores and both OSCE global scores (r = 0.13) and MCQ examination scores (r = 0.10), demonstrating a lack of relationship between reflective writing and these measures of performance. Our findings suggest that to draw meaningful conclusions about reflective capacity as a stable construct in individuals requires 14 writing samples per student, each assessed by four or five raters. This calls into question the feasibility and utility of using reflective writing rigorously as an assessment tool in undergraduate medical education. © 2015 John Wiley & Sons Ltd.

Construct validity of the ovine model in endoscopic sinus surgery training.

PubMed

Awad, Zaid; Taghi, Ali; Sethukumar, Priya; Tolley, Neil S

2015-03-01

To demonstrate construct validity of the ovine model as a tool for training in endoscopic sinus surgery (ESS). Prospective, cross-sectional evaluation study. Over 18 consecutive months, trainees and experts were evaluated in their ability to perform a range of tasks (based on previous face validation and descriptive studies conducted by the same group) relating to ESS on the sheep-head model. Anonymized randomized video recordings of the above were assessed by two independent and blinded assessors. A validated assessment tool utilizing a five-point Likert scale was employed. Construct validity was calculated by comparing scores across training levels and experts using mean and interquartile range of global and task-specific scores. Subgroup analysis of the intermediate group ascertained previous experience. Nonparametric descriptive statistics were used, and analysis was carried out using SPSS version 21 (IBM, Armonk, NY). Reliability of the assessment tool was confirmed. The model discriminated well between different levels of expertise in global and task-specific scores. A positive correlation was noted between year in training and both global and task-specific scores (P < .001). Experience of the intermediate group was variable, and the number of ESS procedures performed under supervision had the highest impact on performance. This study describes an alternative model for ESS training and assessment. It is also the first to demonstrate construct validity of the sheep-head model for ESS training. © 2014 The American Laryngological, Rhinological and Otological Society, Inc.

Getting a handle on virtual tools: An examination of the neuronal activity associated with virtual tool use.

PubMed

Rallis, Austin; Fercho, Kelene A; Bosch, Taylor J; Baugh, Lee A

2018-01-31

Tool use is associated with three visual streams-dorso-dorsal, ventro-dorsal, and ventral visual streams. These streams are involved in processing online motor planning, action semantics, and tool semantics features, respectively. Little is known about the way in which the brain represents virtual tools. To directly assess this question, a virtual tool paradigm was created that provided the ability to manipulate tool components in isolation of one another. During functional magnetic resonance imaging (fMRI), adult participants performed a series of virtual tool manipulation tasks in which vision and movement kinematics of the tool were manipulated. Reaction time and hand movement direction were monitored while the tasks were performed. Functional imaging revealed that activity within all three visual streams was present, in a similar pattern to what would be expected with physical tool use. However, a previously unreported network of right-hemisphere activity was found including right inferior parietal lobule, middle and superior temporal gyri and supramarginal gyrus - regions well known to be associated with tool processing within the left hemisphere. These results provide evidence that both virtual and physical tools are processed within the same brain regions, though virtual tools recruit bilateral tool processing regions to a greater extent than physical tools. Copyright © 2017 Elsevier Ltd. All rights reserved.

Athletes' assessment of the coach--the coach evaluation questionnaire.

PubMed

Rushall, B S; Wiznuk, K

1985-09-01

The purpose of this study was to provide an assessment tool to judge coaching performance that was appropriate for completion by athletes. The questionnaire underwent a variety of developmental stages. In its final form, it contained 36 items. The tool was shown to be a valid, reliable, and standardized questionnaire. It demonstrated discriminability and provoked honest, accurate responding in subjects. The test was capable of providing immediate feedback to coaches seeking information about athletes' perceptions of their coaching performance. Responses on the developed scale were weighted to reflect the desirability of the coaching characteristics of a good coach. The questionnaire provides a total score which can be interpreted by the coach as a measure of how much of an "ideal" coach exists in him/her.

Implementation of a digital preparation validation tool in dental skills laboratory training.

PubMed

Kozarovska, A; Larsson, C

2018-05-01

To describe the implementation of a digital tool for preparation validation and evaluate it as an aid in students' self-assessment. Students at the final semester of skills laboratory training were asked to use a digital preparation validation tool (PVT) when performing two different tasks; preparation of crowns for teeth 11 and 21. The students were divided into two groups. Group A self-assessed and scanned all three attempts at 21 ("prep-and-scan"). Group B self-assessed all attempts chose the best one and scanned it ("best-of-three"). The situation was reversed for 11. The students assessed five parameters of the preparation and marked them as approved (A) or failed (F). These marks were compared with the information from the PVT. The students also completed a questionnaire. Each question was rated from 1 to 5. Teachers' opinions were collected at staff meetings throughout the project. Most students in the "prep-and-scan" groups showed an increase in agreement between their self-assessment and the information from the PVT, whereas students in the "best-of-three" groups showed lower levels of agreement. All students rated the PVT positively. Most strongly agreed that the tool was helpful in developing skills (mean 4.15), easy to use (mean 4.23) and that it added benefits in comparison to existing assessment tools (mean 4.05). They did not however, fully agree that the tool is time efficient (mean 2.55), and they did not consider it a substitute for verbal teacher feedback. Teachers' feedback suggested advantages of the tool in the form of ease of use, visual aid and increasing interest and motivation during skills laboratory training however, they did not notice a reduction in need of verbal feedback. Within the limitations of the study, our conclusion is that a digital PVT may be a valuable adjunct to other assessment tools in skills laboratory training. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

An Electronic Competency-Based Evaluation Tool for Assessing Humanitarian Competencies in a Simulated Exercise.

PubMed

Evans, Andrea B; Hulme, Jennifer M; Nugus, Peter; Cranmer, Hilarie H; Coutu, Melanie; Johnson, Kirsten

2017-06-01

The evaluation tool was first derived from the formerly Consortium of British Humanitarian Agencies' (CBHA; United Kingdom), now "Start Network's," Core Humanitarian Competency Framework and formatted in an electronic data capture tool that allowed for offline evaluation. During a 3-day humanitarian simulation event, participants in teams of eight to 10 were evaluated individually at multiple injects by trained evaluators. Participants were assessed on five competencies and a global rating scale. Participants evaluated both themselves and their team members using the same tool at the end of the simulation exercise (SimEx). All participants (63) were evaluated. A total of 1,008 individual evaluations were completed. There were 90 (9.0%) missing evaluations. All 63 participants also evaluated themselves and each of their teammates using the same tool. Self-evaluation scores were significantly lower than peer-evaluations, which were significantly lower than evaluators' assessments. Participants with a medical degree, and those with humanitarian work experience of one month or more, scored significantly higher on all competencies assessed by evaluators compared to other participants. Participants with prior humanitarian experience scored higher on competencies regarding operating safely and working effectively as a team member. This study presents a novel electronic evaluation tool to assess individual performance in five of six globally recognized humanitarian competency domains in a 3-day humanitarian SimEx. The evaluation tool provides a standardized approach to the assessment of humanitarian competencies that cannot be evaluated through knowledge-based testing in a classroom setting. When combined with testing knowledge-based competencies, this presents an approach to a comprehensive competency-based assessment that provides an objective measurement of competency with respect to the competencies listed in the Framework. There is an opportunity to advance the use of this tool in future humanitarian training exercises and potentially in real time, in the field. This could impact the efficiency and effectiveness of humanitarian operations. Evans AB , Hulme JM , Nugus P , Cranmer HH , Coutu M , Johnson K . An electronic competency-based evaluation tool for assessing humanitarian competencies in a simulated exercise. Prehosp Disaster Med. 2017;32(3):253-260.

Predicting periodontitis progression?

PubMed

Ferraiolo, Debra M

2016-03-01

Cochrane Library, Ovid, Medline, Embase and LILACS were searched using no language restrictions and included information up to July 2014. Bibliographic references of included articles and related review articles were hand searched. On-line hand searching of recent issues of key periodontal journals was performed (Journal of Clinical Periodontology, Journal of Dental Research, Journal of Periodontal Research, Journal of Periodontology, Oral Health and Preventive Dentistry). Prospective and retrospective cohort studies were used for answering the question of prediction since there were no randomised controlled trials on this topic. Risk of bias was assessed using the validated Newcastle-Ottawa quality assessment scale for non-randomised studies. Cross-sectional studies were included in the summary of currently reported risk assessment tools but not for risk of progression of disease, due to the inability to properly assess bias in these types of studies. Titles and abstracts were scanned by two reviewers independently.Full reports were obtained for those articles meeting inclusion criteria or those with insufficient information in the title to make a decision. Any published risk assessment tool was considered. The tool was defined to include any composite measure of patient-level risk directed towards determining the probability for further disease progression in adults with periodontitis. Periodontitis was defined to include both chronic and aggressive forms in the adult population. Outcomes included changes in attachment levels and/or deepening of periodontal pockets in millimeters in study populations undergoing supportive periodontal therapy. Data extraction was performed independently and in collaboration by two reviewers; completed evidence tables were reviewed by three reviewers. Studies were each given a descriptive summary to assess the quantity of data as well as further assessment of study variations within study characteristics. This also allowed for determining the suitability of data for further quantitative analysis (meta-analysis). Unfortunately, the heterogeneity of the data did not allow. After screening, 19 studies fitted the inclusion criteria of identifying five different patient-based periodontal risk assessment tools. DenPlan Excel/Previsor Patient Assessment (DEP-PA) and its modifications were used in five studies. The HIDEP model, the dentition risk system (DRS) and the risk assessment-based individualised treatment (RABIT) were each used in one study. Lastly, the periodontal risk assessment (PRA) and its modifications were found in 12 publications.PRA uses the following factors to assess risk of recurrence of disease: Percentage of bleeding on probing, loss of teeth from a total of 28 teeth, loss of periodontal support in relation to the patient's age, prevalence of residual pockets greater than 4 mm (3-5 mm), systemic and genetic conditions and environmental factors, such as cigarette smoking.Ten included studies had cohort designs (N= 2130) spanning three to 12 years with different follow-up times. Generally, these studies reflected that different assessment tools were able to separate subjects with differing probability of disease progression and tooth loss. The observed effect was dose dependent (the higher the estimation of risk the higher the level of observed disease or tooth loss).Six cross sectional studies (N=1078) reported the comparison of different assessment tools, adjusted or unadjusted associations with periodontal disease and subjective risk assessments provided by the tools. There were three articles noted in the flow diagram as articles proposing the tool. Qualitative analysis reflects that parameters are similar across the studies but differences are present in how these parameters were assessed. In treated populations, results of patient-based risk assessments predicted periodontitis progression and tooth loss in various populations. Additional research on the utility of risk assessment and results in improving patient management are needed.

Freeway performance measurement system : an operational analysis tool

DOT National Transportation Integrated Search

2001-07-30

PeMS is a freeway performance measurement system for all of California. It processes 2 : GB/day of 30-second loop detector data in real time to produce useful information. Managers : at any time can have a uniform, and comprehensive assessment of fre...

Consistency of the Performance and Nonperformance Methods in Gifted Identification

ERIC Educational Resources Information Center

Acar, Selcuk; Sen, Sedat; Cayirdag, Nur

2016-01-01

Current approaches to gifted identification suggest collecting multiple sources of evidence. Some gifted identification guidelines allow for the interchangeable use of "performance" and "nonperformance" identification methods. This multiple criteria approach lacks a strong overlap between the assessment tools; however,…

Indicators and Measurement Tools for Health Systems Integration: A Knowledge Synthesis.

PubMed

Suter, Esther; Oelke, Nelly D; da Silva Lima, Maria Alice Dias; Stiphout, Michelle; Janke, Robert; Witt, Regina Rigatto; Van Vliet-Brown, Cheryl; Schill, Kaela; Rostami, Mahnoush; Hepp, Shelanne; Birney, Arden; Al-Roubaiai, Fatima; Marques, Giselda Quintana

2017-11-13

Despite far reaching support for integrated care, conceptualizing and measuring integrated care remains challenging. This knowledge synthesis aimed to identify indicator domains and tools to measure progress towards integrated care. We used an established framework and a Delphi survey with integration experts to identify relevant measurement domains. For each domain, we searched and reviewed the literature for relevant tools. From 7,133 abstracts, we retrieved 114 unique tools. We found many quality tools to measure care coordination, patient engagement and team effectiveness/performance. In contrast, there were few tools in the domains of performance measurement and information systems, alignment of organizational goals and resource allocation. The search yielded 12 tools that measure overall integration or three or more indicator domains. Our findings highlight a continued gap in tools to measure foundational components that support integrated care. In the absence of such targeted tools, "overall integration" tools may be useful for a broad assessment of the overall state of a system. Continued progress towards integrated care depends on our ability to evaluate the success of strategies across different levels and context. This study has identified 114 tools that measure integrated care across 16 domains, supporting efforts towards a unified measurement framework.

Teaching core competencies of reconstructive microsurgery with the use of standardized patients.

PubMed

Son, Ji; Zeidler, Kamakshi R; Echo, Anthony; Otake, Leo; Ahdoot, Michael; Lee, Gordon K

2013-04-01

The Accreditation Council of Graduate Medical Education has defined 6 core competencies that residents must master before completing their training. Objective structured clinical examinations (OSCEs) using standardized patients are effective educational tools to assess and teach core competencies. We developed an OSCE specific for microsurgical head and neck reconstruction. Fifteen plastic surgery residents participated in the OSCE simulating a typical new patient consultation, which involved a patient with oral cancer. Residents were scored in all 6 core competencies by the standardized patients and faculty experts. Analysis of participant performance showed that although residents performed well overall, many lacked proficiency in systems-based practice. Junior residents were also more likely to omit critical elements of the physical examination compared to senior residents. We have modified our educational curriculum to specifically address these deficiencies. Our study demonstrates that the OSCE is an effective assessment tool for teaching and assessing all core competencies in microsurgery.

ESA's tools for internal charging

NASA Astrophysics Data System (ADS)

Sorensen, J.; Rodgers, D. J.; Ryden, K. A.; Latham, P. M.; Wrenn, G. L.; Levy, L.; Panabiere, G.

2000-06-01

Electrostatic discharges, caused by bulk charging of spacecraft insulating materials, are a major cause of satellite anomalies. A quantitative knowledge of the charge build-up is essential in order to eliminate these problems in the design stage. This is a presentation of ESA's tools to assess whether a given structure is liable to experience electrostatic discharges or not. A study has been made of the physical phenomenon, and an engineering specification has been created to be used to assess a structure for potential discharge problems. The specification has been implemented in a new software DICTAT. The implementation of tests in dedicated facilities is an important part of the specification, and tests have been performed to validate the new tool.

Cardiovascular risk assessment in type 2 diabetes mellitus: comparison of the World Health Organization/International Society of Hypertension risk prediction charts versus UK Prospective Diabetes Study risk engine.

PubMed

Herath, Herath M Meththananda; Weerarathna, Thilak Priyantha; Umesha, Dilini

2015-01-01

Patients with type 2 diabetes mellitus (T2DM) are at higher risk of developing cardiovascular diseases, and assessment of their cardiac risk is important for preventive strategies. The Ministry of Health of Sri Lanka has recommended World Health Organization/International Society of Hypertension (WHO/ISH) charts for cardiac risk assessment in individuals with T2DM. However, the most suitable cardiac risk assessment tool for Sri Lankans with T2DM has not been studied. This study was designed to evaluate the performance of two cardiac risk assessments tools; WHO/ISH charts and UK Prospective Diabetes Study (UKPDS) risk engine. Cardiac risk assessments were done in 2,432 patients with T2DM attending a diabetes clinic in Southern Sri Lanka using the two risk assessment tools. Validity of two assessment tools was further assessed by their ability to recognize individuals with raised low-density lipoprotein (LDL) and raised diastolic blood pressure in a cohort of newly diagnosed T2DM patients (n=332). WHO/ISH charts identified 78.4% of subjects as low cardiac risk whereas the UKPDS risk engine categorized 52.3% as low cardiac risk (P<0.001). In the risk categories of 10%-<20%, the UKPDS risk engine identified higher proportions of patients (28%) compared to WHO/ISH charts (7%). Approximately 6% of subjects were classified as low cardiac risk (<10%) by WHO/ISH when UKPDS recognized them as cardiac risk of >20%. Agreement between the two tools was poor (κ value =0.144, P<0.01). Approximately 82% of individuals categorized as low cardiac risk by WHO/ISH had higher LDL cholesterol than the therapeutic target of 100 mg/dL. There is a significant discrepancy between the two assessment tools with WHO/ISH risk chart recognizing higher proportions of patients having low cardiac risk than the UKPDS risk engine. Risk assessment by both assessment tools demonstrated poor sensitivity in identifying those with treatable levels of LDL cholesterol and diastolic blood pressure.

Reliable assessment of laparoscopic performance in the operating room using videotape analysis.

PubMed

Chang, Lily; Hogle, Nancy J; Moore, Brianna B; Graham, Mark J; Sinanan, Mika N; Bailey, Robert; Fowler, Dennis L

2007-06-01

The Global Operative Assessment of Laparoscopic Skills (GOALS) is a valid assessment tool for objectively evaluating the technical performance of laparoscopic skills in surgery residents. We hypothesized that GOALS would reliably differentiate between an experienced (expert) and an inexperienced (novice) laparoscopic surgeon (construct validity) based on a blinded videotape review of a laparoscopic cholecystectomy procedure. Ten board-certified surgeons actively engaged in the practice and teaching of laparoscopy reviewed and evaluated the videotaped operative performance of one novice and one expert laparoscopic surgeon using GOALS. Each reviewer recorded a score for both the expert and the novice videotape reviews in each of the 5 domains in GOALS (depth perception, bimanual dexterity, efficiency, tissue handling, and overall competence). The scores for the expert and the novice were compared and statistically analyzed using single-factor analysis of variance (ANOVA). The expert scored significantly higher than the novice did in the domains of depth perception (p = .005), bimanual dexterity (p = .001), efficiency (p = .001), and overall competence ( p = .001). Interrater reliability for the reviewers of the novice tape was Cronbach alpha = .93 and the expert tape was Cronbach alpha = .87. There was no difference between the two for tissue handling. The Global Operative Assessment of Laparoscopic Skills is a valid, objective assessment tool for evaluating technical surgical performance when used to blindly evaluate an intraoperative videotape recording of a laparoscopic procedure.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi.

PubMed

Ruark, Allison; Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women's and men's couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi

PubMed Central

Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women’s and men’s couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships. PMID:29190769

Cultural competency assessment tool for hospitals: evaluating hospitals' adherence to the culturally and linguistically appropriate services standards.

PubMed

Weech-Maldonado, Robert; Dreachslin, Janice L; Brown, Julie; Pradhan, Rohit; Rubin, Kelly L; Schiller, Cameron; Hays, Ron D

2012-01-01

The U.S. national standards for culturally and linguistically appropriate services (CLAS) in health care provide guidelines on policies and practices aimed at developing culturally competent systems of care. The Cultural Competency Assessment Tool for Hospitals (CCATH) was developed as an organizational tool to assess adherence to the CLAS standards. First, we describe the development of the CCATH and estimate the reliability and validity of the CCATH measures. Second, we discuss the managerial implications of the CCATH as an organizational tool to assess cultural competency. We pilot tested an initial draft of the CCATH, revised it based on a focus group and cognitive interviews, and then administered it in a field test with a sample of California hospitals. The reliability and validity of the CCATH were evaluated using factor analysis, analysis of variance, and Cronbach's alphas. Exploratory and confirmatory factor analyses identified 12 CCATH composites: leadership and strategic planning, data collection on inpatient population, data collection on service area, performance management systems and quality improvement, human resources practices, diversity training, community representation, availability of interpreter services, interpreter services policies, quality of interpreter services, translation of written materials, and clinical cultural competency practices. All the CCATH scales had internal consistency reliability of .65 or above, and the reliability was .70 or above for 9 of the 12 scales. Analysis of variance results showed that not-for-profit hospitals have higher CCATH scores than for-profit hospitals in five CCATH scales and higher CCATH scores than government hospitals in two CCATH scales. The CCATH showed adequate psychometric properties. Managers and policy makers can use the CCATH as a tool to evaluate hospital performance in cultural competency and identify and target improvements in hospital policies and practices that undergird the provision of CLAS.

Emergency medicine resident crisis resource management ability: a simulation-based longitudinal study

PubMed Central

Clarke, Samuel; Horeczko, Timothy; Carlisle, Matthew; Barton, Joseph D.; Ng, Vivienne; Al-Somali, Sameerah; Bair, Aaron E.

2014-01-01

Background Simulation has been identified as a means of assessing resident physicians’ mastery of technical skills, but there is a lack of evidence for its utility in longitudinal assessments of residents’ non-technical clinical abilities. We evaluated the growth of crisis resource management (CRM) skills in the simulation setting using a validated tool, the Ottawa Crisis Resource Management Global Rating Scale (Ottawa GRS). We hypothesized that the Ottawa GRS would reflect progressive growth of CRM ability throughout residency. Methods Forty-five emergency medicine residents were tracked with annual simulation assessments between 2006 and 2011. We used mixed-methods repeated-measures regression analyses to evaluate elements of the Ottawa GRS by level of training to predict performance growth throughout a 3-year residency. Results Ottawa GRS scores increased over time, and the domains of leadership, problem solving, and resource utilization, in particular, were predictive of overall performance. There was a significant gain in all Ottawa GRS components between postgraduate years 1 and 2, but no significant difference in GRS performance between years 2 and 3. Conclusions In summary, CRM skills are progressive abilities, and simulation is a useful modality for tracking their development. Modification of this tool may be needed to assess advanced learners’ gains in performance. PMID:25499769

Risk determination after an acute myocardial infarction: review of 3 clinical risk prediction tools.

PubMed

Scruth, Elizabeth Ann; Page, Karen; Cheng, Eugene; Campbell, Michelle; Worrall-Carter, Linda

2012-01-01

The objective of the study was to provide comprehensive information for the clinical nurse specialist (CNS) on commonly used clinical prediction (risk assessment) tools used to estimate risk of a secondary cardiac or noncardiac event and mortality in patients undergoing primary percutaneous coronary intervention (PCI) for ST-elevation myocardial infarction (STEMI). The evolution and widespread adoption of primary PCI represent major advances in the treatment of acute myocardial infarction, specifically STEMI. The American College of Cardiology and the American Heart Association have recommended early risk stratification for patients presenting with acute coronary syndromes using several clinical risk scores to identify patients' mortality and secondary event risk after PCI. Clinical nurse specialists are integral to any performance improvement strategy. Their knowledge and understandings of clinical prediction tools will be essential in carrying out important assessment, identifying and managing risk in patients who have sustained a STEMI, and enhancing discharge education including counseling on medications and lifestyle changes. Over the past 2 decades, risk scores have been developed from clinical trials to facilitate risk assessment. There are several risk scores that can be used to determine in-hospital and short-term survival. This article critiques the most common tools: the Thrombolytic in Myocardial Infarction risk score, the Global Registry of Acute Coronary Events risk score, and the Controlled Abciximab and Device Investigation to Lower Late Angioplasty Complications risk score. The importance of incorporating risk screening assessment tools (that are important for clinical prediction models) to guide therapeutic management of patients cannot be underestimated. The ability to forecast secondary risk after a STEMI will assist in determining which patients would require the most aggressive level of treatment and monitoring postintervention including outpatient monitoring. With an increased awareness of specialist assessment tools, the CNS can play an important role in risk prevention and ongoing cardiovascular health promotion in patients diagnosed with STEMI. Knowledge of clinical prediction tools to estimate risk for mortality and risk of secondary events after PCI for acute coronary syndromes including STEMI is essential for the CNS in assisting with improving short- and long-term outcomes and for performance improvement strategies. The risk score assessment utilizing a collaborative approach with the multidisciplinary healthcare team provides for the development of a treatment plan including any invasive intervention strategy for the patient. Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins

Rapid review of cognitive screening instruments in MCI: proposal for a process-based approach modification of overlapping tasks in select widely used instruments.

PubMed

Díaz-Orueta, Unai; Blanco-Campal, Alberto; Burke, Teresa

2018-05-01

ABSTRACTBackground:A detailed neuropsychological assessment plays an important role in the diagnostic process of Mild Cognitive Impairment (MCI). However, available brief cognitive screening tests for this clinical population are administered and interpreted based mainly, or exclusively, on total achievement scores. This score-based approach can lead to erroneous clinical interpretations unless we also pay attention to the test taking behavior or to the type of errors committed during test performance. The goal of the current study is to perform a rapid review of the literature regarding cognitive screening tools for dementia in primary and secondary care; this will include revisiting previously published systematic reviews on screening tools for dementia, extensive database search, and analysis of individual references cited in selected studies. A subset of representative screening tools for dementia was identified that covers as many cognitive functions as possible. How these screening tools overlap with each other (in terms of the cognitive domains being measured and the method used to assess them) was examined and a series of process-based approach (PBA) modifications for these overlapping features was proposed, so that the changes recommended in relation to one particular cognitive task could be extrapolated to other screening tools. It is expected that future versions of cognitive screening tests, modified using a PBA, will highlight the benefits of attending to qualitative features of test performance when trying to identify subtle features suggestive of MCI and/or dementia.

Initial development of a practical safety audit tool to assess fleet safety management practices.

PubMed

Mitchell, Rebecca; Friswell, Rena; Mooren, Lori

2012-07-01

Work-related vehicle crashes are a common cause of occupational injury. Yet, there are few studies that investigate management practices used for light vehicle fleets (i.e. vehicles less than 4.5 tonnes). One of the impediments to obtaining and sharing information on effective fleet safety management is the lack of an evidence-based, standardised measurement tool. This article describes the initial development of an audit tool to assess fleet safety management practices in light vehicle fleets. The audit tool was developed by triangulating information from a review of the literature on fleet safety management practices and from semi-structured interviews with 15 fleet managers and 21 fleet drivers. A preliminary useability assessment was conducted with 5 organisations. The audit tool assesses the management of fleet safety against five core categories: (1) management, systems and processes; (2) monitoring and assessment; (3) employee recruitment, training and education; (4) vehicle technology, selection and maintenance; and (5) vehicle journeys. Each of these core categories has between 1 and 3 sub-categories. Organisations are rated at one of 4 levels on each sub-category. The fleet safety management audit tool is designed to identify the extent to which fleet safety is managed in an organisation against best practice. It is intended that the audit tool be used to conduct audits within an organisation to provide an indicator of progress in managing fleet safety and to consistently benchmark performance against other organisations. Application of the tool by fleet safety researchers is now needed to inform its further development and refinement and to permit psychometric evaluation. Copyright © 2012 Elsevier Ltd. All rights reserved.

78 FR 4859 - Notice of Proposed Information for Public Comment for: Energy and Performance Information Center

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-23

... requirement described below will be submitted to the Office of Management and Budget (OMB) for review, as...; other planning collections and performance reports presently collected in hard copy; the Physical Needs... tracking of the Energy Performance Contract process and will include the Physical Needs Assessment tool...

Further Education Performance Indicators: A Motivational or a Performative Tool?

ERIC Educational Resources Information Center

Boocock, Andrew

2013-01-01

Ethnographic research in a further education College (Borough College) between 2000 and 2005 assessed the impact of performance indicators (PIs) within a department teaching GCSEs and A-levels. Research focused on PIs integral to the Learning and Skills Council funding formula, the Common Inspection Framework and newspaper league tables, and the…

Using cloud-based mobile technology for assessment of competencies among medical students.

PubMed

Ferenchick, Gary S; Solomon, David

2013-01-01

Valid, direct observation of medical student competency in clinical settings remains challenging and limits the opportunity to promote performance-based student advancement. The rationale for direct observation is to ascertain that students have acquired the core clinical competencies needed to care for patients. Too often student observation results in highly variable evaluations which are skewed by factors other than the student's actual performance. Among the barriers to effective direct observation and assessment include the lack of effective tools and strategies for assuring that transparent standards are used for judging clinical competency in authentic clinical settings. We developed a web-based content management system under the name, Just in Time Medicine (JIT), to address many of these issues. The goals of JIT were fourfold: First, to create a self-service interface allowing faculty with average computing skills to author customizable content and criterion-based assessment tools displayable on internet enabled devices, including mobile devices; second, to create an assessment and feedback tool capable of capturing learner progress related to hundreds of clinical skills; third, to enable easy access and utilization of these tools by faculty for learner assessment in authentic clinical settings as a means of just in time faculty development; fourth, to create a permanent record of the trainees' observed skills useful for both learner and program evaluation. From July 2010 through October 2012, we implemented a JIT enabled clinical evaluation exercise (CEX) among 367 third year internal medicine students. Observers (attending physicians and residents) performed CEX assessments using JIT to guide and document their observations, record their time observing and providing feedback to the students, and their overall satisfaction. Inter-rater reliability and validity were assessed with 17 observers who viewed six videotaped student-patient encounters and by measuring the correlation between student CEX scores and their scores on subsequent standardized-patient OSCE exams. A total of 3567 CEXs were completed by 516 observers. The average number of evaluations per student was 9.7 (±1.8 SD) and the average number of CEXs completed per observer was 6.9 (±15.8 SD). Observers spent less than 10 min on 43-50% of the CEXs and 68.6% on feedback sessions. A majority of observers (92%) reported satisfaction with the CEX. Inter-rater reliability was measured at 0.69 among all observers viewing the videotapes and these ratings adequately discriminated competent from non-competent performance. The measured CEX grades correlated with subsequent student performance on an end-of-year OSCE. We conclude that the use of JIT is feasible in capturing discrete clinical performance data with a high degree of user satisfaction. Our embedded checklists had adequate inter-rater reliability and concurrent and predictive validity.

Sport Concussion Knowledge and Clinical Practices: A Survey of Doctors of Chiropractic With Sports Certification.

PubMed

Moreau, William J; Nabhan, Dustin C; Walden, Taylor

2015-09-01

The purpose of this study is to describe the knowledge base and clinical practices regarding concussion by sports-certified doctors of chiropractic. A 21-item survey was distributed to the 312 attendees of the 2014 American Chiropractic Board of Sports Physicians Sports Sciences Symposium. Results were measured by frequency analysis and descriptive statistics for all surveys completed by sports-certified chiropractors. Seventy-six surveys were returned by sports-certified doctors of chiropractic. All (N = 76) 100% of respondents believe that the evaluation of concussion should be performed by a health care provider with training in concussion. The respondents actively assess and manage concussion in adults (96%), adolescents (95%), and children (75%). A majority (79%) of respondents believe that the Sideline Concussion Assessment Tool-3 represents a current standard of care for the sideline evaluation of the athlete who possibly has sustained a sport concussion. Most respondents agreed or strongly agreed that manual therapies may be appropriate in certain circumstances in adults (80%) and minors (80%). This cross section of certified sports chiropractors strongly believes that the evaluation of concussion should be performed by a health care provider with specific training in concussion. A high percentage of the sports-certified chiropractors who responded assess and manage sport concussion in their practice, and many of them endorse the use of the Sideline Concussion Assessment Tool-3 as a sideline assessment tool.

Anaerobic threshold employed on exercise training prescription and performance assessment for laboratory rodents: A short review.

PubMed

Abreu, Phablo; Mendes, Sávio Victor Diogenes; Leal-Cardoso, José Henrique; Ceccatto, Vânia Marilande

2016-04-15

Several studies have generated numerous terms in the field of exercise training prescription and performance assessment that often do not match the information previously demonstrated by many other works, generating much debate and resulting in an immense pool of scientific results. Several protocols in exercise training prescription and performance assessment have been proposed for these purposes by many reasons. In the field of exercise science, the protocol must be thoroughly investigated and provide real tools to be reproducible. Many laboratories have been adapting and developing evaluation protocols and testing on physical training of rodents in different experimental conditions. In this context, mice, rats and rabbits are preferentially chosen due to easy manipulation and good response to exercise, and comparable at results obtained with humans in compatible effort intensities. But, the exercise training programs and aerobic-anaerobic transition assessment proposed for animal models vary extensively, depending on the species, gender, age, type of stimulus, type of exercise, type of method and also on the specific objectives of the program. This short review demonstrates the need in offering tools performed by invasive measurement to assess the anaerobic threshold by blood lactate employed on evolution of aerobic-anaerobic parameters of rodents. The objective of this short review was to present and to discuss physical evaluation protocols applications to rodents. The table submitted may give a basis for anaerobic threshold employed on exercise training prescription and performance assessment for laboratory rodents in future research. Copyright © 2016 Elsevier Inc. All rights reserved.

In-silico wear prediction for knee replacements--methodology and corroboration.

PubMed

Strickland, M A; Taylor, M

2009-07-22

The capability to predict in-vivo wear of knee replacements is a valuable pre-clinical analysis tool for implant designers. Traditionally, time-consuming experimental tests provided the principal means of investigating wear. Today, computational models offer an alternative. However, the validity of these models has not been demonstrated across a range of designs and test conditions, and several different formulas are in contention for estimating wear rates, limiting confidence in the predictive power of these in-silico models. This study collates and retrospectively simulates a wide range of experimental wear tests using fast rigid-body computational models with extant wear prediction algorithms, to assess the performance of current in-silico wear prediction tools. The number of tests corroborated gives a broader, more general assessment of the performance of these wear-prediction tools, and provides better estimates of the wear 'constants' used in computational models. High-speed rigid-body modelling allows a range of alternative algorithms to be evaluated. Whilst most cross-shear (CS)-based models perform comparably, the 'A/A+B' wear model appears to offer the best predictive power amongst existing wear algorithms. However, the range and variability of experimental data leaves considerable uncertainty in the results. More experimental data with reduced variability and more detailed reporting of studies will be necessary to corroborate these models with greater confidence. With simulation times reduced to only a few minutes, these models are ideally suited to large-volume 'design of experiment' or probabilistic studies (which are essential if pre-clinical assessment tools are to begin addressing the degree of variation observed clinically and in explanted components).

Proposal of an environmental performance index to assess solid waste treatment technologies.

PubMed

Coelho, Hosmanny Mauro Goulart; Lange, Liséte Celina; Coelho, Lineker Max Goulart

2012-07-01

Although the concern with sustainable development and environment protection has considerably grown in the last years it is noted that the majority of decision making models and tools are still either excessively tied to economic aspects or geared to the production process. Moreover, existing models focus on the priority steps of solid waste management, beyond waste energy recovery and disposal. So, in order to help the lack of models and tools aiming at the waste treatment and final disposal, a new concept is proposed: the Cleaner Treatment, which is based on the Cleaner Production principles. This paper focuses on the development and validation of the Cleaner Treatment Index (CTI), to assess environmental performance of waste treatment technologies based on the Cleaner Treatment concept. The index is formed by aggregation (summation or product) of several indicators that consists in operational parameters. The weights of the indicator were established by Delphi Method and Brazilian Environmental Laws. In addition, sensitivity analyses were carried out comparing both aggregation methods. Finally, index validation was carried out by applying the CTI to 10 waste-to-energy plants data. From sensitivity analysis and validation results it is possible to infer that summation model is the most suitable aggregation method. For summation method, CTI results were superior to 0.5 (in a scale from 0 to 1) for most facilities evaluated. So, this study demonstrates that CTI is a simple and robust tool to assess and compare the environmental performance of different treatment plants being an excellent quantitative tool to support Cleaner Treatment implementation. Copyright © 2012 Elsevier Ltd. All rights reserved.

Distributed Sensing with Fault-Tolerant Resource Reallocation for Disaster Area Assessment

DTIC Science & Technology

2010-05-01

Abrasion Tool R/C .............................................................................................................. Radio Control RISC...spectrometer onboard the rovers in order to determine their composition. Prior to soil and rock analysis, the robots might utilize their Rock Abrasion ...one robot might be responsible for using its rock abrasion tool and perhaps a manipulator, while another performs the analysis with the Mössbauer

You Are Your Words: Modeling Students' Vocabulary Knowledge with Natural Language Processing Tools

ERIC Educational Resources Information Center

Allen, Laura K.; McNamara, Danielle S.

2015-01-01

The current study investigates the degree to which the lexical properties of students' essays can inform stealth assessments of their vocabulary knowledge. In particular, we used indices calculated with the natural language processing tool, TAALES, to predict students' performance on a measure of vocabulary knowledge. To this end, two corpora were…

Mississippi Curriculum Framework for Machine Tool Operation/Machine Shop (Program CIP: 48.0503--Machine Shop Assistant). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for machine tool operation/machine shop I and II. Presented first are a…

Iranian Expert Opinion about Necessary Criteria for Hospitals Management Performance Assessments

PubMed Central

Dadgar, Elham; Janati, Ali; Tabrizi, Jafar Sadegh; Asghari-Jafarabadi, Mohammad; Barati, Omid

2012-01-01

Background: Managers in the hospital should have enough managerial skill to be coordinated with the complex environment. Defining a competency framework assessment for hospital man-agement will help to establish core competencies for hospital managers. The aim of this study was to develop concrete and suitable performance assessment criteria using expert's view. Methods: In this qualitative study in total, 20 professionals participated in the interview and Fo¬cus Group Discussions (FGD). Two of informants were interviewed and 18 professionals par¬ticipants in three focus group discussions. Discussions and interviews were well planned, the FGD environments were suitable and after interviews completion the notes were checked with participant for completeness. Thematic analysis method was used for the analysis of qualitative data. Results: Findings from 3 FGDs and 2 semi structured interviews done with 20 professionals were categorized accordance to themes. The findings were classified in 7 major and 41 sub themes. The major themes include competency related to planning, organization and staff per-formance management, leadership, information management, and clinical governance and per-formance indicators. Conclusion: All participants had hospital administration experience; so their explanation impor¬tant in identifying the criteria and developing hospital managers’ performance assessment tool. In addition to professional perspectives and studies done in other countries, in order to design this kind of tools, it is necessary to adopt the obtained findings to the local hospital conditions. PMID:24688938

New tools for investigating student learning in upper-division electrostatics

NASA Astrophysics Data System (ADS)

Wilcox, Bethany R.

Student learning in upper-division physics courses is a growing area of research in the field of Physics Education. Developing effective new curricular materials and pedagogical techniques to improve student learning in upper-division courses requires knowledge of both what material students struggle with and what curricular approaches help to overcome these struggles. To facilitate the course transformation process for one specific content area --- upper-division electrostatics --- this thesis presents two new methodological tools: (1) an analytical framework designed to investigate students' struggles with the advanced physics content and mathematically sophisticated tools/techniques required at the junior and senior level, and (2) a new multiple-response conceptual assessment designed to measure student learning and assess the effectiveness of different curricular approaches. We first describe the development and theoretical grounding of a new analytical framework designed to characterize how students use mathematical tools and techniques during physics problem solving. We apply this framework to investigate student difficulties with three specific mathematical tools used in upper-division electrostatics: multivariable integration in the context of Coulomb's law, the Dirac delta function in the context of expressing volume charge densities, and separation of variables as a technique to solve Laplace's equation. We find a number of common themes in students' difficulties around these mathematical tools including: recognizing when a particular mathematical tool is appropriate for a given physics problem, mapping between the specific physical context and the formal mathematical structures, and reflecting spontaneously on the solution to a physics problem to gain physical insight or ensure consistency with expected results. We then describe the development of a novel, multiple-response version of an existing conceptual assessment in upper-division electrostatics courses. The goal of this new version is to provide an easily-graded electrostatics assessment that can potentially be implemented to investigate student learning on a large scale. We show that student performance on the new multiple-response version exhibits a significant degree of consistency with performance on the free-response version, and that it continues to provide significant insight into student reasoning and student difficulties. Moreover, we demonstrate that the new assessment is both valid and reliable using data from upper-division physics students at multiple institutions. Overall, the work described in this thesis represents a significant contribution to the methodological tools available to researchers and instructors interested in improving student learning at the upper-division level.

Hasse diagram as a green analytical metrics tool: ranking of methods for benzo[a]pyrene determination in sediments.

PubMed

Bigus, Paulina; Tsakovski, Stefan; Simeonov, Vasil; Namieśnik, Jacek; Tobiszewski, Marek

2016-05-01

This study presents an application of the Hasse diagram technique (HDT) as the assessment tool to select the most appropriate analytical procedures according to their greenness or the best analytical performance. The dataset consists of analytical procedures for benzo[a]pyrene determination in sediment samples, which were described by 11 variables concerning their greenness and analytical performance. Two analyses with the HDT were performed-the first one with metrological variables and the second one with "green" variables as input data. Both HDT analyses ranked different analytical procedures as the most valuable, suggesting that green analytical chemistry is not in accordance with metrology when benzo[a]pyrene in sediment samples is determined. The HDT can be used as a good decision support tool to choose the proper analytical procedure concerning green analytical chemistry principles and analytical performance merits.

Assessing Probabilistic Reasoning in Verbal-Numerical and Graphical-Pictorial Formats: An Evaluation of the Psychometric Properties of an Instrument

ERIC Educational Resources Information Center

Agus, Mirian; Penna, Maria Pietronilla; Peró-Cebollero, Maribel; Guàrdia-Olmos, Joan

2016-01-01

Research on the graphical facilitation of probabilistic reasoning has been characterised by the effort expended to identify valid assessment tools. The authors developed an assessment instrument to compare reasoning performances when problems were presented in verbal-numerical and graphical-pictorial formats. A sample of undergraduate psychology…

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

Goats Don't Wear Coats: An Examination of Semantic Interference in Rhyming Assessments of Reading Readiness for English Language Learners

ERIC Educational Resources Information Center

Moreira, Sylvia; Hamilton, Maryellen

2006-01-01

Rhyming tests have historically been used in the education system to assess reading readiness. English language learners (ELLs) have consistently scored poorly on these assessment tools. The current article examines a possible reason for this poor performance by ELLs. Specifically, the authors examined the relationship between semantic…

Assessment Tools for Identifying Functional Limitations Associated With Functional Ankle Instability

PubMed Central

Ross, Scott E; Guskiewicz, Kevin M; Gross, Michael T; Yu, Bing

2008-01-01

Context: Assessment tools should identify functional limitations associated with functional ankle instability (FAI) by discriminating unstable from stable ankles. Objective: To identify assessment tools that discriminated FAI from stable ankles and determine the most accurate assessment tool for discriminating between FAI and stable ankles. Design: Case-control study. Setting: Research laboratory. Patients or Other Participants: Fifteen individuals with FAI and 15 healthy individuals; participants with unilateral FAI reported “giving-way” sensations and ankle sprains, whereas healthy participants did not. Intervention(s): Participants answered 12 questions on the Ankle Joint Functional Assessment Tool (AJFAT). They also performed a single-leg jump landing, which required them to jump to half their maximum jump height, land on a single leg, and stabilize quickly on a force plate. Main Outcome Measure(s): Receiver operating characteristic curves determined cutoff scores for discriminating between ankle groups for AJFAT total score and resultant vector (RV) time to stabilization. Accuracy values for discriminating between groups were determined by calculating the area under the receiver operating characteristic curves. Results: The cutoff score for discriminating between FAI and stable ankles was ≥26 (sensitivity  =  1, specificity  =  1) and ≥1.58 seconds (sensitivity  =  0.67, specificity  =  0.73) for the AJFAT total score and RV time to stabilization, respectively. The area under the curve for the AJFAT was 1.0 (asymptotic significance <.05), whereas the RV time to stabilization had an area under the curve of 0.72 (asymptotic significance <.05). Conclusions: The AJFAT was an excellent assessment tool for discriminating between ankle groups, whereas RV time to stabilization was a fair assessment tool. Although both assessments discriminated between ankle groups, the AJFAT more accurately discriminated between groups than the RV time to stabilization did. Future researchers should confirm these findings using a prospective research design. PMID:18335012

'To use or not to use': a qualitative study to evaluate experiences of healthcare providers and patients with the assessment of burden of COPD (ABC) tool.

PubMed

Slok, Annerika H M; Twellaar, Mascha; Jutbo, Leslie; Kotz, Daniel; Chavannes, Niels H; Holverda, Sebastiaan; Salomé, Philippe L; Dekhuijzen, P N Richard; Rutten-van Mölken, Maureen P M H; Schuiten, Denise; In 't Veen, Johannes C C M; van Schayck, Onno C P

2016-11-17

In the management of chronic conditions, such as chronic obstructive pulmonary disease (COPD), there is a shift from doctor-driven care to patient-centred integrated care with active involvement of and self-management by the patient. A recently developed tool, the assessment of burden of COPD (ABC) tool, can be used in this transition to facilitate self-management support and shared decision-making. We performed a qualitative study, in which we collected and analysed the data using the methods of conventional content analyses. We performed in-depth interviews consisting of mainly open questions. Fifteen healthcare providers and 21 patients were interviewed who had worked with the ABC tool in daily care. In general, participants responded positively to the tool. Healthcare providers felt the visual representation provided was effective and comprehensible for patients and provided them with insight into their disease, a finding that patients confirmed. If patients were allowed to choose between a consultation with or without the ABC tool, the majority would prefer using the tool: it provides them with an overview and insight, which makes it easier to discuss all relevant topics related to COPD. The tool can provide structure in consultations, and is compatible with the concepts of 'motivational interviewing' and 'individualised care-planning'. Suggestions for improvement related to content and layout. So far, the tool has only been available as a stand-alone online program, that is not connected to the electronic medical record systems. It was therefore suggested that the tool be integrated into the systems to enhance its usability and its uptake by healthcare providers.

Nutritional Risk Screening 2002, Short Nutritional Assessment Questionnaire, Malnutrition Screening Tool, and Malnutrition Universal Screening Tool Are Good Predictors of Nutrition Risk in an Emergency Service.

PubMed

Rabito, Estela Iraci; Marcadenti, Aline; da Silva Fink, Jaqueline; Figueira, Luciane; Silva, Flávia Moraes

2017-08-01

There is an international consensus that nutrition screening be performed at the hospital; however, there is no "best tool" for screening of malnutrition risk in hospitalized patients. To evaluate (1) the accuracy of the MUST (Malnutrition Universal Screening Tool), MST (Malnutrition Screening Tool), and SNAQ (Short Nutritional Assessment Questionnaire) in comparison with the NRS-2002 (Nutritional Risk Screening 2002) to identify patients at risk of malnutrition and (2) the ability of these nutrition screening tools to predict morbidity and mortality. A specific questionnaire was administered to complete the 4 screening tools. Outcomes measures included length of hospital stay, transfer to the intensive care unit, presence of infection, and incidence of death. A total of 752 patients were included. The nutrition risk was 29.3%, 37.1%, 33.6%, and 31.3% according to the NRS-2002, MUST, MST, and SNAQ, respectively. All screening tools showed satisfactory performance to identify patients at nutrition risk (area under the receiver operating characteristic curve between 0.765-0.808). Patients at nutrition risk showed higher risk of very long length of hospital stay as compared with those not at nutrition risk, independent of the tool applied (relative risk, 1.35-1.78). Increased risk of mortality (2.34 times) was detected by the MUST. The MUST, MST, and SNAQ share similar accuracy to the NRS-2002 in identifying risk of malnutrition, and all instruments were positively associated with very long hospital stay. In clinical practice, the 4 tools could be applied, and the choice for one of them should be made per the particularities of the service.

Assessing resident's knowledge and communication skills using four different evaluation tools.

PubMed

Nuovo, Jim; Bertakis, Klea D; Azari, Rahman

2006-07-01

This study assesses the relationship between 4 Accreditation Council for Graduate Medical Education (ACGME) outcome project measures for interpersonal and communication skills and medical knowledge; specifically, monthly performance evaluations, objective structured clinical examinations (OSCEs), the American Board of Family Practice in-training examination (ABFP-ITE) and the Davis observation code (DOC) practice style profiles. Based on previous work, we have DOC scoring for 29 residents from the University of California, Davis Department of Family and Community Medicine. For all these residents we also had the results of monthly performance evaluations, 2 required OSCE exercises, and the results of 3 American Board of Family Medicine (ABFM) ITEs. Data for each of these measures were abstracted for each resident. The Pearson correlation coefficient was used to assess the presence or lack of correlation between each of these evaluation methods. There is little correlation between various evaluation methods used to assess medical knowledge, and there is also little correlation between various evaluation methods used to assess communication skills. The outcome project remains a 'work in progress', with the need for larger studies to assess the value of different assessment measures of resident competence. It is unlikely that DOC will become a useful evaluation tool.

Using key performance indicators as knowledge-management tools at a regional health-care authority level.

PubMed

Berler, Alexander; Pavlopoulos, Sotiris; Koutsouris, Dimitris

2005-06-01

The advantages of the introduction of information and communication technologies in the complex health-care sector are already well-known and well-stated in the past. It is, nevertheless, paradoxical that although the medical community has embraced with satisfaction most of the technological discoveries allowing the improvement in patient care, this has not happened when talking about health-care informatics. Taking the above issue of concern, our work proposes an information model for knowledge management (KM) based upon the use of key performance indicators (KPIs) in health-care systems. Based upon the use of the balanced scorecard (BSC) framework (Kaplan/Norton) and quality assurance techniques in health care (Donabedian), this paper is proposing a patient journey centered approach that drives information flow at all levels of the day-to-day process of delivering effective and managed care, toward information assessment and knowledge discovery. In order to persuade health-care decision-makers to assess the added value of KM tools, those should be used to propose new performance measurement and performance management techniques at all levels of a health-care system. The proposed KPIs are forming a complete set of metrics that enable the performance management of a regional health-care system. In addition, the performance framework established is technically applied by the use of state-of-the-art KM tools such as data warehouses and business intelligence information systems. In that sense, the proposed infrastructure is, technologically speaking, an important KM tool that enables knowledge sharing amongst various health-care stakeholders and between different health-care groups. The use of BSC is an enabling framework toward a KM strategy in health care.

Combining web-based tools for transparent evaluation of data for risk assessment: developmental effects of bisphenol A on the mammary gland as a case study.

PubMed

Molander, Linda; Hanberg, Annika; Rudén, Christina; Ågerstrand, Marlene; Beronius, Anna

2017-03-01

Different tools have been developed that facilitate systematic and transparent evaluation and handling of toxicity data in the risk assessment process. The present paper sets out to explore the combined use of two web-based tools for study evaluation and identification of reliable data relevant to health risk assessment. For this purpose, a case study was performed using in vivo toxicity studies investigating low-dose effects of bisphenol A on mammary gland development. The reliability of the mammary gland studies was evaluated using the Science in Risk Assessment and Policy (SciRAP) criteria for toxicity studies. The Health Assessment Workspace Collaborative (HAWC) was used for characterizing and visualizing the mammary gland data in terms of type of effects investigated and reported, and the distribution of these effects within the dose interval. It was then investigated whether there was any relationship between study reliability and the type of effects reported and/or their distribution in the dose interval. The combination of the SciRAP and HAWC tools allowed for transparent evaluation and visualization of the studies investigating developmental effects of BPA on the mammary gland. The use of these tools showed that there were no apparent differences in the type of effects and their distribution in the dose interval between the five studies assessed as most reliable and the whole data set. Combining the SciRAP and HAWC tools was found to be a useful approach for evaluating in vivo toxicity studies and identifying reliable and sensitive information relevant to regulatory risk assessment of chemicals. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Sigma metrics as a tool for evaluating the performance of internal quality control in a clinical chemistry laboratory

PubMed Central

Kumar, B. Vinodh; Mohan, Thuthi

2018-01-01

OBJECTIVE: Six Sigma is one of the most popular quality management system tools employed for process improvement. The Six Sigma methods are usually applied when the outcome of the process can be measured. This study was done to assess the performance of individual biochemical parameters on a Sigma Scale by calculating the sigma metrics for individual parameters and to follow the Westgard guidelines for appropriate Westgard rules and levels of internal quality control (IQC) that needs to be processed to improve target analyte performance based on the sigma metrics. MATERIALS AND METHODS: This is a retrospective study, and data required for the study were extracted between July 2015 and June 2016 from a Secondary Care Government Hospital, Chennai. The data obtained for the study are IQC - coefficient of variation percentage and External Quality Assurance Scheme (EQAS) - Bias% for 16 biochemical parameters. RESULTS: For the level 1 IQC, four analytes (alkaline phosphatase, magnesium, triglyceride, and high-density lipoprotein-cholesterol) showed an ideal performance of ≥6 sigma level, five analytes (urea, total bilirubin, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level and for level 2 IQCs, same four analytes of level 1 showed a performance of ≥6 sigma level, and four analytes (urea, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level. For all analytes <6 sigma level, the quality goal index (QGI) was <0.8 indicating the area requiring improvement to be imprecision except cholesterol whose QGI >1.2 indicated inaccuracy. CONCLUSION: This study shows that sigma metrics is a good quality tool to assess the analytical performance of a clinical chemistry laboratory. Thus, sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the efficiency of existing laboratory processes. PMID:29692587

E-learning teaches attendings "how to" objectively assess pediatric urology trainees' surgery skills for orchiopexy.

PubMed

Fernandez, Nicolas; Maizels, Max; Farhat, Walid; Smith, Edwin; Liu, Dennis; Chua, Michael; Bhanji, Yasin

2018-04-01

Established methods to train pediatric urology surgery by residency training programs require updating in response to administrative changes such as new, reduced trainee duty hours. Therefore, new objective methods must be developed to teach trainees. We approached this need by creating e-learning to teach attendings objective assessment of trainee skills using the Zwisch scale, an established assessment tool. The aim of this study was to identify whether or not e-learning is an appropriate platform for effective teaching of this assessment tool, by assessing inter-rater correlation of assessments made by the attendings after participation in the e-learning. Pediatric orchiopexy was used as the index case. An e-learning tool was created to teach attending surgeons objective assessment of trainees' surgical skills. First, e-learning content was created which showed the assessment method videotape of resident surgery done in the operating room. Next, attendings were enrolled to e-learn this method. Finally, the ability of enrollees to assess resident surgery skill performance was tested. Namely, test video was made showing a trainee performing inguinal orchiopexy. All enrollees viewed the same online videos. Assessments of surgical skills (Zwisch scale) were entered into an online survey. Data were analyzed by intercorrelation coefficient kappa analysis (strong correlation was ICC ≥ 0.7). A total of 11 attendings were enrolled. All accessed the online learning and then made assessments of surgical skills trainees showed on videotapes. The e-learning comprised three modules: 1. "Core concepts," in which users learned the assessment tool methods; 2. "Learn to assess," in which users learned how to assess by watching video clips, explaining the assessment method; and 3. "Test," in which users tested their skill at making assessments by watching video clips and then actively inputting their ratings of surgical and global skills as viewed in the video clips (Figure). A total of 89 surgical skill ratings were performed with 56 (65%) exact matches between raters and 89 (100%) matched within one rank. Interclass correlation coefficient (ANOVA) showed statistically significant correlation. (r = 0.725, 95% CI 0.571-0.837, F = 3.976, p ≤ 0.00001). Kappa analysis of inter-rater reliability showed strong consensus between attendings for average measures with ICC = 0.71, 95% CI 0.46-0.95 (p = 0.03). We launched e-learning to teach pediatric urology attendings "how to" assess trainee surgical skills objectively (Zwisch scale). After e-learning, there was strong inter-rater correlation in assessments made. We plan to extend such e-learning to pediatric urology surgical training programs. Copyright © 2017 Journal of Pediatric Urology Company. Published by Elsevier Ltd. All rights reserved.

To Rubric or Not to Rubric? The Effects of Self-Assessment on Self-Regulation, Performance and Self-Efficacy

ERIC Educational Resources Information Center

Panadero, Ernesto; Romero, Margarida

2014-01-01

The objective of this study was to compare the effects of situations in which self-assessment was conducted using rubrics and situations in which no specific self-assessment tool was used. Two hundred and eighteen third-year pre-service teachers were assigned to either non-rubric or rubric self-assessment for designing a conceptual map. They then…

The State of Sustainability Reporting in Universities

ERIC Educational Resources Information Center

Lozano, Rodrigo

2011-01-01

Purpose: The purpose of this paper is to review and assess the state of sustainability reporting in universities. Design/methodology/approach: Analysis of the performance level of 12 universities sustainability reports using the Graphical Assessment of Sustainability in Universities tool. Findings: The results show that sustainability reporting in…

Enhancing Student Motivation: Extensions from Job Enrichment Theory and Practice.

ERIC Educational Resources Information Center

Bloom, Arvid J.; Yorges, Stefani L.; Ruhl, Angela J.

2000-01-01

Explores classroom extensions of job enrichment theory by administering a modified Job Diagnostic Survey, a widely employed organizational research tool that assesses each core job characteristic, to 217 psychology students along with outcome scales assessing their course motivation, satisfaction, performance, absenteeism, interest, and desire to…

Assessment of a human computer interface prototyping environment

NASA Technical Reports Server (NTRS)

Moore, Loretta A.

1993-01-01

A Human Computer Interface (HCI) prototyping environment with embedded evaluation capability has been successfully assessed which will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. The HCI prototyping environment is designed to include four components: (1) a HCI format development tool, (2) a test and evaluation simulator development tool, (3) a dynamic, interactive interface between the HCI prototype and simulator, and (4) an embedded evaluation capability to evaluate the adequacy of an HCI based on a user's performance.

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

Trajectory Assessment and Modification Tools for Next Generation Air Traffic Management Operations

NASA Technical Reports Server (NTRS)

Brasil, Connie; Lee, Paul; Mainini, Matthew; Lee, Homola; Lee, Hwasoo; Prevot, Thomas; Smith, Nancy

2011-01-01

This paper reviews three Next Generation Air Transportation System (NextGen) based high fidelity air traffic control human-in-the-loop (HITL) simulations, with a focus on the expected requirement of enhanced automated trajectory assessment and modification tools to support future air traffic flow management (ATFM) planning positions. The simulations were conducted at the National Aeronautics and Space Administration (NASA) Ames Research Centers Airspace Operations Laboratory (AOL) in 2009 and 2010. The test airspace for all three simulations assumed the mid-term NextGenEn-Route high altitude environment utilizing high altitude sectors from the Kansas City and Memphis Air Route Traffic Control Centers. Trajectory assessment, modification and coordination decision support tools were developed at the AOL in order to perform future ATFM tasks. Overall tool usage results and user acceptability ratings were collected across three areas of NextGen operatoins to evaluate the tools. In addition to the usefulness and usability feedback, feasibility issues, benefits, and future requirements were also addressed. Overall, the tool sets were rated very useful and usable, and many elements of the tools received high scores and were used frequently and successfully. Tool utilization results in all three HITLs showed both user and system benefits including better airspace throughput, reduced controller workload, and highly effective communication protocols in both full Data Comm and mixed-equipage environments.

Benchmarking biology research organizations using a new, dedicated tool.

PubMed

van Harten, Willem H; van Bokhorst, Leonard; van Luenen, Henri G A M

2010-02-01

International competition forces fundamental research organizations to assess their relative performance. We present a benchmark tool for scientific research organizations where, contrary to existing models, the group leader is placed in a central position within the organization. We used it in a pilot benchmark study involving six research institutions. Our study shows that data collection and data comparison based on this new tool can be achieved. It proved possible to compare relative performance and organizational characteristics and to generate suggestions for improvement for most participants. However, strict definitions of the parameters used for the benchmark and a thorough insight into the organization of each of the benchmark partners is required to produce comparable data and draw firm conclusions.

Twenty Years of Growth and Innovation: A Reflection on PACKRAT's Impact on Physician Assistant Education.

PubMed

Cavanagh, Kim; Lessard, Donovan; Britt, Zach

2015-12-01

In its 20th year, the Physician Assistant Clinical Knowledge Rating and Assessment Tool (PACKRAT) is a student self-assessment that can assist physician assistant (PA) students and PA program faculty in identifying strengths and areas in need of improvement in the didactic and clinical phases of PA education. In this reflection, we provide an overview of the history of PACKRAT and outline some of its benefits for students and PA programs, as well as its generative role in assessment within PA studies. Taking a broader view of PACKRAT's impact on assessment for the PA profession, we outline the research on its benefits and its use to maximize student performance, as well as how it has promoted the development of additional assessment tools.

Assessing Procedural Competence: Validity Considerations.

PubMed

Pugh, Debra M; Wood, Timothy J; Boulet, John R

2015-10-01

Simulation-based medical education (SBME) offers opportunities for trainees to learn how to perform procedures and to be assessed in a safe environment. However, SBME research studies often lack robust evidence to support the validity of the interpretation of the results obtained from tools used to assess trainees' skills. The purpose of this paper is to describe how a validity framework can be applied when reporting and interpreting the results of a simulation-based assessment of skills related to performing procedures. The authors discuss various sources of validity evidence because they relate to SBME. A case study is presented.

Comparative assessment of three standardized robotic surgery training methods.

PubMed

Hung, Andrew J; Jayaratna, Isuru S; Teruya, Kara; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2013-10-01

To evaluate three standardized robotic surgery training methods, inanimate, virtual reality and in vivo, for their construct validity. To explore the concept of cross-method validity, where the relative performance of each method is compared. Robotic surgical skills were prospectively assessed in 49 participating surgeons who were classified as follows: 'novice/trainee': urology residents, previous experience <30 cases (n = 38) and 'experts': faculty surgeons, previous experience ≥30 cases (n = 11). Three standardized, validated training methods were used: (i) structured inanimate tasks; (ii) virtual reality exercises on the da Vinci Skills Simulator (Intuitive Surgical, Sunnyvale, CA, USA); and (iii) a standardized robotic surgical task in a live porcine model with performance graded by the Global Evaluative Assessment of Robotic Skills (GEARS) tool. A Kruskal-Wallis test was used to evaluate performance differences between novices and experts (construct validity). Spearman's correlation coefficient (ρ) was used to measure the association of performance across inanimate, simulation and in vivo methods (cross-method validity). Novice and expert surgeons had previously performed a median (range) of 0 (0-20) and 300 (30-2000) robotic cases, respectively (P < 0.001). Construct validity: experts consistently outperformed residents with all three methods (P < 0.001). Cross-method validity: overall performance of inanimate tasks significantly correlated with virtual reality robotic performance (ρ = -0.7, P < 0.001) and in vivo robotic performance based on GEARS (ρ = -0.8, P < 0.0001). Virtual reality performance and in vivo tissue performance were also found to be strongly correlated (ρ = 0.6, P < 0.001). We propose the novel concept of cross-method validity, which may provide a method of evaluating the relative value of various forms of skills education and assessment. We externally confirmed the construct validity of each featured training tool. © 2013 BJU International.

Meeting the challenge of assessing clinical competence of occupational therapists within a program management environment.

PubMed

Salvatori, Penny; Simonavicius, Nijole; Moore, Joan; Rimmer, Georgina; Patterson, Michele

2008-02-01

Program management models have raised concerns among occupational therapists about professional standards related to clinical competence, performance review procedures, and quality improvement initiatives. This paper describes how a chart-stimulated recall (CSR) peer-review process and interview tool was revised, implemented, and evaluated as a pilot project to assess the clinical competence of occupational therapy staff at a large urban health centre in southern Ontario. Fourteen pairs (n=28) of occupational therapists representing various practice areas participated in this project. Half served as peer assessors and half as interviewees. Peer assessors conducted an independent chart review followed by a one-hour personal interview with a peer partner to discuss clinical management issues related to the client cases. Each interviewer rated his or her partner's clinical competence in eight areas of performance using a 7-point Likert scale. Results indicated that the CSR tool could discriminate among occupational therapists in terms of overall levels of clinical competence and also identify specific areas of concern that could be targeted for professional development. Feedback from participants was positive. The CSR tool was found to be useful for assessing clinical competence of occupational therapists in this large health centre as a quality improvement initiative within that discipline group. Further research is needed to establish the reliability and validity of the CSR tool.

Objective laparoscopic skills assessments of surgical residents using Hidden Markov Models based on haptic information and tool/tissue interactions.

PubMed

Rosen, J; Solazzo, M; Hannaford, B; Sinanan, M

2001-01-01

Laparoscopic surgical skills evaluation of surgery residents is usually a subjective process, carried out in the operating room by senior surgeons. By its nature, this process is performed using fuzzy criteria. The objective of the current study was to develop and assess an objective laparoscopic surgical skill scale using Hidden Markov Models (HMM) based on haptic information, tool/tissue interactions and visual task decomposition. Eight subjects (six surgical trainees: first year surgical residents 2 x R1, third year surgical residents 2 x R3 fifth year surgical residents 2 x R5; and two expert laparoscopic surgeons: 2 x ES) performed laparoscopic cholecystectomy following a specific 7 steps protocol on a pig. An instrumented laparoscopic grasper equipped with a three-axis force/torque sensor located at the proximal end with an additional force sensor located on the handle, was used to measure the forces and torques. The hand/tool interface force/torque data was synchronized with a video of the tool operative maneuvers. A synthesis of frame-by-frame video analysis was used to define 14 different types of tool/tissue interactions, each one associated with unique force/torque (F/T) signatures. HMMs were developed for each subject representing the surgical skills by defining the various tool/tissue interactions as states and the associated F/T signatures as observations. The statistical distance between the HMMs representing residents at different levels of their training and the HMMs of expert surgeons were calculated in order to generate a learning curve of selected steps during laparoscopic cholecystectomy. Comparison of HMM's between groups showed significant differences between all skill levels, supporting the objective definition of a learning curve. The major differences between skill levels were: (i) magnitudes of F/T applied (ii) types of tool/tissue interactions used and the transition between them and (iii) time intervals spent in each tool/tissue interaction and the overall completion time. The objective HMM analysis showed that the greatest difference in performance was between R1 and R3 groups and then decreased as the level of expertise increased, suggesting that significant laparoscopic surgical capability develops between the first and the third years of their residency training. The power of the methodology using HMM for objective surgical skill assessment arises from the fact that it compiles enormous amount of data regarding different aspects of surgical skill into a very compact model that can be translated into a single number representing the distance from expert performance. Moreover, the methodology is not limited to in-vivo condition as demonstrated in the current study. It can be extended to other modalities such as measuring performance in surgical simulators and robotic systems.

Assessing progress and outcome of early intensive behavioral intervention for toddlers with autism.

PubMed

MacDonald, Rebecca; Parry-Cruwys, Diana; Dupere, Sally; Ahearn, William

2014-12-01

Intensive behavioral intervention for young children diagnosed with autism can produce large gains in social, cognitive, and language development. Although several studies have identified behaviors that are possible indicators of best outcome, changes in performance are typically measured using norm-referenced standardized scores referencing overall functioning level rather than via repeated observational measures of autism-specific deficits (i.e., social behavior). In the current study, 83 children with autism (CWA), aged 1, 2 and 3 years, and 58 same-aged typically developing children (TDC) were directly observed in the areas of cognitive skills, joint attention (JA), play, and stereotypic behavior using a measure called the Early Skills Assessment Tool (ESAT; MacDonald et al., 2006). CWA were assessed at entry into an EIBI program and again after 1 year of treatment. Changes in performance were compared pre- and post-treatment as well as to the normative data by age. Results indicate significant gains on the ESAT across all age groups with the greatest gains seen in the children who entered treatment prior to their second birthday. Increases were seen on direct measures of JA, play, imitation and language while decreases were seen in stereotypy regardless of level of performance at entry into EIBI. The ESAT, a direct measurement tool, served as a sensitive tool to measure changes in autism symptomatology following EIBI treatment. Copyright © 2014 Elsevier Ltd. All rights reserved.

Knowing the operative game plan: a novel tool for the assessment of surgical procedural knowledge.

PubMed

Balayla, Jacques; Bergman, Simon; Ghitulescu, Gabriela; Feldman, Liane S; Fraser, Shannon A

2012-08-01

What is the source of inadequate performance in the operating room? Is it a lack of technical skills, poor judgment or a lack of procedural knowledge? We created a surgical procedural knowledge (SPK) assessment tool and evaluated its use. We interviewed medical students, residents and training program staff on SPK assessment tools developed for 3 different common general surgery procedures: inguinal hernia repair with mesh in men, laparoscopic cholecystectomy and right hemicolectomy. The tools were developed as a step-wise assessment of specific surgical procedures based on techniques described in a current surgical text. We compared novice (medical student to postgraduate year [PGY]-2) and expert group (PGY-3 to program staff) scores using the Mann-Whitney U test. We calculated the total SPK score and defined a cut-off score using receiver operating characteristic analysis. In all, 5 participants in 7 different training groups (n = 35) underwent an interview. Median scores for each procedure and overall SPK scores increased with experience. The median SPK for novices was 54.9 (95% confidence interval [CI] 21.6-58.8) compared with 98.05 (95% CP 94.1-100.0) for experts (p = 0.012). The SPK cut-off score of 93.1 discriminates between novice and expert surgeons. Surgical procedural knowledge can reliably be assessed using our SPK assessment tool. It can discriminate between novice and expert surgeons for common general surgical procedures. Future studies are planned to evaluate its use for more complex procedures.

The feasibility of sharing simulation-based evaluation scenarios in anesthesiology.

PubMed

Berkenstadt, Haim; Kantor, Gareth S; Yusim, Yakov; Gafni, Naomi; Perel, Azriel; Ezri, Tiberiu; Ziv, Amitai

2005-10-01

We prospectively assessed the feasibility of international sharing of simulation-based evaluation tools despite differences in language, education, and anesthesia practice, in an Israeli study, using validated scenarios from a multi-institutional United States (US) study. Thirty-one Israeli junior anesthesia residents performed four simulation scenarios. Training sessions were videotaped and performance was assessed using two validated scoring systems (Long and Short Forms) by two independent raters. Subjects scored from 37 to 95 (70 +/- 12) of 108 possible points with the "Long Form" and "Short Form" scores ranging from 18 to 35 (28.2 +/- 4.5) of 40 possible points. Scores >70% of the maximal score were achieved by 61% of participants in comparison to only 5% in the original US study. The scenarios were rated as very realistic by 80% of the participants (grade 4 on a 1-4 scale). Reliability of the original assessment tools was demonstrated by internal consistencies of 0.66 for the Long and 0.75 for the Short Form (Cronbach alpha statistic). Values in the original study were 0.72-0.76 for the Long and 0.71-0.75 for the Short Form. The reliability did not change when a revised Israeli version of the scoring was used. Interrater reliability measured by Pearson correlation was 0.91 for the Long and 0.96 for the Short Form (P < 0.01). The high scores for plausibility given to the scenarios and the similar reliability of the original assessment tool support the feasibility of using simulation-based evaluation tools, developed in the US, in Israel. The higher scores achieved by Israeli residents may be related to the fact that most Israeli residents are immigrants with previous training in anesthesia. Simulation-based assessment tools developed in a multi-institutional study in the United States can be used in Israel despite the differences in language, education, and medical system.

External Validation of a Tool Predicting 7-Year Risk of Developing Cardiovascular Disease, Type 2 Diabetes or Chronic Kidney Disease.

PubMed

Rauh, Simone P; Rutters, Femke; van der Heijden, Amber A W A; Luimes, Thomas; Alssema, Marjan; Heymans, Martijn W; Magliano, Dianna J; Shaw, Jonathan E; Beulens, Joline W; Dekker, Jacqueline M

2018-02-01

Chronic cardiometabolic diseases, including cardiovascular disease (CVD), type 2 diabetes (T2D) and chronic kidney disease (CKD), share many modifiable risk factors and can be prevented using combined prevention programs. Valid risk prediction tools are needed to accurately identify individuals at risk. We aimed to validate a previously developed non-invasive risk prediction tool for predicting the combined 7-year-risk for chronic cardiometabolic diseases. The previously developed tool is stratified for sex and contains the predictors age, BMI, waist circumference, use of antihypertensives, smoking, family history of myocardial infarction/stroke, and family history of diabetes. This tool was externally validated, evaluating model performance using area under the receiver operating characteristic curve (AUC)-assessing discrimination-and Hosmer-Lemeshow goodness-of-fit (HL) statistics-assessing calibration. The intercept was recalibrated to improve calibration performance. The risk prediction tool was validated in 3544 participants from the Australian Diabetes, Obesity and Lifestyle Study (AusDiab). Discrimination was acceptable, with an AUC of 0.78 (95% CI 0.75-0.81) in men and 0.78 (95% CI 0.74-0.81) in women. Calibration was poor (HL statistic: p < 0.001), but improved considerably after intercept recalibration. Examination of individual outcomes showed that in men, AUC was highest for CKD (0.85 [95% CI 0.78-0.91]) and lowest for T2D (0.69 [95% CI 0.65-0.74]). In women, AUC was highest for CVD (0.88 [95% CI 0.83-0.94)]) and lowest for T2D (0.71 [95% CI 0.66-0.75]). Validation of our previously developed tool showed robust discriminative performance across populations. Model recalibration is recommended to account for different disease rates. Our risk prediction tool can be useful in large-scale prevention programs for identifying those in need of further risk profiling because of their increased risk for chronic cardiometabolic diseases.

Quality of health care and the need for assessment.

PubMed

Bosse, G; Ngoli, B; Leshabari, M T; Külker, R; Dämmrich, T; Abels, W; Breuer, J P; Kersten, R; Spies, C

2011-09-01

In many hospitals of developing countries quality of care is below the expected standard to maintain patient safety. In 2006, health care experts from Tanzania and Germany collaborated on a set of indicators to be used as a hospital performance assessment tool. The aim of this study was to introduce this tool and check its feasibility for use in a Tanzanian regional hospital. Within the hospital, independent observers assessed quantitatively structural quality and the performance of health care encounter using an itemized scale from 0 (0%) to 2 (100%) for each defined item. Outcome parameters were taken from the annual hospital report. In addition, semi-qualitative interviews with staff and patients were held to a) assess staff knowledge of the treatment guidelines published by the Tanzanian Ministry of Health and Social Welfare (MoHSW), b) assess attitudes and user motivation and c) authenticate the quantitative findings in a mixed-method triangulation approach. Structural quality in maternity was at 75% of the expected standard, while process quality ranged from 36% (Care of the newborn with APGAR score < 4) to 47% (normal delivery procedure). Staff knowledge ranged between 64% and 87% with low motivation and commitment given as contributing factors. Outcome (maternal mortality) was 481/100,000 live births with an infant mortality rate of 10%. The tool appeared to be feasible and effective in judging care quality. It provides a model for continuous quality improvement. Motivation of health care workers, a strong determinant of care process quality, might be improved by strengthening internal factors in health facilities. For conclusive validation, further studies using the tool must be conducted with larger numbers of institutions.

Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24 827 people: systematic review and meta-analysis.

PubMed

Fazel, Seena; Singh, Jay P; Doll, Helen; Grann, Martin

2012-07-24

To investigate the predictive validity of tools commonly used to assess the risk of violence, sexual, and criminal behaviour. Systematic review and tabular meta-analysis of replication studies following PRISMA guidelines. PsycINFO, Embase, Medline, and United States Criminal Justice Reference Service Abstracts. We included replication studies from 1 January 1995 to 1 January 2011 if they provided contingency data for the offending outcome that the tools were designed to predict. We calculated the diagnostic odds ratio, sensitivity, specificity, area under the curve, positive predictive value, negative predictive value, the number needed to detain to prevent one offence, as well as a novel performance indicator-the number safely discharged. We investigated potential sources of heterogeneity using metaregression and subgroup analyses. Risk assessments were conducted on 73 samples comprising 24,847 participants from 13 countries, of whom 5879 (23.7%) offended over an average of 49.6 months. When used to predict violent offending, risk assessment tools produced low to moderate positive predictive values (median 41%, interquartile range 27-60%) and higher negative predictive values (91%, 81-95%), and a corresponding median number needed to detain of 2 (2-4) and number safely discharged of 10 (4-18). Instruments designed to predict violent offending performed better than those aimed at predicting sexual or general crime. Although risk assessment tools are widely used in clinical and criminal justice settings, their predictive accuracy varies depending on how they are used. They seem to identify low risk individuals with high levels of accuracy, but their use as sole determinants of detention, sentencing, and release is not supported by the current evidence. Further research is needed to examine their contribution to treatment and management.

Pictorial representation of illness and self measure (PRISM): an effective tool to assess the burden of psoriasis.

PubMed

Fotiou, K; Hofmann, M; Kaufmann, R; Thaci, D

2015-12-01

Psoriasis has a negative impact on patient's' quality of life, which may reflect the physical and psychosocial impact of the disease. However, little is known about the perceived burden of disease. Pictorial Representation of Illness and Self Measure (PRISM), a pictorial tool, was developed to measure this global suffering. Capturing quality of life impairments in psoriasis is an integral part of assessing the overall disease severity and planning effective treatment strategies. To validate Pictorial Representation of Illness and Self Measure (PRISM) in psoriasis patients. An investigator initiated, prospective cohort study was performed in 108 outpatients with psoriasis to validate PRISM as an appropriate tool; Reliability was assessed in a cohort with controlled stable disease, repeated after 1 hour and after a 3-month follow-up phase; Convergent validity determined by correlation against measures of life quality (DLQI) and reported severity of psoriasis (PASI, PGA and BSA) was performed. For PRISM, we found a high reliability for short-term measurements (ICC = 0.98, P < 0.001) and for follow-up assessments at 3 months (ICC = 0.76, P < 0.001). Our investigation showed significant differences between patients with clear to minimal (PGA 0, 1), mild (PGA 2) and moderate-to-severe disease (PGA 3, 4) and significant (P < 0.001) correlation with DLQI, PGA, PASI and BSA (ρ = -0.62, -0.54, -0.44 and -0.39 respectively). PRISM is a highly reliable tool and new approach to assess perceived burden of patients with psoriasis. It is easy to use and we recommend the application as an additional outcome measure in clinical trial settings. © 2015 European Academy of Dermatology and Venereology.

Joint Analysis: QDR 2001 and Beyond Mini-Symposium Held in Fairfax, Virginia on 1-3 February 2000

DTIC Science & Technology

2001-04-11

have done better in: * Articulating a high level, understandable story that was credible to Congress. * Documenting, archiving assessments performed ...to (1) examine DoD assessment capabilities for performing QDR 2001, (2) provide a non-confrontational environment in which OSD, the Joint Staff...example. Foc trcues-Ec Key Issues Tools/databases Defined for Three Levels _________ (Low, Med., High ) Scenarios A . Emphasis on Modernization B. Emphasis

Data Envelopment Analysis (DEA) Model in Operation Management

NASA Astrophysics Data System (ADS)

Malik, Meilisa; Efendi, Syahril; Zarlis, Muhammad

2018-01-01

Quality management is an effective system in operation management to develops, maintains, and improves quality from groups of companies that allow marketing, production, and service at the most economycal level as well as ensuring customer satisfication. Many companies are practicing quality management to improve their bussiness performance. One of performance measurement is through measurement of efficiency. One of the tools can be used to assess efficiency of companies performance is Data Envelopment Analysis (DEA). The aim of this paper is using Data Envelopment Analysis (DEA) model to assess efficiency of quality management. In this paper will be explained CCR, BCC, and SBM models to assess efficiency of quality management.

Technology-Supported Performance Assessments for Middle School Geoscience

NASA Astrophysics Data System (ADS)

Zalles, D. R.; Quellmalz, E.; Rosenquist, A.; Kreikemeier, P.

2002-12-01

Under funding from the World Bank, the U.S. Department of Education, the National Science Foundation, and the Federal Government's Global Learning and Observations to Benefit the Environment Program (GLOBE), SRI International has developed and piloted web-accessible performance assessments that measure K-12 students' abilities to use learning technologies to reason with scientific information and communicate evidence-based conclusions to scientific problems. This presentation will describe the assessments that pertain to geoscience at the middle school level. They are the GLOBE Assessments and EPA Phoenix, an instantiation of SRI's model of assessment design known as Integrative Performance Assessments in Technology (IPAT). All are publicly-available on the web. GLOBE engages students in scientific data collection and observation about the environment. SRI's classroom assessments for GLOBE provide sample student assessment tools and frameworks that allow teachers and students to assess how well students can use the data in scientific inquiry projects. Teachers can use classroom assessment tools on the site to develop integrated investigations for assessing GLOBE within their particular science curricula. Rubrics are provided for measuring students' GLOBE-related skills, and alignments are made to state, national, and international science standards. Sample investigations are provided about atmosphere, hydrology, landcover, soils, earth systems, and visualizations. The IPAT assessments present students with engaging problems rooted in science or social science content, plus sets of tasks and questions that require them to gather relevant information on the web, use reasoning strategies to analyze and interpret the information, use spreadsheets, word processors, and other productivity tools, and communicate evidence-based findings and recommendations. In the process of gathering information and drawing conclusions, students are assessed on how well they can operate the technology as well as reason with the information made available through its use. In EPA Phoenix, students are asked to examine different representations of air quality data on the EPA website, as well as national weather data, in order to judge whether Phoenix would be a good site for holding certain athletic events. The students are assessed on how well they can interpret the data, synthesize it, and develop and communicate their conclusions. With the exception of formulating Web searches, results from piloting indicated that students were better at operating technology and interpreting single data sources than they were with synthesizing data from multiple sources and communicating cohesive evidence-based conclusions. Under the aegis of NSF and the International Association for the Evaluation of Educational Achievement, SRI is developing more IPAT assessments in science for a comparative international research study about student achievement in information and communication technology. These assessments will add other technologies into the mix such as dynamic modeling tools and geographic information systems.

The kidney disease quality of life cognitive function subscale and cognitive performance maintenance hemodialysis patients

USDA-ARS?s Scientific Manuscript database

Background: Cognitive impairment is common but often undiagnosed in patients with end-stage renal disease, in part reflecting limited validated and easily administered tools to assess cognitive function in dialysis patients. Accordingly, we assessed the utility of the Kidney Disease Quality of Life ...

An Ecological Approach to the On-Line Assessment of Problem-Solving Paths: Principles and Applications.

ERIC Educational Resources Information Center

Shaw, Robert E.; And Others

1997-01-01

Proposes a theoretical framework for designing online-situated assessment tools for multimedia instructional systems. Uses a graphic method based on ecological psychology to monitor student performance through a learning activity. Explores the method's feasibility in case studies describing instructional systems teaching critical-thinking and…

Enriching and Assessing Young Children's Multimodal Storytelling

ERIC Educational Resources Information Center

Wessel-Powell, Christy; Kargin, Tolga; Wohlwend, Karen E.

2016-01-01

This article provides primary teachers with assessment tools and curricular examples to expand writers' workshop by adding a multimodal storytelling unit on drama and filmmaking, allowing students to create engaging off-the-page stories through films and play performances that enrich writing. Too often, children's literacy abilities are assessed…

Handwriting Skills in Children with Spina Bifida: Assessment, Monitoring and Measurement.

ERIC Educational Resources Information Center

Hancock, Julie; Alston, Jean

1986-01-01

Case studies of three students with spina bifida (ages 8-11) illustrate an individualized six-week handwriting intervention program which stressed assessment, monitoring, and measurement of changes in writing performance. Appropriate changes in physical support (sitting position, writing surface, and choice of writing tool) are recommended. (JW)

Multi-Method Assessment of ADHD Characteristics in Preschool Children: Relations between Measures

ERIC Educational Resources Information Center

Sims, Darcey M.; Lonigan, Christopher J.

2012-01-01

Several forms of assessment tools, including behavioral rating scales and objective tests such as the Continuous Performance Test (CPT), can be used to measure inattentive and hyperactive/impulsive behaviors associated with Attention-Deficit/Hyperactivity Disorder (ADHD). However, research with school-age children has shown that the correlations…

Development of safety performance functions and other decision support tools to assess pedestrian and bicycle safety : final report.

DOT National Transportation Integrated Search

2016-09-30

field study was performed at 40 uncontrolled midblock crosswalks and 26 signalized intersections on low-speed roadways selected from the areas surrounding three major urban college campuses across lower Michigan. An array of existing traffic control ...

Accounting for trip frequency in importance-performance analysis

Treesearch

Joshua K. Gill; J.M. Bowker; John C. Bergstrom; Stanley J. Zarnoch

2010-01-01

Understanding customer satisfaction is critical to the successful operation of both privately and publicly managed recreation venues. A popular tool for assessing recreation visitor satisfaction is Importance- Performance Analysis (IPA). IPA provides resource managers, government officials, and private businesses with easy-to-understand and -use information about...

SurvExpress: an online biomarker validation tool and database for cancer gene expression data using survival analysis.

PubMed

Aguirre-Gamboa, Raul; Gomez-Rueda, Hugo; Martínez-Ledesma, Emmanuel; Martínez-Torteya, Antonio; Chacolla-Huaringa, Rafael; Rodriguez-Barrientos, Alberto; Tamez-Peña, José G; Treviño, Victor

2013-01-01

Validation of multi-gene biomarkers for clinical outcomes is one of the most important issues for cancer prognosis. An important source of information for virtual validation is the high number of available cancer datasets. Nevertheless, assessing the prognostic performance of a gene expression signature along datasets is a difficult task for Biologists and Physicians and also time-consuming for Statisticians and Bioinformaticians. Therefore, to facilitate performance comparisons and validations of survival biomarkers for cancer outcomes, we developed SurvExpress, a cancer-wide gene expression database with clinical outcomes and a web-based tool that provides survival analysis and risk assessment of cancer datasets. The main input of SurvExpress is only the biomarker gene list. We generated a cancer database collecting more than 20,000 samples and 130 datasets with censored clinical information covering tumors over 20 tissues. We implemented a web interface to perform biomarker validation and comparisons in this database, where a multivariate survival analysis can be accomplished in about one minute. We show the utility and simplicity of SurvExpress in two biomarker applications for breast and lung cancer. Compared to other tools, SurvExpress is the largest, most versatile, and quickest free tool available. SurvExpress web can be accessed in http://bioinformatica.mty.itesm.mx/SurvExpress (a tutorial is included). The website was implemented in JSP, JavaScript, MySQL, and R.

SurvExpress: An Online Biomarker Validation Tool and Database for Cancer Gene Expression Data Using Survival Analysis

PubMed Central

Aguirre-Gamboa, Raul; Gomez-Rueda, Hugo; Martínez-Ledesma, Emmanuel; Martínez-Torteya, Antonio; Chacolla-Huaringa, Rafael; Rodriguez-Barrientos, Alberto; Tamez-Peña, José G.; Treviño, Victor

2013-01-01

Validation of multi-gene biomarkers for clinical outcomes is one of the most important issues for cancer prognosis. An important source of information for virtual validation is the high number of available cancer datasets. Nevertheless, assessing the prognostic performance of a gene expression signature along datasets is a difficult task for Biologists and Physicians and also time-consuming for Statisticians and Bioinformaticians. Therefore, to facilitate performance comparisons and validations of survival biomarkers for cancer outcomes, we developed SurvExpress, a cancer-wide gene expression database with clinical outcomes and a web-based tool that provides survival analysis and risk assessment of cancer datasets. The main input of SurvExpress is only the biomarker gene list. We generated a cancer database collecting more than 20,000 samples and 130 datasets with censored clinical information covering tumors over 20 tissues. We implemented a web interface to perform biomarker validation and comparisons in this database, where a multivariate survival analysis can be accomplished in about one minute. We show the utility and simplicity of SurvExpress in two biomarker applications for breast and lung cancer. Compared to other tools, SurvExpress is the largest, most versatile, and quickest free tool available. SurvExpress web can be accessed in http://bioinformatica.mty.itesm.mx/SurvExpress (a tutorial is included). The website was implemented in JSP, JavaScript, MySQL, and R. PMID:24066126

Diverter AI based decision aid, phases 1 and 2

NASA Technical Reports Server (NTRS)

Sexton, George A.; Bayles, Scott J.; Patterson, Robert W.; Schulke, Duane A.; Williams, Deborah C.

1989-01-01

It was determined that a system to incorporate artificial intelligence (AI) into airborne flight management computers is feasible. The AI functions that would be most useful to the pilot are to perform situational assessment, evaluate outside influences on the contemplated rerouting, perform flight planning/replanning, and perform maneuver planning. A study of the software architecture and software tools capable of demonstrating Diverter was also made. A skeletal planner known as the Knowledge Acquisition Development Tool (KADET), which is a combination script-based and rule-based system, was used to implement the system. A prototype system was developed which demonstrates advanced in-flight planning/replanning capabilities.

Toward a Real-Time Measurement-Based System for Estimation of Helicopter Engine Degradation Due to Compressor Erosion

NASA Technical Reports Server (NTRS)

Litt, Jonathan S.; Simo, Donald L.

2007-01-01

This paper presents a preliminary demonstration of an automated health assessment tool, capable of real-time on-board operation using existing engine control hardware. The tool allows operators to discern how rapidly individual turboshaft engines are degrading. As the compressor erodes, performance is lost, and with it the ability to generate power. Thus, such a tool would provide an instant assessment of the engine s fitness to perform a mission, and would help to pinpoint any abnormal wear or performance anomalies before they became serious, thereby decreasing uncertainty and enabling improved maintenance scheduling. The research described in the paper utilized test stand data from a T700-GE-401 turboshaft engine that underwent sand-ingestion testing to scale a model-based compressor efficiency degradation estimation algorithm. This algorithm was then applied to real-time Health Usage and Monitoring System (HUMS) data from a T700-GE-701C to track compressor efficiency on-line. The approach uses an optimal estimator called a Kalman filter. The filter is designed to estimate the compressor efficiency using only data from the engine s sensors as input.

Field Assessment of Energy Audit Tools for Retrofit Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Edwards, J.; Bohac, D.; Nelson, C.

2013-07-01

This project focused on the use of home energy ratings as a tool to promote energy retrofits in existing homes. A home energy rating provides a quantitative appraisal of a home's asset performance, usually compared to a benchmark such as the average energy use of similar homes in the same region. Home rating systems can help motivate homeowners in several ways. Ratings can clearly communicate a home's achievable energy efficiency potential, provide a quantitative assessment of energy savings after retrofits are completed, and show homeowners how they rate compared to their neighbors, thus creating an incentive to conform to amore » social standard. An important consideration is how rating tools for the retrofit market will integrate with existing home energy service programs. For residential programs that target energy savings only, home visits should be focused on key efficiency measures for that home. In order to gain wide adoption, a rating tool must be easily integrated into the field process, demonstrate consistency and reasonable accuracy to earn the trust of home energy technicians, and have a low monetary cost and time hurdle for homeowners. Along with the Home Energy Score, this project also evaluated the energy modeling performance of SIMPLE and REM/Rate.« less

[Comparison of the performance-oriented mobility assessment and the Berg balance scale. Assessment tools in geriatrics and geriatric rehabilitation].

PubMed

Schülein, S

2014-02-01

In order to develop and coordinate an integrated plan for treatment of hospitalized elderly patients in danger of future falls it is of utmost importance to ensure using the assessment that best targets people who are at risk for falling. For this purpose the performance-oriented mobility assessment (POMA) and the Berg balance scale (BBS) can be used. The purpose of this study was to collate the results of articles published on these assessment tools in order to appraise whether one of them could be favored under the viewpoint of practicability and expressiveness. A literature search was conducted for studies examining the two assessment tools published since 1986 through December 2011 in English and German language. Reference sections were also inspected for additional citations. Overall 19 studies were retrieved in order to answer the posed question. Of the total number of 1,455 patients in the identified articles, 712 with an average age of 74.1 years were included in the BBS trials and the POMA was assessed using 743 patients with an average age of 75.7 years. The BBS was good at identifying elderly people who are at risk for falling (sensitivity 84-95.5 %) and those who are not at-risk for falling (specificity 76.5-95.5 %. The demonstrated results for the POMA ranged from relatively poor to good (sensitivity 64-95.5 %) and from poor to very high (specificity 60-100 %). The BBS demonstrated its strengths in the more precise survey for monitoring balance and predicting risk for falling. Weaknesses of the BBS were the higher average time of processing and the inability to detect changes in gait. The advantages of the POMA was the short processing time, the possibility for separate identification of balance and gait and the high accuracy in recognition of gait changes. The results suggest that the POMA can be used as a fast screening tool to evaluate risk for falling or changes in gait ability. Geriatric patients who screen positive for risks of falls using the POMA should be selected for further assessment using the BBS. The BBS is a concise assessment tool for monitoring balance and to predict a person's current risk for falling.

Milestones for disposal of radioactive waste at the Waste Isolation Pilot Plant (WIPP) in the United States

DOE Office of Scientific and Technical Information (OSTI.GOV)

RECHARD,ROBERT P.

The opening of the Waste Isolation Pilot Plant on March 26, 1999, was the culmination of a regulatory assessment process that had taken 25 years. National policy issues, negotiated agreements, and court settlements during the first 15 years of the project had a strong influence on the amount and type of scientific data collected up to this point. Assessment activities before the mid 1980s were undertaken primarily (1) to satisfy needs for environmental impact statements, (2) to satisfy negotiated agreements with the State of New Mexico, or (3) to develop general understanding of selected natural phenomena associated with nuclear wastemore » disposal. In the last 10 years, federal compliance policy and actual regulations were sketched out, and continued to evolve until 1996. During this period, stochastic simulations were introduced as a tool for the assessment of the WIPP's performance, and four preliminary performance assessments, one compliance performance assessment, and one verification performance assessment were performed.« less

Assessment of the Draft AIAA S-119 Flight Dynamic Model Exchange Standard

NASA Technical Reports Server (NTRS)

Jackson, E. Bruce; Murri, Daniel G.; Hill, Melissa A.; Jessick, Matthew V.; Penn, John M.; Hasan, David A.; Crues, Edwin Z.; Falck, Robert D.; McCarthy, Thomas G.; Vuong, Nghia;

Acquiring the Language of Learning: The Performance of Hawaiian Preschool Children on the Preschool Language Assessment Instrument (PLAI).

ERIC Educational Resources Information Center

Martini, Mary

The Preschool Language Assessment Instrument (PLAI) was designed as a diagnostic tool for 3- to 6-year-old children to assess children's abilities to use language to solve thinking problems typically posed by teachers. The PLAI was developed after observing middle-class teachers in preschool classrooms encourage children to use language in…

Sulfur Oxides Risk and Exposure Assessment Planning ...

EPA Pesticide Factsheets

In conducting risk/exposure assessments for the Sulfur Oxides NAAQS review, EPA will first develop a draft Scope and Methods Plan which will describe the proposed scope of the quantitative and qualitative analyses to be performed and the tools/methods that may be employed Provide opportunity for CASAC feedback on EPA's plans for the risk and exposure assessment for the Sulfur Oxides NAAQS review

In vitro models for the prediction of in vivo performance of oral dosage forms.

PubMed

Kostewicz, Edmund S; Abrahamsson, Bertil; Brewster, Marcus; Brouwers, Joachim; Butler, James; Carlert, Sara; Dickinson, Paul A; Dressman, Jennifer; Holm, René; Klein, Sandra; Mann, James; McAllister, Mark; Minekus, Mans; Muenster, Uwe; Müllertz, Anette; Verwei, Miriam; Vertzoni, Maria; Weitschies, Werner; Augustijns, Patrick

2014-06-16

Accurate prediction of the in vivo biopharmaceutical performance of oral drug formulations is critical to efficient drug development. Traditionally, in vitro evaluation of oral drug formulations has focused on disintegration and dissolution testing for quality control (QC) purposes. The connection with in vivo biopharmaceutical performance has often been ignored. More recently, the switch to assessing drug products in a more biorelevant and mechanistic manner has advanced the understanding of drug formulation behavior. Notwithstanding this evolution, predicting the in vivo biopharmaceutical performance of formulations that rely on complex intraluminal processes (e.g. solubilization, supersaturation, precipitation…) remains extremely challenging. Concomitantly, the increasing demand for complex formulations to overcome low drug solubility or to control drug release rates urges the development of new in vitro tools. Development and optimizing innovative, predictive Oral Biopharmaceutical Tools is the main target of the OrBiTo project within the Innovative Medicines Initiative (IMI) framework. A combination of physico-chemical measurements, in vitro tests, in vivo methods, and physiology-based pharmacokinetic modeling is expected to create a unique knowledge platform, enabling the bottlenecks in drug development to be removed and the whole process of drug development to become more efficient. As part of the basis for the OrBiTo project, this review summarizes the current status of predictive in vitro assessment tools for formulation behavior. Both pharmacopoeia-listed apparatus and more advanced tools are discussed. Special attention is paid to major issues limiting the predictive power of traditional tools, including the simulation of dynamic changes in gastrointestinal conditions, the adequate reproduction of gastrointestinal motility, the simulation of supersaturation and precipitation, and the implementation of the solubility-permeability interplay. It is anticipated that the innovative in vitro biopharmaceutical tools arising from the OrBiTo project will lead to improved predictions for in vivo behavior of drug formulations in the GI tract. Copyright © 2013 Elsevier B.V. All rights reserved.

Abridged geriatric assessment is a better predictor of overall survival than the Karnofsky Performance Scale and Physical Performance Test in elderly patients with cancer.

PubMed

Ghosn, Marwan; Ibrahim, Tony; El Rassy, Elie; Nassani, Najib; Ghanem, Sassine; Assi, Tarek

2017-03-01

Comprehensive geriatric assessment (CGA) is a complex and interdisciplinary approach to evaluate the health status of elderly patients. The Karnofsky Performance Scale (KPS) and Physical Performance Test (PPT) are less time-consuming tools that measure functional status. This study was designed to assess and compare abridged geriatric assessment (GA), KPS and PPT as predictive tools of mortality in elderly patients with cancer. This prospective interventional study included all individuals aged >70years who were diagnosed with cancer during the study period. Subjects were interviewed directly using a procedure that included a clinical test and a questionnaire composed of the KPS, PPT and abridged GCA. Overall survival (OS) was the primary endpoint. The log rank test was used to compare survival curves, and Cox's regression model (forward procedure) was used for multivariate survival analysis. One hundred patients were included in this study. Abridged GA was the only tool found to predict mortality [median OS for unfit patients (at least two impairments) 467days vs 1030days for fit patients; p=0.04]. Patients defined as fit by mean PPT score (>20) had worse median OS (560 vs 721days); however, this difference was not significant (p=0.488 on log rank). Although median OS did not differ significantly between patients with low (≤80) and high (>80) KPS scores (467 and 795days, respectively; p=0.09), survival curves diverged after nearly 120days of follow-up. Visual and hearing impairments were the only components of abridged GA of prognostic value. Neither KPS nor PPT were shown to predict mortality in elderly patients with cancer whereas abridged GA was predictive. This study suggests a possible role for visual and hearing assessment as screening for patients requiring CGA. Copyright © 2016 Elsevier Ltd. All rights reserved.

The role of simulation in continuing medical education for acute care physicians: a systematic review.

PubMed

Khanduja, P Kristina; Bould, M Dylan; Naik, Viren N; Hladkowicz, Emily; Boet, Sylvain

2015-01-01

We systematically reviewed the effectiveness of simulation-based education, targeting independently practicing qualified physicians in acute care specialties. We also describe how simulation is used for performance assessment in this population. Data source included: DataMEDLINE, Embase, Cochrane Database of Systematic Reviews, Cochrane CENTRAL Database of Controlled Trials, and National Health Service Economic Evaluation Database. The last date of search was January 31, 2013. All original research describing simulation-based education for independently practicing physicians in anesthesiology, critical care, and emergency medicine was reviewed. Data analysis was performed in duplicate with further review by a third author in cases of disagreement until consensus was reached. Data extraction was focused on effectiveness according to Kirkpatrick's model. For simulation-based performance assessment, tool characteristics and sources of validity evidence were also collated. Of 39 studies identified, 30 studies focused on the effectiveness of simulation-based education and nine studies evaluated the validity of simulation-based assessment. Thirteen studies (30%) targeted the lower levels of Kirkpatrick's hierarchy with reliance on self-reporting. Simulation was unanimously described as a positive learning experience with perceived impact on clinical practice. Of the 17 remaining studies, 10 used a single group or "no intervention comparison group" design. The majority (n = 17; 44%) were able to demonstrate both immediate and sustained improvements in educational outcomes. Nine studies reported the psychometric properties of simulation-based performance assessment as their sole objective. These predominantly recruited independent practitioners as a convenience sample to establish whether the tool could discriminate between experienced and inexperienced operators and concentrated on a single aspect of validity evidence. Simulation is perceived as a positive learning experience with limited evidence to support improved learning. Future research should focus on the optimal modality and frequency of exposure, quality of assessment tools and on the impact of simulation-based education beyond the individuals toward improved patient care.

Developing a Tool for Increasing the Awareness about Gendered and Intersectional Processes in the Clinical Assessment of Patients--A Study of Pain Rehabilitation.

PubMed

Hammarström, Anne; Wiklund, Maria; Stålnacke, Britt-Marie; Lehti, Arja; Haukenes, Inger; Fjellman-Wiklund, Anncristine

2016-01-01

There is a need for tools addressing gender inequality in the everyday clinical work in health care. The aim of our paper was to develop a tool for increasing the awareness of gendered and intersectional processes in clinical assessment of patients, based on a study of pain rehabilitation. In the overarching project named "Equal care in rehabilitation" we used multiple methods (both quantitative and qualitative) in five sub studies. With a novel approach we used Grounded Theory in order to synthesize the results from our sub studies, in order to develop the gender equality tool. The gender equality tool described and developed in this article is thus based on results from sub studies about the processes of assessment and selection of patients in pain rehabilitation. Inspired by some questions in earlier tools, we posed open ended questions and inductively searched for findings and concepts relating to gendered and social selection processes in pain rehabilitation, in each of our sub studies. Through this process, the actual gender equality tool was developed as 15 questions about the process of assessing and selecting patients to pain rehabilitation. As a more comprehensive way of understanding the tool, we performed a final step of the GT analyses. Here we synthesized the results of the tool into a comprehensive model with two dimensions in relation to several possible discrimination axes. The process of assessing and selecting patients was visualized as a funnel, a top down process governed by gendered attitudes, rules and structures. We found that the clinicians judged inner and outer characteristics and status of patients in a gendered and intersectional way in the process of clinical decision-making which thus can be regarded as (potentially) biased with regard to gender, socio-economic status, ethnicity and age. The clinical implications of our tool are that the tool can be included in the systematic routine of clinical assessment of patients for both awareness raising and as a base for avoiding gender bias in clinical decision-making. The tool could also be used in team education for health professionals as an instrument for critical reflection on gender bias. Thus, tools for clinical assessment can be developed from empirical studies in various clinical settings. However, such a micro-level approach must be understood from a broader societal perspective including gender relations on both the macro- and the meso-level.

Developing a Tool for Increasing the Awareness about Gendered and Intersectional Processes in the Clinical Assessment of Patients – A Study of Pain Rehabilitation

PubMed Central

Hammarström, Anne; Wiklund, Maria; Stålnacke, Britt-Marie; Lehti, Arja; Haukenes, Inger; Fjellman-Wiklund, Anncristine

2016-01-01

Objective There is a need for tools addressing gender inequality in the everyday clinical work in health care. The aim of our paper was to develop a tool for increasing the awareness of gendered and intersectional processes in clinical assessment of patients, based on a study of pain rehabilitation. Methods In the overarching project named “Equal care in rehabilitation” we used multiple methods (both quantitative and qualitative) in five sub studies. With a novel approach we used Grounded Theory in order to synthesize the results from our sub studies, in order to develop the gender equality tool. The gender equality tool described and developed in this article is thus based on results from sub studies about the processes of assessment and selection of patients in pain rehabilitation. Inspired by some questions in earlier tools, we posed open ended questions and inductively searched for findings and concepts relating to gendered and social selection processes in pain rehabilitation, in each of our sub studies. Through this process, the actual gender equality tool was developed as 15 questions about the process of assessing and selecting patients to pain rehabilitation. As a more comprehensive way of understanding the tool, we performed a final step of the GT analyses. Here we synthesized the results of the tool into a comprehensive model with two dimensions in relation to several possible discrimination axes. Results The process of assessing and selecting patients was visualized as a funnel, a top down process governed by gendered attitudes, rules and structures. We found that the clinicians judged inner and outer characteristics and status of patients in a gendered and intersectional way in the process of clinical decision-making which thus can be regarded as (potentially) biased with regard to gender, socio-economic status, ethnicity and age. Implications The clinical implications of our tool are that the tool can be included in the systematic routine of clinical assessment of patients for both awareness raising and as a base for avoiding gender bias in clinical decision-making. The tool could also be used in team education for health professionals as an instrument for critical reflection on gender bias. Conclusions Thus, tools for clinical assessment can be developed from empirical studies in various clinical settings. However, such a micro-level approach must be understood from a broader societal perspective including gender relations on both the macro- and the meso-level. PMID:27055029

RCTA capstone assessment

NASA Astrophysics Data System (ADS)

Lennon, Craig; Bodt, Barry; Childers, Marshal; Dean, Robert; Oh, Jean; DiBerardino, Chip; Keegan, Terence

2015-05-01

The Army Research Laboratory's Robotics Collaborative Technology Alliance (RCTA) is a program intended to change robots from tools that soldiers use into teammates with which soldiers can work. This requires the integration of fundamental and applied research in perception, artificial intelligence, and human-robot interaction. In October of 2014, the RCTA assessed progress towards integrating this research. This assessment was designed to evaluate the robot's performance when it used new capabilities to perform selected aspects of a mission. The assessed capabilities included the ability of the robot to: navigate semantically outdoors with respect to structures and landmarks, identify doors in the facades of buildings, and identify and track persons emerging from those doors. We present details of the mission-based vignettes that constituted the assessment, and evaluations of the robot's performance in these vignettes.

ENVI-PV: An Interactive Web Client for Multi-Criteria Life Cycle Assessment of Photovoltaic Systems Worldwide

DOE Office of Scientific and Technical Information (OSTI.GOV)

Perez-Lopez, Paula; Gschwind, Benoit; Blanc, Philippe

Solar photovoltaics (PV) is the second largest source of new capacity among renewable energies. The worldwide capacity encompassed 135 GW in 2013 and is estimated to increase to 1721 GW in 2030 and 4674 GW in 2050, according to a prospective high-renewable scenario. To achieve this production level while minimizing environmental impacts, decision makers must have access to environmental performance data that reflect their high spatial variability accurately. We propose ENVI-PV (http://viewer.webservice-energy.org/project_iea), a new interactive tool that provides maps and screening level data, based on weighted average supply chains, for the environmental performance of common PV technologies. Environmental impacts ofmore » PV systems are evaluated according to a life cycle assessment approach. ENVI-PV was developed using a state-of-the-art interoperable and open standard Web Service framework from the Open Geospatial Consortium (OGC). It combines the latest life cycle inventories, published in 2015 by the International Energy Agency (IEA) under the Photovoltaic Power Systems Program (PVPS) Task 12, and some inventories previously published from Ecoinvent v2.2 database with solar irradiation estimates computed from the worldwide NASA SSE database. ENVI-PV is the first tool to propose a worldwide coverage of environmental performance of PV systems using a multi-criteria assessment. The user can compare the PV environmental performance to the environmental footprint of country electricity mixes. ENVI-PV is designed as an environmental interactive tool to generate PV technological options and evaluate their performance in different spatial and techno-economic contexts. Its potential applications are illustrated in this paper with several examples.« less

Historical Relationship Between Performance Assessment for Radioactive Waste Disposal and Other Types of Risk Assessment in the United States

DOE Office of Scientific and Technical Information (OSTI.GOV)

RECHARD,ROBERT P.

This paper describes the evolution of the process for assessing the hazards of a geologic disposal system for radioactive waste and, similarly, nuclear power reactors, and the relationship of this process with other assessments of risk, particularly assessments of hazards from manufactured carcinogenic chemicals during use and disposal. This perspective reviews the common history of scientific concepts for risk assessment developed to the 1950s. Computational tools and techniques developed in the late 1950s and early 1960s to analyze the reliability of nuclear weapon delivery systems were adopted in the early 1970s for probabilistic risk assessment of nuclear power reactors, amore » technology for which behavior was unknown. In turn, these analyses became an important foundation for performance assessment of nuclear waste disposal in the late 1970s. The evaluation of risk to human health and the environment from chemical hazards is built upon methods for assessing the dose response of radionuclides in the 1950s. Despite a shared background, however, societal events, often in the form of legislation, have affected the development path for risk assessment for human health, producing dissimilarities between these risk assessments and those for nuclear facilities. An important difference is the regulator's interest in accounting for uncertainty and the tools used to evaluate it.« less