Development and Validation of the Narrative Quality Assessment Tool.

PubMed

Kim, Wonsun Sunny; Shin, Cha-Nam; Kathryn Larkey, Linda; Roe, Denise J

2017-04-01

The use of storytelling in health promotion has grown over the past 2 decades, showing promise for moving people to initiate healthy behavior change. Given the increasingly prevalent role of storytelling in health promotion research and the need to more clearly identify what storytelling elements and mediators may better predict behavior change, there is a need to develop measures to specifically assess these factors in a cultural community context. The purpose of this study is to develop and preliminarily validate a narrative quality assessment tool for measuring elements of storytelling that are predicted to affect attitude and behavior change (i.e., narrative characteristics, identification, and transportation) within a cultural community setting using a culture-centric model. Reliability and validity of these scales were assessed with repeated administrations among 74 Latino men and women with a mean age of 39.6 years (SD = 11.47 years). The confirmatory factor analysis in addition to internal consistency tests revealed preliminary evidence for reliability and validity of the narrative characteristics, identification, and transportation scales. Cronbach's alpha ranged from .92 to .94. Items revealed adequate factor loadings (.85-.98) and good model fit. The new scales provide the first step in moving the assessment of narrative quality into a culturally relevant context for evaluation of story use in health promotion. The results present valuable information for nurse researchers to guide the development and testing of culturally grounded storytelling interventions' potential to predict attitude and behavior change for patients.

Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor.

PubMed

Zimmerman, Kathleen N; Ledford, Jennifer R; Severini, Katherine E; Pustejovsky, James E; Barton, Erin E; Lloyd, Blair P

2018-03-03

Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional Children, What Works Clearinghouse, and Single-Case Analysis and Design Framework) were compared to determine if conclusions regarding the effectiveness of antecedent sensory-based interventions for young children changed based on choice of quality evaluation tool. Evaluation of SCD quality differed across tools, suggesting selection of quality evaluation tools impacts evaluation findings. Suggestions for selecting an appropriate quality and rigor assessment tool are provided and across-tool conclusions are drawn regarding the quality and rigor of studies. Finally, authors provide guidance for using quality evaluations in conjunction with outcome analyses when conducting syntheses of interventions evaluated in the context of SCD. Copyright © 2018 Elsevier Ltd. All rights reserved.

A web-based screening tool for near-port air quality assessments

PubMed Central

Isakov, Vlad; Barzyk, Timothy M.; Smith, Elizabeth R.; Arunachalam, Saravanan; Naess, Brian; Venkatram, Akula

2018-01-01

The Community model for near-PORT applications (C-PORT) is a screening tool with an intended purpose of calculating differences in annual averaged concentration patterns and relative contributions of various source categories over the spatial domain within about 10 km of the port. C-PORT can inform decision-makers and concerned citizens about local air quality due to mobile source emissions related to commercial port activities. It allows users to visualize and evaluate different planning scenarios, helping them identify the best alternatives for making long-term decisions that protect community health and sustainability. The web-based, easy-to-use interface currently includes data from 21 seaports primarily in the Southeastern U.S., and has a map-based interface based on Google Maps. The tool was developed to visualize and assess changes in air quality due to changes in emissions and/or meteorology in order to analyze development scenarios, and is not intended to support or replace any regulatory models or programs. PMID:29681760

Content, Quality, and Assessment Tools of Physician-Rating Websites in 12 Countries: Quantitative Analysis.

PubMed

Rothenfluh, Fabia; Schulz, Peter J

2018-06-14

Websites on which users can rate their physician are becoming increasingly popular, but little is known about the website quality, the information content, and the tools they offer users to assess physicians. This study assesses these aspects on physician-rating websites in German- and English-speaking countries. The objective of this study was to collect information on websites with a physician rating or review tool in 12 countries in terms of metadata, website quality (transparency, privacy and freedom of speech of physicians and patients, check mechanisms for appropriateness and accuracy of reviews, and ease of page navigation), professional information about the physician, rating scales and tools, as well as traffic rank. A systematic Web search based on a set of predefined keywords was conducted on Google, Bing, and Yahoo in August 2016. A final sample of 143 physician-rating websites was analyzed and coded for metadata, quality, information content, and the physician-rating tools. The majority of websites were registered in the United States (40/143) or Germany (25/143). The vast majority were commercially owned (120/143, 83.9%), and 69.9% (100/143) displayed some form of physician advertisement. Overall, information content (mean 9.95/25) as well as quality were low (mean 18.67/47). Websites registered in the United Kingdom obtained the highest quality scores (mean 26.50/47), followed by Australian websites (mean 21.50/47). In terms of rating tools, physician-rating websites were most frequently asking users to score overall performance, punctuality, or wait time in practice. This study evidences that websites that provide physician rating should improve and communicate their quality standards, especially in terms of physician and user protection, as well as transparency. In addition, given that quality standards on physician-rating websites are low overall, the development of transparent guidelines is required. Furthermore, attention should be paid to the

Assessment of quality of prescribing in patients of hypertension at primary and secondary health care facilities using the Prescription Quality Index (PQI) tool.

PubMed

Suthar, Jalpa Vashishth; Patel, Varsha J

2014-01-01

To determine the quality of prescribing in hypertension in primary and secondary health care settings using the Prescription Quality Index (PQI) tool and to assess the reliability of this tool. An observational cross-sectional study was carried out for 6 months in order to assess quality of prescribing of antihypertensive drugs using Prescription Quality Index (PQI) at four primary (PHC) and two secondary (SHC) health care facilities. Patients attending these facilities for at least 3 months were included. Complete medical history and prescriptions received were noted. Total and criteria wise PQI scores were derived for each prescription. Prescriptions were categorized as poor (score of ≤31), medium (score 32-33) and high quality (score 34-43) based on PQI total score. Psychometric analysis using factor analysis was carried out to assess reliability and validity. Total 73 hypertensive patients were included. Mean age was 61.2 ± 11 years with 35 (48%) patients above 65 years of age. Total PQI score was 26 ± 11. There was a significant difference in PQI score between PHC and SHC (P < 0.05) Out of 73 prescriptions, 43 (59%) were of poor quality with PQI score <31. The value of Cronbach's α for the entire 22 criteria of PQI was 0.71 suggesting good reliability of PQI tool in our setting. Based on PQI scores, quality of prescribing in hypertensive patients was poor, somewhat better in primary as compared to secondary health care facility. PQI is reliable for measuring prescribing quality in hypertension in Indian set up.

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

Identifying and classifying quality-of-life tools for assessing pressure ulcers after spinal cord injury

PubMed Central

Hitzig, Sander L.; Balioussis, Christina; Nussbaum, Ethne; McGillivray, Colleen F.; Catharine Craven, B.; Noreau, Luc

2013-01-01

Context Although pressure ulcers may negatively influence quality of life (QoL) post-spinal cord injury (SCI), our understanding of how to assess their impact is confounded by conceptual and measurement issues. To ensure that descriptions of pressure ulcer impact are appropriately characterized, measures should be selected according to the domains that they evaluate and the population and pathologies for which they are designed. Objective To conduct a systematic literature review to identify and classify outcome measures used to assess the impact of pressure ulcers on QoL after SCI. Methods Electronic databases (Medline/PubMed, CINAHL, and PsycInfo) were searched for studies published between 1975 and 2011. Identified outcome measures were classified as being either subjective or objective using a QoL model. Results Fourteen studies were identified. The majority of tools identified in these studies did not have psychometric evidence supporting their use in the SCI population with the exception of two objective measures, the Short-Form 36 and the Craig Handicap Assessment and Reporting Technique, and two subjective measures, the Life Situation Questionnaire-Revised and the Ferrans and Powers Quality of Life Index SCI-Version. Conclusion Many QoL outcome tools showed promise in being sensitive to the presence of pressure ulcers, but few of them have been validated for use with SCI. Prospective studies should employ more rigorous methods for collecting data on pressure ulcer severity and location to improve the quality of findings with regard to their impact on QoL. The Cardiff Wound Impact Schedule is a potential tool for assessing impact of pressure ulcers-post SCI. PMID:24090238

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi.

PubMed

Ruark, Allison; Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women's and men's couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi

PubMed Central

Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women’s and men’s couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships. PMID:29190769

Innovative tools for quality assessment: integrated quality criteria for review of multiple study designs (ICROMS).

PubMed

Zingg, W; Castro-Sanchez, E; Secci, F V; Edwards, R; Drumright, L N; Sevdalis, N; Holmes, A H

2016-04-01

With the aim to facilitate a more comprehensive review process in public health including patient safety, we established a tool that we have termed ICROMS (Integrated quality Criteria for the Review Of Multiple Study designs), which unifies, integrates and refines current quality criteria for a large range of study designs including qualitative research. Review, pilot testing and expert consensus. The tool is the result of an iterative four phase process over two years: 1) gathering of established criteria for assessing controlled, non-controlled and qualitative study designs; 2) pilot testing of a first version in two systematic reviews on behavioural change in infection prevention and control and in antibiotic prescribing; 3) further refinement and adding of additional study designs in the context of the European Centre for Disease Prevention and Control funded project 'Systematic review and evidence-based guidance on organisation of hospital infection control programmes' (SIGHT); 4) scrutiny by the pan-European expert panel of the SIGHT project, which had the objective of ensuring robustness of the systematic review. ICROMS includes established quality criteria for randomised studies, controlled before-and-after studies and interrupted time series, and incorporates criteria for non-controlled before-and-after studies, cohort studies and qualitative studies. The tool consists of two parts: 1) a list of quality criteria specific for each study design, as well as criteria applicable across all study designs by using a scoring system; 2) a 'decision matrix', which specifies the robustness of the study by identifying minimum requirements according to the study type and the relevance of the study to the review question. The decision matrix directly determines inclusion or exclusion of a study in the review. ICROMS was applied to a series of systematic reviews to test its feasibility and usefulness in the appraisal of multiple study designs. The tool was applicable

An evaluation of the quality of obstetric morbidity coding using an objective assessment tool, the Performance Indicators For Coding Quality (PICQ).

PubMed

Lamb, Mary K; Innes, Kerry; Saad, Patricia; Rust, Julie; Dimitropoulos, Vera; Cumerlato, Megan

The Performance Indicators for Coding Quality (PICQ) is a data quality assessment tool developed by Australia's National Centre for Classification in Health (NCCH). PICQ consists of a number of indicators covering all ICD-10-AM disease chapters, some procedure chapters from the Australian Classification of Health Intervention (ACHI) and some Australian Coding Standards (ACS). The indicators can be used to assess the coding quality of hospital morbidity data by monitoring compliance of coding conventions and ACS; this enables the identification of particular records that may be incorrectly coded, thus providing a measure of data quality. There are 31 obstetric indicators available for the ICD-10-AM Fourth Edition. Twenty of these 31 indicators were classified as Fatal, nine as Warning and two Relative. These indicators were used to examine coding quality of obstetric records in the 2004-2005 financial year Australian national hospital morbidity dataset. Records with obstetric disease or procedure codes listed anywhere in the code string were extracted and exported from the SPSS source file. Data were then imported into a Microsoft Access database table as per PICQ instructions, and run against all Fatal and Warning and Relative (N=31) obstetric PICQ 2006 Fourth Edition Indicators v.5 for the ICD-10- AM Fourth Edition. There were 689,905 gynaecological and obstetric records in the 2004-2005 financial year, of which 1.14% were found to have triggered Fatal degree errors, 3.78% Warning degree errors and 8.35% Relative degree errors. The types of errors include completeness, redundancy, specificity and sequencing problems. It was found that PICQ is a useful initial screening tool for the assessment of ICD-10-AM/ACHI coding quality. The overall quality of codes assigned to obstetric records in the 2004- 2005 Australian national morbidity dataset is of fair quality.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE

Stimulating a Culture of Improvement: Introducing 
an Integrated Quality Tool for Organizational Self-Assessment.

PubMed

Coleman, Cathy

2015-06-01

As leaders and systems-level agents of change, oncology nurses are challenged by opportunities to guide organizational transformation from the front line to the board room. Across all care settings, reform and change initiatives are constants in the quest to optimize quality and healthcare outcomes for individuals, teams, populations, and organizations. This article describes a practical, evidence-based, integrated quality tool for initiating organizational self-assessment to prioritize issues and stimulate a culture of continuous improvement.

MedAd-AppQ: A quality assessment tool for medication adherence apps on iOS and android platforms.

PubMed

Ali, Eskinder Eshetu; Teo, Amanda Kai Sin; Goh, Sherlyn Xue Lin; Chew, Lita; Yap, Kevin Yi-Lwern

2018-02-02

With the recent proliferation of smartphone medication adherence applications (apps), it is increasingly more difficult for patients and clinicians to identify the most useful app. To develop a quality assessment tool for medication adherence apps, and evaluate the quality of such apps from the major app stores. In this study, a Medication Adherence App Quality assessment tool (MedAd-AppQ) was developed and two evaluators independently assessed apps that fulfilled the following criteria: availability in English, had at least a medication reminder feature, non-specific to certain disease conditions (generic apps), free of technical malfunctions and availability on both the iPhone Operating System (iOS) and Android platforms. Descriptive statistics, Mann-Whitney U test, Pearson product moment correlation and Spearman rank-order correlation were used for statistical analysis. MedAd-AppQ was designed to have 24 items (total 43 points) categorized under three sections: content reliability (11 points), feature usefulness (29 points) and feature convenience (3 points). The three sections of MedAd-AppQ were found to have inter-rater correlation coefficients of 0.801 (p-value < .001) or higher. Based on analysis of 52 apps (27 iOS and 25 Android), quality scores ranged between 7/43 (16.3%) and 28/43 (65.1%). There was no significant difference between the quality scores of the Android and iOS versions. None of the apps had features for self-management of side effects. Only two apps in each platform provided disease-related and/or medication information. MedAd-AppQ can be used to reliably assess the quality of adherence apps. Clinicians can use the tool in selecting apps for use by patients. Developers of adherence apps should consider features that provide therapy-related information and help patients in medications and side-effects management. Copyright © 2018 Elsevier Inc. All rights reserved.

BASINS Climate Assessment Tool Tutorials

EPA Pesticide Factsheets

The BASINS Climate Assessment Tool (CAT) provides a flexible set of capabilities for exploring the potential effects of climate change on streamflow and water quality using different watershed models in BASINS.

Embedding systematic quality assessments in supportive supervision at primary healthcare level: application of an electronic Tool to Improve Quality of Healthcare in Tanzania.

PubMed

Mboya, Dominick; Mshana, Christopher; Kessy, Flora; Alba, Sandra; Lengeler, Christian; Renggli, Sabine; Vander Plaetse, Bart; Mohamed, Mohamed A; Schulze, Alexander

2016-10-13

Assessing quality of health services, for example through supportive supervision, is essential for strengthening healthcare delivery. Most systematic health facility assessment mechanisms, however, are not suitable for routine supervision. The objective of this study is to describe a quality assessment methodology using an electronic format that can be embedded in supervision activities and conducted by council health staff. An electronic Tool to Improve Quality of Healthcare (e-TIQH) was developed to assess the quality of primary healthcare provision. The e-TIQH contains six sub-tools, each covering one quality dimension: infrastructure and equipment of the facility, its management and administration, job expectations, clinical skills of the staff, staff motivation and client satisfaction. As part of supportive supervision, council health staff conduct quality assessments in all primary healthcare facilities in a given council, including observation of clinical consultations and exit interviews with clients. Using a hand-held device, assessors enter data and view results in real time through automated data analysis, permitting immediate feedback to health workers. Based on the results, quality gaps and potential measures to address them are jointly discussed and actions plans developed. For illustrative purposes, preliminary findings from e-TIQH application are presented from eight councils of Tanzania for the period 2011-2013, with a quality score <75 % classed as 'unsatisfactory'. Staff motivation (<50 % in all councils) and job expectations (≤50 %) scored lowest of all quality dimensions at baseline. Clinical practice was unsatisfactory in six councils, with more mixed results for availability of infrastructure and equipment, and for administration and management. In contrast, client satisfaction scored surprisingly high. Over time, each council showed a significant overall increase of 3-7 % in mean score, with the most pronounced improvements in staff

BASINs and WEPP Climate Assessment Tools (CAT): Case ...

EPA Pesticide Factsheets

EPA announced the release of the final report, BASINs and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications. This report supports application of two recently developed water modeling tools, the Better Assessment Science Integrating point & Non-point Sources (BASINS) and the Water Erosion Prediction Project Climate Assessment Tool (WEPPCAT). The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments of the potential effects of climate change on streamflow and water quality. This report presents a series of short, illustrative case studies using the BASINS and WEPP climate assessment tools.

Q-SEA – a tool for quality assessment of ethics analyses conducted as part of health technology assessments

PubMed Central

Scott, Anna Mae; Hofmann, Björn; Gutiérrez-Ibarluzea, Iñaki; Bakke Lysdahl, Kristin; Sandman, Lars; Bombard, Yvonne

2017-01-01

Introduction: Assessment of ethics issues is an important part of health technology assessments (HTA). However, in terms of existence of quality assessment tools, ethics for HTA is methodologically underdeveloped in comparison to other areas of HTA, such as clinical or cost effectiveness. Objective: To methodologically advance ethics for HTA by: (1) proposing and elaborating Q-SEA, the first instrument for quality assessment of ethics analyses, and (2) applying Q-SEA to a sample systematic review of ethics for HTA, in order to illustrate and facilitate its use. Methods: To develop a list of items for the Q-SEA instrument, we systematically reviewed the literature on methodology in ethics for HTA, reviewed HTA organizations’ websites, and solicited views from 32 experts in the field of ethics for HTA at two 2-day workshops. We subsequently refined Q-SEA through its application to an ethics analysis conducted for HTA. Results: Q-SEA instrument consists of two domains – the process domain and the output domain. The process domain consists of 5 elements: research question, literature search, inclusion/exclusion criteria, perspective, and ethics framework. The output domain consists of 5 elements: completeness, bias, implications, conceptual clarification, and conflicting values. Conclusion: Q-SEA is the first instrument for quality assessment of ethics analyses in HTA. Further refinements to the instrument to enhance its usability continue. PMID:28326147

High-volume image quality assessment systems: tuning performance with an interactive data visualization tool

NASA Astrophysics Data System (ADS)

Bresnahan, Patricia A.; Pukinskis, Madeleine; Wiggins, Michael

1999-03-01

Image quality assessment systems differ greatly with respect to the number and types of mags they need to evaluate, and their overall architectures. Managers of these systems, however, all need to be able to tune and evaluate system performance, requirements often overlooked or under-designed during project planning. Performance tuning tools allow users to define acceptable quality standards for image features and attributes by adjusting parameter settings. Performance analysis tools allow users to evaluate and/or predict how well a system performs in a given parameter state. While image assessment algorithms are becoming quite sophisticated, duplicating or surpassing the human decision making process in their speed and reliability, they often require a greater investment in 'training' or fine tuning of parameters in order to achieve optimum performance. This process may involve the analysis of hundreds or thousands of images, generating a large database of files and statistics that can be difficult to sort through and interpret. Compounding the difficulty is the fact that personnel charged with tuning and maintaining the production system may not have the statistical or analytical background required for the task. Meanwhile, hardware innovations have greatly increased the volume of images that can be handled in a given time frame, magnifying the consequences of running a production site with an inadequately tuned system. In this paper, some general requirements for a performance evaluation and tuning data visualization system are discussed. A custom engineered solution to the tuning and evaluation problem is then presented, developed within the context of a high volume image quality assessment, data entry, OCR, and image archival system. A key factor influencing the design of the system was the context-dependent definition of image quality, as perceived by a human interpreter. This led to the development of a five-level, hierarchical approach to image quality

Floristic Quality Index: An assessment tool for restoration projects and monitoring sites in coastal Louisiana

USGS Publications Warehouse

Cretini, K.F.; Steyer, G.D.

2011-01-01

The Coastwide Reference Monitoring System (CRMS) program was established to assess the effectiveness of individual coastal restoration projects and the cumulative effects of multiple projects at regional and coastwide scales. In order to make these assessments, analytical teams have been assembled for each of the primary data types sampled under the CRMS program, including vegetation, hydrology, landscape, and soils. These teams consist of scientists and support staff from the U.S. Geological Survey and other Federal agencies, the Louisiana Office of Coastal Protection and Restoration, and university academics. Each team is responsible for developing or identifying parameters, indices, or tools that can be used to assess coastal wetlands at various scales. The CRMS Vegetation Analytical Team has developed a Floristic Quality Index for coastal Louisiana to determine the quality of a wetland based on its plant species composition and abundance.

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours

PubMed Central

Wong, William CW; Cheung, Catherine SK; Hart, Graham J

2008-01-01

Background Systematic reviews based on the critical appraisal of observational and analytic studies on HIV prevalence and risk factors for HIV transmission among men having sex with men are very useful for health care decisions and planning. Such appraisal is particularly difficult, however, as the quality assessment tools available for use with observational and analytic studies are poorly established. Methods We reviewed the existing quality assessment tools for systematic reviews of observational studies and developed a concise quality assessment checklist to help standardise decisions regarding the quality of studies, with careful consideration of issues such as external and internal validity. Results A pilot version of the checklist was developed based on epidemiological principles, reviews of study designs, and existing checklists for the assessment of observational studies. The Quality Assessment Tool for Systematic Reviews of Observational Studies (QATSO) Score consists of five items: External validity (1 item), reporting (2 items), bias (1 item) and confounding factors (1 item). Expert opinions were sought and it was tested on manuscripts that fulfil the inclusion criteria of a systematic review. Like all assessment scales, QATSO may oversimplify and generalise information yet it is inclusive, simple and practical to use, and allows comparability between papers. Conclusion A specific tool that allows researchers to appraise and guide study quality of observational studies is developed and can be modified for similar studies in the future. PMID:19014686

Understanding Interrater Reliability and Validity of Risk Assessment Tools Used to Predict Adverse Clinical Events.

PubMed

Siedlecki, Sandra L; Albert, Nancy M

This article will describe how to assess interrater reliability and validity of risk assessment tools, using easy-to-follow formulas, and to provide calculations that demonstrate principles discussed. Clinical nurse specialists should be able to identify risk assessment tools that provide high-quality interrater reliability and the highest validity for predicting true events of importance to clinical settings. Making best practice recommendations for assessment tool use is critical to high-quality patient care and safe practices that impact patient outcomes and nursing resources. Optimal risk assessment tool selection requires knowledge about interrater reliability and tool validity. The clinical nurse specialist will understand the reliability and validity issues associated with risk assessment tools, and be able to evaluate tools using basic calculations. Risk assessment tools are developed to objectively predict quality and safety events and ultimately reduce the risk of event occurrence through preventive interventions. To ensure high-quality tool use, clinical nurse specialists must critically assess tool properties. The better the tool's ability to predict adverse events, the more likely that event risk is mediated. Interrater reliability and validity assessment is relatively an easy skill to master and will result in better decisions when selecting or making recommendations for risk assessment tool use.

Neighborhood Quality and Attachment: Validation of the Revised Residential Environment Assessment Tool.

PubMed

Poortinga, Wouter; Calve, Tatiana; Jones, Nikki; Lannon, Simon; Rees, Tabitha; Rodgers, Sarah E; Lyons, Ronan A; Johnson, Rhodri

2017-04-01

Various studies have shown that neighborhood quality is linked to neighborhood attachment and satisfaction. However, most have relied upon residents' own perceptions rather than independent observations of the neighborhood environment. This study examines the reliability and validity of the revised Residential Environment Assessment Tool (REAT 2.0), an audit instrument covering both public and private spaces of the neighborhood environment. The research shows that REAT 2.0 is a reliable, easy-to-use instrument and that most underlying constructs can be validated against residents' own neighborhood perceptions. The convergent validity of the instrument, which was tested against digital map data, can be improved for a number of miscellaneous urban form items. The research further found that neighborhood attachment was significantly associated with the overall REAT 2.0 score. This association can mainly be attributed to the property-level neighborhood quality and natural elements components. The research demonstrates the importance of private spaces in the outlook of the neighborhood environment.

BASINs 4.0 Climate Assessment Tool (CAT): Supporting ...

EPA Pesticide Factsheets

EPA announced the availability of the report, BASINS 4.0 Climate Assessment Tool (CAT): Supporting Documentation and User's Manual. This report was prepared by the EPA's Global Change Research Program (GCRP), an assessment-oriented program, that sits within the Office of Research and Development, that focuses on assessing how potential changes in climate and other global environmental stressors may impact water quality, air quality, aquatic ecosystems, and human health in the United States. The Program’s focus on water quality is consistent with the Research Strategy of the U.S. Climate Change Research Program—the federal umbrella organization for climate change science in the U.S. government—and is responsive to U.S. EPA’s mission and responsibilities as defined by the Clean Water Act and the Safe Drinking Water Act. A central goal of the EPA GCRP is to provide EPA program offices, Regions, and other stakeholders with tools and information for assessing and responding to any potential future impacts of climate change. In 2007, the EPA Global Change Research Program (GCRP), in partnership with the EPA Office of Water, supported development of a Climate Assessment Tool (CAT) for version 4 of EPA’s BASINS modeling system. This report provides supporting documentation and user support materials for the BASINS CAT tool. The purpose of this report is to provide in a single document a variety of documentation and user support materials supporting the use

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

The nematode Caenorhabditis elegans as an integrated toxicological tool to assess water quality and pollution.

PubMed

Clavijo, Araceli; Kronberg, María Florencia; Rossen, Ariana; Moya, Aldana; Calvo, Daniel; Salatino, Santa Esmeralda; Pagano, Eduardo Antonio; Morábito, José Antonio; Munarriz, Eliana Rosa

2016-11-01

Determination of water quality status in rivers is critical to establish a sustainable water management policy. For this reason, over the last decades it has been recommended to perform integrated water assessments that include water quantities and physicochemical, ecological and toxicological tests. However, sometimes resources are limited and it is not possible to perform large-scale chemical determinations of pollutants or conduct numerous ecotoxicological tests. To overcome this problem we use and measure the growth, as a response parameter, of the soil nematode Caenorhabditis elegans to assess water quality in rivers. The C. elegans is a ubiquitous organism that has emerged as an important model organism in aquatic and soil toxicology research. The Tunuyán River Basin (Province of Mendoza, Argentina) has been selected as a representative traditional water monitoring system to test the applicability of the C. elegans toxicological bioassay to generate an integrated water quality evaluation. Jointly with the C. elegans toxic assays, physicochemical and bacteriological parameters were determined for each monitoring site. C. elegans bioassays help to identify different water qualities in the river basin. Multivariate statistical analysis (PCA and linear regression models) has allowed us to confirm that traditional water quality studies do not predict potential toxic effects on living organisms. On the contrary, physicochemical and bacteriological analyzes explain <62% of the C. elegans growth response variability, showing that ecotoxicological bioassays are important to obtain a realistic scenario of water quality threats. Our results confirm that the C. elegans bioassay is a sensible and suitable tool to assess toxicity and should be implemented in routine water quality monitoring. Copyright © 2016 Elsevier B.V. All rights reserved.

Intelligent Monitoring? Assessing the ability of the Care Quality Commission's statistical surveillance tool to predict quality and prioritise NHS hospital inspections.

PubMed

Griffiths, Alex; Beaussier, Anne-Laure; Demeritt, David; Rothstein, Henry

2017-02-01

The Care Quality Commission (CQC) is responsible for ensuring the quality of the health and social care delivered by more than 30 000 registered providers in England. With only limited resources for conducting on-site inspections, the CQC has used statistical surveillance tools to help it identify which providers it should prioritise for inspection. In the face of planned funding cuts, the CQC plans to put more reliance on statistical surveillance tools to assess risks to quality and prioritise inspections accordingly. To evaluate the ability of the CQC's latest surveillance tool, Intelligent Monitoring (IM), to predict the quality of care provided by National Health Service (NHS) hospital trusts so that those at greatest risk of providing poor-quality care can be identified and targeted for inspection. The predictive ability of the IM tool is evaluated through regression analyses and χ 2 testing of the relationship between the quantitative risk score generated by the IM tool and the subsequent quality rating awarded following detailed on-site inspection by large expert teams of inspectors. First, the continuous risk scores generated by the CQC's IM statistical surveillance tool cannot predict inspection-based quality ratings of NHS hospital trusts (OR 0.38 (0.14 to 1.05) for Outstanding/Good, OR 0.94 (0.80 to -1.10) for Good/Requires improvement, and OR 0.90 (0.76 to 1.07) for Requires improvement/Inadequate). Second, the risk scores cannot be used more simply to distinguish the trusts performing poorly-those subsequently rated either 'Requires improvement' or 'Inadequate'-from the trusts performing well-those subsequently rated either 'Good' or 'Outstanding' (OR 1.07 (0.91 to 1.26)). Classifying CQC's risk bandings 1-3 as high risk and 4-6 as low risk, 11 of the high risk trusts were performing well and 43 of the low risk trusts were performing poorly, resulting in an overall accuracy rate of 47.6%. Third, the risk scores cannot be used even more simply to

AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Hamel, Candyce; Wells, George A; Bouter, Lex M; Kristjansson, Elizabeth; Grimshaw, Jeremy; Henry, David A; Boers, Maarten

2009-10-01

Our purpose was to measure the agreement, reliability, construct validity, and feasibility of a measurement tool to assess systematic reviews (AMSTAR). We randomly selected 30 systematic reviews from a database. Each was assessed by two reviewers using: (1) the enhanced quality assessment questionnaire (Overview of Quality Assessment Questionnaire [OQAQ]); (2) Sacks' instrument; and (3) our newly developed measurement tool (AMSTAR). We report on reliability (interobserver kappas of the 11 AMSTAR items), intraclass correlation coefficients (ICCs) of the sum scores, construct validity (ICCs of the sum scores of AMSTAR compared with those of other instruments), and completion times. The interrater agreement of the individual items of AMSTAR was substantial with a mean kappa of 0.70 (95% confidence interval [CI]: 0.57, 0.83) (range: 0.38-1.0). Kappas recorded for the other instruments were 0.63 (95% CI: 0.38, 0.78) for enhanced OQAQ and 0.40 (95% CI: 0.29, 0.50) for the Sacks' instrument. The ICC of the total score for AMSTAR was 0.84 (95% CI: 0.65, 0.92) compared with 0.91 (95% CI: 0.82, 0.96) for OQAQ and 0.86 (95% CI: 0.71, 0.94) for the Sacks' instrument. AMSTAR proved easy to apply, each review taking about 15 minutes to complete. AMSTAR has good agreement, reliability, construct validity, and feasibility. These findings need confirmation by a broader range of assessors and a more diverse range of reviews.

LANDSCAPE ASSESSMENT TOOLS FOR WATERSHED CHARACTERIZATION

EPA Science Inventory

A combination of process-based, empirical and statistical models has been developed to assist states in their efforts to assess water quality, locate impairments over large areas, and calculate TMDL allocations. By synthesizing outputs from a number of these tools, LIPS demonstr...

The development of a quality appraisal tool for studies of diagnostic reliability (QAREL).

PubMed

Lucas, Nicholas P; Macaskill, Petra; Irwig, Les; Bogduk, Nikolai

2010-08-01

In systematic reviews of the reliability of diagnostic tests, no quality assessment tool has been used consistently. The aim of this study was to develop a specific quality appraisal tool for studies of diagnostic reliability. Key principles for the quality of studies of diagnostic reliability were identified with reference to epidemiologic principles, existing quality appraisal checklists, and the Standards for Reporting of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) resources. Specific items that encompassed each of the principles were developed. Experts in diagnostic research provided feedback on the items that were to form the appraisal tool. This process was iterative and continued until consensus among experts was reached. The Quality Appraisal of Reliability Studies (QAREL) checklist includes 11 items that explore seven principles. Items cover the spectrum of subjects, spectrum of examiners, examiner blinding, order effects of examination, suitability of the time interval among repeated measurements, appropriate test application and interpretation, and appropriate statistical analysis. QAREL has been developed as a specific quality appraisal tool for studies of diagnostic reliability. The reliability of this tool in different contexts needs to be evaluated. Copyright (c) 2010 Elsevier Inc. All rights reserved.

Quality of care assessment in geriatric evaluation and management units: construction of a chart review tool for a tracer condition.

PubMed

Kergoat, Marie-Jeanne; Leclerc, Bernard-Simon; Leduc, Nicole; Latour, Judith; Berg, Katherine; Bolduc, Aline

2009-07-29

The number of elderly people requiring hospital care is growing, so, quality and assessment of care for elders are emerging and complex areas of research. Very few validated and reliable instruments exist for the assessment of quality of acute care in this field. This study's objective was to create such a tool for Geriatric Evaluation and Management Units (GEMUs). The methodology involved a reliability and feasibility study of a retrospective chart review on 934 older inpatients admitted in 49 GEMUs during the year 2002-2003 for fall-related trauma as a tracer condition. Pertinent indicators for a chart abstraction tool, the Geriatric Care Tool (GCT), were developed and validated according to five dimensions: access to care, comprehensiveness, continuity of care, patient-centred care and appropriateness. Consensus methods were used to develop the content. Participants were experts representing eight main health care professions involved in GEMUs from 19 different sites. Items associated with high quality of care at each step of the multidisciplinary management of patients admitted due to falls were identified. The GCT was tested for intra- and inter-rater reliability using 30 medical charts reviewed by each of three independent and blinded trained nurses. Kappa and agreement measures between pairs of chart reviewers were computed on an item-by-item basis. Three quarters of 169 items identifying the process of care, from the case history to discharge planning, demonstrated good agreement (kappa greater than 0.40 and agreement over 70%). Indicators for the appropriateness of care showed less reliability. Content validity and reliability results, as well as the feasibility of the process, suggest that the chart abstraction tool can gather standardized and pertinent clinical information for further evaluating quality of care in GEMU using admission due to falls as a tracer condition. However, the GCT should be evaluated in other models of acute geriatric units and new

A patient self-assessment tool for cardiac rehabilitation.

PubMed

Phelan, C; Finnell, M D; Mottla, K A

1989-01-01

A patient self-assessment tool was designed, tested, and implemented to promote cardiac-specific data collection, based on Gordon's Functional Health Patterns, to maximize patient/family involvement in determining a plan of care, and to streamline primary nurses' documentation requirements. Retrospective and concurrent chart reviews provided data for quality assurance monitoring. The results of the monitoring demonstrated that the self-assessment tool markedly improved the patient-specific data base.

The live donor assessment tool: a psychosocial assessment tool for live organ donors.

PubMed

Iacoviello, Brian M; Shenoy, Akhil; Braoude, Jenna; Jennings, Tiane; Vaidya, Swapna; Brouwer, Julianna; Haydel, Brandy; Arroyo, Hansel; Thakur, Devendra; Leinwand, Joseph; Rudow, Dianne LaPointe

2015-01-01

Psychosocial evaluation is an important part of the live organ donor evaluation process, yet it is not standardized across institutions, and although tools exist for the psychosocial evaluation of organ recipients, none exist to assess donors. We set out to develop a semistructured psychosocial evaluation tool (the Live Donor Assessment Tool, LDAT) to assess potential live organ donors and to conduct preliminary analyses of the tool's reliability and validity. Review of the literature on the psychosocial variables associated with treatment adherence, quality of life, live organ donation outcome, and resilience, as well as review of the procedures for psychosocial evaluation at our center and other centers around the country, identified 9 domains to address; these domains were distilled into several items each, in collaboration with colleagues at transplant centers across the country, for a total of 29 items. Four raters were trained to use the LDAT, and they retrospectively scored 99 psychosocial evaluations conducted on live organ donor candidates. Reliability of the LDAT was assessed by calculating the internal consistency of the items in the scale and interrater reliability between raters; validity was estimated by comparing LDAT scores between those with a "positive" evaluation outcome and "negative" outcome. The LDAT was found to have good internal consistency, inter-rater reliability, and showed signs of validity: LDAT scores differentiated the positive vs. negative outcome groups. The LDAT demonstrated good reliability and validity, but future research on the LDAT and the ability to implement the LDAT prospectively is warranted. Copyright © 2015 The Academy of Psychosomatic Medicine. Published by Elsevier Inc. All rights reserved.

Assessing Quality in Home Visiting Programs

ERIC Educational Resources Information Center

Korfmacher, Jon; Laszewski, Audrey; Sparr, Mariel; Hammel, Jennifer

2013-01-01

Defining quality and designing a quality assessment measure for home visitation programs is a complex and multifaceted undertaking. This article summarizes the process used to create the Home Visitation Program Quality Rating Tool (HVPQRT) and identifies next steps for its development. The HVPQRT measures both structural and dynamic features of…

Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools

PubMed Central

Jensen-Doss, Amanda; Hawley, Kristin M.

2010-01-01

In an era of evidence-based practice, why are clinicians not typically engaged in evidence-based assessment? To begin to understand this issue, a national multidisciplinary survey was conducted to examine clinician attitudes toward standardized assessment tools. 1442 child clinicians provided opinions about the psychometric qualities of these tools, their benefit over clinical judgment alone, and their practicality. Doctoral-level clinicians and psychologists expressed more positive ratings in all three domains than master’s-level clinicians and non-psychologists respectively, although only the disciplinary differences remained significant when predictors were examined simultaneously. All three attitude scales were predictive of standardized assessment tool use, although practical concerns were the strongest and only independent predictor of use. PMID:21058134

Assessing Assessment Quality: Criteria for Quality Assurance in Design of (Peer) Assessment for Learning--A Review of Research Studies

ERIC Educational Resources Information Center

Tillema, Harm; Leenknecht, Martijn; Segers, Mien

2011-01-01

The interest in "assessment for learning" (AfL) has resulted in a search for new modes of assessment that are better aligned to students' learning how to learn. However, with the introduction of new assessment tools, also questions arose with respect to the quality of its measurement. On the one hand, the appropriateness of traditional,…

Tools used for evaluation of Brazilian children's quality of life

PubMed Central

Souza, João Gabriel S.; Pamponet, Marcela Antunes; Souza, Tamirys Caroline S.; Pereira, Alessandra Ribeiro; Souza, Andrey George S.; Martins, Andréa Maria E. de B. L.

2014-01-01

OBJECTIVE: To review the available tools to evaluate children's quality of life validated for Brazilian language and culture. DATA SOURCES: Search of scientific articles in Medline, Lilacs and SciELO databases using the combination of descriptors "quality of life", "child" and "questionnaires" in Portuguese and English. DATA SYNTHESIS: Among the tools designed to assess children's quality of life validated for the Brazilian language and culture, the Auto questionnaire Qualité de Vie Enfant Imagé (AUQEI), the Child Health Questionnaire - Parent Form 50 (CHQ-PF50), the Pediatric Quality of Life Inventory (PedsQL(tm)) version 4.0 and the Kidscreen-52 are highlighted. Some tools do not include all range of ages and some lack domains that are currently considered relevant in the context of childhood, such as bullying. Moreover, due to the cultural diversity of Brazil, it may be necessary to adapt some instruments or to validate other tools. CONCLUSIONS: There are validated instruments to evaluate children's quality of life in Brazil. However, the validation or the adaptation of other international tools have to be considered in order to overcome current deficiencies. PMID:25119761

Number of genera as a potential screening tool for assessing quality of bryophyte communities in Ohio wetlands

USGS Publications Warehouse

Schumacher, William; Stapanian, Martin A.; Andreas, Barbara; Gara, Brian

2016-01-01

Bryophytes (mosses, liverworts, and hornworts) have numerous advantages as indicators of environmental quality. A quality assessment index for bryophyte species assemblages (BQAI) was developed for the State of Ohio, USA. Reliable identification of bryophytes to species often requires considerable training, practice, and time. In contrast, reliable identification to genera for most bryophytes in Ohio requires much less training. We identified 110 bryophyte species (14 liverworts and 96 mosses) belonging to 69 genera (13 liverwort and 56 moss) in 45 wetlands (27 emergent, 13 forested, and 5 shrub) in Ohio. As expected, there were more genera and higher BQAI scores in forested than in emergent wetlands. Number of genera was highly correlated (r ≥ 0.9) with BQAI in emergent and forested wetlands and for the combined set of wetlands. Number of genera and BQAI responded almost identically to an index of wetland disturbance. The results suggest that number of genera has potential as a screening tool for assessing bryophyte community quality in wetlands in some regions.

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools.

PubMed

Lichtner, Valentina; Dowding, Dawn; Esterhuizen, Philip; Closs, S José; Long, Andrew F; Corbett, Anne; Briggs, Michelle

2014-12-17

There is evidence of under-detection and poor management of pain in patients with dementia, in both long-term and acute care. Accurate assessment of pain in people with dementia is challenging and pain assessment tools have received considerable attention over the years, with an increasing number of tools made available. Systematic reviews on the evidence of their validity and utility mostly compare different sets of tools. This review of systematic reviews analyses and summarises evidence concerning the psychometric properties and clinical utility of pain assessment tools in adults with dementia or cognitive impairment. We searched for systematic reviews of pain assessment tools providing evidence of reliability, validity and clinical utility. Two reviewers independently assessed each review and extracted data from them, with a third reviewer mediating when consensus was not reached. Analysis of the data was carried out collaboratively. The reviews were synthesised using a narrative synthesis approach. We retrieved 441 potentially eligible reviews, 23 met the criteria for inclusion and 8 provided data for extraction. Each review evaluated between 8 and 13 tools, in aggregate providing evidence on a total of 28 tools. The quality of the reviews varied and the reporting often lacked sufficient methodological detail for quality assessment. The 28 tools appear to have been studied in a variety of settings and with varied types of patients. The reviews identified several methodological limitations across the original studies. The lack of a 'gold standard' significantly hinders the evaluation of tools' validity. Most importantly, the samples were small providing limited evidence for use of any of the tools across settings or populations. There are a considerable number of pain assessment tools available for use with the elderly cognitive impaired population. However there is limited evidence about their reliability, validity and clinical utility. On the basis of this

HEPS Inventory Tool: An Inventory Tool Including Quality Assessment of School Interventions on Healthy Eating and Physical Activity

ERIC Educational Resources Information Center

Dadaczynski, Kevin; Paulus, Peter; de Vries, Nanne; de Ruiter, Silvia; Buijs, Goof

2010-01-01

The HEPS Inventory Tool aims to support stakeholders working in school health promotion to promote high quality interventions on healthy eating and physical activity. As a tool it provides a step-by-step approach on how to develop a national or regional inventory of existing school based interventions on healthy eating and physical activity. It…

Introduction of the identification, situation, background, assessment, recommendations tool to improve the quality of information transfer during medical handover in intensive care.

PubMed

Ramasubbu, Benjamin; Stewart, Emma; Spiritoso, Rosalba

2017-02-01

To audit the quality and safety of the current doctor-to-doctor handover of patient information in our Cardiothoracic Intensive Care Unit. If deficient, to implement a validated handover tool to improve the quality of the handover process. In Cycle 1 we observed the verbal handover and reviewed the written handover information transferred for 50 consecutive patients in St George's Hospital Cardiothoracic Intensive Care Unit. For each patient's handover, we assessed whether each section of the Identification, Situation, Background, Assessment, Recommendations tool was used on a scale of 0-2. Zero if no information in that category was transferred, one if the information was partially transferred and two if all relevant information was transferred. Each patient's handover received a score from 0 to 10 and thus, each cycle a total score of 0-500. Following the implementation of the Identification, Situation, Background, Assessment, Recommendations handover tool in our Intensive Care Unit in Cycle 2, we re-observed the handover process for another 50 consecutive patients hence, completing the audit cycle. There was a significant difference between the total scores from Cycle 1 and 2 (263/500 versus 457/500, p < 0.001). The median handover score for Cycle 1 was 5/10 (interquartile range 4-6). The median handover score for Cycle 2 was 9/10 (interquartile range 9-10). Patient handover scores increased significantly between Cycle 1 and 2, U = 13.5, p < 0.001. The introduction of a standardised handover template (Identification, Situation, Background, Assessment, Recommendations tool) has improved the quality and safety of the doctor-to-doctor handover of patient information in our Intensive Care Unit.

The development and validation of a meta-tool for quality appraisal of public health evidence: Meta Quality Appraisal Tool (MetaQAT).

PubMed

Rosella, L; Bowman, C; Pach, B; Morgan, S; Fitzpatrick, T; Goel, V

2016-07-01

Most quality appraisal tools were developed for clinical medicine and tend to be study-specific with a strong emphasis on risk of bias. In order to be more relevant to public health, an appropriate quality appraisal tool needs to be less reliant on the evidence hierarchy and consider practice applicability. Given the broad range of study designs used in public health, the objective of this study was to develop and validate a meta-tool that combines public health-focused principles of appraisal coupled with a set of design-specific companion tools. Several design methods were used to develop and validate the tool including literature review, synthesis, and validation with a reference standard. A search of critical appraisal tools relevant to public health was conducted; core concepts were collated. The resulting framework was piloted during three feedback sessions with public health practitioners. Following subsequent revisions, the final meta-tool, the Meta Quality Appraisal Tool (MetaQAT), was then validated through a content analysis of appraisals conducted by two groups of experienced public health researchers (MetaQAT vs generic appraisal form). The MetaQAT framework consists of four domains: relevancy, reliability, validity, and applicability. In addition, a companion tool was assembled from existing critical appraisal tools to provide study design-specific guidance on validity appraisal. Content analysis showed similar methodological and generalizability concerns were raised by both groups; however, the MetaQAT appraisers commented more extensively on applicability to public health practice. Critical appraisal tools designed for clinical medicine have limitations for use in the context of public health. The meta-tool structure of the MetaQAT allows for rigorous appraisal, while allowing users to simultaneously appraise the multitude of study designs relevant to public health research and assess non-standard domains, such as applicability. Copyright © 2015

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Development and Validation of a Cross-Country Hospital Patient Quality of Care Assessment Tool in Europe.

PubMed

Villiers-Tuthill, Amanda; Doulougeri, Karolina; McGee, Hannah; Montgomery, Anthony; Panagopoulou, Efharis; Morgan, Karen

2017-12-01

Patient perceptions of quality of care (QoC) are directly linked with patient safety and clinical effectiveness. We need patient-designed QoC instruments that work across languages and countries to optimise studies across systems in this area. Few QoC measurement tools exist that assess all aspects of QoC from the patient perspective. This paper describes the development and validation of a comprehensive measure to assess patient perceptions of QoC that incorporates technical and interpersonal aspects of care and is grounded in the established Institute of Medicine (IOM) QoC framework. We conducted a multi-country cross-sectional study. Following a literature review and patient focus groups, an expert panel generated questionnaire items. Following a pilot study, item numbers were reduced. The final questionnaire consisted of three sections: demographics, perceived QoC and one open-ended question. Data was collected from patients (n = 531) discharged from hospitals across seven countries in South East Europe (languages: Turkish, Greek, Portuguese, Romanian, Croatian, Macedonian and Bulgarian). Reliability and validity of the measure were assessed. Confirmatory factor analysis was used to compare various factor models of patient-perceived QoC. Good model fit was demonstrated for a two-factor model: communication and interpersonal care, and hospital facilities. The ORCAB (Improving quality and safety in the hospital: The link between organisational culture, burnout and quality of care) Patient QoC questionnaire has been collaboratively and exhaustively developed between healthcare professionals and patients. It enables patient QoC data to be assessed in the context of the IOM pillars of quality, considering both technical and interpersonal dimensions of care. It represents an important first step in including the patient perspective.

Operational CryoSat Product Quality Assessment

NASA Astrophysics Data System (ADS)

Mannan, Rubinder; Webb, Erica; Hall, Amanda; Bouzinac, Catherine

2013-12-01

The performance and quality of the CryoSat data products are routinely assessed by the Instrument Data quality Evaluation and Analysis Service (IDEAS). This information is then conveyed to the scientific and user community in order to allow them to utilise CryoSat data with confidence. This paper presents details of the Quality Control (QC) activities performed for CryoSat products under the IDEAS contract. Details of the different QC procedures and tools deployed by IDEAS to assess the quality of operational data are presented. The latest updates to the Instrument Processing Facility (IPF) for the Fast Delivery Marine (FDM) products and the future update to Baseline-C are discussed.

Soil bioassays as tools for sludge compost quality assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Domene, Xavier, E-mail: x.domene@creaf.uab.es; Sola, Laura; Ramirez, Wilson

2011-03-15

Composting is a waste management technology that is becoming more widespread as a response to the increasing production of sewage sludge and the pressure for its reuse in soil. In this study, different bioassays (plant germination, earthworm survival, biomass and reproduction, and collembolan survival and reproduction) were assessed for their usefulness in the compost quality assessment. Compost samples, from two different composting plants, were taken along the composting process, which were characterized and submitted to bioassays (plant germination and collembolan and earthworm performance). Results from our study indicate that the noxious effects of some of the compost samples observed inmore » bioassays are related to the low organic matter stability of composts and the enhanced release of decomposition endproducts, with the exception of earthworms, which are favored. Plant germination and collembolan reproduction inhibition was generally associated with uncomposted sludge, while earthworm total biomass and reproduction were enhanced by these materials. On the other hand, earthworm and collembolan survival were unaffected by the degree of composting of the wastes. However, this pattern was clear in one of the composting procedures assessed, but less in the other, where the release of decomposition endproducts was lower due to its higher stability, indicating the sensitivity and usefulness of bioassays for the quality assessment of composts.« less

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

Qualichem In Vivo: A Tool for Assessing the Quality of In Vivo Studies and Its Application for Bisphenol A

PubMed Central

Maxim, Laura; van der Sluijs, Jeroen P.

2014-01-01

In regulatory toxicology, quality assessment of in vivo studies is a critical step for assessing chemical risks. It is crucial for preserving public health studies that are considered suitable for regulating chemicals are robust. Current procedures for conducting quality assessments in safety agencies are not structured, clear or consistent. This leaves room for criticism about lack of transparency, subjective influence and the potential for insufficient protection provided by resulting safety standards. We propose a tool called “Qualichem in vivo” that is designed to systematically and transparently assess the quality of in vivo studies used in chemical health risk assessment. We demonstrate its use here with 12 experts, using two controversial studies on Bisphenol A (BPA) that played an important role in BPA regulation in Europe. The results obtained with Qualichem contradict the quality assessments conducted by expert committees in safety agencies for both of these studies. Furthermore, they show that reliance on standardized guidelines to ensure scientific quality is only partially justified. Qualichem allows experts with different disciplinary backgrounds and professional experiences to express their individual and sometimes divergent views—an improvement over the current way of dealing with minority opinions. It provides a transparent framework for expressing an aggregated, multi-expert level of confidence in a study, and allows a simple graphical representation of how well the study integrates the best available scientific knowledge. Qualichem can be used to compare assessments of the same study by different health agencies, increasing transparency and trust in the work of expert committees. In addition, it may be used in systematic evaluation of in vivo studies submitted by industry in the dossiers that are required for compliance with the REACH Regulation. Qualichem provides a balanced, common framework for assessing the quality of studies that may

Systematic Omics Analysis Review (SOAR) Tool to Support Risk Assessment

PubMed Central

McConnell, Emma R.; Bell, Shannon M.; Cote, Ila; Wang, Rong-Lin; Perkins, Edward J.; Garcia-Reyero, Natàlia; Gong, Ping; Burgoon, Lyle D.

2014-01-01

Environmental health risk assessors are challenged to understand and incorporate new data streams as the field of toxicology continues to adopt new molecular and systems biology technologies. Systematic screening reviews can help risk assessors and assessment teams determine which studies to consider for inclusion in a human health assessment. A tool for systematic reviews should be standardized and transparent in order to consistently determine which studies meet minimum quality criteria prior to performing in-depth analyses of the data. The Systematic Omics Analysis Review (SOAR) tool is focused on assisting risk assessment support teams in performing systematic reviews of transcriptomic studies. SOAR is a spreadsheet tool of 35 objective questions developed by domain experts, focused on transcriptomic microarray studies, and including four main topics: test system, test substance, experimental design, and microarray data. The tool will be used as a guide to identify studies that meet basic published quality criteria, such as those defined by the Minimum Information About a Microarray Experiment standard and the Toxicological Data Reliability Assessment Tool. Seven scientists were recruited to test the tool by using it to independently rate 15 published manuscripts that study chemical exposures with microarrays. Using their feedback, questions were weighted based on importance of the information and a suitability cutoff was set for each of the four topic sections. The final validation resulted in 100% agreement between the users on four separate manuscripts, showing that the SOAR tool may be used to facilitate the standardized and transparent screening of microarray literature for environmental human health risk assessment. PMID:25531884

Quality of health care and the need for assessment.

PubMed

Bosse, G; Ngoli, B; Leshabari, M T; Külker, R; Dämmrich, T; Abels, W; Breuer, J P; Kersten, R; Spies, C

2011-09-01

In many hospitals of developing countries quality of care is below the expected standard to maintain patient safety. In 2006, health care experts from Tanzania and Germany collaborated on a set of indicators to be used as a hospital performance assessment tool. The aim of this study was to introduce this tool and check its feasibility for use in a Tanzanian regional hospital. Within the hospital, independent observers assessed quantitatively structural quality and the performance of health care encounter using an itemized scale from 0 (0%) to 2 (100%) for each defined item. Outcome parameters were taken from the annual hospital report. In addition, semi-qualitative interviews with staff and patients were held to a) assess staff knowledge of the treatment guidelines published by the Tanzanian Ministry of Health and Social Welfare (MoHSW), b) assess attitudes and user motivation and c) authenticate the quantitative findings in a mixed-method triangulation approach. Structural quality in maternity was at 75% of the expected standard, while process quality ranged from 36% (Care of the newborn with APGAR score < 4) to 47% (normal delivery procedure). Staff knowledge ranged between 64% and 87% with low motivation and commitment given as contributing factors. Outcome (maternal mortality) was 481/100,000 live births with an infant mortality rate of 10%. The tool appeared to be feasible and effective in judging care quality. It provides a model for continuous quality improvement. Motivation of health care workers, a strong determinant of care process quality, might be improved by strengthening internal factors in health facilities. For conclusive validation, further studies using the tool must be conducted with larger numbers of institutions.

The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource

Indoor Air Quality Building Education and Assessment Model

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM), released in 2002, is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Patient simulation: a literary synthesis of assessment tools in anesthesiology.

PubMed

Edler, Alice A; Fanning, Ruth G; Chen, Michael I; Claure, Rebecca; Almazan, Dondee; Struyk, Brain; Seiden, Samuel C

2009-12-20

High-fidelity patient simulation (HFPS) has been hypothesized as a modality for assessing competency of knowledge and skill in patient simulation, but uniform methods for HFPS performance assessment (PA) have not yet been completely achieved. Anesthesiology as a field founded the HFPS discipline and also leads in its PA. This project reviews the types, quality, and designated purpose of HFPS PA tools in anesthesiology. We used the systematic review method and systematically reviewed anesthesiology literature referenced in PubMed to assess the quality and reliability of available PA tools in HFPS. Of 412 articles identified, 50 met our inclusion criteria. Seventy seven percent of studies have been published since 2000; more recent studies demonstrated higher quality. Investigators reported a variety of test construction and validation methods. The most commonly reported test construction methods included "modified Delphi Techniques" for item selection, reliability measurement using inter-rater agreement, and intra-class correlations between test items or subtests. Modern test theory, in particular generalizability theory, was used in nine (18%) of studies. Test score validity has been addressed in multiple investigations and shown a significant improvement in reporting accuracy. However the assessment of predicative has been low across the majority of studies. Usability and practicality of testing occasions and tools was only anecdotally reported. To more completely comply with the gold standards for PA design, both shared experience of experts and recognition of test construction standards, including reliability and validity measurements, instrument piloting, rater training, and explicit identification of the purpose and proposed use of the assessment tool, are required.

Improving the Quality of Assessment Grading Tools in Master of Education Courses: A Comparative Case Study in the Scholarship of Teaching and Learning

ERIC Educational Resources Information Center

Christie, Michael; Grainger, Peter; Dahlgren, Robert; Call, Kairen; Heck, Deborah; Simon, Susan

2015-01-01

This study compares the use and efficacy of assessment grading tools within postgraduate education courses in a regional Australian university and a regional university in the US. Specifically, we investigate how the quality of postgraduate education courses can be improved through the use of assessment rubrics or criterion referenced assessment…

Quality of life tools in head and neck oncology.

PubMed

Heutte, N; Plisson, L; Lange, M; Prevost, V; Babin, E

2014-02-01

Quality of life (QoL) is now as much an assessment criterion in clinical trials in head and neck oncology as are survival and response rate. It is therefore important to be able to choose an adapted tool from the wide range of QoL instruments available. The present study presents an inventory of QoL scales validated in their French-language version, to facilitate the selection of appropriate tools showing good psychometric properties. QoL scales cited in all 492 French and English language articles published between March 1st, 2006 and April 3rd, 2012, referenced on Medline and retrieved using the keywords "quality of life" AND "head and neck" AND "cancer", were inventoried and classified thematically in a search of the literature. Ninety QoL scales are presented by theme (ORL oncology, voice, swallowing and mastication, mucosities and xerostomia, etc.), specifying psychometric quality and citation level. The present report constitutes a guide to selecting QoL tools adapted to head and neck oncology studies. Copyright © 2013 Elsevier Masson SAS. All rights reserved.

The development of a tool for assessing the quality of closed circuit camera footage for use in forensic gait analysis.

PubMed

Birch, Ivan; Vernon, Wesley; Walker, Jeremy; Saxelby, Jai

2013-10-01

Gait analysis from closed circuit camera footage is now commonly used as evidence in criminal trials. The biomechanical analysis of human gait is a well established science in both clinical and laboratory settings. However, closed circuit camera footage is rarely of the quality of that taken in the more controlled clinical and laboratory environments. The less than ideal quality of much of this footage for use in gait analysis is associated with a range of issues, the combination of which can often render the footage unsuitable for use in gait analysis. The aim of this piece of work was to develop a tool for assessing the suitability of closed circuit camera footage for the purpose of forensic gait analysis. A Delphi technique was employed with a small sample of expert forensic gait analysis practitioners, to identify key quality elements of CCTV footage used in legal proceedings. Five elements of the footage were identified and then subdivided into 15 contributing sub-elements, each of which was scored using a 5-point Likert scale. A Microsoft Excel worksheet was developed to calculate automatically an overall score from the fifteen sub-element scores. Five expert witnesses experienced in using CCTV footage for gait analysis then trialled the prototype tool on current case footage. A repeatability study was also undertaken using standardized CCTV footage. The results showed the tool to be a simple and repeatable means of assessing the suitability of closed circuit camera footage for use in forensic gait analysis. The inappropriate use of poor quality footage could lead to challenges to the practice of forensic gait analysis. All parties involved in criminal proceedings must therefore understand the fitness for purpose of any footage used. The development of this tool could offer a method of achieving this goal, and help to assure the continued role of forensic gait analysis as an aid to the identification process. Copyright © 2013 Elsevier Ltd and Faculty of

Comparing Quality of Public Primary Care between Hong Kong and Shanghai Using Validated Patient Assessment Tools

PubMed Central

Wei, Xiaolin; Li, Haitao; Yang, Nan; Wong, Samuel Y. S.; Owolabi, Onikepe; Xu, Jianguang; Shi, Leiyu; Tang, Jinling; Li, Donald; Griffiths, Sian M.

2015-01-01

Objectives Primary care is the key element of health reform in China. The objective of this study was to compare patient assessed quality of public primary care between Hong Kong, a city with established primary care environment influenced by its colonial history, and Shanghai, a city leading primary care reform in Mainland China; and to measure the equity of care in the two cities. Methods Cross sectional stratified random sampling surveys were conducted in 2011. Data were collected from 1,994 respondents in Hong Kong and 811 respondents in Shanghai. A validated Chinese version of the primary care assessment tool was employed to assess perceived quality of primary care with respect to socioeconomic characteristics and health status. Results We analyzed 391 and 725 respondents in Hong Kong and Shanghai, respectively, who were regular public primary care users. Respondents in Hong Kong reported significant lower scores in first contact accessibility (1.59 vs. 2.15), continuity of care (2.33 vs. 3.10), coordination of information (2.84 vs. 3.64), comprehensiveness service availability (2.43 vs. 3.31), comprehensiveness service provided (2.11 vs. 2.40), and the total score (23.40 vs. 27.40), but higher scores in first contact utilization (3.15 vs. 2.54) and coordination of services (2.67 vs. 2.40) when compared with those in Shanghai. Respondents with higher income reported a significantly higher total primary care score in Hong Kong, but not in Shanghai. Conclusions Respondents in Shanghai reported better quality of public primary care than those in Hong Kong, while quality of public primary care tended to be more equitable in Shanghai. PMID:25826616

The adenosine triphosphate method as a quality control tool to assess 'cleanliness' of frequently touched hospital surfaces.

PubMed

Knape, L; Hambraeus, A; Lytsy, B

2015-10-01

The adenosine triphosphate (ATP) method is widely accepted as a quality control method to complement visual assessment, in the specifications of requirements, when purchasing cleaning contractors in Swedish hospitals. To examine whether the amount of biological load, as measured by ATP on frequently touched near-patient surfaces, had been reduced after an intervention; to evaluate the correlation between visual assessment and ATP levels on the same surfaces; to identify aspects of the performance of the ATP method as a tool in evaluating hospital cleanliness. A prospective intervention study in three phases was carried out in a medical ward and an intensive care unit (ICU) at a regional hospital in mid-Sweden between 2012 and 2013. Existing cleaning procedures were defined and baseline tests were sampled by visual inspection and ATP measurements of ten frequently touched surfaces in patients' rooms before and after intervention. The intervention consisted of educating nursing staff about the importance of hospital cleaning and direct feedback of ATP levels before and after cleaning. The mixed model showed a significant decrease in ATP levels after the intervention (P < 0.001). Relative light unit values were lower in the ICU. Cleanliness as judged by visual assessments improved. In the logistic regression analysis, there was a significant association between visual assessments and ATP levels. Direct feedback of ATP levels, together with education and introduction of written cleaning protocols, were effective tools to improve cleanliness. Visual assessment correlated with the level of ATP but the correlation was not absolute. The ATP method could serve as an educational tool for staff, but is not enough to assess hospital cleanliness in general as only a limited part of a large area is covered. Copyright © 2015 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

Indoor Air Quality Building Education and Assessment Model Forms

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM) is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process

PubMed Central

2011-01-01

Background There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. Methods A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. Results In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. Conclusion

Quality Management and Self Assessment Tools for Public Libraries.

ERIC Educational Resources Information Center

Evans, Margaret Kinnell

This paper describes a two-year study by the British Library Research and Innovation Centre that examined the potential of self-assessment for public library services. The approaches that formed the basis for the investigation were the Business Excellence Model, the Quality Framework, and the Democratic Approach. Core values were identified by…

Evaluation of the Missoula-VITAS Quality of Life Index--revised: research tool or clinical tool?

PubMed

Schwartz, Carolyn E; Merriman, Melanie P; Reed, George; Byock, Ira

2005-02-01

Quality of life (QOL) is a central outcome measure in caring for seriously ill patients. The Missoula-VITAS Quality of Life Index (MVQOLI) is a 25-item patient-centered index that weights each of five QOL dimensions (symptoms, function, interpersonal, wellbeing, transcendence) by its importance to the respondent. The measure has been used to assess QOL for hospice patients, and has been found to be somewhat complex to use and analyze. This study aimed to simplify the measure, and evaluate the reliability and validity of a revised version as either a research or clinical tool (i.e., "psychometric" versus "clinimetric"). Two data collection efforts are described. The psychometric study collected QOL data from 175 patients at baseline, 3-5 days, and 21 days later. The implementation study evaluated the feasibility and utility of the MVQOLI-R during over six weeks of use. End-stage renal patients on dialysis, hospice, or long-term care patients participated in the psychometric study. The implementation study was done in hospice, home health, and palliative care settings. The MVQOLI-R and the Memorial Symptom Assessment Scale. The psychometric and implementation studies suggest that the MVQOLI-R performs well as a clinical tool but is not powerful as an outcome research instrument. The MVQOLI-R has the heterogeneous structure of clinimetric tools, and demonstrated both relevance and responsiveness. Additionally, in a clinical setting the MVQOLI-R was useful therapeutically for stimulating communication about the psychosocial and spiritual issues important to the tasks of life completion and life closure. The MVQOLI-R has clinical utility as a patient QOL assessment tool and may have therapeutic utility as a tool for fostering discussion among patients and their clinicians, as well as for helping patients identify sources of suffering and opportunities during this time in their lives.

Use of Standardized Assessment Tools to Improve the Effectiveness of Palliative Care Rounds: A Quality Improvement Initiative.

PubMed

Spaner, Donna; Caraiscos, Valerie B; Muystra, Christina; Furman, Margaret Lynn; Zaltz-Dubin, Jodi; Wharton, Marilyn; Whitehead, Katherine

Optimal care for patients in the palliative care setting requires effective clinical teamwork. Communication may be challenging for health-care workers from different disciplines. Daily rounds are one way for clinical teams to share information and develop care plans for patients. The objective of this initiative was to improve the structure and process of daily palliative care rounds by incorporating the use of standardized tools and improved documentation into the meeting. We chose a quality improvement (QI) approach to address this initiative. Our aims were to increase the use of assessment tools when discussing patient care in rounds and to improve the documentation and accessibility of important information in the health record, including goals of care. This QI initiative used a preintervention and postintervention comparison of the outcome measures of interest. The initiative was tested in a palliative care unit (PCU) over a 22-month period from April 2014 to January 2016. Participants were clinical staff in the PCU. Data collected after the completion of several plan-do-study-act cycles showed increased use and incorporation of the Edmonton Symptom Assessment System and Palliative Performance Scale into patient care discussions as well as improvement in inclusion of goals of care into the patient plan of care. Our findings demonstrate that the effectiveness of daily palliative care rounds can be improved by incorporating the use of standard assessment tools and changes into the meeting structure to better focus and direct patient care discussions.

The GRACE Checklist: A Validated Assessment Tool for High Quality Observational Studies of Comparative Effectiveness.

PubMed

Dreyer, Nancy A; Bryant, Allison; Velentgas, Priscilla

2016-10-01

Recognizing the growing need for robust evidence about treatment effectiveness in real-world populations, the Good Research for Comparative Effectiveness (GRACE) guidelines have been developed for noninterventional studies of comparative effectiveness to determine which studies are sufficiently rigorous to be reliable enough for use in health technology assessments. To evaluate which aspects of the GRACE Checklist contribute most strongly to recognition of quality. We assembled 28 observational comparative effectiveness articles published from 2001 to 2010 that compared treatment effectiveness and/or safety of drugs, medical devices, and medical procedures. Twenty-two volunteers from academia, pharmaceutical companies, and government agencies applied the GRACE Checklist to those articles, providing 56 assessments. Ten senior academic and industry experts provided assessments of overall article quality for the purpose of decision support. We also rated each article based on the number of annual citations and impact factor of the journal in which the article was published. To identify checklist items that were most predictive of quality, classification and regression tree (CART) analysis, a binary, recursive, partitioning methodology, was used to create 3 decision trees, which compared the 56 article assessments with 3 external quality outcomes: (1) expert assessment of overall quality, (2) citation frequency, and (3) impact factor. A fourth tree looked at the composite outcome of all 3 quality indicators. The best predictors of quality included the following: use of concurrent comparators, limiting the study to new initiators of the study drug, equivalent measurement of outcomes in study groups, collecting data on most if not all known confounders or effect modifiers, accounting for immortal time bias in the analysis, and use of sensitivity analyses to test how much effect estimates depended on various assumptions. Only sensitivity analyses appeared consistently as

Assessing the Hydrologic Performance of the EPA's Nonpoint Source Water Quality Assessment Decision Support Tool Using North American Land Data Assimilation System (Products)

NASA Technical Reports Server (NTRS)

Lee, S.; Ni-Meister, W.; Toll, D.; Nigro, J.; Guiterrez-Magness, A.; Engman, T.

2010-01-01

The accuracy of streamflow predictions in the EPA's BASINS (Better Assessment Science Integrating Point and Nonpoint Sources) decision support tool is affected by the sparse meteorological data contained in BASINS. The North American Land Data Assimilation System (NLDAS) data with high spatial and temporal resolutions provide an alternative to the NOAA National Climatic Data Center (NCDC)'s station data. This study assessed the improvement of streamflow prediction of the Hydrological Simulation Program-FORTRAN (HSPF) model contained within BASINS using the NLDAS 118 degree hourly precipitation and evapotranspiration estimates in seven watersheds of the Chesapeake Bay region. Our results demonstrated consistent improvements of daily streamflow predictions in five of the seven watersheds when NLDAS precipitation and evapotranspiration data was incorporated into BASINS. The improvement of using the NLDAS data is significant when watershed's meteorological station is either far away or not in a similar climatic region. When the station is nearby, using the NLDAS data produces similar results. The correlation coefficients of the analyses using the NLDAS data were greater than 0.8, the Nash-Sutcliffe (NS) model fit efficiency greater than 0.6, and the error in the water balance was less than 5%. Our analyses also showed that the streamflow improvements were mainly contributed by the NLDAS's precipitation data and that the improvement from using NLDAS's evapotranspiration data was not significant; partially due to the constraints of current BASINS-HSPF settings. However, NLDAS's evapotranspiration data did improve the baseflow prediction. This study demonstrates the NLDAS data has the potential to improve stream flow predictions, thus aid the water quality assessment in the EPA nonpoint water quality assessment decision tool.

Preliminary development of a GIS-tool to assess threats to shallow groundwater quality from soil pollutants in Glasgow, UK (GRASP).

NASA Astrophysics Data System (ADS)

Dochartaigh, B. É. Ó.; Fordyce, F. M.; Ander, E. L.; Bonsor, H. C.

2009-04-01

The protection of groundwater and related surface water quality is a key aspect of the European Union Water Framework Directive and environmental legislation in many countries worldwide. Globally, the protection of urban groundwater resources and related ecosystem services is of growing concern as urbanisation increases. Although urban areas are often where groundwater resources are most in need of protection, there is frequently a lack of information about threats to groundwater quality. Most studies of soil and groundwater contamination, although detailed, are site-specific, and city-wide overviews are generally lacking. The British Geological Survey (BGS) is currently undertaking the Clyde Urban Super-Project (CUSP), delivering multi-disciplinary geoscience products for the Glasgow conurbation. Under this project, a GIS-based prioritisation tool known as GRASP (GRoundwater And Soil Pollutants) has been trialled to aid urban planning and sustainable development by providing a broad-scale assessment of threats to groundwater quality across the conurbation. GRASP identifies areas where shallow groundwater quality is at greatest threat from the leaching and downward movement of potentially harmful metals in the soil. Metal contamination is a known problem in many urban centres including Glasgow, which has a long industrial heritage and associated contamination legacy, notably with respect to Cr. GRASP is based primarily upon an existing British Standard - International Standards Organisation methodology to determine the leaching potential of metals from soils, which has been validated for 11 metals: Al, Fe, Cd, Co, Cr, Cu, Hg, Ni, Mn, Pb and Zn (BS-ISO 15175:2004). However, the GRASP tool is innovative as it combines assessments of soil leaching potential with soil metal content data to highlight threats to shallow groundwater quality. The input parameters required for GRASP (soil pH, clay, organic matter, sesquioxide and metal content) are based upon a systematic

Quality Metadata Management for Geospatial Scientific Workflows: from Retrieving to Assessing with Online Tools

NASA Astrophysics Data System (ADS)

Leibovici, D. G.; Pourabdollah, A.; Jackson, M.

2011-12-01

Experts and decision-makers use or develop models to monitor global and local changes of the environment. Their activities require the combination of data and processing services in a flow of operations and spatial data computations: a geospatial scientific workflow. The seamless ability to generate, re-use and modify a geospatial scientific workflow is an important requirement but the quality of outcomes is equally much important [1]. Metadata information attached to the data and processes, and particularly their quality, is essential to assess the reliability of the scientific model that represents a workflow [2]. Managing tools, dealing with qualitative and quantitative metadata measures of the quality associated with a workflow, are, therefore, required for the modellers. To ensure interoperability, ISO and OGC standards [3] are to be adopted, allowing for example one to define metadata profiles and to retrieve them via web service interfaces. However these standards need a few extensions when looking at workflows, particularly in the context of geoprocesses metadata. We propose to fill this gap (i) at first through the provision of a metadata profile for the quality of processes, and (ii) through providing a framework, based on XPDL [4], to manage the quality information. Web Processing Services are used to implement a range of metadata analyses on the workflow in order to evaluate and present quality information at different levels of the workflow. This generates the metadata quality, stored in the XPDL file. The focus is (a) on the visual representations of the quality, summarizing the retrieved quality information either from the standardized metadata profiles of the components or from non-standard quality information e.g., Web 2.0 information, and (b) on the estimated qualities of the outputs derived from meta-propagation of uncertainties (a principle that we have introduced [5]). An a priori validation of the future decision-making supported by the

Quality of family history collection with use of a patient facing family history assessment tool.

PubMed

Wu, R Ryanne; Himmel, Tiffany L; Buchanan, Adam H; Powell, Karen P; Hauser, Elizabeth R; Ginsburg, Geoffrey S; Henrich, Vincent C; Orlando, Lori A

2014-02-13

Studies have shown that the quality of family health history (FHH) collection in primary care is inadequate to assess disease risk. To use FHH for risk assessment, collected data must have adequate detail. To address this issue, we developed a patient facing FHH assessment tool, MeTree. In this paper we report the content and quality of the FHH collected using MeTree. A hybrid implementation-effectiveness study. Patients were recruited from 2009 to 2012. Two community primary care clinics in Greensboro, NC. All non-adopted adult English speaking patients with upcoming appointments were invited to participate. Education about and collection of FHH with entry into MeTree. We report the proportion of pedigrees that were high-quality. High-quality pedigrees are defined as having all the following criteria: (1) three generations of relatives, (2) relatives' lineage, (3) relatives' gender, (4) an up-to-date FHH, (5) pertinent negatives noted, (6) age of disease onset in affected relatives, and for deceased relatives, (7) the age and (8) cause of death (Prim Care31:479-495, 2004.). Enrollment: 1,184. Participant demographics: age range 18-92 (mean 58.8, SD 11.79), 56% male, and 75% white. The median pedigree size was 21 (range 8-71) and the FHH entered into MeTree resulted in a database of 27,406 individuals. FHHs collected by MeTree were found to be high quality in 99.8% (N = 1,182/1,184) as compared to <4% at baseline. An average of 1.9 relatives per pedigree (range 0-50, SD 4.14) had no data reported. For pedigrees where at least one relative has no data (N = 497/1,184), 4.97 relatives per pedigree (range 1-50, SD 5.44) had no data. Talking with family members before using MeTree significantly decreased the proportion of relatives with no data reported (4.98% if you talked to your relative vs. 10.85% if you did not, p-value < 0.001.). Using MeTree improves the quantity and quality of the FHH data that is collected and talking with relatives prior to the collection of

Water Quality Analysis Tool (WQAT) | Science Inventory | US ...

EPA Pesticide Factsheets

The purpose of the Water Quality Analysis Tool (WQAT) software is to provide a means for analyzing and producing useful remotely sensed data products for an entire estuary, a particular point or area of interest (AOI or POI) in estuaries, or water bodies of interest where pre-processed and geographically gridded remotely sensed images are available. A graphical user interface (GUI), was created to enable the user to select and display imagery from a variety of remote sensing data sources. The user can select a date (or date range) and location to extract pixels from the remotely sensed imagery. The GUI is used to obtain all available pixel values (i.e. pixel from all available bands of all available satellites) for a given location on a given date and time. The resultant data set can be analyzed or saved to a file for future use. The WQAT software provides users with a way to establish algorithms between remote sensing reflectance (Rrs) and any available in situ parameters, as well as statistical and regression analysis. The combined data sets can be used to improve water quality research and studies. Satellites provide spatially synoptic data at high frequency (daily to weekly). These characteristics are desirable for supplementing existing water quality observations and for providing information for large aquatic ecosystems that are historically under-sampled by field programs. Thus, the Water Quality Assessment Tool (WQAT) software tool was developed to suppo

Assessing indoor air quality of school environments: transplanted lichen Pseudovernia furfuracea as a new tool for biomonitoring and bioaccumulation.

PubMed

Protano, Carmela; Owczarek, Malgorzata; Antonucci, Arianna; Guidotti, Maurizio; Vitali, Matteo

2017-07-01

The aim of this research is to evaluate the ability of transplanted lichen Pseudovernia (P). furfuracea to biomonitor and bioaccumulate in urban indoor environments. The elements As, Cd, Cr, Cu, Hg, Ni and Pb and 12 selected polycyclic aromatic hydrocarbons (PAHs) were used to assess P. furfuracea as a biomonitoring tool for the indoor air quality of school environments. To achieve this purpose, lichen samples were exposed for 2 months in the outdoor and indoor environments of five school settings located in urban and rural areas. The results demonstrated that transplanted lichen P. furfuracea is a suitable biomonitoring tool for metals and PAHs in indoor settings and can discriminate between different levels of air pollution related to urbanisation and indoor conditions, such as those characterised by school environments. A transplanted lichen biomonitoring strategy is cost-effective, "green", educational for attending children and less "invasive" than traditional air sampling methods. The feasibility of indoor monitoring by P. furfuracea is a relevant finding and could be a key tool to improve air quality monitoring programmes in school scenarios and thus focus on health prevention interventions for children, who are one of the most susceptible groups in the population.

Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites

PubMed Central

Steinwachs, Donald; Rubin, Haya R

2003-01-01

Background Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness. Objective This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality. Methods An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness. Results Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80. Conclusions Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information. PMID:14713658

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Using Quality Management Tools to Enhance Feedback from Student Evaluations

ERIC Educational Resources Information Center

Jensen, John B.; Artz, Nancy

2005-01-01

Statistical tools found in the service quality assessment literature--the "T"[superscript 2] statistic combined with factor analysis--can enhance the feedback instructors receive from student ratings. "T"[superscript 2] examines variability across multiple sets of ratings to isolate individual respondents with aberrant response…

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Assessment of tools for protection of quality of water: Uncontrollable discharges of pollutants.

PubMed

Dehghani Darmian, Mohsen; Hashemi Monfared, Seyed Arman; Azizyan, Gholamreza; Snyder, Shane A; Giesy, John P

2018-06-06

Selecting an appropriate crisis management plans during uncontrollable loading of pollution to water systems is crucial. In this research the quality of water resources against uncontrollable pollution is protected by use of suitable tools. Case study which was chosen in this investigation was a river-reservoir system. Analytical and numerical solutions of pollutant transport equation were considered as the simulation strategy to calculate the efficient tools to protect water quality. These practical instruments are dilution flow and a new tool called detention time which is proposed and simulated for the first time in this study. For uncontrollable pollution discharge which was approximately 130% of the river's assimilation capacity, as long as the duration of contact (T c ) was considered as a constraint, by releasing 30% of the base flow of the river from the upstream dilution reservoir, the unallowable pollution could be treated. Moreover, when the affected distance (X c ) was selected as a constraint, the required detention time that the rubber dam should detained the water to be treated was equal to 187% of the initial duration of contact. Copyright © 2018 Elsevier Inc. All rights reserved.

Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-06-19

The methodological quality and completeness of reporting of the systematic reviews (SRs) is fundamental to optimal implementation of evidence-based health care and the reduction of research waste. Methods exist to appraise SRs yet little is known about how they are used in SRs or where there are potential gaps in research best-practice guidance materials. The aims of this study are to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of a cohort of SRs and to assess their number, general characteristics, and approaches to 'quality' assessment over time. The Cochrane Library, MEDLINE®, and EMBASE® were searched from January 1990 to October 16, 2014, for reports assessing MQ and/or RQ of SRs. Title, abstract, and full-text screening of all reports were conducted independently by two reviewers. Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included. All results are reported as frequencies and percentages of reports. Of 20,765 unique records retrieved, 1189 of them were reviewed for full-text review, of which 76 reports were included. Eight previously published approaches to assessing MQ or reporting guidelines used as proxy to assess RQ were used in 80% (61/76) of identified reports. These included two reporting guidelines (PRISMA and QUOROM) and five quality assessment tools (AMSTAR, R-AMSTAR, OQAQ, Mulrow, Sacks) and GRADE criteria. The remaining 24% (18/76) of reports developed their own criteria. PRISMA, OQAQ, and AMSTAR were the most commonly used published tools to assess MQ or RQ. In conjunction with other approaches, published tools were used in 29% (22/76) of reports, with 36% (8/22) assessing adherence to both PRISMA and AMSTAR criteria and 26% (6/22) using QUOROM and OQAQ. The methods used to assess quality of SRs are diverse, and none has become universally accepted. The most commonly used quality assessment tools are AMSTAR, OQAQ, and PRISMA. As new tools and guidelines are

A tool for assessing the quality of nursing handovers: a validation study.

PubMed

Ferrara, Paolo; Terzoni, Stefano; Davì, Salvatore; Bisesti, Alberto; Destrebecq, Anne

2017-08-10

Handover, in particular between two shifts, is a crucial aspect of nursing for patient safety, aimed at ensuring continuity of care. During this process, several factors can affect quality of care and cause errors. This study aimed to assess quality of handovers, by validating the Handoff CEX-Italian scale. The scale was translated from English into Italian and the content validity index was calculated and internal consistency assessed. The scale was used in several units of the San Paolo Teaching Hospital in Milan, Italy. A total of 48 reports were assessed (192 evaluations). The median score was 6, interquartile range (IQR) [5;7] and was not influenced by specific (p=0.21) or overall working experience (p=0.13). The domains showing the lowest median values (median=6, IQR [4;8]) were context, communication, and organisation. Night to morning handovers obtained the lowest scores. CVI-S was 0.96, Cronbach's alpha was 0.79. The Handoff CEX-Italian scale is valid and reliable and it can be used to assess the quality of nurse handovers.

Quality evaluation of JAMA Patient Pages on diabetes using the Ensuring Quality Information for Patient (EQIP) tool.

PubMed

Vaona, Alberto; Marcon, Alessandro; Rava, Marta; Buzzetti, Roberto; Sartori, Marco; Abbinante, Crescenza; Moser, Andrea; Seddaiu, Antonia; Prontera, Manuela; Quaglio, Alessandro; Pallazzoni, Piera; Sartori, Valentina; Rigon, Giulio

2011-12-01

Many medical journals provide patient information leaflets on the correct use of medicines and/or appropriate lifestyles. Only a few studies have assessed the quality of this patient-specific literature. The purpose of this study was to evaluate the quality of JAMA Patient Pages on diabetes using the Ensuring Quality Information for Patient (EQIP) tool. A multidisciplinary group of 10 medical doctors analyzed all diabetes-related Patient Pages published by JAMA from 1998 to 2010 using the EQIP tool. Inter-rater reliability was assessed using the percentage of observed total agreement (p(o)). A quality score between 0 and 1 (the higher score indicating higher quality) was calculated for each item on every page as a function of raters' answers to the EQIP checklist. A mean score per item and a mean score per page were then calculated. We found 8 Patient Pages on diabetes on the JAMA web site. The overall quality score of the documents ranged between 0.55 (Managing Diabetes and Diabetes) and 0.67 (weight and diabetes). p(o) was at least moderate (>50%) for 15 of the 20 EQIP items. Despite generally favorable quality scores, some items received low scores. The worst scores were for the item assessing provision of an empty space to customize information for individual patients (score=0.01, p(o)=95%) and patients involvement in document drafting (score=0.11, p(o)=79%). The Patient Pages on diabetes published by JAMA were found to present weak points that limit their overall quality and may jeopardize their efficacy. We therefore recommend that authors and publishers of written patient information comply with published quality criteria. Further research is needed to evaluate the quality and efficacy of existing written health care information. Copyright © 2011 Primary Care Diabetes Europe. Published by Elsevier Ltd. All rights reserved.

Developing Cyberinfrastructure Tools and Services for Metadata Quality Evaluation

NASA Astrophysics Data System (ADS)

Mecum, B.; Gordon, S.; Habermann, T.; Jones, M. B.; Leinfelder, B.; Powers, L. A.; Slaughter, P.

2016-12-01

Metadata and data quality are at the core of reusable and reproducible science. While great progress has been made over the years, much of the metadata collected only addresses data discovery, covering concepts such as titles and keywords. Improving metadata beyond the discoverability plateau means documenting detailed concepts within the data such as sampling protocols, instrumentation used, and variables measured. Given that metadata commonly do not describe their data at this level, how might we improve the state of things? Giving scientists and data managers easy to use tools to evaluate metadata quality that utilize community-driven recommendations is the key to producing high-quality metadata. To achieve this goal, we created a set of cyberinfrastructure tools and services that integrate with existing metadata and data curation workflows which can be used to improve metadata and data quality across the sciences. These tools work across metadata dialects (e.g., ISO19115, FGDC, EML, etc.) and can be used to assess aspects of quality beyond what is internal to the metadata such as the congruence between the metadata and the data it describes. The system makes use of a user-friendly mechanism for expressing a suite of checks as code in popular data science programming languages such as Python and R. This reduces the burden on scientists and data managers to learn yet another language. We demonstrated these services and tools in three ways. First, we evaluated a large corpus of datasets in the DataONE federation of data repositories against a metadata recommendation modeled after existing recommendations such as the LTER best practices and the Attribute Convention for Dataset Discovery (ACDD). Second, we showed how this service can be used to display metadata and data quality information to data producers during the data submission and metadata creation process, and to data consumers through data catalog search and access tools. Third, we showed how the centrally

The visibility of QSEN competencies in clinical assessment tools in Swedish nurse education.

PubMed

Nygårdh, Annette; Sherwood, Gwen; Sandberg, Therese; Rehn, Jeanette; Knutsson, Susanne

2017-12-01

Prospective nurses need specific and sufficient knowledge to be able to provide quality care. The Swedish Society of Nursing has emphasized the importance of the six quality and safety competencies (QSEN), originated in the US, in Swedish nursing education. To investigate the visibility of the QSEN competencies in the assessment tools used in clinical practice METHOD: A quantitative descriptive method was used to analyze assessment tools from 23 universities. Teamwork and collaboration was the most visible competency. Patient-centered care was visible to a large degree but was not referred to by name. Informatics was the least visible, a notable concern since all nurses should be competent in informatics to provide quality and safety in care. These results provide guidance as academic and clinical programs around the world implement assessment of how well nurses have developed these essential quality and safety competencies. Copyright © 2017 Elsevier Ltd. All rights reserved.

Developing a multidisciplinary robotic surgery quality assessment program.

PubMed

Gonsenhauser, Iahn; Abaza, Ronney; Mekhjian, Hagop; Moffatt-Bruce, Susan D

2012-01-01

The objective of this study was to test the feasibility of a novel quality-improvement (QI) program designed to incorporate multiple robotic surgical sub-specialties in one health care system. A robotic surgery quality assessment program was developed by The Ohio State University College of Medicine (OSUMC) in conjunction with The Ohio State University Medical Center Quality Improvement and Operations Department. A retrospective review of cases was performed using data interrogated from the OSUMC Information Warehouse from January 2007 through August 2009. Robotic surgery cases (n=2200) were assessed for operative times, length of stay (LOS), conversions, returns to surgery, readmissions and cancellations as potential quality indicators. An actionable and reproducible framework for the quality measurement and assessment of a multidisciplinary and interdepartmental robotic surgery program was successfully completed demonstrating areas for improvement opportunities. This report supports that standard quality indicators can be applied to multiple specialties within a health care system to develop a useful quality tracking and assessment tool in the highly specialized area of robotic surgery. © 2012 National Association for Healthcare Quality.

ASQ Program Observation Instrument: A Tool for Assessing School-Age Child Care Quality.

ERIC Educational Resources Information Center

O'Connor, Susan; And Others

ASQ (Assessing School-Aged Child Care Quality) is a system for determining the quality of school-age child care programs. The ASQ Program Observation Instrument is a ten-step, self assessment process to guide program improvement. This instrument does not work well in full-day programs that have a single focus, but works well in programs that offer…

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

Survey of Ambient Air Pollution Health Risk Assessment Tools.

PubMed

Anenberg, Susan C; Belova, Anna; Brandt, Jørgen; Fann, Neal; Greco, Sue; Guttikunda, Sarath; Heroux, Marie-Eve; Hurley, Fintan; Krzyzanowski, Michal; Medina, Sylvia; Miller, Brian; Pandey, Kiran; Roos, Joachim; Van Dingenen, Rita

2016-09-01

Designing air quality policies that improve public health can benefit from information about air pollution health risks and impacts, which include respiratory and cardiovascular diseases and premature death. Several computer-based tools help automate air pollution health impact assessments and are being used for a variety of contexts. Expanding information gathered for a May 2014 World Health Organization expert meeting, we survey 12 multinational air pollution health impact assessment tools, categorize them according to key technical and operational characteristics, and identify limitations and challenges. Key characteristics include spatial resolution, pollutants and health effect outcomes evaluated, and method for characterizing population exposure, as well as tool format, accessibility, complexity, and degree of peer review and application in policy contexts. While many of the tools use common data sources for concentration-response associations, population, and baseline mortality rates, they vary in the exposure information source, format, and degree of technical complexity. We find that there is an important tradeoff between technical refinement and accessibility for a broad range of applications. Analysts should apply tools that provide the appropriate geographic scope, resolution, and maximum degree of technical rigor for the intended assessment, within resources constraints. A systematic intercomparison of the tools' inputs, assumptions, calculations, and results would be helpful to determine the appropriateness of each for different types of assessment. Future work would benefit from accounting for multiple uncertainty sources and integrating ambient air pollution health impact assessment tools with those addressing other related health risks (e.g., smoking, indoor pollution, climate change, vehicle accidents, physical activity). © 2016 Society for Risk Analysis.

[Audit as a tool to assess and promote the quality of medical records and hospital appropriateness: metodology and preliminary results].

PubMed

Poscia, Andrea; Cambieri, Andrea; Tucceri, Chiara; Ricciardi, Walter; Volpe, Massimo

2015-01-01

In the actual economic context, with increasing health needs, efficiency and efficacy represents fundamental keyword to ensure a successful use of the resources and the best health outcomes. Together, the medical record, completely and correctly compiled, is an essential tool in the patient diagnostic and therapeutic path, but it's becoming more and more essential for the administrative reporting and legal claims. Nevertheless, even if the improvement of medical records quality and of hospital stay appropriateness represent priorities for every health organization, they could be difficult to realize. This study aims to present the methodology and the preliminary results of a training and improvement process: it was carried out from the Hospital Management of a third level Italian teaching hospital through audit cycles to actively involve their health professionals. A self assessment process of medical records quality and hospital stay appropriateness (inpatients admission and Day Hospital) was conducted through a retrospective evaluation of medical records. It started in 2012 and a random sample of 2295 medical records was examined: the quality assessment was performed using a 48-item evaluation grid modified from the Lombardy Region manual of the medical record, while the appropriateness of each days was assessed using the Italian version of Appropriateness Evaluation Protocol (AEP) - 2002ed. The overall assessment was presented through departmental audit: the audit were designed according to the indication given by the Italian and English Ministry of Health to share the methodology and the results with all the involved professionals (doctors and nurses) and to implement improvement strategies that are synthesized in this paper. Results from quality and appropriateness assessment show several deficiencies, due to 40% of minimum level of acceptability not completely satisfied and to 30% of inappropriateness between days of hospitalization. Furthermore, there are

Quality Assessment of TPB-Based Questionnaires: A Systematic Review

PubMed Central

Oluka, Obiageli Crystal; Nie, Shaofa; Sun, Yi

2014-01-01

Objective This review is aimed at assessing the quality of questionnaires and their development process based on the theory of planned behavior (TPB) change model. Methods A systematic literature search for studies with the primary aim of TPB-based questionnaire development was conducted in relevant databases between 2002 and 2012 using selected search terms. Ten of 1,034 screened abstracts met the inclusion criteria and were assessed for methodological quality using two different appraisal tools: one for the overall methodological quality of each study and the other developed for the appraisal of the questionnaire content and development process. Both appraisal tools consisted of items regarding the likelihood of bias in each study and were eventually combined to give the overall quality score for each included study. Results 8 of the 10 included studies showed low risk of bias in the overall quality assessment of each study, while 9 of the studies were of high quality based on the quality appraisal of questionnaire content and development process. Conclusion Quality appraisal of the questionnaires in the 10 reviewed studies was successfully conducted, highlighting the top problem areas (including: sample size estimation; inclusion of direct and indirect measures; and inclusion of questions on demographics) in the development of TPB-based questionnaires and the need for researchers to provide a more detailed account of their development process. PMID:24722323

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Quality assessment of decision-making in colorectal cancer multidisciplinary meetings.

PubMed

Seretis, Charalampos; Mankotia, Rajnish; Goonetilleke, Kolitha; Rawstorne, Edward

2014-01-01

The quality of decision-making in the colorectal multidisciplinary team (MDT) meetings can significantly affect the quality of care delivered to patients with colorectal cancer. We performed a prospective study to assess the quality of the MDT meetings in a specialized colorectal unit using an externally observational validated tool. An externally validated observational tool, the Colorectal Multidisciplinary Team Metric for Observation of Decision-Making (cMDT-MODe), was used to assess the quality of clinical decision-making in 64 cases. Although case history information presented by the responsible surgeon was rated high (4.4/5), the quality of radiological and histopathological information regarding each patient's case which was available at the time was less adequate, scoring 3.9/5 and 3.8/5, respectively. Moreover, the precise knowledge of patients' personal views and circumstances was a field requiring further improvement. In a general overview however, the quality and extent of the available information enabled the MDT to provide a clear recommendation regarding the patients' treatment plans in 87.5% of the cases. The cMDT-MODe tool can be used to prospectively audit the quality of clinical decision-making in the colorectal MDT meetings and highlight the fields of potential improvement.

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

PubMed

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

['Clinical auditing', a novel tool for quality assessment in surgical oncology].

PubMed

van Leersum, Nicoline J; Kolfschoten, Nikki E; Klinkenbijl, Jean H G; Tollenaar, Rob A E M; Wouters, Michel W J M

2011-01-01

To determine whether systematic audit and feedback of information about the process and outcomes improve the quality of surgical care. Systematic literature review. Embase, PubMed, and Web of Science databases were searched for publications on 'quality assessment' and 'surgery'. The references of the publications found were examined as well. Publications were included in the review if the effect of auditing on the quality of surgical care had been investigated. In the databases 2415 publications were found. After selection, 28 publications describing the effect of auditing, whether or not combined with a quality improvement project, on guideline adherence or indications of outcomes of care were included. In 21 studies, a statistically significant positive effect of auditing was reported. In 5 studies a positive effect was found, but this was either not significant or statistical significance was not determined. In 2 studies no effect was observed. 5 studies compared the combination of auditing with a quality improvement project with auditing alone; 4 of these reported an additional effect of the quality improvement project. Audit and feedback of quality information seem to have a positive effect on the quality of surgical care. The use of quality information from audits for the purpose of a quality improvement project can enhance the positive effect of the audit.

Methodological Quality Assessment of Meta-analyses in Endodontics.

PubMed

Kattan, Sereen; Lee, Su-Min; Kohli, Meetu R; Setzer, Frank C; Karabucak, Bekir

2018-01-01

The objectives of this review were to assess the methodological quality of published meta-analyses related to endodontics using the assessment of multiple systematic reviews (AMSTAR) tool and to provide a follow-up to previously published reviews. Three electronic databases were searched for eligible studies according to the inclusion and exclusion criteria: Embase via Ovid, The Cochrane Library, and Scopus. The electronic search was amended by a hand search of 6 dental journals (International Endodontic Journal; Journal of Endodontics; Australian Endodontic Journal; Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology; Endodontics and Dental Traumatology; and Journal of Dental Research). The searches were conducted to include articles published after July 2009, and the deadline for inclusion of the meta-analyses was November 30, 2016. The AMSTAR assessment tool was used to evaluate the methodological quality of all included studies. A total of 36 reports of meta-analyses were included. The overall quality of the meta-analyses reports was found to be medium, with an estimated mean overall AMSTAR score of 7.25 (95% confidence interval, 6.59-7.90). The most poorly assessed areas were providing an a priori design, the assessment of the status of publication, and publication bias. In recent publications in the field of endodontics, the overall quality of the reported meta-analyses is medium according to AMSTAR. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Assessment of SOAP note evaluation tools in colleges and schools of pharmacy.

PubMed

Sando, Karen R; Skoy, Elizabeth; Bradley, Courtney; Frenzel, Jeanne; Kirwin, Jennifer; Urteaga, Elizabeth

2017-07-01

To describe current methods used to assess SOAP notes in colleges and schools of pharmacy. Members of the American Association of Colleges of Pharmacy Laboratory Instructors Special Interest Group were invited to share assessment tools for SOAP notes. Content of submissions was evaluated to characterize overall qualities and how the tools assessed subjective, objective, assessment, and plan information. Thirty-nine assessment tools from 25 schools were evaluated. Twenty-nine (74%) of the tools were rubrics and ten (26%) were checklists. All rubrics included analytic scoring elements, while two (7%) were mixed with holistic and analytic scoring elements. A majority of the rubrics (35%) used a four-item rating scale. Substantial variability existed in how tools evaluated subjective and objective sections. All tools included problem identification in the assessment section. Other assessment items included goals (82%) and rationale (69%). Seventy-seven percent assessed drug therapy; however, only 33% assessed non-drug therapy. Other plan items included education (59%) and follow-up (90%). There is a great deal of variation in the specific elements used to evaluate SOAP notes in colleges and schools of pharmacy. Improved consistency in assessment methods to evaluate SOAP notes may better prepare students to produce standardized documentation when entering practice. Copyright © 2017 Elsevier Inc. All rights reserved.

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Bibliography for the Indoor Air Quality Building Education and Assessment Model

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM) is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Pain assessment tools: is the content appropriate for use in palliative care?

PubMed

Hølen, Jacob Chr; Hjermstad, Marianne Jensen; Loge, Jon Håvard; Fayers, Peter M; Caraceni, Augusto; De Conno, Franco; Forbes, Karen; Fürst, Carl Johan; Radbruch, Lukas; Kaasa, Stein

2006-12-01

Inadequate pain assessment prevents optimal treatment in palliative care. The content of pain assessment tools might limit their usefulness for proper pain assessment, but data on the content validity of the tools are scarce. The objective of this study was to examine the content of the existing pain assessment tools, and to evaluate the appropriateness of different dimensions and items for pain assessment in palliative care. A systematic search was performed to find pain assessment tools for patients with advanced cancer who were receiving palliative care. An ad hoc search with broader search criteria supplemented the systematic search. The items of the identified tools were allocated to appropriate dimensions. This was reviewed by an international panel of experts, who also evaluated the relevance of the different dimensions for pain assessment in palliative care. The systematic literature search generated 16 assessment tools while the ad hoc search generated 64. Ten pain dimensions containing 1,011 pain items were identified by the experts. The experts ranked intensity, temporal pattern, treatment and exacerbating/relieving factors, location, and interference with health-related quality of life as the most important dimensions. None of the assessment tools covered these dimensions satisfactorily. Most items were related to interference (231) and intensity (138). Temporal pattern (which includes breakthrough pain), ranked as the second most important dimension, was covered by 29 items only. Many tools include dimensions and items of limited relevance for patients with advanced cancer. This might reduce compliance and threaten the validity of the assessment. New tools should reflect the clinical relevance of different dimensions and be user-friendly.

Gaia: automated quality assessment of protein structure models.

PubMed

Kota, Pradeep; Ding, Feng; Ramachandran, Srinivas; Dokholyan, Nikolay V

2011-08-15

Increasing use of structural modeling for understanding structure-function relationships in proteins has led to the need to ensure that the protein models being used are of acceptable quality. Quality of a given protein structure can be assessed by comparing various intrinsic structural properties of the protein to those observed in high-resolution protein structures. In this study, we present tools to compare a given structure to high-resolution crystal structures. We assess packing by calculating the total void volume, the percentage of unsatisfied hydrogen bonds, the number of steric clashes and the scaling of the accessible surface area. We assess covalent geometry by determining bond lengths, angles, dihedrals and rotamers. The statistical parameters for the above measures, obtained from high-resolution crystal structures enable us to provide a quality-score that points to specific areas where a given protein structural model needs improvement. We provide these tools that appraise protein structures in the form of a web server Gaia (http://chiron.dokhlab.org). Gaia evaluates the packing and covalent geometry of a given protein structure and provides quantitative comparison of the given structure to high-resolution crystal structures. dokh@unc.edu Supplementary data are available at Bioinformatics online.

Framework and tools for agricultural landscape assessment relating to water quality protection.

PubMed

Gascuel-Odoux, Chantal; Massa, Florence; Durand, Patrick; Merot, Philippe; Troccaz, Olivier; Baudry, Jacques; Thenail, Claudine

2009-05-01

While many scientific studies show the influence of agricultural landscape patterns on water cycle and water quality, only a few of these have proposed scientifically based and operational methods to improve water management. Territ'eau is a framework developed to adapt agricultural landscapes to water quality protection, using components such as farmers' fields, seminatural areas, and human infrastructures, which can act as sources, sinks, or buffers on water quality. This framework allows us to delimit active areas contributing to water quality, defined by the following three characteristics: (i) the dominant hydrological processes and their flow pathways, (ii) the characteristics of each considered pollutant, and (iii) the main landscape features. These areas are delineated by analyzing the flow connectivity from the stream to the croplands, by assessing the buffer functions of seminatural areas according to their flow pathways. Hence, this framework allows us to identify functional seminatural areas in terms of water quality and assess their limits and functions; it helps in proposing different approaches for changing agricultural landscape, acting on agricultural practices or systems, and/or conserving or rebuilding seminatural areas in controversial landscapes. Finally, it allows us to objectivize the functions of the landscape components, for adapting these components to new environmental constraints.

National Water-Quality Assessment (NAWQA) Area-Characterization Toolbox

USGS Publications Warehouse

Price, Curtis

2010-01-01

This is release 1.0 of the National Water-Quality Assessment (NAWQA) Area-Characterization Toolbox. These tools are designed to be accessed using ArcGIS Desktop software (versions 9.3 and 9.3.1). The toolbox is composed of a collection of custom tools that implement geographic information system (GIS) techniques used by the NAWQA Program to characterize aquifer areas, drainage basins, and sampled wells.

Quality Improvement Project: Replacing the Numeric Rating Scale with a Clinically Aligned Pain Assessment (CAPA) Tool.

PubMed

Topham, Debra; Drew, Debra

2017-12-01

CAPA is a multifaceted pain assessment tool that was adopted at a large tertiary Midwest hospital to replace the numeric scale for adult patients who could self-report their pain experience. This article describes the process of implementation and the effect on patient satisfaction scores. Use of the tool is supported by the premise that pain assessment entails more than just pain intensity and that assessment is an exchange of meaning between patients and clinicians dependent on internal and external factors. Implementation of the tool was a transformative process resulting in modest increases in patient satisfaction scores with pain management. Patient reports that "staff did everything to manage pain" had the biggest gains and were sustained for more than 2 years. The CAPA tool meets regulatory requirements for pain assessment. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Innovative Stormwater Quality Tools by SARA for Holistic Watershed Master Planning

NASA Astrophysics Data System (ADS)

Thomas, S. M.; Su, Y. C.; Hummel, P. R.

2016-12-01

Stormwater management strategies such as Best Management Practices (BMP) and Low-Impact Development (LID) have increasingly gained attention in urban runoff control, becoming vital to holistic watershed master plans. These strategies can help address existing water quality impairments and support regulatory compliance, as well as guide planning and management of future development when substantial population growth and urbanization is projected to occur. However, past efforts have been limited to qualitative planning due to the lack of suitable tools to conduct quantitative assessment. The San Antonio River Authority (SARA), with the assistance of Lockwood, Andrews & Newnam, Inc. (LAN) and AQUA TERRA Consultants (a division of RESPEC), developed comprehensive hydrodynamic and water quality models using the Hydrological Simulation Program-FORTRAN (HSPF) for several urban watersheds in the San Antonio River Basin. These models enabled watershed management to look at water quality issues on a more refined temporal and spatial scale than the limited monitoring data. They also provided a means to locate and quantify potential water quality impairments and evaluate the effects of mitigation measures. To support the models, a suite of software tools were developed. including: 1) SARA Timeseries Utility Tool for managing and processing of large model timeseries files, 2) SARA Load Reduction Tool to determine load reductions needed to achieve screening levels for each modeled constituent on a sub-basin basis, and 3) SARA Enhanced BMP Tool to determine the optimal combination of BMP types and units needed to achieve the required load reductions. Using these SARA models and tools, water quality agencies and stormwater professionals can determine the optimal combinations of BMP/LID to accomplish their goals and save substantial stormwater infrastructure and management costs. The tools can also help regulators and permittees evaluate the feasibility of achieving compliance

Quality Assessment of Medical Apps that Target Medication-Related Problems.

PubMed

Loy, John Shiguang; Ali, Eskinder Eshetu; Yap, Kevin Yi-Lwern

2016-10-01

The advent of smartphones has enabled a plethora of medical apps for disease management. As of 2012, there are 40,000 health care-related mobile apps available in the market. Since most of these medical apps do not go through any stringent quality assessment, there is a risk of consumers being misinformed or misled by unreliable information. In this regard, apps that target medication-related problems (MRPs) are not an exception. There is little information on what constitutes quality in apps that target MRPs and how good the existing apps are. To develop a quality assessment tool for evaluating apps that target MRPs and assess the quality of such apps available in the major mobile app stores (iTunes and Google Play). The top 100 free and paid apps in the medical categories of iTunes and Google Play stores (total of 400 apps) were screened for inclusion in the final analysis. English language apps that targeted MRPs were downloaded on test devices to evaluate their quality. Apps intended for clinicians, patients, or both were eligible for evaluation. The quality assessment tool consisted of 4 sections (appropriateness, reliability, usability, privacy), which determined the overall quality of the apps. Apps that fulfilled the inclusion criteria were classified based on the presence of any 1 or more of the 5 features considered important for apps targeting MRPs (monitoring, interaction checker, dose calculator, medication information, medication record). Descriptive statistics and Mann-Whitney tests were used for analysis. Final analysis was based on 59 apps that fulfilled the study inclusion criteria. Apps with interaction checker (66.9%) and monitoring features (54.8%) had the highest and lowest overall qualities. Paid apps generally scored higher for usability than free apps (P = 0.006) but lower for privacy (P = 0.003). Half of the interaction checker apps were unable to detect interactions with herbal medications. Blood pressure and heart rate monitoring apps

Enhancing Leadership Quality. TQ Source Tips & Tools: Emerging Strategies to Enhance Educator Quality

ERIC Educational Resources Information Center

National Comprehensive Center for Teacher Quality, 2008

2008-01-01

Teaching Quality (TQ) Source Tips & Tools: Emerging Strategies to Enhance Educator Quality is an online resource developed by the TQ Center. It is designed to help education practitioners tap into strategies and resources they can use to enhance educator quality. This publication is based on the TQ Source Tips & Tools topic area "Enhancing…

Clustered lot quality assurance sampling: a pragmatic tool for timely assessment of vaccination coverage.

PubMed

Greenland, K; Rondy, M; Chevez, A; Sadozai, N; Gasasira, A; Abanida, E A; Pate, M A; Ronveaux, O; Okayasu, H; Pedalino, B; Pezzoli, L

2011-07-01

To evaluate oral poliovirus vaccine (OPV) coverage of the November 2009 round in five Northern Nigeria states with ongoing wild poliovirus transmission using clustered lot quality assurance sampling (CLQAS). We selected four local government areas in each pre-selected state and sampled six clusters of 10 children in each Local Government Area, defined as the lot area. We used three decision thresholds to classify OPV coverage: 75-90%, 55-70% and 35-50%. A full lot was completed, but we also assessed in retrospect the potential time-saving benefits of stopping sampling when a lot had been classified. We accepted two local government areas (LGAs) with vaccination coverage above 75%. Of the remaining 18 rejected LGAs, 11 also failed to reach 70% coverage, of which four also failed to reach 50%. The average time taken to complete a lot was 10 h. By stopping sampling when a decision was reached, we could have classified lots in 5.3, 7.7 and 7.3 h on average at the 90%, 70% and 50% coverage targets, respectively. Clustered lot quality assurance sampling was feasible and useful to estimate OPV coverage in Northern Nigeria. The multi-threshold approach provided useful information on the variation of IPD vaccination coverage. CLQAS is a very timely tool, allowing corrective actions to be directly taken in insufficiently covered areas. © 2011 Blackwell Publishing Ltd.

Floristic Quality Assessment Across the Nation: Status, Opportunities, and Challenges

EPA Science Inventory

Floristic Quality Assessment (FQA) will be considered in the USEPA National Wetland Condition Assessment (NWCA). FQA is a powerful tool to describe wetland ecological condition, and is based on Coefficients of Conservatism (CC) of individual native plant species. CCs rank sensiti...

The use of UV-visible reflectance spectroscopy as an objective tool to evaluate pearl quality.

PubMed

Agatonovic-Kustrin, Snezana; Morton, David W

2012-07-01

Assessing the quality of pearls involves the use of various tools and methods, which are mainly visual and often quite subjective. Pearls are normally classified by origin and are then graded by luster, nacre thickness, surface quality, size, color and shape. The aim of this study was to investigate the capacity of Artificial Neural Networks (ANNs) to classify and estimate the quality of 27 different pearls from their UV-Visible spectra. Due to the opaque nature of pearls, spectroscopy measurements were performed using the Diffuse Reflectance UV-Visible spectroscopy technique. The spectra were acquired at two different locations on each pearl sample in order to assess surface homogeneity. The spectral data (inputs) were smoothed to reduce the noise, fed into ANNs and correlated to the pearl's quality/grading criteria (outputs). The developed ANNs were successful in predicting pearl type, mollusk growing species, possible luster and color enhancing, donor condition/type, recipient/host color, donor color, pearl luster, pearl color, origin. The results of this study shows that the developed UV-Vis spectroscopy-ANN method could be used as a more objective method of assessing pearl quality (grading) and may become a valuable tool for the pearl grading industry.

An Alternative Grading Tool for Enhancing Assessment Practice and Quality Assurance in Higher Education

ERIC Educational Resources Information Center

Grainger, Peter; Weir, Katie

2016-01-01

Assessing student learning in university courses is commonly done using a rubric that arranges the assessment criteria and standards descriptors in a matrix style or grid format. This paper introduces an alternative style of grading tool known as the continua model of a guide to making judgements, which arranges assessment criteria based on a…

Guidance on Data Quality Assessment for Life Cycle Inventory Data

EPA Science Inventory

Data quality within Life Cycle Assessment (LCA) is a significant issue for the future support and development of LCA as a decision support tool and its wider adoption within industry. In response to current data quality standards such as the ISO 14000 series, various entities wit...

Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations.

PubMed

Mustafa, Reem A; Wiercioch, Wojtek; Falavigna, Maicon; Zhang, Yuan; Ivanova, Liudmila; Arevalo-Rodriguez, Ingrid; Cheung, Adrienne; Prediger, Barbara; Ventresca, Matthew; Brozek, Jan; Santesso, Nancy; Bossuyt, Patrick; Garg, Amit X; Lloyd, Nancy; Lelgemann, Monika; Bühler, Diedrich; Schünemann, Holger J

2017-12-01

The objective of this study was to identify and describe critical appraisal tools designed for assessing the quality of evidence (QoE) and/or strength of recommendations (SoRs) related to health care-related tests and diagnostic strategies (HCTDSs). We conducted a systematic review to identify tools applied in guidelines, methodological articles, and systematic reviews to assess HCTDS. We screened 5,534 titles and abstracts, 1,004 full-text articles, and abstracted data from 330 references. We identified 29 tools and 14 modifications of existing tools for assessing QoE and SoR. Twenty-three out of 29 tools acknowledge the importance of assessing the QoE and SoR separately, but in 8, the SoR is based solely on QoE. When making decisions about the use of tests, patient values and preferences and impact on resource utilization were considered in 6 and 8 tools, respectively. There is also confusion about the terminology that describes the various factors that influence the QoE and SoR. Although at least one approach includes all relevant criteria for assessing QoE and determining SoR, more detailed guidance about how to operationalize these assessments and make related judgments will be beneficial. There is a need for a better description of the framework for using evidence to make decisions and develop recommendations about HCTDS. Copyright © 2017 Elsevier Inc. All rights reserved.

Southwest principal aquifers regional ground-water quality assessment

USGS Publications Warehouse

Anning, D.W.; Thiros, Susan A.; Bexfield, L.M.; McKinney, T.S.; Green, J.M.

2009-01-01

The National Water-Quality Assessment (NAWQA) Program of the U.S. Geological Survey is conducting a regional analysis of water quality in the principal aquifers in the southwestern United States. The Southwest Principal Aquifers (SWPA) study is building a better understanding of the susceptibility and vulnerability of basin-fill aquifers in the region to ground-water contamination by synthesizing the baseline knowledge of ground-water quality conditions in 15 basins previously studied by the NAWQA Program. The improved understanding of aquifer susceptibility and vulnerability to contamination is assisting in the development of tools that water managers can use to assess and protect the quality of ground-water resources. This fact sheet provides an overview of the basin-fill aquifers in the southwestern United States and description of the completed and planned regional analyses of ground-water quality being performed by the SWPA study.

Links Related to the Indoor Air Quality Building Education and Assessment Model

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM) is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Quality assessment of systematic reviews on alveolar socket preservation.

PubMed

Moraschini, V; Barboza, E Dos S P

2016-09-01

The aim of this overview was to evaluate and compare the quality of systematic reviews, with or without meta-analysis, that have evaluated studies on techniques or biomaterials used for the preservation of alveolar sockets post tooth extraction in humans. An electronic search was conducted without date restrictions using the Medline/PubMed, Cochrane Library, and Web of Science databases up to April 2015. Eligibility criteria included systematic reviews, with or without meta-analysis, focused on the preservation of post-extraction alveolar sockets in humans. Two independent authors assessed the quality of the included reviews using AMSTAR and the checklist proposed by Glenny et al. in 2003. After the selection process, 12 systematic reviews were included. None of these reviews obtained the maximum score using the quality assessment tools implemented, and the results of the analyses were highly variable. A significant statistical correlation was observed between the scores of the two checklists. A wide structural and methodological variability was observed between the systematic reviews published on the preservation of alveolar sockets post tooth extraction. None of the reviews evaluated obtained the maximum score using the two quality assessment tools implemented. Copyright © 2016 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Testing the Visual Soil Assessment tool on Estonian farm fields

NASA Astrophysics Data System (ADS)

Reintam, Endla; Are, Mihkel; Selge, Are

2017-04-01

Soil quality estimation plays important role in decision making on farm as well on policy level. Sustaining the production ability and good health of the soil the chemical, physical and biological indicators should be taken into account. The system to use soil chemical parameters is usually quite well established in most European counties, including Estonia. However, measuring soil physical properties, such bulk density, porosity, penetration resistance, structural stability ect is time consuming, needs special tools and is highly weather dependent. In that reason these parameters are excluded from controllable quality parameters in policy in Estonia. Within the project "Interactive Soil Quality Assessment in Europe and China for Agricultural Productivity and Environmental Resilience" (iSQAPER) the visual soil assessment (VSA) tool was developed for easy detection of soil quality as well the different soil friendly agricultural management practices (AMP) were detected. The aim of current study was to test the VSA tool on Estonian farm fields under different management practices and compare the results with laboratory measurements. The main focus was set on soil physical parameters. Next to the VSA, the undisturbed soil samples were collected from the depth of 5-10 cm and 25-30 cm. The study revealed that results of a visually assessed soil physical parameters, such a soil structure, soil structural stability, soil porosity, presence of tillage pan, were confirmed by laboratory measurements in most cases. Soil water stable structure measurement on field (on 1 cm2 net in one 1 l box with 4-6 cm air dry clods for 5-10 min) underestimated very well structured soil on grassland and overestimated the structure aggregates stability of compacted soil. The slightly better soil quality was detected under no-tillage compared to ploughed soils. However, the ploughed soil got higher quality points compared with minimum tillage. The slurry application (organic manuring) had

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

PubMed

Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

2016-07-01

To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

Development of a context specific accreditation assessment tool for affirming quality midwifery education in Bangladesh.

PubMed

Bogren, Malin; Sathyanarayanan Doraiswamy; Erlandsson, Kerstin; Akhter, Halima; Akter, Dalia; Begum, Momtaz; Chowdhury, Merry; Das, Lucky; Akter, Rehana; Begum, Sufia; Akter, Renoara; Yesmin, Syeada; Khatun, Yamin Ara

2018-06-01

using the International Confederation of Midwives (ICM) Global Standards for Midwifery Education as a conceptual framework, the aim of this study was to explore and describe important 'must haves' for inclusion in a context-specific accreditation assessment tool in Bangladesh. A questionnaire study was conducted using a Likert rating scale and 111 closed-response single items on adherence to accreditation-related statements, ending with an open-ended question. The ICM Global Standards guided data collection, deductive content analysis and description of the quantitative results. twenty-five public institutes/colleges (out of 38 in Bangladesh), covering seven out of eight geographical divisions in the country. one hundred and twenty-three nursing educators teaching the 3-year diploma midwifery education programme. this study provides insight into the development of a context-specific accreditation assessment tool for Bangladesh. Important components to be included in this accreditation tool are presented under the following categories and domains: 'organization and administration', 'midwifery faculty', 'student body', 'curriculum content', 'resources, facilities and services' and 'assessment strategies'. The identified components were a prerequisite to ensure that midwifery students achieve the intended learning outcomes of the midwifery curriculum, and hence contribute to a strong midwifery workforce. The components further ensure well-prepared teachers and a standardized curriculum supported at policy level to enable effective deployment of professional midwives in the existing health system. as part of developing an accreditation assessment tool, it is imperative to build ownership and capacity when translating the ICM Global Standards for Midwifery Education into the national context. this initiative can be used as lessons learned from Bangladesh to develop a context-specific accreditation assessment tool in line with national priorities, supporting the

Assessing the Nutritional Quality of Diets of Canadian Adults Using the 2014 Health Canada Surveillance Tool Tier System.

PubMed

Jessri, Mahsa; Nishi, Stephanie K; L'Abbé, Mary R

2015-12-12

The 2014 Health Canada Surveillance Tool (HCST) was developed to assess adherence of dietary intakes with Canada's Food Guide. HCST classifies foods into one of four Tiers based on thresholds for sodium, total fat, saturated fat and sugar, with Tier 1 representing the healthiest and Tier 4 foods being the unhealthiest. This study presents the first application of HCST to assess (a) dietary patterns of Canadians; and (b) applicability of this tool as a measure of diet quality among 19,912 adult participants of Canadian Community Health Survey 2.2. Findings indicated that even though most of processed meats and potatoes were Tier 4, the majority of reported foods in general were categorized as Tiers 2 and 3 due to the adjustable lenient criteria used in HCST. Moving from the 1st to the 4th quartile of Tier 4 and "other" foods/beverages, there was a significant trend towards increased calories (1876 kcal vs. 2290 kcal) and "harmful" nutrients (e.g., sodium) as well as decreased "beneficial" nutrients. Compliance with the HCST was not associated with lower body mass index. Future nutrient profiling systems need to incorporate both "positive" and "negative" nutrients, an overall score and a wider range of nutrient thresholds to better capture food product differences.

Multicomponent Musculoskeletal Movement Assessment Tools: A Systematic Review and Critical Appraisal of Their Development and Applicability to Professional Practice.

PubMed

Bennett, Hunter; Davison, Kade; Arnold, John; Slattery, Flynn; Martin, Max; Norton, Kevin

2017-10-01

Multicomponent movement assessment tools have become commonplace to measure movement quality, proposing to indicate injury risk and performance capabilities. Despite popular use, there has been no attempt to compare the components of each tool reported in the literature, the processes in which they were developed, or the underpinning rationale for their included content. As such, the objective of this systematic review was to provide a comprehensive summary of current movement assessment tools and appraise the evidence supporting their development. A systematic literature search was performed using PRISMA guidelines to identify multicomponent movement assessment tools. Commonalities between tools and the evidence provided to support the content of each tool was identified. Each tool underwent critical appraisal to identify the rigor in which it was developed, and its applicability to professional practice. Eleven tools were identified, of which 5 provided evidence to support their content as assessments of movement quality. One assessment tool (Soccer Injury Movement Screen [SIMS]) received an overall score of above 65% on critical appraisal, with a further 2 tools (Movement Competency Screen [MCS] and modified 4 movement screen [M4-MS]) scoring above 60%. Only the MCS provided clear justification for its developmental process. The remaining 8 tools scored between 40 and 60%. On appraisal, the MCS, M4-MS, and SIMS seem to provide the most practical value for assessing movement quality as they provide the strongest reports of developmental rigor and an identifiable evidence base. In addition, considering the evidence provided, these tools may have the strongest potential for identifying performance capabilities and guiding exercise prescription in athletic and sport-specific populations.

Data Center IT Equipment Energy Assessment Tools: Current State of Commercial Tools, Proposal for a Future Set of Assessment Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Radhakrishnan, Ben D.

2012-06-30

This research project, which was conducted during the Summer and Fall of 2011, investigated some commercially available assessment tools with a focus on IT equipment to see if such tools could round out the DC Pro tool suite. In this research, the assessment capabilities of the various tools were compiled to help make “non-biased” information available to the public. This research should not be considered to be exhaustive on all existing vendor tools although a number of vendors were contacted. Large IT equipment OEM’s like IBM and Dell provide their proprietary internal automated software which does not work on anymore » other IT equipment. However, found two companies with products that showed promise in performing automated assessments for IT equipment from different OEM vendors. This report documents the research and provides a list of software products reviewed, contacts and websites, product details, discussions with specific companies, a set of recommendations, and next steps. As a result of this research, a simple 3-level approach to an IT assessment tool is proposed along with an example of an assessment using a simple IT equipment data collection tool (Level 1, spreadsheet). The tool has been reviewed with the Green Grid and LBNL staff. The initial feedback has been positive although further refinement to the tool will be necessary. Proposed next steps include a field trial of at least two vendors’ software in two different data centers with an objective to prove the concept, ascertain the extent of energy and computational assessment, ease of installation and opportunities for continuous improvement. Based on the discussions, field trials (or case studies) are proposed with two vendors – JouleX (expected to be completed in 2012) and Sentilla.« less

Assessing the Validity of the Qualistar Early Learning Quality Rating and Improvement System as a Tool for Improving Child-Care Quality

ERIC Educational Resources Information Center

Zellman, Gail L.; Perlman, Michal; Le, Vi-Nhuan; Setodji, Claude Messan

2008-01-01

As a result of the generally low quality of child care in the United States and the increased emphasis on accountability in education policy, quality rating systems (QRSs) are proliferating in the child-care arena. QRSs assess child-care providers on multiple dimensions of quality and integrate these assessments into an easily understood summary…

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

ABISM: an interactive image quality assessment tool for adaptive optics instruments

NASA Astrophysics Data System (ADS)

Girard, Julien H.; Tourneboeuf, Martin

2016-07-01

ABISM (Automatic Background Interactive Strehl Meter) is a interactive tool to evaluate the image quality of astronomical images. It works on seeing-limited point spread functions (PSF) but was developed in particular for diffraction-limited PSF produced by adaptive optics (AO) systems. In the VLT service mode (SM) operations framework, ABISM is designed to help support astronomers or telescope and instruments operators (TIOs) to quickly measure the Strehl ratio (SR) during or right after an observing block (OB) to evaluate whether it meets the requirements/predictions or whether is has to be repeated and will remain in the SM queue. It's a Python-based tool with a graphical user interface (GUI) that can be used with little AO knowledge. The night astronomer (NA) or Telescope and Instrument Operator (TIO) can launch ABISM in one click and the program is able to read keywords from the FITS header to avoid mistakes. A significant effort was also put to make ABISM as robust (and forgiven) with a high rate of repeatability. As a matter of fact, ABISM is able to automatically correct for bad pixels, eliminate stellar neighbours and estimate/fit properly the background, etc.

Guidance on Data Quality Assessment for Life Cycle Inventory ...

EPA Pesticide Factsheets

Data quality within Life Cycle Assessment (LCA) is a significant issue for the future support and development of LCA as a decision support tool and its wider adoption within industry. In response to current data quality standards such as the ISO 14000 series, various entities within the LCA community have developed different methodologies to address and communicate the data quality of Life Cycle Inventory (LCI) data. Despite advances in this field, the LCA community is still plagued by the lack of reproducible data quality results and documentation. To address these issues, US EPA has created this guidance in order to further support reproducible life cycle inventory data quality results and to inform users of the proper application of the US EPA supported data quality system. The work for this report was begun in December 2014 and completed as of April 2016.The updated data quality system includes a novel approach to the pedigree matrix by addressing data quality at the flow and the process level. Flow level indicators address source reliability, temporal correlation, geographic correlation, technological correlation and data sampling methods. The process level indicators address the level of review the unit process has undergone and its completeness. This guidance is designed to be updatable as part of the LCA Research Center’s continuing commitment to data quality advancements. Life cycle assessment is increasingly being used as a tool to identify areas of

Use of dietary assessment tools in randomized trials evaluating diet-based interventions in pregnancy: a systematic review of literature.

PubMed

Al Wattar, Bassel H; Mylrea-Lowndes, Bronacha; Morgan, Catrin; Moore, Amanda P; Thangaratinam, Shakila

2016-12-01

Accurate assessment of dietary intake in interventional trials is the key to evaluate changes in dietary behaviour and compliance. We evaluated the use of dietary assessment tools in randomized trials on diet-based interventions in pregnancy by a systematic review. We updated our previous search (until January 2012) on trials of diet and lifestyle interventions in pregnancy using Medline and EMBASE up to December 2015. Two independent reviewers undertook study selection and data extraction. We assessed the characteristics of dietary assessment tools, the timing and frequency of use and any validation undertaken.Two-thirds (39/58, 67%) of the included studies used some form of tools to assess dietary intake. Multiple days' food diaries were the most commonly used (23/39, 59%). Three studies (3/39, 8%) validated the used tools in a pregnant population. Three studies (3/39, 8%) prespecified the criteria for adherence to the intervention. The use of dietary assessment tools was not associated with study quality, year of publication, journal impact factor, type of journal and the study sample size. Although self-reporting dietary assessment tools are widely used in interventional dietary trials in pregnancy, the quality and applicability of existing tools are low.

The Use of UV-Visible Reflectance Spectroscopy as an Objective Tool to Evaluate Pearl Quality

PubMed Central

Agatonovic-Kustrin, Snezana; Morton, David W.

2012-01-01

Assessing the quality of pearls involves the use of various tools and methods, which are mainly visual and often quite subjective. Pearls are normally classified by origin and are then graded by luster, nacre thickness, surface quality, size, color and shape. The aim of this study was to investigate the capacity of Artificial Neural Networks (ANNs) to classify and estimate the quality of 27 different pearls from their UV-Visible spectra. Due to the opaque nature of pearls, spectroscopy measurements were performed using the Diffuse Reflectance UV-Visible spectroscopy technique. The spectra were acquired at two different locations on each pearl sample in order to assess surface homogeneity. The spectral data (inputs) were smoothed to reduce the noise, fed into ANNs and correlated to the pearl’s quality/grading criteria (outputs). The developed ANNs were successful in predicting pearl type, mollusk growing species, possible luster and color enhancing, donor condition/type, recipient/host color, donor color, pearl luster, pearl color, origin. The results of this study shows that the developed UV-Vis spectroscopy-ANN method could be used as a more objective method of assessing pearl quality (grading) and may become a valuable tool for the pearl grading industry. PMID:22851919

A Quality Classroom: Quality Teaching Tools That Facilitate Student Success.

ERIC Educational Resources Information Center

Cooke, Brian

This presentation described practical applications and quality tools for educators that are based on original classroom research and the theories of motivation, learning, profound knowledge, systems thinking, and service quality advanced by Karl Albrecht, William Glasser, and W. Edwards Deming. The presentation was conducted in a way that…

[The National Database of the Regional Collaborative Rheumatic Centers as a tool for clinical epidemiology and quality assessment in rheumatology].

PubMed

Zink, Angela; Huscher, Dörte; Listing, Joachim

2003-01-01

The national database of the German Collaborative Arthritis Centres is a well-established tool for the observation and assessment of health care delivery to patients with rheumatic diseases in Germany. The discussion of variations in treatment practices contributes to the internal quality assessment in the participating arthritis centres. This documentation has shown deficits in primary health care including late referral to a rheumatologist, undertreatment with disease-modifying drugs and complementary therapies. In rheumatology, there is a trend towards early, intensive medical treatment including combination therapy. The frequency and length of inpatient hospital and rehabilitation treatments is decreasing, while active physiotherapy in outpatient care has been increased. Specific deficits have been identified concerning the provision of occupational therapy services and patient education.

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

Quality Assessment of Collection 6 MODIS Atmospheric Science Products

NASA Astrophysics Data System (ADS)

Manoharan, V. S.; Ridgway, B.; Platnick, S. E.; Devadiga, S.; Mauoka, E.

2015-12-01

Since the launch of the NASA Terra and Aqua satellites in December 1999 and May 2002, respectively, atmosphere and land data acquired by the MODIS (Moderate Resolution Imaging Spectroradiometer) sensor on-board these satellites have been reprocessed five times at the MODAPS (MODIS Adaptive Processing System) located at NASA GSFC. The global land and atmosphere products use science algorithms developed by the NASA MODIS science team investigators. MODAPS completed Collection 6 reprocessing of MODIS Atmosphere science data products in April 2015 and is currently generating the Collection 6 products using the latest version of the science algorithms. This reprocessing has generated one of the longest time series of consistent data records for understanding cloud, aerosol, and other constituents in the earth's atmosphere. It is important to carefully evaluate and assess the quality of this data and remove any artifacts to maintain a useful climate data record. Quality Assessment (QA) is an integral part of the processing chain at MODAPS. This presentation will describe the QA approaches and tools adopted by the MODIS Land/Atmosphere Operational Product Evaluation (LDOPE) team to assess the quality of MODIS operational Atmospheric products produced at MODAPS. Some of the tools include global high resolution images, time series analysis and statistical QA metrics. The new high resolution global browse images with pan and zoom have provided the ability to perform QA of products in real time through synoptic QA on the web. This global browse generation has been useful in identifying production error, data loss, and data quality issues from calibration error, geolocation error and algorithm performance. A time series analysis for various science datasets in the Level-3 monthly product was recently developed for assessing any long term drifts in the data arising from instrument errors or other artifacts. This presentation will describe and discuss some test cases from the

Report Central: quality reporting tool in an electronic health record.

PubMed

Jung, Eunice; Li, Qi; Mangalampalli, Anil; Greim, Julie; Eskin, Michael S; Housman, Dan; Isikoff, Jeremy; Abend, Aaron H; Middleton, Blackford; Einbinder, Jonathan S

2006-01-01

Quality reporting tools, integrated with ambulatory electronic health records, can help clinicians and administrators understand performance, manage populations, and improve quality. Report Central is a secure web report delivery tool built on Crystal Reports XItrade mark and ASP.NET technologies. Pilot evaluation of Report Central indicates that clinicians prefer a quality reporting tool that is integrated with our home-grown EHR to support clinical workflow.

Report Central: Quality Reporting Tool in an Electronic Health Record

PubMed Central

Jung, Eunice; Li, Qi; Mangalampalli, Anil; Greim, Julie; Eskin, Michael S.; Housman, Dan; Isikoff, Jeremy; Abend, Aaron H.; Middleton, Blackford; Einbinder, Jonathan S.

2006-01-01

Quality reporting tools, integrated with ambulatory electronic health records, can help clinicians and administrators understand performance, manage populations, and improve quality. Report Central is a secure web report delivery tool built on Crystal Reports XI™ and ASP.NET technologies. Pilot evaluation of Report Central indicates that clinicians prefer a quality reporting tool that is integrated with our home-grown EHR to support clinical workflow. PMID:17238590

Median of patient results as a tool for assessment of analytical stability.

PubMed

Jørgensen, Lars Mønster; Hansen, Steen Ingemann; Petersen, Per Hyltoft; Sölétormos, György

2015-06-15

In spite of the well-established external quality assessment and proficiency testing surveys of analytical quality performance in laboratory medicine, a simple tool to monitor the long-term analytical stability as a supplement to the internal control procedures is often needed. Patient data from daily internal control schemes was used for monthly appraisal of the analytical stability. This was accomplished by using the monthly medians of patient results to disclose deviations from analytical stability, and by comparing divergences with the quality specifications for allowable analytical bias based on biological variation. Seventy five percent of the twenty analytes achieved on two COBASs INTEGRA 800 instruments performed in accordance with the optimum and with the desirable specifications for bias. Patient results applied in analytical quality performance control procedures are the most reliable sources of material as they represent the genuine substance of the measurements and therefore circumvent the problems associated with non-commutable materials in external assessment. Patient medians in the monthly monitoring of analytical stability in laboratory medicine are an inexpensive, simple and reliable tool to monitor the steadiness of the analytical practice. Copyright © 2015 Elsevier B.V. All rights reserved.

Diabetes care may be improved with Steno Quality Assurance Tool--a self-assessment tool in diabetes management.

PubMed

Bjerre-Christensen, Ulla; Nielsen, Annemette Anker; Binder, Christian; Hansen, Jes B; Eldrup, Ebbe

2014-08-01

To evaluate if improvements in the quality of diabetes care in Indian clinics can be obtained by simple self-surveillance PC-based software. Nineteen Indian diabetes clinics were introduced to the principles of quality assurance (QA), and to a software program, the Steno Quality Assurance Tool (SQAT). Data was entered for an initial 3 months period. Subsequently data were analyzed by the users, who designed plans to improve indicator status and set goals for the upcoming period. A second data entry period followed after 7-9 months. QA data was analyzed from 4487 T2DM patients (baseline) and 4440 (follow-up). The average examination frequency per clinic of the following indicators increased significantly: lipid examination (72-87%) (p=0.007), foot examination (80-94%) (p=0.02), HbA1c investigation (59-77%) (p=0.006), and urine albumin excretion investigation (72-87%) (p=0.006). Outcome parameters also improved significantly: mean (SD) fasting and post prandial BG reduced from 144(16) to 132(16)mg/dl (p=0.02) and 212(24)-195(29)mg/dl (p=0.03), respectively. Systolic BP reduced from 139(6) to 133(4) (p=0.0008)mmHg and diastolic BP from 83(3) to 81(3)mmHg (p=0.002). Quality of diabetes care can be improved by applying SQAT, a QA self-surveillance software that enables documentation of changes in process and outcome indicators. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Assessing the quality of cost management

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fayne, V.; McAllister, A.; Weiner, S.B.

1995-12-31

Managing environmental programs can be effective only when good cost and cost-related management practices are developed and implemented. The Department of Energy`s Office of Environmental Management (EM), recognizing this key role of cost management, initiated several cost and cost-related management activities including the Cost Quality Management (CQM) Program. The CQM Program includes an assessment activity, Cost Quality Management Assessments (CQMAs), and a technical assistance effort to improve program/project cost effectiveness. CQMAs provide a tool for establishing a baseline of cost-management practices and for measuring improvement in those practices. The result of the CQMA program is an organization that has anmore » increasing cost-consciousness, improved cost-management skills and abilities, and a commitment to respond to the public`s concerns for both a safe environment and prudent budget outlays. The CQMA program is part of the foundation of quality management practices in DOE. The CQMA process has contributed to better cost and cost-related management practices by providing measurements and feedback; defining the components of a quality cost-management system; and helping sites develop/improve specific cost-management techniques and methods.« less

Validity evidence as a key marker of quality of technical skill assessment in OTL-HNS.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2018-01-13

Quality monitoring of assessment practices should be a priority in all residency programs. Validity evidence is one of the main hallmarks of assessment quality and should be collected to support the interpretation and use of assessment data. Our objective was to identify, synthesize, and present the validity evidence reported supporting different technical skill assessment tools in otolaryngology-head and neck surgery (OTL-HNS). We performed a secondary analysis of data generated through a systematic review of all published tools for assessing technical skills in OTL-HNS (n = 16). For each tool, we coded validity evidence according to the five types of evidence described by the American Educational Research Association's interpretation of Messick's validity framework. Descriptive statistical analyses were conducted. All 16 tools included in our analysis were supported by internal structure and relationship to variables validity evidence. Eleven articles presented evidence supporting content. Response process was discussed only in one article, and no study reported on evidence exploring consequences. We present the validity evidence reported for 16 rater-based tools that could be used for work-based assessment of OTL-HNS residents in the operating room. The articles included in our review were consistently deficient in evidence for response process and consequences. Rater-based assessment tools that support high-stakes decisions that impact the learner and programs should include several sources of validity evidence. Thus, use of any assessment should be done with careful consideration of the context-specific validity evidence supporting score interpretation, and we encourage deliberate continual assessment quality-monitoring. NA. Laryngoscope, 2018. © 2018 The American Laryngological, Rhinological and Otological Society, Inc.

THE ATMOSPHERIC MODEL EVALUATION TOOL (AMET); AIR QUALITY MODULE

EPA Science Inventory

This presentation reviews the development of the Atmospheric Model Evaluation Tool (AMET) air quality module. The AMET tool is being developed to aid in the model evaluation. This presentation focuses on the air quality evaluation portion of AMET. Presented are examples of the...

Quality assessment of a sample of mobile app-based health behavior change interventions using a tool based on the National Institute of Health and Care Excellence behavior change guidance.

PubMed

McMillan, Brian; Hickey, Eamonn; Patel, Mahendra G; Mitchell, Caroline

2016-03-01

To quality assess a sample of health behavior change apps from the NHS Apps Library using a rating tool based on the 2014 National Institute for Health and Care Excellence behavior change guidance (NICE BCG). A qualitative analysis of the NICE BCG identified themes and questions for a quality assessment of health behavior change apps. These were refined by further discussion and piloting, and applied by two independent raters to a sample of NHS Library apps (N=49). Disagreements were resolved following discussions with a third rater. Themes identified were; purpose, planning, usability, tailoring, behavior change technique (BCT), maintenance, evaluation, data security and documentation. Overall, purpose of the apps was clear, but evidence for collaboration with users or professionals was lacking. Usability information was poor and tailoring disappointing. Most used recognized BCTs but paid less attention to behavior maintenance than initiation. Information on app evaluation and documentation was sparse. This study furthers the work of the NHS Apps Library, adapting the NICE (2014) behavior change guidance for quality assessment of behavior change apps. This study helps lay the foundations for development of a quality assurance tool for mobile health apps aimed at health behavior change. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Assessing the Nutritional Quality of Diets of Canadian Adults Using the 2014 Health Canada Surveillance Tool Tier System

PubMed Central

Jessri, Mahsa; Nishi, Stephanie K.; L’Abbé, Mary R.

2015-01-01

The 2014 Health Canada Surveillance Tool (HCST) was developed to assess adherence of dietary intakes with Canada’s Food Guide. HCST classifies foods into one of four Tiers based on thresholds for sodium, total fat, saturated fat and sugar, with Tier 1 representing the healthiest and Tier 4 foods being the unhealthiest. This study presents the first application of HCST to assess (a) dietary patterns of Canadians; and (b) applicability of this tool as a measure of diet quality among 19,912 adult participants of Canadian Community Health Survey 2.2. Findings indicated that even though most of processed meats and potatoes were Tier 4, the majority of reported foods in general were categorized as Tiers 2 and 3 due to the adjustable lenient criteria used in HCST. Moving from the 1st to the 4th quartile of Tier 4 and “other” foods/beverages, there was a significant trend towards increased calories (1876 kcal vs. 2290 kcal) and “harmful” nutrients (e.g., sodium) as well as decreased “beneficial” nutrients. Compliance with the HCST was not associated with lower body mass index. Future nutrient profiling systems need to incorporate both “positive” and “negative” nutrients, an overall score and a wider range of nutrient thresholds to better capture food product differences. PMID:26703721

Tool for assessing health and equity impacts of interventions modifying air quality in urban environments.

PubMed

Cartier, Yuri; Benmarhnia, Tarik; Brousselle, Astrid

2015-12-01

Urban outdoor air pollution (AP) is a major public health concern but the mechanisms by which interventions impact health and social inequities are rarely assessed. Health and equity impacts of policies and interventions are questioned, but managers and policy agents in various institutional contexts have very few practical tools to help them better orient interventions in sectors other than the health sector. Our objective was to create such a tool to facilitate the assessment of health impacts of urban outdoor AP interventions by non-public health experts. An iterative process of reviewing the academic literature, brainstorming, and consultation with experts was used to identify the chain of effects of urban outdoor AP and the major modifying factors. To test its applicability, the tool was applied to two interventions, the London Low Emission Zone and the Montréal BIXI public bicycle-sharing program. We identify the chain of effects, six categories of modifying factors: those controlling the source of emissions, the quantity of emissions, concentrations of emitted pollutants, their spatial distribution, personal exposure, and individual vulnerability. Modifiable and non-modifiable factors are also identified. Results are presented in the text but also graphically, as we wanted it to be a practical tool, from pollution sources to emission, exposure, and finally, health effects. The tool represents a practical first step to assessing AP-related interventions for health and equity impacts. Understanding how different factors affect health and equity through air pollution can provide insight to city policymakers pursuing Health in All Policies. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Measuring the quality of Hospital Food Services: Development and reliability of a Meal Quality Audit Tool.

PubMed

Banks, Merrilyn; Hannan-Jones, Mary; Ross, Lynda; Buckley, Ann; Ellick, Jennifer; Young, Adrienne

2017-04-01

To develop and test the reliability of a Meal Quality Audit Tool (MQAT) to audit the quality of hospital meals to assist food service managers and dietitians in identifying areas for improvement. The MQAT was developed using expert opinion and was modified over time with extensive use and feedback. A phased approach was used to assess content validity and test reliability: (i) trial with 60 dietetic students, (ii) trial with 12 food service dietitians in practice and (iii) interrater reliability study. Phases 1 and 2 confirmed content validity and informed minor revision of scoring, language and formatting of the MQAT. To assess reliability of the final MQAT, eight separate meal quality audits of five identical meals were conducted over several weeks in the hospital setting. Each audit comprised an 'expert' team and four 'test' teams (dietitians, food services and ward staff). Interrater reliability was determined using intra-class correlation analysis. There was statistically significant interrater reliability for dimensions of Temperature and Accuracy (P < 0.001) but not for Appearance or Sensory. Composition of the 'test' team appeared to influence results for Appearance and Sensory, with food service-led teams scoring higher on these dimensions. 'Test' teams reported that MQAT was clear and easy to use. MQAT was found to be reliable for Temperature and Accuracy domains, with further work required to improve the reliability of the Appearance and Sensory dimensions. The systematic use of the tool, used in conjunction with patient satisfaction, could provide pertinent and useful information regarding the quality of food services and areas for improvement. © 2017 Dietitians Association of Australia.

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

PubMed Central

Wind, Stefanie A.; Engelhard, George

2015-01-01

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rater-mediated assessments involve complex interactions among many variables, including assessment contexts, student artifacts, rubrics, individual rater characteristics, and others, rater-assigned scores are suitable candidates for Mokken scale analysis. The purposes of this study are to describe a suite of indices that can be used to explore the psychometric quality of data from rater-mediated assessments and to illustrate the substantive interpretation of Mokken-based statistics and displays in this context. Techniques that are commonly used in polytomous applications of Mokken scaling are adapted for use with rater-mediated assessments, with a focus on the substantive interpretation related to individual raters. Overall, the findings suggest that indices of rater monotonicity, rater scalability, and invariant rater ordering based on Mokken scaling provide diagnostic information at the level of individual raters related to the requirements for invariant measurement. These Mokken-based indices serve as an additional suite of diagnostic tools for exploring the quality of data from rater-mediated assessments that can supplement rating quality indices based on parametric models. PMID:29795883

Ecological Indication, Bioaccumulation, and Phytoremediation as Tools for Environmental Quality Management

DTIC Science & Technology

2004-12-01

ECOLOGICAL INDICATION, BIOACCUMULATION, AND PHYTOREMEDIATION AS TOOLS FOR ENVIRONMENTAL QUALITY MANAGEMENT ELLY P. H. BEST1, HENRY E. TATEM1...subsequent transport to shoots, and degradation, or prevent contaminants from leaving the site in whatever form, such as leachate , runoff, trophic...transfer ( phytoremediation ). We use risk assessment to evaluate the toxicity and need for cleanup. Cleanup costs are expected to greatly exceed the cost

An Integrative Review of Pediatric Fall Risk Assessment Tools.

PubMed

DiGerolamo, Kimberly; Davis, Katherine Finn

Patient fall prevention begins with accurate risk assessment. However, sustained improvements in prevention and quality of care include use of validated fall risk assessment tools (FRATs). The goal of FRATs is to identify patients at highest risk. Adult FRATs are often borrowed from to create tools for pediatric patients. Though factors associated with pediatric falls in the hospital setting are similar to those in adults, such as mobility, medication use, and cognitive impairment, adult FRATs and the factors associated with them do not adequately assess risk in children. Articles were limited to English language, ages 0-21years, and publish date 2006-2015. The search yielded 22 articles. Ten were excluded as the population was primarily adult or lacked discussion of a FRAT. Critical appraisal and findings were synthesized using the Johns Hopkins Nursing evidence appraisal system. Twelve articles relevant to fall prevention in the pediatric hospital setting that discussed fall risk assessment and use of a FRAT were reviewed. Comparison between and accuracy of FRATs is challenged when different classifications, definitions, risk stratification, and inclusion criteria are used. Though there are several pediatric FRATs published in the literature, none have been found to be reliable and valid across institutions and diverse populations. This integrative review highlights the importance of choosing a FRAT based on an institution's identified risk factors and validating the tool for one's own patient population as well as using the tool in conjunction with nursing clinical judgment to guide interventions. Copyright © 2017 Elsevier Inc. All rights reserved.

Deconstruction Rapid Assessment Tool

EPA Pesticide Factsheets

Deconstruction Rapid Assessment Tool (EPA 905-F-15-001) instructions, form and spreadsheet for assessing and triaging structures being considered for deconstruction. Promote environmental stewardship and economic revitalization through deconstruction.

AIR QUALITY ASSESSMENT IN USA - TECHNICAL TOOLS AND LINKAGE TO HUMAN HEALTH

EPA Science Inventory

This is an invited presentation to the Air4EU Final Conference to held in Prague, Czech Republic, on 10 November 2006. Air4EU is a jointly-sponsored, three-year European effort to provide recommendations on air quality assessment by monitoring and modeling for regulated pollutan...

Spreadsheet Assessment Tool v. 2.4

DOE Office of Scientific and Technical Information (OSTI.GOV)

Allen, David J.; Martinez, Ruben

2016-03-03

The Spreadsheet Assessment Tool (SAT) is an easy to use, blast assessment tool that is intended to estimate the potential risk due to an explosive attack on a blood irradiator. The estimation of risk is based on the methodology, assumptions, and results of a detailed blast effects assessment study that is summarized in Sandia National Laboratories Technical Report SAND2015-6166. Risk as defined in the report and as used in the SAT is: "The potential risk of creating an air blast-induced vent opening at a buildings envelope surface". Vent openings can be created at a buildings envelope through the failure ofmore » an exterior building component—like a wall, window, or door—due to an explosive sabotage of an irradiator within the building. To estimate risk, the tool requires that users obtain and input information pertaining to the building's characteristics and the irradiator location. The tool also suggests several prescriptive mitigation strategies that can be considered to reduce risk. Given the variability in civilian building construction practices, the input parameters used by this tool may not apply to all buildings being assessed. The tool should not be used as a substitute for engineering judgment. The tool is intended for assessment purposes only.« less

Assessment Tools for Adult Education.

ERIC Educational Resources Information Center

Shefrin, Carol; Shafer, Dehra; Forlizzi, Lori

The Assessment Tools for Adult Education project was designed to provide training and support to staff of the Pennsylvania Bureau of Adult Basic and Literacy Education (ABLE) funded programs to help them use assessment tools and procedures to document the learning gains of the adult students they serve. The following candidate assessment…

Development of a methodological tool for the assessment of the hydromorphological conditions of lakes in Europe

NASA Astrophysics Data System (ADS)

Gay, Aurore; Argillier, Christine; Reynaud, Nathalie; Nicolas, Delphine; Baudoin, Jean-Marc

2017-04-01

The assessment of the ecological status of surface waters considering the biological, physico-chemical and hydromorphological conditions is requested by the European Water Framework Directive (WFD). If research efforts have particularly concentrated on rivers, lakes have yet received less attention. Nevertheless, due to their function of receptacles of inland waters, the habitats they provide to an important biodiversity and the numerous services they support (water supply, recreational activities, hydroelectricity), assessing the ecological quality of lakes becomes crucial for their protection. Still, this task remains challenging, especially considering the hydromorphological compartments. Indeed, while promising tools already exist to assess the lake biological and physico-chemical status, our comprehension of the impact of hydromophological impairments on the global ecosystem functioning remains poor and existing tools to assess such impacts often focus only on morphological aspects and in a qualitative rather than quantitative way. In this context, our study aims at providing stakeholders with a methodology to assess quantitatively the hydrological and morphological quality of lakes in Europe. The developed methodology, LAKe HYdromorphological Conditions tool (LAKHYC tool) is based on our current knowledge of the functioning of lakes and pre-existing works (e.g., Rowan et al., 2012; Rinaldi et al., 2013). The LAKHYC tool integrates the six parameters requested by the WFD, each one being assessed by at least three descriptors that are calculated as Ecological Quality Ratios, i.e. as the deviation from a reference condition. The originality of the present method lies in the fact that specific reference conditions are defined for each descriptor. In this way, we avoid using a predetermined set of lakes considered as not impacted by human activities and which often corresponds to natural lakes in specific areas (e.g., mountains) and do not represent the diversity

Service quality assessment of workers compensation health care delivery programs in New York using SERVQUAL.

PubMed

Arunasalam, Mark; Paulson, Albert; Wallace, William

2003-01-01

Preferred provider organizations (PPOs) provide healthcare services to an expanding proportion of the U.S. population. This paper presents a programmatic assessment of service quality in the workers' compensation environment using two different models: the PPO program model and the fee-for-service (FFS) payor model. The methodology used here will augment currently available research in workers' compensation, which has been lacking in measuring service quality determinants and assessing programmatic success/failure of managed care type programs. Results indicated that the SERVQUAL tool provided a reliable and valid clinical quality assessment tool that ascertained that PPO marketers should focus on promoting physician outreach (to show empathy) and accessibility (to show reliability) for injured workers.

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Quality control and quality assurance plan for bridge channel-stability assessments in Massachusetts

USGS Publications Warehouse

Parker, Gene W.; Pinson, Harlow

1993-01-01

A quality control and quality assurance plan has been implemented as part of the Massachusetts bridge scour and channel-stability assessment program. This program is being conducted by the U.S. Geological Survey, Massachusetts-Rhode Island District, in cooperation with the Massachusetts Highway Department. Project personnel training, data-integrity verification, and new data-management technologies are being utilized in the channel-stability assessment process to improve current data-collection and management techniques. An automated data-collection procedure has been implemented to standardize channel-stability assessments on a regular basis within the State. An object-oriented data structure and new image management tools are used to produce a data base enabling management of multiple data object classes. Data will be reviewed by assessors and data base managers before being merged into a master bridge-scour data base, which includes automated data-verification routines.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

A probabilistic-based approach to monitoring tool wear state and assessing its effect on workpiece quality in nickel-based alloys

NASA Astrophysics Data System (ADS)

Akhavan Niaki, Farbod

The objective of this research is first to investigate the applicability and advantage of statistical state estimation methods for predicting tool wear in machining nickel-based superalloys over deterministic methods, and second to study the effects of cutting tool wear on the quality of the part. Nickel-based superalloys are among those classes of materials that are known as hard-to-machine alloys. These materials exhibit a unique combination of maintaining their strength at high temperature and have high resistance to corrosion and creep. These unique characteristics make them an ideal candidate for harsh environments like combustion chambers of gas turbines. However, the same characteristics that make nickel-based alloys suitable for aggressive conditions introduce difficulties when machining them. High strength and low thermal conductivity accelerate the cutting tool wear and increase the possibility of the in-process tool breakage. A blunt tool nominally deteriorates the surface integrity and damages quality of the machined part by inducing high tensile residual stresses, generating micro-cracks, altering the microstructure or leaving a poor roughness profile behind. As a consequence in this case, the expensive superalloy would have to be scrapped. The current dominant solution for industry is to sacrifice the productivity rate by replacing the tool in the early stages of its life or to choose conservative cutting conditions in order to lower the wear rate and preserve workpiece quality. Thus, monitoring the state of the cutting tool and estimating its effects on part quality is a critical task for increasing productivity and profitability in machining superalloys. This work aims to first introduce a probabilistic-based framework for estimating tool wear in milling and turning of superalloys and second to study the detrimental effects of functional state of the cutting tool in terms of wear and wear rate on part quality. In the milling operation, the

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017

Water Quality Analysis Tool (WQAT)

EPA Science Inventory

The purpose of the Water Quality Analysis Tool (WQAT) software is to provide a means for analyzing and producing useful remotely sensed data products for an entire estuary, a particular point or area of interest (AOI or POI) in estuaries, or water bodies of interest where pre-pro...

Using Quality Tools and Methodologies to Improve a Hospital's Quality Position.

PubMed

Branco, Daniel; Wicks, Angela M; Visich, John K

2017-01-01

The authors identify the quality tools and methodologies most frequently used by quality-positioned hospitals versus nonquality hospitals. Northeastern U.S. hospitals in both groups received a brief, 12-question survey. The authors found that 93.75% of the quality hospitals and 81.25% of the nonquality hospitals used some form of process improvement methodologies. However, there were significant differences between the groups regarding the impact of quality improvement initiatives on patients. The findings indicate that in quality hospitals the use of quality improvement initiatives had a significantly greater positive impact on patient satisfaction and patient outcomes when compared to nonquality hospitals.

Evaluation of the Iconic Pain Assessment Tool by a heterogeneous group of people in pain

PubMed Central

Lalloo, Chitra; Henry, James L

2011-01-01

The Iconic Pain Assessment Tool (IPAT) is a novel web-based instrument for the self-report of pain quality, intensity and location in the form of a permanent diary. Originally designed for people with central poststroke pain, the tool is being adapted for a larger, more diverse patient population. The present study aimed to collect evaluative feedback on the IPAT from a heterogeneous sample of individuals with chronic pain. The specific study aims were to evaluate participant comfort with the tool including enjoyment, ease of use and comfort with the electronic medium; to assess perceived value of the tool for communicating pain quality, intensity and location; to gauge participant intent to share their pain diaries with others and use the tool on a regular basis to track their pain over time; to assess the perceived descriptiveness of current IPAT icons and the numerical rating scale; and to identify strengths and weaknesses of the tool to refine the existing prototype. Written and verbal feedback from individuals with a variety of chronic pain conditions (n=23) were collected in the context of these objectives. Overall, the IPAT was positively endorsed by this heterogeneous sample of people in pain. The authors concluded that the IPAT is a user-friendly instrument that has the potential to help people express, document and share their personal experience with chronic pain. PMID:21369536

Methodological Quality Assessment of Meta-Analyses of Hyperthyroidism Treatment.

PubMed

Qin, Yahong; Yao, Liang; Shao, Feifei; Yang, Kehu; Tian, Limin

2018-01-01

Hyperthyroidism is a common condition that is associated with increased morbidity and mortality. A number of meta-analyses (MAs) have assessed the therapeutic measures for hyperthyroidism, including antithyroid drugs, surgery, and radioiodine, however, the methodological quality has not been evaluated. This study evaluated the methodological quality and summarized the evidence obtained from MAs of hyperthyroidism treatments for radioiodine, antithyroid drugs, and surgery. We searched the PubMed, EMBASE, Cochrane Library, Web of Science, and Chinese Biomedical Literature Database databases. Two investigators independently assessed the meta-analyses titles and abstracts for inclusion. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. A total of 26 MAs fulfilled the inclusion criteria. Based on the AMSTAR scores, the average methodological quality was 8.31, with large variability ranging from 4 to 11. The methodological quality of English meta-analyses was better than that of Chinese meta-analyses. Cochrane reviews had better methodological quality than non-Cochrane reviews due to better study selection and data extraction, the inclusion of unpublished studies, and better reporting of study characteristics. The authors did not report conflicts of interest in 53.8% meta-analyses, and 19.2% did not report the harmful effects of treatment. Publication bias was not assessed in 38.5% of meta-analyses, and 19.2% did not report the follow-up time. Large-scale assessment of methodological quality of meta-analyses of hyperthyroidism treatment highlighted methodological strengths and weaknesses. Consideration of scientific quality when formulating conclusions should be made explicit. Future meta-analyses should improve on reporting conflict of interest. © Georg Thieme Verlag KG Stuttgart · New York.

A software tool for ecosystem services assessments

NASA Astrophysics Data System (ADS)

Riegels, Niels; Klinting, Anders; Butts, Michael; Middelboe, Anne Lise; Mark, Ole

2017-04-01

proposed project can be estimated to determine whether the project affects drivers, pressures, states or a combination of these. • In part III, information about impacts on drivers, pressures, and states is used to identify ESS impacted by a proposed project. Potential beneficiaries of impacted ESS are also identified. • In part IV, changes in ESS are estimated. These estimates include changes in the provision of ESS, the use of ESS, and the value of ESS. • A sustainability assessment in Part V estimates the broader impact of a proposed project according to social, environmental, governance and other criteria. The ESS evaluation software tool is designed to assist an evaluation or study leader carrying out an ESS assessment. The tool helps users move through the logic of the ESS evaluation and make sense of relationships between elements of the DPSIR framework, the CICES classification scheme, and the FEGS approach. The tool also provides links to useful indicators and assessment methods in order to help users quantify changes in ESS and ESS values. The software tool is developed in collaboration with the DESSIN user group, who will use the software to estimate changes in ESS resulting from the implementation of green technologies addressing water quality and water scarcity issues. Although the software is targeted to this user group, it will be made available for free to the public after the conclusion of the project.

Continuous Quality Improvement Tools for Effective Teaching.

ERIC Educational Resources Information Center

Cornesky, Robert A.

This manual presents 15 Continuous Quality Improvement (CQI) tools and techniques necessary for effective teaching. By using the tools and techniques of CQI, teachers will be able to help themselves and their students to focus on the classroom processes. This will permit the teacher and students to plan, organize, implement, and make decisions…

Criteria for assessing the quality of mHealth apps: a systematic review.

PubMed

Nouri, Rasool; R Niakan Kalhori, Sharareh; Ghazisaeedi, Marjan; Marchand, Guillaume; Yasini, Mobin

2018-05-16

Review the existing studies including an assessment tool/method to assess the quality of mHealth apps; extract their criteria; and provide a classification of the collected criteria. In accordance with the PRISMA statement, a literature search was conducted in MEDLINE, EMBase, ISI and Scopus for English language citations published from January 1, 2008 to December 22, 2016 for studies including tools or methods for quality assessment of mHealth apps. Two researchers screened the titles and abstracts of all retrieved citations against the inclusion and exclusion criteria. The full text of relevant papers was then individually examined by the same researchers. A senior researcher resolved eventual disagreements and confirmed the relevance of all included papers. The authors, date of publication, subject fields of target mHealth apps, development method, and assessment criteria were extracted from each paper. The extracted assessment criteria were then reviewed, compared, and classified by an expert panel of two medical informatics specialists and two health information management specialists. Twenty-three papers were included in the review. Thirty-eight main classes of assessment criteria were identified. These were reorganized by expert panel into 7 main classes (Design, Information/Content, Usability, Functionality, Ethical Issues, Security and Privacy, and User-perceived value) with 37 sub-classes of criteria. There is a wide heterogeneity in assessment criteria for mHealth apps. It is necessary to define the exact meanings and degree of distinctness of each criterion. This will help to improve the existing tools and may lead to achieve a better comprehensive mHealth app assessment tool.

Self-Report Dietary Assessment Tools Used in Canadian Research: A Scoping Review123

PubMed Central

Vanderlee, Lana; Raffoul, Amanda; Stapleton, Jackie; Csizmadi, Ilona; Boucher, Beatrice A; Massarelli, Isabelle; Rondeau, Isabelle

2017-01-01

Choosing the most appropriate dietary assessment tool for a study can be a challenge. Through a scoping review, we characterized self-report tools used to assess diet in Canada to identify patterns in tool use and to inform strategies to strengthen nutrition research. The research databases Medline, PubMed, PsycINFO, and CINAHL were used to identify Canadian studies published from 2009 to 2014 that included a self-report assessment of dietary intake. The search elicited 2358 records that were screened to identify those that reported on self-report dietary intake among nonclinical, non-Aboriginal adult populations. A pool of 189 articles (reflecting 92 studies) was examined in-depth to assess the dietary assessment tools used. Food-frequency questionnaires (FFQs) and screeners were used in 64% of studies, whereas food records and 24-h recalls were used in 18% and 14% of studies, respectively. Three studies (3%) used a single question to assess diet, and for 3 studies the tool used was not clear. A variety of distinct FFQs and screeners, including those developed and/or adapted for use in Canada and those developed elsewhere, were used. Some tools were reported to have been evaluated previously in terms of validity or reliability, but details of psychometric testing were often lacking. Energy and fat were the most commonly studied, reported by 42% and 39% of studies, respectively. For ∼20% of studies, dietary data were used to assess dietary quality or patterns, whereas close to half assessed ≤5 dietary components. A variety of dietary assessment tools are used in Canadian research. Strategies to improve the application of current evidence on best practices in dietary assessment have the potential to support a stronger and more cohesive literature on diet and health. Such strategies could benefit from national and global collaboration. PMID:28298272

Orion Entry Handling Qualities Assessments

NASA Technical Reports Server (NTRS)

Bihari, B.; Tiggers, M.; Strahan, A.; Gonzalez, R.; Sullivan, K.; Stephens, J. P.; Hart, J.; Law, H., III; Bilimoria, K.; Bailey, R.

2011-01-01

The Orion Command Module (CM) is a capsule designed to bring crew back from the International Space Station (ISS), the moon and beyond. The atmospheric entry portion of the flight is deigned to be flown in autopilot mode for nominal situations. However, there exists the possibility for the crew to take over manual control in off-nominal situations. In these instances, the spacecraft must meet specific handling qualities criteria. To address these criteria two separate assessments of the Orion CM s entry Handling Qualities (HQ) were conducted at NASA s Johnson Space Center (JSC) using the Cooper-Harper scale (Cooper & Harper, 1969). These assessments were conducted in the summers of 2008 and 2010 using the Advanced NASA Technology Architecture for Exploration Studies (ANTARES) six degree of freedom, high fidelity Guidance, Navigation, and Control (GN&C) simulation. This paper will address the specifics of the handling qualities criteria, the vehicle configuration, the scenarios flown, the simulation background and setup, crew interfaces and displays, piloting techniques, ratings and crew comments, pre- and post-fight briefings, lessons learned and changes made to improve the overall system performance. The data collection tools, methods, data reduction and output reports will also be discussed. The objective of the 2008 entry HQ assessment was to evaluate the handling qualities of the CM during a lunar skip return. A lunar skip entry case was selected because it was considered the most demanding of all bank control scenarios. Even though skip entry is not planned to be flown manually, it was hypothesized that if a pilot could fly the harder skip entry case, then they could also fly a simpler loads managed or ballistic (constant bank rate command) entry scenario. In addition, with the evaluation set-up of multiple tasks within the entry case, handling qualities ratings collected in the evaluation could be used to assess other scenarios such as the constant bank angle

MODIS imagery as a tool for synoptic water quality assessments in the southern California coastal ocean

USGS Publications Warehouse

Nezlin, N.P.; DiGiacomo, P.M.; Jones, B.H.; Reifel, K.M.; Warrick, J.A.; Johnson, S.C.; Mengel, M.J.

2007-01-01

The dynamics of rainstorm plumes in the coastal waters of southern California was studied during the Bight'03 Regional Water Quality Program surveys. Measurements of surface salinity and bacterial counts collected from research vessels were compared to MODIS-Aqua satellite imagery. The spectra of normalized water-leaving radiation (nLw) were different in plumes and ambient ocean waters, enabling plumes discrimination and plume area size assessments from remotely-sensed data. The plume/ocean nLw differences (i.e., plume optical signatures) were most evident during first days after the rainstorm over the San Pedro shelf and in the San Diego region and less evident in Santa Monica Bay, where suspended sediments concentration in discharged water was lower than in other regions. In the Ventura area, plumes contained more suspended sediments than in other regions, but the grid of ship-based stations covered only a small part of the freshwater plume and was insufficient to reveal the differences between the plume and ocean optical signatures. The accuracy of plume area assessments from satellite imagery was not high (77% on average), seemingly because of inexactitude in satellite data processing. Nevertheless, satellite imagery is a useful tool for the estimation of the extent of polluted plumes, which is hardly achievable by contact methods.

Tools for proactive collection and use of quality metadata in GEOSS

NASA Astrophysics Data System (ADS)

Bastin, L.; Thum, S.; Maso, J.; Yang, K. X.; Nüst, D.; Van den Broek, M.; Lush, V.; Papeschi, F.; Riverola, A.

2012-12-01

The GEOSS Common Infrastructure allows interactive evaluation and selection of Earth Observation datasets by the scientific community and decision makers, but the data quality information needed to assess fitness for use is often patchy and hard to visualise when comparing candidate datasets. In a number of studies over the past decade, users repeatedly identified the same types of gaps in quality metadata, specifying the need for enhancements such as peer and expert review, better traceability and provenance information, information on citations and usage of a dataset, warning about problems identified with a dataset and potential workarounds, and 'soft knowledge' from data producers (e.g. recommendations for use which are not easily encoded using the existing standards). Despite clear identification of these issues in a number of recommendations, the gaps persist in practice and are highlighted once more in our own, more recent, surveys. This continuing deficit may well be the result of a historic paucity of tools to support the easy documentation and continual review of dataset quality. However, more recent developments in tools and standards, as well as more general technological advances, present the opportunity for a community of scientific users to adopt a more proactive attitude by commenting on their uses of data, and for that feedback to be federated with more traditional and static forms of metadata, allowing a user to more accurately assess the suitability of a dataset for their own specific context and reliability thresholds. The EU FP7 GeoViQua project aims to develop this opportunity by adding data quality representations to the existing search and visualisation functionalities of the Geo Portal. Subsequently we will help to close the gap by providing tools to easily create quality information, and to permit user-friendly exploration of that information as the ultimate incentive for improved data quality documentation. Quality information is derived

33 CFR 101.510 - Assessment tools.

Code of Federal Regulations, 2010 CFR

2010-07-01

... may include: (a) DHS/TSA's vulnerability self-assessment tool located at http://www.tsa.gov/risk; and (b) USCG assessment tools, available from the cognizant COTP or at http://www.uscg.mil/hq/g-m/nvic...

Automated Assessment of the Quality of Depression Websites

PubMed Central

Tang, Thanh Tin; Hawking, David; Christensen, Helen

2005-01-01

Background Since health information on the World Wide Web is of variable quality, methods are needed to assist consumers to identify health websites containing evidence-based information. Manual assessment tools may assist consumers to evaluate the quality of sites. However, these tools are poorly validated and often impractical. There is a need to develop better consumer tools, and in particular to explore the potential of automated procedures for evaluating the quality of health information on the web. Objective This study (1) describes the development of an automated quality assessment procedure (AQA) designed to automatically rank depression websites according to their evidence-based quality; (2) evaluates the validity of the AQA relative to human rated evidence-based quality scores; and (3) compares the validity of Google PageRank and the AQA as indicators of evidence-based quality. Method The AQA was developed using a quality feedback technique and a set of training websites previously rated manually according to their concordance with statements in the Oxford University Centre for Evidence-Based Mental Health’s guidelines for treating depression. The validation phase involved 30 websites compiled from the DMOZ, Yahoo! and LookSmart Depression Directories by randomly selecting six sites from each of the Google PageRank bands of 0, 1-2, 3-4, 5-6 and 7-8. Evidence-based ratings from two independent raters (based on concordance with the Oxford guidelines) were then compared with scores derived from the automated AQA and Google algorithms. There was no overlap in the websites used in the training and validation phases of the study. Results The correlation between the AQA score and the evidence-based ratings was high and significant (r=0.85, P<.001). Addition of a quadratic component improved the fit, the combined linear and quadratic model explaining 82 percent of the variance. The correlation between Google PageRank and the evidence-based score was lower than

Improving the Efficiency and Quality of the Value Assessment Process for Companion Diagnostic Tests: The Companion test Assessment Tool (CAT).

PubMed

Canestaro, William J; Pritchard, Daryl E; Garrison, Louis P; Dubois, Robert; Veenstra, David L

2015-08-01

Companion diagnostic tests (CDTs) have emerged as a vital technology in the effective use of an increasing number of targeted drug therapies. Although CDTs can offer a multitude of potential benefits, assessing their value within a health technology appraisal process can be challenging because of a complex array of factors that influence clinical and economic outcomes. To develop a user-friendly tool to assist managed care and other health care decision makers in screening companion tests and determining whether an intensive technology review is necessary and, if so, where the review should be focused to improve efficiency. First, we conducted a systematic literature review of CDT cost-effectiveness studies to identify value drivers. Second, we conducted key informant interviews with a diverse group of stakeholders to elicit feedback and solicit any additional value drivers and identify desirable attributes for an evidence review tool. A draft tool was developed based on this information that captured value drivers, usability features, and had a particular focus on practical use by nonexperts. Finally, the tool was pilot tested with test developers and managed care evidence evaluators to assess face-validity and usability. The tool was also evaluated using several diverse examples of existing companion diagnostics and refined accordingly. We identified 65 cost-effectiveness studies of companion diagnostic technologies. The following factors were most commonly identified as value drivers from our literature review: clinical validity of testing; efficacy, safety, and cost of baseline and alternative treatments; cost and mortality of health states; and biomarker prevalence and testing cost. Stakeholders identified the following additional factors that they believed influenced the overall value of a companion test: regulatory status, actionability, utility, and market penetration. These factors were used to maximize the efficiency of the evidence review process

Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS)

PubMed Central

Downes, Martin J; Brennan, Marnie L; Williams, Hywel C; Dean, Rachel S

2016-01-01

Objectives The aim of this study was to develop a critical appraisal (CA) tool that addressed study design and reporting quality as well as the risk of bias in cross-sectional studies (CSSs). In addition, the aim was to produce a help document to guide the non-expert user through the tool. Design An initial scoping review of the published literature and key epidemiological texts was undertaken prior to the formation of a Delphi panel to establish key components for a CA tool for CSSs. A consensus of 80% was required from the Delphi panel for any component to be included in the final tool. Results An initial list of 39 components was identified through examination of existing resources. An international Delphi panel of 18 medical and veterinary experts was established. After 3 rounds of the Delphi process, the Appraisal tool for Cross-Sectional Studies (AXIS tool) was developed by consensus and consisted of 20 components. A detailed explanatory document was also developed with the tool, giving expanded explanation of each question and providing simple interpretations and examples of the epidemiological concepts being examined in each question to aid non-expert users. Conclusions CA of the literature is a vital step in evidence synthesis and therefore evidence-based decision-making in a number of different disciplines. The AXIS tool is therefore unique and was developed in a way that it can be used across disciplines to aid the inclusion of CSSs in systematic reviews, guidelines and clinical decision-making. PMID:27932337

Multiscale visual quality assessment for cluster analysis with self-organizing maps

NASA Astrophysics Data System (ADS)

Bernard, Jürgen; von Landesberger, Tatiana; Bremm, Sebastian; Schreck, Tobias

2011-01-01

Cluster analysis is an important data mining technique for analyzing large amounts of data, reducing many objects to a limited number of clusters. Cluster visualization techniques aim at supporting the user in better understanding the characteristics and relationships among the found clusters. While promising approaches to visual cluster analysis already exist, these usually fall short of incorporating the quality of the obtained clustering results. However, due to the nature of the clustering process, quality plays an important aspect, as for most practical data sets, typically many different clusterings are possible. Being aware of clustering quality is important to judge the expressiveness of a given cluster visualization, or to adjust the clustering process with refined parameters, among others. In this work, we present an encompassing suite of visual tools for quality assessment of an important visual cluster algorithm, namely, the Self-Organizing Map (SOM) technique. We define, measure, and visualize the notion of SOM cluster quality along a hierarchy of cluster abstractions. The quality abstractions range from simple scalar-valued quality scores up to the structural comparison of a given SOM clustering with output of additional supportive clustering methods. The suite of methods allows the user to assess the SOM quality on the appropriate abstraction level, and arrive at improved clustering results. We implement our tools in an integrated system, apply it on experimental data sets, and show its applicability.

Developing a tool for assessing competency in root cause analysis.

PubMed

Gupta, Priyanka; Varkey, Prathibha

2009-01-01

Root cause analysis (RCA) is a tool for identifying the key cause(s) contributing to a sentinel event or near miss. Although training in RCA is gaining popularity in medical education, there is no published literature on valid or reliable methods for assessing competency in the same. A tool for assessing competency in RCA was pilot tested as part of an eight-station Objective Structured Clinical Examination that was conducted at the completion of a three-week quality improvement (QI) curriculum for the Mayo Clinic Preventive Medicine and Endocrinology fellowship programs. As part of the curriculum, fellows completed a QI project to enhance physician communication of the diagnosis and treatment plan at the end of a patient visit. They had a didactic session on RCA, followed by process mapping of the information flow at the project clinic, after which fellows conducted an actual RCA using the Ishikawa fishbone diagram. For the RCA competency assessment, fellows performed an RCA regarding a scenario describing an adverse medication event and provided possible solutions to prevent such errors in the future. All faculty strongly agreed or agreed that they were able to accurately assess competency in RCA using the tool. Interrater reliability for the global competency rating and checklist scoring were 0.96 and 0.85, respectively. Internal consistency (Cronbach's alpha) was 0.76. Six of eight of the fellows found the difficulty level of the test to be optimal. Assessment methods must accompany education programs to ensure that graduates are competent in QI methodologies and are able to apply them effectively in the workplace. The RCA assessment tool was found to be a valid, reliable, feasible, and acceptable method for assessing competency in RCA. Further research is needed to examine its predictive validity and generalizability.

Quality Assurance Project Plan Development Tool

EPA Pesticide Factsheets

This tool contains information designed to assist in developing a Quality Assurance (QA) Project Plan that meets EPA requirements for projects that involve surface or groundwater monitoring and/or the collection and analysis of water samples.

Quality tools and resources to support organisational improvement integral to high-quality primary care: a systematic review of published and grey literature.

PubMed

Janamian, Tina; Upham, Susan J; Crossland, Lisa; Jackson, Claire L

2016-04-18

To conduct a systematic review of the literature to identify existing online primary care quality improvement tools and resources to support organisational improvement related to the seven elements in the Primary Care Practice Improvement Tool (PC-PIT), with the identified tools and resources to progress to a Delphi study for further assessment of relevance and utility. Systematic review of the international published and grey literature. CINAHL, Embase and PubMed databases were searched in March 2014 for articles published between January 2004 and December 2013. GreyNet International and other relevant websites and repositories were also searched in March-April 2014 for documents dated between 1992 and 2012. All citations were imported into a bibliographic database. Published and unpublished tools and resources were included in the review if they were in English, related to primary care quality improvement and addressed any of the seven PC-PIT elements of a high-performing practice. Tools and resources that met the eligibility criteria were then evaluated for their accessibility, relevance, utility and comprehensiveness using a four-criteria appraisal framework. We used a data extraction template to systematically extract information from eligible tools and resources. A content analysis approach was used to explore the tools and resources and collate relevant information: name of the tool or resource, year and country of development, author, name of the organisation that provided access and its URL, accessibility information or problems, overview of each tool or resource and the quality improvement element(s) it addresses. If available, a copy of the tool or resource was downloaded into the bibliographic database, along with supporting evidence (published or unpublished) on its use in primary care. This systematic review identified 53 tools and resources that can potentially be provided as part of a suite of tools and resources to support primary care practices in

A Proposal for Assessing Study Quality: Biomonitoring, Environmental Epidemiology, and Short-Lived Chemicals (BEES-C) Instrument

EPA Science Inventory

The quality of exposure assessment is a major determinant of the overall quality of any environmental epidemiology study. The use of biomonitoring as a tool for assessing exposure to ubiquitous chemicals with short physiologic half-lives began relatively recently. These chemicals...

Resource Assessment and Tools

USDA-ARS?s Scientific Manuscript database

Various resource assessment strategies and tools are needed to ensure bioenergy feedstock materials are produced, harvested, and transported in a sustainable manner. This presentation highlights research accomplishments by the USDA-ARS Renewable Energy Assessment Project (REAP) team along with our u...

Web-based decision support and visualization tools for water quality management in the Chesapeake Bay watershed

USGS Publications Warehouse

Mullinix, C.; Hearn, P.; Zhang, H.; Aguinaldo, J.

2009-01-01

Federal, State, and local water quality managers charged with restoring the Chesapeake Bay ecosystem require tools to maximize the impact of their limited resources. To address this need, the U.S. Geological Survey (USGS) and the Environmental Protection Agency's Chesapeake Bay Program (CBP) are developing a suite of Web-based tools called the Chesapeake Online Assessment Support Toolkit (COAST). The goal of COAST is to help CBP partners identify geographic areas where restoration activities would have the greatest effect, select the appropriate management strategies, and improve coordination and prioritization among partners. As part of the COAST suite of tools focused on environmental restoration, a water quality management visualization component called the Nutrient Yields Mapper (NYM) tool is being developed by USGS. The NYM tool is a web application that uses watershed yield estimates from USGS SPAtially Referenced Regressions On Watershed (SPARROW) attributes model (Schwarz et al., 2006) [6] to allow water quality managers to identify important sources of nitrogen and phosphorous within the Chesapeake Bay watershed. The NYM tool utilizes new open source technologies that have become popular in geospatial web development, including components such as OpenLayers and GeoServer. This paper presents examples of water quality data analysis based on nutrient type, source, yield, and area of interest using the NYM tool for the Chesapeake Bay watershed. In addition, we describe examples of map-based techniques for identifying high and low nutrient yield areas; web map engines; and data visualization and data management techniques.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments.

PubMed

Langer, Astrid

2012-08-16

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies

A comparison of sleep assessment tools by nurses and patients in critical care.

PubMed

Richardson, Annette; Crow, Wendy; Coghill, Elaine; Turnock, Christopher

2007-09-01

methods of physiological assessment of sleep. Findings indicate nurses are unable to accurately assess critical care patients' sleep using rating assessment tools. However patients were found to prefer two sleep assessment tools, one banded in hours to assess sleep quantity and one as a comparison against normal sleep to assess sleep quality. This study reviews the importance of sleep assessment and the diverse methods available for assessing sleep focussing on the critically ill patient. More noteworthy it highlights how nurses sole judgements of patients sleep is not a reliable method in clinical practice, however it provides some indication on the application of 'easy to use' tools to assist in the patients assessments of their sleep.

Systematic Sustainability Assessment (SSA) Tool for Hydroelectric Project in Malaysia

NASA Astrophysics Data System (ADS)

Turan, Faiz Mohd; Johan, Kartina

2017-08-01

Sustainably developed and managed hydropower has enormous potential to contribute to global sustainability goals. It is known that hydroelectricity contributing small amounts to greenhouse gas emissions and other atmospheric pollutants. However, developing the remaining hydroelectric potential offers many challenges, and public pressure and expectations on the environmental and social performance of hydroelectric tend to increase over time. This paper aims to develop Systematic Sustainability Assessment (SSA) Tool that promotes and guides more sustainable hydroelectric projects in the context of Malaysia. The proposed SSA tool which not only provide a quality and quantitative report of sustainability performance but also act as Self-Assessment Report (SAR) to provide roadmap to achieve greater level of sustainability in project management for continuous improvement. It is expected to provide a common language that allow government, civil society, financial institutions and the hydroelectric sector to talk about and evaluate sustainability issues. The advantage of SSA tool is it can be used at any stage of hydroelectric development, from the earliest planning stages right through to operation.

Enabling Research Tools for Sustained Climate Assessment

NASA Technical Reports Server (NTRS)

Leidner, Allison K.; Bosilovich, Michael G.; Jasinski, Michael F.; Nemani, Ramakrishna R.; Waliser, Duane Edward; Lee, Tsengdar J.

2016-01-01

The U.S. Global Change Research Program Sustained Assessment process benefits from long-term investments in Earth science research that enable the scientific community to conduct assessment-relevant science. To this end, NASA initiated several research programs over the past five years to support the Earth observation community in developing indicators, datasets, research products, and tools to support ongoing and future National Climate Assessments. These activities complement NASA's ongoing Earth science research programs. One aspect of the assessment portfolio funds four "enabling tools" projects at NASA research centers. Each tool leverages existing capacity within the center, but has developed tailored applications and products for National Climate Assessments. The four projects build on the capabilities of a global atmospheric reanalysis (MERRA-2), a continental U.S. land surface reanalysis (NCA-LDAS), the NASA Earth Exchange (NEX), and a Regional Climate Model Evaluation System (RCMES). Here, we provide a brief overview of each enabling tool, highlighting the ways in which it has advanced assessment science to date. We also discuss how the assessment community can access and utilize these tools for National Climate Assessments and other sustained assessment activities.

Quality assessment of expert answers to lay questions about cystic fibrosis from various language zones in Europe: the ECORN-CF project.

PubMed

d'Alquen, Daniela; De Boeck, Kris; Bradley, Judy; Vávrová, Věra; Dembski, Birgit; Wagner, Thomas O F; Pfalz, Annette; Hebestreit, Helge

2012-02-06

The European Centres of Reference Network for Cystic Fibrosis (ECORN-CF) established an Internet forum which provides the opportunity for CF patients and other interested people to ask experts questions about CF in their mother language. The objectives of this study were to: 1) develop a detailed quality assessment tool to analyze quality of expert answers, 2) evaluate the intra- and inter-rater agreement of this tool, and 3) explore changes in the quality of expert answers over the time frame of the project. The quality assessment tool was developed by an expert panel. Five experts within the ECORN-CF project used the quality assessment tool to analyze the quality of 108 expert answers published on ECORN-CF from six language zones. 25 expert answers were scored at two time points, one year apart. Quality of answers was also assessed at an early and later period of the project. Individual rater scores and group mean scores were analyzed for each expert answer. A scoring system and training manual were developed analyzing two quality categories of answers: content and formal quality. For content quality, the grades based on group mean scores for all raters showed substantial agreement between two time points, however this was not the case for the grades based on individual rater scores. For formal quality the grades based on group mean scores showed only slight agreement between two time points and there was also poor agreement between time points for the individual grades. The inter-rater agreement for content quality was fair (mean kappa value 0.232 ± 0.036, p < 0.001) while only slight agreement was observed for the grades of the formal quality (mean kappa value 0.105 ± 0.024, p < 0.001). The quality of expert answers was rated high (four language zones) or satisfactory (two language zones) and did not change over time. The quality assessment tool described in this study was feasible and reliable when content quality was assessed by a group of raters. Within

Quality Assessment of Information on Bariatric Surgery Websites.

PubMed

Vetter, Diana; Ruhwinkel, Hendrik; Raptis, Dimitri A; Bueter, Marco

2018-05-01

The aim of this study was to assess the quality of patient information on bariatric surgery in the internet using the modified Ensuring Quality Information for Patients (EQIP) tool. Systematic review of information on bariatric surgery in the internet by entering common search terms into five search engines. The top 100 websites of every search term and search engine were assessed using the validated EQIP tool (maximum score, 36), which entails points for content, structure, and identification data of a given website. Websites at or above the 99th percentile were analyzed separately (n = 8). The median EQIP score of all included websites (n = 463) was 17 (IQR 15-19). While information on the medical problem, the indication for surgery, or the treatment alternatives was present in 84% of all websites, only 10% of the included websites contained adequate information on postoperative complications. Although quantitative information on incidence (37.5%) and treatment of complications (12.5%) was significantly better in the top 99th percentile websites, the content of relevant information such as occurrence and treatment of complications was still very limited. The overall quality of patient information on bariatric surgery in the internet is relatively poor. Especially incidence of complications and their treatment are rarely reported even on websites with a 99th percentile EQIP score.

Effectiveness of the Assessment of Burden of COPD (ABC) tool on health-related quality of life in patients with COPD: a cluster randomised controlled trial in primary and hospital care

PubMed Central

Slok, Annerika H M; Kotz, Daniel; van Breukelen, Gerard; Chavannes, Niels H; Rutten-van Mölken, Maureen P M H; Kerstjens, Huib A M; van der Molen, Thys; Asijee, Guus M; Dekhuijzen, P N Richard; Holverda, Sebastiaan; Salomé, Philippe L; Goossens, Lucas M A; Twellaar, Mascha; in ‘t Veen, Johannes C C M; van Schayck, Onno C P

2016-01-01

Objective Assessing the effectiveness of the Assessment of Burden of COPD (ABC) tool on disease-specific quality of life in patients with chronic obstructive pulmonary disease (COPD) measured with the St. George's Respiratory Questionnaire (SGRQ), compared with usual care. Methods A pragmatic cluster randomised controlled trial, in 39 Dutch primary care practices and 17 hospitals, with 357 patients with COPD (postbronchodilator FEV1/FVC ratio <0.7) aged ≥40 years, who could understand and read the Dutch language. Healthcare providers were randomly assigned to the intervention or control group. The intervention group applied the ABC tool, which consists of a short validated questionnaire assessing the experienced burden of COPD, objective COPD parameter (eg, lung function) and a treatment algorithm including a visual display and treatment advice. The control group provided usual care. Researchers were blinded to group allocation during analyses. Primary outcome was the number of patients with a clinically relevant improvement in SGRQ score between baseline and 18-month follow-up. Secondary outcomes were the COPD Assessment Test (CAT) and the Patient Assessment of Chronic Illness Care (PACIC; a measurement of perceived quality of care). Results At 18-month follow-up, 34% of the 146 patients from 27 healthcare providers in the intervention group showed a clinically relevant improvement in the SGRQ, compared with 22% of the 148 patients from 29 healthcare providers in the control group (OR 1.85, 95% CI 1.08 to 3.16). No difference was found on the CAT (−0.26 points (scores ranging from 0 to 40); 95% CI −1.52 to 0.99). The PACIC showed a higher improvement in the intervention group (0.32 points (scores ranging from 1 to 5); 95% CI 0.14 to 0.50). Conclusions This study showed that use of the ABC tool may increase quality of life and perceived quality of care. Trial registration number NTR3788; Results. PMID:27401361

An overview of systematic reviews of complementary and alternative therapies for fibromyalgia using both AMSTAR and ROBIS as quality assessment tools.

PubMed

Perry, Rachel; Leach, Verity; Davies, Philippa; Penfold, Chris; Ness, Andy; Churchill, Rachel

2017-05-15

Fibromyalgia (FM) is a chronic, debilitating pain disorder. Dissatisfaction with conventional medicine can lead people with FM to turn to complementary and alternative medicine (CAM). Two previous overviews of systematic reviews of CAM for FM have been published, but they did not assessed for risk of bias in the review process. Five databases Medline, Embase, AMED (via OVID), Web of Science and Central were searched from their inception to December 2015. Reference lists were hand-searched. We had two aims: the first was to provide an up-to-date and rigorously conducted synthesis of systematic reviews of CAM literature on FM; the second was to evaluate the quality of the available systematic review evidence using two different tools: AMSTAR (Shea et al. BMC Med Res Methodol 15; 7:10, 2007) and a more recently developed tool ROBIS (Whiting et al. J Clin Epidemiol 69:225-34, 2016) specifically designed to assess risk of bias in systematic reviews. Any review that assessed one of eight CAM therapies for participants diagnosed with FM was considered. The individual studies had to be randomised controlled trials where the intervention was compared to placebo, treatment as usual or waitlist controls to be included. The primary outcome measure was pain, and the secondary outcome measure was adverse events. We identified 15 reviews that met inclusion criteria. There was low-quality evidence that acupuncture improves pain compared to no treatment or standard treatment, but good evidence that it is no better than sham acupuncture. The evidence for homoeopathy, spinal manipulation and herbal medicine was limited. Overall, five reviews scored 6 or above using the AMSTAR scale and the inter-rater agreement was good (83.6%), whereas seven reviews achieved a low risk of bias rating using ROBIS and the inter-rater agreement was fair (60.0%). No firm conclusions were drawn for efficacy of either spinal manipulation or homoeopathy for FM. There is limited evidence for topical

[Assessment tools in early detection of osteoporosis in dentistry].

PubMed

Knezović Zlatarić, Dubravka; Pandurić, Josip; Korsić, Mirko; Dodig, Damir

2007-03-01

Osteoporosis, one of the major skeletal diseases in older age, is characterised by low bone mass and microarchitectural deterioration with a resulting increase in bone fragility and hence susceptibility to fracture. In this review we analyse the systemic and local factors associated with oral bone mass loss. Systemic factors most often correlated with the oral bone mass loss include osteoporosis, renal diseases, hormonal disorders, diet and the impact of different drugs on the bony structure. Chronic periodontal disease, early loss of teeth or the effect of inadequate prosthodontic appliance on the residual ridge are the local factors associated with mandibular bone loss. Different assessment tools for the assessment of mandibular oral bone loss have been proposed, such as DXA absorptiometry, quantitative computed tomography, intraoral microdensitometry, SCORE index and the assessment of the thickness and quality of the mandibular inferior cortical border. Qualitative and quantitative assessment of the mandibular bony structure is of great importance in all fields of dentistry - from periodontology to endodontics and prosthodontics, especially in dental implantology. It is important to make the correct indication prior to dental implant therapy, and taking into account the systemic and local factors mentioned above, assess both the actual quality and quantity of the mandible.

OCT as a convenient tool to assess the quality and application of organotypic retinal samples

NASA Astrophysics Data System (ADS)

Gater, Rachel; Khoshnaw, Nicholas; Nguyen, Dan; El Haj, Alicia J.; Yang, Ying

2016-03-01

Eye diseases such as macular degeneration and glaucoma have profound consequences on the quality of human life. Without treatment, these diseases can lead to loss of sight. To develop better treatments for retinal diseases, including cell therapies and drug intervention, establishment of an efficient and reproducible 3D native retinal tissue system, enabled over a prolonged culture duration, will be valuable. The retina is a complex tissue, consisting of ten layers with a different density and cellular composition to each. Uniquely, as a light transmitting tissue, retinal refraction of light differs among the layers, forming a good basis to use optical coherence tomography (OCT) in assessing the layered structure of the retina and its change during the culture and treatments. In this study, we develop a new methodology to generate retinal organotypic tissues and compare two substrates: filter paper and collagen hydrogel, to culture the organotypic tissue. Freshly slaughtered pig eyes have been obtained for use in this study. The layered morphology of intact organotypic retinal tissue cultured on two different substrates has been examined by spectral domain OCT. The viability of the tissues has been examined by live/dead fluorescence dye kit to cross validate the OCT images. For the first time, it is demonstrated that the use of a collagen hydrogel supports the viability of retinal organotypic tissue, capable of prolonged culture up to 2 weeks. OCT is a convenient tool for appraising the quality and application of organotypic retinal samples and is important in the development of current organotypic models.

Bioassay battery interlaboratory investigation of emerging contaminants in spiked water extracts - Towards the implementation of bioanalytical monitoring tools in water quality assessment and monitoring.

PubMed

Di Paolo, Carolina; Ottermanns, Richard; Keiter, Steffen; Ait-Aissa, Selim; Bluhm, Kerstin; Brack, Werner; Breitholtz, Magnus; Buchinger, Sebastian; Carere, Mario; Chalon, Carole; Cousin, Xavier; Dulio, Valeria; Escher, Beate I; Hamers, Timo; Hilscherová, Klára; Jarque, Sergio; Jonas, Adam; Maillot-Marechal, Emmanuelle; Marneffe, Yves; Nguyen, Mai Thao; Pandard, Pascal; Schifferli, Andrea; Schulze, Tobias; Seidensticker, Sven; Seiler, Thomas-Benjamin; Tang, Janet; van der Oost, Ron; Vermeirssen, Etienne; Zounková, Radka; Zwart, Nick; Hollert, Henner

2016-11-01

Bioassays are particularly useful tools to link the chemical and ecological assessments in water quality monitoring. Different methods cover a broad range of toxicity mechanisms in diverse organisms, and account for risks posed by non-target compounds and mixtures. Many tests are already applied in chemical and waste assessments, and stakeholders from the science-police interface have recommended their integration in regulatory water quality monitoring. Still, there is a need to address bioassay suitability to evaluate water samples containing emerging pollutants, which are a current priority in water quality monitoring. The presented interlaboratory study (ILS) verified whether a battery of miniaturized bioassays, conducted in 11 different laboratories following their own protocols, would produce comparable results when applied to evaluate blinded samples consisting of a pristine water extract spiked with four emerging pollutants as single chemicals or mixtures, i.e. triclosan, acridine, 17α-ethinylestradiol (EE2) and 3-nitrobenzanthrone (3-NBA). Assays evaluated effects on aquatic organisms from three different trophic levels (algae, daphnids, zebrafish embryos) and mechanism-specific effects using in vitro estrogenicity (ER-Luc, YES) and mutagenicity (Ames fluctuation) assays. The test battery presented complementary sensitivity and specificity to evaluate the different blinded water extract spikes. Aquatic organisms differed in terms of sensitivity to triclosan (algae > daphnids > fish) and acridine (fish > daphnids > algae) spikes, confirming the complementary role of the three taxa for water quality assessment. Estrogenicity and mutagenicity assays identified with high precision the respective mechanism-specific effects of spikes even when non-specific toxicity occurred in mixture. For estrogenicity, although differences were observed between assays and models, EE2 spike relative induction EC 50 values were comparable to the literature, and E2/EE2

C++ software quality in the ATLAS experiment: tools and experience

NASA Astrophysics Data System (ADS)

Martin-Haugh, S.; Kluth, S.; Seuster, R.; Snyder, S.; Obreshkov, E.; Roe, S.; Sherwood, P.; Stewart, G. A.

2017-10-01

In this paper we explain how the C++ code quality is managed in ATLAS using a range of tools from compile-time through to run time testing and reflect on the substantial progress made in the last two years largely through the use of static analysis tools such as Coverity®, an industry-standard tool which enables quality comparison with general open source C++ code. Other available code analysis tools are also discussed, as is the role of unit testing with an example of how the GoogleTest framework can be applied to our codebase.

An Automated Treatment Plan Quality Control Tool for Intensity-Modulated Radiation Therapy Using a Voxel-Weighting Factor-Based Re-Optimization Algorithm.

PubMed

Song, Ting; Li, Nan; Zarepisheh, Masoud; Li, Yongbao; Gautier, Quentin; Zhou, Linghong; Mell, Loren; Jiang, Steve; Cerviño, Laura

2016-01-01

Intensity-modulated radiation therapy (IMRT) currently plays an important role in radiotherapy, but its treatment plan quality can vary significantly among institutions and planners. Treatment plan quality control (QC) is a necessary component for individual clinics to ensure that patients receive treatments with high therapeutic gain ratios. The voxel-weighting factor-based plan re-optimization mechanism has been proved able to explore a larger Pareto surface (solution domain) and therefore increase the possibility of finding an optimal treatment plan. In this study, we incorporated additional modules into an in-house developed voxel weighting factor-based re-optimization algorithm, which was enhanced as a highly automated and accurate IMRT plan QC tool (TPS-QC tool). After importing an under-assessment plan, the TPS-QC tool was able to generate a QC report within 2 minutes. This QC report contains the plan quality determination as well as information supporting the determination. Finally, the IMRT plan quality can be controlled by approving quality-passed plans and replacing quality-failed plans using the TPS-QC tool. The feasibility and accuracy of the proposed TPS-QC tool were evaluated using 25 clinically approved cervical cancer patient IMRT plans and 5 manually created poor-quality IMRT plans. The results showed high consistency between the QC report quality determinations and the actual plan quality. In the 25 clinically approved cases that the TPS-QC tool identified as passed, a greater difference could be observed for dosimetric endpoints for organs at risk (OAR) than for planning target volume (PTV), implying that better dose sparing could be achieved in OAR than in PTV. In addition, the dose-volume histogram (DVH) curves of the TPS-QC tool re-optimized plans satisfied the dosimetric criteria more frequently than did the under-assessment plans. In addition, the criteria for unsatisfied dosimetric endpoints in the 5 poor-quality plans could typically be

An Automated Treatment Plan Quality Control Tool for Intensity-Modulated Radiation Therapy Using a Voxel-Weighting Factor-Based Re-Optimization Algorithm

PubMed Central

Song, Ting; Li, Nan; Zarepisheh, Masoud; Li, Yongbao; Gautier, Quentin; Zhou, Linghong; Mell, Loren; Jiang, Steve; Cerviño, Laura

2016-01-01

Intensity-modulated radiation therapy (IMRT) currently plays an important role in radiotherapy, but its treatment plan quality can vary significantly among institutions and planners. Treatment plan quality control (QC) is a necessary component for individual clinics to ensure that patients receive treatments with high therapeutic gain ratios. The voxel-weighting factor-based plan re-optimization mechanism has been proved able to explore a larger Pareto surface (solution domain) and therefore increase the possibility of finding an optimal treatment plan. In this study, we incorporated additional modules into an in-house developed voxel weighting factor-based re-optimization algorithm, which was enhanced as a highly automated and accurate IMRT plan QC tool (TPS-QC tool). After importing an under-assessment plan, the TPS-QC tool was able to generate a QC report within 2 minutes. This QC report contains the plan quality determination as well as information supporting the determination. Finally, the IMRT plan quality can be controlled by approving quality-passed plans and replacing quality-failed plans using the TPS-QC tool. The feasibility and accuracy of the proposed TPS-QC tool were evaluated using 25 clinically approved cervical cancer patient IMRT plans and 5 manually created poor-quality IMRT plans. The results showed high consistency between the QC report quality determinations and the actual plan quality. In the 25 clinically approved cases that the TPS-QC tool identified as passed, a greater difference could be observed for dosimetric endpoints for organs at risk (OAR) than for planning target volume (PTV), implying that better dose sparing could be achieved in OAR than in PTV. In addition, the dose-volume histogram (DVH) curves of the TPS-QC tool re-optimized plans satisfied the dosimetric criteria more frequently than did the under-assessment plans. In addition, the criteria for unsatisfied dosimetric endpoints in the 5 poor-quality plans could typically be

33 CFR 101.510 - Assessment tools.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 33 Navigation and Navigable Waters 1 2014-07-01 2014-07-01 false Assessment tools. 101.510 Section 101.510 Navigation and Navigable Waters COAST GUARD, DEPARTMENT OF HOMELAND SECURITY MARITIME SECURITY MARITIME SECURITY: GENERAL Other Provisions § 101.510 Assessment tools. Ports, vessels, and facilities...

A scoping review of assessment tools for laparoscopic suturing.

PubMed

Bilgic, Elif; Endo, Satoshi; Lebedeva, Ekaterina; Takao, Madoka; McKendy, Katherine M; Watanabe, Yusuke; Feldman, Liane S; Vassiliou, Melina C

2018-05-03

A needs assessment identified a gap in teaching and assessment of laparoscopic suturing (LS) skills. The purpose of this review is to identify assessment tools that were used to assess LS skills, to evaluate validity evidence available, and to provide guidance for selecting the right assessment tool for specific assessment conditions. Bibliographic databases were searched till April 2017. Full-text articles were included if they reported on assessment tools used in the operating room/simulation to (1) assess procedures that require LS or (2) specifically assess LS skills. Forty-two tools were identified, of which 26 were used for assessing LS skills specifically and 26 for procedures that require LS. Tools had the most evidence in internal structure and relationship to other variables, and least in consequences. Through identification and evaluation of assessment tools, the results of this review could be used as a guideline when implementing assessment tools into training programs.

Improvement of Computer Software Quality through Software Automated Tools.

DTIC Science & Technology

1986-08-31

requirement for increased emphasis on software quality assurance has lead to the creation of various methods of verification and validation. Experience...result was a vast array of methods , systems, languages and automated tools to assist in the process. Given that the primary role of quality assurance is...Unfortunately, there is no single method , tool or technique that can insure accurate, reliable and cost effective software. Therefore, government and industry

Adult orthodontics: a quality assessment of Internet information.

PubMed

McMorrow, Siobhán Mary; Millett, Declan T

2016-09-01

This study evaluated the quality, reliability and readability of information on the Internet on adult orthodontics. A quality assessment of adult orthodontic websites. Postgraduate Orthodontic Unit, Cork University Dental School and Hospital, Cork, Ireland. An Internet search using three search engines (Google, Yahoo and Bing) was conducted using the terms ('adult orthodontics' and 'adult braces'). The first 50 websites from each engine and under each search term were screened and exclusion criteria applied. Included websites were then assessed for quality using four methods: the HON seal, JAMA benchmarks, the DISCERN instrument and the LIDA tool. Readability of included websites was assessed using the Flesch Reading Ease Score (FRES). Only 13 websites met the inclusion criteria. Most were of US origin (n = 8; 61%). The authors of the websites were dentists (n = 5; 39%), professional organizations (n = 2; 15%), past patients (n = 2; 15%) and unspecified (n = 4; 31%). Only 1 website displayed the HON seal and three websites contained all JAMA benchmarks. The mean overall score for DISCERN was 3.9/5 and the mean total LIDA score was 115/144. The average FRES score was 63.1/100. The number of informative websites on adult orthodontics is low and these are of moderate quality. More accurate, high-quality Internet resources are required on adult orthodontics. Recommendations are made as to how this may be achieved.

A novel, fuzzy-based air quality index (FAQI) for air quality assessment

NASA Astrophysics Data System (ADS)

Sowlat, Mohammad Hossein; Gharibi, Hamed; Yunesian, Masud; Tayefeh Mahmoudi, Maryam; Lotfi, Saeedeh

2011-04-01

The ever increasing level of air pollution in most areas of the world has led to development of a variety of air quality indices for estimation of health effects of air pollution, though the indices have their own limitations such as high levels of subjectivity. Present study, therefore, aimed at developing a novel, fuzzy-based air quality index (FAQI ) to handle such limitations. The index developed by present study is based on fuzzy logic that is considered as one of the most common computational methods of artificial intelligence. In addition to criteria air pollutants (i.e. CO, SO 2, PM 10, O 3, NO 2), benzene, toluene, ethylbenzene, xylene, and 1,3-butadiene were also taken into account in the index proposed, because of their considerable health effects. Different weighting factors were then assigned to each pollutant according to its priority. Trapezoidal membership functions were employed for classifications and the final index consisted of 72 inference rules. To assess the performance of the index, a case study was carried out employing air quality data at five different sampling stations in Tehran, Iran, from January 2008 to December 2009, results of which were then compared to the results obtained from USEPA air quality index (AQI). According to the results from present study, fuzzy-based air quality index is a comprehensive tool for classification of air quality and tends to produce accurate results. Therefore, it can be considered useful, reliable, and suitable for consideration by local authorities in air quality assessment and management schemes. Fuzzy-based air quality index (FAQI).

Student self-assessment in an interactive learning environment: Technological tools for scaffolding and understanding self-assessment practices

NASA Astrophysics Data System (ADS)

Eslinger, Eric Martin

Metacognitive skills are a crucial component of a successful learning career. We define metacognition as the ability to plan, monitor progress toward a goal, reflect on the quality of work and process, and revise the work or plan accordingly. By explicitly addressing certain metacognitive practices in classrooms, researchers have observed improved learning outcomes in both science and mathematical problem solving. Although these efforts were successful, they were also limited in the range of skills that could be addressed at one time and the methods used to address them due to the static nature inherent in traditional pencil-and-paper format. We wished to address these skills in a more dynamic, continuous representation such as that afforded by a computerized learning environment. This paper outlines such an environment and describes pedagogical activities afforded by the system. The ThinkerTools group developed and tested a software scaffold for inquiry projects in a middle-school classroom. By analyzing student use of the software tool, three forms of self-assessment activity were noted: integrated, task and project self-assessment. Each assessment form was related to the degree of interleaving between assessment and work the students engaged in as they developed their inquiry products. I argue that the integrated forms of assessment are more beneficial to student learning, and show that there is a significant relationship between active self-assessment forms and measures of student achievement and product quality. Through the use of case studies including video analysis, I address specific student self-assessment activity that utilized the software as well as self-assessment that took place outside of the software. A model of student self-assessment activity was created, highlighting aspects of activity that afford more productive self-assessment episodes.

The Individual Basic Facts Assessment Tool

ERIC Educational Resources Information Center

Tait-McCutcheon, Sandi; Drake, Michael

2015-01-01

There is an identified and growing need for a levelled diagnostic basic facts assessment tool that provides teachers with formative information about students' mastery of a broad range of basic fact sets. The Individual Basic Facts Assessment tool has been iteratively and cumulatively developed, trialled, and refined with input from teachers and…

Use of a quality improvement tool, the prioritization matrix, to identify and prioritize triage software algorithm enhancement.

PubMed

North, Frederick; Varkey, Prathiba; Caraballo, Pedro; Vsetecka, Darlene; Bartel, Greg

2007-10-11

Complex decision support software can require significant effort in maintenance and enhancement. A quality improvement tool, the prioritization matrix, was successfully used to guide software enhancement of algorithms in a symptom assessment call center.

MQAPRank: improved global protein model quality assessment by learning-to-rank.

PubMed

Jing, Xiaoyang; Dong, Qiwen

2017-05-25

Protein structure prediction has achieved a lot of progress during the last few decades and a greater number of models for a certain sequence can be predicted. Consequently, assessing the qualities of predicted protein models in perspective is one of the key components of successful protein structure prediction. Over the past years, a number of methods have been developed to address this issue, which could be roughly divided into three categories: single methods, quasi-single methods and clustering (or consensus) methods. Although these methods achieve much success at different levels, accurate protein model quality assessment is still an open problem. Here, we present the MQAPRank, a global protein model quality assessment program based on learning-to-rank. The MQAPRank first sorts the decoy models by using single method based on learning-to-rank algorithm to indicate their relative qualities for the target protein. And then it takes the first five models as references to predict the qualities of other models by using average GDT_TS scores between reference models and other models. Benchmarked on CASP11 and 3DRobot datasets, the MQAPRank achieved better performances than other leading protein model quality assessment methods. Recently, the MQAPRank participated in the CASP12 under the group name FDUBio and achieved the state-of-the-art performances. The MQAPRank provides a convenient and powerful tool for protein model quality assessment with the state-of-the-art performances, it is useful for protein structure prediction and model quality assessment usages.

Assessing air quality in Aksaray with time series analysis

NASA Astrophysics Data System (ADS)

Kadilar, Gamze Özel; Kadilar, Cem

2017-04-01

Sulphur dioxide (SO2) is a major air pollutant caused by the dominant usage of diesel, petrol and fuels by vehicles and industries. One of the most air-polluted city in Turkey is Aksaray. Hence, in this study, the level of SO2 is analyzed in Aksaray based on the database monitored at air quality monitoring station of Turkey. Seasonal Autoregressive Integrated Moving Average (SARIMA) approach is used to forecast the level of SO2 air quality parameter. The results indicate that the seasonal ARIMA model provides reliable and satisfactory predictions for the air quality parameters and expected to be an alternative tool for practical assessment and justification.

ATACseqQC: a Bioconductor package for post-alignment quality assessment of ATAC-seq data.

PubMed

Ou, Jianhong; Liu, Haibo; Yu, Jun; Kelliher, Michelle A; Castilla, Lucio H; Lawson, Nathan D; Zhu, Lihua Julie

2018-03-01

ATAC-seq (Assays for Transposase-Accessible Chromatin using sequencing) is a recently developed technique for genome-wide analysis of chromatin accessibility. Compared to earlier methods for assaying chromatin accessibility, ATAC-seq is faster and easier to perform, does not require cross-linking, has higher signal to noise ratio, and can be performed on small cell numbers. However, to ensure a successful ATAC-seq experiment, step-by-step quality assurance processes, including both wet lab quality control and in silico quality assessment, are essential. While several tools have been developed or adopted for assessing read quality, identifying nucleosome occupancy and accessible regions from ATAC-seq data, none of the tools provide a comprehensive set of functionalities for preprocessing and quality assessment of aligned ATAC-seq datasets. We have developed a Bioconductor package, ATACseqQC, for easily generating various diagnostic plots to help researchers quickly assess the quality of their ATAC-seq data. In addition, this package contains functions to preprocess aligned ATAC-seq data for subsequent peak calling. Here we demonstrate the utilities of our package using 25 publicly available ATAC-seq datasets from four studies. We also provide guidelines on what the diagnostic plots should look like for an ideal ATAC-seq dataset. This software package has been used successfully for preprocessing and assessing several in-house and public ATAC-seq datasets. Diagnostic plots generated by this package will facilitate the quality assessment of ATAC-seq data, and help researchers to evaluate their own ATAC-seq experiments as well as select high-quality ATAC-seq datasets from public repositories such as GEO to avoid generating hypotheses or drawing conclusions from low-quality ATAC-seq experiments. The software, source code, and documentation are freely available as a Bioconductor package at https://bioconductor.org/packages/release/bioc/html/ATACseqQC.html .

Perceptual tools for quality-aware video networks

NASA Astrophysics Data System (ADS)

Bovik, A. C.

2014-01-01

Monitoring and controlling the quality of the viewing experience of videos transmitted over increasingly congested networks (especially wireless networks) is a pressing problem owing to rapid advances in video-centric mobile communication and display devices that are straining the capacity of the network infrastructure. New developments in automatic perceptual video quality models offer tools that have the potential to be used to perceptually optimize wireless video, leading to more efficient video data delivery and better received quality. In this talk I will review key perceptual principles that are, or could be used to create effective video quality prediction models, and leading quality prediction models that utilize these principles. The goal is to be able to monitor and perceptually optimize video networks by making them "quality-aware."

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

PubMed Central

2012-01-01

Background Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. Methods To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. Results The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. Conclusions The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware

Addendum to Air Quality: Decision Support Tools, Partner Plans, Working Groups, Committees

NASA Technical Reports Server (NTRS)

Holekamp, Kara; Frisbie, Troy; Estep, Lee

2005-01-01

In the original report dated February 11, 2005, the utility of NASA Earth science data in the air quality activities of other agencies and organizations was assessed by reviewing strategic and mission plans and by conducting personal interviews with agency experts to identify and investigate agencies with the potential for partnership with NASA. The overarching agency strategic plans were reviewed and commonalities such as the desire for partnerships and technology development were noted. This addendum to the original report contains such information about the Tennessee Valley Authority and will be inserted as Section 2.6 of "Air Quality: Decision Support Tools, Partner Plans, Working Groups, Committees."

Addendum to Air Quality: Decision Support Tools, Partner Plans, Working Groups, Committees

NASA Technical Reports Server (NTRS)

Holekamp, Kara; Frisbie, Troy; Estep, Lee

2005-01-01

In the original report dated February 11, 2005, the utility of the NASA Earth science data in the air quality activities of other agencies and organizations was assessed by reviewing strategic and mission plans and by conducting personal interviews with agency experts to identify and investigate agencies with the potential for partnership with NASA. The overarching agency strategic plans were reviewed and commonalities such as the desire for partnerships and technology development were noted. The addendum to the original report contains such information about the Tennessee Valley Authority and will be inserted in Section 2.6 of "Air Quality Decision Support Tools, Partner Plans, Working Groups, Committees".

Quality and Efficiency Improvement Tools for Every Radiologist.

PubMed

Kudla, Alexei U; Brook, Olga R

2018-06-01

In an era of value-based medicine, data-driven quality improvement is more important than ever to ensure safe and efficient imaging services. Familiarity with high-value tools enables all radiologists to successfully engage in quality and efficiency improvement. In this article, we review the model for improvement, strategies for measurement, and common practical tools with real-life examples that include Run chart, Control chart (Shewhart chart), Fishbone (Cause-and-Effect or Ishikawa) diagram, Pareto chart, 5 Whys, and Root Cause Analysis. Copyright © 2018 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

An online network tool for quality information to answer questions about occupational safety and health: usability and applicability.

PubMed

Rhebergen, Martijn D F; Hulshof, Carel T J; Lenderink, Annet F; van Dijk, Frank J H

2010-10-22

Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use. Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition

BASINS and WEPP Climate Assessment Tools (CAT): Case ...

EPA Pesticide Factsheets

This draft report supports application of two recently developed water modeling tools, the BASINS and WEPP climate assessment tools. The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments of the potential future effects of climate change on water resources. This report presents a series of short, illustrative case studies using the BASINS and WEPP climate assessment tools.

A comprehensive clinical assessment tool to inform policy and practice: applications of the minimum data set.

PubMed

Mor, Vincent

2004-04-01

The Minimum Data Set (MDS) for nursing home (NH) resident assessment, designed to assess elders functional status and care needs, exemplifies how the information needs of clinical practice are congruent with those of research. Building on a review of the published literature, this article describes the development of the MDS, its reliability and validity testing, as well as the variety of different policy and research uses to which it has been applied. Interrater reliability of items and internal consistency of MDS summary scales is generally good to excellent. Validation studies reveal good correspondence to research quality instruments for cognition, activities of daily living, and diagnoses with more variable results for vision, pain, mood, and behavior scales. To date, no consistent evidence suggests that applications of MDS data for case-mix reimbursement and quality indicator monitoring systematically bias the data. Although facility variation in data quality could compromise some applications, creation of the MDS as a clinical tool for care planning provides an example of how assessment tools with clinical use can be used in administrative databases for research and policy applications.

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

A Methodological Proposal for Learning Games Selection and Quality Assessment

ERIC Educational Resources Information Center

Dondi, Claudio; Moretti, Michela

2007-01-01

This paper presents a methodological proposal elaborated in the framework of two European projects dealing with game-based learning, both of which have focused on "quality" aspects in order to create suitable tools that support European educators, practitioners and lifelong learners in selecting and assessing learning games for use in…

Category 1 external quality assessment program for serum creatinine.

PubMed

González-Lao, Elisabet; Díaz-Garzón, Jorge; Corte, Zoraida; Ricós, Carmen; Perich, Carmen; Álvarez, Virtudes; Simón, Margarita; Minchinela, Joana; García-Lario, José Vicente; Boned, Beatriz; Biosca, Carmen; Cava, Fernando; Fernández-Fernández, Pilar; Fernández-Calle, Pilar

2017-03-01

The Commission of Analytical Quality and the Committee of External Quality Programs of Spanish Society of Laboratory Medicine (SEQC) in collaboration with the Dutch Foundation for the Quality organized the first national category 1 External Quality Assessment Programs (EQAP) pilot study. The aim is to evaluate the standardization of serum creatinine measurements in the Spanish laboratories through a category 1 external quality assurance program with commutable material and reference method assigned values. A total of 87 Spanish laboratories were involved in this program in 2015. Each day a sample control was measured by duplicate during 6 consecutive days. Percentage deviations and coefficients of variation obtained were compared with quality specifications derived from biological variation. A total of 1044 creatinine results were obtained. Laboratories were coded in 11 different method-traceability combinations. Only enzymatic methods get all results within the acceptability limits. To participate in a category 1 EQAP is a valuable tool to assess the standardization degree in our country; a big effort should be made to promote laboratories to change their procedures and to use enzymatic creatinine methods, in order to achieve a satisfactory standardization degree for this important analyte.

Improving the quality of EHR recording in primary care: a data quality feedback tool.

PubMed

van der Bij, Sjoukje; Khan, Nasra; Ten Veen, Petra; de Bakker, Dinny H; Verheij, Robert A

2017-01-01

Electronic health record (EHR) data are used to exchange information among health care providers. For this purpose, the quality of the data is essential. We developed a data quality feedback tool that evaluates differences in EHR data quality among practices and software packages as part of a larger intervention. The tool was applied in 92 practices in the Netherlands using different software packages. Practices received data quality feedback in 2010 and 2012. We observed large differences in the quality of recording. For example, the percentage of episodes of care that had a meaningful diagnostic code ranged from 30% to 100%. Differences were highly related to the software package. A year after the first measurement, the quality of recording had improved significantly and differences decreased, with 67% of the physicians indicating that they had actively changed their recording habits based on the results of the first measurement. About 80% found the feedback helpful in pinpointing recording problems. One of the software vendors made changes in functionality as a result of the feedback. Our EHR data quality feedback tool is capable of highlighting differences among practices and software packages. As such, it also stimulates improvements. As substantial variability in recording is related to the software package, our study strengthens the evidence that data quality can be improved substantially by standardizing the functionalities of EHR software packages. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Quality control troubleshooting tools for the mill floor

Treesearch

John Dramm

2000-01-01

Statistical Process Control (SPC) provides effective tools for improving process quality in the forest products industry resulting in reduced costs and improved productivity. Implementing SPC helps identify and locate problems that occur in wood products manufacturing. SPC tools achieve their real value when applied on the mill floor for monitoring and troubleshooting...

Reporting Quality Assessment of Randomized Controlled Trials Published in Nephrology Urology Monthly Journal.

PubMed

Mehrazmay, Alireza; Karambakhsh, Alireza; Salesi, Mahmood

2015-07-01

Randomized controlled trials (RCTs) are important tools for evidence-based health care decisions. It is, therefore, important that they be conducted and reported with the highest possible standards. The aim of this study was to evaluate the reporting quality of the RCTs published in nephrology urology monthly journal and to examine whether there was a change over time in the reporting quality. The quality of each report was assessed using the Consolidated Standards of Reporting Trials (CONSORT) 2010 Statement checklist and a 5-point quality assessment instrument, i.e. the Jadad scale. Eighteen (14 Iranian and 4 non-Iranian) RCTs were published from 2012 to 2014 on topics including renal stone (16.6%), hemodialysis and transplantation (38.8%), and prostate conditions (11.1%). Interventions comprised surgery, drugs, and teaching method in 7 (38 %), 10 (55%), and 1 (5%) of them, respectively. According to the CONSORT checklist, the weakest reported items were registration number, identification as a randomized trial in the title, and settings and locations where the data were collected. The mean Jadad score of the reports was 2.72 ± 1.36 (54% of their maximum possible total score). According to the Jadad and CONSORT scales, there was an increase in the quality of reporting from 2012 to 2014. This assessment shows low reporting quality scores in reports. Training courses for researchers, using standard reporting tools (e.g. CONSORT 2010 Statement checklist), and consultation with methodologists can improve the quality of published RCTs.

Validity of portfolio assessment: which qualities determine ratings?

PubMed

Driessen, Erik W; Overeem, Karlijn; van Tartwijk, Jan; van der Vleuten, Cees P M; Muijtjens, Arno M M

2006-09-01

The portfolio is becoming increasingly accepted as a valuable tool for learning and assessment. The validity of portfolio assessment, however, may suffer from bias due to irrelevant qualities, such as lay-out and writing style. We examined the possible effects of such qualities in a portfolio programme aimed at stimulating Year 1 medical students to reflect on their professional and personal development. In later curricular years, this portfolio is also used to judge clinical competence. We developed an instrument, the Portfolio Analysis Scoring Inventory, to examine the impact of form and content aspects on portfolio assessment. The Inventory consists of 15 items derived from interviews with experienced mentors, the literature, and the criteria for reflective competence used in the regular portfolio assessment procedure. Forty portfolios, selected from 231 portfolios for which ratings from the regular assessment procedure were available, were rated by 2 researchers, independently, using the Inventory. Regression analysis was used to estimate the correlation between the ratings from the regular assessment and those resulting from the Inventory items. Inter-rater agreement ranged from 0.46 to 0.87. The strongest predictor of the variance in the regular ratings was 'quality of reflection' (R 0.80; R2 66%). No further items accounted for a significant proportion of variance. Irrelevant items, such as writing style and lay-out, had negligible effects. The absence of an impact of irrelevant criteria appears to support the validity of the portfolio assessment procedure. Further studies should examine the portfolio's validity for the assessment of clinical competence.

Groundwater quality assessment using geospatial and statistical tools in Salem District, Tamil Nadu, India

NASA Astrophysics Data System (ADS)

Arulbalaji, P.; Gurugnanam, B.

2017-10-01

The water quality study of Salem district, Tamil Nadu has been carried out to assess the water quality for domestic and irrigation purposes. For this purpose, 59 groundwater samples were collected and analyzed for pH, electrical conductivity (EC), total dissolved solids (TDS), major anions (HCO3 -, CO3 -, F-, Cl-, NO2 - + NO3 -, and SO4 2-), major cations (Ca2+ Mg2+, Na+, and K+), alkalinity (ALK), and hardness (HAR). To assess the water quality, the following chemical parameters were calculated based on the analytical results, such as Piper plot, water quality index (WQI), sodium adsorption ratio (SAR), magnesium hazard (MH), Kelly index (KI), and residual sodium carbonate (RSC). Wilcox diagram represents that 23% of the samples are excellent to good, 40% of the samples are good to permissible, 10% of the samples are permissible to doubtful, 24% of the samples are doubtful unsuitable, and only 3% of the samples are unsuitable for irrigation. SAR values shows that 52% of the samples indicate high-to-very high and low-to-medium alkali water. KI values indicate good quality (30%) and not suitable (70%) for irrigation purposes. RSC values indicate that 89% of samples are suitable for irrigation purposes. MH reveals that 17% suitable and 83% samples are not suitable for irrigation purposes and for domestic purposes the excellent (8%), good (48%), and poor (44%). The agricultural waste, fertilizer used, soil leaching, urban runoff, livestock waste, and sewages are the sources of poor water quality. Some samples are not suitable for irrigation purposes due to high salinity, hardness, and magnesium concentration. In general, the groundwater of the Salem district was polluted by agricultural activities, anthropogenic activities, ion exchange, and weathering.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

PubMed

Carney, Patricia A; Palmer, Ryan T; Fuqua Miller, Marissa; Thayer, Erin K; Estroff, Sue E; Litzelman, Debra K; Biagioli, Frances E; Teal, Cayla R; Lambros, Ann; Hatt, William J; Satterfield, Jason M

2016-05-01

Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review

PubMed Central

Carney, Patricia A.; Palmer, Ryan T.; Miller, Marissa Fuqua; Thayer, Erin K.; Estroff, Sue E.; Litzelman, Debra K.; Biagioli, Frances E.; Teal, Cayla R.; Lambros, Ann; Hatt, William J.; Satterfield, Jason M.

2015-01-01

Purpose Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. Method The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final, included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Results Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. Conclusions These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development. PMID:26796091

Cognitive assessment tools in Asia: a systematic review.

PubMed

Rosli, Roshaslina; Tan, Maw Pin; Gray, William Keith; Subramanian, Pathmawathi; Chin, Ai-Vyrn

2016-02-01

The prevalence of dementia is increasing in Asia than in any other continent. However, the applicability of the existing cognitive assessment tools is limited by differences in educational and cultural factors in this setting. We conducted a systematic review of published studies on cognitive assessments tools in Asia. We aimed to rationalize the results of available studies which evaluated the validity of cognitive tools for the detection of cognitive impairment and to identify the issues surrounding the available cognitive impairment screening tools in Asia. Five electronic databases (CINAHL, MEDLINE, Embase, Cochrane Library, and Science Direct) were searched using the keywords dementia Or Alzheimer Or cognitive impairment And screen Or measure Or test Or tool Or instrument Or assessment, and 2,381 articles were obtained. Thirty-eight articles, evaluating 28 tools in seven Asian languages, were included. Twenty-nine (76%) of the studies had been conducted in East Asia with only four studies conducted in South Asia and no study from northern, western, or central Asia or Indochina. Local language translations of the Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA) were assessed in 15 and six studies respectively. Only three tools (the Korean Dementia Screening Questionnaire, the Picture-based Memory Intelligence Scale, and the revised Hasegawa Dementia Screen) were derived de novo from Asian populations. These tools were assessed in five studies. Highly variable cut-offs were reported for the MMSE (17-29/30) and MoCA (21-26/30), with 13/19 (68%) of studies reporting educational bias. Few cognitive assessment tools have been validated in Asia, with no published validation studies for many Asian nations and languages. In addition, many available tools display educational bias. Future research should include concerted efforts to develop culturally appropriate tools with minimal educational bias.

Measuring antimicrobial prescribing quality in Australian hospitals: development and evaluation of a national antimicrobial prescribing survey tool.

PubMed

James, Rodney; Upjohn, Lydia; Cotta, Menino; Luu, Susan; Marshall, Caroline; Buising, Kirsty; Thursky, Karin

2015-01-01

Antimicrobial stewardship (AMS) programmes have been developed with the intention of reducing inappropriate and unnecessary use of antimicrobials, while improving the quality of patient care and locally helping prevent the development of antimicrobial resistance. An important aspect of AMS programmes is the qualitative assessment of prescribing through antimicrobial prescribing surveys (APS), which are able to provide information about the prescribing behaviour within institutions. Owing to lack of standardization of audit tools and the resources required, qualitative methods for the assessment of antimicrobial use are not often performed. The aim of this study was to design an audit tool that was appropriate for use in all Australian hospitals, suited to local user requirements and included an assessment of the overall appropriateness of the prescription. In November 2011, a pilot APS was conducted across 32 hospitals to assess the usability and generalizability of a newly designed audit tool. Following participant feedback, this tool was revised to reflect the requirements of the respondents. A second pilot study was then performed in November 2012 across 85 hospitals. These surveys identified several areas that can be targets for quality improvement at a national level, including: documentation of indication; surgical prophylaxis prescribed for >24 h; compliance with prescribing guidelines; and the appropriateness of the prescription. By involving the end users in the design and evaluation, we have been able to provide a practical and relevant APS tool for quantitative and qualitative data collection in a wide range of Australian hospital settings. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Assessment of nutritional status and quality of life in patients treated for head and neck cancer.

PubMed

Prevost, V; Joubert, C; Heutte, N; Babin, E

2014-04-01

The purpose of this study was to identify tools for the assessment of nutritional status in head and neck cancer patients, to evaluate the impact of malnutrition on therapeutic management and quality of life and to propose a simple screening approach adapted to routine clinical practice. The authors conducted a review of the literature to identify tools for the assessment of nutritional status in head and neck cancer patients published in French and English. Articles were obtained from the PubMed database and from the references of these articles and selected journals, using the keywords: "nutritional assessment", and "head and neck" and "cancer". Anthropometric indices, laboratory parameters, dietary intake assessment, clinical scores and nutritional risk scores used in patients with head and neck cancers are presented. The relevance of these tools in clinical practice and in research is discussed, together with the links between nutritional status and quality of life. This article is designed to help teams involved in the management of patients with head and neck cancer to choose the most appropriate tools for assessment of nutritional status according to their resources and their objectives. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Screening and assessment tools for pediatric malnutrition.

PubMed

Huysentruyt, Koen; Vandenplas, Yvan; De Schepper, Jean

2016-06-18

The ideal measures for screening and assessing undernutrition in children remain a point of discussion in literature. This review aims to provide an overview of recent advances in the nutritional screening and assessment methods in children. This review focuses on two major topics that emerged in literature since 2015: the practical endorsement of the new definition for pediatric undernutrition, with a focus on anthropometric measurements and the search for a consensus on pediatric nutritional screening tools in different settings. Few analytical tools exist for the assessment of the nutritional status in children. The subjective global nutritional assessment has been validated by anthropometric as well as clinical outcome parameters. Nutritional screening can help in selecting patients that benefit the most from a full nutritional assessment. Two new screening tools have been developed for use in a general (mixed) hospital population, and one for a population of children with cancer. The value of screening tools in different disease-specific and outpatient pediatric populations remains to be proven.

Assessing the quality of healthcare provided to children.

PubMed

Mangione-Smith, R; McGlynn, E A

1998-10-01

instruments being developed specifically for children. Most of the measures developed to date have either a very limited pediatric component or still require the process or outcome validation step. Although several practice guidelines and indicators of quality have been constructed, a conceptual framework to guide the development of such tools for quality assessment in the pediatric population is lacking. Pediatric health services researchers and the organizations that fund this work need to focus on developing a set of quality assessment tools that will address several challenging issues. Working within the context of the conceptual framework presented, we draw several conclusions related to issues that should be considered in developing quality of care measures for children.

Measurement properties of tools used to assess suicidality in autistic and general population adults: A systematic review.

PubMed

Cassidy, S A; Bradley, L; Bowen, E; Wigham, S; Rodgers, J

2018-05-05

Adults diagnosed with autism are at significantly increased risk of suicidal thoughts, suicidal behaviours and dying by suicide. However, it is unclear whether any validated tools are currently available to effectively assess suicidality in autistic adults in research and clinical practice. This is crucial for understanding and preventing premature death by suicide in this vulnerable group. This two stage systematic review therefore aimed to identify tools used to assess suicidality in autistic and general population adults, evaluate these tools for their appropriateness and measurement properties, and make recommendations for appropriate selection of suicidality assessment tools in research and clinical practice. Three databases were searched (PsycInfo, Medline and Web of Knowledge). Four frequently used suicidality assessment tools were identified, and subsequently rated for quality of the evidence in support of their measurement properties using the COSMIN checklist. Despite studies having explored suicidality in autistic adults, none had utilised a validated tool. Overall, there was lack of evidence in support of suicidality risk assessments successfully predicting future suicide attempts. We recommend adaptations to current suicidality assessment tools and priorities for future research, in order to better conceptualise suicidality and its measurement in autism. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

The effectiveness of environment assessment tools to guide refurbishment of Australian residential aged care facilities: A systematic review.

PubMed

Neylon, Samantha; Bulsara, Caroline; Hill, Anne-Marie

2017-06-01

To determine applicability of environment assessment tools in guiding minor refurbishments of Australian residential aged care facilities. Studies conducted in residential aged care settings using assessment tools which address the physical environment were eligible for inclusion in a systematic review. Given these studies are limited, tools which have not yet been utilised in research settings were also included. Tools were analysed using a critical appraisal screen. Forty-three publications met the inclusion criteria. Ten environment assessment tools were identified, of which four addressed all seven minor refurbishment domains of lighting, colour and contrast, sound, flooring, furniture, signage and way finding. Only one had undergone reliability and validity testing. There are four tools which may be suitable to use for minor refurbishment of Australian residential aged care facilities. Data on their reliability, validity and quality are limited. © 2017 AJA Inc.

A novel framework for assessing metadata quality in epidemiological and public health research settings

PubMed Central

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly. PMID:27570670

A novel framework for assessing metadata quality in epidemiological and public health research settings.

PubMed

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly.

National Water-Quality Assessment (NAWQA) area-characterization toolbox

USGS Publications Warehouse

Price, Curtis V.; Nakagaki, Naomi; Hitt, Kerie J.

2010-01-01

This is release 1.0 of the National Water-Quality Assessment (NAWQA) Area-Characterization Toolbox. These tools are designed to be accessed using ArcGIS Desktop software (versions 9.3 and 9.3.1). The toolbox is composed of a collection of custom tools that implement geographic information system (GIS) techniques used by the NAWQA Program to characterize aquifer areas, drainage basins, and sampled wells. These tools are built on top of standard functionality included in ArcGIS Desktop running at the ArcInfo license level. Most of the tools require a license for the ArcGIS Spatial Analyst extension. ArcGIS is a commercial GIS software system produced by ESRI, Inc. (http://www.esri.com). The NAWQA Area-Characterization Toolbox is not supported by ESRI, Inc. or its technical support staff. Any use of trade, product, or firm names is for descriptive purposes only and does not imply endorsement by the U.S. Government.

Objective Data Assessment (ODA) Methods as Nutritional Assessment Tools.

PubMed

Hamada, Yasuhiro

2015-01-01

Nutritional screening and assessment should be a standard of care for all patients because nutritional management plays an important role in clinical practice. However, there is no gold standard for the diagnosis of malnutrition or undernutrition, although a large number of nutritional screening and assessment tools have been developed. Nutritional screening and assessment tools are classified into two categories, namely, subjective global assessment (SGA) and objective data assessment (ODA). SGA assesses nutritional status based on the features of medical history and physical examination. On the other hand, ODA consists of objective data provided from various analyses, such as anthropometry, bioimpedance analysis (BIA), dual-energy X-ray absorptiometry (DEXA), computed tomography (CT), magnetic resonance imaging (MRI), laboratory tests, and functional tests. This review highlights knowledge on the performance of ODA methods for the assessment of nutritional status in clinical practice. J. Med. Invest. 62: 119-122, August, 2015.

Exposure Assessment Tools by Routes

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Approaches

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Comparison of quality control software tools for diffusion tensor imaging.

PubMed

Liu, Bilan; Zhu, Tong; Zhong, Jianhui

2015-04-01

Image quality of diffusion tensor imaging (DTI) is critical for image interpretation, diagnostic accuracy and efficiency. However, DTI is susceptible to numerous detrimental artifacts that may impair the reliability and validity of the obtained data. Although many quality control (QC) software tools are being developed and are widely used and each has its different tradeoffs, there is still no general agreement on an image quality control routine for DTIs, and the practical impact of these tradeoffs is not well studied. An objective comparison that identifies the pros and cons of each of the QC tools will be helpful for the users to make the best choice among tools for specific DTI applications. This study aims to quantitatively compare the effectiveness of three popular QC tools including DTI studio (Johns Hopkins University), DTIprep (University of North Carolina at Chapel Hill, University of Iowa and University of Utah) and TORTOISE (National Institute of Health). Both synthetic and in vivo human brain data were used to quantify adverse effects of major DTI artifacts to tensor calculation as well as the effectiveness of different QC tools in identifying and correcting these artifacts. The technical basis of each tool was discussed, and the ways in which particular techniques affect the output of each of the tools were analyzed. The different functions and I/O formats that three QC tools provide for building a general DTI processing pipeline and integration with other popular image processing tools were also discussed. Copyright © 2015 Elsevier Inc. All rights reserved.

Environmental Tools and Radiological Assessment

EPA Science Inventory

This presentation details two tools (SADA and FRAMES) available for use in environmental assessments of chemicals that can also be used for radiological assessments of the environment. Spatial Analysis and Decision Assistance (SADA) is a Windows freeware program that incorporate...

Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload.

PubMed

Dias, R D; Ngo-Howard, M C; Boskovski, M T; Zenati, M A; Yule, S J

2018-04-01

Surgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics. A search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score. Of 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent). Self-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

Practical implementation science: developing and piloting the quality implementation tool.

PubMed

Meyers, Duncan C; Katz, Jason; Chien, Victoria; Wandersman, Abraham; Scaccia, Jonathan P; Wright, Annie

2012-12-01

According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.

Tools for quality control of fingerprint databases

NASA Astrophysics Data System (ADS)

Swann, B. Scott; Libert, John M.; Lepley, Margaret A.

2010-04-01

Integrity of fingerprint data is essential to biometric and forensic applications. Accordingly, the FBI's Criminal Justice Information Services (CJIS) Division has sponsored development of software tools to facilitate quality control functions relative to maintaining its fingerprint data assets inherent to the Integrated Automated Fingerprint Identification System (IAFIS) and Next Generation Identification (NGI). This paper provides an introduction of two such tools. The first FBI-sponsored tool was developed by the National Institute of Standards and Technology (NIST) and examines and detects the spectral signature of the ridge-flow structure characteristic of friction ridge skin. The Spectral Image Validation/Verification (SIVV) utility differentiates fingerprints from non-fingerprints, including blank frames or segmentation failures erroneously included in data; provides a "first look" at image quality; and can identify anomalies in sample rates of scanned images. The SIVV utility might detect errors in individual 10-print fingerprints inaccurately segmented from the flat, multi-finger image acquired by one of the automated collection systems increasing in availability and usage. In such cases, the lost fingerprint can be recovered by re-segmentation from the now compressed multi-finger image record. The second FBI-sponsored tool, CropCoeff was developed by MITRE and thoroughly tested via NIST. CropCoeff enables cropping of the replacement single print directly from the compressed data file, thus avoiding decompression and recompression of images that might degrade fingerprint features necessary for matching.

Validity and reliability of the infant breastfeeding assessment tool, the mother baby assessment tool, and the LATCH scoring system.

PubMed

Altuntas, Nilgun; Turkyilmaz, Canan; Yildiz, Havva; Kulali, Ferit; Hirfanoglu, Ibrahim; Onal, Esra; Ergenekon, Ebru; Koç, Esin; Atalay, Yıldız

2014-05-01

We aimed to evaluate the validity and reliability of the Infant Breastfeeding Assessment Tool (IBFAT), the Mother Baby Assessment (MBA) Tool, and the LATCH scoring system. Mothers who delivered healthy, full-term infants in the Obstetrics & Gynecology Service of Gazi University, Ankara, Turkey, between December 2013 and January 2014 and their infants were included in the study. Forty-six randomly selected breastfeeding sessions were monitored and scored simultaneously by three researchers (Raters 1, 2, and 3) using LATCH, IBFAT, and the MBA Tool. Researchers put the score sheets in an envelope in order to hide them from each other. The compatibility of the scores given by three researchers was assessed by statistical methods. We found positive and significant correlation coefficients between 0.81 to 0.88 for the total MBA score, between 0.90 to 0.95 for the total IBFAT score, and between 0.85 to 0.91 for the total LATCH score. Correlation coefficients testing these three tools ranged from 0.71 to 0.88, with the minimum value being noted for the correlation between LATCH and IBFAT scores and the maximum value being noted for the correlation between LATCH and MBA scores. We found positive and significant correlations between researchers' scores for 46 observations using the three assessment tools. This study showed that these above-mentioned tools were compatible for the assessment of the efficiency of breastfeeding.

Monitoring Compliance to Promote Quality Assurance: Development of a Mental Health Clinical Chart Audit Tool in Belize, 2013.

PubMed

Winer, Rachel A; Bennett, Eleanor; Murillo, Illouise; Schuetz-Mueller, Jan; Katz, Craig L

2015-09-01

Belize trained psychiatric nurse practitioners (PNPs) in the early 1990s to provide mental health services throughout the country. Despite overwhelming success, the program is limited by lack of monitoring, evaluation, and surveillance. To promote quality assurance, we developed a chart audit tool to monitor mental healthcare delivery compliance for initial psychiatric assessment notes completed by PNPs. After reviewing the Belize Health Information System electronic medical record system, we developed a clinical audit tool to capture 20 essential components for initial assessment clinical notes. The audit tool was then piloted for initial assessment notes completed during July through September of 2013. One hundred and thirty-four initial psychiatric interviews were audited. The average chart score among all PNPs was 9.57, ranging from 3 to 15. Twenty-three charts-or 17.2%-had a score of 14 or higher and met a 70% compliance benchmark goal. Among indicators most frequently omitted included labs ordered and named (15.7%) and psychiatric diagnosis (21.6%). Explicit statement of medications initiated with dose and frequency occurred in 47.0% of charts. Our findings provide direction for training and improvement, such as emphasizing the importance of naming labs ordered, medications and doses prescribed, and psychiatric diagnoses in initial assessment clinical notes. We hope this initial assessment helps enhance mental health delivery compliance by prompting creation of BHIS templates, development of audits tools for revisit follow-up visits, and establishment of corrective actions for low-scoring practitioners. These efforts may serve as a model for implementing quality assurance programming in other low resource settings.

Rapid Assessment Tool for Haemophilus influenzae type b Disease in Developing Countries1

PubMed Central

Nelson, Christopher B.; Watt, James P.; Mohsni, Ezzeddine; Wenger, Jay D.; Levine, Orin S.

2004-01-01

Haemophilus influenzae type b (Hib) still causes a substantial number of deaths among children in developing countries, despite the availability of effective conjugate vaccines. A major obstacle in developing a Hib vaccine has been limited awareness about the impact of Hib disease. A tool was developed to estimate the national rates of Hib meningitis and pneumonia by assessing retrospective local data over 7 to 10 days. Data from 11 countries in Africa, the Middle East, and Asia were studied and showed rates of Hib meningitis from >50 cases per 100,000 children >5 years in Ghana and Uganda to <15 per 100,000 in Iran, Jordan, and Uzbekistan. Results were affected by the quality of available data. The Hib rapid assessment tool can be useful to countries that desire a timely assessment of Hib disease rates. PMID:15324548

Does the use of the revised psychosocial assessment tool (PATrev) result in improved quality of life and reduced psychosocial risk in Canadian families with a child newly diagnosed with cancer?

PubMed

Barrera, M; Hancock, K; Rokeach, A; Atenafu, E; Cataudella, D; Punnett, A; Johnston, D; Cassidy, M; Zelcer, S; Silva, M; Jansen, P; Bartels, U; Nathan, P C; Shama, W; Greenberg, C

2014-02-01

Early psychosocial screening may guide interventions and ameliorate the adverse psychosocial effects of childhood cancer. The revised psychosocial assessment tool provides risk information - Universal (typical distress), Targeted (additional specific distress), and Clinical (severe distress) - about the child with cancer and his or her family. This pilot study investigated the benefits of providing a summary of family psychosocial risk information to the medical team treating the newly diagnosed child (Experimental Group, EG). We conducted a pilot randomized control trial with a sample of 67 parents, comparing the EG to the control group (CG) on parental perception of family psychosocial difficulties (revised psychosocial assessment tool risk levels), child behavior (behavior assessment scale for children-2), pediatric quality of life (PedsQL), and parental anxiety (state-anxiety scale of the state-trait anxiety inventory ), 2-4 weeks after diagnosis (Time 1) and 6 months later (Time 2). Compared to the CG, participants in the EG had significantly reduced targeted and clinical risk (p < 0.001), and improved pain related PedsQL at Time 2 (p < 0.05). Scores for PedsQL total and nearly all subscales improved over time in both groups (p < 0.05 to p < 0.001). No changes in behavior scores were noted. Preliminary findings suggest that providing a summary of the Psychosocial Assessment Tool to the treating team shortly after diagnosis may help reduce family wide psychosocial risk 6 months later and improve quality of life related to pain for children who are undergoing treatment for cancer. Copyright © 2013 John Wiley & Sons, Ltd.

Improving the Quality of University Libraries through Citation Mining and Analysis Using Two New Dissertation Bibliometric Assessment Tools

ERIC Educational Resources Information Center

Tunon, Johanna; Brydges, Bruce

2005-01-01

University libraries are becoming increasingly aware of the need to assess the quality of students' information literacy and library research skills and to use this assessment data to effectively improve the quality of university library services to graduate programs. However, libraries have had difficulties finding ways to accomplish this both…

Remote assessment of acne: the use of acne grading tools to evaluate digital skin images.

PubMed

Bergman, Hagit; Tsai, Kenneth Y; Seo, Su-Jean; Kvedar, Joseph C; Watson, Alice J

2009-06-01

Digital imaging of dermatology patients is a novel approach to remote data collection. A number of assessment tools have been developed to grade acne severity and to track clinical progress over time. Although these tools have been validated when used in a face-to-face setting, their efficacy and reliability when used to assess digital images have not been examined. The main purpose of this study was to determine whether specific assessment tools designed to grade acne during face-to-face visits can be applied to the evaluation of digital images. The secondary purpose was to ascertain whether images obtained by subjects are of adequate quality to allow such assessments to be made. Three hundred (300) digital images of patients with mild to moderate facial inflammatory acne from an ongoing randomized-controlled study were included in this analysis. These images were obtained from 20 patients and consisted of sets of 3 images taken over time. Of these images, 120 images were captured by subjects themselves and 180 were taken by study staff. Subjects were asked to retake their photographs if the initial images were deemed of poor quality by study staff. Images were evaluated by two dermatologists-in-training using validated acne assessment measures: Total Inflammatory Lesion Count, Leeds technique, and the Investigator's Global Assessment. Reliability of raters was evaluated using correlation coefficients and kappa statistics. Of the different acne assessment measures tested, the inter-rater reliability was highest for the total inflammatory lesion count (r = 0.871), but low for the Leeds technique (kappa = 0.381) and global assessment (kappa = 0.3119). Raters were able to evaluate over 89% of all images using each type of acne assessment measure despite the fact that images obtained by study staff were of higher quality than those obtained by patients (p < 0.001). Several existing clinical assessment measures can be used to evaluate digital images obtained from

Quality assessment of protein model-structures based on structural and functional similarities

PubMed Central

2012-01-01

Background Experimental determination of protein 3D structures is expensive, time consuming and sometimes impossible. A gap between number of protein structures deposited in the World Wide Protein Data Bank and the number of sequenced proteins constantly broadens. Computational modeling is deemed to be one of the ways to deal with the problem. Although protein 3D structure prediction is a difficult task, many tools are available. These tools can model it from a sequence or partial structural information, e.g. contact maps. Consequently, biologists have the ability to generate automatically a putative 3D structure model of any protein. However, the main issue becomes evaluation of the model quality, which is one of the most important challenges of structural biology. Results GOBA - Gene Ontology-Based Assessment is a novel Protein Model Quality Assessment Program. It estimates the compatibility between a model-structure and its expected function. GOBA is based on the assumption that a high quality model is expected to be structurally similar to proteins functionally similar to the prediction target. Whereas DALI is used to measure structure similarity, protein functional similarity is quantified using standardized and hierarchical description of proteins provided by Gene Ontology combined with Wang's algorithm for calculating semantic similarity. Two approaches are proposed to express the quality of protein model-structures. One is a single model quality assessment method, the other is its modification, which provides a relative measure of model quality. Exhaustive evaluation is performed on data sets of model-structures submitted to the CASP8 and CASP9 contests. Conclusions The validation shows that the method is able to discriminate between good and bad model-structures. The best of tested GOBA scores achieved 0.74 and 0.8 as a mean Pearson correlation to the observed quality of models in our CASP8 and CASP9-based validation sets. GOBA also obtained the best

Quality assessment of protein model-structures based on structural and functional similarities.

PubMed

Konopka, Bogumil M; Nebel, Jean-Christophe; Kotulska, Malgorzata

2012-09-21

Experimental determination of protein 3D structures is expensive, time consuming and sometimes impossible. A gap between number of protein structures deposited in the World Wide Protein Data Bank and the number of sequenced proteins constantly broadens. Computational modeling is deemed to be one of the ways to deal with the problem. Although protein 3D structure prediction is a difficult task, many tools are available. These tools can model it from a sequence or partial structural information, e.g. contact maps. Consequently, biologists have the ability to generate automatically a putative 3D structure model of any protein. However, the main issue becomes evaluation of the model quality, which is one of the most important challenges of structural biology. GOBA--Gene Ontology-Based Assessment is a novel Protein Model Quality Assessment Program. It estimates the compatibility between a model-structure and its expected function. GOBA is based on the assumption that a high quality model is expected to be structurally similar to proteins functionally similar to the prediction target. Whereas DALI is used to measure structure similarity, protein functional similarity is quantified using standardized and hierarchical description of proteins provided by Gene Ontology combined with Wang's algorithm for calculating semantic similarity. Two approaches are proposed to express the quality of protein model-structures. One is a single model quality assessment method, the other is its modification, which provides a relative measure of model quality. Exhaustive evaluation is performed on data sets of model-structures submitted to the CASP8 and CASP9 contests. The validation shows that the method is able to discriminate between good and bad model-structures. The best of tested GOBA scores achieved 0.74 and 0.8 as a mean Pearson correlation to the observed quality of models in our CASP8 and CASP9-based validation sets. GOBA also obtained the best result for two targets of CASP8, and

Overview and insights regarding the JEQ soil and water assessment tool (SWAT) special issue

USDA-ARS?s Scientific Manuscript database

The Soil and Water Assessment Tool (SWAT) model has emerged as one of the most widely used water quality watershed- and river basin-scale models worldwide, and has been extensively applied for a broad range of hydrologic and/or environmental problems. Factors driving the international use of SWAT i...

Atmospheric Model Evaluation Tool for meteorological and air quality simulations

EPA Pesticide Factsheets

The Atmospheric Model Evaluation Tool compares model predictions to observed data from various meteorological and air quality observation networks to help evaluate meteorological and air quality simulations.

Reflective action assessment with a prospective clinical problem solving tool in the context of rehabilitation medicine: an illustrative case study.

PubMed

Kellett, David; Mpofu, Elias; Madden, Richard

2013-06-01

This study describes a case formulation approach applying a prospective ICF derived clinical tool to assess rehabilitation needs for a community dwelling stroke survivor with care from an outpatient rehabilitation medicine clinic. Case history data on the person were assessed for rehabilitation management planning using a prospective tool to interlink current with projected future functional status in everyday settings. Implicit assessment with reflective action informed decision points at each stage of the rehabilitation process. As a result of reflective action using the prospective tool, rehabilitation management led to significant changes in client participation after limitations to mobility and self care were mapped to the living conditions of the stroke survivor. The context sensitive rehabilitative plan resulted in higher subjective health-related quality of life in the stroke survivor and significant other and enhanced their capacity for participation. Reflective action informed assessment applying ICF concepts to clinical problem solving resulted in positive gains in health-related quality of life in a stroke survivor.

Water Quality Assessment using Satellite Remote Sensing

NASA Astrophysics Data System (ADS)

Haque, Saad Ul

2016-07-01

The two main global issues related to water are its declining quality and quantity. Population growth, industrialization, increase in agriculture land and urbanization are the main causes upon which the inland water bodies are confronted with the increasing water demand. The quality of surface water has also been degraded in many countries over the past few decades due to the inputs of nutrients and sediments especially in the lakes and reservoirs. Since water is essential for not only meeting the human needs but also to maintain natural ecosystem health and integrity, there are efforts worldwide to assess and restore quality of surface waters. Remote sensing techniques provide a tool for continuous water quality information in order to identify and minimize sources of pollutants that are harmful for human and aquatic life. The proposed methodology is focused on assessing quality of water at selected lakes in Pakistan (Sindh); namely, HUBDAM, KEENJHAR LAKE, HALEEJI and HADEERO. These lakes are drinking water sources for several major cities of Pakistan including Karachi. Satellite imagery of Landsat 7 (ETM+) is used to identify the variation in water quality of these lakes in terms of their optical properties. All bands of Landsat 7 (ETM+) image are analyzed to select only those that may be correlated with some water quality parameters (e.g. suspended solids, chlorophyll a). The Optimum Index Factor (OIF) developed by Chavez et al. (1982) is used for selection of the optimum combination of bands. The OIF is calculated by dividing the sum of standard deviations of any three bands with the sum of their respective correlation coefficients (absolute values). It is assumed that the band with the higher standard deviation contains the higher amount of 'information' than other bands. Therefore, OIF values are ranked and three bands with the highest OIF are selected for the visual interpretation. A color composite image is created using these three bands. The water quality

Analytical Tools Interface for Landscape Assessments

EPA Science Inventory

Environmental management practices are trending away from simple, local-scale assessments toward complex, multiple-stressor regional assessments. Landscape ecology provides the theory behind these assessments while geographic information systems (GIS) supply the tools to implemen...

Objective quality assessment of tone-mapped images.

PubMed

Yeganeh, Hojatollah; Wang, Zhou

2013-02-01

Tone-mapping operators (TMOs) that convert high dynamic range (HDR) to low dynamic range (LDR) images provide practically useful tools for the visualization of HDR images on standard LDR displays. Different TMOs create different tone-mapped images, and a natural question is which one has the best quality. Without an appropriate quality measure, different TMOs cannot be compared, and further improvement is directionless. Subjective rating may be a reliable evaluation method, but it is expensive and time consuming, and more importantly, is difficult to be embedded into optimization frameworks. Here we propose an objective quality assessment algorithm for tone-mapped images by combining: 1) a multiscale signal fidelity measure on the basis of a modified structural similarity index and 2) a naturalness measure on the basis of intensity statistics of natural images. Validations using independent subject-rated image databases show good correlations between subjective ranking score and the proposed tone-mapped image quality index (TMQI). Furthermore, we demonstrate the extended applications of TMQI using two examples-parameter tuning for TMOs and adaptive fusion of multiple tone-mapped images.

INDOOR AIR QUALITY AND INHALATION EXPOSURE - SIMULATION TOOL KIT

EPA Science Inventory

A Microsoft Windows-based indoor air quality (IAQ) simulation software package is presented. Named Simulation Tool Kit for Indoor Air Quality and Inhalation Exposure, or IAQX for short, this package complements and supplements existing IAQ simulation programs and is desi...

Health related quality of life assessment in metastatic disease of the spine: a systematic review.

PubMed

Street, John; Berven, Sigurd; Fisher, Charles; Ryken, Timothy

2009-10-15

Systematic literature review. To examine the available literature on health related quality of life (HRQOL) assessment in metastatic disease of the spine and identify the optimal functional outcome scales to be used in developing a disease-specific tool. There is a lack of consensus in the use of HRQOL measures in patients with metastatic spine disease. A systematic review was conducted using MEDLINE, EMBASE, the Science Citation Index (ISI), the Cumulative Index to Nursing and Allied Health Literature, the PsycINFO, the Allied and Complementary Medicine (AMED), Cochrane Reviews and Global Health databases for clinical studies addressing metastatic spine disease from 1966 through 2008. The validity of outcome tools was established by linkage analysis with the International Classification of Functioning Disability and Health (ICF). One hundred forty-one clinical studies met inclusion criteria including 10,347 patients. Only 5 moderate grade and 1 high grade study were identified. Thirty- four studies used a patient self-assessment instrument to assess health status. None of the instruments were validated for metastatic spine patients. The most commonly used Pi-by-no tools were SF-36, SIP 5, and the ADL. None of the studies defined health related quality of life (HRQOL) or justified the choice of instrument. The most commonly used cancer-specific tools were ECOG, EORTC QCQ-C30, and EUROQOL 5D. Based on frequency of citation and on correlation with the International Classification of Functioning Disability and Health, the ECOG and SF36 were judged as most valid and reliable. A systematic review of the available evidence suggests that valid and reliable health related quality of life measures exist for the assessment of oncology patients; however, a disease-specific tool for metastatic spine disease awaits development. Until such time as a disease-specific tool is available, we recommend that the ECOG and SF-36 be considered for use in studies addressing the outcome

Aqueduct: an interactive tool to empower global water risk assessment

NASA Astrophysics Data System (ADS)

Reig, Paul; Gassert, Francis

2013-04-01

The Aqueduct Water Risk Atlas (Aqueduct) is a publicly available, global database and interactive tool that maps indicators of water related risks for decision makers worldwide. Aqueduct makes use of the latest geo-statistical modeling techniques to compute a composite index and translate the most recently available hydrological data into practical information on water related risks for companies, investors, and governments alike. Twelve global indicators are grouped into a Water Risk Framework designed in response to the growing concerns from private sector actors around water scarcity, water quality, climate change, and increasing demand for freshwater. The Aqueduct framework includes indicators of water stress, variability in supply, storage, flood, drought, groundwater, water quality and social conflict, addressing both spatial and temporal variation in water hazards. It organizes indicators into three categories of risk that bring together multiple dimensions of water related risk into comprehensive aggregated scores, which allow for dynamic weighting to capture users' unique exposure to water hazards. All information is compiled into an online, open access platform, from which decision-makers can view indicators, scores, and maps, conduct global risk assessments, and export data and shape files for further analysis. Companies can use this tool to evaluate their exposure to water risks across operations and supply chains, investors to assess water-related risks in their portfolio, and public-sector actors to better understand water security. Additionally, the open nature of the data and maps allow other organizations to build off of this effort with new research, for example in the areas of water-energy or water-food relationships. This presentation will showcase the Aqueduct Water Risk Atlas online tool and the features and functionalities it offers, as well as explain how it can be used for both private and public sector applications. The session will

A ranking index for quality assessment of forensic DNA profiles forensic DNA profiles

PubMed Central

2010-01-01

Background Assessment of DNA profile quality is vital in forensic DNA analysis, both in order to determine the evidentiary value of DNA results and to compare the performance of different DNA analysis protocols. Generally the quality assessment is performed through manual examination of the DNA profiles based on empirical knowledge, or by comparing the intensities (allelic peak heights) of the capillary electrophoresis electropherograms. Results We recently developed a ranking index for unbiased and quantitative quality assessment of forensic DNA profiles, the forensic DNA profile index (FI) (Hedman et al. Improved forensic DNA analysis through the use of alternative DNA polymerases and statistical modeling of DNA profiles, Biotechniques 47 (2009) 951-958). FI uses electropherogram data to combine the intensities of the allelic peaks with the balances within and between loci, using Principal Components Analysis. Here we present the construction of FI. We explain the mathematical and statistical methodologies used and present details about the applied data reduction method. Thereby we show how to adapt the ranking index for any Short Tandem Repeat-based forensic DNA typing system through validation against a manual grading scale and calibration against a specific set of DNA profiles. Conclusions The developed tool provides unbiased quality assessment of forensic DNA profiles. It can be applied for any DNA profiling system based on Short Tandem Repeat markers. Apart from crime related DNA analysis, FI can therefore be used as a quality tool in paternal or familial testing as well as in disaster victim identification. PMID:21062433

The Assessment of Afterschool Program Practices Tool (APT): Findings from the APT Validation Study

ERIC Educational Resources Information Center

Tracy, Allison; Surr, Wendy; Richer, Amanda

2012-01-01

The Assessment of Afterschool Program Practices Tool ("APT"), developed by the National Institute of Out-of-School Time (NIOST), is an observational instrument designed to measure the aspects of afterschool program quality that research suggests contribute to the 21st century skills, attitudes, and behaviors youth need to be successful…

Medical faculties educational network: multidimensional quality assessment.

PubMed

Komenda, Martin; Schwarz, Daniel; Feberová, Jitka; Stípek, Stanislav; Mihál, Vladimír; Dušek, Ladislav

2012-12-01

Today, World Wide Web technology provides many opportunities in the disclosure of electronic learning and teaching content. The MEFANET project (MEdical FAculties NETwork) has initiated international, effective and open cooperation among all Czech and Slovak medical faculties in the medical education fields. This paper introduces the original MEFANET educational web portal platform. Its main aim is to present the unique collaborative environment, which combines the sharing of electronic educational resources with the use tools for their quality evaluation. It is in fact a complex e-publishing system, which consists of ten standalone portal instances and one central gateway. The fundamental principles of the developed system and used technologies are reported here, as well as procedures of a new multidimensional quality assessment. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

QCScreen: a software tool for data quality control in LC-HRMS based metabolomics.

PubMed

Simader, Alexandra Maria; Kluger, Bernhard; Neumann, Nora Katharina Nicole; Bueschl, Christoph; Lemmens, Marc; Lirk, Gerald; Krska, Rudolf; Schuhmacher, Rainer

2015-10-24

Metabolomics experiments often comprise large numbers of biological samples resulting in huge amounts of data. This data needs to be inspected for plausibility before data evaluation to detect putative sources of error e.g. retention time or mass accuracy shifts. Especially in liquid chromatography-high resolution mass spectrometry (LC-HRMS) based metabolomics research, proper quality control checks (e.g. for precision, signal drifts or offsets) are crucial prerequisites to achieve reliable and comparable results within and across experimental measurement sequences. Software tools can support this process. The software tool QCScreen was developed to offer a quick and easy data quality check of LC-HRMS derived data. It allows a flexible investigation and comparison of basic quality-related parameters within user-defined target features and the possibility to automatically evaluate multiple sample types within or across different measurement sequences in a short time. It offers a user-friendly interface that allows an easy selection of processing steps and parameter settings. The generated results include a coloured overview plot of data quality across all analysed samples and targets and, in addition, detailed illustrations of the stability and precision of the chromatographic separation, the mass accuracy and the detector sensitivity. The use of QCScreen is demonstrated with experimental data from metabolomics experiments using selected standard compounds in pure solvent. The application of the software identified problematic features, samples and analytical parameters and suggested which data files or compounds required closer manual inspection. QCScreen is an open source software tool which provides a useful basis for assessing the suitability of LC-HRMS data prior to time consuming, detailed data processing and subsequent statistical analysis. It accepts the generic mzXML format and thus can be used with many different LC-HRMS platforms to process both multiple

Quality Dashboards: Technical and Architectural Considerations of an Actionable Reporting Tool for Population Management

PubMed Central

Olsha-Yehiav, Maya; Einbinder, Jonathan S.; Jung, Eunice; Linder, Jeffrey A.; Greim, Julie; Li, Qi; Schnipper, Jeffrey L.; Middleton, Blackford

2006-01-01

Quality Dashboards (QD) is a condition-specific, actionable web-based application for quality reporting and population management that is integrated into the Electronic Health Record (EHR). Using server-based graphic web controls in a .Net environment to construct Quality Dashboards allows customization of the reporting tool without the need to rely on commercial business intelligence tool. Quality Dashboards will improve patient care and quality outcomes as clinicians utilize the reporting tool for population management. PMID:17238671

The East Anglian specialist registrar assessment tool

PubMed Central

Robinson, Susan; Boursicot, Katharine; Hayhurst, Catherine

2007-01-01

Background In our region, it was acknowledged that the process of assessment needed to be improved, but before developing a system for this, there was a need to define the “competent or satisfactory trainee”. Objective To outline the process by which a consensus was achieved on this standard, and how a system for formally assessing competency across a wide range of knowledge skills and attitudes was subsequently agreed on, thus enabling increased opportunities for training and feedback and improving the accuracy of assessment in the region. Methods The opinions of trainees and trainers from across the region were collated, and a consensus was achieved with regard to the minimum acceptable standard for a trainee in emergency medicine, thus defining a competent trainee. The group that set the standard then focused on identifying the assessment methods most appropriate for the evaluation of the knowledge, skills and attitudes required of an emergency medicine trainee. The tool was subsequently trialled for a period of 6 months, and opinion evaluated by use of a questionnaire. Results The use of the tool was reviewed from both the trainers' and trainees' perspectives. 42% (n = 11) of trainers and 31% (n = 8) trainees responded to the questionnaire. In the region, there were 26 trainers and 26 trainees. Five trainees and nine trainers had used the tool. 93% (14/15) of respondents thought that the descriptors used to describe the satisfactory trainee were acceptable; 89% (8/9) of trainers thought that it helped them assess trainees more accurately. 60% (3/5) of trainees thought that, as a result, they had a better understanding of their weak areas. Conclusion We believe that we achieved a consensus across our region as to what defined a satisfactory trainee and set the standard against which all our trainees would subsequently be evaluated. The use of this tool to assess trainees during the pilot period was disappointing; however, we were encouraged that

Sequence quality analysis tool for HIV type 1 protease and reverse transcriptase.

PubMed

Delong, Allison K; Wu, Mingham; Bennett, Diane; Parkin, Neil; Wu, Zhijin; Hogan, Joseph W; Kantor, Rami

2012-08-01

Access to antiretroviral therapy is increasing globally and drug resistance evolution is anticipated. Currently, protease (PR) and reverse transcriptase (RT) sequence generation is increasing, including the use of in-house sequencing assays, and quality assessment prior to sequence analysis is essential. We created a computational HIV PR/RT Sequence Quality Analysis Tool (SQUAT) that runs in the R statistical environment. Sequence quality thresholds are calculated from a large dataset (46,802 PR and 44,432 RT sequences) from the published literature ( http://hivdb.Stanford.edu ). Nucleic acid sequences are read into SQUAT, identified, aligned, and translated. Nucleic acid sequences are flagged if with >five 1-2-base insertions; >one 3-base insertion; >one deletion; >six PR or >18 RT ambiguous bases; >three consecutive PR or >four RT nucleic acid mutations; >zero stop codons; >three PR or >six RT ambiguous amino acids; >three consecutive PR or >four RT amino acid mutations; >zero unique amino acids; or <0.5% or >15% genetic distance from another submitted sequence. Thresholds are user modifiable. SQUAT output includes a summary report with detailed comments for troubleshooting of flagged sequences, histograms of pairwise genetic distances, neighbor joining phylogenetic trees, and aligned nucleic and amino acid sequences. SQUAT is a stand-alone, free, web-independent tool to ensure use of high-quality HIV PR/RT sequences in interpretation and reporting of drug resistance, while increasing awareness and expertise and facilitating troubleshooting of potentially problematic sequences.

A New Tool for Quality: The Internal Audit.

PubMed

Haycock, Camille; Schandl, Annette

As health care systems aspire to improve the quality and value for the consumers they serve, quality outcomes must be at the forefront of this value equation. As organizations implement evidence-based practices, electronic records to standardize processes, and quality improvement initiatives, many tactics are deployed to accelerate improvement and care outcomes. This article describes how one organization utilized a formal clinical audit process to identify gaps and/or barriers that may be contributing to underperforming measures and outcomes. This partnership between quality and audit can be a powerful tool and produce insights that can be scaled across a large health care system.

[A French tool for evaluation of home palliative care: adaptation of the Support Team Assessment Schedule].

PubMed

Lagabrielle, D; Guyot, F; Jasso, G; Couturier, P; Poussin, G; Frossard, M; Szabo, P; Franco, A

2001-09-01

The authors describe the utilisation of a quality assessment tool for palliative care administered at home. The questionnaire entitled Support Team Assessment Schedule (STAS) was translated from English for this study. It was then utilised comparatively with different quality of life evaluation instruments. Only the results of the STAS are described here. The approach allows for the unresolved problems in the care to come to the surface week after week. The STAS comprises nine items pertaining to the patient and his/her family, and seven items concerning the services provided. The study exhibits the results of 107 evaluations completed from 50 patients stricken with cancer or AIDS in an advanced phase. The availability of this auto clinical audit tool, employable at home or in a hospital, constitutes an essential initial step in the field of French-speaking clinical evaluation of palliative care.

Computer assisted blast design and assessment tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cameron, A.R.; Kleine, T.H.; Forsyth, W.W.

1995-12-31

In general the software required by a blast designer includes tools that graphically present blast designs (surface and underground), can analyze a design or predict its result, and can assess blasting results. As computers develop and computer literacy continues to rise the development of and use of such tools will spread. An example of the tools that are becoming available includes: Automatic blast pattern generation and underground ring design; blast design evaluation in terms of explosive distribution and detonation simulation; fragmentation prediction; blast vibration prediction and minimization; blast monitoring for assessment of dynamic performance; vibration measurement, display and signal processing;more » evaluation of blast results in terms of fragmentation; and risk and reliability based blast assessment. The authors have identified a set of criteria that are essential in choosing appropriate software blasting tools.« less

Validation of balance-quality assessment using a modified bathroom scale.

PubMed

Hewson, D J; Duchêne, J; Hogrel, J-Y

2015-02-01

The balance quality tester (BQT), based on a standard electronic bathroom scale has been developed in order to assess balance quality. The BQT includes automatic detection of the person to be tested by means of an infrared detector and bluetooth communication capability for remote assessment when linked to a long-distance communication device such as a mobile phone. The BQT was compared to a standard force plate for validity and agreement. The two most widely reported parameters in balance literature, the area of the centre of pressure (COP) displacement and the velocity of the COP displacement, were compared for 12 subjects, each of whom was tested on ten occasions on each of the 2 days. No significant differences were observed between the BQT and the force plate for either of the two parameters. In addition a high level of agreement was observed between both devices. The BQT is a valid device for remote assessment of balance quality, and could provide a useful tool for long-term monitoring of people with balance problems, particularly during home monitoring.

Validation of a global scale to assess the quality of interprofessional teamwork in mental health settings.

PubMed

Tomizawa, Ryoko; Yamano, Mayumi; Osako, Mitue; Hirabayashi, Naotugu; Oshima, Nobuo; Sigeta, Masahiro; Reeves, Scott

2017-12-01

Few scales currently exist to assess the quality of interprofessional teamwork through team members' perceptions of working together in mental health settings. The purpose of this study was to revise and validate an interprofessional scale to assess the quality of teamwork in inpatient psychiatric units and to use it multi-nationally. A literature review was undertaken to identify evaluative teamwork tools and develop an additional 12 items to ensure a broad global focus. Focus group discussions considered adaptation to different care systems using subjective judgements from 11 participants in a pre-test of items. Data quality, construct validity, reproducibility, and internal consistency were investigated in the survey using an international comparative design. Exploratory factor analysis yielded five factors with 21 items: 'patient/community centred care', 'collaborative communication', 'interprofessional conflict', 'role clarification', and 'environment'. High overall internal consistency, reproducibility, adequate face validity, and reasonable construct validity were shown in the USA and Japan. The revised Collaborative Practice Assessment Tool (CPAT) is a valid measure to assess the quality of interprofessional teamwork in psychiatry and identifies the best strategies to improve team performance. Furthermore, the revised scale will generate more rigorous evidence for collaborative practice in psychiatry internationally.

Making Quality Sense: A Guide to Quality, Tools and Techniques, Awards and the Thinking Behind Them.

ERIC Educational Resources Information Center

Owen, Jane

This document is intended to guide further education colleges and work-based learning providers through some of the commonly used tools, techniques, and theories of quality management. The following are among the topics discussed: (1) various ways of defining quality; methods used by organizations to achieve quality (quality control, quality…

Watershed Health Assessment Tools Investigating Fisheries

EPA Science Inventory

WHATIF is software that integrates a number of calculators, tools, and models for assessing the health of watersheds and streams with an emphasis on fish communities. The tool set consists of hydrologic and stream geometry calculators, a fish assemblage predictor, a fish habitat ...

GenePRIMP: A software quality control tool

ScienceCinema

Amrita Pati

2017-12-09

Amrita Pati of the DOE Joint Genome Institute's Genome Biology group describes the software tool GenePRIMP and how it fits into the quality control pipeline for microbial genomics. Further details regarding GenePRIMP appear in a paper published online May 2, 2010 in Nature Methods.

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

PubMed

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients

Evaluating an holistic assessment tool for palliative care practice.

PubMed

McIlfatrick, Sonja; Hasson, Felicity

2014-04-01

To evaluate a holistic assessment tool for palliative care practice. This included identifying patients' needs using the holistic tool and exploring the usability, applicability and barriers and facilitators towards implementation in practice. The delivery of effective holistic palliative care requires a careful assessment of the patients' needs and circumstances. Whilst holistic assessment of palliative care needs is advocated, questions exist around the appropriateness of tools to assist this process. Mixed-method research design. Data collection involved an analysis of piloted holistic assessments undertaken using the tool (n = 132) and two focus groups with healthcare professionals (n = 10). The tool enabled health professionals to identify and gain an understanding of the needs of the patients, specifically in relation to the physical healthcare needs. Differences, however, between the analysis of the tool documentation and focus group responses were identified in particular areas. For example, 59 (68·8%) respondents had discussed preferred priorities of care with the patient; however, focus group comments revealed participants had concerns around this. Similarly, whilst over half of responses (n = 50; 57·5%) had considered a prognostic clinical indicator for the patient as an action, focus group results indicated questions around healthcare professionals' knowledge and perceived usefulness of such indicators. Positive aspects of the tool were that it was easy to understand and captured the needs of individuals. Negative aspects of the tool were that it was repetitive and the experience of assessors required consideration. The tool evaluation identified questions regarding holistic assessment in palliative care practice and the importance of communication. A holistic assessment tool can support patient assessment and identification of patients' needs in the 'real world' of palliative care practice, but the 'tool' is merely an aid to assist professionals to

Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

PubMed

Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

2015-01-01

Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief

Assessment and prediction of air quality using fuzzy logic and autoregressive models

NASA Astrophysics Data System (ADS)

Carbajal-Hernández, José Juan; Sánchez-Fernández, Luis P.; Carrasco-Ochoa, Jesús A.; Martínez-Trinidad, José Fco.

2012-12-01

In recent years, artificial intelligence methods have been used for the treatment of environmental problems. This work, presents two models for assessment and prediction of air quality. First, we develop a new computational model for air quality assessment in order to evaluate toxic compounds that can harm sensitive people in urban areas, affecting their normal activities. In this model we propose to use a Sigma operator to statistically asses air quality parameters using their historical data information and determining their negative impact in air quality based on toxicity limits, frequency average and deviations of toxicological tests. We also introduce a fuzzy inference system to perform parameter classification using a reasoning process and integrating them in an air quality index describing the pollution levels in five stages: excellent, good, regular, bad and danger, respectively. The second model proposed in this work predicts air quality concentrations using an autoregressive model, providing a predicted air quality index based on the fuzzy inference system previously developed. Using data from Mexico City Atmospheric Monitoring System, we perform a comparison among air quality indices developed for environmental agencies and similar models. Our results show that our models are an appropriate tool for assessing site pollution and for providing guidance to improve contingency actions in urban areas.

Objective measures for quality assessment of automatic skin enhancement algorithms

NASA Astrophysics Data System (ADS)

Ciuc, Mihai; Capata, Adrian; Florea, Corneliu

2010-01-01

Automatic portrait enhancement by attenuating skin flaws (pimples, blemishes, wrinkles, etc.) has received considerable attention from digital camera manufacturers thanks to its impact on the public. Subsequently, a number of algorithms have been developed to meet this need. One central aspect to developing such an algorithm is quality assessment: having a few numbers that precisely indicate the amount of beautification brought by an algorithm (as perceived by human observers) is of great help, as it works on circumvent time-costly human evaluation. In this paper, we propose a method to numerically evaluate the quality of a skin beautification algorithm. The most important aspects we take into account and quantize to numbers are the quality of the skin detector, the amount of smoothing performed by the method, the preservation of intrinsic skin texture, and the preservation of facial features. We combine these measures into two numbers that assess the quality of skin detection and beautification. The derived measures are highly correlated with human perception, therefore they constitute a helpful tool for tuning and comparing algorithms.

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis

PubMed Central

2013-01-01

Background Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. Methods We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. Results In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. Conclusions There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis.

PubMed

Armijo-Olivo, Susan; Fuentes, Jorge; Ospina, Maria; Saltaji, Humam; Hartling, Lisa

2013-09-17

Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to assess risk of bias of RCTs. Further

Current Quality-of-Life Tools Available for Use in Contact Dermatitis.

PubMed

Swietlik, Jacquelyn; Reeder, Margo

2016-01-01

Contact dermatitis is a common dermatologic condition that can cause significant impairment in patients' overall quality of life (QoL). This impact is separate and potentially more clinically relevant than one's disease "severity" in contact dermatitis and should be consistently addressed by dermatologists. Despite this, QoL tools specific to contact dermatitis are lacking, and there is little consistency in the literature regarding the tool used to evaluate clinical response to therapies. Measurements currently available to evaluate disease-related QoL in contact dermatitis fit into 1 of the following 3 general types: generic health-related QoL measures, dermatology-related QoL measures, or specific dermatologic disease-related QoL measures. This article reviews the strengths and weaknesses of existing QoL tools used in contact dermatitis including: Short Form Survey 36, Dermatology Life Quality Index, Skindex-29, Skindex-16, Dermatology-Specific Quality of Life, and Fragrance Quality of Life Index.

SMOQ: a tool for predicting the absolute residue-specific quality of a single protein model with support vector machines

PubMed Central

2014-01-01

Background It is important to predict the quality of a protein structural model before its native structure is known. The method that can predict the absolute local quality of individual residues in a single protein model is rare, yet particularly needed for using, ranking and refining protein models. Results We developed a machine learning tool (SMOQ) that can predict the distance deviation of each residue in a single protein model. SMOQ uses support vector machines (SVM) with protein sequence and structural features (i.e. basic feature set), including amino acid sequence, secondary structures, solvent accessibilities, and residue-residue contacts to make predictions. We also trained a SVM model with two new additional features (profiles and SOV scores) on 20 CASP8 targets and found that including them can only improve the performance when real deviations between native and model are higher than 5Å. The SMOQ tool finally released uses the basic feature set trained on 85 CASP8 targets. Moreover, SMOQ implemented a way to convert predicted local quality scores into a global quality score. SMOQ was tested on the 84 CASP9 single-domain targets. The average difference between the residue-specific distance deviation predicted by our method and the actual distance deviation on the test data is 2.637Å. The global quality prediction accuracy of the tool is comparable to other good tools on the same benchmark. Conclusion SMOQ is a useful tool for protein single model quality assessment. Its source code and executable are available at: http://sysbio.rnet.missouri.edu/multicom_toolbox/. PMID:24776231

SMOQ: a tool for predicting the absolute residue-specific quality of a single protein model with support vector machines.

PubMed

Cao, Renzhi; Wang, Zheng; Wang, Yiheng; Cheng, Jianlin

2014-04-28

It is important to predict the quality of a protein structural model before its native structure is known. The method that can predict the absolute local quality of individual residues in a single protein model is rare, yet particularly needed for using, ranking and refining protein models. We developed a machine learning tool (SMOQ) that can predict the distance deviation of each residue in a single protein model. SMOQ uses support vector machines (SVM) with protein sequence and structural features (i.e. basic feature set), including amino acid sequence, secondary structures, solvent accessibilities, and residue-residue contacts to make predictions. We also trained a SVM model with two new additional features (profiles and SOV scores) on 20 CASP8 targets and found that including them can only improve the performance when real deviations between native and model are higher than 5Å. The SMOQ tool finally released uses the basic feature set trained on 85 CASP8 targets. Moreover, SMOQ implemented a way to convert predicted local quality scores into a global quality score. SMOQ was tested on the 84 CASP9 single-domain targets. The average difference between the residue-specific distance deviation predicted by our method and the actual distance deviation on the test data is 2.637Å. The global quality prediction accuracy of the tool is comparable to other good tools on the same benchmark. SMOQ is a useful tool for protein single model quality assessment. Its source code and executable are available at: http://sysbio.rnet.missouri.edu/multicom_toolbox/.

Clinical Parameters and Tools for Home-Based Assessment of Parkinson's Disease: Results from a Delphi study.

PubMed

Ferreira, Joaquim J; Santos, Ana T; Domingos, Josefa; Matthews, Helen; Isaacs, Tom; Duffen, Joy; Al-Jawad, Ahmed; Larsen, Frank; Artur Serrano, J; Weber, Peter; Thoms, Andrea; Sollinger, Stefan; Graessner, Holm; Maetzler, Walter

2015-01-01

Parkinson's disease (PD) is a neurodegenerative disorder with fluctuating symptoms. To aid the development of a system to evaluate people with PD (PwP) at home (SENSE-PARK system) there was a need to define parameters and tools to be applied in the assessment of 6 domains: gait, bradykinesia/hypokinesia, tremor, sleep, balance and cognition. To identify relevant parameters and assessment tools of the 6 domains, from the perspective of PwP, caregivers and movement disorders specialists. A 2-round Delphi study was conducted to select a core of parameters and assessment tools to be applied. This process included PwP, caregivers and movement disorders specialists. Two hundred and thirty-three PwP, caregivers and physicians completed the first round questionnaire, and 50 the second. Results allowed the identification of parameters and assessment tools to be added to the SENSE-PARK system. The most consensual parameters were: Falls and Near Falls; Capability to Perform Activities of Daily Living; Interference with Activities of Daily Living; Capability to Process Tasks; and Capability to Recall and Retrieve Information. The most cited assessment strategies included Walkers; the Evaluation of Performance Doing Fine Motor Movements; Capability to Eat; Assessment of Sleep Quality; Identification of Circumstances and Triggers for Loose of Balance and Memory Assessment. An agreed set of measuring parameters, tests, tools and devices was achieved to be part of a system to evaluate PwP at home. A pattern of different perspectives was identified for each stakeholder.

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions

PubMed Central

Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-01-01

Background Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. Objective The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. Methods As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). Results A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content—a pattern that did not appear in

Accuracy of Nutritional Screening Tools in Assessing the Risk of Undernutrition in Hospitalized Children.

PubMed

Huysentruyt, Koen; Devreker, Thierry; Dejonckheere, Joachim; De Schepper, Jean; Vandenplas, Yvan; Cools, Filip

2015-08-01

The aim of the present study was to evaluate the predictive accuracy of screening tools for assessing nutritional risk in hospitalized children in developed countries. The study involved a systematic review of literature (MEDLINE, EMBASE, and Cochrane Central databases up to January 17, 2014) of studies on the diagnostic performance of pediatric nutritional screening tools. Methodological quality was assessed using a modified QUADAS tool. Sensitivity and specificity were calculated for each screening tool per validation method. A meta-analysis was performed to estimate the risk ratio of different screening result categories of being truly at nutritional risk. A total of 11 studies were included on ≥1 of the following screening tools: Pediatric Nutritional Risk Score, Screening Tool for the Assessment of Malnutrition in Paediatrics, Paediatric Yorkhill Malnutrition Score, and Screening Tool for Risk on Nutritional Status and Growth. Because of variation in reference standards, a direct comparison of the predictive accuracy of the screening tools was not possible. A meta-analysis was performed on 1629 children from 7 different studies. The risk ratio of being truly at nutritional risk was 0.349 (95% confidence interval [CI] 0.16-0.78) for children in the low versus moderate screening category and 0.292 (95% CI 0.19-0.44) in the moderate versus high screening category. There is insufficient evidence to choose 1 nutritional screening tool over another based on their predictive accuracy. The estimated risk of being at "true nutritional risk" increases with each category of screening test result. Each screening category should be linked to a specific course of action, although further research is needed.

Construct measurement quality improves predictive accuracy in violence risk assessment: an illustration using the personality assessment inventory.

PubMed

Hendry, Melissa C; Douglas, Kevin S; Winter, Elizabeth A; Edens, John F

2013-01-01

Much of the risk assessment literature has focused on the predictive validity of risk assessment tools. However, these tools often comprise a list of risk factors that are themselves complex constructs, and focusing on the quality of measurement of individual risk factors may improve the predictive validity of the tools. The present study illustrates this concern using the Antisocial Features and Aggression scales of the Personality Assessment Inventory (Morey, 1991). In a sample of 1,545 prison inmates and offenders undergoing treatment for substance abuse (85% male), we evaluated (a) the factorial validity of the ANT and AGG scales, (b) the utility of original ANT and AGG scales and newly derived ANT and AGG scales for predicting antisocial outcomes (recidivism and institutional infractions), and (c) whether items with a stronger relationship to the underlying constructs (higher factor loadings) were in turn more strongly related to antisocial outcomes. Confirmatory factor analyses (CFAs) indicated that ANT and AGG items were not structured optimally in these data in terms of correspondence to the subscale structure identified in the PAI manual. Exploratory factor analyses were conducted on a random split-half of the sample to derive optimized alternative factor structures, and cross-validated in the second split-half using CFA. Four-factor models emerged for both the ANT and AGG scales, and, as predicted, the size of item factor loadings was associated with the strength with which items were associated with institutional infractions and community recidivism. This suggests that the quality by which a construct is measured is associated with its predictive strength. Implications for risk assessment are discussed. Copyright © 2013 John Wiley & Sons, Ltd.

Tools for surveying and improving the quality of life: people with special needs in focus.

PubMed

Hoyningen-Süess, Ursula; Oberholzer, David; Stalder, René; Brügger, Urs

2012-01-01

This article seeks to describe online tools for surveying and improving quality of life for people with disabilities living in assisted living centers and special education service organizations. Ensuring a decent quality of life for disabled people is an important welfare state goal. Using well-accepted quality of life conceptions, online diagnostic and planning tools were developed during an Institute for Education, University of Zurich, research project. The diagnostic tools measure, evaluate and analyze disabled people's quality of life. The planning tools identify factors that can affect their quality of life and suggest improvements. Instrument validity and reliability are not tested according to the standard statistical procedures. This will be done at a more advanced stage of the project. Instead, the tool is developed, refined and adjusted in cooperation with practitioners who are constantly judging it according to best practice standards. The tools support staff in assisted living centers and special education service organizations. These tools offer comprehensive resources for surveying, quantifying, evaluating, describing and simulating quality of life elements.

Outcome assessments in children with cerebral palsy, part II: discriminatory ability of outcome tools.

PubMed

Bagley, Anita M; Gorton, George; Oeffinger, Donna; Barnes, Douglas; Calmes, Janine; Nicholson, Diane; Damiano, Diane; Abel, Mark; Kryscio, Richard; Rogers, Sarah; Tylkowski, Chester

2007-03-01

Discriminatory ability of several pediatric outcome tools was assessed relative to Gross Motor Function Classification System (GMFCS) level in patients with cerebral palsy. Five hundred and sixty-two patients (400 with diplegia, 162 with hemiplegia; 339 males, 223 females; age range 4-18y, mean 11y 1mo [SD 3y 7mo]), classified as GMFCS Levels I to III, participated in this prospective multicenter, cross-sectional study. All tools were completed by parents and participants when appropriate. Effect size indices (ESIs) for parametric variables and odds ratios for non-parametric data quantified the magnitude of differences across GMFCS levels. Binary logistic regression models determined discrimination, and receiver operating characteristic curves addressed sensitivity and specificity. Between Levels I and II, the most discriminatory tools were Gross Motor Function Measure (GMFM-66), velocity, and WeeFIM Mobility. Between Levels II and III, the most discriminatory tools were GMFM Dimension E, Pediatric Functional Independence Measure (WeeFIM) Self-Care and Mobility, cadence, and Gillette Functional Assessment Questionnaire Question 1. Large ESIs were noted for Parent and Child reports of Pediatric Outcomes Data Collection Instrument (PODCI) Sports & Physical Function, Parent report of PODCI Global Function, GMFM Dimension E, and GMFM-66 across all GMFCS level comparisons. The least discriminatory tools were the Quality of Life and cognition measures; however, these are important in comprehensive assessments of treatment effects.

Analytical tools for assessing land degradation and its impact on soil quality

NASA Astrophysics Data System (ADS)

Bindraban, P. S.; Mantel, S.; Bai, Z.; de Jong, R.

2010-05-01

Maintaining and enhancing the quality of land is of major importance to sustain future production capacity for food and other agriculture based products like fibers and wood, and for maintaining ecosystems services, including below and above ground biodiversity, provision of soil water and sequestration of carbon. Deterioration of this production base will be detrimental to the provision of the foreseen dramatic increase in human needs for goods and services. For this reason, land degradation, defined as a long-term loss in ecosystem function and productivity, has to be understood properly. Climate, soils, topography and socioeconomic activities are primary factors that can cause, by themselves or in combination, a number of temporary or permanent changes in the landscape, leading to degradation of vegetation and soils. For identifying intervention measures to prevent and revert trends of land deterioration, it is fundamental to know the extent of land degradation and to understand its impact on functional properties of land. To assess the global extent, (Bai et al. 2008) apply a remotely sensed vegetation index that describes the greenness of the vegetation cover as a proxy for biomass. Biomass production has been identified as a strong indicator for soil quality as it is an integral measure for soil, crop and environmental characteristics (Bindraban et al., 2000). Bai and colleagues observed that 24% of the global land has been degrading over the past 26 years - often in very productive areas. The relation with functional properties of land can be made through ecosystem models. Mantel et al. (1999; 2000) applied dynamic crop-soil models to calculate crop productivity at the national level. A baseline scenario that represents the current conditions and a scenario for 20 years of prolonged sheet erosion were modeled to calculate the productivity impact of topsoil erosion for wheat in Uruguay and for maize in Kenya. They concluded that topsoil erosion primarily

Framing quality improvement tools and techniques in healthcare the case of improvement leaders' guides.

PubMed

Millar, Ross

2013-01-01

The purpose of this paper is to present a study of how quality improvement tools and techniques are framed within healthcare settings. The paper employs an interpretive approach to understand how quality improvement tools and techniques are mobilised and legitimated. It does so using a case study of the NHS Modernisation Agency Improvement Leaders' Guides in England. Improvement Leaders' Guides were framed within a service improvement approach encouraging the use of quality improvement tools and techniques within healthcare settings. Their use formed part of enacting tools and techniques across different contexts. Whilst this enactment was believed to support the mobilisation of tools and techniques, the experience also illustrated the challenges in distributing such approaches. The paper provides an important contribution in furthering our understanding of framing the "social act" of quality improvement. Given the ongoing emphasis on quality improvement in health systems and the persistent challenges involved, it also provides important information for healthcare leaders globally in seeking to develop, implement or modify similar tools and distribute leadership within health and social care settings.

The use of on-site visits to assess compliance and implementation of quality management at hospital level.

PubMed

Wagner, C; Groene, O; Dersarkissian, M; Thompson, C A; Klazinga, N S; Arah, O A; Suñol, R

2014-04-01

Stakeholders of hospitals often lack standardized tools to assess compliance with quality management strategies and the implementation of clinical quality activities in hospitals. Such assessment tools, if easy to use, could be helpful to hospitals, health-care purchasers and health-care inspectorates. The aim of our study was to determine the psychometric properties of two newly developed tools for measuring compliance with process-oriented quality management strategies and the extent of implementation of clinical quality strategies at the hospital level. We developed and tested two measurement instruments that could be used during on-site visits by trained external surveyors to calculate a Quality Management Compliance Index (QMCI) and a Clinical Quality Implementation Index (CQII). We used psychometric methods and the cross-sectional data to explore the factor structure, reliability and validity of each of these instruments. The sample consisted of 74 acute care hospitals selected at random from each of 7 European countries. The psychometric properties of the two indices (QMCI and CQII). Overall, the indices demonstrated favourable psychometric performance based on factor analysis, item correlations, internal consistency and hypothesis testing. Cronbach's alpha was acceptable for the scales of the QMCI (α: 0.74-0.78) and the CQII (α: 0.82-0.93). Inter-scale correlations revealed that the scales were positively correlated, but distinct. All scales added sufficient new information to each main index to be retained. This study has produced two reliable instruments that can be used during on-site visits to assess compliance with quality management strategies and implementation of quality management activities by hospitals in Europe and perhaps other jurisdictions.

A COMPARISON OF PATIENT AND HEALTHCARE PROFESSIONAL VIEWS WHEN ASSESSING QUALITY OF INFORMATION ON PITUITARY ADENOMA AVAILABLE ON THE INTERNET.

PubMed

Druce, Irena; Williams, Chantal; Baggoo, Carolyn; Keely, Erin; Malcolm, Janine

2017-10-01

Patients are increasingly turning to the internet to seek reliable sources of health information and desire guidance in assessing the quality of information as healthcare becomes progressively more complex. Pituitary adenomas are a rare, diverse group of tumors associated with increased mortality and morbidity whose management requires a multidisciplinary approach. As such, patients with this disorder are often searching for additional sources of healthcare information. We undertook a study to assess the quality of information available on the internet for patients with pituitary adenoma. After exclusion, 42 websites were identified based on a search engine query with various search terms. Each website was assessed in triplicate: once by a health professional, once by a simulated patient, and once by a patient who had a pituitary adenoma and underwent medical and surgical treatment. The assessment tools included a content-specific questionnaire, the DISCERN tool, and the Ensuring Quality Information for Patients tool. The readability of the information was assessed with the Flesch-Kincaid grade level. We found that the overall quality of information on pituitary adenoma on the internet was variable and written at a high grade level. Correlation between the different assessors was poor, indicating that there may be differences in how healthcare professionals and patients view healthcare information. Our findings highlight the importance of assessment of the health information by groups of the intended user to ensure the needs of that population are met. Abbreviation: EQIP = Ensuring Quality Information for Patients.

Gironacel[R]: A Virtual Tool for Learning Quality Management

ERIC Educational Resources Information Center

Mendez, Empar; Casadesus, Marti; De Ciurana, Quim

2006-01-01

This article describes the Gironacel[R] project--a virtual learning environment produced by the University of Girona. The purpose of this tool is to make it easier for students studying quality management courses within engineering schools to understand what the "quality culture" is and how to implement the ISO 9001:2000 standard in a…

Use of electronic dietary assessment tools in primary care: an interdisciplinary perspective.

PubMed

Bonilla, Carolina; Brauer, Paula; Royall, Dawna; Keller, Heather; Hanning, Rhona M; DiCenso, Alba

2015-02-25

Dietary assessment can be challenging for many reasons, including the wide variety of foods, eating patterns and nutrients to be considered. In team-based primary care practice, various disciplines may be involved in assessing diet. Electronic-based dietary assessment (e-DA) instruments available now through mobile apps or websites can potentially facilitate dietary assessment. Providers views of facilitators and barriers related to e-DA instruments and their recommendations for improvement can inform the further development of these tools. The objective of this study was to explore provider perspectives on e-DA tools in mobile apps and websites. The exploratory sequential mixed methods design included interdisciplinary focus groups followed by a web-based survey sent to Family Health Teams throughout Ontario, Canada. Descriptive and bivariate analyses were completed. Focus group transcripts contributed to web-survey content, while interpretive themes added depth and context. 11 focus groups with 50 providers revealed varying perspectives on the use of e-DA for: 1) improving patients' eating habits; 2) improving the quality of dietary assessment; and, 3) integrating e-DA into the care process. In the web-survey 191 respondents from nine disciplines in 73 FHTs completed the survey. Dietitians reported greater use of e-DA than other providers (63% vs.19%; p = .000) respectively. There was strong interest among disciplines in the use of e-DA tools for the management of obesity, diabetes and heart disease, especially for patient self-monitoring. Barriers identified were: patients' lack of comfort with using technology, misinterpretation of e-DA results by patients, time and education for providers to interpret results, and time for providers to offer counselling. e-DA tools in mobile apps and websites may improve dietary counselling over time. Addressing the identified facilitators and barriers can potentially promote the uptake of e-DA into clinical practice.

A novel tool for assessing and summarizing the built environment

PubMed Central

2012-01-01

Background A growing corpus of research focuses on assessing the quality of the local built environment and also examining the relationship between the built environment and health outcomes and indicators in communities. However, there is a lack of research presenting a highly resolved, systematic, and comprehensive spatial approach to assessing the built environment over a large geographic extent. In this paper, we contribute to the built environment literature by describing a tool used to assess the residential built environment at the tax parcel-level, as well as a methodology for summarizing the data into meaningful indices for linkages with health data. Methods A database containing residential built environment variables was constructed using the existing body of literature, as well as input from local community partners. During the summer of 2008, a team of trained assessors conducted an on-foot, curb-side assessment of approximately 17,000 tax parcels in Durham, North Carolina, evaluating the built environment on over 80 variables using handheld Global Positioning System (GPS) devices. The exercise was repeated again in the summer of 2011 over a larger geographic area that included roughly 30,700 tax parcels; summary data presented here are from the 2008 assessment. Results Built environment data were combined with Durham crime data and tax assessor data in order to construct seven built environment indices. These indices were aggregated to US Census blocks, as well as to primary adjacency communities (PACs) and secondary adjacency communities (SACs) which better described the larger neighborhood context experienced by local residents. Results were disseminated to community members, public health professionals, and government officials. Conclusions The assessment tool described is both easily-replicable and comprehensive in design. Furthermore, our construction of PACs and SACs introduces a novel concept to approximate varying scales of community and

Tracer methodology: an appropriate tool for assessing compliance with accreditation standards?

PubMed

Bouchard, Chantal; Jean, Olivier

2017-10-01

Tracer methodology has been used by Accreditation Canada since 2008 to collect evidence on the quality and safety of care and services, and to assess compliance with accreditation standards. Given the importance of this methodology in the accreditation program, the objective of this study is to assess the quality of the methodology and identify its strengths and weaknesses. A mixed quantitative and qualitative approach was adopted to evaluate consistency, appropriateness, effectiveness and stakeholder synergy in applying the methodology. An online questionnaire was sent to 468 Accreditation Canada surveyors. According to surveyors' perceptions, tracer methodology is an effective tool for collecting useful, credible and reliable information to assess compliance with Qmentum program standards and priority processes. The results show good coherence between methodology components (appropriateness of the priority processes evaluated, activities to evaluate a tracer, etc.). The main weaknesses are the time constraints faced by surveyors and management's lack of cooperation during the evaluation of tracers. The inadequate amount of time allowed for the methodology to be applied properly raises questions about the quality of the information obtained. This study paves the way for a future, more in-depth exploration of the identified weaknesses to help the accreditation organization make more targeted improvements to the methodology. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Air quality management in Portugal: example of needs and available tools.

PubMed

Borrego, C; Miranda, A I; Coutinho, M; Ferreira, J; Carvalho, A C

2002-01-01

The Framework Directive (FWD) and the proposed Daughter Directives are the newest legislative instruments concerning a new political strategy and air quality management approach for Europe. Additionally, the member countries of the United Nations Economic Commission for Europe have included the concepts of critical load and level for planning air pollution abatement strategies and as a base of international agreements concerning limitation of the emissions of air pollutants. These concepts imply an accurate knowledge about pollutants deposition fluxes. The paper describes the main needs and the tools available to define a strategy of air quality management in Portugal. Two study cases are presented: (1) extensive monitoring plan to assess the impact of an urban incinerator plant; and (2) contribution to a methodology to estimate critical levels for a coastal region in Portugal. These different approaches allowed illustrating the complexity of the implementation of an air pollution management strategy.

QC-ART: A tool for real-time quality control assessment of mass spectrometry-based proteomics data.

PubMed

Stanfill, Bryan A; Nakayasu, Ernesto S; Bramer, Lisa M; Thompson, Allison M; Ansong, Charles K; Clauss, Therese; Gritsenko, Marina A; Monroe, Matthew E; Moore, Ronald J; Orton, Daniel J; Piehowski, Paul D; Schepmoes, Athena A; Smith, Richard D; Webb-Robertson, Bobbie-Jo; Metz, Thomas O

2018-04-17

Liquid chromatography-mass spectrometry (LC-MS)-based proteomics studies of large sample cohorts can easily require from months to years to complete. Acquiring consistent, high-quality data in such large-scale studies is challenging because of normal variations in instrumentation performance over time, as well as artifacts introduced by the samples themselves, such as those due to collection, storage and processing. Existing quality control methods for proteomics data primarily focus on post-hoc analysis to remove low-quality data that would degrade downstream statistics; they are not designed to evaluate the data in near real-time, which would allow for interventions as soon as deviations in data quality are detected.  In addition to flagging analyses that demonstrate outlier behavior, evaluating how the data structure changes over time can aide in understanding typical instrument performance or identify issues such as a degradation in data quality due to the need for instrument cleaning and/or re-calibration.  To address this gap for proteomics, we developed Quality Control Analysis in Real-Time (QC-ART), a tool for evaluating data as they are acquired in order to dynamically flag potential issues with instrument performance or sample quality.  QC-ART has similar accuracy as standard post-hoc analysis methods with the additional benefit of real-time analysis.  We demonstrate the utility and performance of QC-ART in identifying deviations in data quality due to both instrument and sample issues in near real-time for LC-MS-based plasma proteomics analyses of a sample subset of The Environmental Determinants of Diabetes in the Young cohort. We also present a case where QC-ART facilitated the identification of oxidative modifications, which are often underappreciated in proteomic experiments. Published under license by The American Society for Biochemistry and Molecular Biology, Inc.

The Shoulder Objective Practical Assessment Tool: Evaluation of a New Tool Assessing Residents Learning in Diagnostic Shoulder Arthroscopy.

PubMed

Talbot, Christopher L; Holt, Edward M; Gooding, Benjamin W T; Tennent, Thomas D; Foden, Philip

2015-08-01

To design and validate an objective practical assessment tool for diagnostic shoulder arthroscopy that would provide residents with a method to evaluate their progression in this field of surgery and to identify specific learning needs. We designed and evaluated the shoulder Objective Practical Assessment Tool (OPAT). The shoulder OPAT was designed by us, and scoring domains were created using a Delphi process. The shoulder OPAT was trialed by members of the British Elbow & Shoulder Society Education Committee for internal consistency and ease of use before being offered to other trainers and residents. Inter-rater reliability and intrarater reliability were calculated. One hundred forty orthopaedic residents, of varying seniority, within 5 training regions in the United Kingdom, were questioned regarding the tool. A pilot study of 6 residents was undertaken. Internal consistency was 0.77 (standardized Cronbach α). Inter-rater reliability was 0.60, and intrarater reliability was 0.82. The Spearman correlation coefficient (r) between the global summary score for the shoulder OPAT and the current assessment tool used in postgraduate training for orthopaedic residents undertaking diagnostic shoulder arthroscopy equaled 0.74. Of the residents, 82% agreed or strongly agreed when asked if the shoulder OPAT would be a useful tool in monitoring progression and 72% agreed or strongly agreed with the introduction of the shoulder OPAT within the orthopaedic domain. This study shows that the shoulder OPAT fulfills several aspects of reliability and validity when tested. Despite the inter-rater reliability being 0.60, we believe that the shoulder OPAT has the potential to play a role alongside the current assessment tool in the training of orthopaedic residents. The shoulder OPAT can be used to assess residents during shoulder arthroscopy and has the potential for use in medical education, as well as arthroscopic skills training in the operating theater. Copyright © 2015

A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

ERIC Educational Resources Information Center

Valentine, Jeffrey C.; Cooper, Harris

2008-01-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…

Automated Geospatial Watershed Assessment Tool (AGWA): Applications for Fire Management and Assessment.

EPA Science Inventory

New tools and functionality have been incorporated into the Automated Geospatial Watershed Assessment Tool (AGWA) to assess the impacts of wildland fire on runoff and erosion. AGWA (see: www.tucson.ars.ag.gov/agwa or http://www.epa.gov/esd/land-sci/agwa/) is a GIS interface joi...

Exposure Assessment Tools by Media - Air

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes - Inhalation

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Chemical Classes

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Media - Food

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes - Ingestion

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Exposure Assessment Tools by Routes - Dermal

EPA Pesticide Factsheets

EPA ExpoBox is a toolbox for exposure assessors. Its purpose is to provide a compendium of exposure assessment and risk characterization tools that will present comprehensive step-by-step guidance and links to relevant exposure assessment data bases

Application of the GEM Inventory Data Capture Tools for Dynamic Vulnerability Assessment and Recovery Modelling

NASA Astrophysics Data System (ADS)

Verrucci, Enrica; Bevington, John; Vicini, Alessandro

2014-05-01

A set of open-source tools to create building exposure datasets for seismic risk assessment was developed from 2010-13 by the Inventory Data Capture Tools (IDCT) Risk Global Component of the Global Earthquake Model (GEM). The tools were designed to integrate data derived from remotely-sensed imagery, statistically-sampled in-situ field data of buildings to generate per-building and regional exposure data. A number of software tools were created to aid the development of these data, including mobile data capture tools for in-field structural assessment, and the Spatial Inventory Data Developer (SIDD) for creating "mapping schemes" - statistically-inferred distributions of building stock applied to areas of homogeneous urban land use. These tools were made publically available in January 2014. Exemplar implementations in Europe and Central Asia during the IDCT project highlighted several potential application areas beyond the original scope of the project. These are investigated here. We describe and demonstrate how the GEM-IDCT suite can be used extensively within the framework proposed by the EC-FP7 project SENSUM (Framework to integrate Space-based and in-situ sENSing for dynamic vUlnerability and recovery Monitoring). Specifically, applications in the areas of 1) dynamic vulnerability assessment (pre-event), and 2) recovery monitoring and evaluation (post-event) are discussed. Strategies for using the IDC Tools for these purposes are discussed. The results demonstrate the benefits of using advanced technology tools for data capture, especially in a systematic fashion using the taxonomic standards set by GEM. Originally designed for seismic risk assessment, it is clear the IDCT tools have relevance for multi-hazard risk assessment. When combined with a suitable sampling framework and applied to multi-temporal recovery monitoring, data generated from the tools can reveal spatio-temporal patterns in the quality of recovery activities and resilience trends can be

Integrating three tools for the environmental assessment of the Pardo River, Brazil.

PubMed

Machado, Carolina S; Alves, Renato I S; Fregonesi, Brisa M; Beda, Cassio F; Suzuki, Meire N; Trevilato, Rudison B; Nadal, Martí; Domingo, José L; Segura-Muñoz, Susana I

2015-09-01

There is a growing need for strategic assessment of environmental conditions in river basins around the world. In spite of the considerable water resources, Brazil has been suffering from water quality decrease in recent years. Pardo River runs through Minas Gerais and São Paulo, two of the most economically important states in Brazil, and is being currently promoted as a future drinking water source. This study aimed at integrating three different tools to conduct a hydromorphological assessment focused on the spatial complexity, connectivity, and dynamism of the Pardo River, Brazil. Twelve sampling stretches were evaluated in four sampling campaigns, in dry and rainy seasons. In each stretch, permanent preservation areas (PPAs), hydromorphological integrity by rapid assessment protocol (RAP), and physicochemical parameters were qualified. The kappa coefficient was used to assess statistical agreement among monitoring tools. The PPA analysis showed that in all stretches, the vegetation was modified. RAP results revealed environmental deterioration in stretches located near human activities and less variability of substrates available for aquatic fauna and sediment deposition as well. Low values for dissolved oxygen in the river mouth were noted in the rainy season. Electrical conductivity was higher in stretches near sugarcane crops. The poor agreement (k<0.35) between the RAP and physicochemical parameters indicates that the tools generate different and complementary information, while they are not replaceable. Potential changes of the hydromorphological characteristics and variations in physicochemical indicators must be related to extensive PPA modification.

Assessments of the quality of randomized controlled trials published in International Journal of Urology from 1994 to 2011.

PubMed

Cho, Hee Ju; Chung, Jae Hoon; Jo, Jung Ki; Kang, Dong Hyuk; Cho, Jeong Man; Yoo, Tag Keun; Lee, Seung Wook

2013-12-01

Randomized controlled trials are one of the most reliable resources for assessing the effectiveness and safety of medical treatments. Low quality randomized controlled trials carry a large bias that can ultimately impair the reliability of their conclusions. The present study aimed to evaluate the quality of randomized controlled trials published in International Journal of Urology by using multiple quality assessment tools. Randomized controlled trials articles published in International Journal of Urology were found using the PubMed MEDLINE database, and qualitative analysis was carried out with three distinct assessment tools: the Jadad scale, the van Tulder scale and the Cochrane Collaboration Risk of Bias Tool. The quality of randomized controlled trials was analyzed by publication year, type of subjects, intervention, presence of funding and whether an institutional review board reviewed the study. A total of 68 randomized controlled trial articles were published among a total of 1399 original articles in International Journal of Urology. Among these randomized controlled trials, 10 (2.70%) were from 1994 to 1999, 23 (4.10%) were from 2000 to 2005 and 35 (4.00%) were from 2006 to 2011 (P = 0.494). On the assessment with the Jadad and van Tulder scale, the numbers and percentage of high quality randomized controlled trials increased over time. The studies that had institutional review board reviews, funding resources or that were carried out in multiple institutions had an increased percentage of high quality articles. The numbers and percentage of high-quality randomized controlled trials published in International Journal of Urology have increased over time. Furthermore, randomized controlled trials with funding resources, institutional review board reviews or carried out in multiple institutions have been found to be of higher quality compared with others not presenting these features. © 2013 The Japanese Urological Association.

Translation Quality Assessment in Health Research: A Functionalist Alternative to Back-Translation.

PubMed

Colina, Sonia; Marrone, Nicole; Ingram, Maia; Sánchez, Daisey

2017-09-01

As international research studies become more commonplace, the importance of developing multilingual research instruments continues to increase and with it that of translated materials. It is therefore not unexpected that assessing the quality of translated materials (e.g., research instruments, questionnaires, etc.) has become essential to cross-cultural research, given that the reliability and validity of the research findings crucially depend on the translated instruments. In some fields (e.g., public health and medicine), the quality of translated instruments can also impact the effectiveness and success of interventions and public campaigns. Back-translation (BT) is a commonly used quality assessment tool in cross-cultural research. This quality assurance technique consists of (a) translation (target text [TT 1 ]) of the source text (ST), (b) translation (TT 2 ) of TT 1 back into the source language, and (c) comparison of TT 2 with ST to make sure there are no discrepancies. The accuracy of the BT with respect to the source is supposed to reflect equivalence/accuracy of the TT. This article shows how the use of BT as a translation quality assessment method can have a detrimental effect on a research study and proposes alternatives to BT. One alternative is illustrated on the basis of the translation and quality assessment methods used in a research study on hearing loss carried out in a border community in the southwest of the United States.

Quality Tools for Professional Higher Education Review and Improvement. PHExcel Report

ERIC Educational Resources Information Center

Jørgensen, Malene Dahl; Sparre Kristensen, Regitze; Wimpf, Alexandre; Delplace, Stefan

2014-01-01

The report is the project's first outcome, and provides an overview of quality tools, quality models and quality labels, currently in use in (professional) higher education. It is followed by a gap analysis as regards the Standards and Guidelines for quality assurance in the European Higher Education Area (ESG), and the identified characteristics…

Validating Appetite Assessment Tools among Patients Receiving Hemodialysis

PubMed Central

Molfino, Alessio; Kaysen, George A.; Chertow, Glenn M.; Doyle, Julie; Delgado, Cynthia; Dwyer, Tjien; Laviano, Alessandro; Fanelli, Filippo Rossi; Johansen, Kirsten L.

2016-01-01

Objective To test the performance of appetite assessment tools among patients receiving hemodialysis. Design Cross-sectional. Setting Seven dialysis facilities in Northern California. Subjects 221 patients receiving hemodialysis. Intervention We assessed five appetite assessment tools [self-assessment of appetite, subjective assessment of appetite, visual analogue scale (VAS), Functional Assessment of Anorexia/Cachexia Therapy (FAACT) score and the Anorexia Questionnaire (AQ)]. Main outcome measures Reported food intake, normalized protein catabolic rate (nPCR), and change in body weight were used as criterion measures, and we assessed associations among the appetite tools and biomarkers associated with nutrition and inflammation. Patients were asked to report their appetite and the percentage of food eaten (from 0% to 100%) during the last meal compared to usual intake. Results Fifty-eight (26%) patients reported food intake ≤50% (defined as poor appetite). The prevalence of anorexia was 12% by self-assessment of appetite, 6% by subjective assessment of appetite, 24% by VAS, 17% by FAACT score, and 12% by AQ. All tools were significantly associated with food intake ≤50% (p<0.001), except self-assessment of appetite. The FAACT score and the VAS had the strongest association with food intake ≤50% (c-statistic 0.80 and 0.76). Patients with food intake ≤50% reported weight loss more frequently than patients without low intake (36% vs 22%) and weight gain less frequently (19% vs 35%; p=0.03). nPCR was lower among anorexic patients based on the VAS (1.1 ± 0.3 vs 1.2 ± 0.3, p=0.03). Ln IL-6 correlated inversely with food intake (p=0.03), but neither IL-6 nor CRP correlated with any of the appetite tools. Furthermore, only the self-assessment of appetite was significantly associated with serum albumin (p=0.02), prealbumin (p=0.02) and adiponectin concentrations (p=0.03). Conclusions Alternative appetite assessment tools yielded widely different estimates of the

Validating Appetite Assessment Tools Among Patients Receiving Hemodialysis.

PubMed

Molfino, Alessio; Kaysen, George A; Chertow, Glenn M; Doyle, Julie; Delgado, Cynthia; Dwyer, Tjien; Laviano, Alessandro; Rossi Fanelli, Filippo; Johansen, Kirsten L

2016-03-01

To test the performance of appetite assessment tools among patients receiving hemodialysis (HD). Cross-sectional. Two hundred twenty-one patients receiving HD enrolled in seven dialysis facilities in Northern California. We assessed 5 appetite assessment tools (self-assessment of appetite, subjective assessment of appetite, visual analog scale [VAS], Functional Assessment of Anorexia/Cachexia Therapy [FAACT] score, and the Anorexia Questionnaire [AQ]). Reported food intake, normalized protein catabolic rate, and change in body weight were used as criterion measures, and we assessed associations among the appetite tools and biomarkers associated with nutrition and inflammation. Patients were asked to report their appetite and the percentage of food eaten (from 0% to 100%) during the last meal compared to usual intake. Fifty-eight (26%) patients reported food intake ≤ 50% (defined as poor appetite). The prevalence of anorexia was 12% by self-assessment of appetite, 6% by subjective assessment of appetite, 24% by VAS, 17% by FAACT score, and 12% by AQ. All the tools were significantly associated with food intake ≤ 50% (P < .001), except self-assessment of appetite. The FAACT score and the VAS had the strongest association with food intake ≤ 50% (C-statistic 0.80 and 0.76). Patients with food intake ≤ 50% reported weight loss more frequently than patients without low intake (36% vs 22%) and weight gain less frequently (19% vs 35%; P = .03). Normalized protein catabolic rate was lower among anorexic patients based on the VAS (1.1 ± 0.3 vs 1.2 ± 0.3, P = .03). Ln interleukin-6 correlated inversely with food intake (P = .03), but neither interleukin-6 nor C-reactive protein correlated with any of the appetite tools. Furthermore, only the self-assessment of appetite was significantly associated with serum albumin (P = .02), prealbumin (P = .02) and adiponectin concentrations (P = .03). Alternative appetite assessment tools yielded widely different estimates of

Performance comparison of SNP detection tools with illumina exome sequencing data—an assessment using both family pedigree information and sample-matched SNP array data

PubMed Central

Yi, Ming; Zhao, Yongmei; Jia, Li; He, Mei; Kebebew, Electron; Stephens, Robert M.

2014-01-01

To apply exome-seq-derived variants in the clinical setting, there is an urgent need to identify the best variant caller(s) from a large collection of available options. We have used an Illumina exome-seq dataset as a benchmark, with two validation scenarios—family pedigree information and SNP array data for the same samples, permitting global high-throughput cross-validation, to evaluate the quality of SNP calls derived from several popular variant discovery tools from both the open-source and commercial communities using a set of designated quality metrics. To the best of our knowledge, this is the first large-scale performance comparison of exome-seq variant discovery tools using high-throughput validation with both Mendelian inheritance checking and SNP array data, which allows us to gain insights into the accuracy of SNP calling through such high-throughput validation in an unprecedented way, whereas the previously reported comparison studies have only assessed concordance of these tools without directly assessing the quality of the derived SNPs. More importantly, the main purpose of our study was to establish a reusable procedure that applies high-throughput validation to compare the quality of SNP discovery tools with a focus on exome-seq, which can be used to compare any forthcoming tool(s) of interest. PMID:24831545

Tool Use Within NASA Software Quality Assurance

NASA Technical Reports Server (NTRS)

Shigeta, Denise; Port, Dan; Nikora, Allen P.; Wilf, Joel

2013-01-01

As space mission software systems become larger and more complex, it is increasingly important for the software assurance effort to have the ability to effectively assess both the artifacts produced during software system development and the development process itself. Conceptually, assurance is a straightforward idea - it is the result of activities carried out by an organization independent of the software developers to better inform project management of potential technical and programmatic risks, and thus increase management's confidence in the decisions they ultimately make. In practice, effective assurance for large, complex systems often entails assessing large, complex software artifacts (e.g., requirements specifications, architectural descriptions) as well as substantial amounts of unstructured information (e.g., anomaly reports resulting from testing activities during development). In such an environment, assurance engineers can benefit greatly from appropriate tool support. In order to do so, an assurance organization will need accurate and timely information on the tool support available for various types of assurance activities. In this paper, we investigate the current use of tool support for assurance organizations within NASA, and describe on-going work at JPL for providing assurance organizations with the information about tools they need to use them effectively.

The Northeast Stream Quality Assessment

USGS Publications Warehouse

Van Metre, Peter C.; Riva-Murray, Karen; Coles, James F.

2016-04-22

In 2016, the U.S. Geological Survey (USGS) National Water-Quality Assessment (NAWQA) is assessing stream quality in the northeastern United States. The goal of the Northeast Stream Quality Assessment (NESQA) is to assess the quality of streams in the region by characterizing multiple water-quality factors that are stressors to aquatic life and evaluating the relation between these stressors and biological communities. The focus of NESQA in 2016 will be on the effects of urbanization and agriculture on stream quality in all or parts of eight states: Connecticut, Massachusetts, New Hampshire, New Jersey, New York, Pennsylvania, Rhode Island, and Vermont.Findings will provide the public and policymakers with information about the most critical factors affecting stream quality, thus providing insights about possible approaches to protect the health of streams in the region. The NESQA study will be the fourth regional study conducted as part of NAWQA and will be of similar design and scope to the first three, in the Midwest in 2013, the Southeast in 2014, and the Pacific Northwest in 2015 (http://txpub.usgs.gov/RSQA/).

Quality assessment of urban environment

NASA Astrophysics Data System (ADS)

Ovsiannikova, T. Y.; Nikolaenko, M. N.

2015-01-01

This paper is dedicated to the research applicability of quality management problems of construction products. It is offered to expand quality management borders in construction, transferring its principles to urban systems as economic systems of higher level, which qualitative characteristics are substantially defined by quality of construction product. Buildings and structures form spatial-material basis of cities and the most important component of life sphere - urban environment. Authors justify the need for the assessment of urban environment quality as an important factor of social welfare and life quality in urban areas. The authors suggest definition of a term "urban environment". The methodology of quality assessment of urban environment is based on integrated approach which includes the system analysis of all factors and application of both quantitative methods of assessment (calculation of particular and integrated indicators) and qualitative methods (expert estimates and surveys). The authors propose the system of indicators, characterizing quality of the urban environment. This indicators fall into four classes. The authors show the methodology of their definition. The paper presents results of quality assessment of urban environment for several Siberian regions and comparative analysis of these results.

Pictorial representation of illness and self measure (PRISM): an effective tool to assess the burden of psoriasis.

PubMed

Fotiou, K; Hofmann, M; Kaufmann, R; Thaci, D

2015-12-01

Psoriasis has a negative impact on patient's' quality of life, which may reflect the physical and psychosocial impact of the disease. However, little is known about the perceived burden of disease. Pictorial Representation of Illness and Self Measure (PRISM), a pictorial tool, was developed to measure this global suffering. Capturing quality of life impairments in psoriasis is an integral part of assessing the overall disease severity and planning effective treatment strategies. To validate Pictorial Representation of Illness and Self Measure (PRISM) in psoriasis patients. An investigator initiated, prospective cohort study was performed in 108 outpatients with psoriasis to validate PRISM as an appropriate tool; Reliability was assessed in a cohort with controlled stable disease, repeated after 1 hour and after a 3-month follow-up phase; Convergent validity determined by correlation against measures of life quality (DLQI) and reported severity of psoriasis (PASI, PGA and BSA) was performed. For PRISM, we found a high reliability for short-term measurements (ICC = 0.98, P < 0.001) and for follow-up assessments at 3 months (ICC = 0.76, P < 0.001). Our investigation showed significant differences between patients with clear to minimal (PGA 0, 1), mild (PGA 2) and moderate-to-severe disease (PGA 3, 4) and significant (P < 0.001) correlation with DLQI, PGA, PASI and BSA (ρ = -0.62, -0.54, -0.44 and -0.39 respectively). PRISM is a highly reliable tool and new approach to assess perceived burden of patients with psoriasis. It is easy to use and we recommend the application as an additional outcome measure in clinical trial settings. © 2015 European Academy of Dermatology and Venereology.

The use of drawing as an alternative assessment tool in biology teaching

NASA Astrophysics Data System (ADS)

Nugraha, I.

2018-05-01

Science required the recording of data to build knowledge. The act of drawing an illustration is one of the oldest methods to record the data in science. Illustration in science provides information that the written word cannot, hence the old adage “A picture is worth a thousand words” is very important for studying science. Drawings an illustration is not only valuable for artists but also for scientists because some aspects of science process skills can also be developed through drawing. In terms of science teaching, applying the act of drawing can also be used as an assessment tool. In this study, we assessed drawing of human internal organs of 38 student teachers who enrolled human physiology course and its correlation to their final exam achievement. Guidance of biological drawing was employed to assess the quality, labelling, and annotations of the drawing. The finding of this study showed that there was a positive correlation between the quality of drawing and final exam achievement. It is suggested that using the method of drawing in combination with written responses assessment would provide a more complete information about student’s understanding of human internal organs.

Assessment of olfactory function after traumatic brain injury: comparison of single odour tool with detailed assessment tool.

PubMed

Humphries, Thomas; Singh, Rajiv

2018-01-01

Olfactory disturbance (OD) is common after traumatic brain injury (TBI). Screening for OD can be performed by several different methods. While odour identification tools are considered more accurate, they are time consuming. The predominant method in clinical practice remains the use of a single odour. This study aimed to compare a brief single-odour identification tool (BSOIT) with a more detailed 12-odour assessment tool. One hundred seventy consecutive patients with TBI had their olfaction assessed using BSOIT and a 12-item tool at a single time point. The sensitivity and specificity of the BSOIT were calculated. The sensitivity and specificity of the BSOIT as compared to the Burghart tool were 57.5% and 100%, respectively, for all ODs (anosmia and hyposmia). The sensitivity and specificity for anosmia only were 93.5% and 96.7%, respectively. For the two tools, the Cohen's kappa coefficient showed moderate agreement when both anosmia and hyposmia were considered (k = 0.619, p < 0.001) but a very strong agreement when only anosmia was considered (k = 0.844, p < 0.001). For both the tools, anosmia had a significant association with TBI severity (p < 0.001). However, hyposmia showed no such association. The BSOIT is very effective at identifying anosmia but not hyposmia, producing comparable results to a more detailed test. It can be effective in clinical practice and takes considerably less time.

Student Online Readiness Assessment Tools: A Systematic Review Approach

ERIC Educational Resources Information Center

Farid, Alem

2014-01-01

Although there are tools to assess student's readiness in an "online learning context," little is known about the "psychometric" properties of the tools used or not. A systematic review of 5107 published and unpublished papers identified in a literature search on student online readiness assessment tools between 1990 and…

Concepts of Quality in Student Assessment.

ERIC Educational Resources Information Center

Harlen, Wynne

This paper gives an overview of the methods of moderation, or quality assurance and quality control, as they may be more widely known, that are used to enhance the quality of student assessment. The discussion is based on the educational systems of the United Kingdom but is applicable to assessment in other countries. Quality in assessment is seen…

Development and validation of the Vietnamese primary care assessment tool

PubMed Central

2018-01-01

Objective To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. Design A quantitative cross sectional study. Setting 56 communes in 3 representative provinces of central Vietnam. Participants Total of 3289 people who used health care services at health facility at least once over the past two years. Results The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach’s alpha above 0.70 except for the subscale of Family Centeredness. Conclusions The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops. PMID:29324851

Development and validation of the Vietnamese primary care assessment tool.

PubMed