Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor.

PubMed

Zimmerman, Kathleen N; Ledford, Jennifer R; Severini, Katherine E; Pustejovsky, James E; Barton, Erin E; Lloyd, Blair P

2018-03-03

Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional Children, What Works Clearinghouse, and Single-Case Analysis and Design Framework) were compared to determine if conclusions regarding the effectiveness of antecedent sensory-based interventions for young children changed based on choice of quality evaluation tool. Evaluation of SCD quality differed across tools, suggesting selection of quality evaluation tools impacts evaluation findings. Suggestions for selecting an appropriate quality and rigor assessment tool are provided and across-tool conclusions are drawn regarding the quality and rigor of studies. Finally, authors provide guidance for using quality evaluations in conjunction with outcome analyses when conducting syntheses of interventions evaluated in the context of SCD. Copyright © 2018 Elsevier Ltd. All rights reserved.

Tools for observational gait analysis in patients with stroke: a systematic review.

PubMed

Ferrarello, Francesco; Bianchi, Valeria Anna Maria; Baccini, Marco; Rubbieri, Gaia; Mossello, Enrico; Cavallini, Maria Chiara; Marchionni, Niccolò; Di Bari, Mauro

2013-12-01

Stroke severely affects walking ability, and assessment of gait kinematics is important in defining diagnosis, planning treatment, and evaluating interventions in stroke rehabilitation. Although observational gait analysis is the most common approach to evaluate gait kinematics, tools useful for this purpose have received little attention in the scientific literature and have not been thoroughly reviewed. The aims of this systematic review were to identify tools proposed to conduct observational gait analysis in adults with a stroke, to summarize evidence concerning their quality, and to assess their implementation in rehabilitation research and clinical practice. An extensive search was performed of original articles reporting on visual/observational tools developed to investigate gait kinematics in adults with a stroke. Two reviewers independently selected studies, extracted data, assessed quality of the included studies, and scored the metric properties and clinical utility of each tool. Rigor in reporting metric properties and dissemination of the tools also was evaluated. Five tools were identified, not all of which had been tested adequately for their metric properties. Evaluation of content validity was partially satisfactory. Reliability was poorly investigated in all but one tool. Concurrent validity and sensitivity to change were shown for 3 and 2 tools, respectively. Overall, adequate levels of quality were rarely reached. The dissemination of the tools was poor. Based on critical appraisal, the Gait Assessment and Intervention Tool shows a good level of quality, and its use in stroke rehabilitation is recommended. Rigorous studies are needed for the other tools in order to establish their usefulness.

Total Quality Management (TQM), an Overview

DTIC Science & Technology

1991-09-01

Quality Management (TQM). It discusses the reasons TQM is a current growth industry, what it is, and how one implements it. It describes the basic analytical tools, statistical process control, some advanced analytical tools, tools used by process improvement teams to enhance their own operations, and action plans for making improvements. The final sections discuss assessing quality efforts and measuring the quality to knowledge

The development of a quality appraisal tool for studies of diagnostic reliability (QAREL).

PubMed

Lucas, Nicholas P; Macaskill, Petra; Irwig, Les; Bogduk, Nikolai

2010-08-01

In systematic reviews of the reliability of diagnostic tests, no quality assessment tool has been used consistently. The aim of this study was to develop a specific quality appraisal tool for studies of diagnostic reliability. Key principles for the quality of studies of diagnostic reliability were identified with reference to epidemiologic principles, existing quality appraisal checklists, and the Standards for Reporting of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) resources. Specific items that encompassed each of the principles were developed. Experts in diagnostic research provided feedback on the items that were to form the appraisal tool. This process was iterative and continued until consensus among experts was reached. The Quality Appraisal of Reliability Studies (QAREL) checklist includes 11 items that explore seven principles. Items cover the spectrum of subjects, spectrum of examiners, examiner blinding, order effects of examination, suitability of the time interval among repeated measurements, appropriate test application and interpretation, and appropriate statistical analysis. QAREL has been developed as a specific quality appraisal tool for studies of diagnostic reliability. The reliability of this tool in different contexts needs to be evaluated. Copyright (c) 2010 Elsevier Inc. All rights reserved.

Evaluation of English Websites on Dental Caries by Using Consumer Evaluation Tools.

PubMed

Blizniuk, Anastasiya; Furukawa, Sayaka; Ueno, Masayuki; Kawaguchi, Yoko

2016-01-01

To evaluate the quality of patient-oriented online information about dental caries using existing consumer evaluation tools and to judge the efficacy of these tools in quality assessment. The websites for the evaluation were pooled by using two general search engines (Google and Yahoo!). The search terms were: 'dental caries', 'tooth decay' and 'tooth cavity'. Three assessment tools (LIDA, DISCERN and FRES) were used to evaluate the quality of the information in the areas of accessibility, usability, reliability and readability. In total, 77 websites were analysed. The median scores of LIDA accessibility and usability were 45.0 and 8.0, respectively, which corresponded to a medium level of quality. The median reliability scores for LIDA (12.0) and DISCERN (20.0) both corresponded to low level of quality. The readability was high with the median FRES score 59.7. The websites on caries had good accessibility, usability and readability, while reliability of the information was poor. The LIDA instrument was found to be more convenient than DISCERN and can be recommended to lay people for quick quality assessment.

Validity evidence as a key marker of quality of technical skill assessment in OTL-HNS.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2018-01-13

Quality monitoring of assessment practices should be a priority in all residency programs. Validity evidence is one of the main hallmarks of assessment quality and should be collected to support the interpretation and use of assessment data. Our objective was to identify, synthesize, and present the validity evidence reported supporting different technical skill assessment tools in otolaryngology-head and neck surgery (OTL-HNS). We performed a secondary analysis of data generated through a systematic review of all published tools for assessing technical skills in OTL-HNS (n = 16). For each tool, we coded validity evidence according to the five types of evidence described by the American Educational Research Association's interpretation of Messick's validity framework. Descriptive statistical analyses were conducted. All 16 tools included in our analysis were supported by internal structure and relationship to variables validity evidence. Eleven articles presented evidence supporting content. Response process was discussed only in one article, and no study reported on evidence exploring consequences. We present the validity evidence reported for 16 rater-based tools that could be used for work-based assessment of OTL-HNS residents in the operating room. The articles included in our review were consistently deficient in evidence for response process and consequences. Rater-based assessment tools that support high-stakes decisions that impact the learner and programs should include several sources of validity evidence. Thus, use of any assessment should be done with careful consideration of the context-specific validity evidence supporting score interpretation, and we encourage deliberate continual assessment quality-monitoring. NA. Laryngoscope, 2018. © 2018 The American Laryngological, Rhinological and Otological Society, Inc.

The visibility of QSEN competencies in clinical assessment tools in Swedish nurse education.

PubMed

Nygårdh, Annette; Sherwood, Gwen; Sandberg, Therese; Rehn, Jeanette; Knutsson, Susanne

2017-12-01

Prospective nurses need specific and sufficient knowledge to be able to provide quality care. The Swedish Society of Nursing has emphasized the importance of the six quality and safety competencies (QSEN), originated in the US, in Swedish nursing education. To investigate the visibility of the QSEN competencies in the assessment tools used in clinical practice METHOD: A quantitative descriptive method was used to analyze assessment tools from 23 universities. Teamwork and collaboration was the most visible competency. Patient-centered care was visible to a large degree but was not referred to by name. Informatics was the least visible, a notable concern since all nurses should be competent in informatics to provide quality and safety in care. These results provide guidance as academic and clinical programs around the world implement assessment of how well nurses have developed these essential quality and safety competencies. Copyright © 2017 Elsevier Ltd. All rights reserved.

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

The Structured Assessment of Violence Risk in Adults with Intellectual Disability: A Systematic Review.

PubMed

Hounsome, J; Whittington, R; Brown, A; Greenhill, B; McGuire, J

2018-01-01

While structured professional judgement approaches to assessing and managing the risk of violence have been extensively examined in mental health/forensic settings, the application of the findings to people with an intellectual disability is less extensively researched and reviewed. This review aimed to assess whether risk assessment tools have adequate predictive validity for violence in adults with an intellectual disability. Standard systematic review methodology was used to identify and synthesize appropriate studies. A total of 14 studies were identified as meeting the inclusion criteria. These studies assessed the predictive validity of 18 different risk assessment tools, mainly in forensic settings. All studies concluded that the tools assessed were successful in predicting violence. Studies were generally of a high quality. There is good quality evidence that risk assessment tools are valid for people with intellectual disability who offend but further research is required to validate tools for use with people with intellectual disability who offend. © 2016 John Wiley & Sons Ltd.

Improving the Quality of Assessment Grading Tools in Master of Education Courses: A Comparative Case Study in the Scholarship of Teaching and Learning

ERIC Educational Resources Information Center

Christie, Michael; Grainger, Peter; Dahlgren, Robert; Call, Kairen; Heck, Deborah; Simon, Susan

2015-01-01

This study compares the use and efficacy of assessment grading tools within postgraduate education courses in a regional Australian university and a regional university in the US. Specifically, we investigate how the quality of postgraduate education courses can be improved through the use of assessment rubrics or criterion referenced assessment…

Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites

PubMed Central

Steinwachs, Donald; Rubin, Haya R

2003-01-01

Background Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness. Objective This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality. Methods An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness. Results Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80. Conclusions Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information. PMID:14713658

A tool for assessment of heart failure prescribing quality: A systematic review and meta-analysis.

PubMed

El Hadidi, Seif; Darweesh, Ebtissam; Byrne, Stephen; Bermingham, Margaret

2018-04-16

Heart failure (HF) guidelines aim to standardise patient care. Internationally, prescribing practice in HF may deviate from guidelines and so a standardised tool is required to assess prescribing quality. A systematic review and meta-analysis were performed to identify a quantitative tool for measuring adherence to HF guidelines and its clinical implications. Eleven electronic databases were searched to include studies reporting a comprehensive tool for measuring adherence to prescribing guidelines in HF patients aged ≥18 years. Qualitative studies or studies measuring prescription rates alone were excluded. Study quality was assessed using the Good ReseArch for Comparative Effectiveness Checklist. In total, 2455 studies were identified. Sixteen eligible full-text articles were included (n = 14 354 patients, mean age 69 ± 8 y). The Guideline Adherence Index (GAI), and its modified versions, was the most frequently cited tool (n = 13). Other tools identified were the Individualised Reconciled Evidence Recommendations, the Composite Heart Failure Performance, and the Heart Failure Scale. The meta-analysis included the GAI studies of good to high quality. The average GAI-3 was 62%. Compared to low GAI, high GAI patients had lower mortality rate (7.6% vs 33.9%) and lower rehospitalisation rates (23.5% vs 24.5%); both P ≤ .05. High GAI was associated with reduced risk of mortality (hazard ratio = 0.29, 95% confidence interval, 0.06-0.51) and rehospitalisation (hazard ratio = 0.64, 95% confidence interval, 0.41-1.00). No tool was used to improve prescribing quality. The GAI is the most frequently used tool to assess guideline adherence in HF. High GAI is associated with improved HF outcomes. Copyright © 2018 John Wiley & Sons, Ltd.

Monitoring quality of care at dialysis facilities: a case for regulatory parsimony--and beyond.

PubMed

Stivelman, John C

2012-10-01

With the issuance of the new Conditions for Coverage in 2008 and the implementation of the Prospective Payment System in 2011, the Centers for Medicare & Medicaid Services has fundamentally altered the regulatory landscape of quality in the ESRD program. Although these changes-largely through use of tools comparing individual facility performance to regional and national quality expectations-have increased facility accountability for the quality of patient care in many quarters, they have also complicated both substance and process of facility adherence to quality rules in that component of the program. This editorial critically assesses the main quality tools now in use for dialysis facilities and reviews the issues arising from their conjoint use. A scheme for improving the effectiveness of each quality tool is proposed, and an assessment of their future value and effectiveness in quality improvement is offered.

Indoor Air Quality Building Education and Assessment Model Forms

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM) is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Assessment of quality of prescribing in patients of hypertension at primary and secondary health care facilities using the Prescription Quality Index (PQI) tool.

PubMed

Suthar, Jalpa Vashishth; Patel, Varsha J

2014-01-01

To determine the quality of prescribing in hypertension in primary and secondary health care settings using the Prescription Quality Index (PQI) tool and to assess the reliability of this tool. An observational cross-sectional study was carried out for 6 months in order to assess quality of prescribing of antihypertensive drugs using Prescription Quality Index (PQI) at four primary (PHC) and two secondary (SHC) health care facilities. Patients attending these facilities for at least 3 months were included. Complete medical history and prescriptions received were noted. Total and criteria wise PQI scores were derived for each prescription. Prescriptions were categorized as poor (score of ≤31), medium (score 32-33) and high quality (score 34-43) based on PQI total score. Psychometric analysis using factor analysis was carried out to assess reliability and validity. Total 73 hypertensive patients were included. Mean age was 61.2 ± 11 years with 35 (48%) patients above 65 years of age. Total PQI score was 26 ± 11. There was a significant difference in PQI score between PHC and SHC (P < 0.05) Out of 73 prescriptions, 43 (59%) were of poor quality with PQI score <31. The value of Cronbach's α for the entire 22 criteria of PQI was 0.71 suggesting good reliability of PQI tool in our setting. Based on PQI scores, quality of prescribing in hypertensive patients was poor, somewhat better in primary as compared to secondary health care facility. PQI is reliable for measuring prescribing quality in hypertension in Indian set up.

Use of dietary assessment tools in randomized trials evaluating diet-based interventions in pregnancy: a systematic review of literature.

PubMed

Al Wattar, Bassel H; Mylrea-Lowndes, Bronacha; Morgan, Catrin; Moore, Amanda P; Thangaratinam, Shakila

2016-12-01

Accurate assessment of dietary intake in interventional trials is the key to evaluate changes in dietary behaviour and compliance. We evaluated the use of dietary assessment tools in randomized trials on diet-based interventions in pregnancy by a systematic review. We updated our previous search (until January 2012) on trials of diet and lifestyle interventions in pregnancy using Medline and EMBASE up to December 2015. Two independent reviewers undertook study selection and data extraction. We assessed the characteristics of dietary assessment tools, the timing and frequency of use and any validation undertaken.Two-thirds (39/58, 67%) of the included studies used some form of tools to assess dietary intake. Multiple days' food diaries were the most commonly used (23/39, 59%). Three studies (3/39, 8%) validated the used tools in a pregnant population. Three studies (3/39, 8%) prespecified the criteria for adherence to the intervention. The use of dietary assessment tools was not associated with study quality, year of publication, journal impact factor, type of journal and the study sample size. Although self-reporting dietary assessment tools are widely used in interventional dietary trials in pregnancy, the quality and applicability of existing tools are low.

Indoor Air Quality Building Education and Assessment Model

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM), released in 2002, is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Links Related to the Indoor Air Quality Building Education and Assessment Model

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM) is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Bibliography for the Indoor Air Quality Building Education and Assessment Model

EPA Pesticide Factsheets

The Indoor Air Quality Building Education and Assessment Model (I-BEAM) is a guidance tool designed for use by building professionals and others interested in indoor air quality in commercial buildings.

Teacher Quality Toolkit. 2nd Edition

ERIC Educational Resources Information Center

Lauer, Patricia A.; Dean, Ceri B.; Martin-Glenn, Mya L.; Asensio, Margaret L.

2005-01-01

The Teacher Quality Toolkit addresses the continuum of teacher learning by providing tools that can be used to improve both preservice, and inservice teacher education. Each chapter provides self assessment tools that can guide progress toward improved teacher quality and describes resources for designing exemplary programs and practices. Chapters…

Service quality assessment of workers compensation health care delivery programs in New York using SERVQUAL.

PubMed

Arunasalam, Mark; Paulson, Albert; Wallace, William

2003-01-01

Preferred provider organizations (PPOs) provide healthcare services to an expanding proportion of the U.S. population. This paper presents a programmatic assessment of service quality in the workers' compensation environment using two different models: the PPO program model and the fee-for-service (FFS) payor model. The methodology used here will augment currently available research in workers' compensation, which has been lacking in measuring service quality determinants and assessing programmatic success/failure of managed care type programs. Results indicated that the SERVQUAL tool provided a reliable and valid clinical quality assessment tool that ascertained that PPO marketers should focus on promoting physician outreach (to show empathy) and accessibility (to show reliability) for injured workers.

76 FR 31339 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-31

... extension of the currently approved tool for the collection of ambulatory care clinical performance measure...: Medicare Demonstration Ambulatory Care Quality Measure Performance Assessment Tool (``PAT''); Use: This... based system. This system will also provide a platform for developing tools to collect clinical quality...

A Standards-Based Grading and Reporting Tool for Faculty: Design and Implications

ERIC Educational Resources Information Center

Sadik, Alaa M.

2011-01-01

The use of standard-based assessment, grading and reporting tools is essential to ensure that assessment meets acceptable levels of quality and standardization. This study reports the design, development and evaluation of a standards-based assessment tool for the instructors at Sultan Qaboos University, Sultanate of Oman. The Rapid Applications…

Quality of health care and the need for assessment.

PubMed

Bosse, G; Ngoli, B; Leshabari, M T; Külker, R; Dämmrich, T; Abels, W; Breuer, J P; Kersten, R; Spies, C

2011-09-01

In many hospitals of developing countries quality of care is below the expected standard to maintain patient safety. In 2006, health care experts from Tanzania and Germany collaborated on a set of indicators to be used as a hospital performance assessment tool. The aim of this study was to introduce this tool and check its feasibility for use in a Tanzanian regional hospital. Within the hospital, independent observers assessed quantitatively structural quality and the performance of health care encounter using an itemized scale from 0 (0%) to 2 (100%) for each defined item. Outcome parameters were taken from the annual hospital report. In addition, semi-qualitative interviews with staff and patients were held to a) assess staff knowledge of the treatment guidelines published by the Tanzanian Ministry of Health and Social Welfare (MoHSW), b) assess attitudes and user motivation and c) authenticate the quantitative findings in a mixed-method triangulation approach. Structural quality in maternity was at 75% of the expected standard, while process quality ranged from 36% (Care of the newborn with APGAR score < 4) to 47% (normal delivery procedure). Staff knowledge ranged between 64% and 87% with low motivation and commitment given as contributing factors. Outcome (maternal mortality) was 481/100,000 live births with an infant mortality rate of 10%. The tool appeared to be feasible and effective in judging care quality. It provides a model for continuous quality improvement. Motivation of health care workers, a strong determinant of care process quality, might be improved by strengthening internal factors in health facilities. For conclusive validation, further studies using the tool must be conducted with larger numbers of institutions.

BASINS Climate Assessment Tool Tutorials

EPA Pesticide Factsheets

The BASINS Climate Assessment Tool (CAT) provides a flexible set of capabilities for exploring the potential effects of climate change on streamflow and water quality using different watershed models in BASINS.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi.

PubMed

Ruark, Allison; Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women's and men's couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi

PubMed Central

Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women’s and men’s couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships. PMID:29190769

BASINs and WEPP Climate Assessment Tools (CAT): Case ...

EPA Pesticide Factsheets

EPA announced the release of the final report, BASINs and WEPP Climate Assessment Tools (CAT): Case Study Guide to Potential Applications. This report supports application of two recently developed water modeling tools, the Better Assessment Science Integrating point & Non-point Sources (BASINS) and the Water Erosion Prediction Project Climate Assessment Tool (WEPPCAT). The report presents a series of short case studies designed to illustrate the capabilities of these tools for conducting scenario based assessments of the potential effects of climate change on streamflow and water quality. This report presents a series of short, illustrative case studies using the BASINS and WEPP climate assessment tools.

Quality indicators to compare accredited independent pharmacies and accredited chain pharmacies in Thailand.

PubMed

Arkaravichien, Wiwat; Wongpratat, Apichaya; Lertsinudom, Sunee

2016-08-01

Background Quality indicators determine the quality of actual practice in reference to standard criteria. The Community Pharmacy Association (Thailand), with technical support from the International Pharmaceutical Federation, developed a tool for quality assessment and quality improvement at community pharmacies. This tool has passed validity and reliability tests, but has not yet had feasibility testing. Objective (1) To test whether this quality tool could be used in routine settings. (2) To compare quality scores between accredited independent and accredited chain pharmacies. Setting Accredited independent pharmacies and accredited chain pharmacies in the north eastern region of Thailand. Methods A cross sectional study was conducted in 34 accredited independent pharmacies and accredited chain pharmacies. Quality scores were assessed by observation and by interviewing the responsible pharmacists. Data were collected and analyzed by independent t-test and Mann-Whitney U test as appropriate. Results were plotted by histogram and spider chart. Main outcome measure Domain's assessable scores, possible maximum scores, mean and median of measured scores. Results Domain's assessable scores were close to domain's possible maximum scores. This meant that most indicators could be assessed in most pharmacies. The spider chart revealed that measured scores in the personnel, drug inventory and stocking, and patient satisfaction and health promotion domains of chain pharmacies were significantly higher than those of independent pharmacies (p < 0.05). There was no statistical difference between independent pharmacies and chain pharmacies in the premise and facility or dispensing and patient care domains. Conclusion Quality indicators developed by the Community Pharmacy Association (Thailand) could be used to assess quality of practice in pharmacies in routine settings. It is revealed that the quality scores of chain pharmacies were higher than those of independent pharmacies.

A Proposal for Assessing Study Quality: Biomonitoring, Environmental Epidemiology, and Short-Lived Chemicals (BEES-C) Instrument

EPA Science Inventory

The quality of exposure assessment is a major determinant of the overall quality of any environmental epidemiology study. The use of biomonitoring as a tool for assessing exposure to ubiquitous chemicals with short physiologic half-lives began relatively recently. These chemicals...

Assessing the Validity of the Qualistar Early Learning Quality Rating and Improvement System as a Tool for Improving Child-Care Quality

ERIC Educational Resources Information Center

Zellman, Gail L.; Perlman, Michal; Le, Vi-Nhuan; Setodji, Claude Messan

2008-01-01

As a result of the generally low quality of child care in the United States and the increased emphasis on accountability in education policy, quality rating systems (QRSs) are proliferating in the child-care arena. QRSs assess child-care providers on multiple dimensions of quality and integrate these assessments into an easily understood summary…

Assessing Assessment Quality: Criteria for Quality Assurance in Design of (Peer) Assessment for Learning--A Review of Research Studies

ERIC Educational Resources Information Center

Tillema, Harm; Leenknecht, Martijn; Segers, Mien

2011-01-01

The interest in "assessment for learning" (AfL) has resulted in a search for new modes of assessment that are better aligned to students' learning how to learn. However, with the introduction of new assessment tools, also questions arose with respect to the quality of its measurement. On the one hand, the appropriateness of traditional,…

Quality assessment of decision-making in colorectal cancer multidisciplinary meetings.

PubMed

Seretis, Charalampos; Mankotia, Rajnish; Goonetilleke, Kolitha; Rawstorne, Edward

2014-01-01

The quality of decision-making in the colorectal multidisciplinary team (MDT) meetings can significantly affect the quality of care delivered to patients with colorectal cancer. We performed a prospective study to assess the quality of the MDT meetings in a specialized colorectal unit using an externally observational validated tool. An externally validated observational tool, the Colorectal Multidisciplinary Team Metric for Observation of Decision-Making (cMDT-MODe), was used to assess the quality of clinical decision-making in 64 cases. Although case history information presented by the responsible surgeon was rated high (4.4/5), the quality of radiological and histopathological information regarding each patient's case which was available at the time was less adequate, scoring 3.9/5 and 3.8/5, respectively. Moreover, the precise knowledge of patients' personal views and circumstances was a field requiring further improvement. In a general overview however, the quality and extent of the available information enabled the MDT to provide a clear recommendation regarding the patients' treatment plans in 87.5% of the cases. The cMDT-MODe tool can be used to prospectively audit the quality of clinical decision-making in the colorectal MDT meetings and highlight the fields of potential improvement.

[Risk on bias assessment: (6) A Revised Tool for the Quality Assessment on Diagnostic Accuracy Studies (QUADAS-2)].

PubMed

Qu, Y J; Yang, Z R; Sun, F; Zhan, S Y

2018-04-10

This paper introduced the Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2), including the development and comparison with the original QUADAS, and illustrated the application of QUADAS-2 in a published paper related to the study on diagnostic accuracy which was included in systematic review and Meta-analysis. QUADAS-2 presented considerable improvement over the original tool. Confused items that included in QUADAS had disappeared and the quality assessment of the original study replaced by the rating of risk on bias and applicability. This was implemented through the description on the four main domains with minimal overlapping and answering the signal questions in each domain. The risk of bias and applicability with 'high','low' or 'unclear' was in line with the risk of bias assessment of intervention studies in Cochrane, so to replace the total score of quality assessment in QUADAS. Meanwhile, QUADAS-2 was also applicable to assess the diagnostic accuracy studies in which follow-up without prognosis was involved in golden standard. It was useful to assess the overall methodological quality of the study despite more time consuming than the original QUADAS. However, QUADAS-2 needs to be modified to apply in comparative studies on diagnostic accuracy and we hope the users would follow the updates and give their feedbacks on line.

Performance comparison of SNP detection tools with illumina exome sequencing data—an assessment using both family pedigree information and sample-matched SNP array data

PubMed Central

Yi, Ming; Zhao, Yongmei; Jia, Li; He, Mei; Kebebew, Electron; Stephens, Robert M.

2014-01-01

To apply exome-seq-derived variants in the clinical setting, there is an urgent need to identify the best variant caller(s) from a large collection of available options. We have used an Illumina exome-seq dataset as a benchmark, with two validation scenarios—family pedigree information and SNP array data for the same samples, permitting global high-throughput cross-validation, to evaluate the quality of SNP calls derived from several popular variant discovery tools from both the open-source and commercial communities using a set of designated quality metrics. To the best of our knowledge, this is the first large-scale performance comparison of exome-seq variant discovery tools using high-throughput validation with both Mendelian inheritance checking and SNP array data, which allows us to gain insights into the accuracy of SNP calling through such high-throughput validation in an unprecedented way, whereas the previously reported comparison studies have only assessed concordance of these tools without directly assessing the quality of the derived SNPs. More importantly, the main purpose of our study was to establish a reusable procedure that applies high-throughput validation to compare the quality of SNP discovery tools with a focus on exome-seq, which can be used to compare any forthcoming tool(s) of interest. PMID:24831545

Stimulating a Culture of Improvement: Introducing 
an Integrated Quality Tool for Organizational Self-Assessment.

PubMed

Coleman, Cathy

2015-06-01

As leaders and systems-level agents of change, oncology nurses are challenged by opportunities to guide organizational transformation from the front line to the board room. Across all care settings, reform and change initiatives are constants in the quest to optimize quality and healthcare outcomes for individuals, teams, populations, and organizations. This article describes a practical, evidence-based, integrated quality tool for initiating organizational self-assessment to prioritize issues and stimulate a culture of continuous improvement.

Assessment of nutritional status and quality of life in patients treated for head and neck cancer.

PubMed

Prevost, V; Joubert, C; Heutte, N; Babin, E

2014-04-01

The purpose of this study was to identify tools for the assessment of nutritional status in head and neck cancer patients, to evaluate the impact of malnutrition on therapeutic management and quality of life and to propose a simple screening approach adapted to routine clinical practice. The authors conducted a review of the literature to identify tools for the assessment of nutritional status in head and neck cancer patients published in French and English. Articles were obtained from the PubMed database and from the references of these articles and selected journals, using the keywords: "nutritional assessment", and "head and neck" and "cancer". Anthropometric indices, laboratory parameters, dietary intake assessment, clinical scores and nutritional risk scores used in patients with head and neck cancers are presented. The relevance of these tools in clinical practice and in research is discussed, together with the links between nutritional status and quality of life. This article is designed to help teams involved in the management of patients with head and neck cancer to choose the most appropriate tools for assessment of nutritional status according to their resources and their objectives. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Quality of online pediatric orthopaedic education materials.

PubMed

Feghhi, Daniel P; Komlos, Daniel; Agarwal, Nitin; Sabharwal, Sanjeev

2014-12-03

Increased availability of medical information on the Internet empowers patients to look up answers to questions about their medical conditions. However, the quality of medical information available on the Internet is highly variable. Various tools for the assessment of online medical information have been developed and used to assess the quality and accuracy of medical web sites. In this study we used the LIDA tool (Minervation) to assess the quality of pediatric patient information on the AAOS (American Academy of Orthopaedic Surgeons) and POSNA (Pediatric Orthopaedic Society of North America) web sites. The accessibility, usability, and reliability of online medical information in the "Children" section of the AAOS web site and on the POSNA web site were assessed with use of the LIDA tool. Flesch-Kincaid (FK) and Flesch Reading Ease (FRE) values were also calculated to assess the readability of the pediatric education material. Patient education materials on each web site scored in the moderate range in assessments of accessibility, usability, and reliability. FK and FRE values indicated that the readability of each web site remained at a somewhat higher (more difficult) level than the recommended benchmark. The quality and readability of online information for children on the AAOS and POSNA web sites are acceptable but can be improved further. The quality of online pediatric orthopaedic patient education materials may affect communication with patients and their caregivers, and further investigation and modification of quality are needed. Copyright © 2014 by The Journal of Bone and Joint Surgery, Incorporated.

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis

PubMed Central

2013-01-01

Background Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. Methods We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. Results In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. Conclusions There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to assess risk of bias of RCTs. Further empirical evidence on the use of individual items and the psychometric properties of risk of bias tools is needed. PMID:24044807

Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis.

PubMed

Armijo-Olivo, Susan; Fuentes, Jorge; Ospina, Maria; Saltaji, Humam; Hartling, Lisa

2013-09-17

Assessing the risk of bias of randomized controlled trials (RCTs) is crucial to understand how biases affect treatment effect estimates. A number of tools have been developed to evaluate risk of bias of RCTs; however, it is unknown how these tools compare to each other in the items included. The main objective of this study was to describe which individual items are included in RCT quality tools used in general health and physical therapy (PT) research, and how these items compare to those of the Cochrane Risk of Bias (RoB) tool. We used comprehensive literature searches and a systematic approach to identify tools that evaluated the methodological quality or risk of bias of RCTs in general health and PT research. We extracted individual items from all quality tools. We calculated the frequency of quality items used across tools and compared them to those in the RoB tool. Comparisons were made between general health and PT quality tools using Chi-squared tests. In addition to the RoB tool, 26 quality tools were identified, with 19 being used in general health and seven in PT research. The total number of quality items included in general health research tools was 130, compared with 48 items across PT tools and seven items in the RoB tool. The most frequently included items in general health research tools (14/19, 74%) were inclusion and exclusion criteria, and appropriate statistical analysis. In contrast, the most frequent items included in PT tools (86%, 6/7) were: baseline comparability, blinding of investigator/assessor, and use of intention-to-treat analysis. Key items of the RoB tool (sequence generation and allocation concealment) were included in 71% (5/7) of PT tools, and 63% (12/19) and 37% (7/19) of general health research tools, respectively. There is extensive item variation across tools that evaluate the risk of bias of RCTs in health research. Results call for an in-depth analysis of items that should be used to assess risk of bias of RCTs. Further empirical evidence on the use of individual items and the psychometric properties of risk of bias tools is needed.

Appraisal Tools for Clinical Practice Guidelines: A Systematic Review

PubMed Central

Siering, Ulrich; Eikermann, Michaela; Hausner, Elke; Hoffmann-Eßer, Wiebke; Neugebauer, Edmund A.

2013-01-01

Introduction Clinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools. Methods Among others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items. Results We identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions “evaluation of evidence” (mentioned in 35 tools; 88%), “presentation of guideline content” (34 tools; 85%), “transferability” (33 tools; 83%), “independence” (32 tools; 80%), “scope” (30 tools; 75%), and “information retrieval” (29 tools; 73%). The quality dimensions “consideration of different perspectives” and “dissemination, implementation and evaluation of the guideline” were covered by only twenty (50%) and eighteen tools (45%) respectively. Conclusions Most guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools. PMID:24349397

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

PubMed

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

HEPS Inventory Tool: An Inventory Tool Including Quality Assessment of School Interventions on Healthy Eating and Physical Activity

ERIC Educational Resources Information Center

Dadaczynski, Kevin; Paulus, Peter; de Vries, Nanne; de Ruiter, Silvia; Buijs, Goof

2010-01-01

The HEPS Inventory Tool aims to support stakeholders working in school health promotion to promote high quality interventions on healthy eating and physical activity. As a tool it provides a step-by-step approach on how to develop a national or regional inventory of existing school based interventions on healthy eating and physical activity. It…

Assessing Quality in Home Visiting Programs

ERIC Educational Resources Information Center

Korfmacher, Jon; Laszewski, Audrey; Sparr, Mariel; Hammel, Jennifer

2013-01-01

Defining quality and designing a quality assessment measure for home visitation programs is a complex and multifaceted undertaking. This article summarizes the process used to create the Home Visitation Program Quality Rating Tool (HVPQRT) and identifies next steps for its development. The HVPQRT measures both structural and dynamic features of…

A COMPARISON OF PATIENT AND HEALTHCARE PROFESSIONAL VIEWS WHEN ASSESSING QUALITY OF INFORMATION ON PITUITARY ADENOMA AVAILABLE ON THE INTERNET.

PubMed

Druce, Irena; Williams, Chantal; Baggoo, Carolyn; Keely, Erin; Malcolm, Janine

2017-10-01

Patients are increasingly turning to the internet to seek reliable sources of health information and desire guidance in assessing the quality of information as healthcare becomes progressively more complex. Pituitary adenomas are a rare, diverse group of tumors associated with increased mortality and morbidity whose management requires a multidisciplinary approach. As such, patients with this disorder are often searching for additional sources of healthcare information. We undertook a study to assess the quality of information available on the internet for patients with pituitary adenoma. After exclusion, 42 websites were identified based on a search engine query with various search terms. Each website was assessed in triplicate: once by a health professional, once by a simulated patient, and once by a patient who had a pituitary adenoma and underwent medical and surgical treatment. The assessment tools included a content-specific questionnaire, the DISCERN tool, and the Ensuring Quality Information for Patients tool. The readability of the information was assessed with the Flesch-Kincaid grade level. We found that the overall quality of information on pituitary adenoma on the internet was variable and written at a high grade level. Correlation between the different assessors was poor, indicating that there may be differences in how healthcare professionals and patients view healthcare information. Our findings highlight the importance of assessment of the health information by groups of the intended user to ensure the needs of that population are met. Abbreviation: EQIP = Ensuring Quality Information for Patients.

National Water-Quality Assessment (NAWQA) Area-Characterization Toolbox

USGS Publications Warehouse

Price, Curtis

2010-01-01

This is release 1.0 of the National Water-Quality Assessment (NAWQA) Area-Characterization Toolbox. These tools are designed to be accessed using ArcGIS Desktop software (versions 9.3 and 9.3.1). The toolbox is composed of a collection of custom tools that implement geographic information system (GIS) techniques used by the NAWQA Program to characterize aquifer areas, drainage basins, and sampled wells.

Information security system quality assessment through the intelligent tools

NASA Astrophysics Data System (ADS)

Trapeznikov, E. V.

2018-04-01

The technology development has shown the automated system information security comprehensive analysis necessity. The subject area analysis indicates the study relevance. The research objective is to develop the information security system quality assessment methodology based on the intelligent tools. The basis of the methodology is the information security assessment model in the information system through the neural network. The paper presents the security assessment model, its algorithm. The methodology practical implementation results in the form of the software flow diagram are represented. The practical significance of the model being developed is noted in conclusions.

A case study: application of statistical process control tool for determining process capability and sigma level.

PubMed

Chopra, Vikram; Bairagi, Mukesh; Trivedi, P; Nagar, Mona

2012-01-01

Statistical process control is the application of statistical methods to the measurement and analysis of variation process. Various regulatory authorities such as Validation Guidance for Industry (2011), International Conference on Harmonisation ICH Q10 (2009), the Health Canada guidelines (2009), Health Science Authority, Singapore: Guidance for Product Quality Review (2008), and International Organization for Standardization ISO-9000:2005 provide regulatory support for the application of statistical process control for better process control and understanding. In this study risk assessments, normal probability distributions, control charts, and capability charts are employed for selection of critical quality attributes, determination of normal probability distribution, statistical stability, and capability of production processes, respectively. The objective of this study is to determine tablet production process quality in the form of sigma process capability. By interpreting data and graph trends, forecasting of critical quality attributes, sigma process capability, and stability of process were studied. The overall study contributes to an assessment of process at the sigma level with respect to out-of-specification attributes produced. Finally, the study will point to an area where the application of quality improvement and quality risk assessment principles for achievement of six sigma-capable processes is possible. Statistical process control is the most advantageous tool for determination of the quality of any production process. This tool is new for the pharmaceutical tablet production process. In the case of pharmaceutical tablet production processes, the quality control parameters act as quality assessment parameters. Application of risk assessment provides selection of critical quality attributes among quality control parameters. Sequential application of normality distributions, control charts, and capability analyses provides a valid statistical process control study on process. Interpretation of such a study provides information about stability, process variability, changing of trends, and quantification of process ability against defective production. Comparative evaluation of critical quality attributes by Pareto charts provides the least capable and most variable process that is liable for improvement. Statistical process control thus proves to be an important tool for six sigma-capable process development and continuous quality improvement.

An Automated Treatment Plan Quality Control Tool for Intensity-Modulated Radiation Therapy Using a Voxel-Weighting Factor-Based Re-Optimization Algorithm.

PubMed

Song, Ting; Li, Nan; Zarepisheh, Masoud; Li, Yongbao; Gautier, Quentin; Zhou, Linghong; Mell, Loren; Jiang, Steve; Cerviño, Laura

2016-01-01

Intensity-modulated radiation therapy (IMRT) currently plays an important role in radiotherapy, but its treatment plan quality can vary significantly among institutions and planners. Treatment plan quality control (QC) is a necessary component for individual clinics to ensure that patients receive treatments with high therapeutic gain ratios. The voxel-weighting factor-based plan re-optimization mechanism has been proved able to explore a larger Pareto surface (solution domain) and therefore increase the possibility of finding an optimal treatment plan. In this study, we incorporated additional modules into an in-house developed voxel weighting factor-based re-optimization algorithm, which was enhanced as a highly automated and accurate IMRT plan QC tool (TPS-QC tool). After importing an under-assessment plan, the TPS-QC tool was able to generate a QC report within 2 minutes. This QC report contains the plan quality determination as well as information supporting the determination. Finally, the IMRT plan quality can be controlled by approving quality-passed plans and replacing quality-failed plans using the TPS-QC tool. The feasibility and accuracy of the proposed TPS-QC tool were evaluated using 25 clinically approved cervical cancer patient IMRT plans and 5 manually created poor-quality IMRT plans. The results showed high consistency between the QC report quality determinations and the actual plan quality. In the 25 clinically approved cases that the TPS-QC tool identified as passed, a greater difference could be observed for dosimetric endpoints for organs at risk (OAR) than for planning target volume (PTV), implying that better dose sparing could be achieved in OAR than in PTV. In addition, the dose-volume histogram (DVH) curves of the TPS-QC tool re-optimized plans satisfied the dosimetric criteria more frequently than did the under-assessment plans. In addition, the criteria for unsatisfied dosimetric endpoints in the 5 poor-quality plans could typically be satisfied when the TPS-QC tool generated re-optimized plans without sacrificing other dosimetric endpoints. In addition to its feasibility and accuracy, the proposed TPS-QC tool is also user-friendly and easy to operate, both of which are necessary characteristics for clinical use.

BASINs 4.0 Climate Assessment Tool (CAT): Supporting ...

EPA Pesticide Factsheets

EPA announced the availability of the report, BASINS 4.0 Climate Assessment Tool (CAT): Supporting Documentation and User's Manual. This report was prepared by the EPA's Global Change Research Program (GCRP), an assessment-oriented program, that sits within the Office of Research and Development, that focuses on assessing how potential changes in climate and other global environmental stressors may impact water quality, air quality, aquatic ecosystems, and human health in the United States. The Program’s focus on water quality is consistent with the Research Strategy of the U.S. Climate Change Research Program—the federal umbrella organization for climate change science in the U.S. government—and is responsive to U.S. EPA’s mission and responsibilities as defined by the Clean Water Act and the Safe Drinking Water Act. A central goal of the EPA GCRP is to provide EPA program offices, Regions, and other stakeholders with tools and information for assessing and responding to any potential future impacts of climate change. In 2007, the EPA Global Change Research Program (GCRP), in partnership with the EPA Office of Water, supported development of a Climate Assessment Tool (CAT) for version 4 of EPA’s BASINS modeling system. This report provides supporting documentation and user support materials for the BASINS CAT tool. The purpose of this report is to provide in a single document a variety of documentation and user support materials supporting the use

Measurement tools and outcome measures used in transitional patient safety; a systematic review.

PubMed

van Melle, Marije A; van Stel, Henk F; Poldervaart, Judith M; de Wit, Niek J; Zwart, Dorien L M

2018-01-01

Patients are at risk for harm when treated simultaneously by healthcare providers from different healthcare organisations. To assess current practice and improvements of transitional patient safety, valid measurement tools are needed. To identify and appraise all measurement tools and outcomes that measure aspects of transitional patient safety, PubMed, Cinahl, Embase and Psychinfo were systematically searched. Two researchers performed the title and abstract and full-text selection. First, publications about validation of measurement tools were appraised for quality following COSMIN criteria. Second, we inventoried all measurement tools and outcome measures found in our search that assessed current transitional patient safety or the effect of interventions targeting transitional patient safety. The initial search yielded 8288 studies, of which 18 assessed validity of measurement tools of different aspects of transitional safety, and 191 assessed current transitional patient safety or effect of interventions. In the validated measurement tools, the overall quality of content and structural validity was acceptable; other COSMIN criteria, such as reliability, measurement error and responsiveness, were mostly poor or not reported. In our outcome inventory, the most frequently used validated outcome measure was the Care Transition Measure (n = 9). The most frequently used non-validated outcome measures were: medication discrepancies (n = 98), hospital readmissions (n = 55), adverse events (n = 34), emergency department visits (n = 33), (mental or physical) health status (n = 28), quality and timeliness of discharge summary, and patient satisfaction (n = 23). Although no validated measures exist that assess all aspects of transitional patient safety, we found validated measurement tools on specific aspects. Reporting of validity of transitional measurement tools was incomplete. Numerous outcome measures with unknown measurement properties are used in current studies on safety of care transitions, which makes interpretation or comparison of their results uncertain.

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

What We Know and Don't Know About Measuring Quality in Early Childhood and School-Age Care and Education Settings. OPRE Issue Brief #1. Publication #2009-12

ERIC Educational Resources Information Center

Child Trends, 2009

2009-01-01

Measures assessing the quality of children's environments and interactions in nonparental care settings were developed originally for use in child care research and as self-assessment tools for practitioners. Within the last decade, these measurement tools have moved into the public policy arena, where they are now used to make programmatic…

Use of a quality improvement tool, the prioritization matrix, to identify and prioritize triage software algorithm enhancement.

PubMed

North, Frederick; Varkey, Prathiba; Caraballo, Pedro; Vsetecka, Darlene; Bartel, Greg

2007-10-11

Complex decision support software can require significant effort in maintenance and enhancement. A quality improvement tool, the prioritization matrix, was successfully used to guide software enhancement of algorithms in a symptom assessment call center.

Implementation of Systematic Review Tools in IRIS | Science ...

EPA Pesticide Factsheets

Currently, the number of chemicals present in the environment exceeds the ability of public health scientists to efficiently screen the available data in order to produce well-informed human health risk assessments in a timely manner. For this reason, the US EPA’s Integrated Risk Information System (IRIS) program has started implementing new software tools into the hazard characterization workflow. These automated tools aid in multiple phases of the systematic review process including scoping and problem formulation, literature search, and identification and screening of available published studies. The increased availability of these tools lays the foundation for automating or semi-automating multiple phases of the systematic review process. Some of these software tools include modules to facilitate a structured approach to study quality evaluation of human and animal data, although approaches are generally lacking for assessing complex mechanistic information, in particular “omics”-based evidence tools are starting to become available to evaluate these types of studies. We will highlight how new software programs, online tools, and approaches for assessing study quality can be better integrated to allow for a more efficient and transparent workflow of the risk assessment process as well as identify tool gaps that would benefit future risk assessments. Disclaimer: The views expressed here are those of the authors and do not necessarily represent the view

Evaluating online diagnostic decision support tools for the clinical setting.

PubMed

Pryor, Marie; White, David; Potter, Bronwyn; Traill, Roger

2012-01-01

Clinical decision support tools available at the point of care are an effective adjunct to support clinicians to make clinical decisions and improve patient outcomes. We developed a methodology and applied it to evaluate commercially available online clinical diagnostic decision support (DDS) tools for use at the point of care. We identified 11 commercially available DDS tools and assessed these against an evaluation instrument that included 6 categories; general information, content, quality control, search, clinical results and other features. We developed diagnostically challenging clinical case scenarios based on real patient experience that were commonly missed by junior medical staff. The evaluation was divided into 2 phases; an initial evaluation of all identified and accessible DDS tools conducted by the Clinical Information Access Portal (CIAP) team and a second phase that further assessed the top 3 tools identified in the initial evaluation phase. An evaluation panel consisting of senior and junior medical clinicians from NSW Health conducted the second phase. Of the eleven tools that were assessed against the evaluation instrument only 4 tools completely met the DDS definition that was adopted for this evaluation and were able to produce a differential diagnosis. From the initial phase of the evaluation 4 DDS tools scored 70% or more (maximum score 96%) for the content category, 8 tools scored 65% or more (maximum 100%) for the quality control category, 5 tools scored 65% or more (maximum 94%) for the search category, and 4 tools score 70% or more (maximum 81%) for the clinical results category. The second phase of the evaluation was focused on assessing diagnostic accuracy for the top 3 tools identified in the initial phase. Best Practice ranked highest overall against the 6 clinical case scenarios used. Overall the differentiating factor between the top 3 DDS tools was determined by diagnostic accuracy ranking, ease of use and the confidence and credibility of the clinical information. The evaluation methodology used here to assess the quality and comprehensiveness of clinical DDS tools was effective in identifying the most appropriate tool for the clinical setting. The use of clinical case scenarios is fundamental in determining the diagnostic accuracy and usability of the tools.

Floristic Quality Assessment Across the Nation: Status, Opportunities, and Challenges

EPA Science Inventory

Floristic Quality Assessment (FQA) will be considered in the USEPA National Wetland Condition Assessment (NWCA). FQA is a powerful tool to describe wetland ecological condition, and is based on Coefficients of Conservatism (CC) of individual native plant species. CCs rank sensiti...

The use of UV-visible reflectance spectroscopy as an objective tool to evaluate pearl quality.

PubMed

Agatonovic-Kustrin, Snezana; Morton, David W

2012-07-01

Assessing the quality of pearls involves the use of various tools and methods, which are mainly visual and often quite subjective. Pearls are normally classified by origin and are then graded by luster, nacre thickness, surface quality, size, color and shape. The aim of this study was to investigate the capacity of Artificial Neural Networks (ANNs) to classify and estimate the quality of 27 different pearls from their UV-Visible spectra. Due to the opaque nature of pearls, spectroscopy measurements were performed using the Diffuse Reflectance UV-Visible spectroscopy technique. The spectra were acquired at two different locations on each pearl sample in order to assess surface homogeneity. The spectral data (inputs) were smoothed to reduce the noise, fed into ANNs and correlated to the pearl's quality/grading criteria (outputs). The developed ANNs were successful in predicting pearl type, mollusk growing species, possible luster and color enhancing, donor condition/type, recipient/host color, donor color, pearl luster, pearl color, origin. The results of this study shows that the developed UV-Vis spectroscopy-ANN method could be used as a more objective method of assessing pearl quality (grading) and may become a valuable tool for the pearl grading industry.

Evaluating the quality of internet information for breast cancer.

PubMed

Nghiem, A Z; Mahmoud, Y; Som, R

2016-02-01

The internet is frequently used by patients for researching information regarding breast cancer. This study aims to assess the quality of these websites using validated tools. The term 'breast cancer' was searched for in 3 search engines. The top 20 results were selected, and duplicates and irrelevant websites were excluded. 26/34 websites were analysed using the DISCERN Plus tool, HONcode and the JAMA benchmarks. 46% of the websites were classed as 'excellent' when assessed with the DISCERN tool. The range of DISCERN scores was wide (range: 25-74). Nine websites were found to be HONcode certified. Seven websites complied with all four JAMA benchmarks. This study shows the quality of breast cancer information on the internet is on the whole good; however the range of quality is wide. We recommend healthcare professionals use all 3 tools together to establish which websites are best to advise which websites patients should trust. Copyright © 2015 Elsevier Ltd. All rights reserved.

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools.

PubMed

Lichtner, Valentina; Dowding, Dawn; Esterhuizen, Philip; Closs, S José; Long, Andrew F; Corbett, Anne; Briggs, Michelle

2014-12-17

There is evidence of under-detection and poor management of pain in patients with dementia, in both long-term and acute care. Accurate assessment of pain in people with dementia is challenging and pain assessment tools have received considerable attention over the years, with an increasing number of tools made available. Systematic reviews on the evidence of their validity and utility mostly compare different sets of tools. This review of systematic reviews analyses and summarises evidence concerning the psychometric properties and clinical utility of pain assessment tools in adults with dementia or cognitive impairment. We searched for systematic reviews of pain assessment tools providing evidence of reliability, validity and clinical utility. Two reviewers independently assessed each review and extracted data from them, with a third reviewer mediating when consensus was not reached. Analysis of the data was carried out collaboratively. The reviews were synthesised using a narrative synthesis approach. We retrieved 441 potentially eligible reviews, 23 met the criteria for inclusion and 8 provided data for extraction. Each review evaluated between 8 and 13 tools, in aggregate providing evidence on a total of 28 tools. The quality of the reviews varied and the reporting often lacked sufficient methodological detail for quality assessment. The 28 tools appear to have been studied in a variety of settings and with varied types of patients. The reviews identified several methodological limitations across the original studies. The lack of a 'gold standard' significantly hinders the evaluation of tools' validity. Most importantly, the samples were small providing limited evidence for use of any of the tools across settings or populations. There are a considerable number of pain assessment tools available for use with the elderly cognitive impaired population. However there is limited evidence about their reliability, validity and clinical utility. On the basis of this review no one tool can be recommended given the existing evidence.

Guidance on Data Quality Assessment for Life Cycle Inventory Data

EPA Science Inventory

Data quality within Life Cycle Assessment (LCA) is a significant issue for the future support and development of LCA as a decision support tool and its wider adoption within industry. In response to current data quality standards such as the ISO 14000 series, various entities wit...

Reflective action assessment with a prospective clinical problem solving tool in the context of rehabilitation medicine: an illustrative case study.

PubMed

Kellett, David; Mpofu, Elias; Madden, Richard

2013-06-01

This study describes a case formulation approach applying a prospective ICF derived clinical tool to assess rehabilitation needs for a community dwelling stroke survivor with care from an outpatient rehabilitation medicine clinic. Case history data on the person were assessed for rehabilitation management planning using a prospective tool to interlink current with projected future functional status in everyday settings. Implicit assessment with reflective action informed decision points at each stage of the rehabilitation process. As a result of reflective action using the prospective tool, rehabilitation management led to significant changes in client participation after limitations to mobility and self care were mapped to the living conditions of the stroke survivor. The context sensitive rehabilitative plan resulted in higher subjective health-related quality of life in the stroke survivor and significant other and enhanced their capacity for participation. Reflective action informed assessment applying ICF concepts to clinical problem solving resulted in positive gains in health-related quality of life in a stroke survivor.

Improving the Quality of University Libraries through Citation Mining and Analysis Using Two New Dissertation Bibliometric Assessment Tools

ERIC Educational Resources Information Center

Tunon, Johanna; Brydges, Bruce

2005-01-01

University libraries are becoming increasingly aware of the need to assess the quality of students' information literacy and library research skills and to use this assessment data to effectively improve the quality of university library services to graduate programs. However, libraries have had difficulties finding ways to accomplish this both…

ASQ Program Observation Instrument: A Tool for Assessing School-Age Child Care Quality.

ERIC Educational Resources Information Center

O'Connor, Susan; And Others

ASQ (Assessing School-Aged Child Care Quality) is a system for determining the quality of school-age child care programs. The ASQ Program Observation Instrument is a ten-step, self assessment process to guide program improvement. This instrument does not work well in full-day programs that have a single focus, but works well in programs that offer…

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

The State of Software for Evolutionary Biology.

PubMed

Darriba, Diego; Flouri, Tomáš; Stamatakis, Alexandros

2018-05-01

With Next Generation Sequencing data being routinely used, evolutionary biology is transforming into a computational science. Thus, researchers have to rely on a growing number of increasingly complex software. All widely used core tools in the field have grown considerably, in terms of the number of features as well as lines of code and consequently, also with respect to software complexity. A topic that has received little attention is the software engineering quality of widely used core analysis tools. Software developers appear to rarely assess the quality of their code, and this can have potential negative consequences for end-users. To this end, we assessed the code quality of 16 highly cited and compute-intensive tools mainly written in C/C++ (e.g., MrBayes, MAFFT, SweepFinder, etc.) and JAVA (BEAST) from the broader area of evolutionary biology that are being routinely used in current data analysis pipelines. Because, the software engineering quality of the tools we analyzed is rather unsatisfying, we provide a list of best practices for improving the quality of existing tools and list techniques that can be deployed for developing reliable, high quality scientific software from scratch. Finally, we also discuss journal as well as science policy and, more importantly, funding issues that need to be addressed for improving software engineering quality as well as ensuring support for developing new and maintaining existing software. Our intention is to raise the awareness of the community regarding software engineering quality issues and to emphasize the substantial lack of funding for scientific software development.

Using Quality Management Tools to Enhance Feedback from Student Evaluations

ERIC Educational Resources Information Center

Jensen, John B.; Artz, Nancy

2005-01-01

Statistical tools found in the service quality assessment literature--the "T"[superscript 2] statistic combined with factor analysis--can enhance the feedback instructors receive from student ratings. "T"[superscript 2] examines variability across multiple sets of ratings to isolate individual respondents with aberrant response…

Measuring Website Quality: Asymmetric Effect of User Satisfaction

ERIC Educational Resources Information Center

Kincl, Tomas; Strach, Pavel

2012-01-01

Website quality measurement tools have been largely static and have struggled to determine relevant attributes of user satisfaction. This study compares and contrasts attributes of user satisfaction based on usability guidelines seeking to identify practical easy-to-administer measurement tools. The website users assessed business school homepages…

Health related quality of life assessment in metastatic disease of the spine: a systematic review.

PubMed

Street, John; Berven, Sigurd; Fisher, Charles; Ryken, Timothy

2009-10-15

Systematic literature review. To examine the available literature on health related quality of life (HRQOL) assessment in metastatic disease of the spine and identify the optimal functional outcome scales to be used in developing a disease-specific tool. There is a lack of consensus in the use of HRQOL measures in patients with metastatic spine disease. A systematic review was conducted using MEDLINE, EMBASE, the Science Citation Index (ISI), the Cumulative Index to Nursing and Allied Health Literature, the PsycINFO, the Allied and Complementary Medicine (AMED), Cochrane Reviews and Global Health databases for clinical studies addressing metastatic spine disease from 1966 through 2008. The validity of outcome tools was established by linkage analysis with the International Classification of Functioning Disability and Health (ICF). One hundred forty-one clinical studies met inclusion criteria including 10,347 patients. Only 5 moderate grade and 1 high grade study were identified. Thirty- four studies used a patient self-assessment instrument to assess health status. None of the instruments were validated for metastatic spine patients. The most commonly used Pi-by-no tools were SF-36, SIP 5, and the ADL. None of the studies defined health related quality of life (HRQOL) or justified the choice of instrument. The most commonly used cancer-specific tools were ECOG, EORTC QCQ-C30, and EUROQOL 5D. Based on frequency of citation and on correlation with the International Classification of Functioning Disability and Health, the ECOG and SF36 were judged as most valid and reliable. A systematic review of the available evidence suggests that valid and reliable health related quality of life measures exist for the assessment of oncology patients; however, a disease-specific tool for metastatic spine disease awaits development. Until such time as a disease-specific tool is available, we recommend that the ECOG and SF-36 be considered for use in studies addressing the outcome assessment of patients with metastatic spine disease.

A patient self-assessment tool for cardiac rehabilitation.

PubMed

Phelan, C; Finnell, M D; Mottla, K A

1989-01-01

A patient self-assessment tool was designed, tested, and implemented to promote cardiac-specific data collection, based on Gordon's Functional Health Patterns, to maximize patient/family involvement in determining a plan of care, and to streamline primary nurses' documentation requirements. Retrospective and concurrent chart reviews provided data for quality assurance monitoring. The results of the monitoring demonstrated that the self-assessment tool markedly improved the patient-specific data base.

Abstracting ICU Nursing Care Quality Data From the Electronic Health Record.

PubMed

Seaman, Jennifer B; Evans, Anna C; Sciulli, Andrea M; Barnato, Amber E; Sereika, Susan M; Happ, Mary Beth

2017-09-01

The electronic health record is a potentially rich source of data for clinical research in the intensive care unit setting. We describe the iterative, multi-step process used to develop and test a data abstraction tool, used for collection of nursing care quality indicators from the electronic health record, for a pragmatic trial. We computed Cohen's kappa coefficient (κ) to assess interrater agreement or reliability of data abstracted using preliminary and finalized tools. In assessing the reliability of study data ( n = 1,440 cases) using the finalized tool, 108 randomly selected cases (10% of first half sample; 5% of last half sample) were independently abstracted by a second rater. We demonstrated mean κ values ranging from 0.61 to 0.99 for all indicators. Nursing care quality data can be accurately and reliably abstracted from the electronic health records of intensive care unit patients using a well-developed data collection tool and detailed training.

LANDSCAPE ASSESSMENT TOOLS FOR WATERSHED CHARACTERIZATION

EPA Science Inventory

A combination of process-based, empirical and statistical models has been developed to assist states in their efforts to assess water quality, locate impairments over large areas, and calculate TMDL allocations. By synthesizing outputs from a number of these tools, LIPS demonstr...

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

Renewing focus on family planning service quality globally.

PubMed

Hancock, Nancy L; Stuart, Gretchen S; Tang, Jennifer H; Chibwesha, Carla J; Stringer, Jeffrey S A; Chi, Benjamin H

2016-01-01

Reducing the global unmet need for contraception is currently a priority for many governments, multi-lateral initiatives, non-governmental organizations, and donors. Evidence strongly suggests that the provision of quality family planning services can increase uptake, prevalence, and continuation of contraception. While an accepted framework to define the components of family planning service quality exists, translating this framework into assessment tools that are accessible, easily utilized, and valid for service providers has remained a challenge. We propose new approaches to improve the standardization and accessibility of family planning service quality assessment tools to simplify family planning service quality evaluation. With easier approaches to program evaluation, quality improvements can be performed more swiftly to help increase uptake and continuation of contraception to improve the health of women and their families.

Pictorial Representation of Illness and Self Measure (PRISM): A novel visual instrument to measure quality of life in dermatological inpatients.

PubMed

Mühleisen, Beda; Büchi, Stefan; Schmidhauser, Simone; Jenewein, Josef; French, Lars E; Hofbauer, Günther F L

2009-07-01

To validate the PRISM (Pictorial Representation of Illness and Self Measure) tool, a novel visual instrument, for the assessment of health-related quality of life in dermatological inpatients compared with the Dermatology Life Quality Index (DLQI) and the Skindex-29 questionnaires and to report qualitative information on PRISM. In an open longitudinal study, PRISM and Skindex-29 and DLQI questionnaires were completed and HRQOL measurements compared. Academic dermatological inpatient ward. The study population comprised 227 sequential dermatological inpatients on admission. Patients completed the PRISM tool and the Skindex-29 and DLQI questionnaires at admission and discharge. PRISM Self-Illness Separation (SIS) score; Skindex-29 and DLQI scores; and qualitative PRISM information by Mayring inductive qualitative context analysis. The PRISM scores correlated well with those from the Skindex-29 (rho = 0.426; P < .001) and DLQI (rho = 0.304; P < .001) questionnaires. Between PRISM and Skindex-29 scores, the highest correlations were for dermatitis (rho = 0.614) and leg ulcer (rho = 0.554), and between PRISM and DLQI scores, the highest correlations were for psoriasis (rho = 0.418) and tumor (rho = 0.399). The PRISM tool showed comparable or higher sensitivity than quality of life questionnaires to assess changes in the burden of suffering during hospitalization. Inductive qualitative context analysis revealed impairment of adjustment and self-image as major aspects. Patients overall expected symptomatic and functional improvement. In patients with psoriasis and leg ulcers, many expected no treatment benefit. The PRISM tool proved to be convenient and reliable for health-related quality of life assessment, applicable for a wide range of skin diseases, and correlated with DLQI and Skindex-29 scores. With the PRISM tool, free-text answers allow for the assessment of individual information and potentially customized therapeutic approaches.

Quality assessment tools add value.

PubMed

Paul, L

1996-10-01

The rapid evolution of the health care marketplace can be expected to continue as we move closer to the 21st Century. Externally-imposed pressures for cost reduction will increasingly be accompanied by pressure within health care organizations as risk-sharing reimbursement arrangements become more commonplace. Competitive advantage will be available to those organizations that can demonstrate objective value as defined by the cost-quality equation. The tools an organization chooses to perform quality assessment will be an important factor in its ability to demonstrate such value. Traditional quality assurance will in all likelihood continue, but the extent to which quality improvement activities are adopted by the culture of an organization may determine its ability to provide objective evidence of better health status outcomes.

An Automated Treatment Plan Quality Control Tool for Intensity-Modulated Radiation Therapy Using a Voxel-Weighting Factor-Based Re-Optimization Algorithm

PubMed Central

Song, Ting; Li, Nan; Zarepisheh, Masoud; Li, Yongbao; Gautier, Quentin; Zhou, Linghong; Mell, Loren; Jiang, Steve; Cerviño, Laura

2016-01-01

Intensity-modulated radiation therapy (IMRT) currently plays an important role in radiotherapy, but its treatment plan quality can vary significantly among institutions and planners. Treatment plan quality control (QC) is a necessary component for individual clinics to ensure that patients receive treatments with high therapeutic gain ratios. The voxel-weighting factor-based plan re-optimization mechanism has been proved able to explore a larger Pareto surface (solution domain) and therefore increase the possibility of finding an optimal treatment plan. In this study, we incorporated additional modules into an in-house developed voxel weighting factor-based re-optimization algorithm, which was enhanced as a highly automated and accurate IMRT plan QC tool (TPS-QC tool). After importing an under-assessment plan, the TPS-QC tool was able to generate a QC report within 2 minutes. This QC report contains the plan quality determination as well as information supporting the determination. Finally, the IMRT plan quality can be controlled by approving quality-passed plans and replacing quality-failed plans using the TPS-QC tool. The feasibility and accuracy of the proposed TPS-QC tool were evaluated using 25 clinically approved cervical cancer patient IMRT plans and 5 manually created poor-quality IMRT plans. The results showed high consistency between the QC report quality determinations and the actual plan quality. In the 25 clinically approved cases that the TPS-QC tool identified as passed, a greater difference could be observed for dosimetric endpoints for organs at risk (OAR) than for planning target volume (PTV), implying that better dose sparing could be achieved in OAR than in PTV. In addition, the dose-volume histogram (DVH) curves of the TPS-QC tool re-optimized plans satisfied the dosimetric criteria more frequently than did the under-assessment plans. In addition, the criteria for unsatisfied dosimetric endpoints in the 5 poor-quality plans could typically be satisfied when the TPS-QC tool generated re-optimized plans without sacrificing other dosimetric endpoints. In addition to its feasibility and accuracy, the proposed TPS-QC tool is also user-friendly and easy to operate, both of which are necessary characteristics for clinical use. PMID:26930204

Validation of an organizational communication climate assessment toolkit.

PubMed

Wynia, Matthew K; Johnson, Megan; McCoy, Thomas P; Griffin, Leah Passmore; Osborn, Chandra Y

2010-01-01

Effective communication is critical to providing quality health care and can be affected by a number of modifiable organizational factors. The authors performed a prospective multisite validation study of an organizational communication climate assessment tool in 13 geographically and ethnically diverse health care organizations. Communication climate was measured across 9 discrete domains. Patient and staff surveys with matched items in each domain were developed using a national consensus process, which then underwent psychometric field testing and assessment of domain coherence. The authors found meaningful within-site and between-site performance score variability in all domains. In multivariable models, most communication domains were significant predictors of patient-reported quality of care and trust. The authors conclude that these assessment tools provide a valid empirical assessment of organizational communication climate in 9 domains. Assessment results may be useful to track organizational performance, to benchmark, and to inform tailored quality improvement interventions.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

Methods for examining data quality in healthcare integrated data repositories.

PubMed

Huser, Vojtech; Kahn, Michael G; Brown, Jeffrey S; Gouripeddi, Ramkiran

2018-01-01

This paper summarizes content of the workshop focused on data quality. The first speaker (VH) described data quality infrastructure and data quality evaluation methods currently in place within the Observational Data Science and Informatics (OHDSI) consortium. The speaker described in detail a data quality tool called Achilles Heel and latest development for extending this tool. Interim results of an ongoing Data Quality study within the OHDSI consortium were also presented. The second speaker (MK) described lessons learned and new data quality checks developed by the PEDsNet pediatric research network. The last two speakers (JB, RG) described tools developed by the Sentinel Initiative and University of Utah's service oriented framework. The workshop discussed at the end and throughout how data quality assessment can be advanced by combining best features of each network.

Cognitive screening tools for identification of dementia in illiterate and low-educated older adults, a systematic review and meta-analysis.

PubMed

Paddick, Stella-Maria; Gray, William K; McGuire, Jackie; Richardson, Jenny; Dotchin, Catherine; Walker, Richard W

2017-06-01

The majority of older adults with dementia live in low- and middle-income countries (LMICs). Illiteracy and low educational background are common in older LMIC populations, particularly in rural areas, and cognitive screening tools developed for this setting must reflect this. This study aimed to review published validation studies of cognitive screening tools for dementia in low-literacy settings in order to determine the most appropriate tools for use. A systematic search of major databases was conducted according to PRISMA guidelines. Validation studies of brief cognitive screening tests including illiterate participants or those with elementary education were eligible. Studies were quality assessed using the QUADAS-2 tool. Good or fair quality studies were included in a bivariate random-effects meta-analysis and a hierarchical summary receiver operating characteristic (HSROC) curve constructed. Forty-five eligible studies were quality assessed. A significant proportion utilized a case-control design, resulting in spectrum bias. The area under the ROC (AUROC) curve was 0.937 for community/low prevalence studies, 0.881 for clinic based/higher prevalence studies, and 0.869 for illiterate populations. For the Mini-Mental State Examination (MMSE) (and adaptations), the AUROC curve was 0.853. Numerous tools for assessment of cognitive impairment in low-literacy settings have been developed, and tools developed for use in high-income countries have also been validated in low-literacy settings. Most tools have been inadequately validated, with only MMSE, cognitive abilities screening instrument (CASI), Eurotest, and Fototest having more than one published good or fair quality study in an illiterate or low-literate setting. At present no screening test can be recommended.

MedAd-AppQ: A quality assessment tool for medication adherence apps on iOS and android platforms.

PubMed

Ali, Eskinder Eshetu; Teo, Amanda Kai Sin; Goh, Sherlyn Xue Lin; Chew, Lita; Yap, Kevin Yi-Lwern

2018-02-02

With the recent proliferation of smartphone medication adherence applications (apps), it is increasingly more difficult for patients and clinicians to identify the most useful app. To develop a quality assessment tool for medication adherence apps, and evaluate the quality of such apps from the major app stores. In this study, a Medication Adherence App Quality assessment tool (MedAd-AppQ) was developed and two evaluators independently assessed apps that fulfilled the following criteria: availability in English, had at least a medication reminder feature, non-specific to certain disease conditions (generic apps), free of technical malfunctions and availability on both the iPhone Operating System (iOS) and Android platforms. Descriptive statistics, Mann-Whitney U test, Pearson product moment correlation and Spearman rank-order correlation were used for statistical analysis. MedAd-AppQ was designed to have 24 items (total 43 points) categorized under three sections: content reliability (11 points), feature usefulness (29 points) and feature convenience (3 points). The three sections of MedAd-AppQ were found to have inter-rater correlation coefficients of 0.801 (p-value < .001) or higher. Based on analysis of 52 apps (27 iOS and 25 Android), quality scores ranged between 7/43 (16.3%) and 28/43 (65.1%). There was no significant difference between the quality scores of the Android and iOS versions. None of the apps had features for self-management of side effects. Only two apps in each platform provided disease-related and/or medication information. MedAd-AppQ can be used to reliably assess the quality of adherence apps. Clinicians can use the tool in selecting apps for use by patients. Developers of adherence apps should consider features that provide therapy-related information and help patients in medications and side-effects management. Copyright © 2018 Elsevier Inc. All rights reserved.

Evidence-Based Assessment of Autism Spectrum Disorders in Children and Adolescents

ERIC Educational Resources Information Center

Ozonoff, Sally; Goodlin-Jones, Beth L.; Solomon, Marjorie

2005-01-01

This article reviews evidence-based criteria that can guide practitioners in the selection, use, and interpretation of assessment tools for autism spectrum disorders (ASD). As Mash and Hunsley (2005) discuss in this special section, evidence-based assessment tools not only demonstrate adequate psychometric qualities, but also have relevance to the…

Prostate cancer: how assessment of QoL can improve delivery of care.

PubMed

Brown, Michelle

Prostate cancer treatments often affect quality of life and problems may present at any point during treatment. Measuring and identifying issues of quality of life (QoL) may create an opportunity for the patient to discuss problems and induce information transfer from health professional to patient and vice versa. Many practitioners already assess QoL in patients with prostate cancer because treatment for the disease can have a dramatic impact on lifestyle. QoL may facilitate a more holistic approach to patient care. Using a QoL assessment tool may promote and enhance the current service provision and aid identification of bothersome side-effects, for example loss of libido, gynaecomastia (i.e. abnormal over-development of the breasts in a man), and hot flushes. The Functional Assessment of Cancer Therapy-Prostate scale (FACT-P) (Cella et al, 1993) is a prostate-specific QoL assessment tool, which can be self-administered and takes little time to complete. This may be a useful tool in the ongoing management of patients with advanced prostate cancer. With the emphasis on quality of service for cancer patients (Department of Health (DH), 2000; DH, 2007a; National Health Service Improvement, 2009), it is paramount that health professionals continually examine practice and the quality of the service delivered. Addressing QoL issues for the patient with cancer should be a priority. This article will outline the significant side-effects that a patient with advanced prostate cancer may sustain and attempts to indicate how QoL assessment tools may contribute to care management and delivery.

Quality Management and Information Brokerage.

ERIC Educational Resources Information Center

van Halm, Johan

1995-01-01

To compete effectively, information brokers need to adopt management and marketing tools; Total Quality Management can upgrade an organization's performance by using customer feedback of its services. SERVQUAL identifies gaps in service by assessing quality expectations versus quality experiences. (AEF)

Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

PubMed Central

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

PubMed

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

Introduction of the identification, situation, background, assessment, recommendations tool to improve the quality of information transfer during medical handover in intensive care.

PubMed

Ramasubbu, Benjamin; Stewart, Emma; Spiritoso, Rosalba

2017-02-01

To audit the quality and safety of the current doctor-to-doctor handover of patient information in our Cardiothoracic Intensive Care Unit. If deficient, to implement a validated handover tool to improve the quality of the handover process. In Cycle 1 we observed the verbal handover and reviewed the written handover information transferred for 50 consecutive patients in St George's Hospital Cardiothoracic Intensive Care Unit. For each patient's handover, we assessed whether each section of the Identification, Situation, Background, Assessment, Recommendations tool was used on a scale of 0-2. Zero if no information in that category was transferred, one if the information was partially transferred and two if all relevant information was transferred. Each patient's handover received a score from 0 to 10 and thus, each cycle a total score of 0-500. Following the implementation of the Identification, Situation, Background, Assessment, Recommendations handover tool in our Intensive Care Unit in Cycle 2, we re-observed the handover process for another 50 consecutive patients hence, completing the audit cycle. There was a significant difference between the total scores from Cycle 1 and 2 (263/500 versus 457/500, p < 0.001). The median handover score for Cycle 1 was 5/10 (interquartile range 4-6). The median handover score for Cycle 2 was 9/10 (interquartile range 9-10). Patient handover scores increased significantly between Cycle 1 and 2, U = 13.5, p < 0.001. The introduction of a standardised handover template (Identification, Situation, Background, Assessment, Recommendations tool) has improved the quality and safety of the doctor-to-doctor handover of patient information in our Intensive Care Unit.

Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations.

PubMed

Mustafa, Reem A; Wiercioch, Wojtek; Falavigna, Maicon; Zhang, Yuan; Ivanova, Liudmila; Arevalo-Rodriguez, Ingrid; Cheung, Adrienne; Prediger, Barbara; Ventresca, Matthew; Brozek, Jan; Santesso, Nancy; Bossuyt, Patrick; Garg, Amit X; Lloyd, Nancy; Lelgemann, Monika; Bühler, Diedrich; Schünemann, Holger J

2017-12-01

The objective of this study was to identify and describe critical appraisal tools designed for assessing the quality of evidence (QoE) and/or strength of recommendations (SoRs) related to health care-related tests and diagnostic strategies (HCTDSs). We conducted a systematic review to identify tools applied in guidelines, methodological articles, and systematic reviews to assess HCTDS. We screened 5,534 titles and abstracts, 1,004 full-text articles, and abstracted data from 330 references. We identified 29 tools and 14 modifications of existing tools for assessing QoE and SoR. Twenty-three out of 29 tools acknowledge the importance of assessing the QoE and SoR separately, but in 8, the SoR is based solely on QoE. When making decisions about the use of tests, patient values and preferences and impact on resource utilization were considered in 6 and 8 tools, respectively. There is also confusion about the terminology that describes the various factors that influence the QoE and SoR. Although at least one approach includes all relevant criteria for assessing QoE and determining SoR, more detailed guidance about how to operationalize these assessments and make related judgments will be beneficial. There is a need for a better description of the framework for using evidence to make decisions and develop recommendations about HCTDS. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluating radiographers' diagnostic accuracy in screen-reading mammograms: what constitutes a quality study?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Debono, Josephine C, E-mail: josephine.debono@bci.org.au; Poulos, Ann E; Westmead Breast Cancer Institute, Westmead, New South Wales

The aim of this study was to first evaluate the quality of studies investigating the diagnostic accuracy of radiographers as mammogram screen-readers and then to develop an adapted tool for determining the quality of screen-reading studies. A literature search was used to identify relevant studies and a quality evaluation tool constructed by combining the criteria for quality of Whiting, Rutjes, Dinnes et al. and Brealey and Westwood. This constructed tool was then applied to the studies and subsequently adapted specifically for use in evaluating quality in studies investigating diagnostic accuracy of screen-readers. Eleven studies were identified and the constructed toolmore » applied to evaluate quality. This evaluation resulted in the identification of quality issues with the studies such as potential for bias, applicability of results, study conduct, reporting of the study and observer characteristics. An assessment of the applicability and relevance of the tool for this area of research resulted in adaptations to the criteria and the development of a tool specifically for evaluating diagnostic accuracy in screen-reading. This tool, with further refinement and rigorous validation can make a significant contribution to promoting well-designed studies in this important area of research and practice.« less

An Alternative Grading Tool for Enhancing Assessment Practice and Quality Assurance in Higher Education

ERIC Educational Resources Information Center

Grainger, Peter; Weir, Katie

2016-01-01

Assessing student learning in university courses is commonly done using a rubric that arranges the assessment criteria and standards descriptors in a matrix style or grid format. This paper introduces an alternative style of grading tool known as the continua model of a guide to making judgements, which arranges assessment criteria based on a…

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

[Quality of the pharmacotherapeutic recommendations for the integrated care procedures in Andalusia].

PubMed

Corte, Rosa María Muñoz; Estepa, Raúl García; Ramos, Bernardo Santos; Paloma, Francisco Javier Bautista

2009-01-01

To evaluate the quality of the pharmacotherapeutic recommendations included in the Integrated Care Procedures (PAIs regarding its initials in Spanish) of the Andalusian Ministry of Health, published up to March 2008, through the design and validation of a tool. The assessment tool was designed based on similar instruments, specifically the AGREE. Other criteria included were taken from various literature sources or were devised by ourselves. The tool was validated prior to being used. After applying it to all the PAIs, we examined the degree of compliance with these pharmacotherapeutic criteria, both as a whole and by PAIs subgroups. The developed tool is a questionnaire of 20 items, divided into 4 sections. The first section consists of the essential criteria, and the rest make reference to more specific, non essential criteria: definition of the level of evidence, thoroughness of information and definition of indicators. It was found that 4 of the 60 PAIs do not contain any type of therapeutic recommendation. No PAI fulfils all the items listed in the tool, however, 70 % of them fulfil the essential quality criteria established. There is a great variability in the content of pharmacotherapeutic recommendations for each PAI. Once the validity of the tool has been proved, it could be used to assess the quality of the therapeutic recommendations in clinical practice guidelines.

The Use of UV-Visible Reflectance Spectroscopy as an Objective Tool to Evaluate Pearl Quality

PubMed Central

Agatonovic-Kustrin, Snezana; Morton, David W.

2012-01-01

Assessing the quality of pearls involves the use of various tools and methods, which are mainly visual and often quite subjective. Pearls are normally classified by origin and are then graded by luster, nacre thickness, surface quality, size, color and shape. The aim of this study was to investigate the capacity of Artificial Neural Networks (ANNs) to classify and estimate the quality of 27 different pearls from their UV-Visible spectra. Due to the opaque nature of pearls, spectroscopy measurements were performed using the Diffuse Reflectance UV-Visible spectroscopy technique. The spectra were acquired at two different locations on each pearl sample in order to assess surface homogeneity. The spectral data (inputs) were smoothed to reduce the noise, fed into ANNs and correlated to the pearl’s quality/grading criteria (outputs). The developed ANNs were successful in predicting pearl type, mollusk growing species, possible luster and color enhancing, donor condition/type, recipient/host color, donor color, pearl luster, pearl color, origin. The results of this study shows that the developed UV-Vis spectroscopy-ANN method could be used as a more objective method of assessing pearl quality (grading) and may become a valuable tool for the pearl grading industry. PMID:22851919

Rapid assessment of infrastructure of primary health care facilities - a relevant instrument for health care systems management.

PubMed

Scholz, Stefan; Ngoli, Baltazar; Flessa, Steffen

2015-05-01

Health care infrastructure constitutes a major component of the structural quality of a health system. Infrastructural deficiencies of health services are reported in literature and research. A number of instruments exist for the assessment of infrastructure. However, no easy-to-use instruments to assess health facility infrastructure in developing countries are available. Present tools are not applicable for a rapid assessment by health facility staff. Therefore, health information systems lack data on facility infrastructure. A rapid assessment tool for the infrastructure of primary health care facilities was developed by the authors and pilot-tested in Tanzania. The tool measures the quality of all infrastructural components comprehensively and with high standardization. Ratings use a 2-1-0 scheme which is frequently used in Tanzanian health care services. Infrastructural indicators and indices are obtained from the assessment and serve for reporting and tracing of interventions. The tool was pilot-tested in Tanga Region (Tanzania). The pilot test covered seven primary care facilities in the range between dispensary and district hospital. The assessment encompassed the facilities as entities as well as 42 facility buildings and 80 pieces of technical medical equipment. A full assessment of facility infrastructure was undertaken by health care professionals while the rapid assessment was performed by facility staff. Serious infrastructural deficiencies were revealed. The rapid assessment tool proved a reliable instrument of routine data collection by health facility staff. The authors recommend integrating the rapid assessment tool in the health information systems of developing countries. Health authorities in a decentralized health system are thus enabled to detect infrastructural deficiencies and trace the effects of interventions. The tool can lay the data foundation for district facility infrastructure management.

Scientific Overview /Regional Analyses and Approaches

EPA Science Inventory

A workshop, Tools for Assessing Stream Dissolved Minerals, will introduce approaches and EPA tools for regional and site specific development of water quality criteria based on observations from Arkansas streams. In this presentation regional approaches and tools are described. ...

Tools used for evaluation of Brazilian children's quality of life

PubMed Central

Souza, João Gabriel S.; Pamponet, Marcela Antunes; Souza, Tamirys Caroline S.; Pereira, Alessandra Ribeiro; Souza, Andrey George S.; Martins, Andréa Maria E. de B. L.

2014-01-01

OBJECTIVE: To review the available tools to evaluate children's quality of life validated for Brazilian language and culture. DATA SOURCES: Search of scientific articles in Medline, Lilacs and SciELO databases using the combination of descriptors "quality of life", "child" and "questionnaires" in Portuguese and English. DATA SYNTHESIS: Among the tools designed to assess children's quality of life validated for the Brazilian language and culture, the Auto questionnaire Qualité de Vie Enfant Imagé (AUQEI), the Child Health Questionnaire - Parent Form 50 (CHQ-PF50), the Pediatric Quality of Life Inventory (PedsQL(tm)) version 4.0 and the Kidscreen-52 are highlighted. Some tools do not include all range of ages and some lack domains that are currently considered relevant in the context of childhood, such as bullying. Moreover, due to the cultural diversity of Brazil, it may be necessary to adapt some instruments or to validate other tools. CONCLUSIONS: There are validated instruments to evaluate children's quality of life in Brazil. However, the validation or the adaptation of other international tools have to be considered in order to overcome current deficiencies. PMID:25119761

TU-AB-BRD-04: Development of Quality Management Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thomadsen, B.

2015-06-15

Current quality assurance and quality management guidelines provided by various professional organizations are prescriptive in nature, focusing principally on performance characteristics of planning and delivery devices. However, published analyses of events in radiation therapy show that most events are often caused by flaws in clinical processes rather than by device failures. This suggests the need for the development of a quality management program that is based on integrated approaches to process and equipment quality assurance. Industrial engineers have developed various risk assessment tools that are used to identify and eliminate potential failures from a system or a process before amore » failure impacts a customer. These tools include, but are not limited to, process mapping, failure modes and effects analysis, fault tree analysis. Task Group 100 of the American Association of Physicists in Medicine has developed these tools and used them to formulate an example risk-based quality management program for intensity-modulated radiotherapy. This is a prospective risk assessment approach that analyzes potential error pathways inherent in a clinical process and then ranks them according to relative risk, typically before implementation, followed by the design of a new process or modification of the existing process. Appropriate controls are then put in place to ensure that failures are less likely to occur and, if they do, they will more likely be detected before they propagate through the process, compromising treatment outcome and causing harm to the patient. Such a prospective approach forms the basis of the work of Task Group 100 that has recently been approved by the AAPM. This session will be devoted to a discussion of these tools and practical examples of how these tools can be used in a given radiotherapy clinic to develop a risk based quality management program. Learning Objectives: Learn how to design a process map for a radiotherapy process Learn how to perform failure modes and effects analysis analysis for a given process Learn what fault trees are all about Learn how to design a quality management program based upon the information obtained from process mapping, failure modes and effects analysis and fault tree analysis. Dunscombe: Director, TreatSafely, LLC and Center for the Assessment of Radiological Sciences; Consultant to IAEA and Varian Thomadsen: President, Center for the Assessment of Radiological Sciences Palta: Vice President of the Center for the Assessment of Radiological Sciences.« less

The State of Software for Evolutionary Biology

PubMed Central

Darriba, Diego; Flouri, Tomáš; Stamatakis, Alexandros

2018-01-01

Abstract With Next Generation Sequencing data being routinely used, evolutionary biology is transforming into a computational science. Thus, researchers have to rely on a growing number of increasingly complex software. All widely used core tools in the field have grown considerably, in terms of the number of features as well as lines of code and consequently, also with respect to software complexity. A topic that has received little attention is the software engineering quality of widely used core analysis tools. Software developers appear to rarely assess the quality of their code, and this can have potential negative consequences for end-users. To this end, we assessed the code quality of 16 highly cited and compute-intensive tools mainly written in C/C++ (e.g., MrBayes, MAFFT, SweepFinder, etc.) and JAVA (BEAST) from the broader area of evolutionary biology that are being routinely used in current data analysis pipelines. Because, the software engineering quality of the tools we analyzed is rather unsatisfying, we provide a list of best practices for improving the quality of existing tools and list techniques that can be deployed for developing reliable, high quality scientific software from scratch. Finally, we also discuss journal as well as science policy and, more importantly, funding issues that need to be addressed for improving software engineering quality as well as ensuring support for developing new and maintaining existing software. Our intention is to raise the awareness of the community regarding software engineering quality issues and to emphasize the substantial lack of funding for scientific software development. PMID:29385525

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Patient simulation: a literary synthesis of assessment tools in anesthesiology.

PubMed

Edler, Alice A; Fanning, Ruth G; Chen, Michael I; Claure, Rebecca; Almazan, Dondee; Struyk, Brain; Seiden, Samuel C

2009-12-20

High-fidelity patient simulation (HFPS) has been hypothesized as a modality for assessing competency of knowledge and skill in patient simulation, but uniform methods for HFPS performance assessment (PA) have not yet been completely achieved. Anesthesiology as a field founded the HFPS discipline and also leads in its PA. This project reviews the types, quality, and designated purpose of HFPS PA tools in anesthesiology. We used the systematic review method and systematically reviewed anesthesiology literature referenced in PubMed to assess the quality and reliability of available PA tools in HFPS. Of 412 articles identified, 50 met our inclusion criteria. Seventy seven percent of studies have been published since 2000; more recent studies demonstrated higher quality. Investigators reported a variety of test construction and validation methods. The most commonly reported test construction methods included "modified Delphi Techniques" for item selection, reliability measurement using inter-rater agreement, and intra-class correlations between test items or subtests. Modern test theory, in particular generalizability theory, was used in nine (18%) of studies. Test score validity has been addressed in multiple investigations and shown a significant improvement in reporting accuracy. However the assessment of predicative has been low across the majority of studies. Usability and practicality of testing occasions and tools was only anecdotally reported. To more completely comply with the gold standards for PA design, both shared experience of experts and recognition of test construction standards, including reliability and validity measurements, instrument piloting, rater training, and explicit identification of the purpose and proposed use of the assessment tool, are required.

The Value of Reliable Data: Interactive Data Tools from the National Comprehensive Center for Teacher Quality. Policy-to-Practice Brief. Number 1

ERIC Educational Resources Information Center

National Comprehensive Center for Teacher Quality, 2008

2008-01-01

The National Comprehensive Center for Teacher Quality (TQ Center) designed the Interactive Data Tools to provide users with access to state and national data that can be helpful in assessing the qualifications of teachers in the states and the extent to which a state's teacher policy climate generally supports teacher quality. The Interactive Data…

Criteria for assessing the quality of mHealth apps: a systematic review.

PubMed

Nouri, Rasool; R Niakan Kalhori, Sharareh; Ghazisaeedi, Marjan; Marchand, Guillaume; Yasini, Mobin

2018-05-16

Review the existing studies including an assessment tool/method to assess the quality of mHealth apps; extract their criteria; and provide a classification of the collected criteria. In accordance with the PRISMA statement, a literature search was conducted in MEDLINE, EMBase, ISI and Scopus for English language citations published from January 1, 2008 to December 22, 2016 for studies including tools or methods for quality assessment of mHealth apps. Two researchers screened the titles and abstracts of all retrieved citations against the inclusion and exclusion criteria. The full text of relevant papers was then individually examined by the same researchers. A senior researcher resolved eventual disagreements and confirmed the relevance of all included papers. The authors, date of publication, subject fields of target mHealth apps, development method, and assessment criteria were extracted from each paper. The extracted assessment criteria were then reviewed, compared, and classified by an expert panel of two medical informatics specialists and two health information management specialists. Twenty-three papers were included in the review. Thirty-eight main classes of assessment criteria were identified. These were reorganized by expert panel into 7 main classes (Design, Information/Content, Usability, Functionality, Ethical Issues, Security and Privacy, and User-perceived value) with 37 sub-classes of criteria. There is a wide heterogeneity in assessment criteria for mHealth apps. It is necessary to define the exact meanings and degree of distinctness of each criterion. This will help to improve the existing tools and may lead to achieve a better comprehensive mHealth app assessment tool.

Content, Quality, and Assessment Tools of Physician-Rating Websites in 12 Countries: Quantitative Analysis.

PubMed

Rothenfluh, Fabia; Schulz, Peter J

2018-06-14

Websites on which users can rate their physician are becoming increasingly popular, but little is known about the website quality, the information content, and the tools they offer users to assess physicians. This study assesses these aspects on physician-rating websites in German- and English-speaking countries. The objective of this study was to collect information on websites with a physician rating or review tool in 12 countries in terms of metadata, website quality (transparency, privacy and freedom of speech of physicians and patients, check mechanisms for appropriateness and accuracy of reviews, and ease of page navigation), professional information about the physician, rating scales and tools, as well as traffic rank. A systematic Web search based on a set of predefined keywords was conducted on Google, Bing, and Yahoo in August 2016. A final sample of 143 physician-rating websites was analyzed and coded for metadata, quality, information content, and the physician-rating tools. The majority of websites were registered in the United States (40/143) or Germany (25/143). The vast majority were commercially owned (120/143, 83.9%), and 69.9% (100/143) displayed some form of physician advertisement. Overall, information content (mean 9.95/25) as well as quality were low (mean 18.67/47). Websites registered in the United Kingdom obtained the highest quality scores (mean 26.50/47), followed by Australian websites (mean 21.50/47). In terms of rating tools, physician-rating websites were most frequently asking users to score overall performance, punctuality, or wait time in practice. This study evidences that websites that provide physician rating should improve and communicate their quality standards, especially in terms of physician and user protection, as well as transparency. In addition, given that quality standards on physician-rating websites are low overall, the development of transparent guidelines is required. Furthermore, attention should be paid to the financial goals that the majority of physician-rating websites, especially the ones that are commercially owned, pursue. ©Fabia Rothenfluh, Peter J Schulz. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.06.2018.

The genomics revolution and its effect on water quality

EPA Science Inventory

Genomic-based molecular tools are emerging as powerful laboratory methods for assessing water quality characteristics and improving our ability to assess the human health risks posed by microbial contaminants in drinking water. To a great extent, this revolution in genomics-rese...

The use of on-site visits to assess compliance and implementation of quality management at hospital level.

PubMed

Wagner, C; Groene, O; Dersarkissian, M; Thompson, C A; Klazinga, N S; Arah, O A; Suñol, R

2014-04-01

Stakeholders of hospitals often lack standardized tools to assess compliance with quality management strategies and the implementation of clinical quality activities in hospitals. Such assessment tools, if easy to use, could be helpful to hospitals, health-care purchasers and health-care inspectorates. The aim of our study was to determine the psychometric properties of two newly developed tools for measuring compliance with process-oriented quality management strategies and the extent of implementation of clinical quality strategies at the hospital level. We developed and tested two measurement instruments that could be used during on-site visits by trained external surveyors to calculate a Quality Management Compliance Index (QMCI) and a Clinical Quality Implementation Index (CQII). We used psychometric methods and the cross-sectional data to explore the factor structure, reliability and validity of each of these instruments. The sample consisted of 74 acute care hospitals selected at random from each of 7 European countries. The psychometric properties of the two indices (QMCI and CQII). Overall, the indices demonstrated favourable psychometric performance based on factor analysis, item correlations, internal consistency and hypothesis testing. Cronbach's alpha was acceptable for the scales of the QMCI (α: 0.74-0.78) and the CQII (α: 0.82-0.93). Inter-scale correlations revealed that the scales were positively correlated, but distinct. All scales added sufficient new information to each main index to be retained. This study has produced two reliable instruments that can be used during on-site visits to assess compliance with quality management strategies and implementation of quality management activities by hospitals in Europe and perhaps other jurisdictions.

Do European hospitals have quality and safety governance systems and structures in place?

PubMed

Shaw, C; Kutryba, B; Crisp, H; Vallejo, P; Suñol, R

2009-02-01

Internal systems for quality and safety were assessed in 89 hospitals in six European states, by external teams using standardised criteria and procedures, as part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) project. The assessments were made primarily to identify the current use of quality management systems in the sample hospitals, and also to demonstrate a potential tool for comparable assessment of hospitals in general. The large majority of the hospitals had a formal, documented infrastructure to manage quality and safety, but a significant minority had no designated mission, programme or coordination. In two-thirds of hospitals, the governing body was active in defining policy and programmes for improvement, and received reports on quality, safety and patient satisfaction at least once a year. The brief on-site assessments identified systematic variations, within and between countries, in structures and processes of governance and to document the uptake of best practice. Unacceptable variations in practice could be reduced, to the benefit of consumers and providers, by developing and publishing basic organisational standards relevant to all European states. The simple assessment criteria designed for this project could be developed into a practical tool for self-assessment, peer review or benchmarking of hospitals across national borders. This assessment, combined with explicit, relevant and achievable standards, could provide a vehicle to promote the voluntary uptake of best practice and consistency in quality and safety among hospitals in Europe.

A comprehensive clinical assessment tool to inform policy and practice: applications of the minimum data set.

PubMed

Mor, Vincent

2004-04-01

The Minimum Data Set (MDS) for nursing home (NH) resident assessment, designed to assess elders functional status and care needs, exemplifies how the information needs of clinical practice are congruent with those of research. Building on a review of the published literature, this article describes the development of the MDS, its reliability and validity testing, as well as the variety of different policy and research uses to which it has been applied. Interrater reliability of items and internal consistency of MDS summary scales is generally good to excellent. Validation studies reveal good correspondence to research quality instruments for cognition, activities of daily living, and diagnoses with more variable results for vision, pain, mood, and behavior scales. To date, no consistent evidence suggests that applications of MDS data for case-mix reimbursement and quality indicator monitoring systematically bias the data. Although facility variation in data quality could compromise some applications, creation of the MDS as a clinical tool for care planning provides an example of how assessment tools with clinical use can be used in administrative databases for research and policy applications.

THE TWO FACES OF WATER CHEMISTRY: STRESSOR ON, AND INDICATOR OF, THE ECOLOGICAL CONDITION OF THE GREAT RIVERS.

EPA Science Inventory

This poster presentation is designed to enlighten the interested masses about water quality assessment tools. It is not intended for policy, rather to stimulate thought on the importance of developing water chemistry as as assessment tool.

A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process

PubMed Central

2011-01-01

Background There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. Methods A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. Results In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. Conclusion Based on experts' opinions, a self-assessment tool was found in order to access quality of PA programmes for the elderly. Information obtained with evaluations would be useful to organizations seeking to improve their services, customer satisfaction and, consequently, adherence to PA programmes, targeting the ageing population. PMID:21958203

Embedding systematic quality assessments in supportive supervision at primary healthcare level: application of an electronic Tool to Improve Quality of Healthcare in Tanzania.

PubMed

Mboya, Dominick; Mshana, Christopher; Kessy, Flora; Alba, Sandra; Lengeler, Christian; Renggli, Sabine; Vander Plaetse, Bart; Mohamed, Mohamed A; Schulze, Alexander

2016-10-13

Assessing quality of health services, for example through supportive supervision, is essential for strengthening healthcare delivery. Most systematic health facility assessment mechanisms, however, are not suitable for routine supervision. The objective of this study is to describe a quality assessment methodology using an electronic format that can be embedded in supervision activities and conducted by council health staff. An electronic Tool to Improve Quality of Healthcare (e-TIQH) was developed to assess the quality of primary healthcare provision. The e-TIQH contains six sub-tools, each covering one quality dimension: infrastructure and equipment of the facility, its management and administration, job expectations, clinical skills of the staff, staff motivation and client satisfaction. As part of supportive supervision, council health staff conduct quality assessments in all primary healthcare facilities in a given council, including observation of clinical consultations and exit interviews with clients. Using a hand-held device, assessors enter data and view results in real time through automated data analysis, permitting immediate feedback to health workers. Based on the results, quality gaps and potential measures to address them are jointly discussed and actions plans developed. For illustrative purposes, preliminary findings from e-TIQH application are presented from eight councils of Tanzania for the period 2011-2013, with a quality score <75 % classed as 'unsatisfactory'. Staff motivation (<50 % in all councils) and job expectations (≤50 %) scored lowest of all quality dimensions at baseline. Clinical practice was unsatisfactory in six councils, with more mixed results for availability of infrastructure and equipment, and for administration and management. In contrast, client satisfaction scored surprisingly high. Over time, each council showed a significant overall increase of 3-7 % in mean score, with the most pronounced improvements in staff motivation and job expectations. Given its comprehensiveness, convenient handling and automated statistical reports, e-TIQH enables council health staff to conduct systematic quality assessments. Therefore e-TIQH may not only contribute to objectively identifying quality gaps, but also to more evidence-based supervision. E-TIQH also provides important information for resource planning. Institutional and financial challenges for implementing e-TIQH on a broader scale need to be addressed.

GEOSPATIAL QUALITY COUNCIL

EPA Science Inventory

Geospatial Science is increasingly becoming an important tool in making Agency decisions. QualIty Control and Quality Assurance are required to be integrated during the planning, implementation and assessment of geospatial databases, processes and products. In order to ensure Age...

Quality assessment of a sample of mobile app-based health behavior change interventions using a tool based on the National Institute of Health and Care Excellence behavior change guidance.

PubMed

McMillan, Brian; Hickey, Eamonn; Patel, Mahendra G; Mitchell, Caroline

2016-03-01

To quality assess a sample of health behavior change apps from the NHS Apps Library using a rating tool based on the 2014 National Institute for Health and Care Excellence behavior change guidance (NICE BCG). A qualitative analysis of the NICE BCG identified themes and questions for a quality assessment of health behavior change apps. These were refined by further discussion and piloting, and applied by two independent raters to a sample of NHS Library apps (N=49). Disagreements were resolved following discussions with a third rater. Themes identified were; purpose, planning, usability, tailoring, behavior change technique (BCT), maintenance, evaluation, data security and documentation. Overall, purpose of the apps was clear, but evidence for collaboration with users or professionals was lacking. Usability information was poor and tailoring disappointing. Most used recognized BCTs but paid less attention to behavior maintenance than initiation. Information on app evaluation and documentation was sparse. This study furthers the work of the NHS Apps Library, adapting the NICE (2014) behavior change guidance for quality assessment of behavior change apps. This study helps lay the foundations for development of a quality assurance tool for mobile health apps aimed at health behavior change. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

MEGAPOLI: concept and first results of multi-scale modelling of megacity impacts

NASA Astrophysics Data System (ADS)

Baklanov, A. A.; Lawrence, M.; Pandis, S.

2009-09-01

The European FP7 project MEGAPOLI: ‘Megacities: Emissions, urban, regional and Global Atmospheric POLlution and climate effects, and Integrated tools for assessment and mitigation' (http://megapoli.info), started in October 2008, brings together 27 leading European research groups from 11 countries, state-of-the-art scientific tools and key players from countries outside Europe to investigate the interactions among megacities, air quality and climate. MEGAPOLI bridges the spatial and temporal scales that connect local emissions, air quality and weather with global atmospheric chemistry and climate. The main MEGAPOLI objectives are: 1. to assess impacts of megacities and large air-pollution hot-spots on local, regional and global air quality, 2. to quantify feedbacks among megacity air quality, local and regional climate, and global climate change, 3. to develop improved integrated tools for prediction of air pollution in megacities. In order to achieve these objectives the following tasks are realizing: • Develop and evaluate integrated methods to improve megacity emission data, • Investigate physical and chemical processes starting from the megacity street level, continuing to the city, regional and global scales, • Assess regional and global air quality impacts of megacity plumes, • Determine the main mechanisms of regional meteorology/climate forcing due to megacity plumes, • Assess global megacity pollutant forcing on climate, • Examine feedback mechanisms including effects of climate change on megacity air quality, • Develop integrated tools for prediction of megacity air quality, • Evaluate these integrated tools and use them in case studies, • Develop a methodology to estimate the impacts of different scenarios of megacity development on human health and climate change, • Propose and assess mitigation options to reduce the impacts of megacity emissions. We follow a pyramid strategy of undertaking detailed measurements in one European major city, Paris, performing detailed analysis for 12 megacities with existing air quality datasets and investigate the effects of all megacities on climate and global atmospheric chemistry. The project focuses on the multi-scale modelling of interacting meteorology and air quality, spanning the range from emissions to air quality, effects on climate, and feedbacks and mitigation potentials. Our hypothesis is that megacities around the world have an impact on air quality not only locally, but also regionally and globally and therefore can also influence the climate of our planet. Some of the links between megacities, air quality and climate are reasonably well-understood. However, a complete quantitative picture of these interactions is clearly missing. Understanding and quantifying these missing links is the focus of MEGAPOLI. The current status and modeling results after the first project year on examples of Paris and other European megacities are discussed.

Using an evaluative tool to develop effective mathscasts

NASA Astrophysics Data System (ADS)

Galligan, Linda; Hobohm, Carola; Peake, Katherine

2017-09-01

This study is situated in a course designed for both on-campus and online pre-service and in-service teachers, where student-created mathscasts provide a way for university lecturers to assess students' quality of teaching, and understanding of mathematics. Teachers and pre-service teachers, in a university course with 90% online enrolment, were asked to create mathscasts to explain mathematics concepts at middle school level. This paper describes the process of developing and refining a tool for the creation and evaluation of quality student-produced mathscasts. The study then investigates the usefulness of the tool within the context of pedagogy and mathematical understanding. Despite an abundance of mathscasts already available on the web, there is merit in creating mathscasts, not only as a tool for teaching, but also as a means of learning by doing. The premise for creating student-produced mathscasts was to capture the creators' mathematical understanding and pedagogical approach to teaching a mathematical concept, which were then peer-assessed and graded. The analysis included surveys, practice mathscasts with peer- and self-reviews, and students' final assessed mathscasts. The results indicate that the use of the evaluative tool resulted in an improvement in quality of student-created mathscasts and critiques thereof. The paper concludes with a discussion on future directions of student-produced mathscasts.

Delivery of nutrition services in health systems in sub-Saharan Africa: opportunities in Burkina Faso, Mozambique and Niger.

PubMed

Hampshire, Rachel D; Aguayo, Victor M; Harouna, Hamani; Roley, Julie A; Tarini, Ann; Baker, Shawn K

2004-12-01

In sub-Saharan Africa, underweight and micronutrient deficiencies account for an estimated 25% of the burden of disease. As the coverage of national health systems expands, increased opportunities exist to address the needs of children and women, the most vulnerable to these deficiencies, through high-quality nutrition services. To assess health providers' knowledge and practice with regard to essential nutrition services for women and children in Burkina Faso, Mozambique and Niger, in order to assist the development of a standard guide and tools to assess and monitor the quality of the nutrition services delivered through national health systems. The three surveys reveal the extent of missed opportunities to deliver nutrition services during routine prenatal, postnatal and child-care consultations for the prevention and treatment of highly prevalent nutritional deficiencies. A commitment to improving the quality of facility-based nutrition services is necessary to impact on the health outcomes of women and children 'covered' by national health systems. Rigorous assessment and monitoring of the quality of nutrition services should inform health programme and policy development. Building on the lessons learned in these three assessments, Helen Keller International has developed a standard Guide and Tools to assess the quality of the nutrition services delivered through national health systems. These tools can be adapted to assess ongoing nutrition services in health facilities, provide a framework for nutrition programming, inform the development of pre-service as well as in-service nutrition training curricula for providers, and evaluate the impact of nutrition training on providers' practices.

rnaQUAST: a quality assessment tool for de novo transcriptome assemblies.

PubMed

Bushmanova, Elena; Antipov, Dmitry; Lapidus, Alla; Suvorov, Vladimir; Prjibelski, Andrey D

2016-07-15

Ability to generate large RNA-Seq datasets created a demand for both de novo and reference-based transcriptome assemblers. However, while many transcriptome assemblers are now available, there is still no unified quality assessment tool for RNA-Seq assemblies. We present rnaQUAST-a tool for evaluating RNA-Seq assembly quality and benchmarking transcriptome assemblers using reference genome and gene database. rnaQUAST calculates various metrics that demonstrate completeness and correctness levels of the assembled transcripts, and outputs them in a user-friendly report. rnaQUAST is implemented in Python and is freely available at http://bioinf.spbau.ru/en/rnaquast ap@bioinf.spbau.ru Supplementary data are available at Bioinformatics online. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Systematic Omics Analysis Review (SOAR) Tool to Support Risk Assessment

PubMed Central

McConnell, Emma R.; Bell, Shannon M.; Cote, Ila; Wang, Rong-Lin; Perkins, Edward J.; Garcia-Reyero, Natàlia; Gong, Ping; Burgoon, Lyle D.

2014-01-01

Environmental health risk assessors are challenged to understand and incorporate new data streams as the field of toxicology continues to adopt new molecular and systems biology technologies. Systematic screening reviews can help risk assessors and assessment teams determine which studies to consider for inclusion in a human health assessment. A tool for systematic reviews should be standardized and transparent in order to consistently determine which studies meet minimum quality criteria prior to performing in-depth analyses of the data. The Systematic Omics Analysis Review (SOAR) tool is focused on assisting risk assessment support teams in performing systematic reviews of transcriptomic studies. SOAR is a spreadsheet tool of 35 objective questions developed by domain experts, focused on transcriptomic microarray studies, and including four main topics: test system, test substance, experimental design, and microarray data. The tool will be used as a guide to identify studies that meet basic published quality criteria, such as those defined by the Minimum Information About a Microarray Experiment standard and the Toxicological Data Reliability Assessment Tool. Seven scientists were recruited to test the tool by using it to independently rate 15 published manuscripts that study chemical exposures with microarrays. Using their feedback, questions were weighted based on importance of the information and a suitability cutoff was set for each of the four topic sections. The final validation resulted in 100% agreement between the users on four separate manuscripts, showing that the SOAR tool may be used to facilitate the standardized and transparent screening of microarray literature for environmental human health risk assessment. PMID:25531884

Simulation techniques in hyperthermia treatment planning

PubMed Central

Paulides, MM; Stauffer, PR; Neufeld, E; Maccarini, P; Kyriakou, A; Canters, RAM; Diederich, C; Bakker, JF; Van Rhoon, GC

2013-01-01

Clinical trials have shown that hyperthermia (HT), i.e. an increase of tissue temperature to 39-44°C, significantly enhance radiotherapy and chemotherapy effectiveness (1). Driven by the developments in computational techniques and computing power, personalized hyperthermia treatment planning (HTP) has matured and has become a powerful tool for optimizing treatment quality. Electromagnetic, ultrasound, and thermal simulations using realistic clinical setups are now being performed to achieve patient-specific treatment optimization. In addition, extensive studies aimed to properly implement novel HT tools and techniques, and to assess the quality of HT, are becoming more common. In this paper, we review the simulation tools and techniques developed for clinical hyperthermia, and evaluate their current status on the path from “model” to “clinic”. In addition, we illustrate the major techniques employed for validation and optimization. HTP has become an essential tool for improvement, control, and assessment of HT treatment quality. As such, it plays a pivotal role in the quest to establish HT as an efficacious addition to multi-modality treatment of cancer. PMID:23672453

Visual quality assessment of alternative silvicultural practices in upland hardwood management

Treesearch

Tim McDonald; Bryce Stokes

1997-01-01

Visual impacts of forest operations are of increasing concern to forest managers. Tools are available for evaluating, and potentially avoiding, problems in visual quality resulting from poorly designed harvest unit boundaries. One of these visualization tools is applied in comparing various harvest unit shape alternatives in an upland hardwood stand on steeply sloping...

Item generation in the development of an inpatient experience questionnaire: a qualitative study

PubMed Central

2013-01-01

Background Patient experience is a key feature of quality improvement in modern health-care delivery. Measuring patient experience is one of several tools used to assess and monitor the quality of health services. This study aims to develop a tool for assessing patient experience with inpatient care in public hospitals in Hong Kong. Methods Based on the General Inpatient Questionnaire (GIQ) framework of the Care Quality Commission as a discussion guide, a qualitative study involving focus group discussions and in-depth individual interviews with patients was employed to develop a tool for measuring inpatient experience in Hong Kong. Results All participants agreed that a patient satisfaction survey is an important platform for collecting patients’ views on improving the quality of health-care services. Findings of the focus group discussions and in-depth individual interviews identified nine key themes as important hospital quality indicators: prompt access, information provision, care and involvement in decision making, physical and emotional needs, coordination of care, respect and privacy, environment and facilities, handling of patient feedback, and overall care from health-care professionals and quality of care. Privacy, complaint mechanisms, patient involvement, and information provision were further highlighted as particularly important areas for item revision by the in-depth individual interviews. Thus, the initial version of the Hong Kong Inpatient Experience Questionnaire (HKIEQ), comprising 58 core items under nine themes, was developed. Conclusions A set of dimensions and core items of the HKIEQ was developed and the instrument will undergo validity and reliability tests through a validation survey. A valid and reliable tool is important in accurately assessing patient experience with care delivery in hospitals to improve the quality of health-care services. PMID:23835186

Quality Assessment of Medical Apps that Target Medication-Related Problems.

PubMed

Loy, John Shiguang; Ali, Eskinder Eshetu; Yap, Kevin Yi-Lwern

2016-10-01

The advent of smartphones has enabled a plethora of medical apps for disease management. As of 2012, there are 40,000 health care-related mobile apps available in the market. Since most of these medical apps do not go through any stringent quality assessment, there is a risk of consumers being misinformed or misled by unreliable information. In this regard, apps that target medication-related problems (MRPs) are not an exception. There is little information on what constitutes quality in apps that target MRPs and how good the existing apps are. To develop a quality assessment tool for evaluating apps that target MRPs and assess the quality of such apps available in the major mobile app stores (iTunes and Google Play). The top 100 free and paid apps in the medical categories of iTunes and Google Play stores (total of 400 apps) were screened for inclusion in the final analysis. English language apps that targeted MRPs were downloaded on test devices to evaluate their quality. Apps intended for clinicians, patients, or both were eligible for evaluation. The quality assessment tool consisted of 4 sections (appropriateness, reliability, usability, privacy), which determined the overall quality of the apps. Apps that fulfilled the inclusion criteria were classified based on the presence of any 1 or more of the 5 features considered important for apps targeting MRPs (monitoring, interaction checker, dose calculator, medication information, medication record). Descriptive statistics and Mann-Whitney tests were used for analysis. Final analysis was based on 59 apps that fulfilled the study inclusion criteria. Apps with interaction checker (66.9%) and monitoring features (54.8%) had the highest and lowest overall qualities. Paid apps generally scored higher for usability than free apps (P = 0.006) but lower for privacy (P = 0.003). Half of the interaction checker apps were unable to detect interactions with herbal medications. Blood pressure and heart rate monitoring apps had the highest overall quality scores (67.7%), while apps that monitored visual, hearing, and temperature changes scored the lowest (35.5%). A quality assessment tool for evaluating medical apps targeting MRPs has been developed. Clinicians can use this tool to guide their assessments of medical apps that are appropriate for use in the health care setting. Although potentially useful apps were identified, many apps were found to have deficiencies in quality, among which was poor reliability scores for most of the apps. Continued assessments of the quality of apps targeting MRPs are recommended to ensure their usefulness for clinicians and patients. No outside funding supported this study. The authors have no conflicts of interests directly related to this study. Study concept and design were contributed by Loy and Yap. Loy collected the data and took the lead in data interpretation, along with Ali and Yap. The manuscript was primarily written by Loy, along with Yap, and revised primarily by Ali, along with Yap.

The quality of websites addressing fibromyalgia: an assessment of quality and readability using standardised tools

PubMed Central

MacDermid, Joy C; Wilkins, Seanne; Gibson, Jane; Shaw, Lynn

2011-01-01

Background Patients living with fibromyalgia strongly prefer to access health information on the web. However, the majority of subjects in previous studies strongly expressed their concerns about the quality of online information resources. Objectives The purpose of this study was to evaluate existing online fibromyalgia information resources for content, quality and readability by using standardised quality and readability tools. Methods The first 25 websites were identified using Google and the search keyword ‘fibromyalgia’. Pairs of raters independently evaluated website quality using two structured tools (DISCERN and a quality checklist). Readability was assessed using the Flesch Reading Ease score maps. Results Ranking of the websites' quality varied by the tool used, although there was general agreement about the top three websites (Fibromyalgia Information, Fibromyalgia Information Foundation and National Institute of Arthritis and Musculoskeletal and Skin Diseases). Content analysis indicated that 72% of websites provided information on treatment options, 68% on symptoms, 60% on diagnosis and 40% on coping and resources. DISCERN ratings classified 32% websites as ‘very good’, 32% as ‘good and 36% as ‘marginal’. The mean overall DISCERN score was 36.88 (good). Only 16% of websites met the recommended literacy level grade of 6–8 (range 7–15). Conclusion Higher quality websites tended to be less readable. Online fibromyalgia information resources do not provide comprehensive information about fibromyalgia, and have low quality and poor readability. While information is very important for those living with fibromyalgia, current resources are unlikely to provide necessary or accurate information, and may not be usable for most people. PMID:22021777

The quality of websites addressing fibromyalgia: an assessment of quality and readability using standardised tools.

PubMed

Daraz, Lubna; Macdermid, Joy C; Wilkins, Seanne; Gibson, Jane; Shaw, Lynn

2011-07-31

Background Patients living with fibromyalgia strongly prefer to access health information on the web. However, the majority of subjects in previous studies strongly expressed their concerns about the quality of online information resources. Objectives The purpose of this study was to evaluate existing online fibromyalgia information resources for content, quality and readability by using standardised quality and readability tools. Methods The first 25 websites were identified using Google and the search keyword 'fibromyalgia'. Pairs of raters independently evaluated website quality using two structured tools (DISCERN and a quality checklist). Readability was assessed using the Flesch Reading Ease score maps. Results Ranking of the websites' quality varied by the tool used, although there was general agreement about the top three websites (Fibromyalgia Information, Fibromyalgia Information Foundation and National Institute of Arthritis and Musculoskeletal and Skin Diseases). Content analysis indicated that 72% of websites provided information on treatment options, 68% on symptoms, 60% on diagnosis and 40% on coping and resources. DISCERN ratings classified 32% websites as 'very good', 32% as 'good and 36% as 'marginal'. The mean overall DISCERN score was 36.88 (good). Only 16% of websites met the recommended literacy level grade of 6-8 (range 7-15). Conclusion Higher quality websites tended to be less readable. Online fibromyalgia information resources do not provide comprehensive information about fibromyalgia, and have low quality and poor readability. While information is very important for those living with fibromyalgia, current resources are unlikely to provide necessary or accurate information, and may not be usable for most people.

Assessments of the quality of randomized controlled trials published in International Journal of Urology from 1994 to 2011.

PubMed

Cho, Hee Ju; Chung, Jae Hoon; Jo, Jung Ki; Kang, Dong Hyuk; Cho, Jeong Man; Yoo, Tag Keun; Lee, Seung Wook

2013-12-01

Randomized controlled trials are one of the most reliable resources for assessing the effectiveness and safety of medical treatments. Low quality randomized controlled trials carry a large bias that can ultimately impair the reliability of their conclusions. The present study aimed to evaluate the quality of randomized controlled trials published in International Journal of Urology by using multiple quality assessment tools. Randomized controlled trials articles published in International Journal of Urology were found using the PubMed MEDLINE database, and qualitative analysis was carried out with three distinct assessment tools: the Jadad scale, the van Tulder scale and the Cochrane Collaboration Risk of Bias Tool. The quality of randomized controlled trials was analyzed by publication year, type of subjects, intervention, presence of funding and whether an institutional review board reviewed the study. A total of 68 randomized controlled trial articles were published among a total of 1399 original articles in International Journal of Urology. Among these randomized controlled trials, 10 (2.70%) were from 1994 to 1999, 23 (4.10%) were from 2000 to 2005 and 35 (4.00%) were from 2006 to 2011 (P = 0.494). On the assessment with the Jadad and van Tulder scale, the numbers and percentage of high quality randomized controlled trials increased over time. The studies that had institutional review board reviews, funding resources or that were carried out in multiple institutions had an increased percentage of high quality articles. The numbers and percentage of high-quality randomized controlled trials published in International Journal of Urology have increased over time. Furthermore, randomized controlled trials with funding resources, institutional review board reviews or carried out in multiple institutions have been found to be of higher quality compared with others not presenting these features. © 2013 The Japanese Urological Association.

Assessing the evidence of Six Sigma and Lean in the health care industry.

PubMed

DelliFraine, Jami L; Langabeer, James R; Nembhard, Ingrid M

2010-01-01

Popular quality improvement tools such as Six Sigma and Lean Systems (SS/L) claim to provide health care managers the opportunity to improve health care quality on the basis of sound methodology and data. However, it is unclear whether these 2 quality improvement tools actually improve health care quality. The authors conducted a comprehensive literature review to assess the empirical evidence relating SS/L to improved clinical outcomes, processes of care, and financial performance of health care organizations. The authors identified 177 articles on SS/L published in the last 10 years. However, only 34 of them reported any outcomes of the SS/L projects studied, and less than one-third of these articles included statistical analyses to test for significant changes in outcomes. This review demonstrates that there are significant gaps in the SS/L health care quality improvement literature and very weak evidence that SS/L improve health care quality.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Validation of a global scale to assess the quality of interprofessional teamwork in mental health settings.

PubMed

Tomizawa, Ryoko; Yamano, Mayumi; Osako, Mitue; Hirabayashi, Naotugu; Oshima, Nobuo; Sigeta, Masahiro; Reeves, Scott

2017-12-01

Few scales currently exist to assess the quality of interprofessional teamwork through team members' perceptions of working together in mental health settings. The purpose of this study was to revise and validate an interprofessional scale to assess the quality of teamwork in inpatient psychiatric units and to use it multi-nationally. A literature review was undertaken to identify evaluative teamwork tools and develop an additional 12 items to ensure a broad global focus. Focus group discussions considered adaptation to different care systems using subjective judgements from 11 participants in a pre-test of items. Data quality, construct validity, reproducibility, and internal consistency were investigated in the survey using an international comparative design. Exploratory factor analysis yielded five factors with 21 items: 'patient/community centred care', 'collaborative communication', 'interprofessional conflict', 'role clarification', and 'environment'. High overall internal consistency, reproducibility, adequate face validity, and reasonable construct validity were shown in the USA and Japan. The revised Collaborative Practice Assessment Tool (CPAT) is a valid measure to assess the quality of interprofessional teamwork in psychiatry and identifies the best strategies to improve team performance. Furthermore, the revised scale will generate more rigorous evidence for collaborative practice in psychiatry internationally.

Development of a methodological tool for the assessment of the hydromorphological conditions of lakes in Europe

NASA Astrophysics Data System (ADS)

Gay, Aurore; Argillier, Christine; Reynaud, Nathalie; Nicolas, Delphine; Baudoin, Jean-Marc

2017-04-01

The assessment of the ecological status of surface waters considering the biological, physico-chemical and hydromorphological conditions is requested by the European Water Framework Directive (WFD). If research efforts have particularly concentrated on rivers, lakes have yet received less attention. Nevertheless, due to their function of receptacles of inland waters, the habitats they provide to an important biodiversity and the numerous services they support (water supply, recreational activities, hydroelectricity), assessing the ecological quality of lakes becomes crucial for their protection. Still, this task remains challenging, especially considering the hydromorphological compartments. Indeed, while promising tools already exist to assess the lake biological and physico-chemical status, our comprehension of the impact of hydromophological impairments on the global ecosystem functioning remains poor and existing tools to assess such impacts often focus only on morphological aspects and in a qualitative rather than quantitative way. In this context, our study aims at providing stakeholders with a methodology to assess quantitatively the hydrological and morphological quality of lakes in Europe. The developed methodology, LAKe HYdromorphological Conditions tool (LAKHYC tool) is based on our current knowledge of the functioning of lakes and pre-existing works (e.g., Rowan et al., 2012; Rinaldi et al., 2013). The LAKHYC tool integrates the six parameters requested by the WFD, each one being assessed by at least three descriptors that are calculated as Ecological Quality Ratios, i.e. as the deviation from a reference condition. The originality of the present method lies in the fact that specific reference conditions are defined for each descriptor. In this way, we avoid using a predetermined set of lakes considered as not impacted by human activities and which often corresponds to natural lakes in specific areas (e.g., mountains) and do not represent the diversity of lakes in Europe. Moreover, the combination of all descriptors provides a score that reflects the overall hydromorphological conditions of each lake and allows for a strict comparison of the results between different systems. The range of values is subdivided into five classes corresponding to various level of impairment (from low to high degradation). The application of the LAKHYC tool on lakes across Europe is necessary to improve the tool (i.e., for intercalibration) and enable the comparison of the conditions of lakes on a European-large scale. Further developments of the LAKHYC tool will also include the estimation of associated uncertainties and a sensitivity analysis of this multimetric index. Rinaldi M., Surian N., Comiti F., Bussettini M. (2013) A method for the assessment and analysis of the hydromorphological condition of Italian streams: The Morphological Quality Index (MQI). Geomorphology, 180-181:96-108 Rowan J.S., Greig S.J., Armstrong C.T., Smith D.C., Tierney D. (2012) Development of a classification and decision-support tool for assessing lake hydromorphology. Environmental Modelling & Software, 36:86-98.

TU-AB-BRD-00: Task Group 100

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

2015-06-15

Current quality assurance and quality management guidelines provided by various professional organizations are prescriptive in nature, focusing principally on performance characteristics of planning and delivery devices. However, published analyses of events in radiation therapy show that most events are often caused by flaws in clinical processes rather than by device failures. This suggests the need for the development of a quality management program that is based on integrated approaches to process and equipment quality assurance. Industrial engineers have developed various risk assessment tools that are used to identify and eliminate potential failures from a system or a process before amore » failure impacts a customer. These tools include, but are not limited to, process mapping, failure modes and effects analysis, fault tree analysis. Task Group 100 of the American Association of Physicists in Medicine has developed these tools and used them to formulate an example risk-based quality management program for intensity-modulated radiotherapy. This is a prospective risk assessment approach that analyzes potential error pathways inherent in a clinical process and then ranks them according to relative risk, typically before implementation, followed by the design of a new process or modification of the existing process. Appropriate controls are then put in place to ensure that failures are less likely to occur and, if they do, they will more likely be detected before they propagate through the process, compromising treatment outcome and causing harm to the patient. Such a prospective approach forms the basis of the work of Task Group 100 that has recently been approved by the AAPM. This session will be devoted to a discussion of these tools and practical examples of how these tools can be used in a given radiotherapy clinic to develop a risk based quality management program. Learning Objectives: Learn how to design a process map for a radiotherapy process Learn how to perform failure modes and effects analysis analysis for a given process Learn what fault trees are all about Learn how to design a quality management program based upon the information obtained from process mapping, failure modes and effects analysis and fault tree analysis. Dunscombe: Director, TreatSafely, LLC and Center for the Assessment of Radiological Sciences; Consultant to IAEA and Varian Thomadsen: President, Center for the Assessment of Radiological Sciences Palta: Vice President of the Center for the Assessment of Radiological Sciences.« less

TU-AB-BRD-03: Fault Tree Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dunscombe, P.

2015-06-15

Current quality assurance and quality management guidelines provided by various professional organizations are prescriptive in nature, focusing principally on performance characteristics of planning and delivery devices. However, published analyses of events in radiation therapy show that most events are often caused by flaws in clinical processes rather than by device failures. This suggests the need for the development of a quality management program that is based on integrated approaches to process and equipment quality assurance. Industrial engineers have developed various risk assessment tools that are used to identify and eliminate potential failures from a system or a process before amore » failure impacts a customer. These tools include, but are not limited to, process mapping, failure modes and effects analysis, fault tree analysis. Task Group 100 of the American Association of Physicists in Medicine has developed these tools and used them to formulate an example risk-based quality management program for intensity-modulated radiotherapy. This is a prospective risk assessment approach that analyzes potential error pathways inherent in a clinical process and then ranks them according to relative risk, typically before implementation, followed by the design of a new process or modification of the existing process. Appropriate controls are then put in place to ensure that failures are less likely to occur and, if they do, they will more likely be detected before they propagate through the process, compromising treatment outcome and causing harm to the patient. Such a prospective approach forms the basis of the work of Task Group 100 that has recently been approved by the AAPM. This session will be devoted to a discussion of these tools and practical examples of how these tools can be used in a given radiotherapy clinic to develop a risk based quality management program. Learning Objectives: Learn how to design a process map for a radiotherapy process Learn how to perform failure modes and effects analysis analysis for a given process Learn what fault trees are all about Learn how to design a quality management program based upon the information obtained from process mapping, failure modes and effects analysis and fault tree analysis. Dunscombe: Director, TreatSafely, LLC and Center for the Assessment of Radiological Sciences; Consultant to IAEA and Varian Thomadsen: President, Center for the Assessment of Radiological Sciences Palta: Vice President of the Center for the Assessment of Radiological Sciences.« less

TU-AB-BRD-01: Process Mapping

DOE Office of Scientific and Technical Information (OSTI.GOV)

Palta, J.

2015-06-15

Current quality assurance and quality management guidelines provided by various professional organizations are prescriptive in nature, focusing principally on performance characteristics of planning and delivery devices. However, published analyses of events in radiation therapy show that most events are often caused by flaws in clinical processes rather than by device failures. This suggests the need for the development of a quality management program that is based on integrated approaches to process and equipment quality assurance. Industrial engineers have developed various risk assessment tools that are used to identify and eliminate potential failures from a system or a process before amore » failure impacts a customer. These tools include, but are not limited to, process mapping, failure modes and effects analysis, fault tree analysis. Task Group 100 of the American Association of Physicists in Medicine has developed these tools and used them to formulate an example risk-based quality management program for intensity-modulated radiotherapy. This is a prospective risk assessment approach that analyzes potential error pathways inherent in a clinical process and then ranks them according to relative risk, typically before implementation, followed by the design of a new process or modification of the existing process. Appropriate controls are then put in place to ensure that failures are less likely to occur and, if they do, they will more likely be detected before they propagate through the process, compromising treatment outcome and causing harm to the patient. Such a prospective approach forms the basis of the work of Task Group 100 that has recently been approved by the AAPM. This session will be devoted to a discussion of these tools and practical examples of how these tools can be used in a given radiotherapy clinic to develop a risk based quality management program. Learning Objectives: Learn how to design a process map for a radiotherapy process Learn how to perform failure modes and effects analysis analysis for a given process Learn what fault trees are all about Learn how to design a quality management program based upon the information obtained from process mapping, failure modes and effects analysis and fault tree analysis. Dunscombe: Director, TreatSafely, LLC and Center for the Assessment of Radiological Sciences; Consultant to IAEA and Varian Thomadsen: President, Center for the Assessment of Radiological Sciences Palta: Vice President of the Center for the Assessment of Radiological Sciences.« less

TU-AB-BRD-02: Failure Modes and Effects Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Huq, M.

2015-06-15

Current quality assurance and quality management guidelines provided by various professional organizations are prescriptive in nature, focusing principally on performance characteristics of planning and delivery devices. However, published analyses of events in radiation therapy show that most events are often caused by flaws in clinical processes rather than by device failures. This suggests the need for the development of a quality management program that is based on integrated approaches to process and equipment quality assurance. Industrial engineers have developed various risk assessment tools that are used to identify and eliminate potential failures from a system or a process before amore » failure impacts a customer. These tools include, but are not limited to, process mapping, failure modes and effects analysis, fault tree analysis. Task Group 100 of the American Association of Physicists in Medicine has developed these tools and used them to formulate an example risk-based quality management program for intensity-modulated radiotherapy. This is a prospective risk assessment approach that analyzes potential error pathways inherent in a clinical process and then ranks them according to relative risk, typically before implementation, followed by the design of a new process or modification of the existing process. Appropriate controls are then put in place to ensure that failures are less likely to occur and, if they do, they will more likely be detected before they propagate through the process, compromising treatment outcome and causing harm to the patient. Such a prospective approach forms the basis of the work of Task Group 100 that has recently been approved by the AAPM. This session will be devoted to a discussion of these tools and practical examples of how these tools can be used in a given radiotherapy clinic to develop a risk based quality management program. Learning Objectives: Learn how to design a process map for a radiotherapy process Learn how to perform failure modes and effects analysis analysis for a given process Learn what fault trees are all about Learn how to design a quality management program based upon the information obtained from process mapping, failure modes and effects analysis and fault tree analysis. Dunscombe: Director, TreatSafely, LLC and Center for the Assessment of Radiological Sciences; Consultant to IAEA and Varian Thomadsen: President, Center for the Assessment of Radiological Sciences Palta: Vice President of the Center for the Assessment of Radiological Sciences.« less

Tools for Communication: Novel infrastructure to address patient-perceived gaps in oncology care
.

PubMed

McMullen, Suzanne; Szabo, Shelagh; Halbert, Ronald J; Lai, Catherine; Parikh, Aparna; Bunce, Mikele; Khoury, Raya; Small, Art; Masaquel, Anthony

2017-04-01

Healthcare providers (HCPs) and patient communication are integral to high-quality oncology care. The patient and HCP perspectives are needed to identify gaps in care and develop communication tools.
. This study aimed to understand patient- and HCP-perceived elements of and gaps in high-quality care to develop novel communication tools to improve care. 
. Qualitative interviews were conducted among 16 patients with cancer and 10 HCPs in the United States. Trained interviewers elicited patients' and HCPs' concerns, views, and perceived needs for communication tools. A thematic analysis was used to identify four quality of care domains, depicted in a conceptual model, and two draft communication tools were developed to address identified gaps.
. No patients reported previously using a communication tool, and gaps in communication regarding treatment aims and education were evident. Two tools were developed to assess patients' life and treatment goals and the importance of ongoing education.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

ERIC Educational Resources Information Center

Valentine, Jeffrey C.; Cooper, Harris

2008-01-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…

Monitoring Compliance to Promote Quality Assurance: Development of a Mental Health Clinical Chart Audit Tool in Belize, 2013.

PubMed

Winer, Rachel A; Bennett, Eleanor; Murillo, Illouise; Schuetz-Mueller, Jan; Katz, Craig L

2015-09-01

Belize trained psychiatric nurse practitioners (PNPs) in the early 1990s to provide mental health services throughout the country. Despite overwhelming success, the program is limited by lack of monitoring, evaluation, and surveillance. To promote quality assurance, we developed a chart audit tool to monitor mental healthcare delivery compliance for initial psychiatric assessment notes completed by PNPs. After reviewing the Belize Health Information System electronic medical record system, we developed a clinical audit tool to capture 20 essential components for initial assessment clinical notes. The audit tool was then piloted for initial assessment notes completed during July through September of 2013. One hundred and thirty-four initial psychiatric interviews were audited. The average chart score among all PNPs was 9.57, ranging from 3 to 15. Twenty-three charts-or 17.2%-had a score of 14 or higher and met a 70% compliance benchmark goal. Among indicators most frequently omitted included labs ordered and named (15.7%) and psychiatric diagnosis (21.6%). Explicit statement of medications initiated with dose and frequency occurred in 47.0% of charts. Our findings provide direction for training and improvement, such as emphasizing the importance of naming labs ordered, medications and doses prescribed, and psychiatric diagnoses in initial assessment clinical notes. We hope this initial assessment helps enhance mental health delivery compliance by prompting creation of BHIS templates, development of audits tools for revisit follow-up visits, and establishment of corrective actions for low-scoring practitioners. These efforts may serve as a model for implementing quality assurance programming in other low resource settings.

Floristic Quality Index: An assessment tool for restoration projects and monitoring sites in coastal Louisiana

USGS Publications Warehouse

Cretini, K.F.; Steyer, G.D.

2011-01-01

The Coastwide Reference Monitoring System (CRMS) program was established to assess the effectiveness of individual coastal restoration projects and the cumulative effects of multiple projects at regional and coastwide scales. In order to make these assessments, analytical teams have been assembled for each of the primary data types sampled under the CRMS program, including vegetation, hydrology, landscape, and soils. These teams consist of scientists and support staff from the U.S. Geological Survey and other Federal agencies, the Louisiana Office of Coastal Protection and Restoration, and university academics. Each team is responsible for developing or identifying parameters, indices, or tools that can be used to assess coastal wetlands at various scales. The CRMS Vegetation Analytical Team has developed a Floristic Quality Index for coastal Louisiana to determine the quality of a wetland based on its plant species composition and abundance.

A systematic review of the PTSD Checklist's diagnostic accuracy studies using QUADAS.

PubMed

McDonald, Scott D; Brown, Whitney L; Benesek, John P; Calhoun, Patrick S

2015-09-01

Despite the popularity of the PTSD Checklist (PCL) as a clinical screening test, there has been no comprehensive quality review of studies evaluating its diagnostic accuracy. A systematic quality assessment of 22 diagnostic accuracy studies of the English-language PCL using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) assessment tool was conducted to examine (a) the quality of diagnostic accuracy studies of the PCL, and (b) whether quality has improved since the 2003 STAndards for the Reporting of Diagnostic accuracy studies (STARD) initiative regarding reporting guidelines for diagnostic accuracy studies. Three raters independently applied the QUADAS tool to each study, and a consensus among the 4 authors is reported. Findings indicated that although studies generally met standards in several quality areas, there is still room for improvement. Areas for improvement include establishing representativeness, adequately describing clinical and demographic characteristics of the sample, and presenting better descriptions of important aspects of test and reference standard execution. Only 2 studies met each of the 14 quality criteria. In addition, study quality has not appreciably improved since the publication of the STARD Statement in 2003. Recommendations for the improvement of diagnostic accuracy studies of the PCL are discussed. (c) 2015 APA, all rights reserved).

Test Accuracy of Informant-Based Cognitive Screening Tests for Diagnosis of Dementia and Multidomain Cognitive Impairment in Stroke.

PubMed

McGovern, Aine; Pendlebury, Sarah T; Mishra, Nishant K; Fan, Yuhua; Quinn, Terence J

2016-02-01

Poststroke cognitive assessment can be performed using standardized questionnaires designed for family or care givers. We sought to describe the test accuracy of such informant-based assessments for diagnosis of dementia/multidomain cognitive impairment in stroke. We performed a systematic review using a sensitive search strategy across multidisciplinary electronic databases. We created summary test accuracy metrics and described reporting and quality using STARDdem and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tools, respectively. From 1432 titles, we included 11 studies. Ten papers used the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). Four studies described IQCODE for diagnosis of poststroke dementia (n=1197); summary sensitivity: 0.81 (95% confidence interval, 0.60-0.93); summary specificty: 0.83 (95% confidence interval, 0.64-0.93). Five studies described IQCODE as tool for predicting future dementia (n=837); summary sensitivity: 0.60 (95% confidence interval, 0.32-0.83); summary specificity: 0.97 (95% confidence interval, 0.70-1.00). All papers had issues with at least 1 aspect of study reporting or quality. There is a limited literature on informant cognitive assessments in stroke. IQCODE as a diagnostic tool has test properties similar to other screening tools, IQCODE as a prognostic tool is specific but insensitive. We found no papers describing test accuracy of informant tests for diagnosis of prestroke cognitive decline, few papers on poststroke dementia and all included papers had issues with potential bias. © 2015 American Heart Association, Inc.

Median of patient results as a tool for assessment of analytical stability.

PubMed

Jørgensen, Lars Mønster; Hansen, Steen Ingemann; Petersen, Per Hyltoft; Sölétormos, György

2015-06-15

In spite of the well-established external quality assessment and proficiency testing surveys of analytical quality performance in laboratory medicine, a simple tool to monitor the long-term analytical stability as a supplement to the internal control procedures is often needed. Patient data from daily internal control schemes was used for monthly appraisal of the analytical stability. This was accomplished by using the monthly medians of patient results to disclose deviations from analytical stability, and by comparing divergences with the quality specifications for allowable analytical bias based on biological variation. Seventy five percent of the twenty analytes achieved on two COBASs INTEGRA 800 instruments performed in accordance with the optimum and with the desirable specifications for bias. Patient results applied in analytical quality performance control procedures are the most reliable sources of material as they represent the genuine substance of the measurements and therefore circumvent the problems associated with non-commutable materials in external assessment. Patient medians in the monthly monitoring of analytical stability in laboratory medicine are an inexpensive, simple and reliable tool to monitor the steadiness of the analytical practice. Copyright © 2015 Elsevier B.V. All rights reserved.

Objective Evaluation Tool for Texture-Modified Food (OET-TMF): Development of the Tool and Validation.

PubMed

Calleja-Fernández, Alicia; Pintor-de-la-Maza, Begoña; Vidal-Casariego, Alfonso; Cano-Rodríguez, Isidoro; Ballesteros-Pomar, María D

2016-06-01

Texture-modified diets (TMDs) should fulfil nutritional goals, guarantee homogenous texture, and meet food safety regulations. The food industry has created texture-modified food (TMF) that meets the TMD requirements of quality and safety for inpatients. To design and develop a tool that allows the objective selection of foodstuffs for TMDs that ensures nutritional requirements and swallowing safety of inpatients in order to improve their quality of life, especially regarding their food satisfaction. An evaluation tool was designed to objectively determine the adequacy of food included in the TMD menus of a hospital. The "Objective Evaluation Tool for Texture-Modified Food" (OET-TMF) consists of seven items that evaluate the food's nutritional quality (energy and protein input), presence of allergens, texture and viscosity, cooking, storage type, useful life, and patient acceptance. The total score ranged from 0 to 64 and was divided into four categories: high quality, good quality, medium quality, and low quality. Studying four different commercial TMFs contributed to the validation of the tool. All the evaluated products scored between high and good regarding quality. There was a tendency (p = 0.077) towards higher consumption and a higher overall quality of the product obtained with the OET-TMF. The product that scored highest with the tool was the best accepted; the product with the lowest score had the highest rate of refusal. The OET-TMF allows for the objective discrimination of the quality of TMF. In addition, it shows a certain relationship between the observed and assessed quality intake.

Quality Assessment of TPB-Based Questionnaires: A Systematic Review

PubMed Central

Oluka, Obiageli Crystal; Nie, Shaofa; Sun, Yi

2014-01-01

Objective This review is aimed at assessing the quality of questionnaires and their development process based on the theory of planned behavior (TPB) change model. Methods A systematic literature search for studies with the primary aim of TPB-based questionnaire development was conducted in relevant databases between 2002 and 2012 using selected search terms. Ten of 1,034 screened abstracts met the inclusion criteria and were assessed for methodological quality using two different appraisal tools: one for the overall methodological quality of each study and the other developed for the appraisal of the questionnaire content and development process. Both appraisal tools consisted of items regarding the likelihood of bias in each study and were eventually combined to give the overall quality score for each included study. Results 8 of the 10 included studies showed low risk of bias in the overall quality assessment of each study, while 9 of the studies were of high quality based on the quality appraisal of questionnaire content and development process. Conclusion Quality appraisal of the questionnaires in the 10 reviewed studies was successfully conducted, highlighting the top problem areas (including: sample size estimation; inclusion of direct and indirect measures; and inclusion of questions on demographics) in the development of TPB-based questionnaires and the need for researchers to provide a more detailed account of their development process. PMID:24722323

The kidney disease quality of life cognitive function subscale and cognitive performance maintenance hemodialysis patients

USDA-ARS?s Scientific Manuscript database

Background: Cognitive impairment is common but often undiagnosed in patients with end-stage renal disease, in part reflecting limited validated and easily administered tools to assess cognitive function in dialysis patients. Accordingly, we assessed the utility of the Kidney Disease Quality of Life ...

Teacher-Child Interactions in Chile and Their Associations with Prekindergarten Outcomes

ERIC Educational Resources Information Center

Leyva, Diana; Weiland, Christina; Barata, M.; Yoshikawa, Hirokazu; Snow, Catherine; Treviño, Ernesto; Rolla, Andrea

2015-01-01

Quality of teacher-child interactions is central to prekindergarten children's learning. In the United States, the quality of teacher-child interactions is commonly assessed using the teaching through interactions conceptual framework and an associated observational tool, the Classroom Assessment Scoring System (CLASS). This study examined: (a)…

AIR QUALITY ASSESSMENT IN USA - TECHNICAL TOOLS AND LINKAGE TO HUMAN HEALTH

EPA Science Inventory

This is an invited presentation to the Air4EU Final Conference to held in Prague, Czech Republic, on 10 November 2006. Air4EU is a jointly-sponsored, three-year European effort to provide recommendations on air quality assessment by monitoring and modeling for regulated pollutan...

Soil quality evaluation using Soil Management Assessment Framework (SMAF) in Brazilian oxisols with contrasting texture

USDA-ARS?s Scientific Manuscript database

To ensure current land use strategies and management practices are economically, environmentally, and socially sustainable, tools and techniques for assessing and quantifying changes in soil quality/health (SQ) need to be developed through rigorous research and potential use by consultants, and othe...

Assessing quality of health services with the SERVQUAL model in Iran. A systematic review and meta-analysis.

PubMed

Teshnizi, Saeed Hosseini; Aghamolaei, Teamur; Kahnouji, Kobra; Teshnizi, Seyyed Mehrdad Hosseini; Ghani, Jalil

2018-03-01

The five-dimension service quality (SERVQUAL) scale is one of the most common tools for evaluating gaps between clients' perceptions and expectations. This study aimed to assess the quality of health services in Iran through a meta-analysis of all Iranian studies which used the SERVQUAL tool. A systematic literature review has been performed in Web of Science, PubMed, Scopus, Google Scholar, Iran Medex, Magiran and Scientific Information Database. All relevant English or Persian studies published between January 2009 and April 2016 were have been selected. Papers were considered if they regarded all five dimensions of the SERVQUAL tool for assessing the quality of health care services. Two reviewer independently extracted mean and standard deviation of five dimensions and characteristics of studies. The quality of studies included in meta-analysis using STROBE checklist. Of 315 studies initially identified, 12 were included in our meta-analysis. All analyses were performed in Stata MP v. 14. Patients' perceptions were lower than their expectations (gap = -1.64). Responsibility (-1.22) and reliability (-1.15) had the lowest gaps, and tangibility and empathy (-1.03) had the largest gaps. Except gender, other variables had no significant associations with gaps. Patients in the cities of Arak (-3.47) and Shiraz (-3.02) had the largest gaps. All dimensions of service quality were negative, which implies that the quality of health services in Iran has not been satisfying to patients and needs to be improved.

[Informatics data quality and management].

PubMed

Feng, Rung-Chuang

2009-06-01

While the quality of data affects every aspect of business, it is frequently overlooked in terms of customer data integration, data warehousing, business intelligence and enterprise applications. Regardless of which data terms are used, a high level of data quality is a critical base condition essential to satisfy user needs and facilitate the development of effective applications. In this paper, the author introduces methods, a management framework and the major factors involved in data quality assessment. Author also integrates expert opinions to develop data quality assessment tools.

Impact of reduced mass of light commercial vehicles on fuel consumption, CO2 emissions, air quality, and socio-economic costs.

PubMed

Cecchel, S; Chindamo, D; Turrini, E; Carnevale, C; Cornacchia, G; Gadola, M; Panvini, A; Volta, M; Ferrario, D; Golimbioschi, R

2018-02-01

This study presents a modelling system to evaluate the impact of weight reduction in light commercial vehicles with diesel engines on air quality and greenhouse gas emissions. The PROPS model assesses the emissions of one vehicle in the aforementioned category and its corresponding reduced-weight version. The results serve as an input to the RIAT+ tool, an air quality integrated assessment modelling system. This paper applies the tools in a case study in the Lombardy region (Italy) and discusses the input data pre-processing, the PROPS-RIAT+ modelling system runs, and the results. Copyright © 2017 Elsevier B.V. All rights reserved.

Ninth Annual NASA/Contractors Conference on Quality and Productivity. World Class Excellence: The Journey Continues. Conference presentations

NASA Technical Reports Server (NTRS)

Templeton, Geoffrey B. (Editor); Stewart, Lynne M. (Editor)

1992-01-01

The topics covered include the following: The George M. Low Trophy; total quality assessment and measurement; using award criteria to improve organizational effectiveness; results--keeping an eye on the bottom line; capturing customer satisfaction; moving from management to leadership; leadership versus management; transforming the management team; leadership success stories; success stories in the quest for excellence; small business successes; education success stories; government success stories; tools and techniques for total quality management (TQM) integration; planning and organizing for TQM integration; successful stories for implementing system level TQM/CI tools; assessing TQM results; establishing an environment for continuous improvement at NASA; empowerment; synergism of partnering; and partnerships in education.

Development of a Comprehensive and Interactive Tool to Inform State Violence and Injury Prevention Plans.

PubMed

Wilson, Lauren; Deokar, Angela J; Zaesim, Araya; Thomas, Karen; Kresnow-Sedacca, Marcie-Jo

The Center of Disease Control and Prevention's Core State Violence and Injury Prevention Program (Core SVIPP) provides an opportunity for states to engage with their partners to implement, evaluate, and disseminate strategies that lead to the reduction and prevention of injury and violence. Core SVIPP requires awardees to develop or update their state injury and violence plans. Currently, literature informing state planning efforts is limited, especially regarding materials related to injury and violence. Presumably, plans that are higher quality result in having a greater impact on preventing injury and violence, and literature to improve quality would benefit prevention programming. (1) To create a comprehensive injury-specific index to aid in the development and revision of state injury and violence prevention plans, and (2) to assess the reliability and utility of this index. Through an iterative development process, a workgroup of subject matter experts created the Violence and Injury Prevention: Comprehensive Index Tool (VIP:CIT). The tool was pilot tested on 3 state injury and violence prevention plans and assessed for initial usability. Following revisions to the tool (ie, a rubric was developed to further delineate consistent criteria for rating; items were added and clarified), the same state plans were reassessed to test interrater reliability and tool utility. For the second assessment, reliability of the VIP:CIT improved, indicating that the rubric was a useful addition. Qualitative feedback from states suggested that the tool significantly helped guide plan development and communicate about planning processes. The final VIP:CIT is a tool that can help increase plan quality, decrease the research-to-practice gap, and increase connectivity to emerging public health paradigms. The tool provides an example of tailoring guidance materials to reflect academic literature, and it can be easily adapted to other topic areas to promote quality of strategic plans for numerous outcomes.

Development of a Comprehensive and Interactive Tool to Inform State Violence and Injury Prevention Plans

PubMed Central

Wilson, Lauren; Deokar, Angela J.; Zaesim, Araya; Thomas, Karen; Kresnow-Sedacca, Marcie-jo

2018-01-01

Context The Center of Disease Control and Prevention’s Core State Violence and Injury Prevention Program (Core SVIPP) provides an opportunity for states to engage with their partners to implement, evaluate, and disseminate strategies that lead to the reduction and prevention of injury and violence. Core SVIPP requires awardees to develop or update their state injury and violence plans. Currently, literature informing state planning efforts is limited, especially regarding materials related to injury and violence. Presumably, plans that are higher quality result in having a greater impact on preventing injury and violence, and literature to improve quality would benefit prevention programming. Objective (1) To create a comprehensive injury-specific index to aid in the development and revision of state injury and violence prevention plans, and (2) to assess the reliability and utility of this index. Design Through an iterative development process, a workgroup of subject matter experts created the Violence and Injury Prevention: Comprehensive Index Tool (VIP:CIT). The tool was pilot tested on 3 state injury and violence prevention plans and assessed for initial usability. Following revisions to the tool (ie, a rubric was developed to further delineate consistent criteria for rating; items were added and clarified), the same state plans were reassessed to test interrater reliability and tool utility. Results For the second assessment, reliability of the VIP:CIT improved, indicating that the rubric was a useful addition. Qualitative feedback from states suggested that the tool significantly helped guide plan development and communicate about planning processes. Conclusion The final VIP:CIT is a tool that can help increase plan quality, decrease the research-to-practice gap, and increase connectivity to emerging public health paradigms. The tool provides an example of tailoring guidance materials to reflect academic literature, and it can be easily adapted to other topic areas to promote quality of strategic plans for numerous outcomes. PMID:29189505

Innovative Training for Occupational Health and Infection Control Workplace Assessment in Health Care

ERIC Educational Resources Information Center

O'Hara, Lyndsay; Bryce, Elizabeth Ann; Scharf, Sydney; Yassi, Annalee

2012-01-01

A user-friendly, high quality workplace assessment field guide and an accompanying worksheet are invaluable tools for recognizing hazards in the hospital environment. These tools ensure that both front line workers as well as health and safety and infection control professionals can systematically evaluate hazards and formulate recommendations.…

Overview and insights regarding the JEQ soil and water assessment tool (SWAT) special issue

USDA-ARS?s Scientific Manuscript database

The Soil and Water Assessment Tool (SWAT) model has emerged as one of the most widely used water quality watershed- and river basin-scale models worldwide, and has been extensively applied for a broad range of hydrologic and/or environmental problems. Factors driving the international use of SWAT i...

Creating Quality Schools.

ERIC Educational Resources Information Center

American Association of School Administrators, Arlington, VA.

This booklet presents information on how total quality management can be applied to school systems to create educational improvement. Total quality management offers education a systemic approach and a new set of assessment tools. Chapter 1 provides a definition and historical overview of total quality management. Chapter 2 views the school…

Evaluation of the Iconic Pain Assessment Tool by a heterogeneous group of people in pain

PubMed Central

Lalloo, Chitra; Henry, James L

2011-01-01

The Iconic Pain Assessment Tool (IPAT) is a novel web-based instrument for the self-report of pain quality, intensity and location in the form of a permanent diary. Originally designed for people with central poststroke pain, the tool is being adapted for a larger, more diverse patient population. The present study aimed to collect evaluative feedback on the IPAT from a heterogeneous sample of individuals with chronic pain. The specific study aims were to evaluate participant comfort with the tool including enjoyment, ease of use and comfort with the electronic medium; to assess perceived value of the tool for communicating pain quality, intensity and location; to gauge participant intent to share their pain diaries with others and use the tool on a regular basis to track their pain over time; to assess the perceived descriptiveness of current IPAT icons and the numerical rating scale; and to identify strengths and weaknesses of the tool to refine the existing prototype. Written and verbal feedback from individuals with a variety of chronic pain conditions (n=23) were collected in the context of these objectives. Overall, the IPAT was positively endorsed by this heterogeneous sample of people in pain. The authors concluded that the IPAT is a user-friendly instrument that has the potential to help people express, document and share their personal experience with chronic pain. PMID:21369536

Identifying and classifying quality-of-life tools for assessing pressure ulcers after spinal cord injury

PubMed Central

Hitzig, Sander L.; Balioussis, Christina; Nussbaum, Ethne; McGillivray, Colleen F.; Catharine Craven, B.; Noreau, Luc

2013-01-01

Context Although pressure ulcers may negatively influence quality of life (QoL) post-spinal cord injury (SCI), our understanding of how to assess their impact is confounded by conceptual and measurement issues. To ensure that descriptions of pressure ulcer impact are appropriately characterized, measures should be selected according to the domains that they evaluate and the population and pathologies for which they are designed. Objective To conduct a systematic literature review to identify and classify outcome measures used to assess the impact of pressure ulcers on QoL after SCI. Methods Electronic databases (Medline/PubMed, CINAHL, and PsycInfo) were searched for studies published between 1975 and 2011. Identified outcome measures were classified as being either subjective or objective using a QoL model. Results Fourteen studies were identified. The majority of tools identified in these studies did not have psychometric evidence supporting their use in the SCI population with the exception of two objective measures, the Short-Form 36 and the Craig Handicap Assessment and Reporting Technique, and two subjective measures, the Life Situation Questionnaire-Revised and the Ferrans and Powers Quality of Life Index SCI-Version. Conclusion Many QoL outcome tools showed promise in being sensitive to the presence of pressure ulcers, but few of them have been validated for use with SCI. Prospective studies should employ more rigorous methods for collecting data on pressure ulcer severity and location to improve the quality of findings with regard to their impact on QoL. The Cardiff Wound Impact Schedule is a potential tool for assessing impact of pressure ulcers-post SCI. PMID:24090238

Functional Assessments Used by Occupational Therapists with Older Adults at Risk of Activity and Participation Limitations: A Systematic Review

PubMed Central

Wales, Kylie; Clemson, Lindy; Lannin, Natasha; Cameron, Ian

2016-01-01

Introduction The use of functional assessments to evaluate patient change is complicated by a lack of consensus as to which assessment is most suitable for use with older adults. Objective: To identify and appraise the properties of assessments used to evaluate functional abilities in older adults. Methods A systematic review of randomised controlled trials of occupational therapy interventions was conducted up to 2012 to identify assessments used to measure function. Two authors screened and extracted data independently. A second search then identified papers investigating measurement properties of each assessment. Studies from the second search were included if: i) published in English, ii) the assessment was not modified from its original published form, iii) study aim was to evaluate the quality of the tool, iv) and was original research. Translated versions of assessments were excluded. Measurement quality was rated using the COSMIN checklist and Terwee criteria. Results Twenty-eight assessments were identified from the systematic search of occupational therapy interventions provided to older adults. Assessments were of varied measurement quality and many had been adapted (although still evaluated as though the original tool had been administered) potentially altering the conclusions drawn about measurement quality. Synthesis of best evidence established 15 functional assessments have not been tested in an older adult population. Conclusions The Functional Autonomy Measurement System (SMAF) appears to be a promising assessment for use with older adults. Only two tools (the SMAF and the Assessment of Motor and Process Skills (AMPS)) were deemed to be responsive to change when applied to older adults. Health professionals should use functional assessments that have been validated with their population and in their setting. There are reliable and valid assessments to capture the functional performance of older adults in community and hospital settings, although further refinement of these assessments may be necessary. PMID:26859678

Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools

PubMed Central

Jensen-Doss, Amanda; Hawley, Kristin M.

2010-01-01

In an era of evidence-based practice, why are clinicians not typically engaged in evidence-based assessment? To begin to understand this issue, a national multidisciplinary survey was conducted to examine clinician attitudes toward standardized assessment tools. 1442 child clinicians provided opinions about the psychometric qualities of these tools, their benefit over clinical judgment alone, and their practicality. Doctoral-level clinicians and psychologists expressed more positive ratings in all three domains than master’s-level clinicians and non-psychologists respectively, although only the disciplinary differences remained significant when predictors were examined simultaneously. All three attitude scales were predictive of standardized assessment tool use, although practical concerns were the strongest and only independent predictor of use. PMID:21058134

Hydrologic and Water Quality System (HAWQS)

EPA Science Inventory

The Hydrologic and Water Quality System (HAWQS) is a web-based interactive water quantity and quality modeling system that employs as its core modeling engine the Soil and Water Assessment Tool (SWAT), an internationally-recognized public domain model. HAWQS provides users with i...

Clinical governance is "ACE"--using the EFQM excellence model to support baseline assessment.

PubMed

Holland, K; Fennell, S

2000-01-01

The introduction of clinical governance in the "new NHS" means that National Health Service (NHS) organisations are now accountable for the quality of the services they provide to their local communities. As part of the implementation of clinical governance in the NHS, Trusts and health authorities had to complete a baseline assessment of their capability and capacity by September 1999. Describes one Trust's approach to developing and implementing its baseline assessment tool, based upon its existing use of the European Foundation for Quality Management (EFQM) Excellence Model. An initial review of the process suggests that the model provides an adaptable framework for the development of a comprehensive and practical assessment tool and that self-assessment ensures ownership of action plans at service level.

An evaluation of the quality of obstetric morbidity coding using an objective assessment tool, the Performance Indicators For Coding Quality (PICQ).

PubMed

Lamb, Mary K; Innes, Kerry; Saad, Patricia; Rust, Julie; Dimitropoulos, Vera; Cumerlato, Megan

The Performance Indicators for Coding Quality (PICQ) is a data quality assessment tool developed by Australia's National Centre for Classification in Health (NCCH). PICQ consists of a number of indicators covering all ICD-10-AM disease chapters, some procedure chapters from the Australian Classification of Health Intervention (ACHI) and some Australian Coding Standards (ACS). The indicators can be used to assess the coding quality of hospital morbidity data by monitoring compliance of coding conventions and ACS; this enables the identification of particular records that may be incorrectly coded, thus providing a measure of data quality. There are 31 obstetric indicators available for the ICD-10-AM Fourth Edition. Twenty of these 31 indicators were classified as Fatal, nine as Warning and two Relative. These indicators were used to examine coding quality of obstetric records in the 2004-2005 financial year Australian national hospital morbidity dataset. Records with obstetric disease or procedure codes listed anywhere in the code string were extracted and exported from the SPSS source file. Data were then imported into a Microsoft Access database table as per PICQ instructions, and run against all Fatal and Warning and Relative (N=31) obstetric PICQ 2006 Fourth Edition Indicators v.5 for the ICD-10- AM Fourth Edition. There were 689,905 gynaecological and obstetric records in the 2004-2005 financial year, of which 1.14% were found to have triggered Fatal degree errors, 3.78% Warning degree errors and 8.35% Relative degree errors. The types of errors include completeness, redundancy, specificity and sequencing problems. It was found that PICQ is a useful initial screening tool for the assessment of ICD-10-AM/ACHI coding quality. The overall quality of codes assigned to obstetric records in the 2004- 2005 Australian national morbidity dataset is of fair quality.

Issues in developing valid assessments of speech pathology students' performance in the workplace.

PubMed

McAllister, Sue; Lincoln, Michelle; Ferguson, Alison; McAllister, Lindy

2010-01-01

Workplace-based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be 'the gold standard', but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace-based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. This paper reviews important conceptual issues in the design of valid and reliable workplace-based assessments of competence including assessment content, process, impact on learning, measurement issues, and validation strategies. It then goes on to share what has been learned about quality assessment and validation of a workplace-based performance assessment using competency-based ratings. The outcomes of a four-year national development and validation of an assessment tool are described. A literature review of issues in conceptualizing, designing, and validating workplace-based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling, and data analysis in the validation stages of the development process. This paper provides an accessible overview of factors to consider in the design and validation of workplace-based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS, used in an every speech pathology programme in Australia, New Zealand, and Singapore. The paper also describes Rasch analysis, a model-based statistical approach which is useful for establishing validity and reliability of assessment tools. Through careful attention to conceptual and design issues in the development and trialling of workplace-based assessments, it has been possible to develop the world's first valid and reliable national assessment tool for the assessment of performance in speech pathology.

Quality of care assessment in geriatric evaluation and management units: construction of a chart review tool for a tracer condition.

PubMed

Kergoat, Marie-Jeanne; Leclerc, Bernard-Simon; Leduc, Nicole; Latour, Judith; Berg, Katherine; Bolduc, Aline

2009-07-29

The number of elderly people requiring hospital care is growing, so, quality and assessment of care for elders are emerging and complex areas of research. Very few validated and reliable instruments exist for the assessment of quality of acute care in this field. This study's objective was to create such a tool for Geriatric Evaluation and Management Units (GEMUs). The methodology involved a reliability and feasibility study of a retrospective chart review on 934 older inpatients admitted in 49 GEMUs during the year 2002-2003 for fall-related trauma as a tracer condition. Pertinent indicators for a chart abstraction tool, the Geriatric Care Tool (GCT), were developed and validated according to five dimensions: access to care, comprehensiveness, continuity of care, patient-centred care and appropriateness. Consensus methods were used to develop the content. Participants were experts representing eight main health care professions involved in GEMUs from 19 different sites. Items associated with high quality of care at each step of the multidisciplinary management of patients admitted due to falls were identified. The GCT was tested for intra- and inter-rater reliability using 30 medical charts reviewed by each of three independent and blinded trained nurses. Kappa and agreement measures between pairs of chart reviewers were computed on an item-by-item basis. Three quarters of 169 items identifying the process of care, from the case history to discharge planning, demonstrated good agreement (kappa greater than 0.40 and agreement over 70%). Indicators for the appropriateness of care showed less reliability. Content validity and reliability results, as well as the feasibility of the process, suggest that the chart abstraction tool can gather standardized and pertinent clinical information for further evaluating quality of care in GEMU using admission due to falls as a tracer condition. However, the GCT should be evaluated in other models of acute geriatric units and new strategies should be developed to improve reliability of peer assessments in characterizing the quality of care for elderly patients with complex conditions.

The effectiveness of environment assessment tools to guide refurbishment of Australian residential aged care facilities: A systematic review.

PubMed

Neylon, Samantha; Bulsara, Caroline; Hill, Anne-Marie

2017-06-01

To determine applicability of environment assessment tools in guiding minor refurbishments of Australian residential aged care facilities. Studies conducted in residential aged care settings using assessment tools which address the physical environment were eligible for inclusion in a systematic review. Given these studies are limited, tools which have not yet been utilised in research settings were also included. Tools were analysed using a critical appraisal screen. Forty-three publications met the inclusion criteria. Ten environment assessment tools were identified, of which four addressed all seven minor refurbishment domains of lighting, colour and contrast, sound, flooring, furniture, signage and way finding. Only one had undergone reliability and validity testing. There are four tools which may be suitable to use for minor refurbishment of Australian residential aged care facilities. Data on their reliability, validity and quality are limited. © 2017 AJA Inc.

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

PubMed

Raupach, Tobias; Schiekirka, Sarah; Münscher, Christian; Beißbarth, Tim; Himmel, Wolfgang; Burckhardt, Gerhard; Pukrop, Tobias

2012-01-01

Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical phase of a medical curriculum and address differences between the novel tool and traditional evaluation methods. Student self-assessments before and after completion of a teaching module were used to compute performance gains for specific learning objectives. Mean performance gains in each module were compared to student expectations before the module and data derived from a traditional evaluation tool using overall course ratings at the end of the module. A ranking of the 21 modules according to computed performance gains yielded entirely different results than module rankings based on overall course ratings. There was no significant correlation between performance gain and overall ratings. However, the latter were significantly correlated to student expectations before entering the module as well as structural and procedural parameters (Pearson's r 0.7-0.9). Performance gain computed from comparative self-assessments adds an important new dimension to course evaluation in medical education. In contrast to overall course ratings, the novel tool is less heavily confounded by construct-irrelevant factors. Thus, it appears to be more appropriate than overall course ratings in determining teaching quality and developing algorithms to guide performance-oriented resource allocation in medical education.

Nursing informatics, outcomes, and quality improvement.

PubMed

Charters, Kathleen G

2003-08-01

Nursing informatics actively supports nursing by providing standard language systems, databases, decision support, readily accessible research results, and technology assessments. Through normalized datasets spanning an entire enterprise or other large demographic, nursing informatics tools support improvement of healthcare by answering questions about patient outcomes and quality improvement on an enterprise scale, and by providing documentation for business process definition, business process engineering, and strategic planning. Nursing informatics tools provide a way for advanced practice nurses to examine their practice and the effect of their actions on patient outcomes. Analysis of patient outcomes may lead to initiatives for quality improvement. Supported by nursing informatics tools, successful advance practice nurses leverage their quality improvement initiatives against the enterprise strategic plan to gain leadership support and resources.

Methodological Quality of Systematic Reviews in Subfertility: A Comparison of Two Different Approaches

PubMed Central

Popovich, Ivor; Windsor, Bethany; Jordan, Vanessa; Showell, Marian; Shea, Bev; Farquhar, Cynthia M.

2012-01-01

Background Systematic reviews are used widely to guide health care decisions. Several tools have been created to assess systematic review quality. The measurement tool for assessing the methodological quality of systematic reviews known as the AMSTAR tool applies a yes/no score to eleven relevant domains of review methodology. This tool has been reworked so that each domain is scored based on a four point scale, producing R-AMSTAR. Methods and Findings We aimed to compare the AMSTAR and R-AMSTAR tools in assessing systematic reviews in the field of assisted reproduction for subfertility. All published systematic reviews on assisted reproductive technology, with the latest search for studies taking place from 2007–2011, were considered. Reviews that contained no included studies or considered diagnostic outcomes were excluded. Thirty each of Cochrane and non-Cochrane reviews were randomly selected from a search of relevant databases. Both tools were then applied to all sixty reviews. The results were converted to percentage scores and all reviews graded and ranked based on this. AMSTAR produced a much wider variation in percentage scores and achieved higher inter-rater reliability than R-AMSTAR according to kappa statistics. The average rating for Cochrane reviews was consistent between the two tools (88.3% for R-AMSTAR versus 83.6% for AMSTAR) but inconsistent for non-Cochrane reviews (63.9% R-AMSTAR vs. 38.5% AMSTAR). In comparing the rankings generated between the two tools Cochrane reviews changed an average of 4.2 places, compared to 2.9 for non-Cochrane. Conclusion R-AMSTAR provided greater guidance in the assessment of domains and produced quantitative results. However, there were many problems with the construction of its criteria and AMSTAR was much easier to apply consistently. We recommend that AMSTAR incorporates the findings of this study and produces additional guidance for its application in order to improve its reliability and usefulness. PMID:23300526

Measuring antimicrobial prescribing quality in Australian hospitals: development and evaluation of a national antimicrobial prescribing survey tool.

PubMed

James, Rodney; Upjohn, Lydia; Cotta, Menino; Luu, Susan; Marshall, Caroline; Buising, Kirsty; Thursky, Karin

2015-01-01

Antimicrobial stewardship (AMS) programmes have been developed with the intention of reducing inappropriate and unnecessary use of antimicrobials, while improving the quality of patient care and locally helping prevent the development of antimicrobial resistance. An important aspect of AMS programmes is the qualitative assessment of prescribing through antimicrobial prescribing surveys (APS), which are able to provide information about the prescribing behaviour within institutions. Owing to lack of standardization of audit tools and the resources required, qualitative methods for the assessment of antimicrobial use are not often performed. The aim of this study was to design an audit tool that was appropriate for use in all Australian hospitals, suited to local user requirements and included an assessment of the overall appropriateness of the prescription. In November 2011, a pilot APS was conducted across 32 hospitals to assess the usability and generalizability of a newly designed audit tool. Following participant feedback, this tool was revised to reflect the requirements of the respondents. A second pilot study was then performed in November 2012 across 85 hospitals. These surveys identified several areas that can be targets for quality improvement at a national level, including: documentation of indication; surgical prophylaxis prescribed for >24 h; compliance with prescribing guidelines; and the appropriateness of the prescription. By involving the end users in the design and evaluation, we have been able to provide a practical and relevant APS tool for quantitative and qualitative data collection in a wide range of Australian hospital settings. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

ASSESSING THE WATER QUALITY IMPACTS OF GLOBAL CLIMATE CHANGE IN SOUTHWESTERN OHIO, U.S.A

EPA Science Inventory

This paper uses a watershed-scale hydrologic model (Soil and Water Assessment Tool) to simulate the water quality impacts of future climate change in the Little Miami River (LMR) watershed in southwestern Ohio. The LMR watershed, the principal source of drinking water for 1.6 mi...

Quality Management and Self Assessment Tools for Public Libraries.

ERIC Educational Resources Information Center

Evans, Margaret Kinnell

This paper describes a two-year study by the British Library Research and Innovation Centre that examined the potential of self-assessment for public library services. The approaches that formed the basis for the investigation were the Business Excellence Model, the Quality Framework, and the Democratic Approach. Core values were identified by…

QUALITY ASSURANCE AND QUALITY CONTROL IN THE DEVELOPMENT AND APPLICATION OF THE AUTOMATED GEOSPATIAL WATERSHED ASSESSMENT (AGWA) TOOL

EPA Science Inventory

Planning and assessment in land and water resource management are evolving from simple, local-scale problems toward complex, spatially explicit regional ones. Such problems have to be addressed with distributed models that can compute runoff and erosion at different spatial and t...

Defining Strategic and Excellence Bases for the Development of Portuguese Higher Education

ERIC Educational Resources Information Center

Rosa, Maria Joao; Saraiva, Pedro M.; Diz, Henrique

2005-01-01

A self-assessment model was developed for the Portuguese higher education institutions (HEIs) which was based on an empirical study aiming at better understanding their strategic and quality management and innovation practices and tools and on the study of several quality assessment models developed both for HEIs and business organisations. From…

A Methodological Proposal for Learning Games Selection and Quality Assessment

ERIC Educational Resources Information Center

Dondi, Claudio; Moretti, Michela

2007-01-01

This paper presents a methodological proposal elaborated in the framework of two European projects dealing with game-based learning, both of which have focused on "quality" aspects in order to create suitable tools that support European educators, practitioners and lifelong learners in selecting and assessing learning games for use in…

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review.

PubMed

Mani, Suresh; Sharma, Shobha; Omar, Baharudin; Paungmali, Aatit; Joseph, Leonard

2017-04-01

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.

Modeling the influence of septic systems on fecal bacteria load in a suburban watershed in Georgia (GWRC 2017)

EPA Science Inventory

Watershed scale models such as the soil and water assessment tool (SWAT) are promising tools for studying the impacts of septic systems on water quality and quantity. In this study, SWAT was used to assess the influence of septic systems on bacterial loads in a suburban watershed...

The Assessment of Afterschool Program Practices Tool (APT): Findings from the APT Validation Study

ERIC Educational Resources Information Center

Tracy, Allison; Surr, Wendy; Richer, Amanda

2012-01-01

The Assessment of Afterschool Program Practices Tool ("APT"), developed by the National Institute of Out-of-School Time (NIOST), is an observational instrument designed to measure the aspects of afterschool program quality that research suggests contribute to the 21st century skills, attitudes, and behaviors youth need to be successful…

Development of a Data Collection Tool for MbHIS-QUAL: Evaluation of the Quality of Morbidity Data in Routine Health Information Systems (RHISs) in Hospitals.

PubMed

Hanmer, Lyn; Nicola, Edward; Bradshaw, Debbie

2017-01-01

The quality of morbidity data in multiple routine inpatient records in a sample of South African hospitals is being assessed in terms of data accuracy and completeness. Extensive modification of available data collection tools was required to make it possible to collect the required data for the study.

Ecological Indication, Bioaccumulation, and Phytoremediation as Tools for Environmental Quality Management

DTIC Science & Technology

2004-12-01

ECOLOGICAL INDICATION, BIOACCUMULATION, AND PHYTOREMEDIATION AS TOOLS FOR ENVIRONMENTAL QUALITY MANAGEMENT ELLY P. H. BEST1, HENRY E. TATEM1...subsequent transport to shoots, and degradation, or prevent contaminants from leaving the site in whatever form, such as leachate , runoff, trophic...transfer ( phytoremediation ). We use risk assessment to evaluate the toxicity and need for cleanup. Cleanup costs are expected to greatly exceed the cost

Impact of an Information Technology-Enabled Initiative on the Quality of Prostate Multiparametric MRI Reports

PubMed Central

Silveira, Patricia C.; Dunne, Ruth; Sainani, Nisha I.; Lacson, Ronilda; Silverman, Stuart G.; Tempany, Clare M.; Khorasani, Ramin

2015-01-01

Rationale and Objectives Assess the impact of implementing a structured report template and a computer-aided diagnosis (CAD) tool on the quality of prostate multiparametric MRI (mp-MRI) reports. Materials and Methods Institutional Review Board approval was obtained for this HIPAA-compliant study performed at an academic medical center. The study cohort included all prostate mp-MRI reports (n=385) finalized 6 months before and after implementation of a structured report template and a CAD tool (collectively the IT tools) integrated into the PACS workstation. Primary outcome measure was quality of prostate mp-MRI reports. An expert panel of our institution’s subspecialty trained abdominal radiologists defined prostate mp-MRI report quality as optimal, satisfactory or unsatisfactory based on documentation of 9 variables. Reports were reviewed to extract the predefined quality variables and determine whether the IT tools were used to create each report. Chi-square and Student’s t-tests were used to compare report quality before and after implementation of IT tools. Results The overall proportion of optimal or satisfactory reports increased from 29.8% (47/158) to 53.3% (121/227) (p<0.001) after implementing the IT tools. While the proportion of optimal or satisfactory reports increased among reports generated using at least one of the IT tools (47/158=[29.8%] vs. 105/161=[65.2%]; p<0.001), there was no change in quality among reports generated without use of the IT tools (47/158=[29.8%] vs. 16/66=[24.2%]; p=0.404). Conclusion The use of a structured template and CAD tool improved the quality of prostate mp-MRI reports compared to free-text report format and subjective measurement of contrast enhancement kinetic curve. PMID:25863794

[A French tool for evaluation of home palliative care: adaptation of the Support Team Assessment Schedule].

PubMed

Lagabrielle, D; Guyot, F; Jasso, G; Couturier, P; Poussin, G; Frossard, M; Szabo, P; Franco, A

2001-09-01

The authors describe the utilisation of a quality assessment tool for palliative care administered at home. The questionnaire entitled Support Team Assessment Schedule (STAS) was translated from English for this study. It was then utilised comparatively with different quality of life evaluation instruments. Only the results of the STAS are described here. The approach allows for the unresolved problems in the care to come to the surface week after week. The STAS comprises nine items pertaining to the patient and his/her family, and seven items concerning the services provided. The study exhibits the results of 107 evaluations completed from 50 patients stricken with cancer or AIDS in an advanced phase. The availability of this auto clinical audit tool, employable at home or in a hospital, constitutes an essential initial step in the field of French-speaking clinical evaluation of palliative care.

Exploring Systems That Support Good Clinical Care in Indigenous Primary Health-care Services: A Retrospective Analysis of Longitudinal Systems Assessment Tool Data from High-Improving Services.

PubMed

Woods, Cindy; Carlisle, Karen; Larkins, Sarah; Thompson, Sandra Claire; Tsey, Komla; Matthews, Veronica; Bailie, Ross

2017-01-01

Continuous Quality Improvement is a process for raising the quality of primary health care (PHC) across Indigenous PHC services. In addition to clinical auditing using plan, do, study, and act cycles, engaging staff in a process of reflecting on systems to support quality care is vital. The One21seventy Systems Assessment Tool (SAT) supports staff to assess systems performance in terms of five key components. This study examines quantitative and qualitative SAT data from five high-improving Indigenous PHC services in northern Australia to understand the systems used to support quality care. High-improving services selected for the study were determined by calculating quality of care indices for Indigenous health services participating in the Audit and Best Practice in Chronic Disease National Research Partnership. Services that reported continuing high improvement in quality of care delivered across two or more audit tools in three or more audits were selected for the study. Precollected SAT data (from annual team SAT meetings) are presented longitudinally using radar plots for quantitative scores for each component, and content analysis is used to describe strengths and weaknesses of performance in each systems' component. High-improving services were able to demonstrate strong processes for assessing system performance and consistent improvement in systems to support quality care across components. Key strengths in the quality support systems included adequate and orientated workforce, appropriate health system supports, and engagement with other organizations and community, while the weaknesses included lack of service infrastructure, recruitment, retention, and support for staff and additional costs. Qualitative data revealed clear voices from health service staff expressing concerns with performance, and subsequent SAT data provided evidence of changes made to address concerns. Learning from the processes and strengths of high-improving services may be useful as we work with services striving to improve the quality of care provided in other areas.

Operational CryoSat Product Quality Assessment

NASA Astrophysics Data System (ADS)

Mannan, Rubinder; Webb, Erica; Hall, Amanda; Bouzinac, Catherine

2013-12-01

The performance and quality of the CryoSat data products are routinely assessed by the Instrument Data quality Evaluation and Analysis Service (IDEAS). This information is then conveyed to the scientific and user community in order to allow them to utilise CryoSat data with confidence. This paper presents details of the Quality Control (QC) activities performed for CryoSat products under the IDEAS contract. Details of the different QC procedures and tools deployed by IDEAS to assess the quality of operational data are presented. The latest updates to the Instrument Processing Facility (IPF) for the Fast Delivery Marine (FDM) products and the future update to Baseline-C are discussed.

Data Envelopment Analysis (DEA) Model in Operation Management

NASA Astrophysics Data System (ADS)

Malik, Meilisa; Efendi, Syahril; Zarlis, Muhammad

2018-01-01

Quality management is an effective system in operation management to develops, maintains, and improves quality from groups of companies that allow marketing, production, and service at the most economycal level as well as ensuring customer satisfication. Many companies are practicing quality management to improve their bussiness performance. One of performance measurement is through measurement of efficiency. One of the tools can be used to assess efficiency of companies performance is Data Envelopment Analysis (DEA). The aim of this paper is using Data Envelopment Analysis (DEA) model to assess efficiency of quality management. In this paper will be explained CCR, BCC, and SBM models to assess efficiency of quality management.

A Survey to Evaluate Facilitators and Barriers to Quality Measurement and Improvement: Adapting Tools for Implementation Research in Palliative Care Programs.

PubMed

Dy, Sydney M; Al Hamayel, Nebras Abu; Hannum, Susan M; Sharma, Ritu; Isenberg, Sarina R; Kuchinad, Kamini; Zhu, Junya; Smith, Katherine; Lorenz, Karl A; Kamal, Arif H; Walling, Anne M; Weaver, Sallie J

2017-12-01

Although critical for improving patient outcomes, palliative care quality indicators are not yet widely used. Better understanding of facilitators and barriers to palliative care quality measurement and improvement might improve their use and program quality. Development of a survey tool to assess palliative care team perspectives on facilitators and barriers to quality measurement and improvement in palliative care programs. We used the adapted Consolidated Framework for Implementation Research to define domains and constructs to select instruments. We assembled a draft survey and assessed content validity through pilot testing and cognitive interviews with experts and frontline practitioners for key items. We analyzed responses using a constant comparative process to assess survey item issues and potential solutions. We developed a final survey using these results. The survey includes five published instruments and two additional item sets. Domains include organizational characteristics, individual and team characteristics, intervention characteristics, and process of implementation. Survey modules include Quality Improvement in Palliative Care, Implementing Quality Improvement in the Palliative Care Program, Teamwork and Communication, Measuring the Quality of Palliative Care, and Palliative Care Quality in Your Program. Key refinements from cognitive interviews included item wording on palliative care team members, programs, and quality issues. This novel, adaptable instrument assesses palliative care team perspectives on barriers and facilitators for quality measurement and improvement in palliative care programs. Next steps include evaluation of the survey's construct validity and how survey results correlate with findings from program quality initiatives. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

GEOSPATIAL QA

EPA Science Inventory

Geospatial Science is increasingly becoming an important tool in making Agency decisions. Quality Control and Quality Assurance are required to be integrated during the planning, implementation and assessment of geospatial databases, processes and products. In order to ensure Age...

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

HPTLC Fingerprint Analysis: A Quality Control for Authentication of Herbal Phytochemicals

NASA Astrophysics Data System (ADS)

Ram, Mauji; Abdin, M. Z.; Khan, M. A.; Jha, Prabhakar

Authentication and consistent quality are the basic requirement for Indian traditional medicine (TIM), Chinese traditional herbal medicine (TCHM), and their commercial products, regardless of the kind of research conducted to modernize the TIM and TCHM. The complexities of TIM and TCHM challenge the current official quality control mode, for which only a few biochemical markers were selected for identification and quantitative assay. Referring too many unknown factors existed in TIM and TCHM, it is impossible and unnecessary to pinpoint qualitatively and quantitatively every single component contained in the herbal drug. Chromatographic fingerprint is a rational option to meet the need for more effective and powerful quality assessment to TIM and TCHM. The optimized chromatographic fingerprint is not only an alternative analytical tool for authentication, but also an approach to express the various pattern of chemical ingredients distribution in the herbal drugs and preserve such "database" for further multifaced sustainable studies. Analytical separation techniques, for example, high-performance liquid chromatography (HPLC), gas chromatography (GC) and mass spectrometry (MS) were among the most popular methods of choice used for quality control of raw material and finished herbal product. Fingerprint analysis approach using high-performance thin-layer chromatography (HPTLC) has become the most potent tool for quality control of herbal medicines because of its simplicity and reliability. It can serve as a tool for identification, authentication, and quality control of herbal drugs. In this chapter, attempts are being made to expand the use of HPTLC and at the same time create interest among prospective researcher in herbal analysis. The developed method can be used as a quality control tool for rapid authentication from a wide variety of herbal samples. Some examples demonstrated the role of fingerprinting in quality control and assessment.

COMPUTERIZED NEEDS-ORIENTED QUALITY MEASUREMENT EVALUATION SYSTEM (CONQUEST)

EPA Science Inventory

CONQUEST is an easy-to-use quality improvement software tool that uses a common structure and language to help users identity, understand, compare, evaluate, and select among 1,200 clinical performance measures that can be used to assess and improve quality of care. CONQUEST's in...

Measuring Quality of Care in Community Mental Health: Validation of Concordant Clinician and Client Quality-of-Care Scales.

PubMed

Luther, Lauren; Fukui, Sadaaki; Garabrant, Jennifer M; Rollins, Angela L; Morse, Gary; Henry, Nancy; Shimp, Dawn; Gearhart, Timothy; Salyers, Michelle P

2018-04-12

Measuring quality of care can transform care, but few tools exist to measure quality from the client's perspective. The aim of this study was to create concordant clinician and client self-report quality-of-care scales in a sample of community mental health clinicians (n = 189) and clients (n = 469). The client scale had three distinct factors (Person-Centered Care, Negative Staff Interactions, and Inattentive Care), while the clinician scale had two: Person-Centered Care and Discordant Care. Both versions demonstrated adequate internal consistency and validity with measures related to satisfaction and the therapeutic relationship. These measures are promising, brief quality assessment tools.

The methodological and reporting quality of systematic reviews from China and the USA are similar.

PubMed

Tian, Jinhui; Zhang, Jun; Ge, Long; Yang, Kehu; Song, Fujian

2017-05-01

To compare the methodological and reporting quality of systematic reviews by authors from China and those from the United States (USA). From systematic reviews of randomized trials published in 2014 in English, we randomly selected 100 from China and 100 from the USA. The methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool, and reporting quality assessed using the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) tool. Compared with systematic reviews from the USA, those from China were more likely to be a meta-analysis, published in low-impact journals, and a non-Cochrane review. The mean summary Assessing the Methodological Quality of Systematic Reviews score was 6.7 (95% confidence interval: 6.5, 7.0) for reviews from China and 6.6 (6.1, 7.1) for reviews from the USA, and the mean summary Preferred Reporting Items for Systematic Reviews and Meta-analyses score was 21.2 (20.7, 21.6) for reviews from China and 20.6 (19.9, 21.3) for reviews from the USA. The differences in summary quality scores between China and the USA were statistically nonsignificant after adjusting for multiple review factors. The overall methodological and reporting quality of systematic reviews by authors from China are similar to those from the USA, although the quality of systematic reviews from both countries could be further improved. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.

Demonstration of the Health Literacy Universal Precautions Toolkit: Lessons for Quality Improvement.

PubMed

Mabachi, Natabhona M; Cifuentes, Maribel; Barnard, Juliana; Brega, Angela G; Albright, Karen; Weiss, Barry D; Brach, Cindy; West, David

2016-01-01

The Agency for Healthcare Research and Quality Health Literacy Universal Precautions Toolkit was developed to help primary care practices assess and make changes to improve communication with and support for patients. Twelve diverse primary care practices implemented assigned tools over a 6-month period. Qualitative results revealed challenges practices experienced during implementation, including competing demands, bureaucratic hurdles, technological challenges, limited quality improvement experience, and limited leadership support. Practices used the Toolkit flexibly and recognized the efficiencies of implementing tools in tandem and in coordination with other quality improvement initiatives. Practices recommended reducing Toolkit density and making specific refinements.

An online network tool for quality information to answer questions about occupational safety and health: usability and applicability.

PubMed

Rhebergen, Martijn D F; Hulshof, Carel T J; Lenderink, Annet F; van Dijk, Frank J H

2010-10-22

Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use. Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

PubMed Central

Wind, Stefanie A.; Engelhard, George

2015-01-01

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rater-mediated assessments involve complex interactions among many variables, including assessment contexts, student artifacts, rubrics, individual rater characteristics, and others, rater-assigned scores are suitable candidates for Mokken scale analysis. The purposes of this study are to describe a suite of indices that can be used to explore the psychometric quality of data from rater-mediated assessments and to illustrate the substantive interpretation of Mokken-based statistics and displays in this context. Techniques that are commonly used in polytomous applications of Mokken scaling are adapted for use with rater-mediated assessments, with a focus on the substantive interpretation related to individual raters. Overall, the findings suggest that indices of rater monotonicity, rater scalability, and invariant rater ordering based on Mokken scaling provide diagnostic information at the level of individual raters related to the requirements for invariant measurement. These Mokken-based indices serve as an additional suite of diagnostic tools for exploring the quality of data from rater-mediated assessments that can supplement rating quality indices based on parametric models. PMID:29795883

Methodological Quality Assessment of Meta-analyses in Endodontics.

PubMed

Kattan, Sereen; Lee, Su-Min; Kohli, Meetu R; Setzer, Frank C; Karabucak, Bekir

2018-01-01

The objectives of this review were to assess the methodological quality of published meta-analyses related to endodontics using the assessment of multiple systematic reviews (AMSTAR) tool and to provide a follow-up to previously published reviews. Three electronic databases were searched for eligible studies according to the inclusion and exclusion criteria: Embase via Ovid, The Cochrane Library, and Scopus. The electronic search was amended by a hand search of 6 dental journals (International Endodontic Journal; Journal of Endodontics; Australian Endodontic Journal; Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology; Endodontics and Dental Traumatology; and Journal of Dental Research). The searches were conducted to include articles published after July 2009, and the deadline for inclusion of the meta-analyses was November 30, 2016. The AMSTAR assessment tool was used to evaluate the methodological quality of all included studies. A total of 36 reports of meta-analyses were included. The overall quality of the meta-analyses reports was found to be medium, with an estimated mean overall AMSTAR score of 7.25 (95% confidence interval, 6.59-7.90). The most poorly assessed areas were providing an a priori design, the assessment of the status of publication, and publication bias. In recent publications in the field of endodontics, the overall quality of the reported meta-analyses is medium according to AMSTAR. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

National Water-Quality Assessment (NAWQA) area-characterization toolbox

USGS Publications Warehouse

Price, Curtis V.; Nakagaki, Naomi; Hitt, Kerie J.

2010-01-01

This is release 1.0 of the National Water-Quality Assessment (NAWQA) Area-Characterization Toolbox. These tools are designed to be accessed using ArcGIS Desktop software (versions 9.3 and 9.3.1). The toolbox is composed of a collection of custom tools that implement geographic information system (GIS) techniques used by the NAWQA Program to characterize aquifer areas, drainage basins, and sampled wells. These tools are built on top of standard functionality included in ArcGIS Desktop running at the ArcInfo license level. Most of the tools require a license for the ArcGIS Spatial Analyst extension. ArcGIS is a commercial GIS software system produced by ESRI, Inc. (http://www.esri.com). The NAWQA Area-Characterization Toolbox is not supported by ESRI, Inc. or its technical support staff. Any use of trade, product, or firm names is for descriptive purposes only and does not imply endorsement by the U.S. Government.

Quality Improvement Project: Replacing the Numeric Rating Scale with a Clinically Aligned Pain Assessment (CAPA) Tool.

PubMed

Topham, Debra; Drew, Debra

2017-12-01

CAPA is a multifaceted pain assessment tool that was adopted at a large tertiary Midwest hospital to replace the numeric scale for adult patients who could self-report their pain experience. This article describes the process of implementation and the effect on patient satisfaction scores. Use of the tool is supported by the premise that pain assessment entails more than just pain intensity and that assessment is an exchange of meaning between patients and clinicians dependent on internal and external factors. Implementation of the tool was a transformative process resulting in modest increases in patient satisfaction scores with pain management. Patient reports that "staff did everything to manage pain" had the biggest gains and were sustained for more than 2 years. The CAPA tool meets regulatory requirements for pain assessment. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Guidance on Data Quality Assessment for Life Cycle Inventory ...

EPA Pesticide Factsheets

Data quality within Life Cycle Assessment (LCA) is a significant issue for the future support and development of LCA as a decision support tool and its wider adoption within industry. In response to current data quality standards such as the ISO 14000 series, various entities within the LCA community have developed different methodologies to address and communicate the data quality of Life Cycle Inventory (LCI) data. Despite advances in this field, the LCA community is still plagued by the lack of reproducible data quality results and documentation. To address these issues, US EPA has created this guidance in order to further support reproducible life cycle inventory data quality results and to inform users of the proper application of the US EPA supported data quality system. The work for this report was begun in December 2014 and completed as of April 2016.The updated data quality system includes a novel approach to the pedigree matrix by addressing data quality at the flow and the process level. Flow level indicators address source reliability, temporal correlation, geographic correlation, technological correlation and data sampling methods. The process level indicators address the level of review the unit process has undergone and its completeness. This guidance is designed to be updatable as part of the LCA Research Center’s continuing commitment to data quality advancements. Life cycle assessment is increasingly being used as a tool to identify areas of

Effectiveness of the Assessment of Burden of COPD (ABC) tool on health-related quality of life in patients with COPD: a cluster randomised controlled trial in primary and hospital care

PubMed Central

Slok, Annerika H M; Kotz, Daniel; van Breukelen, Gerard; Chavannes, Niels H; Rutten-van Mölken, Maureen P M H; Kerstjens, Huib A M; van der Molen, Thys; Asijee, Guus M; Dekhuijzen, P N Richard; Holverda, Sebastiaan; Salomé, Philippe L; Goossens, Lucas M A; Twellaar, Mascha; in ‘t Veen, Johannes C C M; van Schayck, Onno C P

2016-01-01

Objective Assessing the effectiveness of the Assessment of Burden of COPD (ABC) tool on disease-specific quality of life in patients with chronic obstructive pulmonary disease (COPD) measured with the St. George's Respiratory Questionnaire (SGRQ), compared with usual care. Methods A pragmatic cluster randomised controlled trial, in 39 Dutch primary care practices and 17 hospitals, with 357 patients with COPD (postbronchodilator FEV1/FVC ratio <0.7) aged ≥40 years, who could understand and read the Dutch language. Healthcare providers were randomly assigned to the intervention or control group. The intervention group applied the ABC tool, which consists of a short validated questionnaire assessing the experienced burden of COPD, objective COPD parameter (eg, lung function) and a treatment algorithm including a visual display and treatment advice. The control group provided usual care. Researchers were blinded to group allocation during analyses. Primary outcome was the number of patients with a clinically relevant improvement in SGRQ score between baseline and 18-month follow-up. Secondary outcomes were the COPD Assessment Test (CAT) and the Patient Assessment of Chronic Illness Care (PACIC; a measurement of perceived quality of care). Results At 18-month follow-up, 34% of the 146 patients from 27 healthcare providers in the intervention group showed a clinically relevant improvement in the SGRQ, compared with 22% of the 148 patients from 29 healthcare providers in the control group (OR 1.85, 95% CI 1.08 to 3.16). No difference was found on the CAT (−0.26 points (scores ranging from 0 to 40); 95% CI −1.52 to 0.99). The PACIC showed a higher improvement in the intervention group (0.32 points (scores ranging from 1 to 5); 95% CI 0.14 to 0.50). Conclusions This study showed that use of the ABC tool may increase quality of life and perceived quality of care. Trial registration number NTR3788; Results. PMID:27401361

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

A dynamic quality assessment tool for laparoscopic hysterectomy to measure surgical outcomes.

PubMed

Driessen, Sara R C; Van Zwet, Erik W; Haazebroek, Pascal; Sandberg, Evelien M; Blikkendaal, Mathijs D; Twijnstra, Andries R H; Jansen, Frank Willem

2016-12-01

The current health care system has an urgent need for tools to measure quality. A wide range of quality indicators have been developed in an attempt to differentiate between high-quality and low-quality health care processes. However, one of the main issues of currently used indicators is the lack of case-mix correction and improvement possibilities. Case-mix is defined as specific (patient) characteristics that are known to potentially affect (surgical) outcome. If these characteristics are not taken into consideration, comparisons of outcome among health care providers may not be valid. The objective of the study was to develop and test a quality assessment tool for laparoscopic hysterectomy, which can serve as a new outcome quality indicator. This is a prospective, international, multicenter implementation study. A web-based application was developed with 3 main goals: (1) to measure the surgeon's performance using 3 primary outcomes (blood loss, operative time, and complications); (2) to provide immediate individual feedback using cumulative observed-minus-expected graphs; and (3) to detect consistently suboptimal performance after correcting for case-mix characteristics. All gynecologists who perform laparoscopic hysterectomies were requested to register their procedures in the application. A patient safety risk factor checklist was used by the surgeon for reflection. Thereafter a prospective implementation study was performed, and the application was tested using a survey that included the System Usability Scale. A total of 2066 laparoscopic hysterectomies were registered by 81 gynecologists. Mean operative time was 100 ± 39 minutes, blood loss 127 ± 163 mL, and the complication rate 6.1%. The overall survey response rate was 75%, and the mean System Usability Scale was 76.5 ± 13.6, which indicates that the application was good to excellent. The majority of surgeons reported that the application made them more aware of their performance, the outcomes, and patient safety, and they noted that the application provided motivation for improving future performance. We report the development and test of a real-time, dynamic, quality assessment tool for measuring individual surgical outcome for laparoscopic hysterectomy. Importantly, this tool provides opportunities for improving surgical performance. Our study provides a foundation for helping clinicians develop evidence-based quality indicators for other surgical procedures. Copyright © 2016 Elsevier Inc. All rights reserved.

Quality evaluation of JAMA Patient Pages on diabetes using the Ensuring Quality Information for Patient (EQIP) tool.

PubMed

Vaona, Alberto; Marcon, Alessandro; Rava, Marta; Buzzetti, Roberto; Sartori, Marco; Abbinante, Crescenza; Moser, Andrea; Seddaiu, Antonia; Prontera, Manuela; Quaglio, Alessandro; Pallazzoni, Piera; Sartori, Valentina; Rigon, Giulio

2011-12-01

Many medical journals provide patient information leaflets on the correct use of medicines and/or appropriate lifestyles. Only a few studies have assessed the quality of this patient-specific literature. The purpose of this study was to evaluate the quality of JAMA Patient Pages on diabetes using the Ensuring Quality Information for Patient (EQIP) tool. A multidisciplinary group of 10 medical doctors analyzed all diabetes-related Patient Pages published by JAMA from 1998 to 2010 using the EQIP tool. Inter-rater reliability was assessed using the percentage of observed total agreement (p(o)). A quality score between 0 and 1 (the higher score indicating higher quality) was calculated for each item on every page as a function of raters' answers to the EQIP checklist. A mean score per item and a mean score per page were then calculated. We found 8 Patient Pages on diabetes on the JAMA web site. The overall quality score of the documents ranged between 0.55 (Managing Diabetes and Diabetes) and 0.67 (weight and diabetes). p(o) was at least moderate (>50%) for 15 of the 20 EQIP items. Despite generally favorable quality scores, some items received low scores. The worst scores were for the item assessing provision of an empty space to customize information for individual patients (score=0.01, p(o)=95%) and patients involvement in document drafting (score=0.11, p(o)=79%). The Patient Pages on diabetes published by JAMA were found to present weak points that limit their overall quality and may jeopardize their efficacy. We therefore recommend that authors and publishers of written patient information comply with published quality criteria. Further research is needed to evaluate the quality and efficacy of existing written health care information. Copyright © 2011 Primary Care Diabetes Europe. Published by Elsevier Ltd. All rights reserved.

SLIPTA e-Tool improves laboratory audit process in Vietnam and Cambodia.

PubMed

Nguyen, Thuong T; McKinney, Barbara; Pierson, Antoine; Luong, Khue N; Hoang, Quynh T; Meharwal, Sandeep; Carvalho, Humberto M; Nguyen, Cuong Q; Nguyen, Kim T; Bond, Kyle B

2014-01-01

The Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist is used worldwide to drive quality improvement in laboratories in developing countries and to assess the effectiveness of interventions such as the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme. However, the paper-based format of the checklist makes administration cumbersome and limits timely analysis and communication of results. In early 2012, the SLMTA team in Vietnam developed an electronic SLIPTA checklist tool. The e-Tool was pilot tested in Vietnam in mid-2012 and revised. It was used during SLMTA implementation in Vietnam and Cambodia in 2012 and 2013 and further revised based on auditors' feedback about usability. The SLIPTA e-Tool enabled rapid turn-around of audit results, reduced workload and language barriers and facilitated analysis of national results. Benefits of the e-Tool will be magnified with in-country scale-up of laboratory quality improvement efforts and potential expansion to other countries.

[Usefulness of scoring risk for adverse outcomes in older patients with the Identification of Seniors at Risk scale and the Triage Risk Screening Tool: a meta-analysis].

PubMed

Rivero-Santana, Amado; Del Pino-Sedeño, Tasmania; Ramallo-Fariña, Yolanda; Vergara, Itziar; Serrano-Aguilar, Pedro

2017-02-01

A considerable proportion of the geriatric population experiences unfavorable outcomes of hospital emergency department care. An assessment of risk for adverse outcomes would facilitate making changes in clinical management by adjusting available resources to needs according to an individual patient's risk. Risk assessment tools are available, but their prognostic precision varies. This systematic review sought to quantify the prognostic precision of 2 geriatric screening and risk assessment tools commonly used in emergency settings for patients at high risk of adverse outcomes (revisits, functional deterioration, readmissions, or death): the Identification of Seniors at Risk (ISAR) scale and the Triage Risk Screening Tool (TRST). We searched PubMed, EMBASE, the Cochrane Central Register of Controlled Trials, and SCOPUS, with no date limits, to find relevant studies. Quality was assessed with the QUADAS-2 checklist (for quality assessment of diagnostic accuracy studies). We pooled data for prognostic yield reported for the ISAR and TRST scores for each short- and medium-term outcome using bivariate random-effects modeling. The sensitivity of the ISAR scoring system as a whole ranged between 67% and 99%; specificity fell between 21% and 41%. TRST sensitivity ranged between 52% and 75% and specificity between 39% and 51%.We conclude that the tools currently used to assess risk of adverse outcomes in patients of advanced age attended in hospital emergency departments do not have adequate prognostic precision to be clinically useful.

Assessment of SOAP note evaluation tools in colleges and schools of pharmacy.

PubMed

Sando, Karen R; Skoy, Elizabeth; Bradley, Courtney; Frenzel, Jeanne; Kirwin, Jennifer; Urteaga, Elizabeth

2017-07-01

To describe current methods used to assess SOAP notes in colleges and schools of pharmacy. Members of the American Association of Colleges of Pharmacy Laboratory Instructors Special Interest Group were invited to share assessment tools for SOAP notes. Content of submissions was evaluated to characterize overall qualities and how the tools assessed subjective, objective, assessment, and plan information. Thirty-nine assessment tools from 25 schools were evaluated. Twenty-nine (74%) of the tools were rubrics and ten (26%) were checklists. All rubrics included analytic scoring elements, while two (7%) were mixed with holistic and analytic scoring elements. A majority of the rubrics (35%) used a four-item rating scale. Substantial variability existed in how tools evaluated subjective and objective sections. All tools included problem identification in the assessment section. Other assessment items included goals (82%) and rationale (69%). Seventy-seven percent assessed drug therapy; however, only 33% assessed non-drug therapy. Other plan items included education (59%) and follow-up (90%). There is a great deal of variation in the specific elements used to evaluate SOAP notes in colleges and schools of pharmacy. Improved consistency in assessment methods to evaluate SOAP notes may better prepare students to produce standardized documentation when entering practice. Copyright © 2017 Elsevier Inc. All rights reserved.

Google vs. the Library (Part III): Assessing the Quality of Sources Found by Undergraduates

ERIC Educational Resources Information Center

Georgas, Helen

2015-01-01

This study assesses and compares the quality of sources found by undergraduate students when doing research using both Google and a library (federated) search tool. Thirty undergraduates were asked to find four sources (one book, two articles, and one additional source of their choosing) related to a selected research topic. Students used both…

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

PubMed

Carney, Patricia A; Palmer, Ryan T; Fuqua Miller, Marissa; Thayer, Erin K; Estroff, Sue E; Litzelman, Debra K; Biagioli, Frances E; Teal, Cayla R; Lambros, Ann; Hatt, William J; Satterfield, Jason M

2016-05-01

Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review

PubMed Central

Carney, Patricia A.; Palmer, Ryan T.; Miller, Marissa Fuqua; Thayer, Erin K.; Estroff, Sue E.; Litzelman, Debra K.; Biagioli, Frances E.; Teal, Cayla R.; Lambros, Ann; Hatt, William J.; Satterfield, Jason M.

2015-01-01

Purpose Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. Method The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final, included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Results Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. Conclusions These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development. PMID:26796091

Development of a Self-Assessment Tool to Facilitate Decision-Making in Choosing a Long Term Care Administration Major

ERIC Educational Resources Information Center

Johs-Artisensi, Jennifer L.; Olson, Douglas M.; Nahm, Abraham Y.

2016-01-01

Long term care administrators need a broad base of knowledge, skills, and interests to provide leadership and be successful in managing a fiscally responsible, quality long term care organization. Researchers developed a tool to help students assess whether a long term care administration major is a compatible fit. With input from professionals in…

Evaluating analytic and risk assessment tools to estimate sediment and nutrients losses from agricultural lands in the southern region of the USA

USDA-ARS?s Scientific Manuscript database

Non-point source pollution from agricultural fields is a critical problem associated with water quality impairment in the USA and a low-oxygen environment in the Gulf of Mexico. The use, development and enhancement of qualitative and quantitative models or tools for assessing agricultural runoff qua...

ATACseqQC: a Bioconductor package for post-alignment quality assessment of ATAC-seq data.

PubMed

Ou, Jianhong; Liu, Haibo; Yu, Jun; Kelliher, Michelle A; Castilla, Lucio H; Lawson, Nathan D; Zhu, Lihua Julie

2018-03-01

ATAC-seq (Assays for Transposase-Accessible Chromatin using sequencing) is a recently developed technique for genome-wide analysis of chromatin accessibility. Compared to earlier methods for assaying chromatin accessibility, ATAC-seq is faster and easier to perform, does not require cross-linking, has higher signal to noise ratio, and can be performed on small cell numbers. However, to ensure a successful ATAC-seq experiment, step-by-step quality assurance processes, including both wet lab quality control and in silico quality assessment, are essential. While several tools have been developed or adopted for assessing read quality, identifying nucleosome occupancy and accessible regions from ATAC-seq data, none of the tools provide a comprehensive set of functionalities for preprocessing and quality assessment of aligned ATAC-seq datasets. We have developed a Bioconductor package, ATACseqQC, for easily generating various diagnostic plots to help researchers quickly assess the quality of their ATAC-seq data. In addition, this package contains functions to preprocess aligned ATAC-seq data for subsequent peak calling. Here we demonstrate the utilities of our package using 25 publicly available ATAC-seq datasets from four studies. We also provide guidelines on what the diagnostic plots should look like for an ideal ATAC-seq dataset. This software package has been used successfully for preprocessing and assessing several in-house and public ATAC-seq datasets. Diagnostic plots generated by this package will facilitate the quality assessment of ATAC-seq data, and help researchers to evaluate their own ATAC-seq experiments as well as select high-quality ATAC-seq datasets from public repositories such as GEO to avoid generating hypotheses or drawing conclusions from low-quality ATAC-seq experiments. The software, source code, and documentation are freely available as a Bioconductor package at https://bioconductor.org/packages/release/bioc/html/ATACseqQC.html .

Multi-intelligence critical rating assessment of fusion techniques (MiCRAFT)

NASA Astrophysics Data System (ADS)

Blasch, Erik

2015-06-01

Assessment of multi-intelligence fusion techniques includes credibility of algorithm performance, quality of results against mission needs, and usability in a work-domain context. Situation awareness (SAW) brings together low-level information fusion (tracking and identification), high-level information fusion (threat and scenario-based assessment), and information fusion level 5 user refinement (physical, cognitive, and information tasks). To measure SAW, we discuss the SAGAT (Situational Awareness Global Assessment Technique) technique for a multi-intelligence fusion (MIF) system assessment that focuses on the advantages of MIF against single intelligence sources. Building on the NASA TLX (Task Load Index), SAGAT probes, SART (Situational Awareness Rating Technique) questionnaires, and CDM (Critical Decision Method) decision points; we highlight these tools for use in a Multi-Intelligence Critical Rating Assessment of Fusion Techniques (MiCRAFT). The focus is to measure user refinement of a situation over the information fusion quality of service (QoS) metrics: timeliness, accuracy, confidence, workload (cost), and attention (throughput). A key component of any user analysis includes correlation, association, and summarization of data; so we also seek measures of product quality and QuEST of information. Building a notion of product quality from multi-intelligence tools is typically subjective which needs to be aligned with objective machine metrics.

Minimal Data and Site Specific Approaches

EPA Science Inventory

As part of a workshop, Tools for Assessing Stream Dissolved Minerals, approaches and EPA tools are described for site specific development of water quality criteria based on observations from Arkansas streams using minimal data. Discussion topics will include site-specific appro...

The Comprehensive Evaluation of Electronic Learning Tools and Educational Software (CEELTES)

ERIC Educational Resources Information Center

Karolcík, Štefan; Cipková, Elena; Hrušecký, Roman; Veselský, Milan

2015-01-01

Despite the fact that digital technologies are more and more used in the learning and education process, there is still lack of professional evaluation tools capable of assessing the quality of used digital teaching aids in a comprehensive and objective manner. Construction of the Comprehensive Evaluation of Electronic Learning Tools and…

Quality of websites with patient information about spinal cord injury in Spanish.

PubMed

Bea-Muñoz, M; Medina-Sánchez, M; Flórez-García, M T

2016-07-01

Descriptive, cross-sectional analysis of websites with information on spinal cord injury (SCI) in Spanish. To assess the quality, readability and presence of quality labels on web pages with information about SCI in Spanish. The Internet. An Internet search was conducted on Google with the keywords 'lesión medular' (spinal cord injury), 'paraplejia' (paraplegia) and 'tetraplejia' (tetraplegia). The first 50 results of each search were included. The quality of websites was assessed with the LIDA tool while the readability was assessed with the Flesch-Szigriszt index and the INFLESZ scale. We also checked the presence of any quality label. After excluding duplicated and irrelevant results, 33 websites were analysed. Only four of them had a quality label. The mean score of the LIDA tool was 61.12% (medium quality), and the worst results were those referring to the reliability of the information. The readability of the web pages was somewhat difficult, with a mean of 48.22 in the Flesch-Szigriszt index. Only eight of the websites showed normal readability. We observed no differences in either the quality or the readability of the websites according to their origin or the presence of quality labels. The websites analysed present a medium quality. Mainly, they should improve the reliability of their contents and their readability, including more quality labels. For SCI information in Spanish to be understandable and to provide valuable content, websites analysed in our study need to improve the quality parameters.

Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations.

PubMed

Papageorgiou, Spyridon N; Papadopoulos, Moschos A; Athanasiou, Athanasios E

2014-02-01

Ideally meta-analyses (MAs) should consolidate the characteristics of orthodontic research in order to produce an evidence-based answer. However severe flaws are frequently observed in most of them. The aim of this study was to evaluate the statistical methods, the methodology, and the quality characteristics of orthodontic MAs and to assess their reporting quality during the last years. Electronic databases were searched for MAs (with or without a proper systematic review) in the field of orthodontics, indexed up to 2011. The AMSTAR tool was used for quality assessment of the included articles. Data were analyzed with Student's t-test, one-way ANOVA, and generalized linear modelling. Risk ratios with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 80 MAs with 1086 primary studies were included in this evaluation. Using the AMSTAR tool, 25 (27.3%) of the MAs were found to be of low quality, 37 (46.3%) of medium quality, and 18 (22.5%) of high quality. Specific characteristics like explicit protocol definition, extensive searches, and quality assessment of included trials were associated with a higher AMSTAR score. Model selection and dealing with heterogeneity or publication bias were often problematic in the identified reviews. The number of published orthodontic MAs is constantly increasing, while their overall quality is considered to range from low to medium. Although the number of MAs of medium and high level seems lately to rise, several other aspects need improvement to increase their overall quality.

Reporting Quality Assessment of Randomized Controlled Trials Published in Nephrology Urology Monthly Journal.

PubMed

Mehrazmay, Alireza; Karambakhsh, Alireza; Salesi, Mahmood

2015-07-01

Randomized controlled trials (RCTs) are important tools for evidence-based health care decisions. It is, therefore, important that they be conducted and reported with the highest possible standards. The aim of this study was to evaluate the reporting quality of the RCTs published in nephrology urology monthly journal and to examine whether there was a change over time in the reporting quality. The quality of each report was assessed using the Consolidated Standards of Reporting Trials (CONSORT) 2010 Statement checklist and a 5-point quality assessment instrument, i.e. the Jadad scale. Eighteen (14 Iranian and 4 non-Iranian) RCTs were published from 2012 to 2014 on topics including renal stone (16.6%), hemodialysis and transplantation (38.8%), and prostate conditions (11.1%). Interventions comprised surgery, drugs, and teaching method in 7 (38 %), 10 (55%), and 1 (5%) of them, respectively. According to the CONSORT checklist, the weakest reported items were registration number, identification as a randomized trial in the title, and settings and locations where the data were collected. The mean Jadad score of the reports was 2.72 ± 1.36 (54% of their maximum possible total score). According to the Jadad and CONSORT scales, there was an increase in the quality of reporting from 2012 to 2014. This assessment shows low reporting quality scores in reports. Training courses for researchers, using standard reporting tools (e.g. CONSORT 2010 Statement checklist), and consultation with methodologists can improve the quality of published RCTs.

A systematic review of clinical assessment for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Lee, Cindy Ching Siang; Wang, Wenru

2015-02-01

Consolidated clinical practicum prepares pre-registration nursing students to function as beginning practitioners. The clinical competencies of final-year nursing students provide a key indication of professional standards of practice and patient safety. Thus, clinical assessment of nursing students is a crucial issue for educators and administrators. The aim of this systematic review was to explore the clinical competency assessment for undergraduate nursing students. PubMed, CINAHL, ScienceDirect, Web of Science, and EBSCO were systematically searched from January 2000 to December 2013. The systematic review was in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Published quantitative and qualitative studies that examined clinical assessment practices and tools used in clinical nursing education were retrieved. Quality assessment, data extraction, and analysis were completed on all included studies. This review screened 2073 titles, abstracts and full-text records, resulting in 33 included studies. Two reviewers assessed the quality of the included studies. Fourteen quantitative and qualitative studies were identified for this evaluation. The evidence was ordered into emergent themes; the overarching themes were current practices in clinical assessment, issues of learning and assessment, development of assessment tools, and reliability and validity of assessment tools. There is a need to develop a holistic clinical assessment tool with reasonable level of validity and reliability. Clinical assessment is a robust activity and requires collaboration between clinical partners and academia to enhance the clinical experiences of students, the professional development of preceptors, and the clinical credibility of academics. Copyright © 2014 Elsevier Ltd. All rights reserved.

Risk Factor Assessment Branch (RFAB)

Cancer.gov

The Risk Factor Assessment Branch (RFAB) focuses on the development, evaluation, and dissemination of high-quality risk factor metrics, methods, tools, technologies, and resources for use across the cancer research continuum, and the assessment of cancer-related risk factors in the population.

QUAST: quality assessment tool for genome assemblies.

PubMed

Gurevich, Alexey; Saveliev, Vladislav; Vyahhi, Nikolay; Tesler, Glenn

2013-04-15

Limitations of genome sequencing techniques have led to dozens of assembly algorithms, none of which is perfect. A number of methods for comparing assemblers have been developed, but none is yet a recognized benchmark. Further, most existing methods for comparing assemblies are only applicable to new assemblies of finished genomes; the problem of evaluating assemblies of previously unsequenced species has not been adequately considered. Here, we present QUAST-a quality assessment tool for evaluating and comparing genome assemblies. This tool improves on leading assembly comparison software with new ideas and quality metrics. QUAST can evaluate assemblies both with a reference genome, as well as without a reference. QUAST produces many reports, summary tables and plots to help scientists in their research and in their publications. In this study, we used QUAST to compare several genome assemblers on three datasets. QUAST tables and plots for all of them are available in the Supplementary Material, and interactive versions of these reports are on the QUAST website. http://bioinf.spbau.ru/quast . Supplementary data are available at Bioinformatics online.

A web-based screening tool for near-port air quality assessments

PubMed Central

Isakov, Vlad; Barzyk, Timothy M.; Smith, Elizabeth R.; Arunachalam, Saravanan; Naess, Brian; Venkatram, Akula

2018-01-01

The Community model for near-PORT applications (C-PORT) is a screening tool with an intended purpose of calculating differences in annual averaged concentration patterns and relative contributions of various source categories over the spatial domain within about 10 km of the port. C-PORT can inform decision-makers and concerned citizens about local air quality due to mobile source emissions related to commercial port activities. It allows users to visualize and evaluate different planning scenarios, helping them identify the best alternatives for making long-term decisions that protect community health and sustainability. The web-based, easy-to-use interface currently includes data from 21 seaports primarily in the Southeastern U.S., and has a map-based interface based on Google Maps. The tool was developed to visualize and assess changes in air quality due to changes in emissions and/or meteorology in order to analyze development scenarios, and is not intended to support or replace any regulatory models or programs. PMID:29681760

Improving health, safety and energy efficiency in New Zealand through measuring and applying basic housing standards.

PubMed

Gillespie-Bennett, Julie; Keall, Michael; Howden-Chapman, Philippa; Baker, Michael G

2013-08-02

Substandard housing is a problem in New Zealand. Historically there has been little recognition of the important aspects of housing quality that affect people's health and safety. In this viewpoint article we outline the importance of assessing these factors as an essential step to improving the health and safety of New Zealanders and household energy efficiency. A practical risk assessment tool adapted to New Zealand conditions, the Healthy Housing Index (HHI), measures the physical characteristics of houses that affect the health and safety of the occupants. This instrument is also the only tool that has been validated against health and safety outcomes and reported in the international peer-reviewed literature. The HHI provides a framework on which a housing warrant of fitness (WOF) can be based. The HHI inspection takes about one hour to conduct and is performed by a trained building inspector. To maximise the effectiveness of this housing quality assessment we envisage the output having two parts. The first would be a pass/fail WOF assessment showing whether or not the house meets basic health, safety and energy efficiency standards. The second component would rate each main assessment area (health, safety and energy efficiency), potentially on a five-point scale. This WOF system would establish a good minimum standard for rental accommodation as well encouraging improved housing performance over time. In this article we argue that the HHI is an important, validated, housing assessment tool that will improve housing quality, leading to better health of the occupants, reduced home injuries, and greater energy efficiency. If required, this tool could be extended to also cover resilience to natural hazards, broader aspects of sustainability, and the suitability of the dwelling for occupants with particular needs.

Multiscale visual quality assessment for cluster analysis with self-organizing maps

NASA Astrophysics Data System (ADS)

Bernard, Jürgen; von Landesberger, Tatiana; Bremm, Sebastian; Schreck, Tobias

2011-01-01

Cluster analysis is an important data mining technique for analyzing large amounts of data, reducing many objects to a limited number of clusters. Cluster visualization techniques aim at supporting the user in better understanding the characteristics and relationships among the found clusters. While promising approaches to visual cluster analysis already exist, these usually fall short of incorporating the quality of the obtained clustering results. However, due to the nature of the clustering process, quality plays an important aspect, as for most practical data sets, typically many different clusterings are possible. Being aware of clustering quality is important to judge the expressiveness of a given cluster visualization, or to adjust the clustering process with refined parameters, among others. In this work, we present an encompassing suite of visual tools for quality assessment of an important visual cluster algorithm, namely, the Self-Organizing Map (SOM) technique. We define, measure, and visualize the notion of SOM cluster quality along a hierarchy of cluster abstractions. The quality abstractions range from simple scalar-valued quality scores up to the structural comparison of a given SOM clustering with output of additional supportive clustering methods. The suite of methods allows the user to assess the SOM quality on the appropriate abstraction level, and arrive at improved clustering results. We implement our tools in an integrated system, apply it on experimental data sets, and show its applicability.

Modeling the Effects of Conservation Tillage on Water Quality at the Field Scale

USDA-ARS?s Scientific Manuscript database

The development and application of predictive tools to quantitatively assess the effects of tillage and related management activities should be carefully tested against high quality field data. This study reports on: 1) the calibration and validation of the Root Zone Water Quality Model (RZWQM) to a...

Quality Parameterization of Educational Resources from the Perspective of a Teacher

ERIC Educational Resources Information Center

Karolcík, Štefan; Cipková, Elena; Veselský, Milan; Hrubišková, Helena; Matulcíková, Mária

2017-01-01

Objective assessment of the quality of available educational resources presupposes the existence of specific quality standards and specific evaluation tools which consider the specificities of digital products with educational ambitions. The study presents the results of research conducted on a representative sample of teachers who commented on…

The Baldrige Award for Education: How To Measure and Document Quality Improvement.

ERIC Educational Resources Information Center

Arcaro, Jerome S.

This volume describes in practical terms how schools and colleges can use the Malcolm Baldrige National Quality Award assessment as a tool to document and measure areas of existing quality and to identify areas for improvement. This Award is currently given annually to recognize quality in business companies with plans to expand it to include…

SLIPTA e-Tool improves laboratory audit process in Vietnam and Cambodia

PubMed Central

Nguyen, Thuong T.; McKinney, Barbara; Pierson, Antoine; Luong, Khue N.; Hoang, Quynh T.; Meharwal, Sandeep; Carvalho, Humberto M.; Nguyen, Cuong Q.; Nguyen, Kim T.

2014-01-01

Background The Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist is used worldwide to drive quality improvement in laboratories in developing countries and to assess the effectiveness of interventions such as the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme. However, the paper-based format of the checklist makes administration cumbersome and limits timely analysis and communication of results. Development of e-Tool In early 2012, the SLMTA team in Vietnam developed an electronic SLIPTA checklist tool. The e-Tool was pilot tested in Vietnam in mid-2012 and revised. It was used during SLMTA implementation in Vietnam and Cambodia in 2012 and 2013 and further revised based on auditors’ feedback about usability. Outcomes The SLIPTA e-Tool enabled rapid turn-around of audit results, reduced workload and language barriers and facilitated analysis of national results. Benefits of the e-Tool will be magnified with in-country scale-up of laboratory quality improvement efforts and potential expansion to other countries. PMID:29043190

Quality and Cultural Sensitivity of Linguistically Appropriate Cardiovascular Disease Information for Chinese Immigrants: A Review of Online Resources From Heart Foundations.

PubMed

Li, Jialin; Lowres, Nicole; Jin, Kai; Zhang, Ling; Neubeck, Lis; Gallagher, Robyn

Chinese immigrants are at an increased risk for cardiovascular diseases (CVDs) compared with Chinese nationals partly because of lifestyle changes and knowledge deficits. Translated patient resources are available on the Internet and are often provided by health professionals; however, the quality and cultural sensitivity of these resources have not been reported. The aim of this study was to assess the availability, quality, and cultural sensitivity of Chinese-language information available from national "Heart Foundations" (cardiac research bodies, nongovernmental organisations) of the 5 most popular destinations of Chinese immigration. This study is a descriptive research in which national "Heart Foundation" websites were systematically searched for Chinese-language CVD patient education resources. Quality (content, identification, structure) was assessed using the Ensuring Quality Information for Patients instrument. Cultural sensitivity was evaluated using the Cultural Sensitivity Assessment Tool. From 107 identified resources, 33 were CVD specific: coronary heart disease (n = 20), arrhythmias (n = 7), and heart failure (n = 6). Quality of resources was adequate (mean Ensuring Quality Information for Patients score, 69%), but scores varied significantly (min, 60%; max, 85%). Although all resources were classified as culturally sensitive (Cultural Sensitivity Assessment Tool score ≥ 2.5), 2 resources scored low (≤2.5) for visual impact, and across all resources, written and visual domains were assessed as least culturally sensitive. Most resources lacked culturally specific references. Chinese-language CVD resources were inconsistent in the supply of key information. Quality and level of cultural sensitivity were adequate, but most resources lacked culturally specific references. Comprehensive, high-quality CVD resources powered by Editorial Manager and ProduXion Manager from Aries Systems Corporation tailored for Chinese immigrants are urgently needed for healthcare providers to support CVD education and care of patients belonging to this population.

Evaluating the implementation of confusion assessment method-intensive care unit using a quality improvement approach.

PubMed

Stewart, C; Bench, S

2018-05-15

Quality improvement (QI) is a way through which health care delivery can be made safer and more effective. Various models of quality improvement methods exist in health care today. These models can help guide and manage the process of introducing changes into clinical practice. The aim of this project was to implement the use of a delirium assessment tool into three adult critical care units within the same hospital using a QI approach. The objective was to improve the identification and management of delirium. Using the Model for Improvement framework, a multidisciplinary working group was established. A delirium assessment tool was introduced via a series of educational initiatives. New local guidelines regarding the use of delirium assessment and management for the multidisciplinary team were also produced. Audit data were collected at 6 weeks and 5 months post-implementation to evaluate compliance with the use of the tool across three critical care units within a single hospital in London. At 6 weeks, in 134 assessment points out of a possible 202, the tool was deemed to be used appropriately, meaning that 60% of patients received timely assessment; 18% of patients were identified as delirious in audit one. Five months later, only 95 assessment points out of a possible 199 were being appropriately assessed (47%); however, a greater number (32%) were identified as delirious. This project emphasizes the complexity of changing practice in a large busy critical care centre. Despite an initial increase in delirium assessment, this was not sustained over time. The use of a QI model highlights the continuous process of embedding changes into clinical practice and the need to use a QI method that can address the challenging nature of modern health care. QI models guide changes in practice. Consideration should be given to the type of QI model used. © 2018 British Association of Critical Care Nurses.

A novel framework for assessing metadata quality in epidemiological and public health research settings

PubMed Central

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly. PMID:27570670

A novel framework for assessing metadata quality in epidemiological and public health research settings.

PubMed

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly.

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Quality assessment of systematic reviews on alveolar socket preservation.

PubMed

Moraschini, V; Barboza, E Dos S P

2016-09-01

The aim of this overview was to evaluate and compare the quality of systematic reviews, with or without meta-analysis, that have evaluated studies on techniques or biomaterials used for the preservation of alveolar sockets post tooth extraction in humans. An electronic search was conducted without date restrictions using the Medline/PubMed, Cochrane Library, and Web of Science databases up to April 2015. Eligibility criteria included systematic reviews, with or without meta-analysis, focused on the preservation of post-extraction alveolar sockets in humans. Two independent authors assessed the quality of the included reviews using AMSTAR and the checklist proposed by Glenny et al. in 2003. After the selection process, 12 systematic reviews were included. None of these reviews obtained the maximum score using the quality assessment tools implemented, and the results of the analyses were highly variable. A significant statistical correlation was observed between the scores of the two checklists. A wide structural and methodological variability was observed between the systematic reviews published on the preservation of alveolar sockets post tooth extraction. None of the reviews evaluated obtained the maximum score using the two quality assessment tools implemented. Copyright © 2016 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Towards better digital pathology workflows: programming libraries for high-speed sharpness assessment of Whole Slide Images.

PubMed

Ameisen, David; Deroulers, Christophe; Perrier, Valérie; Bouhidel, Fatiha; Battistella, Maxime; Legrès, Luc; Janin, Anne; Bertheau, Philippe; Yunès, Jean-Baptiste

2014-01-01

Since microscopic slides can now be automatically digitized and integrated in the clinical workflow, quality assessment of Whole Slide Images (WSI) has become a crucial issue. We present a no-reference quality assessment method that has been thoroughly tested since 2010 and is under implementation in multiple sites, both public university-hospitals and private entities. It is part of the FlexMIm R&D project which aims to improve the global workflow of digital pathology. For these uses, we have developed two programming libraries, in Java and Python, which can be integrated in various types of WSI acquisition systems, viewers and image analysis tools. Development and testing have been carried out on a MacBook Pro i7 and on a bi-Xeon 2.7GHz server. Libraries implementing the blur assessment method have been developed in Java, Python, PHP5 and MySQL5. For web applications, JavaScript, Ajax, JSON and Sockets were also used, as well as the Google Maps API. Aperio SVS files were converted into the Google Maps format using VIPS and Openslide libraries. We designed the Java library as a Service Provider Interface (SPI), extendable by third parties. Analysis is computed in real-time (3 billion pixels per minute). Tests were made on 5000 single images, 200 NDPI WSI, 100 Aperio SVS WSI converted to the Google Maps format. Applications based on our method and libraries can be used upstream, as calibration and quality control tool for the WSI acquisition systems, or as tools to reacquire tiles while the WSI is being scanned. They can also be used downstream to reacquire the complete slides that are below the quality threshold for surgical pathology analysis. WSI may also be displayed in a smarter way by sending and displaying the regions of highest quality before other regions. Such quality assessment scores could be integrated as WSI's metadata shared in clinical, research or teaching contexts, for a more efficient medical informatics workflow.

Implementing clinical protocols in oncology: quality gaps and the learning curve phenomenon.

PubMed

Kedikoglou, Simos; Syrigos, Konstantinos; Skalkidis, Yannis; Ploiarchopoulou, Fani; Dessypris, Nick; Petridou, Eleni

2005-08-01

The quality improvement effort in clinical practice has focused mostly on 'performance quality', i.e. on the development of comprehensive, evidence-based guidelines. This study aimed to assess the 'conformance quality', i.e. the extent to which guidelines once developed are correctly and consistently applied. It also aimed to assess the existence of quality gaps in the treatment of certain patient segments as defined by age or gender and to investigate methods to improve overall conformance quality. A retrospective audit of clinical practice in a well-defined oncology setting was undertaken and the results compared to those obtained from prospectively applying an internally developed clinical protocol in the same setting and using specific tools to increase conformance quality. All indicators showed improvement after the implementation of the protocol that in many cases reached statistical significance, while in the entire cohort advanced age was associated (although not significantly) with sub-optimal delivery of care. A 'learning curve' phenomenon in the implementation of quality initiatives was detected, with all indicators improving substantially in the second part of the prospective study. Clinicians should pay separate attention to the implementation of chosen protocols and employ specific tools to increase conformance quality in patient care.

Nutrition screening tools: an analysis of the evidence.

PubMed

Skipper, Annalynn; Ferguson, Maree; Thompson, Kyle; Castellanos, Victoria H; Porcari, Judy

2012-05-01

In response to questions about tools for nutrition screening, an evidence analysis project was developed to identify the most valid and reliable nutrition screening tools for use in acute care and hospital-based ambulatory care settings. An oversight group defined nutrition screening and literature search criteria. A trained analyst conducted structured searches of the literature for studies of nutrition screening tools according to predetermined criteria. Eleven nutrition screening tools designed to detect undernutrition in patients in acute care and hospital-based ambulatory care were identified. Trained analysts evaluated articles for quality using criteria specified by the American Dietetic Association's Evidence Analysis Library. Members of the oversight group assigned quality grades to the tools based on the quality of the supporting evidence, including reliability and validity data. One tool, the NRS-2002, received a grade I, and 4 tools-the Simple Two-Part Tool, the Mini-Nutritional Assessment-Short Form (MNA-SF), the Malnutrition Screening Tool (MST), and Malnutrition Universal Screening Tool (MUST)-received a grade II. The MST was the only tool shown to be both valid and reliable for identifying undernutrition in the settings studied. Thus, validated nutrition screening tools that are simple and easy to use are available for application in acute care and hospital-based ambulatory care settings.

Effectiveness of the Assessment of Burden of Chronic Obstructive Pulmonary Disease (ABC) tool: study protocol of a cluster randomised trial in primary and secondary care

PubMed Central

2014-01-01

Background Chronic Obstructive Pulmonary Disease (COPD) is a growing worldwide problem that imposes a great burden on the daily life of patients. Since there is no cure, the goal of treating COPD is to maintain or improve quality of life. We have developed a new tool, the Assessment of Burden of COPD (ABC) tool, to assess and visualize the integrated health status of patients with COPD, and to provide patients and healthcare providers with a treatment algorithm. This tool may be used during consultations to monitor the burden of COPD and to adjust treatment if necessary. The aim of the current study is to analyse the effectiveness of the ABC tool compared with usual care on health related quality of life among COPD patients over a period of 18 months. Methods/Design A cluster randomised controlled trial will be conducted in COPD patients in both primary and secondary care throughout the Netherlands. An intervention group, receiving care based on the ABC tool, will be compared with a control group receiving usual care. The primary outcome will be the change in score on a disease-specific-quality-of-life questionnaire, the Saint George Respiratory Questionnaire. Secondary outcomes will be a different questionnaire (the COPD Assessment Test), lung function and number of exacerbations. During the 18 months follow-up, seven measurements will be conducted, including a baseline and final measurement. Patients will receive questionnaires to be completed at home. Additional data, such as number of exacerbations, will be recorded by the patients’ healthcare providers. A total of 360 patients will be recruited by 40 general practitioners and 20 pulmonologists. Additionally, a process evaluation will be performed among patients and healthcare providers. Discussion The new ABC tool complies with the 2014 Global Initiative for Chronic Obstructive Lung Disease guidelines, which describe the necessity to classify patients on both their airway obstruction and a comprehensive symptom assessment. It has been developed to classify patients, but also to provide visual insight into the burden of COPD and to provide treatment advice. Trial registration Netherlands Trial Register, NTR3788. PMID:25098313

A ranking index for quality assessment of forensic DNA profiles forensic DNA profiles

PubMed Central

2010-01-01

Background Assessment of DNA profile quality is vital in forensic DNA analysis, both in order to determine the evidentiary value of DNA results and to compare the performance of different DNA analysis protocols. Generally the quality assessment is performed through manual examination of the DNA profiles based on empirical knowledge, or by comparing the intensities (allelic peak heights) of the capillary electrophoresis electropherograms. Results We recently developed a ranking index for unbiased and quantitative quality assessment of forensic DNA profiles, the forensic DNA profile index (FI) (Hedman et al. Improved forensic DNA analysis through the use of alternative DNA polymerases and statistical modeling of DNA profiles, Biotechniques 47 (2009) 951-958). FI uses electropherogram data to combine the intensities of the allelic peaks with the balances within and between loci, using Principal Components Analysis. Here we present the construction of FI. We explain the mathematical and statistical methodologies used and present details about the applied data reduction method. Thereby we show how to adapt the ranking index for any Short Tandem Repeat-based forensic DNA typing system through validation against a manual grading scale and calibration against a specific set of DNA profiles. Conclusions The developed tool provides unbiased quality assessment of forensic DNA profiles. It can be applied for any DNA profiling system based on Short Tandem Repeat markers. Apart from crime related DNA analysis, FI can therefore be used as a quality tool in paternal or familial testing as well as in disaster victim identification. PMID:21062433

Q-SEA – a tool for quality assessment of ethics analyses conducted as part of health technology assessments

PubMed Central

Scott, Anna Mae; Hofmann, Björn; Gutiérrez-Ibarluzea, Iñaki; Bakke Lysdahl, Kristin; Sandman, Lars; Bombard, Yvonne

2017-01-01

Introduction: Assessment of ethics issues is an important part of health technology assessments (HTA). However, in terms of existence of quality assessment tools, ethics for HTA is methodologically underdeveloped in comparison to other areas of HTA, such as clinical or cost effectiveness. Objective: To methodologically advance ethics for HTA by: (1) proposing and elaborating Q-SEA, the first instrument for quality assessment of ethics analyses, and (2) applying Q-SEA to a sample systematic review of ethics for HTA, in order to illustrate and facilitate its use. Methods: To develop a list of items for the Q-SEA instrument, we systematically reviewed the literature on methodology in ethics for HTA, reviewed HTA organizations’ websites, and solicited views from 32 experts in the field of ethics for HTA at two 2-day workshops. We subsequently refined Q-SEA through its application to an ethics analysis conducted for HTA. Results: Q-SEA instrument consists of two domains – the process domain and the output domain. The process domain consists of 5 elements: research question, literature search, inclusion/exclusion criteria, perspective, and ethics framework. The output domain consists of 5 elements: completeness, bias, implications, conceptual clarification, and conflicting values. Conclusion: Q-SEA is the first instrument for quality assessment of ethics analyses in HTA. Further refinements to the instrument to enhance its usability continue. PMID:28326147

A multiparametric automatic method to monitor long-term reproducibility in digital mammography: results from a regional screening programme.

PubMed

Gennaro, G; Ballaminut, A; Contento, G

2017-09-01

This study aims to illustrate a multiparametric automatic method for monitoring long-term reproducibility of digital mammography systems, and its application on a large scale. Twenty-five digital mammography systems employed within a regional screening programme were controlled weekly using the same type of phantom, whose images were analysed by an automatic software tool. To assess system reproducibility levels, 15 image quality indices (IQIs) were extracted and compared with the corresponding indices previously determined by a baseline procedure. The coefficients of variation (COVs) of the IQIs were used to assess the overall variability. A total of 2553 phantom images were collected from the 25 digital mammography systems from March 2013 to December 2014. Most of the systems showed excellent image quality reproducibility over the surveillance interval, with mean variability below 5%. Variability of each IQI was 5%, with the exception of one index associated with the smallest phantom objects (0.25 mm), which was below 10%. The method applied for reproducibility tests-multi-detail phantoms, cloud automatic software tool to measure multiple image quality indices and statistical process control-was proven to be effective and applicable on a large scale and to any type of digital mammography system. • Reproducibility of mammography image quality should be monitored by appropriate quality controls. • Use of automatic software tools allows image quality evaluation by multiple indices. • System reproducibility can be assessed comparing current index value with baseline data. • Overall system reproducibility of modern digital mammography systems is excellent. • The method proposed and applied is cost-effective and easily scalable.

What do evaluation instruments tell us about the quality of complementary medicine information on the internet?

PubMed

Breckons, Matthew; Jones, Ray; Morris, Jenny; Richardson, Janet

2008-01-22

Developers of health information websites aimed at consumers need methods to assess whether their website is of "high quality." Due to the nature of complementary medicine, website information is diverse and may be of poor quality. Various methods have been used to assess the quality of websites, the two main approaches being (1) to compare the content against some gold standard, and (2) to rate various aspects of the site using an assessment tool. We aimed to review available evaluation instruments to assess their performance when used by a researcher to evaluate websites containing information on complementary medicine and breast cancer. In particular, we wanted to see if instruments used the same criteria, agreed on the ranking of websites, were easy to use by a researcher, and if use of a single tool was sufficient to assess website quality. Bibliographic databases, search engines, and citation searches were used to identify evaluation instruments. Instruments were included that enabled users with no subject knowledge to make an objective assessment of a website containing health information. The elements of each instrument were compared to nine main criteria defined by a previous study. Google was used to search for complementary medicine and breast cancer sites. The first six results and a purposive six from different origins (charities, sponsored, commercial) were chosen. Each website was assessed using each tool, and the percentage of criteria successfully met was recorded. The ranking of the websites by each tool was compared. The use of the instruments by others was estimated by citation analysis and Google searching. A total of 39 instruments were identified, 12 of which met the inclusion criteria; the instruments contained between 4 and 43 questions. When applied to 12 websites, there was agreement of the rank order of the sites with 10 of the instruments. Instruments varied in the range of criteria they assessed and in their ease of use. Comparing the content of websites against a gold standard is time consuming and only feasible for very specific advice. Evaluation instruments offer gateway providers a method to assess websites. The checklist approach has face validity when results are compared to the actual content of "good" and "bad" websites. Although instruments differed in the range of items assessed, there was fair agreement between most available instruments. Some were easier to use than others, but these were not necessarily the instruments most widely used to date. Combining some of the better features of instruments to provide fewer, easy-to-use methods would be beneficial to gateway providers.

Measuring Program Quality: Evidence of the Scientific Validity of the Assessment of Program Practices Tool

ERIC Educational Resources Information Center

Tracy, Allison; Charmaraman, Linda; Ceder, Ineke; Richer, Amanda; Surr, Wendy

2016-01-01

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

Methodological quality of systematic reviews addressing femoroacetabular impingement.

PubMed

Kowalczuk, Marcin; Adamich, John; Simunovic, Nicole; Farrokhyar, Forough; Ayeni, Olufemi R

2015-09-01

As the body of literature on femoroacetabular impingement (FAI) continues to grow, clinicians turn to systematic reviews to remain current with the best available evidence. The quality of systematic reviews in the FAI literature is currently unknown. The goal of this study was to assess the quality of the reporting of systematic reviews addressing FAI over the last 11 years (2003-2014) and to identify the specific methodological shortcomings and strengths. A search of the electronic databases, MEDLINE, EMBASE and PubMed, was performed to identify relevant systematic reviews. Methodological quality was assessed by two reviewers using the revised assessment of multiple systematic reviews (R-AMSTAR) scoring tool. An intraclass correlation coefficient (ICC) with 95 % confidence intervals (CI) was used to determine agreement between reviewers on R-AMSTAR quality scores. A total of 22 systematic reviews were assessed for methodological quality. The mean consensus R-AMSTAR score across all studies was 26.7 out of 40.0, indicating fair methodological quality. An ICC of 0.931, 95 % CI 0.843-0.971 indicated excellent agreement between reviewers during the scoring process. The systematic reviews addressing FAI are generally of fair methodological quality. Use of tools such as the R-AMSTAR score or PRISMA guidelines while designing future systematic reviews can assist in eliminating methodological shortcomings identified in this review. These shortcomings need to be kept in mind by clinicians when applying the current literature to their patient populations and making treatment decisions. Systematic reviews of highest methodological quality should be used by clinicians when possible to answer clinical questions.

Gaia: automated quality assessment of protein structure models.

PubMed

Kota, Pradeep; Ding, Feng; Ramachandran, Srinivas; Dokholyan, Nikolay V

2011-08-15

Increasing use of structural modeling for understanding structure-function relationships in proteins has led to the need to ensure that the protein models being used are of acceptable quality. Quality of a given protein structure can be assessed by comparing various intrinsic structural properties of the protein to those observed in high-resolution protein structures. In this study, we present tools to compare a given structure to high-resolution crystal structures. We assess packing by calculating the total void volume, the percentage of unsatisfied hydrogen bonds, the number of steric clashes and the scaling of the accessible surface area. We assess covalent geometry by determining bond lengths, angles, dihedrals and rotamers. The statistical parameters for the above measures, obtained from high-resolution crystal structures enable us to provide a quality-score that points to specific areas where a given protein structural model needs improvement. We provide these tools that appraise protein structures in the form of a web server Gaia (http://chiron.dokhlab.org). Gaia evaluates the packing and covalent geometry of a given protein structure and provides quantitative comparison of the given structure to high-resolution crystal structures. dokh@unc.edu Supplementary data are available at Bioinformatics online.

A Preliminary Investigation of the Utility of the "Behavior Support Plan Quality Evaluation Guide II" for Use in Australia

ERIC Educational Resources Information Center

Webber, Lynne S.; McVilly, Keith R.; Fester, Tarryn; Zazelis, Telly

2011-01-01

Background: The quality of behaviour support plans (BSPs) can be an important influence on the quality of the support provided to people with disability who show challenging behaviours. The Behavior Support Plan Quality Evaluation Guide II (BSP-QE II) is one tool that may be useful in assessing the quality of behaviour support plans. It has…

Next-generation sequencing (NGS) for assessment of microbial water quality: current progress, challenges, and future opportunities

PubMed Central

Tan, BoonFei; Ng, Charmaine; Nshimyimana, Jean Pierre; Loh, Lay Leng; Gin, Karina Y.-H.; Thompson, Janelle R.

2015-01-01

Water quality is an emergent property of a complex system comprised of interacting microbial populations and introduced microbial and chemical contaminants. Studies leveraging next-generation sequencing (NGS) technologies are providing new insights into the ecology of microbially mediated processes that influence fresh water quality such as algal blooms, contaminant biodegradation, and pathogen dissemination. In addition, sequencing methods targeting small subunit (SSU) rRNA hypervariable regions have allowed identification of signature microbial species that serve as bioindicators for sewage contamination in these environments. Beyond amplicon sequencing, metagenomic and metatranscriptomic analyses of microbial communities in fresh water environments reveal the genetic capabilities and interplay of waterborne microorganisms, shedding light on the mechanisms for production and biodegradation of toxins and other contaminants. This review discusses the challenges and benefits of applying NGS-based methods to water quality research and assessment. We will consider the suitability and biases inherent in the application of NGS as a screening tool for assessment of biological risks and discuss the potential and limitations for direct quantitative interpretation of NGS data. Secondly, we will examine case studies from recent literature where NGS based methods have been applied to topics in water quality assessment, including development of bioindicators for sewage pollution and microbial source tracking, characterizing the distribution of toxin and antibiotic resistance genes in water samples, and investigating mechanisms of biodegradation of harmful pollutants that threaten water quality. Finally, we provide a short review of emerging NGS platforms and their potential applications to the next generation of water quality assessment tools. PMID:26441948

Developing a caries risk registry to support caries risk assessment and management for children: A quality improvement initiative.

PubMed

Ruff, Jesley C; Herndon, Jill Boylston; Horton, Roger A; Lynch, Julie; Mathwig, Dawn C; Leonard, Audra; Aravamudhan, Krishna

2017-10-27

Health registries are commonly used in medicine to support public health activities and are increasingly used in quality improvement (QI) initiatives. Illustrations of dental registries and their QI applications are lacking. Within dentistry, caries risk assessment implementation and documentation are vital to optimal patient care. The purpose of this article is to describe the processes used to develop a caries risk assessment registry as a QI initiative to support clinical caries risk assessment, caries prevention, and disease management for children. Developmental steps reflected Agency for Healthcare Research and Quality recommendations for planning QI registries and included engaging "champions," defining the project, identifying registry features, defining performance dashboard indicators, and pilot testing with participant feedback. We followed Standards for Quality Improvement Reporting Excellence guidelines. Registry eligibility is patients aged 0-17 years. QI tools include prompts to register eligible patients; decision support tools grounded in evidence-based guidelines; and performance dashboard reports delivered at the provider and aggregated levels at regular intervals. The registry was successfully piloted in two practices with documented caries risk assessment increasing from 57 percent to 92 percent and positive feedback regarding the potential to improve dental practice patient centeredness, patient engagement and education, and quality of care. The caries risk assessment registry demonstrates how dental registries may be used in QI efforts to promote joint patient and provider engagement, foster shared decision making, and systematically collect patient information to generate timely and actionable data to improve care quality and patient outcomes at the individual and population levels. © 2017 American Association of Public Health Dentistry.

Measurement properties of tools used to assess suicidality in autistic and general population adults: A systematic review.

PubMed

Cassidy, S A; Bradley, L; Bowen, E; Wigham, S; Rodgers, J

2018-05-05

Adults diagnosed with autism are at significantly increased risk of suicidal thoughts, suicidal behaviours and dying by suicide. However, it is unclear whether any validated tools are currently available to effectively assess suicidality in autistic adults in research and clinical practice. This is crucial for understanding and preventing premature death by suicide in this vulnerable group. This two stage systematic review therefore aimed to identify tools used to assess suicidality in autistic and general population adults, evaluate these tools for their appropriateness and measurement properties, and make recommendations for appropriate selection of suicidality assessment tools in research and clinical practice. Three databases were searched (PsycInfo, Medline and Web of Knowledge). Four frequently used suicidality assessment tools were identified, and subsequently rated for quality of the evidence in support of their measurement properties using the COSMIN checklist. Despite studies having explored suicidality in autistic adults, none had utilised a validated tool. Overall, there was lack of evidence in support of suicidality risk assessments successfully predicting future suicide attempts. We recommend adaptations to current suicidality assessment tools and priorities for future research, in order to better conceptualise suicidality and its measurement in autism. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Systematic literature review of clinical trials evaluating pharmacotherapy for overactive bladder in elderly patients: An assessment of trial quality.

PubMed

Kistler, Kristin D; Xu, Yingxin; Zou, Kelly H; Ntanios, Fady; Chapman, Douglass S; Luo, Xuemei

2018-01-01

Overactive bladder (OAB) disproportionately affects older-aged adults, yet most randomized controlled trials (RCTs) underrepresent patients ≥65. This systematic literature review (SLR) identified RCTs evaluating β-3 adrenergic agonists or muscarinic antagonists in elderly patients with OAB, and compared study quality across trials. MEDLINE ® , Embase ® , and Cochrane Collaboration Central Register of Clinical Trials databases were searched from inception through April 28, 2015 to identify published, peer-reviewed RCT reports evaluating β-3 adrenergic agonists or muscarinic antagonists in elderly OAB patients (either ≥65 years or study-described as "elderly"). To assess study quality of RCT reports, we focused on internal/external validity, assessed via two scales: the validated Effective Public Health Practice Project [EPHPP]): Quality Assessment Tool for Quantitative Studies, and a tool commissioned by the Agency for Healthcare Research and Quality (AHRQ). Database searches yielded 1380 records that were then screened according to predefined inclusion/exclusion criteria. We included eight papers meeting study criteria. Despite scientific community efforts to improve RCT reporting standards, published reports still include incomplete and inconsistent reporting-of subject attrition, baseline patient characteristics, inclusion/exclusion criteria, and other important details. Only three of the eight OAB RCTs in this review received quality ratings of Strong (EPHPP) or Fair (AHRQ) and were multicenter with large samples. Despite the prevalence of OAB among older age individuals, relatively few RCTs evaluate OAB treatments explicitly among elderly subjects. The findings from this quality assessment suggest some areas for improvement in both conduct and reporting of future RCTs assessing OAB treatment in elderly. © 2017 Wiley Periodicals, Inc.

Quality tools and resources to support organisational improvement integral to high-quality primary care: a systematic review of published and grey literature.

PubMed

Janamian, Tina; Upham, Susan J; Crossland, Lisa; Jackson, Claire L

2016-04-18

To conduct a systematic review of the literature to identify existing online primary care quality improvement tools and resources to support organisational improvement related to the seven elements in the Primary Care Practice Improvement Tool (PC-PIT), with the identified tools and resources to progress to a Delphi study for further assessment of relevance and utility. Systematic review of the international published and grey literature. CINAHL, Embase and PubMed databases were searched in March 2014 for articles published between January 2004 and December 2013. GreyNet International and other relevant websites and repositories were also searched in March-April 2014 for documents dated between 1992 and 2012. All citations were imported into a bibliographic database. Published and unpublished tools and resources were included in the review if they were in English, related to primary care quality improvement and addressed any of the seven PC-PIT elements of a high-performing practice. Tools and resources that met the eligibility criteria were then evaluated for their accessibility, relevance, utility and comprehensiveness using a four-criteria appraisal framework. We used a data extraction template to systematically extract information from eligible tools and resources. A content analysis approach was used to explore the tools and resources and collate relevant information: name of the tool or resource, year and country of development, author, name of the organisation that provided access and its URL, accessibility information or problems, overview of each tool or resource and the quality improvement element(s) it addresses. If available, a copy of the tool or resource was downloaded into the bibliographic database, along with supporting evidence (published or unpublished) on its use in primary care. This systematic review identified 53 tools and resources that can potentially be provided as part of a suite of tools and resources to support primary care practices in improving the quality of their practice, to achieve improved health outcomes.

Pain assessment tools: is the content appropriate for use in palliative care?

PubMed

Hølen, Jacob Chr; Hjermstad, Marianne Jensen; Loge, Jon Håvard; Fayers, Peter M; Caraceni, Augusto; De Conno, Franco; Forbes, Karen; Fürst, Carl Johan; Radbruch, Lukas; Kaasa, Stein

2006-12-01

Inadequate pain assessment prevents optimal treatment in palliative care. The content of pain assessment tools might limit their usefulness for proper pain assessment, but data on the content validity of the tools are scarce. The objective of this study was to examine the content of the existing pain assessment tools, and to evaluate the appropriateness of different dimensions and items for pain assessment in palliative care. A systematic search was performed to find pain assessment tools for patients with advanced cancer who were receiving palliative care. An ad hoc search with broader search criteria supplemented the systematic search. The items of the identified tools were allocated to appropriate dimensions. This was reviewed by an international panel of experts, who also evaluated the relevance of the different dimensions for pain assessment in palliative care. The systematic literature search generated 16 assessment tools while the ad hoc search generated 64. Ten pain dimensions containing 1,011 pain items were identified by the experts. The experts ranked intensity, temporal pattern, treatment and exacerbating/relieving factors, location, and interference with health-related quality of life as the most important dimensions. None of the assessment tools covered these dimensions satisfactorily. Most items were related to interference (231) and intensity (138). Temporal pattern (which includes breakthrough pain), ranked as the second most important dimension, was covered by 29 items only. Many tools include dimensions and items of limited relevance for patients with advanced cancer. This might reduce compliance and threaten the validity of the assessment. New tools should reflect the clinical relevance of different dimensions and be user-friendly.

The risk of bias in systematic reviews tool showed fair reliability and good construct validity.

PubMed

Bühn, Stefanie; Mathes, Tim; Prengel, Peggy; Wegewitz, Uta; Ostermann, Thomas; Robens, Sibylle; Pieper, Dawid

2017-11-01

There is a movement from generic quality checklists toward a more domain-based approach in critical appraisal tools. This study aimed to report on a first experience with the newly developed risk of bias in systematic reviews (ROBIS) tool and compare it with A Measurement Tool to Assess Systematic Reviews (AMSTAR), that is, the most common used tool to assess methodological quality of systematic reviews while assessing validity, reliability, and applicability. Validation study with four reviewers based on 16 systematic reviews in the field of occupational health. Interrater reliability (IRR) of all four raters was highest for domain 2 (Fleiss' kappa κ = 0.56) and lowest for domain 4 (κ = 0.04). For ROBIS, median IRR was κ = 0.52 (range 0.13-0.88) for the experienced pair of raters compared to κ = 0.32 (range 0.12-0.76) for the less experienced pair of raters. The percentage of "yes" scores of each review of ROBIS ratings was strongly correlated with the AMSTAR ratings (r s  = 0.76; P = 0.01). ROBIS has fair reliability and good construct validity to assess the risk of bias in systematic reviews. More validation studies are needed to investigate reliability and applicability, in particular. Copyright © 2017 Elsevier Inc. All rights reserved.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Number of genera as a potential screening tool for assessing quality of bryophyte communities in Ohio wetlands

USGS Publications Warehouse

Schumacher, William; Stapanian, Martin A.; Andreas, Barbara; Gara, Brian

2016-01-01

Bryophytes (mosses, liverworts, and hornworts) have numerous advantages as indicators of environmental quality. A quality assessment index for bryophyte species assemblages (BQAI) was developed for the State of Ohio, USA. Reliable identification of bryophytes to species often requires considerable training, practice, and time. In contrast, reliable identification to genera for most bryophytes in Ohio requires much less training. We identified 110 bryophyte species (14 liverworts and 96 mosses) belonging to 69 genera (13 liverwort and 56 moss) in 45 wetlands (27 emergent, 13 forested, and 5 shrub) in Ohio. As expected, there were more genera and higher BQAI scores in forested than in emergent wetlands. Number of genera was highly correlated (r ≥ 0.9) with BQAI in emergent and forested wetlands and for the combined set of wetlands. Number of genera and BQAI responded almost identically to an index of wetland disturbance. The results suggest that number of genera has potential as a screening tool for assessing bryophyte community quality in wetlands in some regions.

Tracking the quality of care for sick children using lot quality assurance sampling: targeting improvements of health services in Jigawa, Nigeria.

PubMed

Oladele, Edward Adekola; Ormond, Louise; Adeyemi, Olusegun; Patrick, David; Okoh, Festus; Oresanya, Olusola Bukola; Valadez, Joseph J

2012-01-01

In Nigeria, 30% of child deaths are due to malaria. The National Malaria Control Program of Nigeria (NMCP) during 2009 initiated a program to improve the quality of paediatric malaria services delivered in health facilities (HF). This study reports a rapid approach used to assess the existing quality of services in Jigawa state at decentralised levels of the health system. NMCP selected Lot Quality Assurance Sampling (LQAS) to identify the variation in HF service quality among Senatorial Districts (SD). LQAS was selected because it was affordable and could be used by local health workers (HW) in a population-based survey. NMCP applied a 2-stage LQAS using a structured Rapid Health Facility Assessment (R-HFA) tool to identify high and low performing SD for specified indicators. LQAS identified variations in HF performance (n = 21) and enabled resources to be targeted to address priorities. All SD exhibited deficient essential services, supplies and equipment. Only 9.7% of HF had Artemisinin-based Combination Therapies and other first-line treatments for childhood illnesses. No SD and few HF exhibited adequate HW performance for the assessment, treatment or counselling of sick children. Using the IMCI algorithm, 17.5% of HW assessed the child's vaccination status, 46.8% assessed nutritional status, and 65.1% assessed children for dehydration. Only 5.1% of HW treatments were appropriate for the assessment. Exit interviews revealed that 5.1% of caregivers knew their children's illness, and only 19.9% could accurately describe how to administer the prescribed drug. This R-HFA, using LQAS principles, is a rapid, simple tool for assessing malaria services and can be used at scale. It identified technical deficiencies that could be corrected by improved continuing medical education, targeted supervision, and recurrent R-HFA assessments of the quality of services.

Tracking the Quality of Care for Sick Children Using Lot Quality Assurance Sampling: Targeting Improvements of Health Services in Jigawa, Nigeria

PubMed Central

Oladele, Edward Adekola; Ormond, Louise; Adeyemi, Olusegun; Patrick, David; Okoh, Festus; Oresanya, Olusola Bukola; Valadez, Joseph J.

2012-01-01

Background In Nigeria, 30% of child deaths are due to malaria. The National Malaria Control Program of Nigeria (NMCP) during 2009 initiated a program to improve the quality of paediatric malaria services delivered in health facilities (HF). This study reports a rapid approach used to assess the existing quality of services in Jigawa state at decentralised levels of the health system. Methods NMCP selected Lot Quality Assurance Sampling (LQAS) to identify the variation in HF service quality among Senatorial Districts (SD). LQAS was selected because it was affordable and could be used by local health workers (HW) in a population-based survey. NMCP applied a 2-stage LQAS using a structured Rapid Health Facility Assessment (R-HFA) tool to identify high and low performing SD for specified indicators. Findings LQAS identified variations in HF performance (n = 21) and enabled resources to be targeted to address priorities. All SD exhibited deficient essential services, supplies and equipment. Only 9.7% of HF had Artemisinin-based Combination Therapies and other first-line treatments for childhood illnesses. No SD and few HF exhibited adequate HW performance for the assessment, treatment or counselling of sick children. Using the IMCI algorithm, 17.5% of HW assessed the child’s vaccination status, 46.8% assessed nutritional status, and 65.1% assessed children for dehydration. Only 5.1% of HW treatments were appropriate for the assessment. Exit interviews revealed that 5.1% of caregivers knew their children’s illness, and only 19.9% could accurately describe how to administer the prescribed drug. Conclusion This R-HFA, using LQAS principles, is a rapid, simple tool for assessing malaria services and can be used at scale. It identified technical deficiencies that could be corrected by improved continuing medical education, targeted supervision, and recurrent R-HFA assessments of the quality of services. PMID:23028519

Qualichem In Vivo: A Tool for Assessing the Quality of In Vivo Studies and Its Application for Bisphenol A

PubMed Central

Maxim, Laura; van der Sluijs, Jeroen P.

2014-01-01

In regulatory toxicology, quality assessment of in vivo studies is a critical step for assessing chemical risks. It is crucial for preserving public health studies that are considered suitable for regulating chemicals are robust. Current procedures for conducting quality assessments in safety agencies are not structured, clear or consistent. This leaves room for criticism about lack of transparency, subjective influence and the potential for insufficient protection provided by resulting safety standards. We propose a tool called “Qualichem in vivo” that is designed to systematically and transparently assess the quality of in vivo studies used in chemical health risk assessment. We demonstrate its use here with 12 experts, using two controversial studies on Bisphenol A (BPA) that played an important role in BPA regulation in Europe. The results obtained with Qualichem contradict the quality assessments conducted by expert committees in safety agencies for both of these studies. Furthermore, they show that reliance on standardized guidelines to ensure scientific quality is only partially justified. Qualichem allows experts with different disciplinary backgrounds and professional experiences to express their individual and sometimes divergent views—an improvement over the current way of dealing with minority opinions. It provides a transparent framework for expressing an aggregated, multi-expert level of confidence in a study, and allows a simple graphical representation of how well the study integrates the best available scientific knowledge. Qualichem can be used to compare assessments of the same study by different health agencies, increasing transparency and trust in the work of expert committees. In addition, it may be used in systematic evaluation of in vivo studies submitted by industry in the dossiers that are required for compliance with the REACH Regulation. Qualichem provides a balanced, common framework for assessing the quality of studies that may or may not be following standardized guidelines. PMID:24489958

Systematic review of the behavioural assessment of pain in cats.

PubMed

Merola, Isabella; Mills, Daniel S

2016-02-01

The objectives were to review systematically the range of assessment tools used in cats to detect the behavioural expression of pain and the evidence of their quality; and to examine behavioural metrics (considering both the sensory and affective domains) used to assess pain. A search of PubMed and ScienceDirect, alongside articles known to the authors, from 2000 onwards, for papers in English was performed. This was followed by a manual search of the references within the primary data sources. Only peer-reviewed publications that provided information on the assessment tool used to evaluate the behavioural expression of pain in cats, in conscious animals (not anaesthetised cats), were included. No previous systematic reviews were identified. One hundred papers were included in the final assessment. Studies were primarily related to the assessment of pain in relation to surgical procedures, and no clear distinction was made concerning the onset of acute and chronic pain. Ten broad types of instrument to assess pain were identified, and generally the quality of evidence to support the use of the various instruments was poor. Only one specific instrument (UNESP-Botucatu scale) had published evidence of validity, reliability and sensitivity at the level of a randomised control trial, but with a positive rather than placebo control, and limited to its use in the ovariohysterectomy situation. The metrics used within the tools appeared to focus primarily on the sensory aspect of pain, with no study clearly discriminating between the sensory and affective components of pain. Further studies are required to provide a higher quality of evidence for methods used to assess pain in cats. Furthermore, a consistent definition for acute and chronic pain is needed. Tools need to be validated that can detect pain in a range of conditions and by different evaluators (veterinary surgeons and owners), which consider both the sensory and emotional aspects of pain. © ISFM and AAFP 2015.

Testing the Visual Soil Assessment tool on Estonian farm fields

NASA Astrophysics Data System (ADS)

Reintam, Endla; Are, Mihkel; Selge, Are

2017-04-01

Soil quality estimation plays important role in decision making on farm as well on policy level. Sustaining the production ability and good health of the soil the chemical, physical and biological indicators should be taken into account. The system to use soil chemical parameters is usually quite well established in most European counties, including Estonia. However, measuring soil physical properties, such bulk density, porosity, penetration resistance, structural stability ect is time consuming, needs special tools and is highly weather dependent. In that reason these parameters are excluded from controllable quality parameters in policy in Estonia. Within the project "Interactive Soil Quality Assessment in Europe and China for Agricultural Productivity and Environmental Resilience" (iSQAPER) the visual soil assessment (VSA) tool was developed for easy detection of soil quality as well the different soil friendly agricultural management practices (AMP) were detected. The aim of current study was to test the VSA tool on Estonian farm fields under different management practices and compare the results with laboratory measurements. The main focus was set on soil physical parameters. Next to the VSA, the undisturbed soil samples were collected from the depth of 5-10 cm and 25-30 cm. The study revealed that results of a visually assessed soil physical parameters, such a soil structure, soil structural stability, soil porosity, presence of tillage pan, were confirmed by laboratory measurements in most cases. Soil water stable structure measurement on field (on 1 cm2 net in one 1 l box with 4-6 cm air dry clods for 5-10 min) underestimated very well structured soil on grassland and overestimated the structure aggregates stability of compacted soil. The slightly better soil quality was detected under no-tillage compared to ploughed soils. However, the ploughed soil got higher quality points compared with minimum tillage. The slurry application (organic manuring) had controversial impact - it increased the number of earthworms but decreased soil structural stability. Even the manuring with slurry increases organic matter amount in the soil, the compaction due to the use of heavy machinery during the application, especially on wet soil, reduces the positive effect of slurry.

U.S. Geological Survey Combined Well-Bore Flow and Depth-Dependent Water Sampler

USGS Publications Warehouse

Izbicki, John A.; Christensen, Allen H.; Hanson, Randall T.; Martin, Peter; Crawford, Steven M.; Smith, Gregory A.

1999-01-01

The U.S. Geological Survey has developed a combined well-bore flow and depth-dependent sample collection tool. It is suitable for use in existing production wells having limited access and clearances as small as 1 inch. The combination of well-bore flow and depth-dependent water-quality data is especially effective in assessing changes in aquifer properties and water quality with depth. These are direct measures of changes in well yield and ground-water quality with depth under actual operating conditions. Combinations of other geophysical tools capable of making these measurements, such as vertical-axis current meters used with wire-line samplers, are commercially available but these tools are large and can not easily enter existing production wells.

Questioning the application of risk of bias tools in appraising evidence from natural experimental studies: critical reflections on Benton et al., IJBNPA 2016.

PubMed

Humphreys, David K; Panter, Jenna; Ogilvie, David

2017-04-19

We recently read the article by Benton et al. which reviewed risk of bias in natural experimental studies investigating the impact of the built environment on physical activity (Benton et al., 2016; Int J Behav Nutr Phys Act 13:107). As a technical exercise in assessing risk of bias to understand study quality, we found the results of this study both interesting and potentially useful. However, it prompted a number of concerns with the use of risk of bias tools for assessing the quality of evidence from studies exploiting natural experiments. As we discuss in this commentary, the rigid application of such tools could have adverse effects on the uptake and use of natural experiments in population health research and practice.

International recognition of the Chronic Otitis Media Questionnaire 12.

PubMed

Kosyakov, S I; Minavnina, J V; Phillips, J S; Yung, M W

2017-06-01

The Chronic Otitis Media Questionnaire 12 was developed initially in the UK to assess patient-reported health-related quality of life associated with chronic otitis media. This study aimed to determine whether this tool is applicable to the Russian population, which has a materially different healthcare system. A total of 108 patients with different forms of chronic otitis media completed the Russian Chronic Otitis Media Questionnaire 12. The average Russian Chronic Otitis Media Questionnaire 12 score was 19.4 (standard deviation = 8.3). The internal consistency of the Russian Chronic Otitis Media Questionnaire 12 was high, with a Cronbach's alpha value of 0.860. The Russian version of the Chronic Otitis Media Questionnaire 12 was found to be a reliable tool for the assessment of health-related quality of life in patients with chronic otitis media. This sets the scene for international collaboration, using this tool to assess the effectiveness of surgical treatments even amongst countries with different healthcare systems.

[eLearning-radiology.com--sustainability for quality assurance].

PubMed

Ketelsen, D; Talanow, R; Uder, M; Grunewald, M

2009-04-01

The aim of the study was to analyze the availability of published radiological e-learning tools and to establish a solution for quality assurance. Substantial pubmed research was performed to identify radiological e-learning tools. 181 e-learning programs were selected. As examples two databases expanding their programs with external links, Compare (n = 435 external links) and TNT-Radiology (n = 1078 external links), were evaluated. A concept for quality assurance was developed by an international taskforce. At the time of assessment, 56.4 % (102 / 181) of the investigated e-learning tools were accessible at their original URL. A subgroup analysis of programs published 5 to 8 years ago showed significantly inferior availability to programs published 3 to 5 years ago (p < 0.01). The analysis of external links showed 49.2 % and 61.0 % accessible links for the programs Compare (published 2003) and TNT-Radiology (published 2006), respectively. As a consequence, the domain www.eLearning-radiology.com was developed by the taskforce and published online. This tool allows authors to present their programs and users to evaluate the e-learning tools depending on several criteria in order to remove inoperable links and to obtain information about the complexity and quality of the e-learning tools. More than 50 % of investigated radiological e-learning tools on the Internet were not accessible after a period of 5 to 8 years. As a consequence, an independent, international tool for quality assurance was designed and published online under www.eLearning-radiology.com .

Web-based decision support and visualization tools for water quality management in the Chesapeake Bay watershed

USGS Publications Warehouse

Mullinix, C.; Hearn, P.; Zhang, H.; Aguinaldo, J.

2009-01-01

Federal, State, and local water quality managers charged with restoring the Chesapeake Bay ecosystem require tools to maximize the impact of their limited resources. To address this need, the U.S. Geological Survey (USGS) and the Environmental Protection Agency's Chesapeake Bay Program (CBP) are developing a suite of Web-based tools called the Chesapeake Online Assessment Support Toolkit (COAST). The goal of COAST is to help CBP partners identify geographic areas where restoration activities would have the greatest effect, select the appropriate management strategies, and improve coordination and prioritization among partners. As part of the COAST suite of tools focused on environmental restoration, a water quality management visualization component called the Nutrient Yields Mapper (NYM) tool is being developed by USGS. The NYM tool is a web application that uses watershed yield estimates from USGS SPAtially Referenced Regressions On Watershed (SPARROW) attributes model (Schwarz et al., 2006) [6] to allow water quality managers to identify important sources of nitrogen and phosphorous within the Chesapeake Bay watershed. The NYM tool utilizes new open source technologies that have become popular in geospatial web development, including components such as OpenLayers and GeoServer. This paper presents examples of water quality data analysis based on nutrient type, source, yield, and area of interest using the NYM tool for the Chesapeake Bay watershed. In addition, we describe examples of map-based techniques for identifying high and low nutrient yield areas; web map engines; and data visualization and data management techniques.

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Quality of Life Perceptions and Directions for Urban Regeneration in Hong Kong

ERIC Educational Resources Information Center

Ng, Mee Kam

2005-01-01

Urban regeneration can be an effective tool to promote sustainability and enhance macro-level quality of life if the principles of encouraging participation, building community character, advancing equity, improving environment and enlivening the economy are observed. Through the assessment of various quality of life indicators related to these…

Managing Change to a Quality Philosophy: A Partnership Perspective.

ERIC Educational Resources Information Center

Snyder, Karolyn J.; Acker-Hocevar, Michele

Within the past 5 years there has been an international movement to adapt the principles and practices of Total Quality Management work environments to school-restructuring agendas. This paper reports on the development of a model called the Educational Quality System, a benchmark assessment tool for identifying the essential elements of quality…

Minnesota 4-H Youth Program Quality Improvement Model

ERIC Educational Resources Information Center

Herman, Margo; Grant, Samantha

2015-01-01

The University of Minnesota Extension Center for Youth Development made an organizational decision in 2011 to invest in a system-wide approach to implement youth program quality into the 4-H program using the Youth Program Quality Assessment (YPQA) tool. This article describes the four key components to the Minnesota Youth Program Quality…

A Database and Tool for Boundary Conditions for Regional Air Quality Modeling: Description and Evaluation

EPA Science Inventory

Transported air pollutants receive increasing attention as regulations tighten and global concentrations increase. The need to represent international transport in regional air quality assessments requires improved representation of boundary concentrations. Currently available ob...

Assess So You Can Address Indoor Air Quality in Your School – Use EPA’s New IAQ School Assessment Mobile App

EPA Pesticide Factsheets

Provides overview of Assessing IAQ by downloading EPA's School Assessment Mobile App. “One-stop shop” for accessing guidance from EPA’s IAQ Tools for Schools Action Kit with proven strategies for specifically addressing important IAQ issues.

Quality and safety in pediatric anesthesia.

PubMed

Varughese, Anna M; Rampersad, Sally E; Whitney, Gina M; Flick, Randall P; Anton, Blair; Heitmiller, Eugenie S

2013-12-01

Health care quality and value are leading issues in medicine today for patients, health care professionals, and policy makers. Outcome, safety, and service-the components of quality-have been used to define value when placed in the context of cost. Health care organizations and professionals are faced with the challenge of improving quality while reducing health care related costs to improve value. Measurement of quality is essential for assessing what is effective and what is not when working toward improving quality and value. However, there are few tools currently for assessing quality of care, and clinicians often lack the resources and skills required to conduct quality improvement work. In this article, we provide a brief review of quality improvement as a discipline and describe these efforts within pediatric anesthesiology.

Does the use of the revised psychosocial assessment tool (PATrev) result in improved quality of life and reduced psychosocial risk in Canadian families with a child newly diagnosed with cancer?

PubMed

Barrera, M; Hancock, K; Rokeach, A; Atenafu, E; Cataudella, D; Punnett, A; Johnston, D; Cassidy, M; Zelcer, S; Silva, M; Jansen, P; Bartels, U; Nathan, P C; Shama, W; Greenberg, C

2014-02-01

Early psychosocial screening may guide interventions and ameliorate the adverse psychosocial effects of childhood cancer. The revised psychosocial assessment tool provides risk information - Universal (typical distress), Targeted (additional specific distress), and Clinical (severe distress) - about the child with cancer and his or her family. This pilot study investigated the benefits of providing a summary of family psychosocial risk information to the medical team treating the newly diagnosed child (Experimental Group, EG). We conducted a pilot randomized control trial with a sample of 67 parents, comparing the EG to the control group (CG) on parental perception of family psychosocial difficulties (revised psychosocial assessment tool risk levels), child behavior (behavior assessment scale for children-2), pediatric quality of life (PedsQL), and parental anxiety (state-anxiety scale of the state-trait anxiety inventory ), 2-4 weeks after diagnosis (Time 1) and 6 months later (Time 2). Compared to the CG, participants in the EG had significantly reduced targeted and clinical risk (p < 0.001), and improved pain related PedsQL at Time 2 (p < 0.05). Scores for PedsQL total and nearly all subscales improved over time in both groups (p < 0.05 to p < 0.001). No changes in behavior scores were noted. Preliminary findings suggest that providing a summary of the Psychosocial Assessment Tool to the treating team shortly after diagnosis may help reduce family wide psychosocial risk 6 months later and improve quality of life related to pain for children who are undergoing treatment for cancer. Copyright © 2013 John Wiley & Sons, Ltd.

Pictorial representation of illness and self measure (PRISM): an effective tool to assess the burden of psoriasis.

PubMed

Fotiou, K; Hofmann, M; Kaufmann, R; Thaci, D

2015-12-01

Psoriasis has a negative impact on patient's' quality of life, which may reflect the physical and psychosocial impact of the disease. However, little is known about the perceived burden of disease. Pictorial Representation of Illness and Self Measure (PRISM), a pictorial tool, was developed to measure this global suffering. Capturing quality of life impairments in psoriasis is an integral part of assessing the overall disease severity and planning effective treatment strategies. To validate Pictorial Representation of Illness and Self Measure (PRISM) in psoriasis patients. An investigator initiated, prospective cohort study was performed in 108 outpatients with psoriasis to validate PRISM as an appropriate tool; Reliability was assessed in a cohort with controlled stable disease, repeated after 1 hour and after a 3-month follow-up phase; Convergent validity determined by correlation against measures of life quality (DLQI) and reported severity of psoriasis (PASI, PGA and BSA) was performed. For PRISM, we found a high reliability for short-term measurements (ICC = 0.98, P < 0.001) and for follow-up assessments at 3 months (ICC = 0.76, P < 0.001). Our investigation showed significant differences between patients with clear to minimal (PGA 0, 1), mild (PGA 2) and moderate-to-severe disease (PGA 3, 4) and significant (P < 0.001) correlation with DLQI, PGA, PASI and BSA (ρ = -0.62, -0.54, -0.44 and -0.39 respectively). PRISM is a highly reliable tool and new approach to assess perceived burden of patients with psoriasis. It is easy to use and we recommend the application as an additional outcome measure in clinical trial settings. © 2015 European Academy of Dermatology and Venereology.

[The National Database of the Regional Collaborative Rheumatic Centers as a tool for clinical epidemiology and quality assessment in rheumatology].

PubMed

Zink, Angela; Huscher, Dörte; Listing, Joachim

2003-01-01

The national database of the German Collaborative Arthritis Centres is a well-established tool for the observation and assessment of health care delivery to patients with rheumatic diseases in Germany. The discussion of variations in treatment practices contributes to the internal quality assessment in the participating arthritis centres. This documentation has shown deficits in primary health care including late referral to a rheumatologist, undertreatment with disease-modifying drugs and complementary therapies. In rheumatology, there is a trend towards early, intensive medical treatment including combination therapy. The frequency and length of inpatient hospital and rehabilitation treatments is decreasing, while active physiotherapy in outpatient care has been increased. Specific deficits have been identified concerning the provision of occupational therapy services and patient education.

Computerized Decision Aids for Shared Decision Making in Serious Illness: Systematic Review.

PubMed

Staszewska, Anna; Zaki, Pearl; Lee, Joon

2017-10-06

Shared decision making (SDM) is important in achieving patient-centered care. SDM tools such as decision aids are intended to inform the patient. When used to assist in decision making between treatments, decision aids have been shown to reduce decisional conflict, increase ease of decision making, and increase modification of previous decisions. The purpose of this systematic review is to assess the impact of computerized decision aids on patient-centered outcomes related to SDM for seriously ill patients. PubMed and Scopus databases were searched to identify randomized controlled trials (RCTs) that assessed the impact of computerized decision aids on patient-centered outcomes and SDM in serious illness. Six RCTs were identified and data were extracted on study population, design, and results. Risk of bias was assessed by a modified Cochrane Risk of Bias Tool for Quality Assessment of Randomized Controlled Trials. Six RCTs tested decision tools in varying serious illnesses. Three studies compared different computerized decision aids against each other and a control. All but one study demonstrated improvement in at least one patient-centered outcome. Computerized decision tools may reduce unnecessary treatment in patients with low disease severity in comparison with informational pamphlets. Additionally, electronic health record (EHR) portals may provide the opportunity to manage care from the home for individuals affected by illness. The quality of decision aids is of great importance. Furthermore, satisfaction with the use of tools is associated with increased patient satisfaction and reduced decisional conflict. Finally, patients may benefit from computerized decision tools without the need for increased physician involvement. Most computerized decision aids improved at least one patient-centered outcome. All RCTs identified were at a High Risk of Bias or Unclear Risk of Bias. Effort should be made to improve the quality of RCTs testing SDM aids in serious illness. ©Anna Staszewska, Pearl Zaki, Joon Lee. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 06.10.2017.

Communication Tools for End-of-Life Decision-Making in Ambulatory Care Settings: A Systematic Review and Meta-Analysis.

PubMed

Oczkowski, Simon J; Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J

2016-01-01

Patients with serious illness, and their families, state that better communication and decision-making with healthcare providers is a high priority to improve the quality of end-of-life care. Numerous communication tools to assist patients, family members, and clinicians in end-of-life decision-making have been published, but their effectiveness remains unclear. To determine, amongst adults in ambulatory care settings, the effect of structured communication tools for end-of-life decision-making on completion of advance care planning. We searched for relevant randomized controlled trials (RCTs) or non-randomized intervention studies in MEDLINE, EMBASE, CINAHL, ERIC, and the Cochrane Database of Randomized Controlled Trials from database inception until July 2014. Two reviewers independently screened articles for eligibility, extracted data, and assessed risk of bias. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was used to evaluate the quality of evidence for each of the primary and secondary outcomes. Sixty-seven studies, including 46 RCTs, were found. The majority evaluated communication tools in older patients (age >50) with no specific medical condition, but many specifically evaluated populations with cancer, lung, heart, neurologic, or renal disease. Most studies compared the use of communication tools against usual care, but several compared the tools to less-intensive advance care planning tools. The use of structured communication tools increased: the frequency of advance care planning discussions/discussions about advance directives (RR 2.31, 95% CI 1.25-4.26, p = 0.007, low quality evidence) and the completion of advance directives (ADs) (RR 1.92, 95% CI 1.43-2.59, p<0.001, low quality evidence); concordance between AD preferences and subsequent medical orders for use or non-use of life supporting treatment (RR 1.19, 95% CI 1.01-1.39, p = 0.028, very low quality evidence, 1 observational study); and concordance between the care desired and care received by patients (RR 1.17, 95% CI 1.05-1.30, p = 0.004, low quality evidence, 2 RCTs). The use of structured communication tools may increase the frequency of discussions about and completion of advance directives, and concordance between the care desired and the care received by patients. The use of structured communication tools rather than an ad-hoc approach to end-of-life decision-making should be considered, and the selection and implementation of such tools should be tailored to address local needs and context. PROSPERO CRD42014012913.

Communication Tools for End-of-Life Decision-Making in Ambulatory Care Settings: A Systematic Review and Meta-Analysis

PubMed Central

Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J.

2016-01-01

Background Patients with serious illness, and their families, state that better communication and decision-making with healthcare providers is a high priority to improve the quality of end-of-life care. Numerous communication tools to assist patients, family members, and clinicians in end-of-life decision-making have been published, but their effectiveness remains unclear. Objectives To determine, amongst adults in ambulatory care settings, the effect of structured communication tools for end-of-life decision-making on completion of advance care planning. Methods We searched for relevant randomized controlled trials (RCTs) or non-randomized intervention studies in MEDLINE, EMBASE, CINAHL, ERIC, and the Cochrane Database of Randomized Controlled Trials from database inception until July 2014. Two reviewers independently screened articles for eligibility, extracted data, and assessed risk of bias. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was used to evaluate the quality of evidence for each of the primary and secondary outcomes. Results Sixty-seven studies, including 46 RCTs, were found. The majority evaluated communication tools in older patients (age >50) with no specific medical condition, but many specifically evaluated populations with cancer, lung, heart, neurologic, or renal disease. Most studies compared the use of communication tools against usual care, but several compared the tools to less-intensive advance care planning tools. The use of structured communication tools increased: the frequency of advance care planning discussions/discussions about advance directives (RR 2.31, 95% CI 1.25–4.26, p = 0.007, low quality evidence) and the completion of advance directives (ADs) (RR 1.92, 95% CI 1.43–2.59, p<0.001, low quality evidence); concordance between AD preferences and subsequent medical orders for use or non-use of life supporting treatment (RR 1.19, 95% CI 1.01–1.39, p = 0.028, very low quality evidence, 1 observational study); and concordance between the care desired and care received by patients (RR 1.17, 95% CI 1.05–1.30, p = 0.004, low quality evidence, 2 RCTs). Conclusions The use of structured communication tools may increase the frequency of discussions about and completion of advance directives, and concordance between the care desired and the care received by patients. The use of structured communication tools rather than an ad-hoc approach to end-of-life decision-making should be considered, and the selection and implementation of such tools should be tailored to address local needs and context. Registration PROSPERO CRD42014012913 PMID:27119571

Developing a multidisciplinary robotic surgery quality assessment program.

PubMed

Gonsenhauser, Iahn; Abaza, Ronney; Mekhjian, Hagop; Moffatt-Bruce, Susan D

2012-01-01

The objective of this study was to test the feasibility of a novel quality-improvement (QI) program designed to incorporate multiple robotic surgical sub-specialties in one health care system. A robotic surgery quality assessment program was developed by The Ohio State University College of Medicine (OSUMC) in conjunction with The Ohio State University Medical Center Quality Improvement and Operations Department. A retrospective review of cases was performed using data interrogated from the OSUMC Information Warehouse from January 2007 through August 2009. Robotic surgery cases (n=2200) were assessed for operative times, length of stay (LOS), conversions, returns to surgery, readmissions and cancellations as potential quality indicators. An actionable and reproducible framework for the quality measurement and assessment of a multidisciplinary and interdepartmental robotic surgery program was successfully completed demonstrating areas for improvement opportunities. This report supports that standard quality indicators can be applied to multiple specialties within a health care system to develop a useful quality tracking and assessment tool in the highly specialized area of robotic surgery. © 2012 National Association for Healthcare Quality.

Quality of patient health information on the Internet: reviewing a complex and evolving landscape.

PubMed

Fahy, Eamonn; Hardikar, Rohan; Fox, Adrian; Mackay, Sean

2014-01-01

The popularity of the Internet has enabled unprecedented access to health information. As a largely unregulated source, there is potential for inconsistency in the quality of information that reaches the patient. To review the literature relating to the quality indicators of health information for patients on the Internet. A search of English language literature was conducted using PubMed, Google Scholar and EMBASE databases. Many articles have been published which assess the quality of information relating to specific medical conditions. Indicators of quality have been defined in an attempt to predict higher quality health information on the Internet. Quality evaluation tools are scoring systems based on indicators of quality. Established tools such as the HONcode may help patients navigate to more reliable information. Google and Wikipedia are important emerging sources of patient health information. The Internet is crucial for modern dissemination of health information, but it is clear that quality varies significantly between sources. Quality indicators for web-information have been developed but there is no agreed standard yet. We envisage that reliable rating tools, effective search engine ranking and progress in crowd-edited websites will enhance patient access to health information on the Internet.

The Microbial Fecal Indicator Paradigm: Tools in the Toolbox Applications in Recreational Waters

EPA Science Inventory

Summary of ORD’s recent research to develop tools for assessing microbial water quality in recreational waters. Methods discussed include the development of health associations between microbial fecal indicators and the development of culture, and molecular methods for fec...

Emerging developments in the standardized chemical characterization of indoor air quality.

PubMed

Nehr, Sascha; Hösen, Elisabeth; Tanabe, Shin-Ichi

2017-01-01

Despite the fact that the special characteristics of indoor air pollution make closed environments quite different from outdoor environments, the conceptual ideas for assessing air quality indoors and outdoors are similar. Therefore, the elaboration of International Standards for air quality characterization in view of controlling indoor air quality should resort to this common basis. In this short review we describe the possibilities of standardization of tools dedicated to indoor air quality characterization with a focus on the tools permitting to study the indoor air chemistry. The link between indoor exposure and health as well as the critical processes driving the indoor air quality are introduced. Available International Standards for the assessment of indoor air quality are depicted. The standards comprise requirements for the sampling on site, the analytical procedures, and the determination of material emissions. To date, these standardized procedures assure that indoor air, settled dust and material samples are analyzed in a comparable manner. However, existing International Standards exclusively specify conventional, event-driven target-screening using discontinuous measurement methods for long-lived pollutants. Therefore, this review draws a parallel between physico-chemical processes in indoor and outdoor environments. The achievements in atmospheric sciences also improve our understanding of indoor environments. The community of atmospheric scientists can be both ideal and supporter for researchers in the area of indoor air quality characterization. This short review concludes with propositions for future standardization activities for the chemical characterization of indoor air quality. Future standardization efforts should focus on: (i) the elaboration of standardized measurement methods and measurement strategies for online monitoring of long-lived and short-lived pollutants, (ii) the assessment of the potential and the limitations of non-target screening, (iii) the paradigm shift from event-driven investigations to systematic approaches to characterize indoor environments, and (iv) the development of tools for policy implementation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Demonstration of the Health Literacy Universal Precautions Toolkit

PubMed Central

Mabachi, Natabhona M.; Cifuentes, Maribel; Barnard, Juliana; Brega, Angela G.; Albright, Karen; Weiss, Barry D.; Brach, Cindy; West, David

2016-01-01

The Agency for Healthcare Research and Quality Health Literacy Universal Precautions Toolkit was developed to help primary care practices assess and make changes to improve communication with and support for patients. Twelve diverse primary care practices implemented assigned tools over a 6-month period. Qualitative results revealed challenges practices experienced during implementation, including competing demands, bureaucratic hurdles, technological challenges, limited quality improvement experience, and limited leadership support. Practices used the Toolkit flexibly and recognized the efficiencies of implementing tools in tandem and in coordination with other quality improvement initiatives. Practices recommended reducing Toolkit density and making specific refinements. PMID:27232681

Achieving Workplace Health through Application of Wellness Strategies

NASA Technical Reports Server (NTRS)

Robinson, Judith L.

2008-01-01

Purpose: 1) Understand and measure JSC workplace health: a) levels, sources, indicators & effects of negative, work-related stress; b) define leading indicators of emerging issues. 2 Provide linkage to outcomes: a) Focus application of wellness strategies & HR tools; b) Increase quality of work life and productivity. 3) Current effort will result in: a) Online assessment tool; b) Assessment of total JSC population (civil service & contractors); c) Application of mitigation tools and strategies. 4) Product of the JSC Employee Wellness Program. 5) Collaboration with Corporate Health Improvement Program/University of Arizona.

Measuring diet in the 21st century: use of new technologies.

PubMed

Cade, Janet E

2017-08-01

The advent of the internet and smartphone technology has allowed dietary assessment to reach the 21st century! The variety of foods available on the supermarket shelf is now greater than ever before. New approaches to measuring diet may help to reduce measurement error and advance our understanding of nutritional determinants of disease. This advance provides the potential to capture detailed dietary data on large numbers of individuals without the need for costly and time-consuming manual nutrition coding. This aim of the present paper is to review the need for new technologies to measure diet with an overview of tools available. The three main areas will be addressed: (1) development of web-based tools to measure diet; (2) use of smartphone apps to self-monitor diet; (3) improving the quality of dietary assessment through development of an online library of tools. A practical example of the development of a web-based tool to assess diet myfood24 (www.myfood24.org) will be given exploring its potential, limitations and challenges. The development of a new food composition database using back-of-pack information will be described. Smartphone apps used to measure diet with a focus on obesity will be reviewed. Many apps are unreliable in terms of tracking, and most are not evaluated. Accurate and consistent measurement of diet is needed for public health and epidemiology. The choice of the most appropriate dietary assessment method tends to rely on experience. The DIET@NET partnership has developed best practice guidelines for selection of dietary assessment tools, which aim to improve the quality, consistency and comparability of dietary data. These developments provide us with a step-change in our ability to reliably characterise food and nutrient intake in population studies. The need for high-quality, validated systems will be important to fully realise the benefits of new technologies.

Adaptation of the Quality Indicator for Rehabilitative Care (QuIRC) for use in mental health supported accommodation services (QuIRC-SA).

PubMed

Killaspy, Helen; White, Sarah; Dowling, Sarah; Krotofil, Joanna; McPherson, Peter; Sandhu, Sima; Arbuthnott, Maurice; Curtis, Sarah; Leavey, Gerard; Priebe, Stefan; Shepherd, Geoff; King, Michael

2016-04-14

No standardised tools for assessing the quality of specialist mental health supported accommodation services exist. To address this, we adapted the Quality Indicator for Rehabilitative care-QuIRC-that was originally developed to assess the quality of longer term inpatient and community based mental health facilities. The QuIRC, which is completed by the service manager and gives ratings of seven domains of care, has good psychometric properties. Focus groups with staff of the three main types of supported accommodation in the UK (residential care, supported housing and floating outreach services) were carried out to identify potential amendments to the QuIRC. Additional advice was gained from consultation with three expert panels, two of which comprised service users with lived experience of mental health and supported accommodation services. The amended QuIRC (QuIRC-SA) was piloted with a manager of each of the three service types. Item response variance, inter-rater reliability and internal consistency were assessed in a random sample of 52 services. Factorial structure and discriminant validity were assessed in a larger random sample of 87 services. The QuIRC-SA comprised 143 items of which only 18 items showed a narrow range of response and five items had poor inter-rater reliability. The tool showed good discriminant validity, with supported housing services generally scoring higher than the other two types of supported accommodation on most domains. Exploratory factor analysis showed that the QuIRC-SA items loaded onto the domains to which they had been allocated. The QuIRC-SA is the first standardised tool for quality assessment of specialist mental health supported accommodation services. Its psychometric properties mean that it has potential for use in research as well as audit and quality improvement programmes. A web based application is being developed to make it more accessible which will produce a printable report for the service manager about the performance of their service, comparison data for similar services and suggestions on how to improve service quality.

Quality Assessment of Collection 6 MODIS Atmospheric Science Products

NASA Astrophysics Data System (ADS)

Manoharan, V. S.; Ridgway, B.; Platnick, S. E.; Devadiga, S.; Mauoka, E.

2015-12-01

Since the launch of the NASA Terra and Aqua satellites in December 1999 and May 2002, respectively, atmosphere and land data acquired by the MODIS (Moderate Resolution Imaging Spectroradiometer) sensor on-board these satellites have been reprocessed five times at the MODAPS (MODIS Adaptive Processing System) located at NASA GSFC. The global land and atmosphere products use science algorithms developed by the NASA MODIS science team investigators. MODAPS completed Collection 6 reprocessing of MODIS Atmosphere science data products in April 2015 and is currently generating the Collection 6 products using the latest version of the science algorithms. This reprocessing has generated one of the longest time series of consistent data records for understanding cloud, aerosol, and other constituents in the earth's atmosphere. It is important to carefully evaluate and assess the quality of this data and remove any artifacts to maintain a useful climate data record. Quality Assessment (QA) is an integral part of the processing chain at MODAPS. This presentation will describe the QA approaches and tools adopted by the MODIS Land/Atmosphere Operational Product Evaluation (LDOPE) team to assess the quality of MODIS operational Atmospheric products produced at MODAPS. Some of the tools include global high resolution images, time series analysis and statistical QA metrics. The new high resolution global browse images with pan and zoom have provided the ability to perform QA of products in real time through synoptic QA on the web. This global browse generation has been useful in identifying production error, data loss, and data quality issues from calibration error, geolocation error and algorithm performance. A time series analysis for various science datasets in the Level-3 monthly product was recently developed for assessing any long term drifts in the data arising from instrument errors or other artifacts. This presentation will describe and discuss some test cases from the recently processed C6 products. We will also describe the various tools and approaches developed to verify and assess the algorithm changes implemented by the science team to address known issues in the products and improve the quality of the products.

A method for the design and development of medical or health care information websites to optimize search engine results page rankings on Google.

PubMed

Dunne, Suzanne; Cummins, Niamh Maria; Hannigan, Ailish; Shannon, Bill; Dunne, Colum; Cullen, Walter

2013-08-27

The Internet is a widely used source of information for patients searching for medical/health care information. While many studies have assessed existing medical/health care information on the Internet, relatively few have examined methods for design and delivery of such websites, particularly those aimed at the general public. This study describes a method of evaluating material for new medical/health care websites, or for assessing those already in existence, which is correlated with higher rankings on Google's Search Engine Results Pages (SERPs). A website quality assessment (WQA) tool was developed using criteria related to the quality of the information to be contained in the website in addition to an assessment of the readability of the text. This was retrospectively applied to assess existing websites that provide information about generic medicines. The reproducibility of the WQA tool and its predictive validity were assessed in this study. The WQA tool demonstrated very high reproducibility (intraclass correlation coefficient=0.95) between 2 independent users. A moderate to strong correlation was found between WQA scores and rankings on Google SERPs. Analogous correlations were seen between rankings and readability of websites as determined by Flesch Reading Ease and Flesch-Kincaid Grade Level scores. The use of the WQA tool developed in this study is recommended as part of the design phase of a medical or health care information provision website, along with assessment of readability of the material to be used. This may ensure that the website performs better on Google searches. The tool can also be used retrospectively to make improvements to existing websites, thus, potentially enabling better Google search result positions without incurring the costs associated with Search Engine Optimization (SEO) professionals or paid promotion.

Case study applications of the BASINS climate assessment tool (CAT)

EPA Science Inventory

This EPA report will illustrate the application of different climate assessment capabilities within EPA’s BASINS modeling system for assessing a range of potential questions about the effects of climate change on streamflow and water quality in different watershed settings and us...

OC35 - Child Friendly Healthcare Initiative, implementation project in a paediatric department in Greece.

PubMed

Boutopoulou, Barbara; Clarke, Andrew; Christothanopoulou, Ioanna; Douros, Konstantinos; Tsirouda, Maria; Papaevangelou, Vasiliki

2016-05-09

Theme: Accreditation and quality improvement. Child Friendly Healthcare Initiative (CFHI) aims to improve quality of experience and health care given to children and families by improving realisation of children's rights and reducing unnecessary fear, anxiety and suffering during and because of health care. To present results of preliminary CFH assessment. Implementation was initiated in a paediatric department of a University Hospital in Athens, Greece, consisting of a 37-bed ward, Outpatient Clinic and Emergency Department. For the preliminary assessment of the CFHI tool No1, which is for parents-caregiverschildren and health workers, this was translated into Greek. 112 parents-caregivers and six children were interviewed by an independent interviewer. In total, 24 health workers - 5 paediatricians, 11 residents and 8 nurses - responded to the CFHI tool No 1. Issues highlighted were mostly about CFH Standard 3 and Standard 7. Suggestions for improvement in all Standards were suggested. Preliminary assessment revealed the quality of care needs improvement. The next step is the training health workers, planning and making improvements.

Improving Health Care Quality and Patient Safety Through Peer-to-Peer Assessment: Demonstration Project in Two Academic Medical Centers.

PubMed

Mort, Elizabeth; Bruckel, Jeffrey; Donelan, Karen; Paine, Lori; Rosen, Michael; Thompson, David; Weaver, Sallie; Yagoda, Daniel; Pronovost, Peter

Despite decades of investment in patient safety, unintentional patient harm remains a major challenge in the health care industry. Peer-to-peer assessment in the nuclear industry has been shown to reduce harm. The study team's goal was to pilot and assess the feasibility of this approach in health care. The team developed tools and piloted a peer-to-peer assessment at 2 academic hospitals: Massachusetts General Hospital and Johns Hopkins Hospital. The assessment evaluated both the institutions' organizational approach to quality and safety as well as their approach to reducing 2 specific areas of patient harm. Site visits were completed and consisted of semistructured interviews with institutional leaders and clinical staff as well as direct patient observations using audit tools. Reports with recommendations were well received and each institution has developed improvement plans. The study team believes that peer-to-peer assessment in health care has promise and warrants consideration for wider adoption.

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

Development of an Ergonomics Checklist for Investigation of Work-Related Whole-Body Disorders in Farming - AWBA: Agricultural Whole-Body Assessment.

PubMed

Kong, Y K; Lee, S J; Lee, K S; Kim, G R; Kim, D M

2015-10-01

Researchers have been using various ergonomic tools to study occupational musculoskeletal diseases in industrial contexts. However, in agricultural work, where the work environment is poorer and the socio-psychological stress is high due to the high labor intensities of the industry, current research efforts have been scarce, and the number of available tools is small. In our preliminary studies, which focused on a limited number of body parts and other working elements, we developed separate evaluation tools for the upper and lower extremities. The current study was conducted to develop a whole-body ergonomic assessment tool for agricultural work that integrates the existing assessment tools for lower and upper extremities developed in the preliminary studies and to verify the relevance of the integrated assessment tool. To verify the relevance of the Agricultural Whole-Body Assessment (AWBA) tool, we selected 50 different postures that occur frequently in agricultural work. Our results showed that the AWBA-determined risk levels were similar to the subjective risk levels determined by experts. In addition, as the risk level increased, the average risk level increased to a similar extent. Moreover, the differences in risk levels between the AWBA and expert assessments were mostly smaller than the differences in risk levels between other assessment tools and the expert assessments in this study. In conclusion, the AWBA tool developed in this study was demonstrated to be appropriate for use as a tool for assessing various postures commonly assumed in agricultural work. Moreover, we believe that our verification of the assessment tools will contribute to the enhancement of the quality of activities designed to prevent and control work-related musculoskeletal diseases in other industries.

The Three-item ALERT-B Questionnaire Provides a Validated Screening Tool to Detect Chronic Gastrointestinal Symptoms after Pelvic Radiotherapy in Cancer Survivors.

PubMed

Taylor, S; Byrne, A; Adams, R; Turner, J; Hanna, L; Staffurth, J; Farnell, D; Sivell, S; Nelson, A; Green, J

2016-10-01

Although pelvic radiotherapy is an effective treatment for various malignancies, around half of patients develop significant gastrointestinal problems. These symptoms often remain undetected, despite the existence of effective treatments. This study developed and refined a simple screening tool to detect common gastrointestinal symptoms in outpatient clinics. These symptoms have a significant effect on quality of life. This tool will increase detection rates and so enable access to specialist gastroenterologists, which will in turn lead to improved symptom control and quality of life after treatment. A literature review and expert consensus meeting identified four items for the ALERT-B (Assessment of Late Effects of RadioTherapy - Bowel) screening tool. ALERT-B was face tested for its usability and acceptability using cognitive interviews with 12 patients experiencing late gastrointestinal symptoms after pelvic radiotherapy. Thematic analysis and probe category were used to analyse interview transcripts. Interview data were presented to a group of experts to agree on the final content and format of the tool. ALERT-B was assessed for reliability and tested for validity against the Gastrointestinal Symptom Rating Scale in a clinical study (EAGLE). Overall, the tool was found to be acceptable in terms of wording, response format and completion time. Participant-reported experiences, including lifestyle modifications and the psychological effect of the symptoms, led to further modifications of the tool. The refined tool includes three questions covering rectal bleeding, incontinence, nocturnal bowel movements and impact on quality of life, including mood, relationships and socialising. ALERT-B was successfully validated against the Gastrointestinal Symptom Rating Scale in the EAGLE study with the tool shown broadly to be internally consistent (Cronbach's α = 0.61 and all item-subscale correlation [Spearman] coefficients are > 0.6). The ALERT-B screening tool can be used in clinical practice to improve post-treatment supportive care by triggering the clinical assessment of patients suitable for referral to a gastroenterologist. Copyright © 2016 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Hamel, Candyce; Wells, George A; Bouter, Lex M; Kristjansson, Elizabeth; Grimshaw, Jeremy; Henry, David A; Boers, Maarten

2009-10-01

Our purpose was to measure the agreement, reliability, construct validity, and feasibility of a measurement tool to assess systematic reviews (AMSTAR). We randomly selected 30 systematic reviews from a database. Each was assessed by two reviewers using: (1) the enhanced quality assessment questionnaire (Overview of Quality Assessment Questionnaire [OQAQ]); (2) Sacks' instrument; and (3) our newly developed measurement tool (AMSTAR). We report on reliability (interobserver kappas of the 11 AMSTAR items), intraclass correlation coefficients (ICCs) of the sum scores, construct validity (ICCs of the sum scores of AMSTAR compared with those of other instruments), and completion times. The interrater agreement of the individual items of AMSTAR was substantial with a mean kappa of 0.70 (95% confidence interval [CI]: 0.57, 0.83) (range: 0.38-1.0). Kappas recorded for the other instruments were 0.63 (95% CI: 0.38, 0.78) for enhanced OQAQ and 0.40 (95% CI: 0.29, 0.50) for the Sacks' instrument. The ICC of the total score for AMSTAR was 0.84 (95% CI: 0.65, 0.92) compared with 0.91 (95% CI: 0.82, 0.96) for OQAQ and 0.86 (95% CI: 0.71, 0.94) for the Sacks' instrument. AMSTAR proved easy to apply, each review taking about 15 minutes to complete. AMSTAR has good agreement, reliability, construct validity, and feasibility. These findings need confirmation by a broader range of assessors and a more diverse range of reviews.

Enhancing wind erosion monitoring and assessment for U.S. rangelands

USGS Publications Warehouse

Webb, Nicholas P.; Van Zee, Justin W.; Karl, Jason W.; Herrick, Jeffrey E.; Courtright, Ericha M.; Billings, Benjamin J.; Boyd, Robert C.; Chappell, Adrian; Duniway, Michael C.; Derner, Justin D.; Hand, Jenny L.; Kachergis, Emily; McCord, Sarah E.; Newingham, Beth A.; Pierson, Frederick B.; Steiner, Jean L.; Tatarko, John; Tedela, Negussie H.; Toledo, David; Van Pelt, R. Scott

2017-01-01

On the GroundWind erosion is a major resource concern for rangeland managers because it can impact soil health, ecosystem structure and function, hydrologic processes, agricultural production, and air quality.Despite its significance, little is known about which landscapes are eroding, by how much, and when.The National Wind Erosion Research Network was established in 2014 to develop tools for monitoring and assessing wind erosion and dust emissions across the United States.The Network, currently consisting of 13 sites, creates opportunities to enhance existing rangeland soil, vegetation, and air quality monitoring programs.Decision-support tools developed by the Network will improve the prediction and management of wind erosion across rangeland ecosystems.

Federal Workforce Quality: Measurement and Improvement

DTIC Science & Technology

1992-08-01

explicit standards of production and service quality . Assessment Tools 4 OPM should institutionalize its data collection program of longitudinal research...include data about quirements, should set explicit standards of various aspects of the model. That is, the production and service quality . effort...are the immediate consumers service quality are possible. of the products and services delivered, and still others in the larger society who have no

Sigma metrics as a tool for evaluating the performance of internal quality control in a clinical chemistry laboratory.

PubMed

Kumar, B Vinodh; Mohan, Thuthi

2018-01-01

Six Sigma is one of the most popular quality management system tools employed for process improvement. The Six Sigma methods are usually applied when the outcome of the process can be measured. This study was done to assess the performance of individual biochemical parameters on a Sigma Scale by calculating the sigma metrics for individual parameters and to follow the Westgard guidelines for appropriate Westgard rules and levels of internal quality control (IQC) that needs to be processed to improve target analyte performance based on the sigma metrics. This is a retrospective study, and data required for the study were extracted between July 2015 and June 2016 from a Secondary Care Government Hospital, Chennai. The data obtained for the study are IQC - coefficient of variation percentage and External Quality Assurance Scheme (EQAS) - Bias% for 16 biochemical parameters. For the level 1 IQC, four analytes (alkaline phosphatase, magnesium, triglyceride, and high-density lipoprotein-cholesterol) showed an ideal performance of ≥6 sigma level, five analytes (urea, total bilirubin, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level and for level 2 IQCs, same four analytes of level 1 showed a performance of ≥6 sigma level, and four analytes (urea, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level. For all analytes <6 sigma level, the quality goal index (QGI) was <0.8 indicating the area requiring improvement to be imprecision except cholesterol whose QGI >1.2 indicated inaccuracy. This study shows that sigma metrics is a good quality tool to assess the analytical performance of a clinical chemistry laboratory. Thus, sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the efficiency of existing laboratory processes.

Using Academy Standards of Excellence in Nutrition and Dietetics for organization self-assessment and quality improvement.

PubMed

Price, Joyce A; Kent, Sue; Cox, Sharon A; McCauley, Sharon M; Parekh, Janki; Klein, Catherine J

2014-08-01

Standards of Excellence in Nutrition and Dietetics for an Organization is a self-assessment tool to measure and evaluate an organization's program, services, and initiatives that identify and distinguish the Registered Dietitian Nutritionist (RDN) brand as the professional expert in food and nutrition. The Standards of Excellence will serve as a road map to recognize RDNs as leaders and collaborators. Standards of Excellence criteria apply to all practice segments of nutrition and dietetics: health care, education and research, business and industry, and community nutrition and public health. Given the membership's call to action to be recognized for their professional expertise, the Academy of Nutrition and Dietetics Quality Management Committee developed four Standards of Excellence in Nutrition and Dietetics for Organizations: Quality of Leadership, Quality of Organization, Quality of Practice, and Quality of Outcomes. Within each standard, specific indicators provide strategies for an organization to demonstrate excellence. The Academy will develop a self-evaluation scoring tool to assist the organization in applying and implementing one or more of the strategies in the Standards of Excellence indicators. The organization can use the self-assessment tool to establish itself as a Center of Excellence in Nutrition and Dietetics. The role examples illustrate initiatives RDNs and organizations can take to identify themselves as a Center of Excellence in Nutrition and Dietetics. Achieving the Excellence level is an important collaborative initiative between nutrition and dietetics organizations and the Academy to provide increased autonomy, supportive management, respect within peers and community, opportunities for professional development, support for further education, and compensation for the RDN. For purposes of the Standards, "organization" means workplace or practice setting. Copyright © 2014 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

A web-based screening tool for near-port air quality assessments

EPA Science Inventory

The Community model for near-PORT applications (C-PORT) is a screening tool with an intended purpose of calculating differences in annual averaged concentration patterns and relative contributions of various source categories over the spatial domain within about 10 km of the port...

Development, application, and sensitivity analysis of a water quality index for drinking water management in small systems.

PubMed

Scheili, A; Rodriguez, Manuel J; Sadiq, R

2015-11-01

The aim of this study was to produce a drinking water assessment tool for operators of small distribution systems. A drinking water quality index (DWQI) was developed and applied to small systems based on the water quality index of the Canadian Council of Ministers of Environment. The drinking water quality index was adapted to specific needs by creating four drinking water quality scenarios. First, the temporal and spatial dimensions of drinking water quality variability were taken into account. The DWQI was designed to express global drinking water quality according to different monitoring frequencies. Daily, monthly, and seasonal assessment was also considered. With the data made available, it was possible to use the index as a spatial monitoring tool and express water quality in different points in the distribution system. Moreover, adjustments were made to prioritize the type of contaminant to monitor. For instance, monitoring contaminants with acute health effects led to a scenario based on daily measures, including easily accessible and affordable water quality parameters. On the other hand, contaminants with chronic effects, especially disinfection by-products, were considered in a seasonal monitoring scenario where disinfection by-product reference values were redefined according to their seasonal variability. A sensitivity analysis was also carried out to validate the index. Globally, the DWQI developed is adapted to the needs of small systems. In fact, expressing drinking water quality using the DWQI contributes to the identification of problematic periods and segments in the distribution system. Further work may include this index in the development of a customized decision-making tool for small-system operators and managers.

Quality improvement in multidisciplinary cancer teams: an investigation of teamwork and clinical decision-making and cross-validation of assessments.

PubMed

Lamb, B W; Sevdalis, N; Mostafid, H; Vincent, C; Green, J S A

2011-12-01

Teamworking and clinical decision-making are important in multidisciplinary cancer teams (MDTs). Our objective is to assess the quality of information presentation and MDT members' contribution to decision-making via expert observation and self-report, aiming to cross-validate the two methods and assess the insight of MDT members into their own team performance. Behaviors were scored using (i) a validated observational tool employing Likert scales with objective anchors, and (ii) a 29-question online self-report tool. Data were collected from observation of 164 cases in five MDTs, and 47 surveys from MDT members (response rate 70%). Presentation of information (case history, radiological, pathological, comorbidities, psychosocial, and patients' views) and quality of contribution to decision-making of MDT members (surgeons, oncologists, radiologists, pathologists, nurses, and MDT coordinators) were analyzed via descriptive statistics and the Jonckheere-Terpstra test. Correlation between observational and self-report assessments was assessed with Spearman's correlations. Quality of information presentation: Case histories and radiology information rated highest; patients' views and comorbidities/psychosocial issues rated lowest (observed: Z = 14.80, P ≤ 0.001; self-report: Z = 3.70, P < 0.001). Contribution to decision-making: Surgeons and oncologists rated highest, nurses and MDT coordinators rated lowest, and others in between (observed: Z = 20.00, P ≤ 0.001; self-report: Z = 8.10, P < 0.001). Correlations between observational and self-report assessments: Median Spearman's rho = 0.74 (range = 0.66-0.91; P < 0.05). The quality of teamworking and clinical decision-making in MDTs can reliably be assessed using observational and self-report metrics. MDT members have good insight into their own team performance. Such robust assessment methods could provide the basis of a toolkit for MDT team evaluation and improvement.

Testing, Requirements, and Metrics

NASA Technical Reports Server (NTRS)

Rosenberg, Linda; Hyatt, Larry; Hammer, Theodore F.; Huffman, Lenore; Wilson, William

1998-01-01

The criticality of correct, complete, testable requirements is a fundamental tenet of software engineering. Also critical is complete requirements based testing of the final product. Modern tools for managing requirements allow new metrics to be used in support of both of these critical processes. Using these tools, potential problems with the quality of the requirements and the test plan can be identified early in the life cycle. Some of these quality factors include: ambiguous or incomplete requirements, poorly designed requirements databases, excessive or insufficient test cases, and incomplete linkage of tests to requirements. This paper discusses how metrics can be used to evaluate the quality of the requirements and test to avoid problems later. Requirements management and requirements based testing have always been critical in the implementation of high quality software systems. Recently, automated tools have become available to support requirements management. At NASA's Goddard Space Flight Center (GSFC), automated requirements management tools are being used on several large projects. The use of these tools opens the door to innovative uses of metrics in characterizing test plan quality and assessing overall testing risks. In support of these projects, the Software Assurance Technology Center (SATC) is working to develop and apply a metrics program that utilizes the information now available through the application of requirements management tools. Metrics based on this information provides real-time insight into the testing of requirements and these metrics assist the Project Quality Office in its testing oversight role. This paper discusses three facets of the SATC's efforts to evaluate the quality of the requirements and test plan early in the life cycle, thus preventing costly errors and time delays later.

SMOQ: a tool for predicting the absolute residue-specific quality of a single protein model with support vector machines

PubMed Central

2014-01-01

Background It is important to predict the quality of a protein structural model before its native structure is known. The method that can predict the absolute local quality of individual residues in a single protein model is rare, yet particularly needed for using, ranking and refining protein models. Results We developed a machine learning tool (SMOQ) that can predict the distance deviation of each residue in a single protein model. SMOQ uses support vector machines (SVM) with protein sequence and structural features (i.e. basic feature set), including amino acid sequence, secondary structures, solvent accessibilities, and residue-residue contacts to make predictions. We also trained a SVM model with two new additional features (profiles and SOV scores) on 20 CASP8 targets and found that including them can only improve the performance when real deviations between native and model are higher than 5Å. The SMOQ tool finally released uses the basic feature set trained on 85 CASP8 targets. Moreover, SMOQ implemented a way to convert predicted local quality scores into a global quality score. SMOQ was tested on the 84 CASP9 single-domain targets. The average difference between the residue-specific distance deviation predicted by our method and the actual distance deviation on the test data is 2.637Å. The global quality prediction accuracy of the tool is comparable to other good tools on the same benchmark. Conclusion SMOQ is a useful tool for protein single model quality assessment. Its source code and executable are available at: http://sysbio.rnet.missouri.edu/multicom_toolbox/. PMID:24776231

SMOQ: a tool for predicting the absolute residue-specific quality of a single protein model with support vector machines.

PubMed

Cao, Renzhi; Wang, Zheng; Wang, Yiheng; Cheng, Jianlin

2014-04-28

It is important to predict the quality of a protein structural model before its native structure is known. The method that can predict the absolute local quality of individual residues in a single protein model is rare, yet particularly needed for using, ranking and refining protein models. We developed a machine learning tool (SMOQ) that can predict the distance deviation of each residue in a single protein model. SMOQ uses support vector machines (SVM) with protein sequence and structural features (i.e. basic feature set), including amino acid sequence, secondary structures, solvent accessibilities, and residue-residue contacts to make predictions. We also trained a SVM model with two new additional features (profiles and SOV scores) on 20 CASP8 targets and found that including them can only improve the performance when real deviations between native and model are higher than 5Å. The SMOQ tool finally released uses the basic feature set trained on 85 CASP8 targets. Moreover, SMOQ implemented a way to convert predicted local quality scores into a global quality score. SMOQ was tested on the 84 CASP9 single-domain targets. The average difference between the residue-specific distance deviation predicted by our method and the actual distance deviation on the test data is 2.637Å. The global quality prediction accuracy of the tool is comparable to other good tools on the same benchmark. SMOQ is a useful tool for protein single model quality assessment. Its source code and executable are available at: http://sysbio.rnet.missouri.edu/multicom_toolbox/.

Estimating learning outcomes from pre- and posttest student self-assessments: a longitudinal study.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Beißbarth, Tim; Anders, Sven; Pukrop, Tobias; Raupach, Tobias

2013-03-01

Learning outcome is an important measure for overall teaching quality and should be addressed by comprehensive evaluation tools. The authors evaluated the validity of a novel evaluation tool based on student self-assessments, which may help identify specific strengths and weaknesses of a particular course. In 2011, the authors asked 145 fourth-year students at Göttingen Medical School to self-assess their knowledge on 33 specific learning objectives in a pretest and posttest as part of a cardiorespiratory module. The authors compared performance gain calculated from self-assessments with performance gain derived from formative examinations that were closely matched to these 33 learning objectives. Eighty-three students (57.2%) completed the assessment. There was good agreement between performance gain derived from subjective data and performance gain derived from objective examinations (Pearson r=0.78; P<.0001) on the group level. The association between the two measures was much weaker when data were analyzed on the individual level. Further analysis determined a quality cutoff for performance gain derived from aggregated student self-assessments. When using this cutoff, the evaluation tool was highly sensitive in identifying specific learning objectives with favorable or suboptimal objective performance gains. The tool is easy to implement, takes initial performance levels into account, and does not require extensive pre-post testing. By providing valid estimates of actual performance gain obtained during a teaching module, it may assist medical teachers in identifying strengths and weaknesses of a particular course on the level of specific learning objectives.

A Systematic Review of Athletes’ and Coaches’ Nutrition Knowledge and Reflections on the Quality of Current Nutrition Knowledge Measures

PubMed Central

Trakman, Gina L.; Forsyth, Adrienne; Devlin, Brooke L.; Belski, Regina

2016-01-01

Context: Nutrition knowledge can influence dietary choices and impact on athletic performance. Valid and reliable measures are needed to assess the nutrition knowledge of athletes and coaches. Objectives: (1) To systematically review the published literature on nutrition knowledge of adult athletes and coaches and (2) to assess the quality of measures used to assess nutrition knowledge. Data Sources: MEDLINE, CINAHL, SPORTDiscuss, Web of Science, and SCOPUS. Study Selection: 36 studies that provided a quantitative measure of nutrition knowledge and described the measurement tool that was used were included. Data extraction: Participant description, questionnaire description, results (mean correct and responses to individual items), study quality, and questionnaire quality. Data synthesis: All studies were of neutral quality. Tools used to measure knowledge did not consider health literacy, were outdated with regards to consensus recommendations, and lacked appropriate and adequate validation. The current status of nutrition knowledge in athletes and coaches is difficult to ascertain. Gaps in knowledge also remain unclear, but it is likely that energy density, the need for supplementation, and the role of protein are frequently misunderstood. Conclusions: Previous reports of nutrition knowledge need to be interpreted with caution. A new, universal, up-to-date, validated measure of general and sports nutrition knowledge is required to allow for assessment of nutrition knowledge. PMID:27649242

The point-touch technique for botulinum toxin injection in adductor spasmodic dysphonia: quality of life assessment.

PubMed

Morzaria, S; Damrose, E J

2011-07-01

Botulinum toxin injection under electromyographic guidance is the 'gold standard' for adductor spasmodic dysphonia treatment. The point-touch technique, an alternative injection method which relies on anatomical landmarks, is cheaper, quicker and more accessible, but has not yet gained widespread acceptance due to concerns about patient satisfaction. To assess swallowing and voice-related quality of life following point-touch botulinum toxin injection in adductor spasmodic dysphonia patients. Stanford University Voice and Swallowing Center. Prospective case series (evidence level four). Consecutive adductor spasmodic dysphonia patients with a stable botulinum toxin dose-response relationship were recruited prospectively. The Eating Assessment Tool and Voice-Related Quality of Life questionnaires were completed pre-treatment and at 10 and 30 per cent completion of the injection cycle, respectively. Thirty-seven patients completed follow up. The mean total botulinum toxin dose was 0.88 units. Pre-treatment Voice-Related Quality of Life questionnaire results reflected the burden of disease. Post-treatment Eating Assessment Tool and Voice-Related Quality of Life questionnaire results were collected at 2.53 and 7.84 weeks, respectively; the former showed an increase in dysphagia, albeit statistically insignificant, while the latter showed significantly improved scores (both domain and total). The point-touch technique is a viable alternative for botulinum toxin injection in the treatment of adductor spasmodic dysphonia.

Chronic Pelvic Pain: Assessment, Evaluation, and Objectivation

PubMed Central

Pota, Vincenzo; Sansone, Pasquale; Aurilio, Caterina; Pace, Maria Caterina

2017-01-01

Chronic Pelvic Pain (CPP) and Chronic Pelvic Pain Syndrome (CPPS) have a significant impact on men and women of reproductive and nonreproductive age, with a considerable burden on overall quality of life (QoL) and on psychological, functional, and behavioural status. Moreover, diagnostic and therapeutic difficulties are remarkable features in many patients. Therefore evaluation, assessment and objectivation tools are often necessary to properly address each patient and consequently his/her clinical needs. Here we review the different tools for pain assessment, evaluation, and objectivation; specific features regarding CPP/CPPS will be highlighted. Also, recent findings disclosed with neuroimaging investigations will be reviewed as they provide new insights into CPP/CPPS pathophysiology and may serve as a tool for CPP assessment and objectivation. PMID:29359045

Hydrology and water quality of a field and riparian buffer adjacent to a mangrove wetland in Jobos Bay Watershed, Puerto Rico

USDA-ARS?s Scientific Manuscript database

Models that estimate the effects of agricultural conservation practices on water quantity and quality have become increasingly important tools for short- and long-term assessments. In this study, we simulated the water quality and hydrology of a portion of the Jobos Bay watershed, Puerto Rico using...

Assessing and Managing Quality of Information Assurance

DTIC Science & Technology

2010-11-01

such as firewalls, antivirus scanning tools and mechanisms for user authentication and authorization. Advanced mission-critical systems often...imply increased risk to DoD information systems. The Process and Organizational Maturity (POM) class focuses on the maturity of the software and...include architectural quality. Common Weakness Enumeration (CWE) is a recent example that highlights the connection between software quality and

QUAST: quality assessment tool for genome assemblies

PubMed Central

Gurevich, Alexey; Saveliev, Vladislav; Vyahhi, Nikolay; Tesler, Glenn

2013-01-01

Summary: Limitations of genome sequencing techniques have led to dozens of assembly algorithms, none of which is perfect. A number of methods for comparing assemblers have been developed, but none is yet a recognized benchmark. Further, most existing methods for comparing assemblies are only applicable to new assemblies of finished genomes; the problem of evaluating assemblies of previously unsequenced species has not been adequately considered. Here, we present QUAST—a quality assessment tool for evaluating and comparing genome assemblies. This tool improves on leading assembly comparison software with new ideas and quality metrics. QUAST can evaluate assemblies both with a reference genome, as well as without a reference. QUAST produces many reports, summary tables and plots to help scientists in their research and in their publications. In this study, we used QUAST to compare several genome assemblers on three datasets. QUAST tables and plots for all of them are available in the Supplementary Material, and interactive versions of these reports are on the QUAST website. Availability: http://bioinf.spbau.ru/quast Contact: gurevich@bioinf.spbau.ru Supplementary information: Supplementary data are available at Bioinformatics online. PMID:23422339

A survey-based benchmarking approach for health care using the Baldrige quality criteria.

PubMed

Jennings, K; Westfall, F

1994-09-01

Since 1988, manufacturing and service industries have been using the Malcolm Baldrige National Quality Award to assess their management processes (for example, leadership, information, and analysis) against critical performance criteria. Recognizing that the typical Baldrige assessment is time intensive and dependent on intensive training, The Pacer Group, a consulting firm in Dayton, Ohio, developed a self-assessment tool based on the Baldrige criteria which provides a snapshot assessment of an organization's management practices. The survey was administered at 25 hospitals within a health care system. Hospitals were able to compare their scores with other hospitals in the system, as well as the scores of a Baldrige award winner. Results were also analyzed on a systemwide basis to identify strengths and weaknesses across the system. For all 25 hospitals, the following areas were identified as strengths: management of process quality, leadership, and customer focus and satisfaction. Weaknesses included lack of employee involvement in the quality planning process, poor design of quality systems, and lack of cross-departmental cooperation. One of the surveyed hospitals launched improvement initiatives in knowledge of improvement tools and methods and in a patient satisfaction focus. A team was formed to improve the human resource management system. Also, a new unit was designed using patient-centered care principles. A team re-evaluated every operation that affected patients on the unit. A survey modeled after the Baldrige Award criteria can be useful in benchmarking an organization's quality improvement practices.

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

The development and validation of a meta-tool for quality appraisal of public health evidence: Meta Quality Appraisal Tool (MetaQAT).

PubMed

Rosella, L; Bowman, C; Pach, B; Morgan, S; Fitzpatrick, T; Goel, V

2016-07-01

Most quality appraisal tools were developed for clinical medicine and tend to be study-specific with a strong emphasis on risk of bias. In order to be more relevant to public health, an appropriate quality appraisal tool needs to be less reliant on the evidence hierarchy and consider practice applicability. Given the broad range of study designs used in public health, the objective of this study was to develop and validate a meta-tool that combines public health-focused principles of appraisal coupled with a set of design-specific companion tools. Several design methods were used to develop and validate the tool including literature review, synthesis, and validation with a reference standard. A search of critical appraisal tools relevant to public health was conducted; core concepts were collated. The resulting framework was piloted during three feedback sessions with public health practitioners. Following subsequent revisions, the final meta-tool, the Meta Quality Appraisal Tool (MetaQAT), was then validated through a content analysis of appraisals conducted by two groups of experienced public health researchers (MetaQAT vs generic appraisal form). The MetaQAT framework consists of four domains: relevancy, reliability, validity, and applicability. In addition, a companion tool was assembled from existing critical appraisal tools to provide study design-specific guidance on validity appraisal. Content analysis showed similar methodological and generalizability concerns were raised by both groups; however, the MetaQAT appraisers commented more extensively on applicability to public health practice. Critical appraisal tools designed for clinical medicine have limitations for use in the context of public health. The meta-tool structure of the MetaQAT allows for rigorous appraisal, while allowing users to simultaneously appraise the multitude of study designs relevant to public health research and assess non-standard domains, such as applicability. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

The Cluster-Randomized BRIGHT Trial: Proactive Case Finding for Community-Dwelling Older Adults

PubMed Central

Kerse, Ngaire; McLean, Chris; Moyes, Simon A.; Peri, Kathy; Ng, Terence; Wilkinson-Meyers, Laura; Brown, Paul; Latham, Nancy; Connolly, Martin

2014-01-01

PURPOSE People are now living longer, but disability may affect the quality of those additional years of life. We undertook a trial to assess whether case finding reduces disability among older primary care patients. METHODS We conducted a cluster-randomized trial of the Brief Risk Identification Geriatric Health Tool (BRIGHT) among 60 primary care practices in New Zealand, assigning them to an intervention or control group. Intervention practices sent a BRIGHT screening tool to older adults every birthday; those with a score of 3 or higher were referred to regional geriatric services for assessment and, if needed, service provision. Control practices provided usual care. Main outcomes, assessed in blinded fashion, were residential care placement and hospitalization, and secondary outcomes were disability, assessed with Nottingham Extended Activities of Daily Living Scale (NEADL), and quality of life, assessed with the World Health Organization Quality of Life scale, abbreviated version (WHOQOL-BREF). RESULTS All 8,308 community-dwelling patients aged 75 years and older were approached; 3,893 (47%) participated, of whom 3,010 (77%) completed the trial. Their mean age was 80.3 (SD 4.5) years, and 55% were women. Overall, 88% of the intervention group returned a BRIGHT tool; 549 patients were referred. After 36 months, patients in the intervention group were more likely than those in the control group to have been placed in residential care: 8.4% vs 6.2% (hazard ratio = 1.32; 95% CI, 1.04–1.68; P = .02). Intervention patients had smaller declines in mean scores for physical health-related quality of life (1.6 vs 2.9 points, P = .007) and psychological health-related quality of life (1.1 vs 2.4 points, P = .005). Hospitalization, disability, and use of services did not differ between groups, however. CONCLUSIONS Our case-finding strategy was effective in increasing identification of older adults with disability, but there was little evidence of improved outcomes. Further research could trial stronger primary care integration strategies. PMID:25384813

Participant comprehension of research for which they volunteer: a systematic review.

PubMed

Montalvo, Wanda; Larson, Elaine

2014-11-01

Evidence indicates that research participants often do not fully understand the studies for which they have volunteered. The aim of this systematic review was to examine the relationship between the process of obtaining informed consent for research and participant comprehension and satisfaction with the research. Systematic review of published research on informed consent and participant comprehension of research for which they volunteer using the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) Statement as a guide. PubMed, Cumulative Index for Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trails, and Cochrane Database of Systematic Reviews were used to search the literature for studies meeting the following inclusion criteria: (a) published between January 1, 2006, and December 31, 2013, (b) interventional or descriptive quantitative design, (c) published in a peer-reviewed journal, (d) written in English, and (e) assessed participant comprehension or satisfaction with the research process. Studies were assessed for quality using seven indicators: sampling method, use of controls or comparison groups, response rate, description of intervention, description of outcome, statistical method, and health literacy assessment. Of 176 studies identified, 27 met inclusion criteria: 13 (48%) were randomized interventional designs and 14 (52%) were descriptive. Three categories of studies included projects assessing (a) enhanced consent process or form, (b) multimedia methods, and (c) education to improve participant understanding. Most (78%) used investigator-developed tools to assess participant comprehension, did not assess participant health literacy (74%), or did not assess the readability level of the consent form (89%). Researchers found participants lacked basic understanding of research elements: randomization, placebo, risks, and therapeutic misconception. Findings indicate (a) inconsistent assessment of participant reading or health literacy level, (b) measurement variation associated with use of nonstandardized tools, and (c) continued therapeutic misconception and lack of understanding among research participants of randomization, placebo, benefit, and risk. While the Agency for Healthcare and Quality and National Quality Forum have published informed consent and authorization toolkits, previously published validated tools are underutilized. Informed consent requires the assessment of health literacy, reading level, and comprehension of research participants using validated assessment tools and methods. © 2014 Sigma Theta Tau International.

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing.

PubMed

González-Chordá, Víctor Manuel; Maciá-Soler, María Loreto

2015-01-01

to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. prospective longitudinal study conducted in a population of 60 secondyear Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teachinglearning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care.

Quality improvement and practice-based research in neurology using the electronic medical record

PubMed Central

Frigerio, Roberta; Kazmi, Nazia; Meyers, Steven L.; Sefa, Meredith; Walters, Shaun A.; Silverstein, Jonathan C.

2015-01-01

Abstract We describe quality improvement and practice-based research using the electronic medical record (EMR) in a community health system–based department of neurology. Our care transformation initiative targets 10 neurologic disorders (brain tumors, epilepsy, migraine, memory disorders, mild traumatic brain injury, multiple sclerosis, neuropathy, Parkinson disease, restless legs syndrome, and stroke) and brain health (risk assessments and interventions to prevent Alzheimer disease and related disorders in targeted populations). Our informatics methods include building and implementing structured clinical documentation support tools in the EMR; electronic data capture; enrollment, data quality, and descriptive reports; quality improvement projects; clinical decision support tools; subgroup-based adaptive assignments and pragmatic trials; and DNA biobanking. We are sharing EMR tools and deidentified data with other departments toward the creation of a Neurology Practice-Based Research Network. We discuss practical points to assist other clinical practices to make quality improvements and practice-based research in neurology using the EMR a reality. PMID:26576324

Recent advances in omic technologies for meat quality management.

PubMed

Picard, B; Lebret, B; Cassar-Malek, I; Liaubet, L; Berri, C; Le Bihan-Duval, E; Hocquette, J F; Renand, G

2015-11-01

The knowledge of the molecular organization of living organisms evolved considerably during the last years. The methodologies associated also progressed with the development of the high-throughput sequencing (SNP array, RNAseq, etc.) and of genomic tools allowing the simultaneous analysis of hundreds or thousands of genes, proteins or metabolites. In farm animals, some proteins, mRNAs or metabolites whose abundance has been associated with meat quality traits have been detected in pig, cattle, chicken. They constitute biomarkers for the assessment and prediction of qualities of interest in each species, with potential biomarkers across species. The ongoing development of rapid methods will allow their use for decision-making and management tools in slaughterhouses, to better allocate carcasses or cuts to the appropriate markets. Besides, their application on living animals will help to improve genetic selection and to adapt a breeding system to fulfill expected quality level. The ultimate goal is to propose effective molecular tools for the management of product quality in meat production chains. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Assessing Assessment: In Pursuit of Meaningful Learning

ERIC Educational Resources Information Center

Rootman-le Grange, Ilse; Blackie, Margaret A. L.

2018-01-01

The challenge of supporting the development of meaningful learning is prevalent in chemistry education research. One of the core activities used in the learning process is assessments. The aim of this paper is to illustrate how the semantics dimension of Legitimation Code Theory can be a helpful tool to critique the quality of assessments and…

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

PubMed

Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

2015-01-01

Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief disease management encounters. MISHCE also evaluates quality of the patient-provider therapeutic alliance, i.e., the "flow" of the interaction. Copyright © 2015 Elsevier Inc. All rights reserved.

Aggregate Measures of Watershed Health from Reconstructed Water Quality Data with Uncertainty

EPA Science Inventory

Risk-based indices such as reliability, resilience, and vulnerability (R-R-V), have the potential to serve as watershed health assessment tools. Recent research has demonstrated the applicability of such indices for water quality (WQ) constituents such as total suspended solids ...

WATERSHED BASED SURVEY DESIGNS

EPA Science Inventory

The development of watershed-based design and assessment tools will help to serve the multiple goals for water quality monitoring required under the Clean Water Act, including assessment of regional condition to meet Section 305(b), identification of impaired water bodies or wate...

WATERSHED-BASED SURVEY DESIGNS

EPA Science Inventory

Water-based sampling design and assessment tools help serve the multiple goals for water quality monitoring required under the Clean Water Act, including assessment of regional conditions to meet Section 305(b), identification if impaired water bodies or watersheds to meet Sectio...

Health Reporting in Print Media in Lebanon: Evidence, Quality and Role in Informing Policymaking.

PubMed

El-Jardali, Fadi; Bou Karroum, Lama; Bawab, Lamya; Kdouh, Ola; El-Sayed, Farah; Rachidi, Hala; Makki, Malak

2015-01-01

Media plays a vital role in shaping public policies and opinions through disseminating health-related information. This study aims at exploring the role of media in informing health policies in Lebanon, identifying the factors influencing health reporting and investigating the role of evidence in health journalism and the quality of health reporting. It also identifies strategies to enhance the use of evidence in health journalism and improve the quality of health reporting. Media analysis was conducted to assess the way media reports on health-related issues and the quality of reporting using a quality assessment tool. Semi-structured interviews were also conducted with 27 journalists, researchers and policymakers to explore their perception on the role of media in health policymaking and the factors influencing health reporting. In addition, a validation workshop was conducted. Out of 1,279 health-related news articles identified, 318 articles used certain type of evidence to report health issues 39.8% of which relied on experts' opinions as their source of evidence while only 5.9% referenced peer-reviewed research studies. The quality of health reporting was judged to be low based on a quality assessment tool consisting of a set of ten criteria. Journalists raised concerns about issues impeding them from referring to evidence. Journalists also reported difficulties with the investigative health journalism. Policymakers and researchers viewed media as an important tool for evidence-informed health policies, however, serious concerns were voiced in terms of the current practice and capacities. Our study provides a structured reflection on the role of media and the factors that influence health reporting including context-specific strategies that would enhance the quality and promote the use of evidence in health reporting. In the light of the political changes in many Middle Eastern countries, findings from this study can contribute to redefining the role of media in strengthening health systems.

Health Reporting in Print Media in Lebanon: Evidence, Quality and Role in Informing Policymaking

PubMed Central

El-Jardali, Fadi; Bou Karroum, Lama; Bawab, Lamya; Kdouh, Ola; El-Sayed, Farah; Rachidi, Hala; Makki, Malak

2015-01-01

Background Media plays a vital role in shaping public policies and opinions through disseminating health-related information. This study aims at exploring the role of media in informing health policies in Lebanon, identifying the factors influencing health reporting and investigating the role of evidence in health journalism and the quality of health reporting. It also identifies strategies to enhance the use of evidence in health journalism and improve the quality of health reporting. Methods Media analysis was conducted to assess the way media reports on health-related issues and the quality of reporting using a quality assessment tool. Semi-structured interviews were also conducted with 27 journalists, researchers and policymakers to explore their perception on the role of media in health policymaking and the factors influencing health reporting. In addition, a validation workshop was conducted. Results Out of 1,279 health-related news articles identified, 318 articles used certain type of evidence to report health issues 39.8% of which relied on experts’ opinions as their source of evidence while only 5.9% referenced peer-reviewed research studies. The quality of health reporting was judged to be low based on a quality assessment tool consisting of a set of ten criteria. Journalists raised concerns about issues impeding them from referring to evidence. Journalists also reported difficulties with the investigative health journalism. Policymakers and researchers viewed media as an important tool for evidence-informed health policies, however, serious concerns were voiced in terms of the current practice and capacities. Conclusion Our study provides a structured reflection on the role of media and the factors that influence health reporting including context-specific strategies that would enhance the quality and promote the use of evidence in health reporting. In the light of the political changes in many Middle Eastern countries, findings from this study can contribute to redefining the role of media in strengthening health systems. PMID:26308077

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools.

PubMed

Shurtz, Suzanne; Foster, Margaret J

2011-07-01

The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed.

Dupuytren Disease: Is There Enough Comprehensive Patient Information on the Internet?

PubMed Central

Raptis, Dimitri A; Fertsch, Sonia; Guggenheim, Merlin

2017-01-01

Background Dupuytren disease is a chronic nonmalign fibroproliferative disorder that causes finger contractures via proliferation of new tissue under the glabrous skin of the hand, resulting in multiple functional limitations for the patient. As many surgical therapy options exist, patients suffering from this condition actively search for information in their environment before consulting a health professional. Objective As little is known about the quality of Web-based patient information, the aim of this study was to conduct its systematic evaluation using a validated tool. Methods A total of 118 websites were included, and qualitative and quantitative assessment was performed using the modified Ensuring Quality Information for Patients (EQIP) tool. This standardized and reproducible tool consists of 36 items to assess available information in three categories: contents, identification, and structure data. Scientific data with restricted access, duplicates, and irrelevant websites were not included. Results Only 32 websites addressed more than 19 items, and the scores did not significantly differ among the website developers. The median number of items from the EQIP tool was 16, with the top websites addressing 28 out of 36 items. The quality of the newly developed websites did not increase with passing time. Conclusions This study revealed several shortcomings in the quality of Web-based information available for patients suffering from Dupuytren disease. In the world of continuously growing and instantly available Web-based information, it is the health providers’ negligence of the last two decades that there are very few good quality, informative, and educative websites that could be recommended to patients. PMID:28642214

Evaluation of the Missoula-VITAS Quality of Life Index--revised: research tool or clinical tool?

PubMed

Schwartz, Carolyn E; Merriman, Melanie P; Reed, George; Byock, Ira

2005-02-01

Quality of life (QOL) is a central outcome measure in caring for seriously ill patients. The Missoula-VITAS Quality of Life Index (MVQOLI) is a 25-item patient-centered index that weights each of five QOL dimensions (symptoms, function, interpersonal, wellbeing, transcendence) by its importance to the respondent. The measure has been used to assess QOL for hospice patients, and has been found to be somewhat complex to use and analyze. This study aimed to simplify the measure, and evaluate the reliability and validity of a revised version as either a research or clinical tool (i.e., "psychometric" versus "clinimetric"). Two data collection efforts are described. The psychometric study collected QOL data from 175 patients at baseline, 3-5 days, and 21 days later. The implementation study evaluated the feasibility and utility of the MVQOLI-R during over six weeks of use. End-stage renal patients on dialysis, hospice, or long-term care patients participated in the psychometric study. The implementation study was done in hospice, home health, and palliative care settings. The MVQOLI-R and the Memorial Symptom Assessment Scale. The psychometric and implementation studies suggest that the MVQOLI-R performs well as a clinical tool but is not powerful as an outcome research instrument. The MVQOLI-R has the heterogeneous structure of clinimetric tools, and demonstrated both relevance and responsiveness. Additionally, in a clinical setting the MVQOLI-R was useful therapeutically for stimulating communication about the psychosocial and spiritual issues important to the tasks of life completion and life closure. The MVQOLI-R has clinical utility as a patient QOL assessment tool and may have therapeutic utility as a tool for fostering discussion among patients and their clinicians, as well as for helping patients identify sources of suffering and opportunities during this time in their lives.

Southwest principal aquifers regional ground-water quality assessment

USGS Publications Warehouse

Anning, D.W.; Thiros, Susan A.; Bexfield, L.M.; McKinney, T.S.; Green, J.M.

2009-01-01

The National Water-Quality Assessment (NAWQA) Program of the U.S. Geological Survey is conducting a regional analysis of water quality in the principal aquifers in the southwestern United States. The Southwest Principal Aquifers (SWPA) study is building a better understanding of the susceptibility and vulnerability of basin-fill aquifers in the region to ground-water contamination by synthesizing the baseline knowledge of ground-water quality conditions in 15 basins previously studied by the NAWQA Program. The improved understanding of aquifer susceptibility and vulnerability to contamination is assisting in the development of tools that water managers can use to assess and protect the quality of ground-water resources. This fact sheet provides an overview of the basin-fill aquifers in the southwestern United States and description of the completed and planned regional analyses of ground-water quality being performed by the SWPA study.

A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: the Study Design and Implementation Assessment Device (Study DIAD).

PubMed

Valentine, Jeffrey C; Cooper, Harris

2008-06-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of studies. These tools tend to (a) be insufficiently operational, (b) rely on arbitrary post-hoc decision rules, and (c) result in a single number to represent a multidimensional construct. In response to these limitations, a multilevel and hierarchical instrument was developed in consultation with a wide range of methodological and statistical experts. The instrument focuses on the operational details of studies and results in a profile of scores instead of a single score to represent study quality. A pilot test suggested that satisfactory between-judge agreement can be obtained using well-trained raters working in naturalistic conditions. Limitations of the instrument are discussed, but these are inherent in making decisions about study quality given incomplete reporting and in the absence of strong, contextually based information about the effects of design flaws on study outcomes. (PsycINFO Database Record (c) 2008 APA, all rights reserved).

Investigating the Validity of Two Widely Used Quantitative Text Tools

ERIC Educational Resources Information Center

Cunningham, James W.; Hiebert, Elfrieda H.; Mesmer, Heidi Anne

2018-01-01

In recent years, readability formulas have gained new prominence as a basis for selecting texts for learning and assessment. Variables that quantitative tools count (e.g., word frequency, sentence length) provide valid measures of text complexity insofar as they accurately predict representative and high-quality criteria. The longstanding…

A new quality of bone ultrasound research.

PubMed

Gluer, C C

2008-07-01

Quantitative ultrasound (QUS) methods have strong power to predict osteoporotic fractures, but they are also very relevant for the assessment of bone quality. A representative sample of recent studies addressing these topics can be found in this special issue. Further pursuit of these methods will establish micro-QUS imaging methods as tools for measuring specific aspects of bone quality. Once this is achieved, we will be able to link such data to the clinical QUS methods used in vivo to determine which aspects of bone quality cause QUS to be a predictor of fracture risk that is independent of bone mineral density (BMD). Potentially this could lead to the development of a new generation of QUS devices for improved and expanded clinical assessment. Good quality of basic science work will thus lead to good quality of clinical patient examinations on the basis of a more detailed assessment of bone quality.

Shared decision making for stroke prevention in atrial fibrillation: study protocol for a randomized controlled trial.

PubMed

Kunneman, Marleen; Branda, Megan E; Noseworthy, Peter A; Linzer, Mark; Burnett, Bruce; Dick, Sara; Spencer-Bonilla, Gabriela; Fernandez, Cara A; Gorr, Haeshik; Wambua, Mike; Keune, Shelly; Zeballos-Palacios, Claudia; Hargraves, Ian; Shah, Nilay D; Montori, Victor M

2017-09-29

Nonvalvular atrial fibrillation (AF) is a common ongoing health problem that places patients at risk of stroke. Whether and how a patient addresses this risk depends on each patient's goals, context, and values. Consequently, leading cardiovascular societies recommend using shared decision making (SDM) to individualize antithrombotic treatment in patients with AF. The aim of this study is to assess the extent to which the ANTICOAGULATION CHOICE conversation tool promotes high-quality SDM and influences anticoagulation uptake and adherence in patients with AF at risk of strokes. This study protocol describes a multicenter, encounter-level, randomized trial to assess the effect of using the ANTICOAGULATION CHOICE conversation tool in the clinical encounter, compared to usual care. The participating centers include an academic hospital system, a suburban community group practice, and an urban safety net hospital, all in Minnesota, USA. Patients with ongoing nonvalvular AF at risk of strokes (CHA 2 DS 2 -VASc score ≥ 1 in men, or ≥ 2 in women) will be eligible for participation. We aim to include 999 patients and their clinicians. The primary outcome is the quality of SDM as perceived by participants, and as assessed by a post-encounter survey that ascertains (a) knowledge transfer, (b) concordance of the decision made, (c) quality of communication, and (d) satisfaction with the decision-making process. Recordings of encounters will be reviewed to assess the extent of patient involvement and how participants use the tool (fidelity). Anticoagulant use, choice of agent, and adherence will be drawn from patients' medical and pharmacy records. Strokes and bleeding events will be drawn from patient records. This study will provide a valid and precise measure of the effect of the ANTICOAGULATION CHOICE conversation tool on SDM quality and processes, and on the treatment choices and adherence to therapy among AF patients at risk of stroke. ClinicalTrials.gov, NCT02905032 . Registered on 9 September 2016.

Methodological quality of systematic reviews in subfertility: a comparison of Cochrane and non-Cochrane systematic reviews in assisted reproductive technologies.

PubMed

Windsor, B; Popovich, I; Jordan, V; Showell, M; Shea, B; Farquhar, C

2012-12-01

Are there differences in the methodological quality of Cochrane systematic reviews (CRs) and non-Cochrane systematic reviews (NCRs) of assisted reproductive technologies? CRs on assisted reproduction are of higher methodological quality than similar reviews published in other journals. The quality of systematic reviews varies. This was a cross-sectional study of 30 CR and 30 NCR systematic reviews that were randomly selected from the eligible reviews identified from a literature search for the years 2007-2011. We extracted data on the reporting and methodological characteristics of the included systematic reviews. We assessed the methodological quality of the reviews using the 11-domain Measurement Tool to Assess the Methodological Quality of Systematic Reviews (AMSTAR) tool and subsequently compared CR and NCR systematic reviews. The AMSTAR quality assessment found that CRs were superior to NCRs. For 10 of 11 AMSTAR domains, the requirements were met in >50% of CRs, but only 4 of 11 domains showed requirements being met in >50% of NCRs. The strengths of CRs are the a priori study design, comprehensive literature search, explicit lists of included and excluded studies and assessments of internal validity. Significant failings in the CRs were found in duplicate study selection and data extraction (67% meeting requirements), assessment for publication bias (53% meeting requirements) and reporting of conflicts of interest (47% meeting requirements). NCRs were more likely to contain methodological weaknesses as the majority of the domains showed <40% of reviews meeting requirements, e.g. a priori study design (17%), duplicate study selection and data extraction (17%), assessment of study quality (27%), study quality in the formulation of conclusions (23%) and reporting of conflict of interests (10%). The AMSTAR assessment can only judge what is reported by authors. Although two of the five authors are involved in the production of CRs, the risk of bias was reduced by not involving these authors in the assessment of the systematic review quality. Not all systematic reviews are equal. The reader needs to consider the quality of the systematic review when they consider the results and the conclusions of a systematic review. There are no conflicts with any commercial organization. Funding was provided for the students by the summer studentship programme of the Faculty of Medical and Health Sciences of the University of Auckland.

Risk-based Process Development of Biosimilars as Part of the Quality by Design Paradigm.

PubMed

Zalai, Dénes; Dietzsch, Christian; Herwig, Christoph

2013-01-01

In the last few years, several quality by design (QbD) studies demonstrated the benefit of systematic approaches for biopharmaceutical development. However, only very few studies identified biosimilars as a special case of product development. The targeted quality profile of biosimilars is strictly defined by the originator's product characteristic. Moreover, the major source of prior knowledge is the experience with the originator product itself. Processing this information in biosimilar development has a major effect on risk management and process development strategies. The main objective of this contribution is to demonstrate how risk management can facilitate the implementation of QbD in early-stage product development with special emphasis on fitting the reported approaches to biosimilars. Risk assessments were highlighted as important tools to integrate prior knowledge in biosimilar development. The risk assessment process as suggested by the International Conference on Harmonization (ICH Q9) was reviewed and three elements were identified to play a key role in targeted risk assessment approaches: proper understanding of target linkage, risk assessment tool compliance, and criticality threshold value. Adjusting these steps to biosimilar applications helped to address some unique challenges of these products such as a strictly defined quality profile or a lack of process knowledge. This contribution demonstrates the need for tailored risk management approaches for the risk-based development of biosimilars and provides novel tools for the integration of additional knowledge available for these products. The pharmaceutical industry is facing challenges such as profit loss and price competition. Companies are forced to rationalize business models and to cut costs in development as well as manufacturing. These trends recently hinder the implementation of any concepts that do not offer certain financial benefit or promise a long return of investment. Quality by design (QbD) is a concept that is currently struggling for more acceptance from the side of the pharmaceutical industry. To achieve this, the major goals of QbD have to be revisited and QbD tools have to be subsequently developed. This contribution offers an example as to how implement risk management in early-stage biosimilar development as part of the QbD concept. The main goal was to go beyond the conventional QbD workflow and to adjust risk management to the challenges of biosimilar products. Accordingly, instead of using methods like failure mode and effects analysis, recommendations of the ICH Q9 guideline were reviewed and put into practice by creating tailored risk assessment tools. The novelty of this contribution is to report those tailored tools ready-to-use for early bioprocess development of biosimilars along QbD principles.

Evaluation of the ToxRTool's ability to rate the reliability of toxicological data for human health hazard assessments

EPA Science Inventory

Regulatory agencies often utilize results from peer reviewed publications for hazard assessments.A problem in doing so is the lack of well-accepted tools to objectively, efficiently and systematically assess the quality of published toxicological studies. Herein, we evaluated the...

State Early Childhood Inclusion Self-Assessment

ERIC Educational Resources Information Center

Whaley, Kathy T.; Cate, Debbie; Dell, Penny; Vinh, Megan; Neitzel, Jen

2017-01-01

This self-assessment tool provides a framework for examining key aspects of a State infrastructure that are useful for promoting high quality inclusive practices, programs and policies. The sections of the self-assessment are organized by the nine state recommendations of the "Policy Statement on Inclusion of Children with Disabilities in…

Assessment of Interpersonal Relations: A Test Review.

ERIC Educational Resources Information Center

Brooke, Stephanie L.

1999-01-01

Evaluates the Assessment of Interpersonal Relations (AIR), a measure designed to identify relationship difficulties with parents, peers, and teachers for adolescents. Concludes that the AIR may be a useful tool when assessing the quality of relationships of students, but that additional research evidence is needed to ascertain if the AIR is a…

Dynamic extreme values modeling and monitoring by means of sea shores water quality biomarkers and valvometry.

PubMed

Durrieu, Gilles; Pham, Quang-Khoai; Foltête, Anne-Sophie; Maxime, Valérie; Grama, Ion; Tilly, Véronique Le; Duval, Hélène; Tricot, Jean-Marie; Naceur, Chiraz Ben; Sire, Olivier

2016-07-01

Water quality can be evaluated using biomarkers such as tissular enzymatic activities of endemic species. Measurement of molluscs bivalves activity at high frequency (e.g., valvometry) during a long time period is another way to record the animal behavior and to evaluate perturbations of the water quality in real time. As the pollution affects the activity of oysters, we consider the valves opening and closing velocities to monitor the water quality assessment. We propose to model the huge volume of velocity data collected in the framework of valvometry using a new nonparametric extreme values statistical model. The objective is to estimate the tail probabilities and the extreme quantiles of the distribution of valve closing velocity. The tail of the distribution function of valve closing velocity is modeled by a Pareto distribution with parameter t,τ , beyond a threshold τ according to the time t of the experiment. Our modeling approach reveals the dependence between the specific activity of two enzymatic biomarkers (Glutathione-S-transferase and acetylcholinesterase) and the continuous recording of oyster valve velocity, proving the suitability of this tool for water quality assessment. Thus, valvometry allows in real-time in situ analysis of the bivalves behavior and appears as an effective early warning tool in ecological risk assessment and marine environment monitoring.

Developing an Evaluation Tool for Assessing Clinical Ethics Consultation Skills in Simulation Based Education: The ACES Project.

PubMed

Wasson, Katherine; Parsi, Kayhan; McCarthy, Michael; Siddall, Viva Jo; Kuczewski, Mark

2016-06-01

The American Society for Bioethics and Humanities has created a quality attestation (QA) process for clinical ethics consultants; the pilot phase of reviewing portfolios has begun. One aspect of the QA process which is particularly challenging is assessing the interpersonal skills of individual clinical ethics consultants. We propose that using case simulation to evaluate clinical ethics consultants is an approach that can meet this need provided clear standards for assessment are identified. To this end, we developed the Assessing Clinical Ethics Skills (ACES) tool, which identifies and specifies specific behaviors that a clinical ethics consultant should demonstrate in an ethics case simulation. The aim is for the clinical ethics consultant or student to use a videotaped case simulation, along with the ACES tool scored by a trained rater, to demonstrate their competence as part of their QA portfolio. The development and piloting of the tool is described.

Assessing indoor air quality of school environments: transplanted lichen Pseudovernia furfuracea as a new tool for biomonitoring and bioaccumulation.

PubMed

Protano, Carmela; Owczarek, Malgorzata; Antonucci, Arianna; Guidotti, Maurizio; Vitali, Matteo

2017-07-01

The aim of this research is to evaluate the ability of transplanted lichen Pseudovernia (P). furfuracea to biomonitor and bioaccumulate in urban indoor environments. The elements As, Cd, Cr, Cu, Hg, Ni and Pb and 12 selected polycyclic aromatic hydrocarbons (PAHs) were used to assess P. furfuracea as a biomonitoring tool for the indoor air quality of school environments. To achieve this purpose, lichen samples were exposed for 2 months in the outdoor and indoor environments of five school settings located in urban and rural areas. The results demonstrated that transplanted lichen P. furfuracea is a suitable biomonitoring tool for metals and PAHs in indoor settings and can discriminate between different levels of air pollution related to urbanisation and indoor conditions, such as those characterised by school environments. A transplanted lichen biomonitoring strategy is cost-effective, "green", educational for attending children and less "invasive" than traditional air sampling methods. The feasibility of indoor monitoring by P. furfuracea is a relevant finding and could be a key tool to improve air quality monitoring programmes in school scenarios and thus focus on health prevention interventions for children, who are one of the most susceptible groups in the population.

The development of a tool for assessing the quality of closed circuit camera footage for use in forensic gait analysis.

PubMed

Birch, Ivan; Vernon, Wesley; Walker, Jeremy; Saxelby, Jai

2013-10-01

Gait analysis from closed circuit camera footage is now commonly used as evidence in criminal trials. The biomechanical analysis of human gait is a well established science in both clinical and laboratory settings. However, closed circuit camera footage is rarely of the quality of that taken in the more controlled clinical and laboratory environments. The less than ideal quality of much of this footage for use in gait analysis is associated with a range of issues, the combination of which can often render the footage unsuitable for use in gait analysis. The aim of this piece of work was to develop a tool for assessing the suitability of closed circuit camera footage for the purpose of forensic gait analysis. A Delphi technique was employed with a small sample of expert forensic gait analysis practitioners, to identify key quality elements of CCTV footage used in legal proceedings. Five elements of the footage were identified and then subdivided into 15 contributing sub-elements, each of which was scored using a 5-point Likert scale. A Microsoft Excel worksheet was developed to calculate automatically an overall score from the fifteen sub-element scores. Five expert witnesses experienced in using CCTV footage for gait analysis then trialled the prototype tool on current case footage. A repeatability study was also undertaken using standardized CCTV footage. The results showed the tool to be a simple and repeatable means of assessing the suitability of closed circuit camera footage for use in forensic gait analysis. The inappropriate use of poor quality footage could lead to challenges to the practice of forensic gait analysis. All parties involved in criminal proceedings must therefore understand the fitness for purpose of any footage used. The development of this tool could offer a method of achieving this goal, and help to assure the continued role of forensic gait analysis as an aid to the identification process. Copyright © 2013 Elsevier Ltd and Faculty of Forensic and Legal Medicine. All rights reserved.

The validity and reliability of the four square step test in different adult populations: a systematic review.

PubMed

Moore, Martha; Barker, Karen

2017-09-11

The four square step test (FSST) was first validated in healthy older adults to provide a measure of dynamic standing balance and mobility. The FSST has since been used in a variety of patient populations. The purpose of this systematic review is to determine the validity and reliability of the FSST in these different adult patient populations. The literature search was conducted to highlight all the studies that measured validity and reliability of the FSST. Six electronic databases were searched including AMED, CINAHL, MEDLINE, PEDro, Web of Science and Google Scholar. Grey literature was also searched for any documents relevant to the review. Two independent reviewers carried out study selection and quality assessment. The methodological quality was assessed using the QUADAS-2 tool, which is a validated tool for the quality assessment of diagnostic accuracy studies, and the COSMIN four-point checklist, which contains standards for evaluating reliability studies on the measurement properties of health instruments. Fifteen studies were reviewed studying community-dwelling older adults, Parkinson's disease, Huntington's disease, multiple sclerosis, vestibular disorders, post stroke, post unilateral transtibial amputation, knee pain and hip osteoarthritis. Three of the studies were of moderate methodological quality scoring low in risk of bias and applicability for all domains in the QUADAS-2 tool. Three studies scored "fair" on the COSMIN four-point checklist for the reliability components. The concurrent validity of the FSST was measured in nine of the studies with moderate to strong correlations being found. Excellent Intraclass Correlation Coefficients were found between physiotherapists carrying out the tests (ICC = .99) with good to excellent test-retest reliability shown in nine of the studies (ICC = .73-.98). The FSST may be an effective and valid tool for measuring dynamic balance and a participants' falls risk. It has been shown to have strong correlations with other measures of balance and mobility with good reliability shown in a number of populations. However, the quality of the papers reviewed was variable with key factors, such as sample size and test set up, needing to be addressed before the tool can be confidently used in these specified populations.

Application of process mining to assess the data quality of routinely collected time-based performance data sourced from electronic health records by validating process conformance.

PubMed

Perimal-Lewis, Lua; Teubner, David; Hakendorf, Paul; Horwood, Chris

2016-12-01

Effective and accurate use of routinely collected health data to produce Key Performance Indicator reporting is dependent on the underlying data quality. In this research, Process Mining methodology and tools were leveraged to assess the data quality of time-based Emergency Department data sourced from electronic health records. This research was done working closely with the domain experts to validate the process models. The hospital patient journey model was used to assess flow abnormalities which resulted from incorrect timestamp data used in time-based performance metrics. The research demonstrated process mining as a feasible methodology to assess data quality of time-based hospital performance metrics. The insight gained from this research enabled appropriate corrective actions to be put in place to address the data quality issues. © The Author(s) 2015.

Measurement of the dimensions of food insecurity in developed countries: a systematic literature review.

PubMed

Ashby, Stephanie; Kleve, Suzanne; McKechnie, Rebecca; Palermo, Claire

2016-11-01

Food insecurity is a salient health issue comprised of four dimensions - food access, availability, utilization and stability over time. The aim of the present study was to conduct a systematic literature review to identify all multi-item tools that measure food insecurity and explore which of the dimensions they assess. Five databases were searched (CENTRAL, CINAHL plus, EMBASE, MEDLINE, TRIP) for studies published in English since 1999. Inclusion criteria included human studies using multi-item tools to measure food security and studies conducted in developed countries. Manuscripts describing the US Department of Agriculture Food Security Survey Module, that measures 'food access', were excluded due to wide acceptance of the validity and reliability of this instrument. Two authors extracted data and assessed the quality of the included studies. Data were summarized against the dimensions of food insecurity. A systematic review of the literature. The majority of tools were developed in the USA and had been used in different age groups and cultures. Eight multi-item tools were identified. All of the tools assessed the 'food access' dimension and two partially assessed the dimensions 'food utilization' and 'stability over time', respectively. 'Food availability' was not assessed by existing tools. Current tools available for measuring food insecurity are subjective, limited in scope, with a majority assessing only one dimension of food insecurity (access). To more accurately assess the true burden of food insecurity, tools should be adapted or developed to assess all four dimensions of food insecurity.

Development of a web-based toolkit to support improvement of care coordination in primary care.

PubMed

Ganz, David A; Barnard, Jenny M; Smith, Nina Z Y; Miake-Lye, Isomi M; Delevan, Deborah M; Simon, Alissa; Rose, Danielle E; Stockdale, Susan E; Chang, Evelyn T; Noël, Polly H; Finley, Erin P; Lee, Martin L; Zulman, Donna M; Cordasco, Kristina M; Rubenstein, Lisa V

2018-05-23

Promising practices for the coordination of chronic care exist, but how to select and share these practices to support quality improvement within a healthcare system is uncertain. This study describes an approach for selecting high-quality tools for an online care coordination toolkit to be used in Veterans Health Administration (VA) primary care practices. We evaluated tools in three steps: (1) an initial screening to identify tools relevant to care coordination in VA primary care, (2) a two-clinician expert review process assessing tool characteristics (e.g. frequency of problem addressed, linkage to patients' experience of care, effect on practice workflow, and sustainability with existing resources) and assigning each tool a summary rating, and (3) semi-structured interviews with VA patients and frontline clinicians and staff. Of 300 potentially relevant tools identified by searching online resources, 65, 38, and 18 remained after steps one, two and three, respectively. The 18 tools cover five topics: managing referrals to specialty care, medication management, patient after-visit summary, patient activation materials, agenda setting, patient pre-visit packet, and provider contact information for patients. The final toolkit provides access to the 18 tools, as well as detailed information about tools' expected benefits, and resources required for tool implementation. Future care coordination efforts can benefit from systematically reviewing available tools to identify those that are high quality and relevant.

The nematode Caenorhabditis elegans as an integrated toxicological tool to assess water quality and pollution.

PubMed

Clavijo, Araceli; Kronberg, María Florencia; Rossen, Ariana; Moya, Aldana; Calvo, Daniel; Salatino, Santa Esmeralda; Pagano, Eduardo Antonio; Morábito, José Antonio; Munarriz, Eliana Rosa

2016-11-01

Determination of water quality status in rivers is critical to establish a sustainable water management policy. For this reason, over the last decades it has been recommended to perform integrated water assessments that include water quantities and physicochemical, ecological and toxicological tests. However, sometimes resources are limited and it is not possible to perform large-scale chemical determinations of pollutants or conduct numerous ecotoxicological tests. To overcome this problem we use and measure the growth, as a response parameter, of the soil nematode Caenorhabditis elegans to assess water quality in rivers. The C. elegans is a ubiquitous organism that has emerged as an important model organism in aquatic and soil toxicology research. The Tunuyán River Basin (Province of Mendoza, Argentina) has been selected as a representative traditional water monitoring system to test the applicability of the C. elegans toxicological bioassay to generate an integrated water quality evaluation. Jointly with the C. elegans toxic assays, physicochemical and bacteriological parameters were determined for each monitoring site. C. elegans bioassays help to identify different water qualities in the river basin. Multivariate statistical analysis (PCA and linear regression models) has allowed us to confirm that traditional water quality studies do not predict potential toxic effects on living organisms. On the contrary, physicochemical and bacteriological analyzes explain <62% of the C. elegans growth response variability, showing that ecotoxicological bioassays are important to obtain a realistic scenario of water quality threats. Our results confirm that the C. elegans bioassay is a sensible and suitable tool to assess toxicity and should be implemented in routine water quality monitoring. Copyright © 2016 Elsevier B.V. All rights reserved.

PROJECT SUMMARY: DEVELOPMENT OF THE VIRTUAL BEACH MODEL, PHASE I: AN EMPIRICAL MODEL

EPA Science Inventory

Mathematical models based on water-quality and other environmental surrogates may help to provide water quality assessment within a few hours and potentially provide one to three day forecasts, providing beach managers and public-health officials a tool for developing beach-speci...

Assessing the radar rainfall estimates in watershed-scale water quality model

USDA-ARS?s Scientific Manuscript database

Watershed-scale water quality models are effective science-based tools for interpreting change in complex environmental systems that affect hydrology cycle, soil erosion and nutrient fate and transport in watershed. Precipitation is one of the primary input data to achieve a precise rainfall-runoff ...

Recent Developments in Hyperspectral Imaging for Assessment of Food Quality and Safety

PubMed Central

Huang, Hui; Liu, Li; Ngadi, Michael O.

2014-01-01

Hyperspectral imaging which combines imaging and spectroscopic technology is rapidly gaining ground as a non-destructive, real-time detection tool for food quality and safety assessment. Hyperspectral imaging could be used to simultaneously obtain large amounts of spatial and spectral information on the objects being studied. This paper provides a comprehensive review on the recent development of hyperspectral imaging applications in food and food products. The potential and future work of hyperspectral imaging for food quality and safety control is also discussed. PMID:24759119

Addendum to Air Quality: Decision Support Tools, Partner Plans, Working Groups, Committees

NASA Technical Reports Server (NTRS)

Holekamp, Kara; Frisbie, Troy; Estep, Lee

2005-01-01

In the original report dated February 11, 2005, the utility of NASA Earth science data in the air quality activities of other agencies and organizations was assessed by reviewing strategic and mission plans and by conducting personal interviews with agency experts to identify and investigate agencies with the potential for partnership with NASA. The overarching agency strategic plans were reviewed and commonalities such as the desire for partnerships and technology development were noted. This addendum to the original report contains such information about the Tennessee Valley Authority and will be inserted as Section 2.6 of "Air Quality: Decision Support Tools, Partner Plans, Working Groups, Committees."

Addendum to Air Quality: Decision Support Tools, Partner Plans, Working Groups, Committees

NASA Technical Reports Server (NTRS)

Holekamp, Kara; Frisbie, Troy; Estep, Lee

2005-01-01

In the original report dated February 11, 2005, the utility of the NASA Earth science data in the air quality activities of other agencies and organizations was assessed by reviewing strategic and mission plans and by conducting personal interviews with agency experts to identify and investigate agencies with the potential for partnership with NASA. The overarching agency strategic plans were reviewed and commonalities such as the desire for partnerships and technology development were noted. The addendum to the original report contains such information about the Tennessee Valley Authority and will be inserted in Section 2.6 of "Air Quality Decision Support Tools, Partner Plans, Working Groups, Committees".

On the question of economic efficiency and how to assess it

NASA Astrophysics Data System (ADS)

Petrosyan, M. O.; Kovalev, I. V.; Zelenkov, P. V.; Chuvashova, M. N.; Grishina, I. A.; Pershakova, K. K.

2016-04-01

Over the years, since the world moved to a system of market-based economic relations scientists and businessmen worldwide wonder how to ease and modernize the process of analyzing business performance. During this time, a variety of methods and tools have been developed to deal with this problem. After all, the productivity of the company is directly related to it’s competitive qualities, so the managers are interested in the quality of evaluation of their companies. The article deals with the traditional methods of evaluating the performance of enterprises and some of the tools used in order to improve its quality.

LOUISIANA ENVIRONMENTAL MODELING SYSTEM FOR HYPOXIA RELATED ISSUES

EPA Science Inventory

An environmental assessment tool to evaluate the impacts of nonpoint source (NPS) pollutants discharged from Mississippi River basins into the Gulf of Mexico and to assess their effects on receiving water quality will be described. This system (Louisiana Environmental Modeling S...

Quality of life tools in head and neck oncology.

PubMed

Heutte, N; Plisson, L; Lange, M; Prevost, V; Babin, E

2014-02-01

Quality of life (QoL) is now as much an assessment criterion in clinical trials in head and neck oncology as are survival and response rate. It is therefore important to be able to choose an adapted tool from the wide range of QoL instruments available. The present study presents an inventory of QoL scales validated in their French-language version, to facilitate the selection of appropriate tools showing good psychometric properties. QoL scales cited in all 492 French and English language articles published between March 1st, 2006 and April 3rd, 2012, referenced on Medline and retrieved using the keywords "quality of life" AND "head and neck" AND "cancer", were inventoried and classified thematically in a search of the literature. Ninety QoL scales are presented by theme (ORL oncology, voice, swallowing and mastication, mucosities and xerostomia, etc.), specifying psychometric quality and citation level. The present report constitutes a guide to selecting QoL tools adapted to head and neck oncology studies. Copyright © 2013 Elsevier Masson SAS. All rights reserved.

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

Mental health nurses' views about antipsychotic medication side effects.

PubMed

Stomski, N J; Morrison, P; Meehan, T

2016-08-01

WHAT IS KNOWN ON THE SUBJECT?: The only previous quantitative study that examined nurses' use of assessment tools to identify antipsychotic medication side effects found that about 25% of mental health nurses were using assessment tools. No previous studies have examined factors that influence the manner in which mental health nurses assess antipsychotic medication side effects. WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: One-third of the respondents were not aware of any antipsychotic medication side-effect assessment tool, and only one-quarter were currently using an assessment tool. 'Service responsibility' was significantly associated with ongoing use of antipsychotic medication assessment tools, indicating that respondents with more positive attitudes to their service were more likely to continue using antipsychotic medication assessment tools. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: The low level of awareness and use of antipsychotic medication side-effect assessment tools indicates that nursing educational institutions should incorporate more detail about these tools in course content, and emphasize in particular the benefits that result from the use of these tools in clinical practice. Service processes contributed significantly to the use of antipsychotic medication assessment tools, which indicates that managers need to foster workplace cultures that promote routine use of these tools. Introduction Limited evidence suggests that only a minority of mental health nurses regularly use standardized assessment tools to assess antipsychotic medication side effects, but the factors that contribute to the non-routine use of these tools remain unknown. Aim To examine Australian mental health nurses' awareness of, and attitudes towards, side-effect assessment tools, and also identify factors the influence the use of these tools. Methods A cross-sectional survey was undertaken through distributing an online questionnaire via email to members of the Australian College of Mental Health Nurses. Completed questionnaires were received from 171 respondents. Linear regression was used to examine the relationship between the 'service responsibility' and 'personal confidence' scale scores, and awareness, previous use and ongoing use of antipsychotic medication assessment tools. Results Only one-quarter of the respondents (26.5%) were currently using an assessment tool. 'Service responsibility' was significantly associated with ongoing use of antipsychotic medication assessment tools (Β = 3.26; 95% CI 0.83-5.69). 'Personal confidence' did not influence the ongoing use of assessment tools (Β = -0.05; 95% CI -1.06-1.50). Implications for clinical practice Stakeholders can incorporate 'service responsibility' processes to foster increased use of assessment tools, which may enhance the identification antipsychotic medication side effects and improve the quality of care for service users. © 2016 John Wiley & Sons Ltd.

Towards better digital pathology workflows: programming libraries for high-speed sharpness assessment of Whole Slide Images

PubMed Central

2014-01-01

Background Since microscopic slides can now be automatically digitized and integrated in the clinical workflow, quality assessment of Whole Slide Images (WSI) has become a crucial issue. We present a no-reference quality assessment method that has been thoroughly tested since 2010 and is under implementation in multiple sites, both public university-hospitals and private entities. It is part of the FlexMIm R&D project which aims to improve the global workflow of digital pathology. For these uses, we have developed two programming libraries, in Java and Python, which can be integrated in various types of WSI acquisition systems, viewers and image analysis tools. Methods Development and testing have been carried out on a MacBook Pro i7 and on a bi-Xeon 2.7GHz server. Libraries implementing the blur assessment method have been developed in Java, Python, PHP5 and MySQL5. For web applications, JavaScript, Ajax, JSON and Sockets were also used, as well as the Google Maps API. Aperio SVS files were converted into the Google Maps format using VIPS and Openslide libraries. Results We designed the Java library as a Service Provider Interface (SPI), extendable by third parties. Analysis is computed in real-time (3 billion pixels per minute). Tests were made on 5000 single images, 200 NDPI WSI, 100 Aperio SVS WSI converted to the Google Maps format. Conclusions Applications based on our method and libraries can be used upstream, as calibration and quality control tool for the WSI acquisition systems, or as tools to reacquire tiles while the WSI is being scanned. They can also be used downstream to reacquire the complete slides that are below the quality threshold for surgical pathology analysis. WSI may also be displayed in a smarter way by sending and displaying the regions of highest quality before other regions. Such quality assessment scores could be integrated as WSI's metadata shared in clinical, research or teaching contexts, for a more efficient medical informatics workflow. PMID:25565494

Duly noted: Lessons from a two-site intervention to assess and improve the quality of clinical documentation in the electronic health record.

PubMed

Fanucchi, Laura; Yan, Donglin; Conigliaro, Rosemarie L

2016-07-06

Communication errors are identified as a root cause contributing to a majority of sentinel events. The clinical note is a cornerstone of physician communication, yet there are few published interventions on teaching note writing in the electronic health record (EHR). This is a prospective, two-site, quality improvement project to assess and improve the quality of clinical documentation in the EHR using a validated assessment tool. Internal Medicine (IM) residents at the University of Kentucky College of Medicine (UK) and Montefiore Medical Center/Albert Einstein College of Medicine (MMC) received one of two interventions during an inpatient ward month: either a lecture, or a lecture and individual feedback on progress notes. A third group of residents in each program served as control. Notes were evaluated with the Physician Documentation Quality Instrument 9 (PDQI-9). Due to a significant difference in baseline PDQI-9 scores at MMC, the sites were not combined. Of 75 residents at the UK site, 22 were eligible, 20 (91%) enrolled, 76 notes in total were scored. Of 156 residents at MMC, 22 were eligible, 18 (82%) enrolled, 40 notes in total were scored. Note quality did not improve as measured by the PDQI-9. This educational quality improvement project did not improve the quality of clinical documentation as measured by the PDQI-9. This project underscores the difficulty in improving note quality. Further efforts should explore more effective educational tools to improve the quality of clinical documentation in the EHR.

Use of ecological momentary assessment to determine which structural factors impact perceived teaching quality of attending rounds.

PubMed

Willett, Lisa; Houston, Thomas K; Heudebert, Gustavo R; Estrada, Carlos

2012-09-01

Providing high-quality teaching to residents during attending rounds is challenging. Reasons include structural factors that affect rounds, which are beyond the attending's teaching style and control. To develop a new evaluation tool to identify the structural components of ward rounds that most affect teaching quality in an internal medicine (IM) residency program. The authors developed a 10-item Ecological Momentary Assessment (EMA) tool and collected daily evaluations for 18 months from IM residents rotating on inpatient services. Residents ranked the quality of teaching on rounds that day, and questions related to their service (general medicine, medical intensive care unit, and subspecialty services), patient census, absenteeism of team members, call status, and number of teaching methods used by the attending. Residents completed 488 evaluation cards over 18 months. This found no association between perceived teaching quality and training level, team absenteeism, and call status. We observed differences by service (P < .001) and patient census (P  =  .009). After adjusting for type of service, census was no longer significant. Use of a larger variety of teaching methods was associated with higher perceived teaching quality, regardless of service or census (P for trend < .001). The EMA tool successfully identified that higher patient census was associated with lower perceived teaching quality, but the results were also influenced by the type of teaching service. We found that, regardless of census or teaching service, attendings can improve their teaching by diversifying the number of methods used in daily rounds.

Quality assessment of protein model-structures based on structural and functional similarities.

PubMed

Konopka, Bogumil M; Nebel, Jean-Christophe; Kotulska, Malgorzata

2012-09-21

Experimental determination of protein 3D structures is expensive, time consuming and sometimes impossible. A gap between number of protein structures deposited in the World Wide Protein Data Bank and the number of sequenced proteins constantly broadens. Computational modeling is deemed to be one of the ways to deal with the problem. Although protein 3D structure prediction is a difficult task, many tools are available. These tools can model it from a sequence or partial structural information, e.g. contact maps. Consequently, biologists have the ability to generate automatically a putative 3D structure model of any protein. However, the main issue becomes evaluation of the model quality, which is one of the most important challenges of structural biology. GOBA--Gene Ontology-Based Assessment is a novel Protein Model Quality Assessment Program. It estimates the compatibility between a model-structure and its expected function. GOBA is based on the assumption that a high quality model is expected to be structurally similar to proteins functionally similar to the prediction target. Whereas DALI is used to measure structure similarity, protein functional similarity is quantified using standardized and hierarchical description of proteins provided by Gene Ontology combined with Wang's algorithm for calculating semantic similarity. Two approaches are proposed to express the quality of protein model-structures. One is a single model quality assessment method, the other is its modification, which provides a relative measure of model quality. Exhaustive evaluation is performed on data sets of model-structures submitted to the CASP8 and CASP9 contests. The validation shows that the method is able to discriminate between good and bad model-structures. The best of tested GOBA scores achieved 0.74 and 0.8 as a mean Pearson correlation to the observed quality of models in our CASP8 and CASP9-based validation sets. GOBA also obtained the best result for two targets of CASP8, and one of CASP9, compared to the contest participants. Consequently, GOBA offers a novel single model quality assessment program that addresses the practical needs of biologists. In conjunction with other Model Quality Assessment Programs (MQAPs), it would prove useful for the evaluation of single protein models.

Quality of Patient Information Websites About Congenital Heart Defects: Mixed-Methods Study of Perspectives Among Individuals With Experience of a Prenatal Diagnosis.

PubMed

Carlsson, Tommy; Melander Marttala, Ulla; Wadensten, Barbro; Bergman, Gunnar; Axelsson, Ove; Mattsson, Elisabet

2017-09-12

When a heart defect is prenatally diagnosed in the fetus, expectant parents experience a great need for information about various topics. After the diagnosis, the Web is used for supplemental information, and the scarcity of research calls attention to the need to explore patient information websites from the perspectives of the intended consumers. The overarching aim of this study was to explore the quality of Swedish patient information websites about congenital heart defects, from the perspectives of individuals with experience of a prenatal diagnosis of congenital heart defect in the fetus. This was a mixed-methods study of websites identified through systematic searches in the two most used Web-based search engines. Of the total 80 screened hits, 10 hits led to patient information websites about congenital heart defects. A quality assessment tool inspired by a previous study was used to evaluate each website's appearance, details, relevance, suitability, information about treatment choices, and overall quality. Answers were given on a 5-point Likert scale, ranging from 1, representing the lowest score, to 5, representing the highest score. Each website was assessed individually by persons with experience of continued (n=4) and terminated (n=5) pregnancy following a prenatal diagnosis. Assessments were analyzed with Kendall's coefficient of concordance W, Mann-Whitney U test, Friedman's test, and a Wilcoxon-Nemenyi-McDonald-Thompson test. In addition, each assessor submitted written responses to open-ended questions in the quality assessment tool, and two joint focus group discussions were conducted with each group of assessors. The qualitative data were analyzed with inductive manifest content analysis. Assessments represented a low score (median=2.0) for treatment choices and moderate scores (median=3.0) for appearance, details, relevance, suitability, and overall quality. No website had a median of the highest achievable score for any of the questions in the quality assessment tool. Medians of the lowest achievable score were found in questions about treatment choices (n=4 websites), details (n=2 websites), suitability (n=1 website), and overall quality (n=1 website). Websites had significantly different scores for appearance (P=.01), details (P<.001), relevance (P<.001), suitability (P<.001), treatment choices (P=.04), and overall quality (P<.001). The content analysis of the qualitative data generated six categories: (1) advertisements, (2) comprehensiveness, (3) design, (4) illustrations and pictures, (5) language, and (6) trustworthiness. Various issues with the included websites were highlighted, including the use of inappropriate advertisements, biased information, poor illustrations, complex language, and poor trustworthiness. From the perspectives of the intended consumers, patient information websites about congenital heart defects are, to a large extent, inadequate tools for supplemental information following a prenatal diagnosis. Health professionals should initiate discussions with patients about their intentions to use the Web, inform them about the varied quality in the Web-based landscape, and offer recommendations for appropriate Web-based sources. ©Tommy Carlsson, Ulla Melander Marttala, Barbro Wadensten, Gunnar Bergman, Ove Axelsson, Elisabet Mattsson. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 12.09.2017.

Quality of Patient Information Websites About Congenital Heart Defects: Mixed-Methods Study of Perspectives Among Individuals With Experience of a Prenatal Diagnosis

PubMed Central

Melander Marttala, Ulla; Wadensten, Barbro; Bergman, Gunnar; Axelsson, Ove; Mattsson, Elisabet

2017-01-01

Background When a heart defect is prenatally diagnosed in the fetus, expectant parents experience a great need for information about various topics. After the diagnosis, the Web is used for supplemental information, and the scarcity of research calls attention to the need to explore patient information websites from the perspectives of the intended consumers. Objective The overarching aim of this study was to explore the quality of Swedish patient information websites about congenital heart defects, from the perspectives of individuals with experience of a prenatal diagnosis of congenital heart defect in the fetus. Methods This was a mixed-methods study of websites identified through systematic searches in the two most used Web-based search engines. Of the total 80 screened hits, 10 hits led to patient information websites about congenital heart defects. A quality assessment tool inspired by a previous study was used to evaluate each website’s appearance, details, relevance, suitability, information about treatment choices, and overall quality. Answers were given on a 5-point Likert scale, ranging from 1, representing the lowest score, to 5, representing the highest score. Each website was assessed individually by persons with experience of continued (n=4) and terminated (n=5) pregnancy following a prenatal diagnosis. Assessments were analyzed with Kendall’s coefficient of concordance W, Mann-Whitney U test, Friedman’s test, and a Wilcoxon-Nemenyi-McDonald-Thompson test. In addition, each assessor submitted written responses to open-ended questions in the quality assessment tool, and two joint focus group discussions were conducted with each group of assessors. The qualitative data were analyzed with inductive manifest content analysis. Results Assessments represented a low score (median=2.0) for treatment choices and moderate scores (median=3.0) for appearance, details, relevance, suitability, and overall quality. No website had a median of the highest achievable score for any of the questions in the quality assessment tool. Medians of the lowest achievable score were found in questions about treatment choices (n=4 websites), details (n=2 websites), suitability (n=1 website), and overall quality (n=1 website). Websites had significantly different scores for appearance (P=.01), details (P<.001), relevance (P<.001), suitability (P<.001), treatment choices (P=.04), and overall quality (P<.001). The content analysis of the qualitative data generated six categories: (1) advertisements, (2) comprehensiveness, (3) design, (4) illustrations and pictures, (5) language, and (6) trustworthiness. Various issues with the included websites were highlighted, including the use of inappropriate advertisements, biased information, poor illustrations, complex language, and poor trustworthiness. Conclusions From the perspectives of the intended consumers, patient information websites about congenital heart defects are, to a large extent, inadequate tools for supplemental information following a prenatal diagnosis. Health professionals should initiate discussions with patients about their intentions to use the Web, inform them about the varied quality in the Web-based landscape, and offer recommendations for appropriate Web-based sources. PMID:28899846

Measuring activities and participation in persons with haemophilia: A systematic review of commonly used instruments.

PubMed

Timmer, M A; Gouw, S C; Feldman, B M; Zwagemaker, A; de Kleijn, P; Pisters, M F; Schutgens, R E G; Blanchette, V; Srivastava, A; David, J A; Fischer, K; van der Net, J

2018-03-01

Monitoring clinical outcome in persons with haemophilia (PWH) is essential in order to provide optimal treatment for individual patients and compare effectiveness of treatment strategies. Experience with measurement of activities and participation in haemophilia is limited and consensus on preferred tools is lacking. The aim of this study was to give a comprehensive overview of the measurement properties of a selection of commonly used tools developed to assess activities and participation in PWH. Electronic databases were searched for articles that reported on reliability, validity or responsiveness of predetermined measurement tools (5 self-reported and 4 performance based measurement tools). Methodological quality of the studies was assessed according to the COSMIN checklist. Best evidence synthesis was used to summarize evidence on the measurement properties. The search resulted in 3453 unique hits. Forty-two articles were included. The self-reported Haemophilia Acitivity List (HAL), Pediatric HAL (PedHAL) and the performance based Functional Independence Score in Haemophilia (FISH) were studied most extensively. Methodological quality of the studies was limited. Measurement error, cross-cultural validity and responsiveness have been insufficiently evaluated. Albeit based on limited evidence, the measurement properties of the PedHAL, HAL and FISH are currently considered most satisfactory. Further research needs to focus on measurement error, responsiveness, interpretability and cross-cultural validity of the self-reported tools and validity of performance based tools which are able to assess limitations in sports and leisure activities. © 2018 The Authors. Haemophilia Published by John Wiley & Sons Ltd.

Development and validation of an observation tool for the assessment of nursing pain management practices in intensive care unit in a standardized clinical simulation setting.

PubMed

Gosselin, Emilie; Bourgault, Patricia; Lavoie, Stephan; Coleman, Robin-Marie; Méziat-Burdin, Anne

2014-12-01

Pain management in the intensive care unit is often inadequate. There is no tool available to assess nursing pain management practices. The aim of this study was to develop and validate a measuring tool to assess nursing pain management in the intensive care unit during standardized clinical simulation. A literature review was performed to identify relevant components demonstrating optimal pain management in adult intensive care units and to integrate them in an observation tool. This tool was submitted to an expert panel and pretested. It was then used to assess pain management practice during 26 discrete standardized clinical simulation sessions with intensive care nurses. The Nursing Observation Tool for Pain Management (NOTPaM) contains 28 statements grouped into 8 categories, which are grouped into 4 dimensions: subjective assessment, objective assessment, interventions, and reassessment. The tool's internal consistency was calculated at a Cronbach's alpha of 0.436 for the whole tool; the alpha varies from 0.328 to 0.518 for each dimension. To evaluate the inter-rater reliability, intra-class correlation coefficient was used, which was calculated at 0.751 (p < .001) for the whole tool, with variations from 0.619 to 0.920 (p < .01) between dimensions. The expert panel was satisfied with the content and face validity of the tool. The psychometric qualities of the NOTPaM developed in this study are satisfactory. However, the tool could be improved with slight modifications. Nevertheless, it was useful in assessing intensive care nurses' pain management in a standardized clinical simulation. The NOTPaM is the first tool created for this purpose. Copyright © 2014 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Investigating the Psychometric Properties of the ACEI Global Guidelines Assessment (GGA) in Four Countries

ERIC Educational Resources Information Center

Hardin, Belinda J.; Bergen, Doris; Hung, Hsuan-Fang

2013-01-01

The ACEI Global Guidelines Assessment (GGA) was developed to provide an international assessment tool that can be used by early childhood educators to develop, assess, and improve program quality worldwide. This pilot study was conducted in four countries to investigate the psychometric properties of the GGA within and across different countries.…

Improving the Quality of Voluntary Medical Male Circumcision through Use of the Continuous Quality Improvement Approach: A Pilot in 30 PEPFAR-Supported Sites in Uganda

PubMed Central

Opio, Alex; Calnan, Jacqueline; Njeuhmeli, Emmanuel

2015-01-01

Background Uganda adopted voluntary medical male circumcision (VMMC) (also called Safe Male Circumcision in Uganda), as part of its HIV prevention strategy in 2010. Since then, the Ministry of Health (MOH) has implemented VMMC mostly with support from the United States President’s Emergency Plan for AIDS Relief (PEPFAR) through its partners. In 2012, two PEPFAR-led external quality assessments evaluated compliance of service delivery sites with minimum quality standards. Quality gaps were identified, including lack of standardized forms or registers, lack of documentation of client consent, poor preparedness for emergencies and use of untrained service providers. In response, PEPFAR, through a USAID-supported technical assistance project, provided support in quality improvement to the MOH and implementing partners to improve quality and safety in VMMC services and build capacity of MOH staff to continuously improve VMMC service quality. Methods and Findings Sites were supported to identify barriers in achieving national standards, identify possible solutions to overcome the barriers and carry out improvement plans to test these changes, while collecting performance data to objectively measure whether they had bridged gaps. A 53-indicator quality assessment tool was used by teams as a management tool to measure progress; teams also measured client-level indicators through self-assessment of client records. At baseline (February-March 2013), less than 20 percent of sites scored in the “good” range (>80%) for supplies and equipment, patient counseling and surgical procedure; by November 2013, the proportion of sites scoring “good” rose to 67 percent, 93 percent and 90 percent, respectively. Significant improvement was noted in post-operative follow-up at 48 hours, sexually transmitted infection assessment, informed consent and use of local anesthesia but not rate of adverse events. Conclusion Public sector providers can be engaged to address the quality of VMMC using a continuous quality improvement approach. PMID:26207986

Integrating Quality Improvement Education into the Nephrology Curricular Milestones Framework and the Clinical Learning Environment Review

PubMed Central

Prince, Lisa K.; Little, Dustin J.; Schexneider, Katherine I.

2017-01-01

The Accreditation Council for Graduate Medical Education requires that trainees show progressive milestone attainment in the practice–based learning and systems–based practice competencies. As part of the Clinical Learning Environment Review, sponsoring hospitals must educate trainees in health care quality improvement, provide them with specialty–specific quality data, and ensure trainee participation in quality improvement activities and committees. Subspecialty–specific quality improvement curricula in nephrology training programs have not been reported, although considerable curricular and assessment material exists for specialty residencies, including tools for assessing trainee and faculty competence. Nephrology–specific didactic material exists to assist nephrology fellows and faculty mentors in designing and implementing quality improvement projects. Nephrology is notable among internal medicine subspecialties for the emphasis placed on adherence to quality thresholds—specifically for chronic RRT shown by the Centers for Medicare and Medicaid Services Quality Incentive Program. We have developed a nephrology-specific curriculum that meets Accreditation Council for Graduate Medical Education and Clinical Learning Environment Review requirements, acknowledges regulatory quality improvement requirements, integrates with ongoing divisional quality improvement activities, and has improved clinical care and the training program. In addition to didactic training in quality improvement, we track trainee compliance with Kidney Disease Improving Global Outcomes CKD and ESRD quality indicators (emphasizing Quality Improvement Program indicators), and fellows collaborate on a yearly multidisciplinary quality improvement project. Over the past 6 years, each fellowship class has, on the basis of a successful quality improvement project, shown milestone achievement in Systems-Based Practice and Practice-Based Learning. Fellow quality improvement projects have improved nephrology clinical care within the institution and introduced new educational and assessment tools to the training program. All have been opportunities for quality improvement scholarship. The curriculum prepares fellows to apply quality improvement principals in independent clinical practice—while showing milestone advancement and divisional compliance with Clinical Learning Environment Review requirements. PMID:28174318

Assessing patients' eligibility for fully funded nursing care.

PubMed

Anderson, William; Bungay, Hilary

The introduction of free nursing care in nursing homes requires that patients' needs for care from a registered nurse are determined as part of the assessment of health and social care needs. It is important that patients are assigned to the band of care that is appropriate for them so that they receive the correct contribution to their care. A minimum data set/resident assessment instrument was piloted on residents living in nursing homes as an assessment tool to see whether this agreed with decisions that had been made by the NHS-designated assessor for the registered nursing contribution to care. Comparison of findings showed that the assessment tool was a means of improving the quality of assessments.

a Free and Open Source Tool to Assess the Accuracy of Land Cover Maps: Implementation and Application to Lombardy Region (italy)

NASA Astrophysics Data System (ADS)

Bratic, G.; Brovelli, M. A.; Molinari, M. E.

2018-04-01

The availability of thematic maps has significantly increased over the last few years. Validation of these maps is a key factor in assessing their suitability for different applications. The evaluation of the accuracy of classified data is carried out through a comparison with a reference dataset and the generation of a confusion matrix from which many quality indexes can be derived. In this work, an ad hoc free and open source Python tool was implemented to automatically compute all the matrix confusion-derived accuracy indexes proposed by literature. The tool was integrated into GRASS GIS environment and successfully applied to evaluate the quality of three high-resolution global datasets (GlobeLand30, Global Urban Footprint, Global Human Settlement Layer Built-Up Grid) in the Lombardy Region area (Italy). In addition to the most commonly used accuracy measures, e.g. overall accuracy and Kappa, the tool allowed to compute and investigate less known indexes such as the Ground Truth and the Classification Success Index. The promising tool will be further extended with spatial autocorrelation analysis functions and made available to researcher and user community.

The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource

Finding the State Story in the National Lake Survey Data with an Excel Exploratory Tool

EPA Science Inventory

The National Lakes Assessment (NLA) surveyed over 1200 U.S. lakes in the summer of 2007, evaluating lake quality based on water quality, physical habitat, and indicators of biological and recreational condition. An upcoming national report will summarize survey results primarily ...

Handbook for Qualities of Effective Teachers

ERIC Educational Resources Information Center

Stronge, James H.; Tucker, Pamela D.; Hindman, Jennifer L.

2004-01-01

This book makes it much easier to implement a staff development, teacher education, or self-help program to improve the six research-based teacher qualities that are most apt to raise student achievement. Use the dozens of assessments, observation guides, planning tools, and other resources to: (1) Strengthen teachers' verbal abilities, content…

Accreditations as Local Management Tools

ERIC Educational Resources Information Center

Cret, Benoit

2011-01-01

The development of accreditation agencies within the Higher Education sector in order to assess and guarantee the quality of services or product is still a growing phenomenon in Europe. Accreditations are conceived by institutional authors and by authors who directly deal with quality assurance processes as a means of legitimization or a means of…

Behind the Scenes

ERIC Educational Resources Information Center

Dahnert, Roger; Pack, Andrew

2007-01-01

High-quality sports facilities are an essential tool in recruiting top collegiate athletes and coaches. They enhance the school's competitiveness and enable expansion of the school's sports programs. In choosing schools, top athletes and coaches assess the quality of the stadium, playing fields, track and courts. But they also will be looking at…

ANALYSIS OF LANDSCAPE AND WATER QUALITY IN THE NEW YORK CATSKILL - DELAWARE WATERSHED (1973-1998)

EPA Science Inventory

The primary goal of this study is to improve risk assessment through the development of methods and tools for characterization of landscape and water resource change. Exploring the relationship between landscape pattern and water quality in the Catskill-Delaware basins will impro...

INTERNATIONAL PERSPECTIVE: U.S. EPA'S APPROACH TO SURVEILLANCE AND MANAGEMENT OF WATER QUALITY

EPA Science Inventory

For the past 35 years, the Environmental Protection Agency (EPA) has been establishing health-based standards for more than 80 contaminants and developing water quality methods and tools to monitor, assess, and report on the health of America's water resources. The Safe Drinking ...

77 FR 4808 - Conference on Air Quality Modeling

Federal Register 2010, 2011, 2012, 2013, 2014

2012-01-31

... update our available modeling tools with state-of-the-science techniques and for the public to offer new... C111, 109 T.W. Alexander Drive, Research Triangle Park, NC 27711. FOR FURTHER INFORMATION CONTACT... Quality Assessment Division, Mail Code C439-01, Research Triangle Park, NC 27711; telephone: (919) 541...

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

ERIC Educational Resources Information Center

Wind, Stefanie A.; Engelhard, George, Jr.

2016-01-01

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement…

NEIGHBORHOOD SCALE MODELING OF PM 2.5 AND AIR TOXICS CONCENTRATION DISTRIBUTIONS TO DRIVE HUMAN EXPOSURE MODELS

EPA Science Inventory

Air quality (AQ) simulation models provide a basis for implementing the National Ambient Air Quality Standards (NAAQS) and are a tool for performing risk-based assessments and for developing environmental management strategies. Fine particulate matter (PM 2.5), its constituent...

Program Quality in Leadership Preparation Programs: An Assessment Tool

ERIC Educational Resources Information Center

Campanotta, Linda; Simpson, Patricia; Newton, Jodi

2018-01-01

The leadership of school principals is widely considered to have a strong influence on the quality of teaching and learning in schools. University-based leadership preparation programs have the responsibility for preparing candidates to serve as school principals and in other leadership capacities. This qualitative study of educational leadership…

Taking stock of monitoring and evaluation systems in the health sector: findings from Rwanda and Uganda.

PubMed

Holvoet, Nathalie; Inberg, Liesbeth

2014-07-01

In the context of sector-wide approaches and the considerable funding being put into the health sectors of low-income countries, the need to invest in well-functioning national health sector monitoring and evaluation (M&E) systems is widely acknowledged. Regardless of the approach adopted, an important first step in any strategy for capacity development is to diagnose the quality of existing systems or arrangements, taking into account both the supply and demand sides of M&E. As no standardized M&E diagnostic instrument currently exists, we first invested in the development of an assessment tool for sector M&E systems. To counter the criticism that M&E is often narrowed down to a focus on technicalities, our diagnostic tool assesses the quality of M&E systems according to six dimensions: (i) policy; (ii) quality of indicators and data (collection) and methodology; (iii) organization (further divided into iiia: structure and iiib: linkages); (iv) capacity; (v) participation of non-government actors and (vi) M&E outputs: quality and use. We subsequently applied the assessment tool to the health sector M&E systems of Rwanda and Uganda, and this article provides a comparative overview of the main research findings. Our research may have important implications for policy, as both countries receive health sector (budget) support in relation to which M&E system diagnosis and improvement are expected to be high on the agenda. The findings of our assessments indicate that, thus far, the health sector M&E systems in Rwanda and Uganda can at best be diagnosed as 'fragmentary', with some stronger and weaker elements. Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine © The Author 2013; all rights reserved.

Assessing air quality in Aksaray with time series analysis

NASA Astrophysics Data System (ADS)

Kadilar, Gamze Özel; Kadilar, Cem

2017-04-01

Sulphur dioxide (SO2) is a major air pollutant caused by the dominant usage of diesel, petrol and fuels by vehicles and industries. One of the most air-polluted city in Turkey is Aksaray. Hence, in this study, the level of SO2 is analyzed in Aksaray based on the database monitored at air quality monitoring station of Turkey. Seasonal Autoregressive Integrated Moving Average (SARIMA) approach is used to forecast the level of SO2 air quality parameter. The results indicate that the seasonal ARIMA model provides reliable and satisfactory predictions for the air quality parameters and expected to be an alternative tool for practical assessment and justification.

Positional Quality Assessment of Orthophotos Obtained from Sensors Onboard Multi-Rotor UAV Platforms

PubMed Central

Mesas-Carrascosa, Francisco Javier; Rumbao, Inmaculada Clavero; Berrocal, Juan Alberto Barrera; Porras, Alfonso García-Ferrer

2014-01-01

In this study we explored the positional quality of orthophotos obtained by an unmanned aerial vehicle (UAV). A multi-rotor UAV was used to obtain images using a vertically mounted digital camera. The flight was processed taking into account the photogrammetry workflow: perform the aerial triangulation, generate a digital surface model, orthorectify individual images and finally obtain a mosaic image or final orthophoto. The UAV orthophotos were assessed with various spatial quality tests used by national mapping agencies (NMAs). Results showed that the orthophotos satisfactorily passed the spatial quality tests and are therefore a useful tool for NMAs in their production flowchart. PMID:25587877

Positional quality assessment of orthophotos obtained from sensors onboard multi-rotor UAV platforms.

PubMed

Mesas-Carrascosa, Francisco Javier; Rumbao, Inmaculada Clavero; Berrocal, Juan Alberto Barrera; Porras, Alfonso García-Ferrer

2014-11-26

In this study we explored the positional quality of orthophotos obtained by an unmanned aerial vehicle (UAV). A multi-rotor UAV was used to obtain images using a vertically mounted digital camera. The flight was processed taking into account the photogrammetry workflow: perform the aerial triangulation, generate a digital surface model, orthorectify individual images and finally obtain a mosaic image or final orthophoto. The UAV orthophotos were assessed with various spatial quality tests used by national mapping agencies (NMAs). Results showed that the orthophotos satisfactorily passed the spatial quality tests and are therefore a useful tool for NMAs in their production flowchart.

Remote assessment of acne: the use of acne grading tools to evaluate digital skin images.

PubMed

Bergman, Hagit; Tsai, Kenneth Y; Seo, Su-Jean; Kvedar, Joseph C; Watson, Alice J

2009-06-01

Digital imaging of dermatology patients is a novel approach to remote data collection. A number of assessment tools have been developed to grade acne severity and to track clinical progress over time. Although these tools have been validated when used in a face-to-face setting, their efficacy and reliability when used to assess digital images have not been examined. The main purpose of this study was to determine whether specific assessment tools designed to grade acne during face-to-face visits can be applied to the evaluation of digital images. The secondary purpose was to ascertain whether images obtained by subjects are of adequate quality to allow such assessments to be made. Three hundred (300) digital images of patients with mild to moderate facial inflammatory acne from an ongoing randomized-controlled study were included in this analysis. These images were obtained from 20 patients and consisted of sets of 3 images taken over time. Of these images, 120 images were captured by subjects themselves and 180 were taken by study staff. Subjects were asked to retake their photographs if the initial images were deemed of poor quality by study staff. Images were evaluated by two dermatologists-in-training using validated acne assessment measures: Total Inflammatory Lesion Count, Leeds technique, and the Investigator's Global Assessment. Reliability of raters was evaluated using correlation coefficients and kappa statistics. Of the different acne assessment measures tested, the inter-rater reliability was highest for the total inflammatory lesion count (r = 0.871), but low for the Leeds technique (kappa = 0.381) and global assessment (kappa = 0.3119). Raters were able to evaluate over 89% of all images using each type of acne assessment measure despite the fact that images obtained by study staff were of higher quality than those obtained by patients (p < 0.001). Several existing clinical assessment measures can be used to evaluate digital images obtained from subjects with inflammatory acne lesions. The level of inter-rater agreement is highly variable across assessment measures, and we found the Total Inflammatory Lesion Count to be the most reliable. This measure could be used to allow a dermatologist to remotely track a patient's progress over time.

Using the HSE stress indicator tool in a military context.

PubMed

Bridger, Robert S; Dobson, Karen; Davison, Hannah

2016-01-01

An assessment of the Health and Safety Executive's (HSE) stress indicator tool was conducted to determine whether it was suitable for use with Ministry of Defence (MoD) personnel. A total of 1031 respondents from the Army, Navy, Air Force and MoD civilians completed a questionnaire containing the HSE tool and supplementary measures of work-life balance, engagement, deployment, leave taken and hours of work. Six measures of adverse reaction to the stressors were also reported: perceptions of job stress, job stress and health, psychological strain, fatigue after work, work ability and quality of working life. The stressor scales, particularly the 'demands' and 'relationships' scales, were associated with adverse outcomes as was the work-life balance scale. The HSE tool had some validity when used with MoD personnel, but its content was too narrow. The content validity of the tool can be improved for use in a military context with the addition of a 'work-life balance' scale'. The HSE stress tool was tested with a mixed sample of MoD employees. The ‘Demands and “Relationships” scales were associated with adverse outcomes. An additional Work–Life Balance’ scale improved the content validity, demonstrating the importance of assessing the psychometric qualities of scales when used within particular contexts to ensure validity.

Communication tools for end-of-life decision-making in the intensive care unit: a systematic review and meta-analysis.

PubMed

Oczkowski, Simon J W; Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J

2016-04-09

For many patients admitted to the intensive care unit (ICU), preferences for end-of-life care are unknown, and clinicians and substitute decision-makers are required to make decisions about the goals of care on their behalf. We conducted a systematic review to determine the effect of structured communication tools for end-of-life decision-making, compared to usual care, upon the number of documented goals of care discussions, documented code status, and decisions to withdraw life-sustaining treatments, in adult patients admitted to the ICU. We searched multiple databases including MEDLINE, Embase, CINAHL, ERIC, and Cochrane from database inception until July 2014. Two reviewers independently screened articles, assessed eligibility, verified data extraction, and assessed risk of bias using the tool described by the Cochrane Collaboration and the Newcastle Ottawa Scale. Pooled estimates of effect (relative risk, standardized mean difference, or mean difference), were calculated where sufficient data existed. GRADE was used to evaluate the overall quality of evidence for each outcome. We screened 5785 abstracts and reviewed the full text of 424 articles, finding 168 eligible articles, including 19 studies in the ICU setting. The use of communication tools increased documentation of goals-of-care discussions (RR 3.47, 95% CI 1.55, 7.75, p = 0.020, very low-quality evidence), but did not have an effect on code status documentation (RR 1.03, 95% CI 0.96, 1.10, p = 0.540, low-quality evidence) or decisions to withdraw or withhold life-sustaining treatments (RR 0.98, 95% CI 0.89, 1.08, p = 0.70, low-quality evidence). The use of such tools was associated with a decrease in multiple measures of health care resource utilization, including duration of mechanical ventilation (MD -1.9 days, 95% CI -3.26, -0.54, p = 0.006, very low-quality evidence), length of ICU stay (MD -1.11 days, 95% CI -2.18, -0.03, p = 0.04, very low-quality evidence), and health care costs (SMD -0.32, 95% CI -0.5, -0.15, p < 0.001, very low-quality evidence). Structured communication tools may improve documentation of EOL decision making and may result in lower resource use. The supporting evidence is low to very low in quality. Further high-quality randomized studies of simple communication interventions are needed to determine whether structured, rather than ad hoc, approaches to end-of-life decision-making improve patient-level, family-level, and system-level outcomes. PROSPERO CRD42014012913.

Robust Implementation of MDC: Teacher Perceptions of Tool Use and Outcomes. Brief Three

ERIC Educational Resources Information Center

Lawrence, Nancy; Sanders, Felicia

2012-01-01

The Bill and Melinda Gates Foundation has invested in the development and dissemination of high-quality instructional and formative assessment tools to support teachers' incorporation of the Common Core State Standards (CCSS) into their classroom instruction. Lessons from the first generation of standards-based reforms suggest that intense…

Robust Implementation of LDC: Teacher Perceptions of Tool Use and Outcomes. Brief Two

ERIC Educational Resources Information Center

Reumann-Moore, Rebecca; Sanders, Felicia

2012-01-01

The Bill and Melinda Gates Foundation has invested in the development and dissemination of high-quality instructional and formative assessment tools to support teachers' incorporation of the Common Core State Standards (CCSS) into their classroom instruction. Lessons from the first generation of standards-based reforms suggest that intense…

GIS as a Tool in Interdisciplinary Environmental Studies: Student, Teacher, and Community Perspectives.

ERIC Educational Resources Information Center

Alibrandi, Marsha

1998-01-01

Describes an application of Geographic Information Systems (GIS) technology as a tool in an environmental community-service project in which students and adult community members participated in water-quality monitoring and biological assessment. Discusses issues and problems associated with technology in education and recommends a balance of…

Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal

PubMed Central

Schwartz, Carolyn E; Rapkin, Bruce D

2004-01-01

The increasing evidence for response shift phenomena in quality of life (QOL) assessment points to the necessity to reconsider both the measurement model and the application of psychometric analyses. The proposed psychometric model posits that the QOL true score is always contingent upon parameters of the appraisal process. This new model calls into question existing methods for establishing the reliability and validity of QOL assessment tools and suggests several new approaches for describing the psychometric properties of these scales. Recommendations for integrating the assessment of appraisal into QOL research and clinical practice are discussed. PMID:15038830

Air Emissions Inventories

EPA Pesticide Factsheets

This site provides access to emissions data, regulations and guidance, electronic system access, resources and tools to support trends analysis, regional, and local scale air quality modeling, regulatory impact assessments.

Questionnaires on Family Satisfaction in the Adult ICU: A Systematic Review Including Psychometric Properties.

PubMed

van den Broek, Janneke M; Brunsveld-Reinders, Anja H; Zedlitz, Aglaia M E E; Girbes, Armand R J; de Jonge, Evert; Arbous, M Sesmu

2015-08-01

To perform a systematic review of the literature to determine which questionnaires are currently available to measure family satisfaction with care on the ICU and to provide an overview of their quality by evaluating their psychometric properties. We searched PubMed, Embase, The Cochrane Library, Web of Science, PsycINFO, and CINAHL from inception to October 30, 2013. Experimental and observational research articles reporting on questionnaires on family satisfaction and/or needs in the ICU were included. Two reviewers determined eligibility. Design, application mode, language, and the number of studies of the tools were registered. With this information, the tools were globally categorized according to validity and reliability: level I (well-established quality), II (approaching well-established quality), III (promising quality), or IV (unconfirmed quality). The quality of the highest level (I) tools was assessed by further examination of the psychometric properties and sample size of the studies. The search detected 3,655 references, from which 135 articles were included. We found 27 different tools that assessed overall or circumscribed aspects of family satisfaction with ICU care. Only four questionnaires were categorized as level I: the Critical Care Family Needs Inventory, the Society of Critical Care Medicine Family Needs Assessment, the Critical Care Family Satisfaction Survey, and the Family Satisfaction in the Intensive Care Unit. Studies on these questionnaires were of good sample size (n ≥ 100) and showed adequate data on face/content validity and internal consistency. Studies on the Critical Care Family Needs Inventory, the Family Satisfaction in the Intensive Care Unit also contained sufficient data on inter-rater/test-retest reliability, responsiveness, and feasibility. In general, data on measures of central tendency and sensitivity to change were scarce. Of all the questionnaires found, the Critical Care Family Needs Inventory and the Family Satisfaction in the Intensive Care Unit were the most reliable and valid in relation to their psychometric properties. However, a universal "best questionnaire" is indefinable because it depends on the specific goal, context, and population used in the inquiry.

Developing an Assessment Process for a Master's of Science Degree in a Pharmaceutical Sciences Program.

PubMed

Bloom, Timothy J; Hall, Julie M; Liu, Qinfeng; Stagner, William C; Adams, Michael L

2016-09-25

Objective. To develop a program-level assessment process for a master's of science degree in a pharmaceutical sciences (MSPS) program. Design. Program-level goals were created and mapped to course learning objectives. Embedded assessment tools were created by each course director and used to gather information related to program-level goals. Initial assessment iterations involved a subset of offered courses, and course directors met with the department assessment committee to review the quality of the assessment tools as well as the data collected with them. Insights from these discussions were used to improve the process. When all courses were used for collecting program-level assessment data, a modified system of guided reflection was used to reduce demands on committee members. Assessment. The first two iterations of collecting program-level assessment revealed problems with both the assessment tools and the program goals themselves. Course directors were inconsistent in the Bloom's Taxonomy level at which they assessed student achievement of program goals. Moreover, inappropriate mapping of program goals to course learning objectives were identified. These issues led to unreliable measures of how well students were doing with regard to program-level goals. Peer discussions between course directors and the assessment committee led to modification of program goals as well as improved assessment data collection tools. Conclusion. By starting with a subset of courses and using course-embedded assessment tools, a program-level assessment process was created with little difficulty. Involving all faculty members and avoiding comparisons between courses made obtaining faculty buy-in easier. Peer discussion often resulted in consensus on how to improve assessment tools.

Implementing iRound: A Computer-Based Auditing Tool.

PubMed

Brady, Darcie

Many hospitals use rounding or auditing as a tool to help identify gaps and needs in quality and process performance. Some hospitals are also using rounding to help improve patient experience. It is known that purposeful rounding helps improve Hospital Consumer Assessment of Healthcare Providers and Systems scores by helping manage patient expectations, provide service recovery, and recognize quality caregivers. Rounding works when a standard method is used across the facility, where data are comparable and trustworthy. This facility had a pen-and-paper process in place that made data reporting difficult, created a silo culture between departments, and most audits and rounds were completed differently on each unit. It was recognized that this facility needed to standardize the rounding and auditing process. The tool created by the Advisory Board called iRound was chosen as the tool this facility would use for patient experience rounds as well as process and quality rounding. The success of the iRound tool in this facility depended on several factors that started many months before implementation to current everyday usage.

Clinical guidelines in pediatric headache: evaluation of quality using the AGREE II instrument

PubMed Central

2014-01-01

Background The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs. Methods A systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument. Results Six CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038). Conclusions CGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine. PMID:25178699

eCPD in Action and Self-Assessment

ERIC Educational Resources Information Center

Butler, Steve

2007-01-01

Self-assessment is an integral component in the life of any education and training organisation so as to ensure quality improvement. This publication illustrates an individual self-assessment tool developed by the Learning and Skills Network (LSN) which gives feedback and support to assist staff to enhance their teaching and learning through the…

KIPS: An Evidence-Based Tool for Assessing Parenting Strengths and Needs in Diverse Families

ERIC Educational Resources Information Center

Comfort, Marilee; Gordon, Philip R.; Naples, Denise

2011-01-01

The movement toward evidence-based practices has stimulated greater interest in assessing parenting outcomes. The purpose of these studies was to further validate the Keys to Interactive Parenting Scale (KIPS), a structured observational assessment of parenting quality, with 397 diverse families. Factor analysis demonstrated that the 12 KIPS items…

Automated Formative Assessment as a Tool to Scaffold Student Documentary Writing

ERIC Educational Resources Information Center

Ferster, Bill; Hammond, Thomas C.; Alexander, R. Curby; Lyman, Hunt

2012-01-01

The hurried pace of the modern classroom does not permit formative feedback on writing assignments at the frequency or quality recommended by the research literature. One solution for increasing individual feedback to students is to incorporate some form of computer-generated assessment. This study explores the use of automated assessment of…

Assessing the Hydrologic Performance of the EPA's Nonpoint Source Water Quality Assessment Decision Support Tool Using North American Land Data Assimilation System (Products)

NASA Technical Reports Server (NTRS)

Lee, S.; Ni-Meister, W.; Toll, D.; Nigro, J.; Guiterrez-Magness, A.; Engman, T.

2010-01-01

The accuracy of streamflow predictions in the EPA's BASINS (Better Assessment Science Integrating Point and Nonpoint Sources) decision support tool is affected by the sparse meteorological data contained in BASINS. The North American Land Data Assimilation System (NLDAS) data with high spatial and temporal resolutions provide an alternative to the NOAA National Climatic Data Center (NCDC)'s station data. This study assessed the improvement of streamflow prediction of the Hydrological Simulation Program-FORTRAN (HSPF) model contained within BASINS using the NLDAS 118 degree hourly precipitation and evapotranspiration estimates in seven watersheds of the Chesapeake Bay region. Our results demonstrated consistent improvements of daily streamflow predictions in five of the seven watersheds when NLDAS precipitation and evapotranspiration data was incorporated into BASINS. The improvement of using the NLDAS data is significant when watershed's meteorological station is either far away or not in a similar climatic region. When the station is nearby, using the NLDAS data produces similar results. The correlation coefficients of the analyses using the NLDAS data were greater than 0.8, the Nash-Sutcliffe (NS) model fit efficiency greater than 0.6, and the error in the water balance was less than 5%. Our analyses also showed that the streamflow improvements were mainly contributed by the NLDAS's precipitation data and that the improvement from using NLDAS's evapotranspiration data was not significant; partially due to the constraints of current BASINS-HSPF settings. However, NLDAS's evapotranspiration data did improve the baseflow prediction. This study demonstrates the NLDAS data has the potential to improve stream flow predictions, thus aid the water quality assessment in the EPA nonpoint water quality assessment decision tool.

Construct measurement quality improves predictive accuracy in violence risk assessment: an illustration using the personality assessment inventory.

PubMed

Hendry, Melissa C; Douglas, Kevin S; Winter, Elizabeth A; Edens, John F

2013-01-01

Much of the risk assessment literature has focused on the predictive validity of risk assessment tools. However, these tools often comprise a list of risk factors that are themselves complex constructs, and focusing on the quality of measurement of individual risk factors may improve the predictive validity of the tools. The present study illustrates this concern using the Antisocial Features and Aggression scales of the Personality Assessment Inventory (Morey, 1991). In a sample of 1,545 prison inmates and offenders undergoing treatment for substance abuse (85% male), we evaluated (a) the factorial validity of the ANT and AGG scales, (b) the utility of original ANT and AGG scales and newly derived ANT and AGG scales for predicting antisocial outcomes (recidivism and institutional infractions), and (c) whether items with a stronger relationship to the underlying constructs (higher factor loadings) were in turn more strongly related to antisocial outcomes. Confirmatory factor analyses (CFAs) indicated that ANT and AGG items were not structured optimally in these data in terms of correspondence to the subscale structure identified in the PAI manual. Exploratory factor analyses were conducted on a random split-half of the sample to derive optimized alternative factor structures, and cross-validated in the second split-half using CFA. Four-factor models emerged for both the ANT and AGG scales, and, as predicted, the size of item factor loadings was associated with the strength with which items were associated with institutional infractions and community recidivism. This suggests that the quality by which a construct is measured is associated with its predictive strength. Implications for risk assessment are discussed. Copyright © 2013 John Wiley & Sons, Ltd.

Software component quality evaluation

NASA Technical Reports Server (NTRS)

Clough, A. J.

1991-01-01

The paper describes a software inspection process that can be used to evaluate the quality of software components. Quality criteria, process application, independent testing of the process and proposed associated tool support are covered. Early results indicate that this technique is well suited for assessing software component quality in a standardized fashion. With automated machine assistance to facilitate both the evaluation and selection of software components, such a technique should promote effective reuse of software components.

The Blue Cross Blue Shield of Michigan Cardiovascular Consortium (BMC2) collaborative quality improvement initiative in percutaneous coronary interventions.

PubMed

Moscucci, Mauro; Share, David; Kline-Rogers, Eva; O'Donnell, Michael; Maxwell-Eward, Ann; Meengs, William L; Clark, Vivian L; Kraft, Phillip; De Franco, Anthony C; Chambers, James L; Patel, Kirit; McGinnity, John G; Eagle, Kim A

2002-10-01

The past decade has been characterized by increased scrutiny of outcomes of surgical and percutaneous coronary interventions (PCIs). This increased scrutiny has led to the development of regional, state, and national databases for outcome assessment and for public reporting. This report describes the initial development of a regional, collaborative, cardiovascular consortium and the progress made so far by this collaborative group. In 1997, a group of hospitals in the state Michigan agreed to create a regional collaborative consortium for the development of a quality improvement program in interventional cardiology. The project included the creation of a comprehensive database of PCIs to be used for risk assessment, feedback on absolute and risk-adjusted outcomes, and sharing of information. To date, information from nearly 20,000 PCIs have been collected. A risk prediction tool for death in the hospital and additional risk prediction tools for other outcomes have been developed from the data collected, and are currently used by the participating centers for risk assessment and for quality improvement. As the project enters into year 5, the participating centers are deeply engaged in the quality improvement phase, and expansion to a total of 17 hospitals with active PCI programs is in process. In conclusion, the Blue Cross Blue Shield of Michigan Cardiovascular Consortium is an example of a regional collaborative effort to assess and improve quality of care and outcomes that overcome the barriers of traditional market and academic competition.

Diagnostic image quality in gynaecological ultrasound: Who should measure it, what should we measure and how?

PubMed Central

Knapp, Karen

2013-01-01

Assessment of diagnostic image quality in gynaecological ultrasound is an important aspect of imaging department quality assurance. This may be addressed through audit, but who should undertake the audit, what should be measured and how, remains contentious. The aim of this study was to identify whether peer audit is a suitable method of assessing the diagnostic quality of gynaecological ultrasound images. Nineteen gynaecological ultrasound studies were independently assessed by six sonographers utilising a pilot version of an audit tool. Outcome measures were levels of inter-rater agreement using different data collection methods (binary scores, Likert scale, continuous scale), effect of ultrasound study difficulty on study score and whether systematic differences were present between reviewers of different clinical grades and length of experience. Inter-rater agreement ranged from moderate to good depending on the data collection method. A continuous scale gave the highest level of inter-rater agreement with an intra-class correlation coefficient of 0.73. A strong correlation (r = 0.89) between study difficulty and study score was yielded. Length of clinical experience between reviewers had no effect on the audit scores, but individuals of a higher clinical grade gave significantly lower scores than those of a lower grade (p = 0.04). Peer audit is a promising tool in the assessment of ultrasound image quality. Continuous scales seem to be the best method of data collection implying a strong element of heuristically driven decision making by reviewing ultrasound practitioners. PMID:27433192

Assessment of the water quality monitoring network of the Piabanha River experimental watersheds in Rio de Janeiro, Brazil, using autoassociative neural networks.

PubMed

Villas-Boas, Mariana D; Olivera, Francisco; de Azevedo, Jose Paulo S

2017-09-01

Water quality monitoring is a complex issue that requires support tools in order to provide information for water resource management. Budget constraints as well as an inadequate water quality network design call for the development of evaluation tools to provide efficient water quality monitoring. For this purpose, a nonlinear principal component analysis (NLPCA) based on an autoassociative neural network was performed to assess the redundancy of the parameters and monitoring locations of the water quality network in the Piabanha River watershed. Oftentimes, a small number of variables contain the most relevant information, while the others add little or no interpretation to the variability of water quality. Principal component analysis (PCA) is widely used for this purpose. However, conventional PCA is not able to capture the nonlinearities of water quality data, while neural networks can represent those nonlinear relationships. The results presented in this work demonstrate that NLPCA performs better than PCA in the reconstruction of the water quality data of Piabanha watershed, explaining most of data variance. From the results of NLPCA, the most relevant water quality parameter is fecal coliforms (FCs) and the least relevant is chemical oxygen demand (COD). Regarding the monitoring locations, the most relevant is Poço Tarzan (PT) and the least is Parque Petrópolis (PP).

Combining Archetypes, Ontologies and Formalization Enables Automated Computation of Quality Indicators.

PubMed

Legaz-García, María Del Carmen; Dentler, Kathrin; Fernández-Breis, Jesualdo Tomás; Cornet, Ronald

2017-01-01

ArchMS is a framework that represents clinical information and knowledge using ontologies in OWL, which facilitates semantic interoperability and thereby the exploitation and secondary use of clinical data. However, it does not yet support the automated assessment of quality of care. CLIF is a stepwise method to formalize quality indicators. The method has been implemented in the CLIF tool which supports its users in generating computable queries based on a patient data model which can be based on archetypes. To enable the automated computation of quality indicators using ontologies and archetypes, we tested whether ArchMS and the CLIF tool can be integrated. We successfully automated the process of generating SPARQL queries from quality indicators that have been formalized with CLIF and integrated them into ArchMS. Hence, ontologies and archetypes can be combined for the execution of formalized quality indicators.

Association between health worker motivation and healthcare quality efforts in Ghana.

PubMed

Alhassan, Robert Kaba; Spieker, Nicole; van Ostenberg, Paul; Ogink, Alice; Nketiah-Amponsah, Edward; de Wit, Tobias F Rinke

2013-08-14

Ghana is one of the sub-Saharan African countries making significant progress towards universal access to quality healthcare. However, it remains a challenge to attain the 2015 targets for the health related Millennium Development Goals (MDGs) partly due to health sector human resource challenges including low staff motivation. This paper addresses indicators of health worker motivation and assesses associations with quality care and patient safety in Ghana. The aim is to identify interventions at the health worker level that contribute to quality improvement in healthcare facilities. The study is a baseline survey of health workers (n = 324) in 64 primary healthcare facilities in two regions in Ghana. Data collection involved quality care assessment using the SafeCare Essentials tool, the National Health Insurance Authority (NHIA) accreditation data and structured staff interviews on workplace motivating factors. The Spearman correlation test was conducted to test the hypothesis that the level of health worker motivation is associated with level of effort by primary healthcare facilities to improve quality care and patient safety. The quality care situation in health facilities was generally low, as determined by the SafeCare Essentials tool and NHIA data. The majority of facilities assessed did not have documented evidence of processes for continuous quality improvement and patient safety. Overall, staff motivation appeared low although workers in private facilities perceived better working conditions than workers in public facilities (P <0.05). Significant positive associations were found between staff satisfaction levels with working conditions and the clinic's effort towards quality improvement and patient safety (P <0.05). As part of efforts towards attainment of the health related MDGs in Ghana, more comprehensive staff motivation interventions should be integrated into quality improvement strategies especially in government-owned healthcare facilities where working conditions are perceived to be the worst.

The Accreditation Canada Program: A Complementary Tool to Promote Accountability in Canadian Healthcare

PubMed Central

Mitchell, Jonathan I.; Nicklin, Wendy; Macdonald, Bernadette

2014-01-01

Across Canada and internationally, the public and governments at all levels have increasing expectations for quality of care, value for healthcare dollars and accountability. Within this reality, there is increasing recognition of the value of accreditation as a barometer of quality and as a tool to assess and improve accountability and efficiency in healthcare delivery. In this commentary, we show how three key attributes of the Accreditation Canada Qmentum accreditation program – measurement, scalability and currency – promote accountability in healthcare. PMID:25305398

Patient reported outcomes in head and neck cancer: selecting instruments for quality of life integration in clinical protocols.

PubMed

Silveira, Augusta P; Gonçalves, Joaquim; Sequeira, Teresa; Ribeiro, Cláudia; Lopes, Carlos; Monteiro, Eurico; Pimentel, Francisco L

2010-10-31

Health Related Quality of Life has been used in medical research for more than twenty years, being progressively accepted during the last decade as an important patient reported outcome. Considering the multidimensional approach involved in Health Related Quality of Life assessment, instrument applicability and cultural adaptation must be tested for each population. In order to select the most appropriate instrument for Head and Neck cancer patients, two major Health Related Quality of Life specific questionnaires for Head and Neck cancer patients were compared. Conceptual differences, psychometric characteristics, scores, reliability, construct validity and sensitivity to symptomatology, tumour location, tumour size were analyzed. 102 consecutive Head and Neck cancer patients completed two different Health Related Quality of Life questionnaires: EORTC QLQ-C30 and its specific head and neck module QLQ-H&N35 and the Functional Assessment of Cancer Therapy Scales (FACT-H&N). Patients completed the questionnaires, immediately before consultation as a part of the routine evaluation. A greater variability was always found in the EORTC QLC-C30 questionnaire's scores for all comparable domains. Both instruments revealed a good internal consistency and demonstrated to be good tools to distinguish symptomatic patients. The EORTC questionnaires still demonstrated sensitivity to distinguish T3 and T4 staging. Conceptual differences and the psychometric characteristics are discussed. Our results suggest that these two instruments assess different aspects of Health Related Quality of Life - the questionnaires should be used separately and chosen according to the study objectives and methodology. This study emphases the importance in selecting the appropriate tool as a critical success factor in implementing routine Health Related Quality of Life assessment in clinical practice. This decision assumes particularly importance when utilization of results in real time and integration into clinical protocols are considered.

Seeing is believing? A mixed-methods study exploring the quality and perceived trustworthiness of online information about chronic conditions aimed at children and young people.

PubMed

McPherson, Amy C; Gofine, Miriam L; Stinson, Jennifer

2014-01-01

The numbers of children and young people with chronic conditions are increasing. While their information needs may vary, providing health care information can have considerable benefits, including better emotional health, less distress during treatments, and greater satisfaction with medical care. The Internet is increasingly being used to communicate health-related information to children about a range of chronic conditions. However, the quality of such websites is underexplored. Thus, the objectives of this study were to evaluate the reliability and quality of online information for children about chronic conditions using a standardized evaluation tool, and to explore children's and young people's perceptions of quality and trustworthiness regarding online health information. The study consisted of two phases. In Phase 1, websites about common pediatric chronic conditions aimed at children and containing treatment or management options were identified and the quality assessment tool DISCERN was completed. Test-retest and interrater reliability were calculated. In Phase 2, two focus groups with laptop computers were conducted with children and young people with a chronic condition to explore their perceptions of trustworthiness of online health information. In Phase 1, 165 websites were identified and 100 met the criteria and were assessed. The mean DISCERN score of all sites was 48.16 out of 75 (SD = 7.97, range 28-71, min 15 to max 75). Quality scores varied widely across the sample. The internal consistency and interrater reliability scores were both lower than previously reported in studies using the DISCERN to assess information for adults. In Phase 2, two focus groups with a total of six participants aged 11-23 years revealed a relative lack of concern about the quality and trustworthiness of online health information. Older participants reported judging the source and authorship of websites, but other participants did not question the source of the information they found online. Although personal websites were perceived to be less reliable than those from well-known medical institutions, they were still valued by many of the participants. Overall, there were relatively few websites about pediatric chronic conditions aimed at children, with variable quality and reliability. However, DISCERN's use with pediatric websites across a broad spectrum of developmental stages is limited. Children and young people demonstrated a need for more guidance around assessing trustworthiness of online information. A more appropriate quality assessment tool is warranted, which could usefully be employed by health care professionals, children, and parents.

Dupuytren Disease: Is There Enough Comprehensive Patient Information on the Internet?

PubMed

Zuk, Grzegorz; Reinisch, Katharina B; Raptis, Dimitri A; Fertsch, Sonia; Guggenheim, Merlin; Palma, Adrian F

2017-06-22

Dupuytren disease is a chronic nonmalign fibroproliferative disorder that causes finger contractures via proliferation of new tissue under the glabrous skin of the hand, resulting in multiple functional limitations for the patient. As many surgical therapy options exist, patients suffering from this condition actively search for information in their environment before consulting a health professional. As little is known about the quality of Web-based patient information, the aim of this study was to conduct its systematic evaluation using a validated tool. A total of 118 websites were included, and qualitative and quantitative assessment was performed using the modified Ensuring Quality Information for Patients (EQIP) tool. This standardized and reproducible tool consists of 36 items to assess available information in three categories: contents, identification, and structure data. Scientific data with restricted access, duplicates, and irrelevant websites were not included. Only 32 websites addressed more than 19 items, and the scores did not significantly differ among the website developers. The median number of items from the EQIP tool was 16, with the top websites addressing 28 out of 36 items. The quality of the newly developed websites did not increase with passing time. This study revealed several shortcomings in the quality of Web-based information available for patients suffering from Dupuytren disease. In the world of continuously growing and instantly available Web-based information, it is the health providers' negligence of the last two decades that there are very few good quality, informative, and educative websites that could be recommended to patients. ©Grzegorz Zuk, Katharina B Reinisch, Dimitri A Raptis, Sonia Fertsch, Merlin Guggenheim, Adrian F Palma. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 22.06.2017.

Alternate approaches for assessing impacts of oil sands development on air quality: A case study using the First Nation Community of Fort McKay.

PubMed

Davidson, Carla; Spink, David

2018-04-01

Previous analyses of continuously measured compounds in Fort McKay, an indigenous community in the Athabasca Oil Sands, have detected increasing concentrations of nitrogen dioxide (NO 2 ) and total hydrocarbons (THC), but not of sulfur dioxide (SO 2 ), ozone (O 3 ), total reduced sulfur compounds (TRS), or particulate matter (aerodynamic diameter <2.5 μm; PM 2.5 ). Yet the community frequently experiences odors, dust, and reduced air quality. The authors used Fort McKay's continuously monitored air quality data (1998-2014) as a case study to assess techniques for air quality analysis that make no assumptions regarding type of change. Linear trend analysis detected increasing concentrations of higher percentiles of NO 2 , nitric oxide (NO), and nitrogen oxides (NO x ), and THC. However, comparisons of all compounds between an early industrial expansion period (1998-2001) and current day (2011-2014) show that concentrations of NO 2 , SO 2 , THC, TRS, and PM 2.5 have significantly increased, whereas concentrations of O 3 are significantly lower. An assessment of the frequency and duration of periods when concentrations of each compound were above a variety of thresholds indicated that the frequency of air quality events is increasing for NO 2 and THC. Assessment of change over time with odds ratios of the 25th, 50th, 75th, and 90th percentile concentrations for each compound compared with an estimate of natural background variability showed that concentrations of TRS, SO 2 , and THC are dynamic, higher than background, and changes are nonlinear and nonmonotonic. An assessment of concentrations as a function of wind direction showed a clear and generally increasing influence of industry on air quality. This work shows that evaluating air quality without assumptions of linearity reveals dynamic changes in air quality in Fort McKay, and that it is increasingly being affected by oil sands operations. Understanding the nature and types of air quality changes occurring in a community or region is essential for the development of appropriate air quality management policies. Time-series trending of air quality data is a common tool for assessing air quality changes and is often used to assess the effectiveness of current emission management programs. The use of this tool, in the context of oil sands development, has significant limitations, and alternate air quality change analysis approaches need to be applied to ensure that the impact of this development on air quality is fully understood so that appropriate emission management actions can be taken.

Development, initial reliability and validity testing of an observational tool for assessing technical skills of operating room nurses.

PubMed

Sevdalis, Nick; Undre, Shabnam; Henry, Janet; Sydney, Elaine; Koutantji, Mary; Darzi, Ara; Vincent, Charles A

2009-09-01

The recent emergence of the Systems Approach to the safety and quality of surgical care has triggered individual and team skills training modules for surgeons and anaesthetists and relevant observational assessment tools have been developed. To develop an observational tool that captures operating room (OR) nurses' technical skill and can be used for assessment and training. The Imperial College Assessment of Technical Skills for Nurses (ICATS-N) assesses (i) gowning and gloving, (ii) setting up instrumentation, (iii) draping, and (iv) maintaining sterility. Three to five observable behaviours have been identified for each skill and are rated on 1-6 scales. Feasibility and aspects of reliability and validity were assessed in 20 simulation-based crisis management training modules for trainee nurses and doctors, carried out in a Simulated Operating Room. The tool was feasible to use in the context of simulation-based training. Satisfactory reliability (Cronbach alpha) was obtained across trainers' and trainees' scores (analysed jointly and separately). Moreover, trainer nurse's ratings of the four skills correlated positively, thus indicating adequate content validity. Trainer's and trainees' ratings did not correlate. Assessment of OR nurses' technical skill is becoming a training priority. The present evidence suggests that the ICATS-N could be considered for use as an assessment/training tool for junior OR nurses.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools

PubMed Central

Foster, Margaret J

2011-01-01

Objective: The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. Methods: The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Results: Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. Conclusions: As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed. PMID:21753917

Preliminary development of a GIS-tool to assess threats to shallow groundwater quality from soil pollutants in Glasgow, UK (GRASP).

NASA Astrophysics Data System (ADS)

Dochartaigh, B. É. Ó.; Fordyce, F. M.; Ander, E. L.; Bonsor, H. C.

2009-04-01

The protection of groundwater and related surface water quality is a key aspect of the European Union Water Framework Directive and environmental legislation in many countries worldwide. Globally, the protection of urban groundwater resources and related ecosystem services is of growing concern as urbanisation increases. Although urban areas are often where groundwater resources are most in need of protection, there is frequently a lack of information about threats to groundwater quality. Most studies of soil and groundwater contamination, although detailed, are site-specific, and city-wide overviews are generally lacking. The British Geological Survey (BGS) is currently undertaking the Clyde Urban Super-Project (CUSP), delivering multi-disciplinary geoscience products for the Glasgow conurbation. Under this project, a GIS-based prioritisation tool known as GRASP (GRoundwater And Soil Pollutants) has been trialled to aid urban planning and sustainable development by providing a broad-scale assessment of threats to groundwater quality across the conurbation. GRASP identifies areas where shallow groundwater quality is at greatest threat from the leaching and downward movement of potentially harmful metals in the soil. Metal contamination is a known problem in many urban centres including Glasgow, which has a long industrial heritage and associated contamination legacy, notably with respect to Cr. GRASP is based primarily upon an existing British Standard - International Standards Organisation methodology to determine the leaching potential of metals from soils, which has been validated for 11 metals: Al, Fe, Cd, Co, Cr, Cu, Hg, Ni, Mn, Pb and Zn (BS-ISO 15175:2004). However, the GRASP tool is innovative as it combines assessments of soil leaching potential with soil metal content data to highlight threats to shallow groundwater quality. The input parameters required for GRASP (soil pH, clay, organic matter, sesquioxide and metal content) are based upon a systematic geochemical dataset of 1600 soils (4 per km2) collected across Glasgow as part of the BGS Geochemical Baseline Survey of the Environment (G-BASE) project. These parameters are combined with assessments of climate, groundwater levels and the leaching potential of unsaturated Quaternary deposits to produce maps that prioritise the likely threats to shallow groundwater quality. Data processing for the GRASP methodology is carried out in five steps in Microsoft Excel®, using Visual Basic® programming language, and ArcGIS® software. The GRASP prioritisation tool is in the process of development; however, the rationale and initial derivation of the methodology for the city of Glasgow will be presented.

The adenosine triphosphate method as a quality control tool to assess 'cleanliness' of frequently touched hospital surfaces.

PubMed

Knape, L; Hambraeus, A; Lytsy, B

2015-10-01

The adenosine triphosphate (ATP) method is widely accepted as a quality control method to complement visual assessment, in the specifications of requirements, when purchasing cleaning contractors in Swedish hospitals. To examine whether the amount of biological load, as measured by ATP on frequently touched near-patient surfaces, had been reduced after an intervention; to evaluate the correlation between visual assessment and ATP levels on the same surfaces; to identify aspects of the performance of the ATP method as a tool in evaluating hospital cleanliness. A prospective intervention study in three phases was carried out in a medical ward and an intensive care unit (ICU) at a regional hospital in mid-Sweden between 2012 and 2013. Existing cleaning procedures were defined and baseline tests were sampled by visual inspection and ATP measurements of ten frequently touched surfaces in patients' rooms before and after intervention. The intervention consisted of educating nursing staff about the importance of hospital cleaning and direct feedback of ATP levels before and after cleaning. The mixed model showed a significant decrease in ATP levels after the intervention (P < 0.001). Relative light unit values were lower in the ICU. Cleanliness as judged by visual assessments improved. In the logistic regression analysis, there was a significant association between visual assessments and ATP levels. Direct feedback of ATP levels, together with education and introduction of written cleaning protocols, were effective tools to improve cleanliness. Visual assessment correlated with the level of ATP but the correlation was not absolute. The ATP method could serve as an educational tool for staff, but is not enough to assess hospital cleanliness in general as only a limited part of a large area is covered. Copyright © 2015 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

Intelligent Monitoring? Assessing the ability of the Care Quality Commission's statistical surveillance tool to predict quality and prioritise NHS hospital inspections.

PubMed

Griffiths, Alex; Beaussier, Anne-Laure; Demeritt, David; Rothstein, Henry

2017-02-01

The Care Quality Commission (CQC) is responsible for ensuring the quality of the health and social care delivered by more than 30 000 registered providers in England. With only limited resources for conducting on-site inspections, the CQC has used statistical surveillance tools to help it identify which providers it should prioritise for inspection. In the face of planned funding cuts, the CQC plans to put more reliance on statistical surveillance tools to assess risks to quality and prioritise inspections accordingly. To evaluate the ability of the CQC's latest surveillance tool, Intelligent Monitoring (IM), to predict the quality of care provided by National Health Service (NHS) hospital trusts so that those at greatest risk of providing poor-quality care can be identified and targeted for inspection. The predictive ability of the IM tool is evaluated through regression analyses and χ 2 testing of the relationship between the quantitative risk score generated by the IM tool and the subsequent quality rating awarded following detailed on-site inspection by large expert teams of inspectors. First, the continuous risk scores generated by the CQC's IM statistical surveillance tool cannot predict inspection-based quality ratings of NHS hospital trusts (OR 0.38 (0.14 to 1.05) for Outstanding/Good, OR 0.94 (0.80 to -1.10) for Good/Requires improvement, and OR 0.90 (0.76 to 1.07) for Requires improvement/Inadequate). Second, the risk scores cannot be used more simply to distinguish the trusts performing poorly-those subsequently rated either 'Requires improvement' or 'Inadequate'-from the trusts performing well-those subsequently rated either 'Good' or 'Outstanding' (OR 1.07 (0.91 to 1.26)). Classifying CQC's risk bandings 1-3 as high risk and 4-6 as low risk, 11 of the high risk trusts were performing well and 43 of the low risk trusts were performing poorly, resulting in an overall accuracy rate of 47.6%. Third, the risk scores cannot be used even more simply to distinguish the worst performing trusts-those subsequently rated 'Inadequate'-from the remaining, better performing trusts (OR 1.11 (0.94 to 1.32)). Classifying CQC's risk banding 1 as high risk and 2-6 as low risk, the highest overall accuracy rate of 72.8% was achieved, but still only 6 of the 13 Inadequate trusts were correctly classified as being high risk. Since the IM statistical surveillance tool cannot predict the outcome of NHS hospital trust inspections, it cannot be used for prioritisation. A new approach to inspection planning is therefore required. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Measuring Quality in Ethics Consultation.

PubMed

Bliss, Sally E; Oppenlander, Jane; Dahlke, Jacob M; Meyer, Gordon J; Williford, Eva M; Macauley, Robert C

2016-01-01

For all of the emphasis on quality improvement-as well as the acknowledged overlap between assessment of the quality of healthcare services and clinical ethics-the quality of clinical ethics consultation has received scant attention, especially in terms of empirical measurement. Recognizing this need, the second edition of Core Competencies for Health Care Ethics Consultation1 identified four domains of ethics quality: (1) ethicality, (2) stakeholders' satisfaction, (3) resolution of the presenting conflict/dilemma, and (4) education that translates into knowledge. This study is the first, to our knowledge, to directly measure all of these domains. Here we describe the quality improvement process undertaken at a tertiary care academic medical center, as well as the tools developed to measure the quality of ethics consultation, which include post-consultation satisfaction surveys and weekly case conferences. The information gained through these tools helps to improve not only the process of ethics consultation, but also the measurement and assurance of quality. Copyright 2016 The Journal of Clinical Ethics. All rights reserved.

Investigating the Psychometric Properties of the ACEI Global Guidelines Assessment, Third Edition (GGA) in Nine Countries

ERIC Educational Resources Information Center

Hardin, Belinda J.; Bergen, Doris; Busio, Dionne Sills; Boone, William

2017-01-01

The Third Edition of the ACEI Global Guidelines Assessment (GGA) was evaluated for its effectiveness as an international assessment tool for use by early childhood educators to develop, assess, and improve program quality worldwide. This expanded study was conducted in nine countries [People's Republic of China (2 sites), Guatemala, India, Italy,…

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing 1

PubMed Central

González-Chordá, Víctor Manuel; Maciá-Soler, María Loreto

2015-01-01

Abstract Objective: to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. Method: prospective longitudinal study conducted in a population of 60 secondyear Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. Results: nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). Conclusion: the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teachinglearning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care. PMID:26444173

Cumulative Impact Assessment: Approaching Environmental Capacity in Development Area Using Environmental Impact Assessment Information

NASA Astrophysics Data System (ADS)

Cho, N.; Lee, M. J.; Maeng, J. H.

2017-12-01

Environmental impact assessment estimates the impact of development as a business unit and establishes mitigation plan. If the development is done, its economic effects can spread to the nearby areas. So that various developments can be distributed at different time intervals. The impact of the new developments can be combined with existing environmental impacts and can have a larger impact. That is, Cumulative impact assessment is needed to consider the environmental capacity of the Nearby area. Cumulative impact assessments require policy tools such as environmental impact assessment information and cumulative impact estimation models. In Korea, environmental information (water quality, air quality, etc.) of the development site is measured for environmental impact assessment and monitored for a certain period (generally 5 years) after the project. In addition, by constructing the environmental information as a spatial database, it is possible to express the environmental impact on a regional basis spatially and to intuitively use it for development site selection. Utilizing a composite model of environmental impact assessment information and Remote Sensing data for cumulative impact estimation, That can be used as a policy decision support tool that provides quantitative information for development area management, such as time series effect and sprawl phenomenon.

A Method for the Design and Development of Medical or Health Care Information Websites to Optimize Search Engine Results Page Rankings on Google

PubMed Central

Cummins, Niamh Maria; Hannigan, Ailish; Shannon, Bill; Dunne, Colum; Cullen, Walter

2013-01-01

Background The Internet is a widely used source of information for patients searching for medical/health care information. While many studies have assessed existing medical/health care information on the Internet, relatively few have examined methods for design and delivery of such websites, particularly those aimed at the general public. Objective This study describes a method of evaluating material for new medical/health care websites, or for assessing those already in existence, which is correlated with higher rankings on Google's Search Engine Results Pages (SERPs). Methods A website quality assessment (WQA) tool was developed using criteria related to the quality of the information to be contained in the website in addition to an assessment of the readability of the text. This was retrospectively applied to assess existing websites that provide information about generic medicines. The reproducibility of the WQA tool and its predictive validity were assessed in this study. Results The WQA tool demonstrated very high reproducibility (intraclass correlation coefficient=0.95) between 2 independent users. A moderate to strong correlation was found between WQA scores and rankings on Google SERPs. Analogous correlations were seen between rankings and readability of websites as determined by Flesch Reading Ease and Flesch-Kincaid Grade Level scores. Conclusions The use of the WQA tool developed in this study is recommended as part of the design phase of a medical or health care information provision website, along with assessment of readability of the material to be used. This may ensure that the website performs better on Google searches. The tool can also be used retrospectively to make improvements to existing websites, thus, potentially enabling better Google search result positions without incurring the costs associated with Search Engine Optimization (SEO) professionals or paid promotion. PMID:23981848

Usefulness of the WHOQOL-BREF questionnaire in assessing the quality of life of parents of children with asthma

PubMed Central

Roncada, Cristian; Dias, Caroline Pieta; Goecks, Suelen; Cidade, Simone Elenise Falcão; Pitrez, Paulo Márcio Condessa

2015-01-01

Objective:: To evaluate the quality of life (QOL) of parents of children with asthma and to analyze the internal consistency of the generic QOL tool World Health Organization Quality of Life, abbreviated version (WHOQOL-BREF). Methods:: We evaluated the QOL of parents of asthmatic and healthy children aged between 8 and 16, using the generic WHOQOL-BREF questionnaire. We also evaluated the internal consistency using Cronbach's alpha (αC), in order to determine whether the tool had good validity for the target audience. Results:: The study included 162 individuals with a mean age of 43.8±13.6 years, of which 104 were female (64.2%) and 128 were married (79.0%). When assessing the QOL, the group of parents of healthy children had higher scores than the group of parents of asthmatic children in the four areas evaluated by the questionnaire (Physical, Psychological Health, Social Relationships and Environment), indicating a better quality of life. Regarding the internal consistency of the WHOQOL-BREF, values of ˛C were 0.86 points for the group of parents of asthmatic children, and 0.88 for the group of parents of healthy children. Conclusions:: Parents of children with asthma have impaired quality of life due to their children's disease. Furthermore, the WHOQOL-BREF, even as a generic tool, showed to be practical and efficient to evaluate the quality of life of parents of asthmatic children. © 2015 Sociedade de Pediatria de São Paulo. Published by Elsevier Editora Ltda. All rights reserved. PMID:26137868

MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites

PubMed Central

2017-01-01

Quality control of MRI is essential for excluding problematic acquisitions and avoiding bias in subsequent image processing and analysis. Visual inspection is subjective and impractical for large scale datasets. Although automated quality assessments have been demonstrated on single-site datasets, it is unclear that solutions can generalize to unseen data acquired at new sites. Here, we introduce the MRI Quality Control tool (MRIQC), a tool for extracting quality measures and fitting a binary (accept/exclude) classifier. Our tool can be run both locally and as a free online service via the OpenNeuro.org portal. The classifier is trained on a publicly available, multi-site dataset (17 sites, N = 1102). We perform model selection evaluating different normalization and feature exclusion approaches aimed at maximizing across-site generalization and estimate an accuracy of 76%±13% on new sites, using leave-one-site-out cross-validation. We confirm that result on a held-out dataset (2 sites, N = 265) also obtaining a 76% accuracy. Even though the performance of the trained classifier is statistically above chance, we show that it is susceptible to site effects and unable to account for artifacts specific to new sites. MRIQC performs with high accuracy in intra-site prediction, but performance on unseen sites leaves space for improvement which might require more labeled data and new approaches to the between-site variability. Overcoming these limitations is crucial for a more objective quality assessment of neuroimaging data, and to enable the analysis of extremely large and multi-site samples. PMID:28945803

Human Connectome Project Informatics: quality control, database services, and data visualization

PubMed Central

Marcus, Daniel S.; Harms, Michael P.; Snyder, Abraham Z.; Jenkinson, Mark; Wilson, J Anthony; Glasser, Matthew F.; Barch, Deanna M.; Archie, Kevin A.; Burgess, Gregory C.; Ramaratnam, Mohana; Hodge, Michael; Horton, William; Herrick, Rick; Olsen, Timothy; McKay, Michael; House, Matthew; Hileman, Michael; Reid, Erin; Harwell, John; Coalson, Timothy; Schindler, Jon; Elam, Jennifer S.; Curtiss, Sandra W.; Van Essen, David C.

2013-01-01

The Human Connectome Project (HCP) has developed protocols, standard operating and quality control procedures, and a suite of informatics tools to enable high throughput data collection, data sharing, automated data processing and analysis, and data mining and visualization. Quality control procedures include methods to maintain data collection consistency over time, to measure head motion, and to establish quantitative modality-specific overall quality assessments. Database services developed as customizations of the XNAT imaging informatics platform support both internal daily operations and open access data sharing. The Connectome Workbench visualization environment enables user interaction with HCP data and is increasingly integrated with the HCP's database services. Here we describe the current state of these procedures and tools and their application in the ongoing HCP study. PMID:23707591

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

Institutional Advancement: Using the Malcolm Baldrige National Quality Award Criteria for Self-Study and Accreditation.

ERIC Educational Resources Information Center

Cooke, Brian

The criteria used for the Malcolm Baldrige National Quality Award can provide community colleges with a strategic tool for college planning, management, assessment, and accreditation. The Criteria focus on two measurable objectives for institutional effectiveness: the delivery of educational value to current and future students through instruction…

Web-based Air Quality Screening Tool for Near-port Assessments: Example of Application in Porto, Portugal

EPA Science Inventory

The HARMO conference presents an opportunity to extend and further develop ORD’s collaboration with our European colleagues. This paper describes the C-PORT application in Porto, Portugal as a part of the EU project AIRSHIP designed to evaluate the air quality impacts of m...

School District Wellness Policy Quality and Weight-Related Outcomes among High School Students in Minnesota

ERIC Educational Resources Information Center

Hoffman, Pamela K.; Davey, Cynthia S.; Larson, Nicole; Grannon, Katherine Y.; Hanson, Carlie; Nanney, Marilyn S.

2016-01-01

Weight-related outcomes were examined among high school students in Minnesota public school districts according to the quality of district wellness policies. Wellness policy strength and comprehensiveness were scored using the Wellness School Assessment Tool (WellSAT) for 325 Minnesota public school districts in 2013. The associations between…

Fact sheets and slides summarizing Soil and Water Assessment Tool (SWAT) and Integrated Farm Systems Model (IFSM)

USDA-ARS?s Scientific Manuscript database

Water quality models address nonpoint source pollution from agricultural land at a range of scales and complexities and involve a variety of input parameters. It is often difficult for conservationists and stakeholders to understand and reconcile water quality results from different models. However,...

Evaluating the APEX model for simulating streamflow and water quality on ten agricultural watersheds in the U.S.

USDA-ARS?s Scientific Manuscript database

Simulation models are increasingly used to assess water quality constituent losses from agricultural systems. Mis-use often gives irrelevant or erroneous answers. The Agricultural Policy Environmental Extender (APEX) model is emerging as one of the premier modeling tools for fields, farms, and agr...

Rapid Assessment Tool for Haemophilus influenzae type b Disease in Developing Countries1

PubMed Central

Nelson, Christopher B.; Watt, James P.; Mohsni, Ezzeddine; Wenger, Jay D.; Levine, Orin S.

2004-01-01

Haemophilus influenzae type b (Hib) still causes a substantial number of deaths among children in developing countries, despite the availability of effective conjugate vaccines. A major obstacle in developing a Hib vaccine has been limited awareness about the impact of Hib disease. A tool was developed to estimate the national rates of Hib meningitis and pneumonia by assessing retrospective local data over 7 to 10 days. Data from 11 countries in Africa, the Middle East, and Asia were studied and showed rates of Hib meningitis from >50 cases per 100,000 children >5 years in Ghana and Uganda to <15 per 100,000 in Iran, Jordan, and Uzbekistan. Results were affected by the quality of available data. The Hib rapid assessment tool can be useful to countries that desire a timely assessment of Hib disease rates. PMID:15324548

A tool to measure whether business management capacity in general practice impacts on the quality of chronic illness care.

PubMed

Holton, Christine H; Proudfoot, Judith G; Jayasinghe, Upali W; Grimm, Jane; Bubner, Tanya K; Winstanley, Julie; Harris, Mark F; Beilby, Justin J

2010-11-01

Our aim was to develop a tool to identify specific features of the business and financial management of practices that facilitate better quality care for chronic illness in primary care. Domains of management were identified, resulting in the development of a structured interview tool that was administered in 97 primary care practices in Australia. Interview items were screened and subjected to factor analysis, subscales identified and the overall model fit determined. The instrument's validity was assessed against another measure of quality of care. Analysis provided a four-factor solution containing 21 items, which explained 42.5% of the variance in the total scores. The factors related to administrative processes, human resources, marketing analysis and business development. All scores increased significantly with practice size. The business development subscale and total score were higher for rural practices. There was a significant correlation between the business development subscale and quality of care. The indicators of business and financial management in the final tool appear to be useful predictors of the quality of care. The instrument may help inform policy regarding the structure of general practice and implementation of a systems approach to chronic illness care. It can provide information to practices about areas for further development.

Quality control and quality assurance plan for bridge channel-stability assessments in Massachusetts

USGS Publications Warehouse

Parker, Gene W.; Pinson, Harlow

1993-01-01

A quality control and quality assurance plan has been implemented as part of the Massachusetts bridge scour and channel-stability assessment program. This program is being conducted by the U.S. Geological Survey, Massachusetts-Rhode Island District, in cooperation with the Massachusetts Highway Department. Project personnel training, data-integrity verification, and new data-management technologies are being utilized in the channel-stability assessment process to improve current data-collection and management techniques. An automated data-collection procedure has been implemented to standardize channel-stability assessments on a regular basis within the State. An object-oriented data structure and new image management tools are used to produce a data base enabling management of multiple data object classes. Data will be reviewed by assessors and data base managers before being merged into a master bridge-scour data base, which includes automated data-verification routines.

Validation of Medical Tourism Service Quality Questionnaire (MTSQQ) for Iranian Hospitals.

PubMed

Qolipour, Mohammad; Torabipour, Amin; Khiavi, Farzad Faraji; Malehi, Amal Saki

2017-03-01

Assessing service quality is one of the basic requirements to develop the medical tourism industry. There is no valid and reliable tool to measure service quality of medical tourism. This study aimed to determine the reliability and validity of a Persian version of medical tourism service quality questionnaire for Iranian hospitals. To validate the medical tourism service quality questionnaire (MTSQQ), a cross-sectional study was conducted on 250 Iraqi patients referred to hospitals in Ahvaz (Iran) from 2015. To design a questionnaire and determine its content validity, the Delphi Technique (3 rounds) with the participation of 20 medical tourism experts was used. Construct validity of the questionnaire was assessed through exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach's alpha coefficient. Data were analyzed by Excel 2007, SPSS version18, and Lisrel l8.0 software. The content validity of the questionnaire with CVI=0.775 was confirmed. According to exploratory factor analysis, the MTSQQ included 31 items and 8 dimensions (tangibility, reliability, responsiveness, assurance, empathy, exchange and travel facilities, technical and infrastructure facilities and safety and security). Construct validity of the questionnaire was confirmed, based on the goodness of fit quantities of model (RMSEA=0.032, CFI= 0.98, GFI=0.88). Cronbach's alpha coefficient was 0.837 and 0.919 for expectation and perception questionnaire. The results of the study showed that the medical tourism SERVQUAL questionnaire with 31 items and 8 dimensions was a valid and reliable tool to measure service quality of medical tourism in Iranian hospitals.

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions

PubMed Central

Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-01-01

Background Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. Objective The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. Methods As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). Results A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content—a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. Conclusions This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program’s evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. PMID:28325712

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions.

PubMed

Baumel, Amit; Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-03-21

Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content-a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program's evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. ©Amit Baumel, Keren Faber, Nandita Mathur, John M Kane, Fred Muench. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.03.2017.

NASA EEE Parts and Advanced Interconnect Program (AIP)

NASA Technical Reports Server (NTRS)

Gindorf, T.; Garrison, A.

1996-01-01

none given From Program Objectives: I. Accelerate the readiness of new technologies through development of validation, assessment and test method/tools II. Provide NASA Projects infusion paths for emerging technologies III. Provide NASA Projects technology selection, application and validation guidelines for harware and processes IV. Disseminate quality assurance, reliability, validation, tools and availability information to the NASA community.

Sensitivity, Calibration, and Validation of SWAT in the Choptank River Basin

USDA-ARS?s Scientific Manuscript database

The value of watershed-scale, water quality models to ecosystem management is increasingly evident as more programs adopt these tools to help assess the effectiveness of different management scenarios on the environment. The USDA-Conservation Effects Assessment Project (CEAP) is one such program whi...

Thermal Characterization of Carbon Nanotubes by Photothermal Techniques

NASA Astrophysics Data System (ADS)

Leahu, G.; Li Voti, R.; Larciprete, M. C.; Sibilia, C.; Bertolotti, M.; Nefedov, I.; Anoshkin, I. V.

2015-06-01

Carbon nanotubes (CNTs) are multifunctional materials commonly used in a large number of applications in electronics, sensors, nanocomposites, thermal management, actuators, energy storage and conversion, and drug delivery. Despite recent important advances in the development of CNT purity assessment tools and atomic resolution imaging of individual nanotubes by scanning tunnelling microscopy and high-resolution transmission electron microscopy, the macroscale assessment of the overall surface qualities of commercial CNT materials remains a great challenge. The lack of quantitative measurement technology to characterize and compare the surface qualities of bulk manufactured and engineered CNT materials has negative impacts on the reliable and consistent nanomanufacturing of CNT products. In this paper it is shown how photoacoustic spectroscopy and photothermal radiometry represent useful non-destructive tools to study the optothermal properties of carbon nanotube thin films.

Evaluation of Micronutrient Sensors for Food Matrices in Resource-Limited Settings: A Systematic Narrative Review.

PubMed

Waller, Anna W; Lotton, Jennifer L; Gaur, Shashank; Andrade, Jeanette M; Andrade, Juan E

2018-06-21

In resource-limited settings, mass food fortification is a common strategy to ensure the population consumes appropriate quantities of essential micronutrients. Food and government organizations in these settings, however, lack tools to monitor the quality and compliance of fortified products and their efficacy to enhance nutrient status. The World Health Organization has developed general guidelines known as ASSURED (Affordable, Sensitive, Specific, User-friendly, Rapid and Robust, Equipment-free, and Deliverable to end-users) to aid the development of useful diagnostic tools for these settings. These guidelines assume performance aspects such as sufficient accuracy, reliability, and validity. The purpose of this systematic narrative review is to examine the micronutrient sensor literature on its adherence towards the ASSURED criteria along with accuracy, reliability, and validation when developing micronutrient sensors for resource-limited settings. Keyword searches were conducted in three databases: Web of Science, PubMed, and Scopus and were based on 6-point inclusion criteria. A 16-question quality assessment tool was developed to determine the adherence towards quality and performance criteria. Of the 2,365 retrieved studies, 42 sensors were included based on inclusion/exclusion criteria. Results showed that improvements to the current sensor design are necessary, especially their affordability, user-friendliness, robustness, equipment-free, and deliverability within the ASSURED criteria, and accuracy and validity of the additional criteria to be useful in resource-limited settings. Although it requires further validation, the 16-question quality assessment tool can be used as a guide in the development of sensors for resource-limited settings. © 2018 Institute of Food Technologists®.

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

Nutritional status assessed by the Patient-Generated Subjective Global Assessment (PG-SGA) is associated with qualities of diet and life in Korean cerebral infarction patients.

PubMed

Lim, Hyun Jung; Choue, Ryowon

2010-01-01

Assessment of the nutritional status of patients with cerebral infarction (CI) is important because their nutritional status influences disease outcome. The purpose of this study was to assess the nutritional status of patients with CI using the scored Patient-Generated Subjective Global Assessment (PG-SGA) and to investigate the relation of the quality of their diet and life with their nutritional status. Seventy-three patients with CI were recruited from Kyung Hee University Oriental Medical Center in Seoul, Korea, from May to July 2007. The subjects' PG-SGA, dietary quality (Dietary Diversity Score, Dietary Variety Score, and Diet Quality Index-International), and quality of life (Stroke-Specific Quality of Life, modified Barthel Index, and Beck Depression Inventory) were investigated. The patients were classified by PG-SGA categories as well nourished (26.0%), moderately malnourished (49.3%), or severely malnourished (24.7%). Quality of diet assessed by the Dietary Diversity Score and Dietary Variety Score was significantly lower in severely malnourished patients (P < 0.001). The overall dietary quality expressed by the Diet Quality Index-International was significantly greater in the well-nourished group, followed by the moderately malnourished and severely malnourished groups. Quality of life assessed by the Stroke-Specific Quality of Life and modified Barthel Index was significantly lower in the malnourished group (P < 0.05). Quality of diet (P < 0.001) and life (P < 0.05) in patients with CI were significantly correlated with their nutritional status. The PG-SGA is a useful nutritional assessment tool for patients with CI with stable vital signs. When patients with CI were categorized according to their PG-SGA score, well-nourished patients demonstrated better diet quality and better quality of life. 2010 Elsevier Inc. All rights reserved.

Concordance in the Assessment of Effectiveness of Palliative Care between Patients and Palliative Care Nurses in Malaysia: A Study with the Palliative Care Outcome Scale

PubMed Central

Koh, Kwee Choy; Gupta, Esha Das; Poovaneswaran, Sangeetha; Then, Siaw Ling; Teo, Michelle Jia Jui; Gan, Teik Yiap; Thing, Joanne Hwei Yean

2017-01-01

Context: The Palliative Care Outcome Scale (POS) is an easy-to-use assessment tool to evaluate the effectiveness of palliative care. There is no published literature on the use of POS as an assessment tool in Malaysia. Aim: To define the concordance in the assessment of quality of life between patients with advanced cancers and their palliative care nurses using a Malay version of the POS. Settings and Design: This study was conducted in the palliative care unit of the Hospital Tuanku Ja'afar Seremban, Malaysia, from February 2014 to June 2014. Subjects and Methods: We adapted and validated the English version of the 3-day recall POS into Malay and used it to define the concordance in the assessment of quality of life between patients and palliative care nurses. Forty patients with advanced stage cancers and forty palliative care nurses completed the Malay POS questionnaire. Statistical Analysis Used: The kappa statistical test was used to assess the agreement between patients and their palliative care nurses. Results: Slight to fair concordance was found in all items, except for one item (family anxiety) where there was no agreement. Conclusions: The Malay version of the POS was well accepted and reliable as an assessment tool for evaluation of the effectiveness of palliative care in Malaysia. Slight to fair concordance was shown between the patients and their palliative care nurses, suggesting the needs for more training of the nurses. PMID:28216862

The Practice of Continuous Assessment in Primary Schools: The Case of Chagni, Ethiopia

ERIC Educational Resources Information Center

Abejehu, Sintayehu Belay

2016-01-01

Continuous assessment is part and parcel of instructional process that has to be taken as a key tool in educational quality assurance endeavor. Thus, this article examined the actual practice of continuous assessment in primary schools of Chagni City Administration, Ethiopia. To address this purpose the study employed descriptive survey design.…

Improving the Validity and Reliability of Large Scale Writing Assessment.

ERIC Educational Resources Information Center

Fenton, Ray; Straugh, Tom; Stofflet, Fred; Garrison, Steve

This paper examines the efforts of the Anchorage School District, Alaska, to improve the validity of its writing assessment as a useful tool for the training of teachers and the characterization of the quality of student writing. The paper examines how a number of changes in the process and scoring of the Anchorage Writing Assessment affected the…

A Web Site that Provides Resources for Assessing Students' Statistical Literacy, Reasoning and Thinking

ERIC Educational Resources Information Center

Garfield, Joan; delMas, Robert

2010-01-01

The Assessment Resource Tools for Improving Statistical Thinking (ARTIST) Web site was developed to provide high-quality assessment resources for faculty who teach statistics at the tertiary level but resources are also useful to statistics teachers at the secondary level. This article describes some of the numerous ARTIST resources and suggests…

Quality Assessment of Information on Bariatric Surgery Websites.

PubMed

Vetter, Diana; Ruhwinkel, Hendrik; Raptis, Dimitri A; Bueter, Marco

2018-05-01

The aim of this study was to assess the quality of patient information on bariatric surgery in the internet using the modified Ensuring Quality Information for Patients (EQIP) tool. Systematic review of information on bariatric surgery in the internet by entering common search terms into five search engines. The top 100 websites of every search term and search engine were assessed using the validated EQIP tool (maximum score, 36), which entails points for content, structure, and identification data of a given website. Websites at or above the 99th percentile were analyzed separately (n = 8). The median EQIP score of all included websites (n = 463) was 17 (IQR 15-19). While information on the medical problem, the indication for surgery, or the treatment alternatives was present in 84% of all websites, only 10% of the included websites contained adequate information on postoperative complications. Although quantitative information on incidence (37.5%) and treatment of complications (12.5%) was significantly better in the top 99th percentile websites, the content of relevant information such as occurrence and treatment of complications was still very limited. The overall quality of patient information on bariatric surgery in the internet is relatively poor. Especially incidence of complications and their treatment are rarely reported even on websites with a 99th percentile EQIP score.

Quasi-experimental study designs series-paper 6: risk of bias assessment.

PubMed

Waddington, Hugh; Aloe, Ariel M; Becker, Betsy Jane; Djimeu, Eric W; Hombrados, Jorge Garcia; Tugwell, Peter; Wells, George; Reeves, Barney

2017-09-01

Rigorous and transparent bias assessment is a core component of high-quality systematic reviews. We assess modifications to existing risk of bias approaches to incorporate rigorous quasi-experimental approaches with selection on unobservables. These are nonrandomized studies using design-based approaches to control for unobservable sources of confounding such as difference studies, instrumental variables, interrupted time series, natural experiments, and regression-discontinuity designs. We review existing risk of bias tools. Drawing on these tools, we present domains of bias and suggest directions for evaluation questions. The review suggests that existing risk of bias tools provide, to different degrees, incomplete transparent criteria to assess the validity of these designs. The paper then presents an approach to evaluating the internal validity of quasi-experiments with selection on unobservables. We conclude that tools for nonrandomized studies of interventions need to be further developed to incorporate evaluation questions for quasi-experiments with selection on unobservables. Copyright © 2017 Elsevier Inc. All rights reserved.

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments.

PubMed

Langer, Astrid

2012-08-16

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

PubMed Central

2012-01-01

Background Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. Methods To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. Results The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. Conclusions The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test. PMID:22894708

Sigma metrics as a tool for evaluating the performance of internal quality control in a clinical chemistry laboratory

PubMed Central

Kumar, B. Vinodh; Mohan, Thuthi

2018-01-01

OBJECTIVE: Six Sigma is one of the most popular quality management system tools employed for process improvement. The Six Sigma methods are usually applied when the outcome of the process can be measured. This study was done to assess the performance of individual biochemical parameters on a Sigma Scale by calculating the sigma metrics for individual parameters and to follow the Westgard guidelines for appropriate Westgard rules and levels of internal quality control (IQC) that needs to be processed to improve target analyte performance based on the sigma metrics. MATERIALS AND METHODS: This is a retrospective study, and data required for the study were extracted between July 2015 and June 2016 from a Secondary Care Government Hospital, Chennai. The data obtained for the study are IQC - coefficient of variation percentage and External Quality Assurance Scheme (EQAS) - Bias% for 16 biochemical parameters. RESULTS: For the level 1 IQC, four analytes (alkaline phosphatase, magnesium, triglyceride, and high-density lipoprotein-cholesterol) showed an ideal performance of ≥6 sigma level, five analytes (urea, total bilirubin, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level and for level 2 IQCs, same four analytes of level 1 showed a performance of ≥6 sigma level, and four analytes (urea, albumin, cholesterol, and potassium) showed an average performance of <3 sigma level. For all analytes <6 sigma level, the quality goal index (QGI) was <0.8 indicating the area requiring improvement to be imprecision except cholesterol whose QGI >1.2 indicated inaccuracy. CONCLUSION: This study shows that sigma metrics is a good quality tool to assess the analytical performance of a clinical chemistry laboratory. Thus, sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the efficiency of existing laboratory processes. PMID:29692587

Exploring an educational assessment tool to measure registered nurses' knowledge of hearing impairment and effective communication strategies: A USA study.

PubMed

Ruesch, Amy L

2018-01-01

Poor communication between the Registered Nurse and a hearing impaired patient can affect quality of care and health outcomes. Communication skills training programs for healthcare providers are needed to improve patient centered care. A descriptive research study, using a knowledge assessment tool developed and validated by the researcher, was conducted on 339 Registered Nurses to identify knowledge deficits to be addressed in a communication skills training program being designed. The educational tool measured the Registered Nurses' knowledge across four areas - hearing impairment, hearing aids, communication strategies, and regulations regarding access to care for a person with a hearing disability. Knowledge deficits were detected in all four areas. Using this educational assessment tool may enable nurse educators to tailor communication skills training programs to specifically address the gaps identified regarding hearing impairment and how to effectively communicate with the hearing impaired patient. Post training program, nurse educators can use the tool to evaluate effectiveness. Copyright © 2017 Elsevier Ltd. All rights reserved.

Fall prevention strategy in an emergency department.

PubMed

Muray, Mwali; Bélanger, Charles H; Razmak, Jamil

2018-02-12

Purpose The purpose of this paper is to document the need for implementing a fall prevention strategy in an emergency department (ED). The paper also spells out the research process that led to approving an assessment tool for use in hospital outpatient services. Design/methodology/approach The fall risk assessment tool was based on the Morse Fall Scale. Gender mix and age above 65 and 80 years were assessed on six risk assessment variables using χ 2 analyses. A logistic regression analysis and model were used to test predictor strength and relationships among variables. Findings In total, 5,371 (56.5 percent) geriatric outpatients were deemed to be at fall risk during the study. Women have a higher falls incidence in young and old age categories. Being on medications for patients above 80 years exposed both genders to equal fall risks. Regression analysis explained 73-98 percent of the variance in the six-variable tool. Originality/value Canadian quality and safe healthcare accreditation standards require that hospital staff develop and adhere to fall prevention policies. Anticipated physiological falls can be prevented by healthcare interventions, particularly with older people known to bear higher risk factors. An aging population is increasing healthcare volumes and medical challenges. Precautionary measures for patients with a vulnerable cognitive and physical status are essential for quality care.

Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Hartling, Lisa

2017-03-23

Overviews of reviews (overviews) compile information from multiple systematic reviews (SRs) to provide a single synthesis of relevant evidence for decision-making. It is recommended that authors assess and report the methodological quality of SRs in overviews-for example, using A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Currently, there is variation in whether and how overview authors assess and report SR quality, and limited guidance is available. Our objectives were to: examine methodological considerations involved in using AMSTAR to assess the quality of Cochrane and non-Cochrane SRs in overviews of healthcare interventions; identify challenges (and develop potential decision rules) when using AMSTAR in overviews; and examine the potential impact of considering methodological quality when making inclusion decisions in overviews. We selected seven overviews of healthcare interventions and included all SRs meeting each overview's inclusion criteria. For each SR, two reviewers independently conducted AMSTAR assessments with consensus and discussed challenges encountered. We also examined the correlation between AMSTAR assessments and SR results/conclusions. Ninety-five SRs were included (30 Cochrane, 65 non-Cochrane). Mean AMSTAR assessments (9.6/11 vs. 5.5/11; p < 0.001) and inter-rater reliability (AC1 statistic: 0.84 vs. 0.69; "almost perfect" vs. "substantial" using the Landis & Koch criteria) were higher for Cochrane compared to non-Cochrane SRs. Four challenges were identified when applying AMSTAR in overviews: the scope of the SRs and overviews often differed; SRs examining similar topics sometimes made different methodological decisions; reporting of non-Cochrane SRs was sometimes poor; and some non-Cochrane SRs included other SRs as well as primary studies. Decision rules were developed to address each challenge. We found no evidence that AMSTAR assessments were correlated with SR results/conclusions. Results indicate that the AMSTAR tool can be used successfully in overviews that include Cochrane and non-Cochrane SRs, though decision rules may be useful to circumvent common challenges. Findings support existing recommendations that quality assessments of SRs in overviews be conducted independently, in duplicate, with a process for consensus. Results also suggest that using methodological quality to guide inclusion decisions (e.g., to exclude poorly conducted and reported SRs) may not introduce bias into the overview process.

Use of Standardized Assessment Tools to Improve the Effectiveness of Palliative Care Rounds: A Quality Improvement Initiative.

PubMed

Spaner, Donna; Caraiscos, Valerie B; Muystra, Christina; Furman, Margaret Lynn; Zaltz-Dubin, Jodi; Wharton, Marilyn; Whitehead, Katherine

Optimal care for patients in the palliative care setting requires effective clinical teamwork. Communication may be challenging for health-care workers from different disciplines. Daily rounds are one way for clinical teams to share information and develop care plans for patients. The objective of this initiative was to improve the structure and process of daily palliative care rounds by incorporating the use of standardized tools and improved documentation into the meeting. We chose a quality improvement (QI) approach to address this initiative. Our aims were to increase the use of assessment tools when discussing patient care in rounds and to improve the documentation and accessibility of important information in the health record, including goals of care. This QI initiative used a preintervention and postintervention comparison of the outcome measures of interest. The initiative was tested in a palliative care unit (PCU) over a 22-month period from April 2014 to January 2016. Participants were clinical staff in the PCU. Data collected after the completion of several plan-do-study-act cycles showed increased use and incorporation of the Edmonton Symptom Assessment System and Palliative Performance Scale into patient care discussions as well as improvement in inclusion of goals of care into the patient plan of care. Our findings demonstrate that the effectiveness of daily palliative care rounds can be improved by incorporating the use of standard assessment tools and changes into the meeting structure to better focus and direct patient care discussions.

Applying a Data Stewardship Maturity Matrix to the NOAA Observing System Portfolio Integrated Assessment Process

NASA Astrophysics Data System (ADS)

Peng, G.; Austin, M.

2017-12-01

Identification and prioritization of targeted user community needs are not always considered until after data has been created and archived. Gaps in data curation and documentation in the data production and delivery phases limit data's broad utility specifically for decision makers. Expert understanding and knowledge of a particular dataset is often required as a part of the data and metadata curation process to establish the credibility of the data and support informed decision-making. To enhance curation practices, content from NOAA's Observing System Integrated Assessment (NOSIA) Value Tree, NOAA's Data Catalog/Digital Object Identifier (DOI) projects (collection-level metadata) have been integrated with Data/Stewardship Maturity Matrices (data and stewardship quality information) focused on assessment of user community needs. This results in user focused evidence based decision making tools created by NOAA's National Environmental Satellite, Data, and Information Service (NESDIS) through identification and assessment of data content gaps related to scientific knowledge and application to key areas of societal benefit. Through enabling user need feedback from the beginning of data creation through archive allows users to determine the quality and value of data that is fit for purpose. Data gap assessment and prioritization are presented in a user-friendly way using the data stewardship maturity matrices as measurement of data management quality. These decision maker tools encourages data producers and data providers/stewards to consider users' needs prior to data creation and dissemination resulting in user driven data requirements increasing return on investment. A use case focused on need for NOAA observations linked societal benefit will be used to demonstrate the value of these tools.

High-volume image quality assessment systems: tuning performance with an interactive data visualization tool

NASA Astrophysics Data System (ADS)

Bresnahan, Patricia A.; Pukinskis, Madeleine; Wiggins, Michael

1999-03-01

Image quality assessment systems differ greatly with respect to the number and types of mags they need to evaluate, and their overall architectures. Managers of these systems, however, all need to be able to tune and evaluate system performance, requirements often overlooked or under-designed during project planning. Performance tuning tools allow users to define acceptable quality standards for image features and attributes by adjusting parameter settings. Performance analysis tools allow users to evaluate and/or predict how well a system performs in a given parameter state. While image assessment algorithms are becoming quite sophisticated, duplicating or surpassing the human decision making process in their speed and reliability, they often require a greater investment in 'training' or fine tuning of parameters in order to achieve optimum performance. This process may involve the analysis of hundreds or thousands of images, generating a large database of files and statistics that can be difficult to sort through and interpret. Compounding the difficulty is the fact that personnel charged with tuning and maintaining the production system may not have the statistical or analytical background required for the task. Meanwhile, hardware innovations have greatly increased the volume of images that can be handled in a given time frame, magnifying the consequences of running a production site with an inadequately tuned system. In this paper, some general requirements for a performance evaluation and tuning data visualization system are discussed. A custom engineered solution to the tuning and evaluation problem is then presented, developed within the context of a high volume image quality assessment, data entry, OCR, and image archival system. A key factor influencing the design of the system was the context-dependent definition of image quality, as perceived by a human interpreter. This led to the development of a five-level, hierarchical approach to image quality evaluation. Lower-level pass-fail conditions and decision rules were coded into the system. Higher-level image quality states were defined by allowing the users to interactively adjust the system's sensitivity to various image attributes by manipulating graphical controls. Results were presented in easily interpreted bar graphs. These graphs were mouse- sensitive, allowing the user to more fully explore the subsets of data indicated by various color blocks. In order to simplify the performance evaluation and tuning process, users could choose to view the results of (1) the existing system parameter state, (2) the results of any arbitrary parameter values they chose, or (3) the results of a quasi-optimum parameter state, derived by applying a decision rule to a large set of possible parameter states. Giving managers easy- to-use tools for defining the more subjective aspects of quality resulted in a system that responded to contextual cues that are difficult to hard-code. It had the additional advantage of allowing the definition of quality to evolve over time, as users became more knowledgeable as to the strengths and limitations of an automated quality inspection system.

Designing a Method with Physician Participation to Assess and Improve Quality of Healthcare in Otolaryngology.

PubMed

Arce, José M; Martín Cleary, Catalina; Cenjor, Carlos; Ramos, Ángel; Ortiz, Alberto

2017-04-01

Patient choice of healthcare centers to be treated for specific diseases is compromised by the low accessibility of understandable information. Physicians are rarely involved in healthcare quality assessment, despite their potentially valuable input. The purpose of this study was to develop a methodology for evaluating the quality of care that specifically incorporates advice from medical specialists and provides accessible information for patients in search of high-quality healthcare. A pilot Delphi study was conducted among 28 Spanish otolaryngology experts, seeking their opinion on the quality-of-care indicators and on their ability to recommend the most suitable department for the treatment of specific otolaryngologic diseases. The average acceptance rate was 91.9% for quality-of-care indicator and 96.5% for the resources needed for improving the quality of care. Furthermore, 93% experts reported that patients frequently ask for physician advice on which center provides better care for a specific disease, 92.6% experts believe they could recommend the best centers for specific otolaryngologic diseases, and 80% experts agreed that expert opinion on the quality of care offered by different centers would be a valuable addition to quality-of-care assessment. The incorporation of physician advice into healthcare quality assessment may improve the usefulness of healthcare quality indicators for patients. Assessment tools incorporating physician advice should be developed and validated.

Student self-assessment in an interactive learning environment: Technological tools for scaffolding and understanding self-assessment practices

NASA Astrophysics Data System (ADS)

Eslinger, Eric Martin

Metacognitive skills are a crucial component of a successful learning career. We define metacognition as the ability to plan, monitor progress toward a goal, reflect on the quality of work and process, and revise the work or plan accordingly. By explicitly addressing certain metacognitive practices in classrooms, researchers have observed improved learning outcomes in both science and mathematical problem solving. Although these efforts were successful, they were also limited in the range of skills that could be addressed at one time and the methods used to address them due to the static nature inherent in traditional pencil-and-paper format. We wished to address these skills in a more dynamic, continuous representation such as that afforded by a computerized learning environment. This paper outlines such an environment and describes pedagogical activities afforded by the system. The ThinkerTools group developed and tested a software scaffold for inquiry projects in a middle-school classroom. By analyzing student use of the software tool, three forms of self-assessment activity were noted: integrated, task and project self-assessment. Each assessment form was related to the degree of interleaving between assessment and work the students engaged in as they developed their inquiry products. I argue that the integrated forms of assessment are more beneficial to student learning, and show that there is a significant relationship between active self-assessment forms and measures of student achievement and product quality. Through the use of case studies including video analysis, I address specific student self-assessment activity that utilized the software as well as self-assessment that took place outside of the software. A model of student self-assessment activity was created, highlighting aspects of activity that afford more productive self-assessment episodes.

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Eco-innovative design approach: Integrating quality and environmental aspects in prioritizing and solving engineering problems

NASA Astrophysics Data System (ADS)

Chakroun, Mahmoud; Gogu, Grigore; Pacaud, Thomas; Thirion, François

2014-09-01

This study proposes an eco-innovative design process taking into consideration quality and environmental aspects in prioritizing and solving technical engineering problems. This approach provides a synergy between the Life Cycle Assessment (LCA), the nonquality matrix, the Theory of Inventive Problem Solving (TRIZ), morphological analysis and the Analytical Hierarchy Process (AHP). In the sequence of these tools, LCA assesses the environmental impacts generated by the system. Then, for a better consideration of environmental aspects, a new tool is developed, the non-quality matrix, which defines the problem to be solved first from an environmental point of view. The TRIZ method allows the generation of new concepts and contradiction resolution. Then, the morphological analysis offers the possibility of extending the search space of solutions in a design problem in a systematic way. Finally, the AHP identifies the promising solution(s) by providing a clear logic for the choice made. Their usefulness has been demonstrated through their application to a case study involving a centrifugal spreader with spinning discs.

Neighborhood Quality and Attachment: Validation of the Revised Residential Environment Assessment Tool.

PubMed

Poortinga, Wouter; Calve, Tatiana; Jones, Nikki; Lannon, Simon; Rees, Tabitha; Rodgers, Sarah E; Lyons, Ronan A; Johnson, Rhodri

2017-04-01

Various studies have shown that neighborhood quality is linked to neighborhood attachment and satisfaction. However, most have relied upon residents' own perceptions rather than independent observations of the neighborhood environment. This study examines the reliability and validity of the revised Residential Environment Assessment Tool (REAT 2.0), an audit instrument covering both public and private spaces of the neighborhood environment. The research shows that REAT 2.0 is a reliable, easy-to-use instrument and that most underlying constructs can be validated against residents' own neighborhood perceptions. The convergent validity of the instrument, which was tested against digital map data, can be improved for a number of miscellaneous urban form items. The research further found that neighborhood attachment was significantly associated with the overall REAT 2.0 score. This association can mainly be attributed to the property-level neighborhood quality and natural elements components. The research demonstrates the importance of private spaces in the outlook of the neighborhood environment.

Development and Validation of a Cross-Country Hospital Patient Quality of Care Assessment Tool in Europe.

PubMed

Villiers-Tuthill, Amanda; Doulougeri, Karolina; McGee, Hannah; Montgomery, Anthony; Panagopoulou, Efharis; Morgan, Karen

2017-12-01

Patient perceptions of quality of care (QoC) are directly linked with patient safety and clinical effectiveness. We need patient-designed QoC instruments that work across languages and countries to optimise studies across systems in this area. Few QoC measurement tools exist that assess all aspects of QoC from the patient perspective. This paper describes the development and validation of a comprehensive measure to assess patient perceptions of QoC that incorporates technical and interpersonal aspects of care and is grounded in the established Institute of Medicine (IOM) QoC framework. We conducted a multi-country cross-sectional study. Following a literature review and patient focus groups, an expert panel generated questionnaire items. Following a pilot study, item numbers were reduced. The final questionnaire consisted of three sections: demographics, perceived QoC and one open-ended question. Data was collected from patients (n = 531) discharged from hospitals across seven countries in South East Europe (languages: Turkish, Greek, Portuguese, Romanian, Croatian, Macedonian and Bulgarian). Reliability and validity of the measure were assessed. Confirmatory factor analysis was used to compare various factor models of patient-perceived QoC. Good model fit was demonstrated for a two-factor model: communication and interpersonal care, and hospital facilities. The ORCAB (Improving quality and safety in the hospital: The link between organisational culture, burnout and quality of care) Patient QoC questionnaire has been collaboratively and exhaustively developed between healthcare professionals and patients. It enables patient QoC data to be assessed in the context of the IOM pillars of quality, considering both technical and interpersonal dimensions of care. It represents an important first step in including the patient perspective.

Evaluation of Cross-Cultural Adaptation and Measurement Properties of STarT Back Screening Tool: A Systematic Review.

PubMed

Al Zoubi, Fadi M; Eilayyan, Owis; Mayo, Nancy E; Bussières, André E

2017-10-01

The purpose of this systematic review was to investigate the extent to which the STarT Back Screening Tool (SBST) has been evaluated for (1) the quality of translation of evidence for cross-cultural adaptation and (2) the measurement properties in languages other than English. A systematic search of 8 databases, including Medline, Embase, CINAHL, PsycINFO, AMED, Scopus, PubMed, and Web of Science, was performed. Electronic databases were searched for the period between 2008 and December 27, 2016. We included studies related to cross-cultural adaptation, including translation and assessment of the measurement properties of SBST. Study selection, translation, methodologic and quality assessments, and data extraction were performed independently by 2 reviewers. Of the 1566 citations retrieved, 17 studies were admissible, representing 11 different SBST versions in 10 languages. The quadratic weighted κ statistics of the 2 reviewers, for the translation, methodologic assessment, and quality assessment were 0.85, 0.76, and 0.83, respectively. For translation, only 2 versions (Belgian-French and Mandarin) fulfilled all requirements. None of the versions had tested all the measurement properties, and when performed, these were found to have been conducted inadequately. With regard to quality assessment, overall, the included versions had a "Poor" total summary score except 2 (Persian and Swiss-German), which were rated as "Fair." Few versions fully met the standard criteria for valid translation, and none of the versions tested all the measurement properties. There is a clear need for more accurate cross-cultural adaptation of SBST and greater attention to the quality of psychometric evaluation of the adapted versions of SBST. At this time, caution is recommended when using SBST in languages other than English. Copyright © 2017. Published by Elsevier Inc.

Pupillometry: Cutting Edge Biometrics for Early Intervention in Increased Intracranial Pressure.

PubMed

John, Jennilee St

2015-10-01

The pupillometer, a cutting-edge biometric device, is a valuable assessment tool that can aid in the early detection and prompt treatment of neurological abnormalities. Pupil assessment is a critical component of the neurological examination, and manual pupil assessment leaves much room for error. Automated pupillometry improves the quality and reliability of pupillary and neurological assessments, ultimately improving patient outcomes. Copyright 2015, SLACK Incorporated.