On the evaluation of segmentation editing tools

PubMed Central

Heckel, Frank; Moltz, Jan H.; Meine, Hans; Geisler, Benjamin; Kießling, Andreas; D’Anastasi, Melvin; dos Santos, Daniel Pinto; Theruvath, Ashok Joseph; Hahn, Horst K.

2014-01-01

Abstract. Efficient segmentation editing tools are important components in the segmentation process, as no automatic methods exist that always generate sufficient results. Evaluating segmentation editing algorithms is challenging, because their quality depends on the user’s subjective impression. So far, no established methods for an objective, comprehensive evaluation of such tools exist and, particularly, intermediate segmentation results are not taken into account. We discuss the evaluation of editing algorithms in the context of tumor segmentation in computed tomography. We propose a rating scheme to qualitatively measure the accuracy and efficiency of editing tools in user studies. In order to objectively summarize the overall quality, we propose two scores based on the subjective rating and the quantified segmentation quality over time. Finally, a simulation-based evaluation approach is discussed, which allows a more reproducible evaluation without the need for human input. This automated evaluation complements user studies, allowing a more convincing evaluation, particularly during development, where frequent user studies are not possible. The proposed methods have been used to evaluate two dedicated editing algorithms on 131 representative tumor segmentations. We show how the comparison of editing algorithms benefits from the proposed methods. Our results also show the correlation of the suggested quality score with the qualitative ratings. PMID:26158063

Report Central: Quality Reporting Tool in an Electronic Health Record

PubMed Central

Jung, Eunice; Li, Qi; Mangalampalli, Anil; Greim, Julie; Eskin, Michael S.; Housman, Dan; Isikoff, Jeremy; Abend, Aaron H.; Middleton, Blackford; Einbinder, Jonathan S.

2006-01-01

Quality reporting tools, integrated with ambulatory electronic health records, can help clinicians and administrators understand performance, manage populations, and improve quality. Report Central is a secure web report delivery tool built on Crystal Reports XI™ and ASP.NET technologies. Pilot evaluation of Report Central indicates that clinicians prefer a quality reporting tool that is integrated with our home-grown EHR to support clinical workflow. PMID:17238590

Evaluating Inclusive Educational Practices for Students with Severe Disabilities Using the Program Quality Measurement Tool

ERIC Educational Resources Information Center

Cushing, Lisa S.; Carter, Erik W.; Clark, Nitasha; Wallis, Terry; Kennedy, Craig H.

2009-01-01

Recent legislative and school reform efforts require schools to evaluate and improve educational practices for students with severe disabilities. The authors developed the "Program Quality Measurement Tool" (PQMT) to enable administrators and educators to evaluate the educational programming provided to students with severe disabilities against…

Evaluating online diagnostic decision support tools for the clinical setting.

PubMed

Pryor, Marie; White, David; Potter, Bronwyn; Traill, Roger

2012-01-01

Clinical decision support tools available at the point of care are an effective adjunct to support clinicians to make clinical decisions and improve patient outcomes. We developed a methodology and applied it to evaluate commercially available online clinical diagnostic decision support (DDS) tools for use at the point of care. We identified 11 commercially available DDS tools and assessed these against an evaluation instrument that included 6 categories; general information, content, quality control, search, clinical results and other features. We developed diagnostically challenging clinical case scenarios based on real patient experience that were commonly missed by junior medical staff. The evaluation was divided into 2 phases; an initial evaluation of all identified and accessible DDS tools conducted by the Clinical Information Access Portal (CIAP) team and a second phase that further assessed the top 3 tools identified in the initial evaluation phase. An evaluation panel consisting of senior and junior medical clinicians from NSW Health conducted the second phase. Of the eleven tools that were assessed against the evaluation instrument only 4 tools completely met the DDS definition that was adopted for this evaluation and were able to produce a differential diagnosis. From the initial phase of the evaluation 4 DDS tools scored 70% or more (maximum score 96%) for the content category, 8 tools scored 65% or more (maximum 100%) for the quality control category, 5 tools scored 65% or more (maximum 94%) for the search category, and 4 tools score 70% or more (maximum 81%) for the clinical results category. The second phase of the evaluation was focused on assessing diagnostic accuracy for the top 3 tools identified in the initial phase. Best Practice ranked highest overall against the 6 clinical case scenarios used. Overall the differentiating factor between the top 3 DDS tools was determined by diagnostic accuracy ranking, ease of use and the confidence and credibility of the clinical information. The evaluation methodology used here to assess the quality and comprehensiveness of clinical DDS tools was effective in identifying the most appropriate tool for the clinical setting. The use of clinical case scenarios is fundamental in determining the diagnostic accuracy and usability of the tools.

Appraisal Tools for Clinical Practice Guidelines: A Systematic Review

PubMed Central

Siering, Ulrich; Eikermann, Michaela; Hausner, Elke; Hoffmann-Eßer, Wiebke; Neugebauer, Edmund A.

2013-01-01

Introduction Clinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools. Methods Among others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items. Results We identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions “evaluation of evidence” (mentioned in 35 tools; 88%), “presentation of guideline content” (34 tools; 85%), “transferability” (33 tools; 83%), “independence” (32 tools; 80%), “scope” (30 tools; 75%), and “information retrieval” (29 tools; 73%). The quality dimensions “consideration of different perspectives” and “dissemination, implementation and evaluation of the guideline” were covered by only twenty (50%) and eighteen tools (45%) respectively. Conclusions Most guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools. PMID:24349397

Tools for observational gait analysis in patients with stroke: a systematic review.

PubMed

Ferrarello, Francesco; Bianchi, Valeria Anna Maria; Baccini, Marco; Rubbieri, Gaia; Mossello, Enrico; Cavallini, Maria Chiara; Marchionni, Niccolò; Di Bari, Mauro

2013-12-01

Stroke severely affects walking ability, and assessment of gait kinematics is important in defining diagnosis, planning treatment, and evaluating interventions in stroke rehabilitation. Although observational gait analysis is the most common approach to evaluate gait kinematics, tools useful for this purpose have received little attention in the scientific literature and have not been thoroughly reviewed. The aims of this systematic review were to identify tools proposed to conduct observational gait analysis in adults with a stroke, to summarize evidence concerning their quality, and to assess their implementation in rehabilitation research and clinical practice. An extensive search was performed of original articles reporting on visual/observational tools developed to investigate gait kinematics in adults with a stroke. Two reviewers independently selected studies, extracted data, assessed quality of the included studies, and scored the metric properties and clinical utility of each tool. Rigor in reporting metric properties and dissemination of the tools also was evaluated. Five tools were identified, not all of which had been tested adequately for their metric properties. Evaluation of content validity was partially satisfactory. Reliability was poorly investigated in all but one tool. Concurrent validity and sensitivity to change were shown for 3 and 2 tools, respectively. Overall, adequate levels of quality were rarely reached. The dissemination of the tools was poor. Based on critical appraisal, the Gait Assessment and Intervention Tool shows a good level of quality, and its use in stroke rehabilitation is recommended. Rigorous studies are needed for the other tools in order to establish their usefulness.

An Approach to Industrial Stormwater Benchmarks: Establishing and Using Site-Specific Threshold Criteria at Lawrence Livermore National Laboratory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Campbell, C G; Mathews, S

2006-09-07

Current regulatory schemes use generic or industrial sector specific benchmarks to evaluate the quality of industrial stormwater discharges. While benchmarks can be a useful tool for facility stormwater managers in evaluating the quality stormwater runoff, benchmarks typically do not take into account site-specific conditions, such as: soil chemistry, atmospheric deposition, seasonal changes in water source, and upstream land use. Failing to account for these factors may lead to unnecessary costs to trace a source of natural variation, or potentially missing a significant local water quality problem. Site-specific water quality thresholds, established upon the statistical evaluation of historic data take intomore » account these factors, are a better tool for the direct evaluation of runoff quality, and a more cost-effective trigger to investigate anomalous results. Lawrence Livermore National Laboratory (LLNL), a federal facility, established stormwater monitoring programs to comply with the requirements of the industrial stormwater permit and Department of Energy orders, which require the evaluation of the impact of effluent discharges on the environment. LLNL recognized the need to create a tool to evaluate and manage stormwater quality that would allow analysts to identify trends in stormwater quality and recognize anomalous results so that trace-back and corrective actions could be initiated. LLNL created the site-specific water quality threshold tool to better understand the nature of the stormwater influent and effluent, to establish a technical basis for determining when facility operations might be impacting the quality of stormwater discharges, and to provide ''action levels'' to initiate follow-up to analytical results. The threshold criteria were based on a statistical analysis of the historic stormwater monitoring data and a review of relevant water quality objectives.« less

Developing a consumer evaluation tool of weight control strategy advertisements on the Internet.

PubMed

Luevorasirikul, Kanokrat; Gray, Nicola J; Anderson, Claire W

2008-06-01

To develop two evaluation tools for weight loss and weight gain advertisements on the Internet in order to help consumers to evaluate the quality of information within these advertisements. One hundred websites identified by Internet search engines for weight loss and weight gain strategies (50 websites each) were evaluated using two specific scoring instruments, developed by adapting questions from the 'DISCERN' tool and reviewing all related weight control guidelines and advertising regulations. The validity and reliability of the adapted tools were tested. Our evaluation tools rated the information from most websites as poor quality (70%). In the case of weight loss strategies, statements about rapid (18%) and permanent (28%) weight loss caused concern as well as lack of sensible advice about dieting and a lack of product warnings (84%). Safety concerns relating to weight gain products were the lack of warnings about side effects in products containing steroids and creatine (92%). The adapted tools exhibited acceptable validity and reliability. Quality of information within weight control advertisements on the Internet was generally poor. Problems of false claims, little advice on healthy ways to modify weight and few warnings on side effects have been highlighted in this study.

Multiple Criteria Evaluation of Quality and Optimisation of e-Learning System Components

ERIC Educational Resources Information Center

Kurilovas, Eugenijus; Dagiene, Valentina

2010-01-01

The main research object of the paper is investigation and proposal of the comprehensive Learning Object Repositories (LORs) quality evaluation tool suitable for their multiple criteria decision analysis, evaluation and optimisation. Both LORs "internal quality" and "quality in use" evaluation (decision making) criteria are analysed in the paper.…

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing.

PubMed

González-Chordá, Víctor Manuel; Maciá-Soler, María Loreto

2015-01-01

to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. prospective longitudinal study conducted in a population of 60 secondyear Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teachinglearning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care.

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

New tools for sculpting cranial implants in a shared haptic augmented reality environment.

PubMed

Ai, Zhuming; Evenhouse, Ray; Leigh, Jason; Charbel, Fady; Rasmussen, Mary

2006-01-01

New volumetric tools were developed for the design and fabrication of high quality cranial implants from patient CT data. These virtual tools replace time consuming physical sculpting, mold making and casting steps. The implant is designed by medical professionals in tele-immersive collaboration. Virtual clay is added in the virtual defect area on the CT data using the adding tool. With force feedback the modeler can feel the edge of the defect and fill only the space where no bone is present. A carving tool and a smoothing tool are then used to sculpt and refine the implant. To make a physical evaluation, the skull with simulated defect and the implant are fabricated via stereolithography to allow neurosurgeons to evaluate the quality of the implant. Initial tests demonstrate a very high quality fit. These new haptic volumetric sculpting tools are a critical component of a comprehensive tele-immersive system.

Current Quality-of-Life Tools Available for Use in Contact Dermatitis.

PubMed

Swietlik, Jacquelyn; Reeder, Margo

2016-01-01

Contact dermatitis is a common dermatologic condition that can cause significant impairment in patients' overall quality of life (QoL). This impact is separate and potentially more clinically relevant than one's disease "severity" in contact dermatitis and should be consistently addressed by dermatologists. Despite this, QoL tools specific to contact dermatitis are lacking, and there is little consistency in the literature regarding the tool used to evaluate clinical response to therapies. Measurements currently available to evaluate disease-related QoL in contact dermatitis fit into 1 of the following 3 general types: generic health-related QoL measures, dermatology-related QoL measures, or specific dermatologic disease-related QoL measures. This article reviews the strengths and weaknesses of existing QoL tools used in contact dermatitis including: Short Form Survey 36, Dermatology Life Quality Index, Skindex-29, Skindex-16, Dermatology-Specific Quality of Life, and Fragrance Quality of Life Index.

Quality Evaluation Tool for Computer-and Web-Delivered Instruction

DTIC Science & Technology

2005-06-01

Bryman , A ., Mars, R., & Tapangco, L. (1996). When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons...is unlimited. " A " 13. ABSTRACT (Maximum 200 words) The objective of this effort was to develop an Instructional Quality Evaluation Tool to help...developed for each rating point on all scales. This report includes these anchored Likert scales, which can serve as a "stand-alone" Tool. The

A Quality Model to Select Patients in Cupping Therapy Clinics: A New Tool for Ensuring Safety in Clinical Practice.

PubMed

Aboushanab, Tamer; AlSanad, Saud

2018-06-08

Cupping therapy is a popular treatment in various countries and regions, including Saudi Arabia. Cupping therapy is regulated in Saudi Arabia by the National Center for Complementary and Alternative Medicine (NCCAM), Ministry of Health. The authors recommend that this quality model for selecting patients in cupping clinics - first version (QMSPCC-1) - be used routinely as part of clinical practice and quality management in cupping clinics. The aim of the quality model is to ensure the safety of patients and to introduce and facilitate quality and auditing processes in cupping therapy clinics. Clinical evaluation of this tool is recommended. Continued development, re-evaluation and reassessment of this tool are important. Copyright © 2018. Published by Elsevier B.V.

Systematic review of the properties of tools used to measure outcomes in anxiety intervention studies for children with autism spectrum disorders.

PubMed

Wigham, Sarah; McConachie, Helen

2014-01-01

Evidence about relevant outcomes is required in the evaluation of clinical interventions for children with autism spectrum disorders (ASD). However, to date, the variety of outcome measurement tools being used, and lack of knowledge about the measurement properties of some, compromise conclusions regarding the most effective interventions. This two-stage systematic review aimed to identify the tools used in studies evaluating interventions for anxiety for high-functioning children with ASD in middle childhood, and then to evaluate the tools for their appropriateness and measurement properties. Electronic databases including Medline, PsychInfo, Embase, and the Cochrane database and registers were searched for anxiety intervention studies for children with ASD in middle childhood. Articles examining the measurement properties of the tools used were then searched for using a methodological filter in PubMed, and the quality of the papers evaluated using the COSMIN checklist. Ten intervention studies were identified in which six tools measuring anxiety and one of overall symptom change were used as primary outcomes. One further tool was included as it is recommended for standard use in UK children's mental health services. Sixty three articles on the properties of the tools were evaluated for the quality of evidence, and the quality of the measurement properties of each tool was summarised. Overall three questionnaires were found robust in their measurement properties, the Spence Children's Anxiety Scale, its revised version - the Revised Children's Anxiety and Depression Scale, and also the Screen for Child Anxiety Related Emotional Disorders. Crucially the articles on measurement properties provided almost no evidence on responsiveness to change, nor on the validity of use of the tools for evaluation of interventions for children with ASD. CRD42012002684.

Systematic Review of the Properties of Tools Used to Measure Outcomes in Anxiety Intervention Studies for Children with Autism Spectrum Disorders

PubMed Central

Wigham, Sarah; McConachie, Helen

2014-01-01

Background Evidence about relevant outcomes is required in the evaluation of clinical interventions for children with autism spectrum disorders (ASD). However, to date, the variety of outcome measurement tools being used, and lack of knowledge about the measurement properties of some, compromise conclusions regarding the most effective interventions. Objectives This two-stage systematic review aimed to identify the tools used in studies evaluating interventions for anxiety for high-functioning children with ASD in middle childhood, and then to evaluate the tools for their appropriateness and measurement properties. Methods Electronic databases including Medline, PsychInfo, Embase, and the Cochrane database and registers were searched for anxiety intervention studies for children with ASD in middle childhood. Articles examining the measurement properties of the tools used were then searched for using a methodological filter in PubMed, and the quality of the papers evaluated using the COSMIN checklist. Results Ten intervention studies were identified in which six tools measuring anxiety and one of overall symptom change were used as primary outcomes. One further tool was included as it is recommended for standard use in UK children's mental health services. Sixty three articles on the properties of the tools were evaluated for the quality of evidence, and the quality of the measurement properties of each tool was summarised. Conclusions Overall three questionnaires were found robust in their measurement properties, the Spence Children's Anxiety Scale, its revised version – the Revised Children's Anxiety and Depression Scale, and also the Screen for Child Anxiety Related Emotional Disorders. Crucially the articles on measurement properties provided almost no evidence on responsiveness to change, nor on the validity of use of the tools for evaluation of interventions for children with ASD. PROSPERO Registration number CRD42012002684. PMID:24465519

A comparative evaluation of genome assembly reconciliation tools.

PubMed

Alhakami, Hind; Mirebrahim, Hamid; Lonardi, Stefano

2017-05-18

The majority of eukaryotic genomes are unfinished due to the algorithmic challenges of assembling them. A variety of assembly and scaffolding tools are available, but it is not always obvious which tool or parameters to use for a specific genome size and complexity. It is, therefore, common practice to produce multiple assemblies using different assemblers and parameters, then select the best one for public release. A more compelling approach would allow one to merge multiple assemblies with the intent of producing a higher quality consensus assembly, which is the objective of assembly reconciliation. Several assembly reconciliation tools have been proposed in the literature, but their strengths and weaknesses have never been compared on a common dataset. We fill this need with this work, in which we report on an extensive comparative evaluation of several tools. Specifically, we evaluate contiguity, correctness, coverage, and the duplication ratio of the merged assembly compared to the individual assemblies provided as input. None of the tools we tested consistently improved the quality of the input GAGE and synthetic assemblies. Our experiments show an increase in contiguity in the consensus assembly when the original assemblies already have high quality. In terms of correctness, the quality of the results depends on the specific tool, as well as on the quality and the ranking of the input assemblies. In general, the number of misassemblies ranges from being comparable to the best of the input assembly to being comparable to the worst of the input assembly.

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

The Definition and Measurement of Evaluation Quality as a Management Tool.

ERIC Educational Resources Information Center

Chelimsky, Eleanor

1983-01-01

Evaluation management requires a system for measuring, improving, and accounting for quality. The Institute for Program Evaluation in the United States General Accounting Office is developing such a system. (Author)

[A quality evaluation tableau for health institutions: an educational tool].

PubMed

Moll, Marie Christine; Decavel, Frédérique; Merlet, Christine

2009-09-01

For a few years, health institutions have had to comply with the certification and the need to establish the new governance. Thanks to the accreditation version 2 (obtained in 2005), the elaboration of the hospital project (adopted in October, 2006) and the organization in poles since 2006, the quality oriented management became a priority axis at the University Hospital of Angers. The strategic adaptation to quality requirements leads to develop the hospital management, more especially at the level of the clinical, medico technical and administrative poles. The elements of the hospital project including the part about the quality, risk and evaluation aim at being adapted by every pole according to the level of its project. This adaptation which is imposed to each pole manager requires a practical and educational accompaniment allowing at the same time to realize a diagnosis of the progress of the quality approach, a measure of the impact of the global impregnation within the institution and a comparison between pole. A eight axis dashboard with criteria and a user guide were developed from certification ISO 9001, the EFQM manual and the certification manual version 2 of the Healthcare High Authorities. The criteria are transcribed in an EXCEL grid ready to use. Succeeding in estimating your own quality system means that you demonstrate the maturity of the quality approach. The results of this evaluation confirmed those of the certification. The dashboard is a management structuring tool at the service of the multidisciplinary team. Two considerations emerge from these results: First of all, for the hospital top management, the axes to be improved emerge as a priority to determine and target the next annual action plans. The results also allow to support the auto evaluation for the certification version 2010 planned in January of the same year. It is a pragmatic tool which allows auto evaluation and comparison to estimate the pole performances. It is a strategic driving tool for the hospital, for the quality department and for the pole. The pole quality system evaluation dashboard for Healthcare institutions is a simple tool which allies strategy and performance for a better efficiency of the actions to be taken to improve the quality, the risk management and the evaluation of the poles for a better service to the hospital users.

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing 1

PubMed Central

González-Chordá, Víctor Manuel; Maciá-Soler, María Loreto

2015-01-01

Abstract Objective: to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. Method: prospective longitudinal study conducted in a population of 60 secondyear Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. Results: nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). Conclusion: the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teachinglearning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care. PMID:26444173

The Comprehensive Evaluation of Electronic Learning Tools and Educational Software (CEELTES)

ERIC Educational Resources Information Center

Karolcík, Štefan; Cipková, Elena; Hrušecký, Roman; Veselský, Milan

2015-01-01

Despite the fact that digital technologies are more and more used in the learning and education process, there is still lack of professional evaluation tools capable of assessing the quality of used digital teaching aids in a comprehensive and objective manner. Construction of the Comprehensive Evaluation of Electronic Learning Tools and…

Prevention and management of "do not return" notices: a quality improvement process for supplemental staffing nursing agencies.

PubMed

Ade-Oshifogun, Jochebed Bosede; Dufelmeier, Thaddeus

2012-01-01

This article describes a quality improvement process for "do not return" (DNR) notices for healthcare supplemental staffing agencies and healthcare facilities that use them. It is imperative that supplemental staffing agencies partner with healthcare facilities in assuring the quality of supplemental staff. Although supplemental staffing agencies attempt to ensure quality staffing, supplemental staff are sometimes subjectively evaluated by healthcare facilities as "DNR." The objective of this article is to describe a quality improvement process to prevent and manage "DNR" within healthcare organizations. We developed a curriculum and accompanying evaluation tool by adapting Rampersad's problem-solving discipline approach: (a) definition of area(s) for improvement; (b) identification of all possible causes; (c) development of an action plan; (d) implementation of the action plan; (e) evaluation for program improvement; and (f) standardization of the process. Face and content validity of the evaluation tool was ascertained by input from a panel of experienced supplemental staff and nursing faculty. This curriculum and its evaluation tool will have practical implications for supplemental staffing agencies and healthcare facilities in reducing "DNR" rates and in meeting certification/accreditation requirements. Further work is needed to translate this process into future research. © 2012 Wiley Periodicals, Inc.

Patient-specific dosimetric endpoints based treatment plan quality control in radiotherapy.

PubMed

Song, Ting; Staub, David; Chen, Mingli; Lu, Weiguo; Tian, Zhen; Jia, Xun; Li, Yongbao; Zhou, Linghong; Jiang, Steve B; Gu, Xuejun

2015-11-07

In intensity modulated radiotherapy (IMRT), the optimal plan for each patient is specific due to unique patient anatomy. To achieve such a plan, patient-specific dosimetric goals reflecting each patient's unique anatomy should be defined and adopted in the treatment planning procedure for plan quality control. This study is to develop such a personalized treatment plan quality control tool by predicting patient-specific dosimetric endpoints (DEs). The incorporation of patient specific DEs is realized by a multi-OAR geometry-dosimetry model, capable of predicting optimal DEs based on the individual patient's geometry. The overall quality of a treatment plan is then judged with a numerical treatment plan quality indicator and characterized as optimal or suboptimal. Taking advantage of clinically available prostate volumetric modulated arc therapy (VMAT) treatment plans, we built and evaluated our proposed plan quality control tool. Using our developed tool, six of twenty evaluated plans were identified as sub-optimal plans. After plan re-optimization, these suboptimal plans achieved better OAR dose sparing without sacrificing the PTV coverage, and the dosimetric endpoints of the re-optimized plans agreed well with the model predicted values, which validate the predictability of the proposed tool. In conclusion, the developed tool is able to accurately predict optimally achievable DEs of multiple OARs, identify suboptimal plans, and guide plan optimization. It is a useful tool for achieving patient-specific treatment plan quality control.

A web tool for STORET/WQX water quality data retrieval and Best Management Practice scenario suggestion.

PubMed

Park, Youn Shik; Engel, Bernie A; Kim, Jonggun; Theller, Larry; Chaubey, Indrajeet; Merwade, Venkatesh; Lim, Kyoung Jae

2015-03-01

Total Maximum Daily Load is a water quality standard to regulate water quality of streams, rivers and lakes. A wide range of approaches are used currently to develop TMDLs for impaired streams and rivers. Flow and load duration curves (FDC and LDC) have been used in many states to evaluate the relationship between flow and pollutant loading along with other models and approaches. A web-based LDC Tool was developed to facilitate development of FDC and LDC as well as to support other hydrologic analyses. In this study, the FDC and LDC tool was enhanced to allow collection of water quality data via the web and to assist in establishing cost-effective Best Management Practice (BMP) implementations. The enhanced web-based tool provides use of water quality data not only from the US Geological Survey but also from the Water Quality Portal for the U.S. via web access. Moreover, the web-based tool identifies required pollutant reductions to meet standard loads and suggests a BMP scenario based on ability of BMPs to reduce pollutant loads, BMP establishment and maintenance costs. In the study, flow and water quality data were collected via web access to develop LDC and to identify the required reduction. The suggested BMP scenario from the web-based tool was evaluated using the EPA Spreadsheet Tool for the Estimation of Pollutant Load model to attain the required pollutant reduction at least cost. Copyright © 2014 Elsevier Ltd. All rights reserved.

Assessing Lymphatic Filariasis Data Quality in Endemic Communities in Ghana, Using the Neglected Tropical Diseases Data Quality Assessment Tool for Preventive Chemotherapy.

PubMed

de Souza, Dziedzom K; Yirenkyi, Eric; Otchere, Joseph; Biritwum, Nana-Kwadwo; Ameme, Donne K; Sackey, Samuel; Ahorlu, Collins; Wilson, Michael D

2016-03-01

The activities of the Global Programme for the Elimination of Lymphatic Filariasis have been in operation since the year 2000, with Mass Drug Administration (MDA) undertaken yearly in disease endemic communities. Information collected during MDA-such as population demographics, age, sex, drugs used and remaining, and therapeutic and geographic coverage-can be used to assess the quality of the data reported. To assist country programmes in evaluating the information reported, the WHO, in collaboration with NTD partners, including ENVISION/RTI, developed an NTD Data Quality Assessment (DQA) tool, for use by programmes. This study was undertaken to evaluate the tool and assess the quality of data reported in some endemic communities in Ghana. A cross sectional study, involving review of data registers and interview of drug distributors, disease control officers, and health information officers using the NTD DQA tool, was carried out in selected communities in three LF endemic Districts in Ghana. Data registers for service delivery points were obtained from District health office for assessment. The assessment verified reported results in comparison with recounted values for five indicators: number of tablets received, number of tablets used, number of tablets remaining, MDA coverage, and population treated. Furthermore, drug distributors, disease control officers, and health information officers (at the first data aggregation level), were interviewed, using the DQA tool, to determine the performance of the functional areas of the data management system. The results showed that over 60% of the data reported were inaccurate, and exposed the challenges and limitations of the data management system. The DQA tool is a very useful monitoring and evaluation (M&E) tool that can be used to elucidate and address data quality issues in various NTD control programmes.

Handling Qualities Evaluation of Pilot Tools for Spacecraft Docking in Earth Orbit

NASA Technical Reports Server (NTRS)

Bilimoria, Karl D.; Mueller, Eric; Frost, Chad

2009-01-01

A new generation of spacecraft is now under development by NASA to replace the Space Shuttle and return astronauts to the Moon. These spacecraft will have a manual control capability for several mission tasks, and the ease and precision with which pilots can execute these tasks will have an important effect on mission risk and training costs. This paper focuses on the handling qualities of a spacecraft based on dynamics similar to that of the Crew Exploration Vehicle, during the last segment of the docking task with a space station in low Earth orbit. A previous study established that handling qualities for this task degrade significantly as the level of translation-into-rotation coupling increases. The goal of this study is to evaluate the efficacy of various pilot aids designed to mitigate the handling qualities degradation caused by this coupling. Four pilot tools were ev adluaetead:d-band box/indicator, flight-path marker, translation guidance cues, and feed-forward control. Each of these pilot tools improved handling qualities, generally with greater improvements resulting from using these tools in combination. A key result of this study is that feedforward control effectively counteracts coupling effects, providing solid Level 1 handling qualities for the spacecraft configuration evaluated.

Electronic tools to support medication reconciliation: a systematic review.

PubMed

Marien, Sophie; Krug, Bruno; Spinewine, Anne

2017-01-01

Medication reconciliation (MedRec) is essential for reducing patient harm caused by medication discrepancies across care transitions. Electronic support has been described as a promising approach to moving MedRec forward. We systematically reviewed the evidence about electronic tools that support MedRec, by (a) identifying tools; (b) summarizing their characteristics with regard to context, tool, implementation, and evaluation; and (c) summarizing key messages for successful development and implementation. We searched PubMed, the Cumulative Index to Nursing and Allied Health Literature, Embase, PsycINFO, and the Cochrane Library, and identified additional reports from reference lists, reviews, and patent databases. Reports were included if the electronic tool supported medication history taking and the identification and resolution of medication discrepancies. Two researchers independently selected studies, evaluated the quality of reporting, and extracted data. Eighteen reports relative to 11 tools were included. There were eight quality improvement projects, five observational effectiveness studies, three randomized controlled trials (RCTs) or RCT protocols (ie, descriptions of RCTs in progress), and two patents. All tools were developed in academic environments in North America. Most used electronic data from multiple sources and partially implemented functionalities considered to be important. Relevant information on functionalities and implementation features was frequently missing. Evaluations mainly focused on usability, adherence, and user satisfaction. One RCT evaluated the effect on potential adverse drug events. Successful implementation of electronic tools to support MedRec requires favorable context, properly designed tools, and attention to implementation features. Future research is needed to evaluate the effect of these tools on the quality and safety of healthcare. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Teacher Quality, Professionalism and Professional Development: Findings from a European Project

ERIC Educational Resources Information Center

Hilton, Gillian; Flores, Maria Assunção; Niklasson, Laila

2013-01-01

This paper presents and discusses findings from a European project concerning strengthening the teacher's voice in defining professional quality. In the project tools were developed and evaluated to help teachers reflect on their professional quality. Twelve countries participated and twelve tools were tested with help of student teachers,…

Reliability and Utility of the Behaviour Support Plan Quality Evaluation Tool (BSP-QEII) for Auditing and Quality Development in Services for Adults with Intellectual Disability and Challenging Behaviour

ERIC Educational Resources Information Center

McVilly, K.; Webber, L.; Paris, M.; Sharp, G.

2013-01-01

Background: Having an objective means of evaluating the quality of behaviour support plans (BSPs) could assist service providers and statutory authorities to monitor and improve the quality of support provided to people with intellectual disability (ID) who exhibit challenging behaviour. The Behaviour Support Plan Quality Evaluation Guide II…

SUSTAIN - A BMP PROCESS AND PLACEMENT TOOL FOR URBAN WATERSHEDS

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads (...

SUSTAIN - A BMP PROCESS AND PLACEMENT TOOL FOR URBAN WATERSHEDS

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads ...

Breadth of Coverage, Ease of Use, and Quality of Mobile Point-of-Care Tool Information Summaries: An Evaluation

PubMed Central

Ren, Jinma

2016-01-01

Background With advances in mobile technology, accessibility of clinical resources at the point of care has increased. Objective The objective of this research was to identify if six selected mobile point-of-care tools meet the needs of clinicians in internal medicine. Point-of-care tools were evaluated for breadth of coverage, ease of use, and quality. Methods Six point-of-care tools were evaluated utilizing four different devices (two smartphones and two tablets). Breadth of coverage was measured using select International Classification of Diseases, Ninth Revision, codes if information on summary, etiology, pathophysiology, clinical manifestations, diagnosis, treatment, and prognosis was provided. Quality measures included treatment and diagnostic inline references and individual and application time stamping. Ease of use covered search within topic, table of contents, scrolling, affordance, connectivity, and personal accounts. Analysis of variance based on the rank of score was used. Results Breadth of coverage was similar among Medscape (mean 6.88), Uptodate (mean 6.51), DynaMedPlus (mean 6.46), and EvidencePlus (mean 6.41) (P>.05) with DynaMed (mean 5.53) and Epocrates (mean 6.12) scoring significantly lower (P<.05). Ease of use had DynaMedPlus with the highest score, and EvidencePlus was lowest (6.0 vs 4.0, respectively, P<.05). For quality, reviewers rated the same score (4.00) for all tools except for Medscape, which was rated lower (P<.05). Conclusions For breadth of coverage, most point-of-care tools were similar with the exception of DynaMed. For ease of use, only UpToDate and DynaMedPlus allow for search within a topic. All point-of-care tools have remote access with the exception of UpToDate and Essential Evidence Plus. All tools except Medscape covered criteria for quality evaluation. Overall, there was no significant difference between the point-of-care tools with regard to coverage on common topics used by internal medicine clinicians. Selection of point-of-care tools is highly dependent on individual preference based on ease of use and cost of the application. PMID:27733328

The coronary artery disease quality dashboard: a chronic care disease management tool in an electronic health record.

PubMed

Jung, Eunice; Schnipper, Jeffrey L; Li, Qi; Linder, Jeffrey A; Rose, Alan F; Li, Ruzhuo; Eskin, Michael S; Housman, Dan; Middleton, Blackford; Einbinder, Jonathan S

2007-10-11

Quality reporting tools, integrated with ambulatory electronic health records (EHRs), may help clinicians understand performance, manage populations, and improve quality. The Coronary Artery Disease Quality Dash board (CAD QD) is a secure web report for performance measurement of a chronic care condition delivered through a central data warehouse and custom-built reporting tool. Pilot evaluation of the CAD Quality Dash board indicates that clinicians prefer a quality report that combines not only structured data from EHRs but one that facilitates actions to be taken on individual patients or on a population, i.e., for case management.

A YEAR-LONG MM5 EVALUATION USING A MODEL EVALUATION TOOLKIT

EPA Science Inventory

Air quality modeling has expanded in both sophistication and application over the past decade. Meteorological and air quality modeling tools are being used for research, forecasting, and regulatory related emission control strategies. Results from air quality simulations have far...

A quality assessment tool for markup-based clinical guidelines.

PubMed

Shalom, Erez; Shahar, Yuval; Taieb-Maimon, Meirav; Lunenfeld, Eitan

2008-11-06

We introduce a tool for quality assessment of procedural and declarative knowledge. We developed this tool for evaluating the specification of mark-up-based clinical GLs. Using this graphical tool, the expert physician and knowledge engineer collaborate to perform scoring, using pre-defined scoring scale, each of the knowledge roles of the mark-ups, comparing it to a gold standard. The tool enables scoring the mark-ups simultaneously at different sites by different users at different locations.

Turning Continuous Quality Improvement into Institutional Practice: The Tools and Techniques.

ERIC Educational Resources Information Center

Cornesky, Robert A.

This manual is intended to assist managers of support units at institutions of higher education in the implementation of Continuous Quality Improvement (CQI). The purpose is to describe a cooperative model for CQI which will permit managers to evaluate the quality of their units and institution, and by using the described tools and techniques, to…

[Evaluation of the Andalusia Public Health System hospital websites in the period 2010-2012].

PubMed

de la Torre Barbero, M J; Estepa Luna, M J; López-Pardo Martínez, M; León Márquez, M; Sánchez Laguna, F; Toledano Redondo, S

2014-01-01

Evaluate the quality, accessibility and presence of Web 2.0 tools in the Andalusia Public Health System hospitals websites Observational, descriptive study carried out between 2010 and 2012. The variables analyzed were: quality, accessibility and innovation. The quality was evaluated using a Bermudez-Tamayo questionnaire. Accessibility was measured using the Web Accessibility Test (TAW) tool. Web 2.0 tools were identified by direct observation. A total of 31 of the 45 hospitals (68.9%) had a website in the year 2010, increasing to 34 (75.5%) in 2012. The average score+standard deviation (SD) of the Bermudez-Tamayo quality questionnaire was 11.1+3.8 points in 2010, and 12.3+3.9 points in 2012, observing a statistically significant difference of 0.25 being observed between the means (P=.007), 95% CI; 0.00 to 0.50) In the accessibility evaluation only 7 websites (n=31) in 2010, and 10 (n=34) in 2012, fulfilled the legal criteria for accessibility. The use of Web 2.0 tools has increased throughout the study. In 2010, 19.4% (n=6) of the hospital websites had this type of tool, in comparison to 58.8% (n=20) in 2012. In general, the quality of the websites studied is good. However, current legislation regarding accessibility is not fulfilled and must be revised and adapted to the current legal rules. There is an incipient use of Web 2.0 resources as education and communication strategies with regard to health. Copyright © 2013 SECA. Published by Elsevier Espana. All rights reserved.

SUSTAIN - A USEPA BMP PROCESS AND PLACEMENT TOOL FOR URBAN WATERSHEDS

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads (...

Development of quality standards in inflammatory bowel disease management and design of an evaluation tool of nursing care.

PubMed

Torrejón, Antonio; Oltra, Lorena; Hernández-Sampelayo, Paloma; Marín, Laura; García-Sánchez, Valle; Casellas, Francesc; Alfaro, Noelia; Lázaro, Pablo; Vera, María Isabel

2013-01-01

nursing management of inflammatory bowel disease (IBD) is highly relevant for patient care and outcomes. However, there is evidence of substantial variability in clinical practices. The objectives of this study were to develop standards of healthcare quality for nursing management of IBD and elaborate the evaluation tool "Nursing Care Quality in IBD Assessment" (NCQ-IBD) based on these standards. a 178-item healthcare quality questionnaire was developed based on a systematic review of IBD nursing management literature. The questionnaire was used to perform two 2-round Delphi studies: Delphi A included 27 IBD healthcare professionals and Delphi B involved 12 patients. The NCQ-IBD was developed from the list of items resulting from both Delphi studies combined with the Scientific Committee´s expert opinion. the final NCQ-IBD consists of 90 items, organized in13 sections measuring the following aspects of nursing management of IBD: infrastructure, services, human resources, type of organization, nursing responsibilities, nurse-provided information to the patient, nurses training, annual audits of nursing activities, and nursing research in IBD. Using the NCQ-IBD to evaluate these components allows the rating of healthcare quality for nursing management of IBD into 4 categories: A (highest quality) through D (lowest quality). the use of the NCQ-IBD tool to evaluate nursing management quality of IBD identifies areas in need of improvement and thus contribute to an enhancement of care quality and reduction in clinical practice variations.

COMPUTERIZED NEEDS-ORIENTED QUALITY MEASUREMENT EVALUATION SYSTEM (CONQUEST)

EPA Science Inventory

CONQUEST is an easy-to-use quality improvement software tool that uses a common structure and language to help users identity, understand, compare, evaluate, and select among 1,200 clinical performance measures that can be used to assess and improve quality of care. CONQUEST's in...

Application of Multimedia Design Principles to Visuals Used in Course-Books: An Evaluation Tool

ERIC Educational Resources Information Center

Kuzu, Abdullah; Akbulut, Yavuz; Sahin, Mehmet Can

2007-01-01

This paper introduces an evaluation tool prepared to examine the quality of visuals in course-books. The tool is based on Mayer's Cognitive Theory of Multimedia Learning (i.e. Generative Theory) and its principles regarding the correct use of illustrations within text. The reason to generate the tool, the development process along with the…

Multisite Evaluation of a Data Quality Tool for Patient-Level Clinical Data Sets

PubMed Central

Huser, Vojtech; DeFalco, Frank J.; Schuemie, Martijn; Ryan, Patrick B.; Shang, Ning; Velez, Mark; Park, Rae Woong; Boyce, Richard D.; Duke, Jon; Khare, Ritu; Utidjian, Levon; Bailey, Charles

2016-01-01

Introduction: Data quality and fitness for analysis are crucial if outputs of analyses of electronic health record data or administrative claims data should be trusted by the public and the research community. Methods: We describe a data quality analysis tool (called Achilles Heel) developed by the Observational Health Data Sciences and Informatics Collaborative (OHDSI) and compare outputs from this tool as it was applied to 24 large healthcare datasets across seven different organizations. Results: We highlight 12 data quality rules that identified issues in at least 10 of the 24 datasets and provide a full set of 71 rules identified in at least one dataset. Achilles Heel is a freely available software that provides a useful starter set of data quality rules with the ability to add additional rules. We also present results of a structured email-based interview of all participating sites that collected qualitative comments about the value of Achilles Heel for data quality evaluation. Discussion: Our analysis represents the first comparison of outputs from a data quality tool that implements a fixed (but extensible) set of data quality rules. Thanks to a common data model, we were able to compare quickly multiple datasets originating from several countries in America, Europe and Asia. PMID:28154833

[eLearning-radiology.com--sustainability for quality assurance].

PubMed

Ketelsen, D; Talanow, R; Uder, M; Grunewald, M

2009-04-01

The aim of the study was to analyze the availability of published radiological e-learning tools and to establish a solution for quality assurance. Substantial pubmed research was performed to identify radiological e-learning tools. 181 e-learning programs were selected. As examples two databases expanding their programs with external links, Compare (n = 435 external links) and TNT-Radiology (n = 1078 external links), were evaluated. A concept for quality assurance was developed by an international taskforce. At the time of assessment, 56.4 % (102 / 181) of the investigated e-learning tools were accessible at their original URL. A subgroup analysis of programs published 5 to 8 years ago showed significantly inferior availability to programs published 3 to 5 years ago (p < 0.01). The analysis of external links showed 49.2 % and 61.0 % accessible links for the programs Compare (published 2003) and TNT-Radiology (published 2006), respectively. As a consequence, the domain www.eLearning-radiology.com was developed by the taskforce and published online. This tool allows authors to present their programs and users to evaluate the e-learning tools depending on several criteria in order to remove inoperable links and to obtain information about the complexity and quality of the e-learning tools. More than 50 % of investigated radiological e-learning tools on the Internet were not accessible after a period of 5 to 8 years. As a consequence, an independent, international tool for quality assurance was designed and published online under www.eLearning-radiology.com .

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

PubMed

Raupach, Tobias; Schiekirka, Sarah; Münscher, Christian; Beißbarth, Tim; Himmel, Wolfgang; Burckhardt, Gerhard; Pukrop, Tobias

2012-01-01

Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical phase of a medical curriculum and address differences between the novel tool and traditional evaluation methods. Student self-assessments before and after completion of a teaching module were used to compute performance gains for specific learning objectives. Mean performance gains in each module were compared to student expectations before the module and data derived from a traditional evaluation tool using overall course ratings at the end of the module. A ranking of the 21 modules according to computed performance gains yielded entirely different results than module rankings based on overall course ratings. There was no significant correlation between performance gain and overall ratings. However, the latter were significantly correlated to student expectations before entering the module as well as structural and procedural parameters (Pearson's r 0.7-0.9). Performance gain computed from comparative self-assessments adds an important new dimension to course evaluation in medical education. In contrast to overall course ratings, the novel tool is less heavily confounded by construct-irrelevant factors. Thus, it appears to be more appropriate than overall course ratings in determining teaching quality and developing algorithms to guide performance-oriented resource allocation in medical education.

Communication Tools for End-of-Life Decision-Making in Ambulatory Care Settings: A Systematic Review and Meta-Analysis.

PubMed

Oczkowski, Simon J; Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J

2016-01-01

Patients with serious illness, and their families, state that better communication and decision-making with healthcare providers is a high priority to improve the quality of end-of-life care. Numerous communication tools to assist patients, family members, and clinicians in end-of-life decision-making have been published, but their effectiveness remains unclear. To determine, amongst adults in ambulatory care settings, the effect of structured communication tools for end-of-life decision-making on completion of advance care planning. We searched for relevant randomized controlled trials (RCTs) or non-randomized intervention studies in MEDLINE, EMBASE, CINAHL, ERIC, and the Cochrane Database of Randomized Controlled Trials from database inception until July 2014. Two reviewers independently screened articles for eligibility, extracted data, and assessed risk of bias. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was used to evaluate the quality of evidence for each of the primary and secondary outcomes. Sixty-seven studies, including 46 RCTs, were found. The majority evaluated communication tools in older patients (age >50) with no specific medical condition, but many specifically evaluated populations with cancer, lung, heart, neurologic, or renal disease. Most studies compared the use of communication tools against usual care, but several compared the tools to less-intensive advance care planning tools. The use of structured communication tools increased: the frequency of advance care planning discussions/discussions about advance directives (RR 2.31, 95% CI 1.25-4.26, p = 0.007, low quality evidence) and the completion of advance directives (ADs) (RR 1.92, 95% CI 1.43-2.59, p<0.001, low quality evidence); concordance between AD preferences and subsequent medical orders for use or non-use of life supporting treatment (RR 1.19, 95% CI 1.01-1.39, p = 0.028, very low quality evidence, 1 observational study); and concordance between the care desired and care received by patients (RR 1.17, 95% CI 1.05-1.30, p = 0.004, low quality evidence, 2 RCTs). The use of structured communication tools may increase the frequency of discussions about and completion of advance directives, and concordance between the care desired and the care received by patients. The use of structured communication tools rather than an ad-hoc approach to end-of-life decision-making should be considered, and the selection and implementation of such tools should be tailored to address local needs and context. PROSPERO CRD42014012913.

Communication Tools for End-of-Life Decision-Making in Ambulatory Care Settings: A Systematic Review and Meta-Analysis

PubMed Central

Chung, Han-Oh; Hanvey, Louise; Mbuagbaw, Lawrence; You, John J.

2016-01-01

Background Patients with serious illness, and their families, state that better communication and decision-making with healthcare providers is a high priority to improve the quality of end-of-life care. Numerous communication tools to assist patients, family members, and clinicians in end-of-life decision-making have been published, but their effectiveness remains unclear. Objectives To determine, amongst adults in ambulatory care settings, the effect of structured communication tools for end-of-life decision-making on completion of advance care planning. Methods We searched for relevant randomized controlled trials (RCTs) or non-randomized intervention studies in MEDLINE, EMBASE, CINAHL, ERIC, and the Cochrane Database of Randomized Controlled Trials from database inception until July 2014. Two reviewers independently screened articles for eligibility, extracted data, and assessed risk of bias. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was used to evaluate the quality of evidence for each of the primary and secondary outcomes. Results Sixty-seven studies, including 46 RCTs, were found. The majority evaluated communication tools in older patients (age >50) with no specific medical condition, but many specifically evaluated populations with cancer, lung, heart, neurologic, or renal disease. Most studies compared the use of communication tools against usual care, but several compared the tools to less-intensive advance care planning tools. The use of structured communication tools increased: the frequency of advance care planning discussions/discussions about advance directives (RR 2.31, 95% CI 1.25–4.26, p = 0.007, low quality evidence) and the completion of advance directives (ADs) (RR 1.92, 95% CI 1.43–2.59, p<0.001, low quality evidence); concordance between AD preferences and subsequent medical orders for use or non-use of life supporting treatment (RR 1.19, 95% CI 1.01–1.39, p = 0.028, very low quality evidence, 1 observational study); and concordance between the care desired and care received by patients (RR 1.17, 95% CI 1.05–1.30, p = 0.004, low quality evidence, 2 RCTs). Conclusions The use of structured communication tools may increase the frequency of discussions about and completion of advance directives, and concordance between the care desired and the care received by patients. The use of structured communication tools rather than an ad-hoc approach to end-of-life decision-making should be considered, and the selection and implementation of such tools should be tailored to address local needs and context. Registration PROSPERO CRD42014012913 PMID:27119571

A Quality Improvement Activity to Promote Interprofessional Collaboration Among Health Professions Students

PubMed Central

Stevenson, Katherine; Busch, Angela; Scott, Darlene J.; Henry, Carol; Wall, Patricia A.

2009-01-01

Objectives To develop and evaluate a classroom-based curriculum designed to promote interprofessional competencies by having undergraduate students from various health professions work together on system-based problems using quality improvement (QI) methods and tools to improve patient-centered care. Design Students from 4 health care programs (nursing, nutrition, pharmacy, and physical therapy) participated in an interprofessional QI activity. In groups of 6 or 7, students completed pre-intervention and post-intervention reflection tools on attitudes relating to interprofessio nal teams, and a tool designed to evaluate group process. Assessment One hundred thirty-four students (76.6%) completed both self-reflection instruments, and 132 (74.2%) completed the post-course group evaluation instrument. Although already high prior to the activity, students' mean post-intervention reflection scores increased for 12 of 16 items. Post-intervention group evaluation scores reflected a high level of satisfaction with the experience. Conclusion Use of a quality-based case study and QI methodology were an effective approach to enhancing interprofessional experiences among students. PMID:19657497

Using Quality Management Tools to Enhance Feedback from Student Evaluations

ERIC Educational Resources Information Center

Jensen, John B.; Artz, Nancy

2005-01-01

Statistical tools found in the service quality assessment literature--the "T"[superscript 2] statistic combined with factor analysis--can enhance the feedback instructors receive from student ratings. "T"[superscript 2] examines variability across multiple sets of ratings to isolate individual respondents with aberrant response…

A quality improvement management model for renal care.

PubMed

Vlchek, D L; Day, L M

1991-04-01

The purpose of this article is to explore the potential for applying the theory and tools of quality improvement (total quality management) in the renal care setting. We believe that the coupling of the statistical techniques used in the Deming method of quality improvement, with modern approaches to outcome and process analysis, will provide the renal care community with powerful tools, not only for improved quality (i.e., reduced morbidity and mortality), but also for technology evaluation and resource allocation.

A Preliminary Investigation of the Utility of the "Behavior Support Plan Quality Evaluation Guide II" for Use in Australia

ERIC Educational Resources Information Center

Webber, Lynne S.; McVilly, Keith R.; Fester, Tarryn; Zazelis, Telly

2011-01-01

Background: The quality of behaviour support plans (BSPs) can be an important influence on the quality of the support provided to people with disability who show challenging behaviours. The Behavior Support Plan Quality Evaluation Guide II (BSP-QE II) is one tool that may be useful in assessing the quality of behaviour support plans. It has…

Renewing focus on family planning service quality globally.

PubMed

Hancock, Nancy L; Stuart, Gretchen S; Tang, Jennifer H; Chibwesha, Carla J; Stringer, Jeffrey S A; Chi, Benjamin H

2016-01-01

Reducing the global unmet need for contraception is currently a priority for many governments, multi-lateral initiatives, non-governmental organizations, and donors. Evidence strongly suggests that the provision of quality family planning services can increase uptake, prevalence, and continuation of contraception. While an accepted framework to define the components of family planning service quality exists, translating this framework into assessment tools that are accessible, easily utilized, and valid for service providers has remained a challenge. We propose new approaches to improve the standardization and accessibility of family planning service quality assessment tools to simplify family planning service quality evaluation. With easier approaches to program evaluation, quality improvements can be performed more swiftly to help increase uptake and continuation of contraception to improve the health of women and their families.

Methods for examining data quality in healthcare integrated data repositories.

PubMed

Huser, Vojtech; Kahn, Michael G; Brown, Jeffrey S; Gouripeddi, Ramkiran

2018-01-01

This paper summarizes content of the workshop focused on data quality. The first speaker (VH) described data quality infrastructure and data quality evaluation methods currently in place within the Observational Data Science and Informatics (OHDSI) consortium. The speaker described in detail a data quality tool called Achilles Heel and latest development for extending this tool. Interim results of an ongoing Data Quality study within the OHDSI consortium were also presented. The second speaker (MK) described lessons learned and new data quality checks developed by the PEDsNet pediatric research network. The last two speakers (JB, RG) described tools developed by the Sentinel Initiative and University of Utah's service oriented framework. The workshop discussed at the end and throughout how data quality assessment can be advanced by combining best features of each network.

[Measurement of customer satisfaction and participation of citizens in improving the quality of healthcare services.].

PubMed

Degrassi, Flori; Sopranzi, Cristina; Leto, Antonella; Amato, Simona; D'Urso, Antonio

2009-01-01

Managing quality in health care whilst ensuring equity is a fundamental aspect of the provision of services by healthcare organizations. Measuring perceived quality of care is an important tool for evaluating the quality of healthcare delivery in that it allows the implementation of corrective actions to meet the healthcare needs of patients. The Rome B (ASL RMB) local health authority adopted the UNI EN 10006:2006 norms as a management tool, therefore introducing the evaluation of customer satisfaction as an opportunity to involve users in the creation of quality healthcare services with and for the citizens. This paper presents the activities implemented and the results achieved with regards to shared and integrated continuous improvement of services.

Efficacy of critical incident monitoring for evaluating disaster medical readiness and response during the Sydney 2000 Olympic Games.

PubMed

Flabouris, Arthas; Nocera, Antony; Garner, Alan

2004-01-01

Multiple casualty incidents (MCI) are infrequent events for medical systems. This renders audit and quality improvement of the medical responses difficult. Quality tools and use of such tools for improvement is necessary to ensure that the design of medical systems facilitates the best possible response to MCI. To describe the utility of incident reporting as a quality monitoring and improvement tool during the deployment of medical teams for mass gatherings and multiple casualty incidents. Voluntary and confidential reporting of incidents was provided by members of the disaster medical response teams during the period of disaster medical team deployment for the 2000 Sydney Olympic Games. Qualitative evaluations were conducted of reported incidents. The main outcome measures included the nature of incident and associated contributing factors, minimization factors, harm potential, and comparison with the post-deployment, cold debriefings. A total of 53 incidents were reported. Management-based decisions, poor or non-existent protocols, and equipment and communication-related issues were the principal contributing factors. Eighty nine percent of the incidents were considered preventable. A potential for harm to patients and/or team members was documented in 58% of reports, of which 76% were likely to cause at least significant harm. Of equipment incidents, personal protective equipment (33%), medical equipment (27%), provision of equipment (22%), and communication equipment (17%) predominated. Personal protective equipment (50%) was reported as the most frequent occupational health and safety incident followed by fatigue (25%). Pre-deployment planning was the most important factor for future incident impact minimization. Incident monitoring was efficacious as a quality tool in identifying incident contributing factors. Incident monitoring allowed for greater systems evaluation. Further evaluation of this quality tool within different disaster settings is required.

Testing, Requirements, and Metrics

NASA Technical Reports Server (NTRS)

Rosenberg, Linda; Hyatt, Larry; Hammer, Theodore F.; Huffman, Lenore; Wilson, William

1998-01-01

The criticality of correct, complete, testable requirements is a fundamental tenet of software engineering. Also critical is complete requirements based testing of the final product. Modern tools for managing requirements allow new metrics to be used in support of both of these critical processes. Using these tools, potential problems with the quality of the requirements and the test plan can be identified early in the life cycle. Some of these quality factors include: ambiguous or incomplete requirements, poorly designed requirements databases, excessive or insufficient test cases, and incomplete linkage of tests to requirements. This paper discusses how metrics can be used to evaluate the quality of the requirements and test to avoid problems later. Requirements management and requirements based testing have always been critical in the implementation of high quality software systems. Recently, automated tools have become available to support requirements management. At NASA's Goddard Space Flight Center (GSFC), automated requirements management tools are being used on several large projects. The use of these tools opens the door to innovative uses of metrics in characterizing test plan quality and assessing overall testing risks. In support of these projects, the Software Assurance Technology Center (SATC) is working to develop and apply a metrics program that utilizes the information now available through the application of requirements management tools. Metrics based on this information provides real-time insight into the testing of requirements and these metrics assist the Project Quality Office in its testing oversight role. This paper discusses three facets of the SATC's efforts to evaluate the quality of the requirements and test plan early in the life cycle, thus preventing costly errors and time delays later.

Web-site evaluation tools: a case study in reproductive health information.

PubMed

Aslani, Azam; Pournik, Omid; Abu-Hanna, Ameen; Eslami, Saeid

2014-01-01

Internet forms an opportunity to inform, teach, and connect professionals and patients. However, much information on Internet is incomplete, inaccurate, or misleading, and not only in the medical domain. Because of the potential for damage from misleading and inaccurate health information, many organizations and individuals have published or implemented scoring tools for evaluating the appropriateness or quality of these resources. The objective of this study is to identify and summarize scoring tools that have evaluated web-sites providing reproductive health information in order to compare them and recommend an overarching evaluation tool. We searched Ovid MEDLINE(R) (1946 to July 2013) and OVID Embase (1980 to July 2013); and included English language studies that have evaluated the quality of websites providing reproductive health information. Studies only assessing the content of websites were excluded. We identified 5 scoring tools: 1-The HON (health on the net) Code of Conduct for medical and health Web sites, 2-Silberg scores, 3-Hogne Sandvik scale, 4-Jim Kapoun's Criteria for Evaluating Web Pages, and 5-The Health Information Technology Institute (HITI) criteria. We have compared these scales and identified 14 criteria: authorship, ownership, currency, objectivity/content, transparency/source, interactivity, privacy/ethics, financial disclosure, navigability/links, complementarity, advertising policy, design, quantity, and accessibility. We integrated these criteria and introduced a new tool with 10 criteria. Website evaluation tools differ in their evaluation criteria and there is a lack of consensus about which to use; therefore, an integrated easy to use set of criteria is needed.

Community-led Air Sensor Evaluation: New Tools for Citizen Scientists Fact Sheet

EPA Pesticide Factsheets

EPA has developed a guide and analysis tool for citizen scientists to evaluate the performance of low-cost sensors and interpret the data they collect to help citizen scientists interested in learning about local air quality.

Software component quality evaluation

NASA Technical Reports Server (NTRS)

Clough, A. J.

1991-01-01

The paper describes a software inspection process that can be used to evaluate the quality of software components. Quality criteria, process application, independent testing of the process and proposed associated tool support are covered. Early results indicate that this technique is well suited for assessing software component quality in a standardized fashion. With automated machine assistance to facilitate both the evaluation and selection of software components, such a technique should promote effective reuse of software components.

A new impetus for guideline development and implementation: construction and evaluation of a toolbox.

PubMed

Hilbink, Mirrian A H W; Ouwens, Marielle M T J; Burgers, Jako S; Kool, Rudolf B

2014-03-19

In the last decade, guideline organizations faced a number of problems, including a lack of standardization in guideline development methods and suboptimal guideline implementation. To contribute to the solution of these problems, we produced a toolbox for guideline development, implementation, revision, and evaluation. All relevant guideline organizations in the Netherlands were approached to prioritize the topics. We sent out a questionnaire and discussed the results at an invitational conference. Based on consensus, twelve topics were selected for the development of new tools. Subsequently, working groups were composed for the development of the tools. After development of the tools, their draft versions were pilot tested in 40 guideline projects. Based on the results of the pilot tests, the tools were refined and their final versions were presented. The vast majority of organizations involved in pilot testing of the tools reported satisfaction with using the tools. Guideline experts involved in pilot testing of the tools proposed a variety of suggestions for the implementation of the tools. The tools are available in Dutch and in English at a web-based platform on guideline development and implementation (http://www.ha-ring.nl). A collaborative approach was used for the development and evaluation of a toolbox for development, implementation, revision, and evaluation of guidelines. This approach yielded a potentially powerful toolbox for improving the quality and implementation of Dutch clinical guidelines. Collaboration between guideline organizations within this project led to stronger linkages, which is useful for enhancing coordination of guideline development and implementation and preventing duplication of efforts. Use of the toolbox could improve quality standards in the Netherlands, and might facilitate the development of high-quality guidelines in other countries as well.

The development of a quality appraisal tool for studies of diagnostic reliability (QAREL).

PubMed

Lucas, Nicholas P; Macaskill, Petra; Irwig, Les; Bogduk, Nikolai

2010-08-01

In systematic reviews of the reliability of diagnostic tests, no quality assessment tool has been used consistently. The aim of this study was to develop a specific quality appraisal tool for studies of diagnostic reliability. Key principles for the quality of studies of diagnostic reliability were identified with reference to epidemiologic principles, existing quality appraisal checklists, and the Standards for Reporting of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) resources. Specific items that encompassed each of the principles were developed. Experts in diagnostic research provided feedback on the items that were to form the appraisal tool. This process was iterative and continued until consensus among experts was reached. The Quality Appraisal of Reliability Studies (QAREL) checklist includes 11 items that explore seven principles. Items cover the spectrum of subjects, spectrum of examiners, examiner blinding, order effects of examination, suitability of the time interval among repeated measurements, appropriate test application and interpretation, and appropriate statistical analysis. QAREL has been developed as a specific quality appraisal tool for studies of diagnostic reliability. The reliability of this tool in different contexts needs to be evaluated. Copyright (c) 2010 Elsevier Inc. All rights reserved.

Tools Used to Evaluate Written Medicine and Health Information: Document and User Perspectives

ERIC Educational Resources Information Center

Luk, Alice; Aslani, Parisa

2011-01-01

This study aims to identify and review tools used to evaluate consumer-oriented written medicine (WMI) and health (WHI) information from a document and user perspective. Articles that met the following inclusion criteria were reviewed: studies evaluating readability, presentation, suitability, quality of WMI/WHI. A total of 152 articles were…

The element of naturalness when evaluating image quality of digital photo documentation after sexual assault.

PubMed

Ernst, E J; Speck, P M; Fitzpatrick, J J

2012-01-01

Digital photography is a valuable adjunct to document physical injuries after sexual assault. In order for a digital photograph to have high image quality, there must exist a high level of naturalness. Digital photo documentation has varying degrees of naturalness; however, for a photograph to be natural, specific technical elements for the viewer must be satisfied. No tool was available to rate the naturalness of digital photo documentation of female genital injuries after sexual assault. The Photo Documentation Image Quality Scoring System (PDIQSS) tool was developed to rate technical elements for naturalness. Using this tool, experts evaluated randomly selected digital photographs of female genital injuries captured following sexual assault. Naturalness of female genital injuries following sexual assault was demonstrated when measured in all dimensions.

Investigating the Effect of Approach Angle and Nose Radius on Surface Quality of Inconel 718

NASA Astrophysics Data System (ADS)

Kumar, Sunil; Singh, Dilbag; Kalsi, Nirmal S.

2017-11-01

This experimental work presents a surface quality evaluation of a Nickel-Cr-Fe based Inconel 718 superalloy, which has many applications in the aero engine and turbine components. However, during machining, the early wear of tool leads to decrease in surface quality. The coating on cutting tool plays a significant role in increasing the wear resistance and life of the tool. In this work, the aim is to study the surface quality of Inconel 718 with TiAlN-coated carbide tools. Influence of various geometrical parameters (tool nose radius, approach angle) and machining variables (cutting velocity, feed rate) on the quality of machined surface (surface roughness) was determined by using central composite design (CCD) matrix. The mathematical model of the same was developed. Analysis of variance was used to find the significance of the parameters. Results showed that the tool nose radius and feed were the main active factors. The present experiment accomplished that TiAlN-coated carbide inserts result in better surface quality as compared with uncoated carbide inserts.

Forage resource evaluation system for habitat—deer: an interactive deer habitat model

Treesearch

Thomas A. Hanley; Donald E. Spalinger; Kenrick J. Mock; Oran L. Weaver; Grant M. Harris

2012-01-01

We describe a food-based system for quantitatively evaluating habitat quality for deer called the Forage Resource Evaluation System for Habitat and provide its rationale and suggestions for use. The system was developed as a tool for wildlife biologists and other natural resource managers and planners interested in evaluating habitat quality and, especially, comparing...

Using Student Evaluations at a Cambodian University to Improve Teaching Effectiveness

ERIC Educational Resources Information Center

Nash, John Lysne

2012-01-01

This is the first study done in Cambodia wherein students used the Student Evaluations of Educational Quality (SEEQ) evaluation tool to evaluate the teaching quality of their instructors. Respondents were instructors and students from the English Language Support Unit at the Royal University of Phnom Penh. This study generated data from mid- and…

Information quality-control model

NASA Technical Reports Server (NTRS)

Vincent, D. A.

1971-01-01

Model serves as graphic tool for estimating complete product objectives from limited input information, and is applied to cost estimations, product-quality evaluations, and effectiveness measurements for manpower resources allocation. Six product quality levels are defined.

Information systems as a quality management tool in clinical laboratories

NASA Astrophysics Data System (ADS)

Schmitz, Vanessa; Rosecler Bez el Boukhari, Marta

2007-11-01

This article describes information systems as a quality management tool in clinical laboratories. The quality of laboratory analyses is of fundamental importance for health professionals in aiding appropriate diagnosis and treatment. Information systems allow the automation of internal quality management processes, using standard sample tests, Levey-Jennings charts and Westgard multirule analysis. This simplifies evaluation and interpretation of quality tests and reduces the possibility of human error. This study proposes the development of an information system with appropriate functions and costs for the automation of internal quality control in small and medium-sized clinical laboratories. To this end, it evaluates the functions and usability of two commercial software products designed for this purpose, identifying the positive features of each, so that these can be taken into account during the development of the proposed system.

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Water flow algorithm decision support tool for travelling salesman problem

NASA Astrophysics Data System (ADS)

Kamarudin, Anis Aklima; Othman, Zulaiha Ali; Sarim, Hafiz Mohd

2016-08-01

This paper discuss about the role of Decision Support Tool in Travelling Salesman Problem (TSP) for helping the researchers who doing research in same area will get the better result from the proposed algorithm. A study has been conducted and Rapid Application Development (RAD) model has been use as a methodology which includes requirement planning, user design, construction and cutover. Water Flow Algorithm (WFA) with initialization technique improvement is used as the proposed algorithm in this study for evaluating effectiveness against TSP cases. For DST evaluation will go through usability testing conducted on system use, quality of information, quality of interface and overall satisfaction. Evaluation is needed for determine whether this tool can assists user in making a decision to solve TSP problems with the proposed algorithm or not. Some statistical result shown the ability of this tool in term of helping researchers to conduct the experiments on the WFA with improvements TSP initialization.

Developing Cyberinfrastructure Tools and Services for Metadata Quality Evaluation

NASA Astrophysics Data System (ADS)

Mecum, B.; Gordon, S.; Habermann, T.; Jones, M. B.; Leinfelder, B.; Powers, L. A.; Slaughter, P.

2016-12-01

Metadata and data quality are at the core of reusable and reproducible science. While great progress has been made over the years, much of the metadata collected only addresses data discovery, covering concepts such as titles and keywords. Improving metadata beyond the discoverability plateau means documenting detailed concepts within the data such as sampling protocols, instrumentation used, and variables measured. Given that metadata commonly do not describe their data at this level, how might we improve the state of things? Giving scientists and data managers easy to use tools to evaluate metadata quality that utilize community-driven recommendations is the key to producing high-quality metadata. To achieve this goal, we created a set of cyberinfrastructure tools and services that integrate with existing metadata and data curation workflows which can be used to improve metadata and data quality across the sciences. These tools work across metadata dialects (e.g., ISO19115, FGDC, EML, etc.) and can be used to assess aspects of quality beyond what is internal to the metadata such as the congruence between the metadata and the data it describes. The system makes use of a user-friendly mechanism for expressing a suite of checks as code in popular data science programming languages such as Python and R. This reduces the burden on scientists and data managers to learn yet another language. We demonstrated these services and tools in three ways. First, we evaluated a large corpus of datasets in the DataONE federation of data repositories against a metadata recommendation modeled after existing recommendations such as the LTER best practices and the Attribute Convention for Dataset Discovery (ACDD). Second, we showed how this service can be used to display metadata and data quality information to data producers during the data submission and metadata creation process, and to data consumers through data catalog search and access tools. Third, we showed how the centrally deployed DataONE quality service can achieve major efficiency gains by allowing member repositories to customize and use recommendations that fit their specific needs without having to create de novo infrastructure at their site.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

[Recommendations for the evaluation and follow-up of the continuous quality improvement].

PubMed

Maurellet-Evrard, S; Daunizeau, A

2013-06-01

Continual improvement of the quality in a medical laboratory is based on the implementation of tools for systematically evaluate the quality management system and its ability to meet the objectives defined. Monitoring through audit and management review, addressing complaints and nonconformities and performing client satisfaction survey are the key for the continual improvement.

How Good Is Our College? First Edition

ERIC Educational Resources Information Center

Education Scotland, 2016

2016-01-01

The new quality framework, "How good is our college?" is a tool to support and enable colleges to evaluate the quality of provision and services alongside reporting on progress in relation to outcome agreements. It is designed to be used by all college staff. Colleges will evaluate the quality of their provision and services using the 12…

Usefulness of the WHOQOL-BREF questionnaire in assessing the quality of life of parents of children with asthma

PubMed Central

Roncada, Cristian; Dias, Caroline Pieta; Goecks, Suelen; Cidade, Simone Elenise Falcão; Pitrez, Paulo Márcio Condessa

2015-01-01

Objective:: To evaluate the quality of life (QOL) of parents of children with asthma and to analyze the internal consistency of the generic QOL tool World Health Organization Quality of Life, abbreviated version (WHOQOL-BREF). Methods:: We evaluated the QOL of parents of asthmatic and healthy children aged between 8 and 16, using the generic WHOQOL-BREF questionnaire. We also evaluated the internal consistency using Cronbach's alpha (αC), in order to determine whether the tool had good validity for the target audience. Results:: The study included 162 individuals with a mean age of 43.8±13.6 years, of which 104 were female (64.2%) and 128 were married (79.0%). When assessing the QOL, the group of parents of healthy children had higher scores than the group of parents of asthmatic children in the four areas evaluated by the questionnaire (Physical, Psychological Health, Social Relationships and Environment), indicating a better quality of life. Regarding the internal consistency of the WHOQOL-BREF, values of ˛C were 0.86 points for the group of parents of asthmatic children, and 0.88 for the group of parents of healthy children. Conclusions:: Parents of children with asthma have impaired quality of life due to their children's disease. Furthermore, the WHOQOL-BREF, even as a generic tool, showed to be practical and efficient to evaluate the quality of life of parents of asthmatic children. © 2015 Sociedade de Pediatria de São Paulo. Published by Elsevier Editora Ltda. All rights reserved. PMID:26137868

Systematic review adherence to methodological or reporting quality.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-07-19

Guidelines for assessing methodological and reporting quality of systematic reviews (SRs) were developed to contribute to implementing evidence-based health care and the reduction of research waste. As SRs assessing a cohort of SRs is becoming more prevalent in the literature and with the increased uptake of SR evidence for decision-making, methodological quality and standard of reporting of SRs is of interest. The objective of this study is to evaluate SR adherence to the Quality of Reporting of Meta-analyses (QUOROM) and PRISMA reporting guidelines and the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Overview Quality Assessment Questionnaire (OQAQ) quality assessment tools as evaluated in methodological overviews. The Cochrane Library, MEDLINE®, and EMBASE® databases were searched from January 1990 to October 2014. Title and abstract screening and full-text screening were conducted independently by two reviewers. Reports assessing the quality or reporting of a cohort of SRs of interventions using PRISMA, QUOROM, OQAQ, or AMSTAR were included. All results are reported as frequencies and percentages of reports and SRs respectively. Of the 20,765 independent records retrieved from electronic searching, 1189 reports were reviewed for eligibility at full text, of which 56 reports (5371 SRs in total) evaluating the PRISMA, QUOROM, AMSTAR, and/or OQAQ tools were included. Notable items include the following: of the SRs using PRISMA, over 85% (1532/1741) provided a rationale for the review and less than 6% (102/1741) provided protocol information. For reports using QUOROM, only 9% (40/449) of SRs provided a trial flow diagram. However, 90% (402/449) described the explicit clinical problem and review rationale in the introduction section. Of reports using AMSTAR, 30% (534/1794) used duplicate study selection and data extraction. Conversely, 80% (1439/1794) of SRs provided study characteristics of included studies. In terms of OQAQ, 37% (499/1367) of the SRs assessed risk of bias (validity) in the included studies, while 80% (1112/1387) reported the criteria for study selection. Although reporting guidelines and quality assessment tools exist, reporting and methodological quality of SRs are inconsistent. Mechanisms to improve adherence to established reporting guidelines and methodological assessment tools are needed to improve the quality of SRs.

On the question of economic efficiency and how to assess it

NASA Astrophysics Data System (ADS)

Petrosyan, M. O.; Kovalev, I. V.; Zelenkov, P. V.; Chuvashova, M. N.; Grishina, I. A.; Pershakova, K. K.

2016-04-01

Over the years, since the world moved to a system of market-based economic relations scientists and businessmen worldwide wonder how to ease and modernize the process of analyzing business performance. During this time, a variety of methods and tools have been developed to deal with this problem. After all, the productivity of the company is directly related to it’s competitive qualities, so the managers are interested in the quality of evaluation of their companies. The article deals with the traditional methods of evaluating the performance of enterprises and some of the tools used in order to improve its quality.

The characteristics, implementation and effects of Aboriginal and Torres Strait Islander health promotion tools: a systematic literature search

PubMed Central

2014-01-01

Background Health promotion by and with Aboriginal and Torres Strait Islander (hereafter Indigenous) Australians is critically important given a wide gap in health parity compared to other Australians. The development and implementation of step-by-step guides, instruments, packages, frameworks or resources has provided a feasible and low-resource strategy for strengthening evidence-informed health promotion practice. Yet there has been little assessment of where and how these tools are implemented or their effectiveness. This paper reviews the characteristics, implementation and effects of Indigenous health promotion tools. Methods Indigenous health promotion tools were identified through a systematic literature search including a prior scoping study, eight databases, references of other reviews and the authors’ knowledge (n = 1494). Documents in the peer reviewed and grey literature were included if they described or evaluated tools designed, recommended or used for strengthening Indigenous Australian health promotion. Eligible publications were entered into an Excel spreadsheet and documented tools classified according to their characteristics, implementation and effects. Quality was appraised using the Dictionary for Effective Public Health Practice Project (EPHPP) and Critical Appraisal Skills Program (CASP) tools for quantitative and qualitative studies respectively. Results The review found that Indigenous health promotion tools were widely available. Of 74 publications that met inclusion criteria, sixty (81%) documented tools developed specifically for the Indigenous Australian population. All tools had been developed in reference to evidence; but only 22/74 (30%) publications specified intended or actual implementation, and only 11/74 (15%) publications evaluated impacts of the implemented tools. Impacts included health, environmental, community, organisational and health care improvements. The quality of impact evaluations was strong for only five (7%) studies. Conclusions The small number and generally moderate quality of implementation and evaluation studies means that little is known about how tools work to strengthen Indigenous health promotion practice. The findings suggest that rather than continuing to invest in tool development, practitioners, policy makers and researchers could evaluate the implementation and effects of existing tools and publish the results. There is a need for long-term investment in research to review the current use of health promotion tools and the factors that are likely to enhance their implementation. PMID:25012401

Organ Donation European Quality System: ODEQUS project methodology.

PubMed

Manyalich, M; Guasch, X; Gomez, M P; Páez, G; Teixeira, L

2013-01-01

Differences in the number of organ donors among hospitals cannot be explained only by the number of intensive care unit beds used or neurologic patients treated. The figures obtained are influenced by the organizational structure of the donation process and how efficient it is. The Organ Donation European Quality System (ODEQUS) is a 3-year project (from October 2010 to September 2013) co-financed by the European Agency for Health and Consumers (EAHC20091108) which aims to define a methodology to evaluate organ procurement performance at the hospital level. ODEQUS's specific objectives are to identify quality criteria and to develop quality indicators in three types of organ donation (after brain death, after cardiac death, and living donation). Those tools will be useful for hospitals' self-assessment as well as for developing an international auditing model. A consortium has been established involving 14 associated partners from Austria, Croatia, France, Germany, Italy, Poland, Portugal, Romania, Spain, Sweden, and the United Kingdom, as well as five collaborating partners from Greece, Hungary, Malta, Slovenia, and Turkey. The project has been established in three steps: 1) Design of a survey about the use of quality tools in a wide sample of European hospitals; 2) Development of quality criteria and quality indicators by the project experts. The main fields considered have been organizational structures, clinical procedures, and outcomes; and 3) Elaboration of an evaluation system to test the quality indicators in 11 European hospitals. Two types of training have been designed and performed: one concerns the development of quality criteria and quality indicators, whereas another is focused on how to use evaluation tools. Following this methodology, the project has so far identified 131 quality criteria and developed 31 quality indicators. Currently, the quality indicators are being tested in 11 selected hospitals. Copyright © 2013 Elsevier Inc. All rights reserved.

QUAST: quality assessment tool for genome assemblies.

PubMed

Gurevich, Alexey; Saveliev, Vladislav; Vyahhi, Nikolay; Tesler, Glenn

2013-04-15

Limitations of genome sequencing techniques have led to dozens of assembly algorithms, none of which is perfect. A number of methods for comparing assemblers have been developed, but none is yet a recognized benchmark. Further, most existing methods for comparing assemblies are only applicable to new assemblies of finished genomes; the problem of evaluating assemblies of previously unsequenced species has not been adequately considered. Here, we present QUAST-a quality assessment tool for evaluating and comparing genome assemblies. This tool improves on leading assembly comparison software with new ideas and quality metrics. QUAST can evaluate assemblies both with a reference genome, as well as without a reference. QUAST produces many reports, summary tables and plots to help scientists in their research and in their publications. In this study, we used QUAST to compare several genome assemblers on three datasets. QUAST tables and plots for all of them are available in the Supplementary Material, and interactive versions of these reports are on the QUAST website. http://bioinf.spbau.ru/quast . Supplementary data are available at Bioinformatics online.

Using an evaluative tool to develop effective mathscasts

NASA Astrophysics Data System (ADS)

Galligan, Linda; Hobohm, Carola; Peake, Katherine

2017-09-01

This study is situated in a course designed for both on-campus and online pre-service and in-service teachers, where student-created mathscasts provide a way for university lecturers to assess students' quality of teaching, and understanding of mathematics. Teachers and pre-service teachers, in a university course with 90% online enrolment, were asked to create mathscasts to explain mathematics concepts at middle school level. This paper describes the process of developing and refining a tool for the creation and evaluation of quality student-produced mathscasts. The study then investigates the usefulness of the tool within the context of pedagogy and mathematical understanding. Despite an abundance of mathscasts already available on the web, there is merit in creating mathscasts, not only as a tool for teaching, but also as a means of learning by doing. The premise for creating student-produced mathscasts was to capture the creators' mathematical understanding and pedagogical approach to teaching a mathematical concept, which were then peer-assessed and graded. The analysis included surveys, practice mathscasts with peer- and self-reviews, and students' final assessed mathscasts. The results indicate that the use of the evaluative tool resulted in an improvement in quality of student-created mathscasts and critiques thereof. The paper concludes with a discussion on future directions of student-produced mathscasts.

One Piece of the Whole: Teacher Evaluation as Part of a Comprehensive System for Teaching and Learning

ERIC Educational Resources Information Center

Darling-Hammond, Linda

2014-01-01

As a major policy focus, teacher evaluation is currently the primary tool promoted to improve teaching quality. But evaluation alone is not enough. What will most transform teaching quality--and the profession--is the creation of a larger system that supports teaching and learning through on-the-job evaluation and professional development, and…

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

The quality of websites addressing fibromyalgia: an assessment of quality and readability using standardised tools

PubMed Central

MacDermid, Joy C; Wilkins, Seanne; Gibson, Jane; Shaw, Lynn

2011-01-01

Background Patients living with fibromyalgia strongly prefer to access health information on the web. However, the majority of subjects in previous studies strongly expressed their concerns about the quality of online information resources. Objectives The purpose of this study was to evaluate existing online fibromyalgia information resources for content, quality and readability by using standardised quality and readability tools. Methods The first 25 websites were identified using Google and the search keyword ‘fibromyalgia’. Pairs of raters independently evaluated website quality using two structured tools (DISCERN and a quality checklist). Readability was assessed using the Flesch Reading Ease score maps. Results Ranking of the websites' quality varied by the tool used, although there was general agreement about the top three websites (Fibromyalgia Information, Fibromyalgia Information Foundation and National Institute of Arthritis and Musculoskeletal and Skin Diseases). Content analysis indicated that 72% of websites provided information on treatment options, 68% on symptoms, 60% on diagnosis and 40% on coping and resources. DISCERN ratings classified 32% websites as ‘very good’, 32% as ‘good and 36% as ‘marginal’. The mean overall DISCERN score was 36.88 (good). Only 16% of websites met the recommended literacy level grade of 6–8 (range 7–15). Conclusion Higher quality websites tended to be less readable. Online fibromyalgia information resources do not provide comprehensive information about fibromyalgia, and have low quality and poor readability. While information is very important for those living with fibromyalgia, current resources are unlikely to provide necessary or accurate information, and may not be usable for most people. PMID:22021777

The quality of websites addressing fibromyalgia: an assessment of quality and readability using standardised tools.

PubMed

Daraz, Lubna; Macdermid, Joy C; Wilkins, Seanne; Gibson, Jane; Shaw, Lynn

2011-07-31

Background Patients living with fibromyalgia strongly prefer to access health information on the web. However, the majority of subjects in previous studies strongly expressed their concerns about the quality of online information resources. Objectives The purpose of this study was to evaluate existing online fibromyalgia information resources for content, quality and readability by using standardised quality and readability tools. Methods The first 25 websites were identified using Google and the search keyword 'fibromyalgia'. Pairs of raters independently evaluated website quality using two structured tools (DISCERN and a quality checklist). Readability was assessed using the Flesch Reading Ease score maps. Results Ranking of the websites' quality varied by the tool used, although there was general agreement about the top three websites (Fibromyalgia Information, Fibromyalgia Information Foundation and National Institute of Arthritis and Musculoskeletal and Skin Diseases). Content analysis indicated that 72% of websites provided information on treatment options, 68% on symptoms, 60% on diagnosis and 40% on coping and resources. DISCERN ratings classified 32% websites as 'very good', 32% as 'good and 36% as 'marginal'. The mean overall DISCERN score was 36.88 (good). Only 16% of websites met the recommended literacy level grade of 6-8 (range 7-15). Conclusion Higher quality websites tended to be less readable. Online fibromyalgia information resources do not provide comprehensive information about fibromyalgia, and have low quality and poor readability. While information is very important for those living with fibromyalgia, current resources are unlikely to provide necessary or accurate information, and may not be usable for most people.

Visual quality assessment of alternative silvicultural practices in upland hardwood management

Treesearch

Tim McDonald; Bryce Stokes

1997-01-01

Visual impacts of forest operations are of increasing concern to forest managers. Tools are available for evaluating, and potentially avoiding, problems in visual quality resulting from poorly designed harvest unit boundaries. One of these visualization tools is applied in comparing various harvest unit shape alternatives in an upland hardwood stand on steeply sloping...

Translating Oral Health-Related Quality of Life Measures: Are There Alternative Methodologies?

ERIC Educational Resources Information Center

Brondani, Mario; He, Sarah

2013-01-01

Translating existing sociodental indicators to another language involves a rigorous methodology, which can be costly. Free-of-charge online translator tools are available, but have not been evaluated in the context of research involving quality of life measures. To explore the value of using online translator tools to develop oral health-related…

Classification of the fragrant styles and evaluation of the aromatic quality of flue-cured tobacco leaves by machine-learning methods.

PubMed

Gu, Li; Xue, Lichun; Song, Qi; Wang, Fengji; He, Huaqin; Zhang, Zhongyi

2016-12-01

During commercial transactions, the quality of flue-cured tobacco leaves must be characterized efficiently, and the evaluation system should be easily transferable across different traders. However, there are over 3000 chemical compounds in flue-cured tobacco leaves; thus, it is impossible to evaluate the quality of flue-cured tobacco leaves using all the chemical compounds. In this paper, we used Support Vector Machine (SVM) algorithm together with 22 chemical compounds selected by ReliefF-Particle Swarm Optimization (R-PSO) to classify the fragrant style of flue-cured tobacco leaves, where the Accuracy (ACC) and Matthews Correlation Coefficient (MCC) were 90.95% and 0.80, respectively. SVM algorithm combined with 19 chemical compounds selected by R-PSO achieved the best assessment performance of the aromatic quality of tobacco leaves, where the PCC and MSE were 0.594 and 0.263, respectively. Finally, we constructed two online tools to classify the fragrant style and evaluate the aromatic quality of flue-cured tobacco leaf samples. These tools can be accessed at http://bioinformatics.fafu.edu.cn/tobacco .

[A French tool for evaluation of home palliative care: adaptation of the Support Team Assessment Schedule].

PubMed

Lagabrielle, D; Guyot, F; Jasso, G; Couturier, P; Poussin, G; Frossard, M; Szabo, P; Franco, A

2001-09-01

The authors describe the utilisation of a quality assessment tool for palliative care administered at home. The questionnaire entitled Support Team Assessment Schedule (STAS) was translated from English for this study. It was then utilised comparatively with different quality of life evaluation instruments. Only the results of the STAS are described here. The approach allows for the unresolved problems in the care to come to the surface week after week. The STAS comprises nine items pertaining to the patient and his/her family, and seven items concerning the services provided. The study exhibits the results of 107 evaluations completed from 50 patients stricken with cancer or AIDS in an advanced phase. The availability of this auto clinical audit tool, employable at home or in a hospital, constitutes an essential initial step in the field of French-speaking clinical evaluation of palliative care.

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Understanding Interrater Reliability and Validity of Risk Assessment Tools Used to Predict Adverse Clinical Events.

PubMed

Siedlecki, Sandra L; Albert, Nancy M

This article will describe how to assess interrater reliability and validity of risk assessment tools, using easy-to-follow formulas, and to provide calculations that demonstrate principles discussed. Clinical nurse specialists should be able to identify risk assessment tools that provide high-quality interrater reliability and the highest validity for predicting true events of importance to clinical settings. Making best practice recommendations for assessment tool use is critical to high-quality patient care and safe practices that impact patient outcomes and nursing resources. Optimal risk assessment tool selection requires knowledge about interrater reliability and tool validity. The clinical nurse specialist will understand the reliability and validity issues associated with risk assessment tools, and be able to evaluate tools using basic calculations. Risk assessment tools are developed to objectively predict quality and safety events and ultimately reduce the risk of event occurrence through preventive interventions. To ensure high-quality tool use, clinical nurse specialists must critically assess tool properties. The better the tool's ability to predict adverse events, the more likely that event risk is mediated. Interrater reliability and validity assessment is relatively an easy skill to master and will result in better decisions when selecting or making recommendations for risk assessment tool use.

Walkyourplace - Evaluating Neighbourhood Accessibility at Street Level

NASA Astrophysics Data System (ADS)

Steiniger, S.; Poorazizi, M. E.; Hunter, A. J. S.

2013-05-01

The popularity of a neighbourhood is often explained by its perceived "higher" quality of life. Good access to shops, restaurants, parks, etc., is seen as an indicator that reflects improved quality of life. We present a web-based tool for assessment of accessibility to such services. The system evaluates in real time an area that is accessible using pedestrian, transit, and cycling infrastructure. The accessible area is evaluated using "quality of life" indicators, such as the number of grocery stores, shopping and recreation facilities, and local crime within that area. This tool sets itself apart from pre-computed and neighbourhood-level walkability indices, because it makes use of detailed street-level data, rather than block-level generalizations. It uses real network travel time, and, when transit data are provided, permits the creation and evaluation of accessibility areas for a combination of travel modes such as walking with transit use.

Process Evaluation of a Quality Improvement Project to Decrease Hospital Readmissions From Skilled Nursing Facilities.

PubMed

Meehan, Thomas P; Qazi, Daniel J; Van Hoof, Thomas J; Ho, Shih-Yieh; Eckenrode, Sheila; Spenard, Ann; Pandolfi, Michelle; Johnson, Florence; Quetti, Deborah

2015-08-01

To describe and evaluate the impact of quality improvement (QI) support provided to skilled nursing facilities (SNFs) by a Quality Improvement Organization (QIO). Retrospective, mixed-method, process evaluation of a QI project intended to decrease preventable hospital readmissions from SNFs. Five SNFs in Connecticut. SNF Administrators, Directors of Nursing, Assistant Directors of Nursing, Admissions Coordinators, Registered Nurses, Certified Nursing Assistants, Receptionists, QIO Quality Improvement Consultant. QIO staff provided training and technical assistance to SNF administrative and clinical staff to establish or enhance QI infrastructure and implement an established set of QI tools [Interventions to Reduce Acute Care Transfers (INTERACT) tools]. Baseline SNF demographic, staffing, and hospital readmission data; baseline and follow-up SNF QI structure (QI Committee), processes (general and use of INTERACT tools), and outcome (30-day all-cause hospital readmission rates); details of QIO-provided training and technical assistance; QIO-perceived barriers to quality improvement; SNF leadership-perceived barriers, accomplishments, and suggestions for improvement of QIO support. Success occurred in establishing QI Committees and targeting preventable hospital readmissions, as well as implementing INTERACT tools in all SNFs; however, hospital readmission rates decreased in only 2 facilities. QIO staff and SNF leaders noted the ongoing challenge of engaging already busy SNF staff and leadership in QI activities. SNF leaders reported that they appreciated the training and technical assistance that their institutions received, although most noted that additional support was needed to bring about improvement in readmission rates. This process evaluation documented mixed clinical results but successfully identified opportunities to improve recruitment of and provision of technical support to participating SNFs. Recommendations are offered for others who wish to conduct similar projects. Copyright © 2015 AMDA – The Society for Post-Acute and Long-Term Care Medicine. All rights reserved.

Use of dietary assessment tools in randomized trials evaluating diet-based interventions in pregnancy: a systematic review of literature.

PubMed

Al Wattar, Bassel H; Mylrea-Lowndes, Bronacha; Morgan, Catrin; Moore, Amanda P; Thangaratinam, Shakila

2016-12-01

Accurate assessment of dietary intake in interventional trials is the key to evaluate changes in dietary behaviour and compliance. We evaluated the use of dietary assessment tools in randomized trials on diet-based interventions in pregnancy by a systematic review. We updated our previous search (until January 2012) on trials of diet and lifestyle interventions in pregnancy using Medline and EMBASE up to December 2015. Two independent reviewers undertook study selection and data extraction. We assessed the characteristics of dietary assessment tools, the timing and frequency of use and any validation undertaken.Two-thirds (39/58, 67%) of the included studies used some form of tools to assess dietary intake. Multiple days' food diaries were the most commonly used (23/39, 59%). Three studies (3/39, 8%) validated the used tools in a pregnant population. Three studies (3/39, 8%) prespecified the criteria for adherence to the intervention. The use of dietary assessment tools was not associated with study quality, year of publication, journal impact factor, type of journal and the study sample size. Although self-reporting dietary assessment tools are widely used in interventional dietary trials in pregnancy, the quality and applicability of existing tools are low.

Practical implementation science: developing and piloting the quality implementation tool.

PubMed

Meyers, Duncan C; Katz, Jason; Chien, Victoria; Wandersman, Abraham; Scaccia, Jonathan P; Wright, Annie

2012-12-01

According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.

A quality-refinement process for medical imaging applications.

PubMed

Neuhaus, J; Maleike, D; Nolden, M; Kenngott, H-G; Meinzer, H-P; Wolf, I

2009-01-01

To introduce and evaluate a process for refinement of software quality that is suitable to research groups. In order to avoid constraining researchers too much, the quality improvement process has to be designed carefully. The scope of this paper is to present and evaluate a process to advance quality aspects of existing research prototypes in order to make them ready for initial clinical studies. The proposed process is tailored for research environments and therefore more lightweight than traditional quality management processes. Focus on quality criteria that are important at the given stage of the software life cycle. Usage of tools that automate aspects of the process is emphasized. To evaluate the additional effort that comes along with the process, it was exemplarily applied for eight prototypical software modules for medical image processing. The introduced process has been applied to improve the quality of all prototypes so that they could be successfully used in clinical studies. The quality refinement yielded an average of 13 person days of additional effort per project. Overall, 107 bugs were found and resolved by applying the process. Careful selection of quality criteria and the usage of automated process tools lead to a lightweight quality refinement process suitable for scientific research groups that can be applied to ensure a successful transfer of technical software prototypes into clinical research workflows.

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

ERIC Educational Resources Information Center

Wind, Stefanie A.; Engelhard, George, Jr.

2016-01-01

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement…

Miniature spinning: an improved cotton research tools

USDA-ARS?s Scientific Manuscript database

Cotton is a natural fiber and is highly variable. Researchers need to evaluate cotton fiber properties to aid in the development of improved varieties and to ensure that changes in agronomic practices do not harm fiber quality or processing propensity. There is a need for fiber quality evaluation be...

Examining the quality of IEPs for young children with autism.

PubMed

Ruble, Lisa A; McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2010-12-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool's reliability; test the tool on a pilot sample of IEPs of young children; and examine associations between IEP quality and school, teacher, and child characteristics. IEPs for 35 students with autism (Mage = 6.1 years; SD = 1.6) from 35 different classrooms were examined. The IEP tool had adequate interrater reliability (ICC = .70). Results identified no statistically significant association between demographics and IEP quality, and IEPs contained relatively clear descriptions of present levels of performance. Weaknesses of IEPs were described and recommendations provided.

Evaluation of a Digital Library by Means of Quality Function Deployment (QFD) and the Kano Model

ERIC Educational Resources Information Center

Garibay, Cecilia; Gutierrez, Humberto; Figueroa, Arturo

2010-01-01

This paper proposes utilizing a combination of the Quality Function Deployment (QFD)-Kano model as a useful tool to evaluate service quality. The digital library of the University of Guadalajara (Mexico) is presented as a case study. Data to feed the QFD-Kano model was gathered by an online questionnaire that was made available to users on the…

Learnings From the Pilot Implementation of Mobile Medical Milestones Application.

PubMed

Page, Cristen P; Reid, Alfred; Coe, Catherine L; Carlough, Martha; Rosenbaum, Daryl; Beste, Janalynn; Fagan, Blake; Steinbacher, Erika; Jones, Geoffrey; Newton, Warren P

2016-10-01

Implementation of the educational milestones benefits from mobile technology that facilitates ready assessments in the clinical environment. We developed a point-of-care resident evaluation tool, the Mobile Medical Milestones Application (M3App), and piloted it in 8 North Carolina family medicine residency programs. We sought to examine variations we found in the use of the tool across programs and explored the experiences of program directors, faculty, and residents to better understand the perceived benefits and challenges of implementing the new tool. Residents and faculty completed presurveys and postsurveys about the tool and the evaluation process in their program. Program directors were interviewed individually. Interviews and open-ended survey responses were analyzed and coded using the constant comparative method, and responses were tabulated under themes. Common perceptions included increased data collection, enhanced efficiency, and increased perceived quality of the information gathered with the M3App. Residents appreciated the timely, high-quality feedback they received. Faculty reported becoming more comfortable with the tool over time, and a more favorable evaluation of the tool was associated with higher utilization. Program directors reported improvements in faculty knowledge of the milestones and resident satisfaction with feedback. Faculty and residents credited the M3App with improving the quality and efficiency of resident feedback. Residents appreciated the frequency, proximity, and specificity of feedback, and faculty reported the app improved their familiarity with the milestones. Implementation challenges included lack of a physician champion and competing demands on faculty time.

Lot quality assurance sampling to monitor supplemental immunization activity quality: an essential tool for improving performance in polio endemic countries.

PubMed

Brown, Alexandra E; Okayasu, Hiromasa; Nzioki, Michael M; Wadood, Mufti Z; Chabot-Couture, Guillaume; Quddus, Arshad; Walker, George; Sutter, Roland W

2014-11-01

Monitoring the quality of supplementary immunization activities (SIAs) is a key tool for polio eradication. Regular monitoring data, however, are often unreliable, showing high coverage levels in virtually all areas, including those with ongoing virus circulation. To address this challenge, lot quality assurance sampling (LQAS) was introduced in 2009 as an additional tool to monitor SIA quality. Now used in 8 countries, LQAS provides a number of programmatic benefits: identifying areas of weak coverage quality with statistical reliability, differentiating areas of varying coverage with greater precision, and allowing for trend analysis of campaign quality. LQAS also accommodates changes to survey format, interpretation thresholds, evaluations of sample size, and data collection through mobile phones to improve timeliness of reporting and allow for visualization of campaign quality. LQAS becomes increasingly important to address remaining gaps in SIA quality and help focus resources on high-risk areas to prevent the continued transmission of wild poliovirus. © Crown copyright 2014.

Quality of care assessment in geriatric evaluation and management units: construction of a chart review tool for a tracer condition.

PubMed

Kergoat, Marie-Jeanne; Leclerc, Bernard-Simon; Leduc, Nicole; Latour, Judith; Berg, Katherine; Bolduc, Aline

2009-07-29

The number of elderly people requiring hospital care is growing, so, quality and assessment of care for elders are emerging and complex areas of research. Very few validated and reliable instruments exist for the assessment of quality of acute care in this field. This study's objective was to create such a tool for Geriatric Evaluation and Management Units (GEMUs). The methodology involved a reliability and feasibility study of a retrospective chart review on 934 older inpatients admitted in 49 GEMUs during the year 2002-2003 for fall-related trauma as a tracer condition. Pertinent indicators for a chart abstraction tool, the Geriatric Care Tool (GCT), were developed and validated according to five dimensions: access to care, comprehensiveness, continuity of care, patient-centred care and appropriateness. Consensus methods were used to develop the content. Participants were experts representing eight main health care professions involved in GEMUs from 19 different sites. Items associated with high quality of care at each step of the multidisciplinary management of patients admitted due to falls were identified. The GCT was tested for intra- and inter-rater reliability using 30 medical charts reviewed by each of three independent and blinded trained nurses. Kappa and agreement measures between pairs of chart reviewers were computed on an item-by-item basis. Three quarters of 169 items identifying the process of care, from the case history to discharge planning, demonstrated good agreement (kappa greater than 0.40 and agreement over 70%). Indicators for the appropriateness of care showed less reliability. Content validity and reliability results, as well as the feasibility of the process, suggest that the chart abstraction tool can gather standardized and pertinent clinical information for further evaluating quality of care in GEMU using admission due to falls as a tracer condition. However, the GCT should be evaluated in other models of acute geriatric units and new strategies should be developed to improve reliability of peer assessments in characterizing the quality of care for elderly patients with complex conditions.

Single-Subject Evaluation: A Tool for Quality Assurance.

ERIC Educational Resources Information Center

Nuehring, Elane M.; Pascone, Anne B.

1986-01-01

The use of single-subject designs in peer review, in utilization review, and in other quality-assurance audits is encouraged. Presents an overview of the methodologies of single-subject designs and quality assurance, and provides examples of cases in which single-subject techniques furnished relevant quality assurance documentation. (Author/ABB)

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Comparison of tools for assessing the methodological quality of primary and secondary studies in health technology assessment reports in Germany.

PubMed

Dreier, Maren; Borutta, Birgit; Stahmeyer, Jona; Krauth, Christian; Walter, Ulla

2010-06-14

HEALTH CARE POLICY BACKGROUND: Findings from scientific studies form the basis for evidence-based health policy decisions. Quality assessments to evaluate the credibility of study results are an essential part of health technology assessment reports and systematic reviews. Quality assessment tools (QAT) for assessing the study quality examine to what extent study results are systematically distorted by confounding or bias (internal validity). The tools can be divided into checklists, scales and component ratings. What QAT are available to assess the quality of interventional studies or studies in the field of health economics, how do they differ from each other and what conclusions can be drawn from these results for quality assessments? A systematic search of relevant databases from 1988 onwards is done, supplemented by screening of the references, of the HTA reports of the German Agency for Health Technology Assessment (DAHTA) and an internet search. The selection of relevant literature, the data extraction and the quality assessment are carried out by two independent reviewers. The substantive elements of the QAT are extracted using a modified criteria list consisting of items and domains specific to randomized trials, observational studies, diagnostic studies, systematic reviews and health economic studies. Based on the number of covered items and domains, more and less comprehensive QAT are distinguished. In order to exchange experiences regarding problems in the practical application of tools, a workshop is hosted. A total of eight systematic methodological reviews is identified as well as 147 QAT: 15 for systematic reviews, 80 for randomized trials, 30 for observational studies, 17 for diagnostic studies and 22 for health economic studies. The tools vary considerably with regard to the content, the performance and quality of operationalisation. Some tools do not only include the items of internal validity but also the items of quality of reporting and external validity. No tool covers all elements or domains. Design-specific generic tools are presented, which cover most of the content criteria. The evaluation of QAT by using content criteria is difficult, because there is no scientific consensus on the necessary elements of internal validity, and not all of the generally accepted elements are based on empirical evidence. Comparing QAT with regard to contents neglects the operationalisation of the respective parameters, for which the quality and precision are important for transparency, replicability, the correct assessment and interrater reliability. QAT, which mix items on the quality of reporting and internal validity, should be avoided. There are different, design-specific tools available which can be preferred for quality assessment, because of its wider coverage of substantive elements of internal validity. To minimise the subjectivity of the assessment, tools with a detailed and precise operationalisation of the individual elements should be applied. For health economic studies, tools should be developed and complemented with instructions, which define the appropriateness of the criteria. Further research is needed to identify study characteristics that influence the internal validity of studies.

The use of medical quality indices as a performance-enhancement tool for community clinics.

PubMed

Elhayany, A

2001-12-01

One of the most important issues for a country, its population and doctors is the effective use of its health system. The extensive variation in doctors' performance leads to a tremendous waste of resources. To combat this, and at the same time ensure that medical quality plays a role when making decisions on interventions, it is essential to equip doctors and clinic directors with information on the quality of the medical care they are providing. In order to assist clinic directors in maintaining medical quality, Clalit Health Services has developed comparative medical indices enabling doctors to compare their performance to that of their colleagues, as well as to the standard and their performance over time. The development of an index to evaluate the quality of medical treatment offered in clinics provides doctors and the health system with an essential tool to lessen the existing variation among doctors and to enhance and evaluate performance.

Identification of Technological Parameters of Ni-Alloys When Machining by Monolithic Ceramic Milling Tool

NASA Astrophysics Data System (ADS)

Czán, Andrej; Kubala, Ondrej; Danis, Igor; Czánová, Tatiana; Holubják, Jozef; Mikloš, Matej

2017-12-01

The ever-increasing production and the usage of hard-to-machine progressive materials are the main cause of continual finding of new ways and methods of machining. One of these ways is the ceramic milling tool, which combines the pros of conventional ceramic cutting materials and pros of conventional coating steel-based insert. These properties allow to improve cutting conditions and so increase the productivity with preserved quality known from conventional tools usage. In this paper, there is made the identification of properties and possibilities of this tool when machining of hard-to-machine materials such as nickel alloys using in airplanes engines. This article is focused on the analysis and evaluation ordinary technological parameters and surface quality, mainly roughness of surface and quality of machined surface and tool wearing.

The Air Quality Model Evaluation International Initiative ...

EPA Pesticide Factsheets

This presentation provides an overview of the Air Quality Model Evaluation International Initiative (AQMEII). It contains a synopsis of the three phases of AQMEII, including objectives, logistics, and timelines. It also provides a number of examples of analyses conducted through AQMEII with a particular focus on past and future analyses of deposition. The National Exposure Research Laboratory (NERL) Computational Exposure Division (CED) develops and evaluates data, decision-support tools, and models to be applied to media-specific or receptor-specific problem areas. CED uses modeling-based approaches to characterize exposures, evaluate fate and transport, and support environmental diagnostics/forensics with input from multiple data sources. It also develops media- and receptor-specific models, process models, and decision support tools for use both within and outside of EPA.

NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare.

PubMed

Akl, Elie A; Treweek, Shaun; Foy, Robbie; Francis, Jill; Oxman, Andrew D

2007-06-26

The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions.

NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare

PubMed Central

Akl, Elie A; Treweek, Shaun; Foy, Robbie; Francis, Jill; Oxman, Andrew D

2007-01-01

Background The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. Methods We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. Results NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial Conclusion NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions. PMID:17594495

[Methodological quality and reporting quality evaluation of randomized controlled trials published in China Journal of Chinese Materia Medica].

PubMed

Yu, Dan-Dan; Xie, Yan-Ming; Liao, Xing; Zhi, Ying-Jie; Jiang, Jun-Jie; Chen, Wei

2018-02-01

To evaluate the methodological quality and reporting quality of randomized controlled trials(RCTs) published in China Journal of Chinese Materia Medica, we searched CNKI and China Journal of Chinese Materia webpage to collect RCTs since the establishment of the magazine. The Cochrane risk of bias assessment tool was used to evaluate the methodological quality of RCTs. The CONSORT 2010 list was adopted as reporting quality evaluating tool. Finally, 184 RCTs were included and evaluated methodologically, of which 97 RCTs were evaluated with reporting quality. For the methodological evaluating, 62 trials(33.70%) reported the random sequence generation; 9(4.89%) trials reported the allocation concealment; 25(13.59%) trials adopted the method of blinding; 30(16.30%) trials reported the number of patients withdrawing, dropping out and those lost to follow-up;2 trials （1.09%） reported trial registration and none of the trial reported the trial protocol; only 8(4.35%) trials reported the sample size estimation in details. For reporting quality appraising, 3 reporting items of 25 items were evaluated with high-quality,including: abstract, participants qualified criteria, and statistical methods; 4 reporting items with medium-quality, including purpose, intervention, random sequence method, and data collection of sites and locations; 9 items with low-quality reporting items including title, backgrounds, random sequence types, allocation concealment, blindness, recruitment of subjects, baseline data, harms, and funding;the rest of items were of extremely low quality(the compliance rate of reporting item<10%). On the whole, the methodological and reporting quality of RCTs published in the magazine are generally low. Further improvement in both methodological and reporting quality for RCTs of traditional Chinese medicine are warranted. It is recommended that the international standards and procedures for RCT design should be strictly followed to conduct high-quality trials. At the same time, in order to improve the reporting quality of randomized controlled trials, CONSORT standards should be adopted in the preparation of research reports and submissions. Copyright© by the Chinese Pharmaceutical Association.

QUAST: quality assessment tool for genome assemblies

PubMed Central

Gurevich, Alexey; Saveliev, Vladislav; Vyahhi, Nikolay; Tesler, Glenn

2013-01-01

Summary: Limitations of genome sequencing techniques have led to dozens of assembly algorithms, none of which is perfect. A number of methods for comparing assemblers have been developed, but none is yet a recognized benchmark. Further, most existing methods for comparing assemblies are only applicable to new assemblies of finished genomes; the problem of evaluating assemblies of previously unsequenced species has not been adequately considered. Here, we present QUAST—a quality assessment tool for evaluating and comparing genome assemblies. This tool improves on leading assembly comparison software with new ideas and quality metrics. QUAST can evaluate assemblies both with a reference genome, as well as without a reference. QUAST produces many reports, summary tables and plots to help scientists in their research and in their publications. In this study, we used QUAST to compare several genome assemblers on three datasets. QUAST tables and plots for all of them are available in the Supplementary Material, and interactive versions of these reports are on the QUAST website. Availability: http://bioinf.spbau.ru/quast Contact: gurevich@bioinf.spbau.ru Supplementary information: Supplementary data are available at Bioinformatics online. PMID:23422339

Development of a Data Collection Tool for MbHIS-QUAL: Evaluation of the Quality of Morbidity Data in Routine Health Information Systems (RHISs) in Hospitals.

PubMed

Hanmer, Lyn; Nicola, Edward; Bradshaw, Debbie

2017-01-01

The quality of morbidity data in multiple routine inpatient records in a sample of South African hospitals is being assessed in terms of data accuracy and completeness. Extensive modification of available data collection tools was required to make it possible to collect the required data for the study.

Ecological Indication, Bioaccumulation, and Phytoremediation as Tools for Environmental Quality Management

DTIC Science & Technology

2004-12-01

ECOLOGICAL INDICATION, BIOACCUMULATION, AND PHYTOREMEDIATION AS TOOLS FOR ENVIRONMENTAL QUALITY MANAGEMENT ELLY P. H. BEST1, HENRY E. TATEM1...subsequent transport to shoots, and degradation, or prevent contaminants from leaving the site in whatever form, such as leachate , runoff, trophic...transfer ( phytoremediation ). We use risk assessment to evaluate the toxicity and need for cleanup. Cleanup costs are expected to greatly exceed the cost

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Improving Reference Service: The Case for Using a Continuous Quality Improvement Method.

ERIC Educational Resources Information Center

Aluri, Rao

1993-01-01

Discusses the evaluation of library reference service; examines problems with past evaluations, including the lack of long-term planning and a systems perspective; and suggests a method for continuously monitoring and improving reference service using quality improvement tools such as checklists, cause and effect diagrams, Pareto charts, and…

Development and application of air quality models at the US ...

EPA Pesticide Factsheets

Overview of the development and application of air quality models at the U.S. EPA, particularly focused on the development and application of the Community Multiscale Air Quality (CMAQ) model developed within the Computation Exposure Division (CED) of the National Exposure Research Laboratory (NERL). This presentation will provide a simple overview of air quality model development and application geared toward a non-technical student audience. The National Exposure Research Laboratory (NERL) Computational Exposure Division (CED) develops and evaluates data, decision-support tools, and models to be applied to media-specific or receptor-specific problem areas. CED uses modeling-based approaches to characterize exposures, evaluate fate and transport, and support environmental diagnostics/forensics with input from multiple data sources. It also develops media- and receptor-specific models, process models, and decision support tools for use both within and outside of EPA.

A database and tool for boundary conditions for regional air quality modeling: description and evaluation

NASA Astrophysics Data System (ADS)

Henderson, B. H.; Akhtar, F.; Pye, H. O. T.; Napelenok, S. L.; Hutzell, W. T.

2013-09-01

Transported air pollutants receive increasing attention as regulations tighten and global concentrations increase. The need to represent international transport in regional air quality assessments requires improved representation of boundary concentrations. Currently available observations are too sparse vertically to provide boundary information, particularly for ozone precursors, but global simulations can be used to generate spatially and temporally varying Lateral Boundary Conditions (LBC). This study presents a public database of global simulations designed and evaluated for use as LBC for air quality models (AQMs). The database covers the contiguous United States (CONUS) for the years 2000-2010 and contains hourly varying concentrations of ozone, aerosols, and their precursors. The database is complimented by a tool for configuring the global results as inputs to regional scale models (e.g., Community Multiscale Air Quality or Comprehensive Air quality Model with extensions). This study also presents an example application based on the CONUS domain, which is evaluated against satellite retrieved ozone vertical profiles. The results show performance is largely within uncertainty estimates for the Tropospheric Emission Spectrometer (TES) with some exceptions. The major difference shows a high bias in the upper troposphere along the southern boundary in January. This publication documents the global simulation database, the tool for conversion to LBC, and the fidelity of concentrations on the boundaries. This documentation is intended to support applications that require representation of long-range transport of air pollutants.

A new generation of tools for search, recovery and quality evaluation of World Wide Web medical resources.

PubMed

Aguillo, I

2000-01-01

Although the Internet is already a valuable information resource in medicine, there are important challenges to be faced before physicians and general users will have extensive access to this information. As a result of a research effort to compile a health-related Internet directory, new tools and strategies have been developed to solve key problems derived from the explosive growth of medical information on the Net and the great concern over the quality of such critical information. The current Internet search engines lack some important capabilities. We suggest using second generation tools (client-side based) able to deal with large quantities of data and to increase the usability of the records recovered. We tested the capabilities of these programs to solve health-related information problems, recognising six groups according to the kind of topics addressed: Z39.50 clients, downloaders, multisearchers, tracing agents, indexers and mappers. The evaluation of the quality of health information available on the Internet could require a large amount of human effort. A possible solution may be to use quantitative indicators based on the hypertext visibility of the Web sites. The cybermetric measures are valid for quality evaluation if they are derived from indirect peer review by experts with Web pages citing the site. The hypertext links acting as citations need to be extracted from a controlled sample of quality super-sites.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Measuring quality in services for children with an intellectual disability.

PubMed

Koornneef, Erik

2006-01-01

To evaluate the application of one particular quality measurement tool, the SERVQUAL instrument, as a potential mechanism to measure quality in services for children with disabilities Staff and family of children with an intellectual disability in two organisations providing specialist therapy and day completed an adapted SERVQUAL questionnaire. A total of 81 SERVQUAL questionnaires were distributed and 59 questionnaires were returned (response rate of 73 per cent). The SERVQUAL instrument can be considered as a useful diagnostic tool to identify particular strengths and areas for improvement in services for people with disabilities as the instrument lends itself for the monitoring of the effectiveness of quality improvement initiatives over time. The findings also showed relatively high customer expectations and the organisations involved in this research are currently not meeting all of these high expectations as significant quality gaps were found in the areas of reliability and responsiveness. The sample size was relatively small and the measurement of quality using the SERVQUAL instrument remains a challenge, due to the conceptual and empirical difficulties. The SERVQUAL instrument is probably most be attractive to service managers and funding organisations because of its ability to identify gaps in the quality of the service. The tool had been used to measure quality in services for people with disabilities and the research has shown that this tool might be an important additional quality measurement tool for services.

The National Shipbuilding Research Program, Analytical Quality Circles

DTIC Science & Technology

1986-09-01

standard tools for quality control, in English, see “Guide to Quality Control” by Dr. Kaoru Ishikawa , Asian Productivity Organization, Aoyama Dai-ichi...factors affect work evaluation is shown schemati- cally by Characteristic-Factor Diagrams (also called Fishbone or Ishikawa Diagrams), see Figure 2-5

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

Use of ecological momentary assessment to determine which structural factors impact perceived teaching quality of attending rounds.

PubMed

Willett, Lisa; Houston, Thomas K; Heudebert, Gustavo R; Estrada, Carlos

2012-09-01

Providing high-quality teaching to residents during attending rounds is challenging. Reasons include structural factors that affect rounds, which are beyond the attending's teaching style and control. To develop a new evaluation tool to identify the structural components of ward rounds that most affect teaching quality in an internal medicine (IM) residency program. The authors developed a 10-item Ecological Momentary Assessment (EMA) tool and collected daily evaluations for 18 months from IM residents rotating on inpatient services. Residents ranked the quality of teaching on rounds that day, and questions related to their service (general medicine, medical intensive care unit, and subspecialty services), patient census, absenteeism of team members, call status, and number of teaching methods used by the attending. Residents completed 488 evaluation cards over 18 months. This found no association between perceived teaching quality and training level, team absenteeism, and call status. We observed differences by service (P < .001) and patient census (P  =  .009). After adjusting for type of service, census was no longer significant. Use of a larger variety of teaching methods was associated with higher perceived teaching quality, regardless of service or census (P for trend < .001). The EMA tool successfully identified that higher patient census was associated with lower perceived teaching quality, but the results were also influenced by the type of teaching service. We found that, regardless of census or teaching service, attendings can improve their teaching by diversifying the number of methods used in daily rounds.

Instruction Guide and Macro Analysis Tool for Community-led Air Monitoring

EPA Pesticide Factsheets

EPA has developed two tools for evaluating the performance of low-cost sensors and interpreting the data they collect to help citizen scientists, communities, and professionals interested in learning about local air quality.

Surface roughness model based on force sensors for the prediction of the tool wear.

PubMed

de Agustina, Beatriz; Rubio, Eva María; Sebastián, Miguel Ángel

2014-04-04

In this study, a methodology has been developed with the objective of evaluating the surface roughness obtained during turning processes by measuring the signals detected by a force sensor under the same cutting conditions. In this way, the surface quality achieved along the process is correlated to several parameters of the cutting forces (thrust forces, feed forces and cutting forces), so the effect that the tool wear causes on the surface roughness is evaluated. In a first step, the best cutting conditions (cutting parameters and radius of tool) for a certain quality surface requirement were found for pieces of UNS A97075. Next, with this selection a model of surface roughness based on the cutting forces was developed for different states of wear that simulate the behaviour of the tool throughout its life. The validation of this model reveals that it was effective for approximately 70% of the surface roughness values obtained.

Process auditing in long term care facilities.

PubMed

Hewitt, S M; LeSage, J; Roberts, K L; Ellor, J R

1985-01-01

The ECC tool development and audit experiences indicated that there is promise in developing a process audit tool to monitor quality of care in nursing homes; moreover, the tool selected required only one hour per resident. Focusing on the care process and resident needs provided useful information for care providers at the unit level as well as for administrative personnel. Besides incorporating a more interdisciplinary focus, the revised tool needs to define support services most appropriate for nursing homes, includes items related to discharge planning and increases measurement of significant others' involvement in the care process. Future emphasis at the ECC will focus on developing intervention plans to maintain strengths and correct deficiencies identified in the audits. Various strategies to bring about desired changes in the quality of care will be evaluated through regular, periodic monitoring. Having a valid and reliable measure of quality of care as a tool will be an important step forward for LTC facilities.

An Automated Treatment Plan Quality Control Tool for Intensity-Modulated Radiation Therapy Using a Voxel-Weighting Factor-Based Re-Optimization Algorithm.

PubMed

Song, Ting; Li, Nan; Zarepisheh, Masoud; Li, Yongbao; Gautier, Quentin; Zhou, Linghong; Mell, Loren; Jiang, Steve; Cerviño, Laura

2016-01-01

Intensity-modulated radiation therapy (IMRT) currently plays an important role in radiotherapy, but its treatment plan quality can vary significantly among institutions and planners. Treatment plan quality control (QC) is a necessary component for individual clinics to ensure that patients receive treatments with high therapeutic gain ratios. The voxel-weighting factor-based plan re-optimization mechanism has been proved able to explore a larger Pareto surface (solution domain) and therefore increase the possibility of finding an optimal treatment plan. In this study, we incorporated additional modules into an in-house developed voxel weighting factor-based re-optimization algorithm, which was enhanced as a highly automated and accurate IMRT plan QC tool (TPS-QC tool). After importing an under-assessment plan, the TPS-QC tool was able to generate a QC report within 2 minutes. This QC report contains the plan quality determination as well as information supporting the determination. Finally, the IMRT plan quality can be controlled by approving quality-passed plans and replacing quality-failed plans using the TPS-QC tool. The feasibility and accuracy of the proposed TPS-QC tool were evaluated using 25 clinically approved cervical cancer patient IMRT plans and 5 manually created poor-quality IMRT plans. The results showed high consistency between the QC report quality determinations and the actual plan quality. In the 25 clinically approved cases that the TPS-QC tool identified as passed, a greater difference could be observed for dosimetric endpoints for organs at risk (OAR) than for planning target volume (PTV), implying that better dose sparing could be achieved in OAR than in PTV. In addition, the dose-volume histogram (DVH) curves of the TPS-QC tool re-optimized plans satisfied the dosimetric criteria more frequently than did the under-assessment plans. In addition, the criteria for unsatisfied dosimetric endpoints in the 5 poor-quality plans could typically be satisfied when the TPS-QC tool generated re-optimized plans without sacrificing other dosimetric endpoints. In addition to its feasibility and accuracy, the proposed TPS-QC tool is also user-friendly and easy to operate, both of which are necessary characteristics for clinical use.

Quality evaluation of JAMA Patient Pages on diabetes using the Ensuring Quality Information for Patient (EQIP) tool.

PubMed

Vaona, Alberto; Marcon, Alessandro; Rava, Marta; Buzzetti, Roberto; Sartori, Marco; Abbinante, Crescenza; Moser, Andrea; Seddaiu, Antonia; Prontera, Manuela; Quaglio, Alessandro; Pallazzoni, Piera; Sartori, Valentina; Rigon, Giulio

2011-12-01

Many medical journals provide patient information leaflets on the correct use of medicines and/or appropriate lifestyles. Only a few studies have assessed the quality of this patient-specific literature. The purpose of this study was to evaluate the quality of JAMA Patient Pages on diabetes using the Ensuring Quality Information for Patient (EQIP) tool. A multidisciplinary group of 10 medical doctors analyzed all diabetes-related Patient Pages published by JAMA from 1998 to 2010 using the EQIP tool. Inter-rater reliability was assessed using the percentage of observed total agreement (p(o)). A quality score between 0 and 1 (the higher score indicating higher quality) was calculated for each item on every page as a function of raters' answers to the EQIP checklist. A mean score per item and a mean score per page were then calculated. We found 8 Patient Pages on diabetes on the JAMA web site. The overall quality score of the documents ranged between 0.55 (Managing Diabetes and Diabetes) and 0.67 (weight and diabetes). p(o) was at least moderate (>50%) for 15 of the 20 EQIP items. Despite generally favorable quality scores, some items received low scores. The worst scores were for the item assessing provision of an empty space to customize information for individual patients (score=0.01, p(o)=95%) and patients involvement in document drafting (score=0.11, p(o)=79%). The Patient Pages on diabetes published by JAMA were found to present weak points that limit their overall quality and may jeopardize their efficacy. We therefore recommend that authors and publishers of written patient information comply with published quality criteria. Further research is needed to evaluate the quality and efficacy of existing written health care information. Copyright © 2011 Primary Care Diabetes Europe. Published by Elsevier Ltd. All rights reserved.

Critical Appraisal of Microbiology Guidelines Endorsed by two Professional Organisations: Société Française De Microbiologie (SFM) and American Society of Microbiology (ASM).

PubMed

Fonfrède, Michèle; Couaillac, Jean Paul; Augereau, Christine; Lepargneur, Jean Pierre; Watine, Joseph

2012-07-01

Medical practice guidelines (GLs) being tools that are mainly designed to evaluate medical professionals, it sounds logical, and fair, that professionals should in turn evaluate GLs. Microbiology being a medical discipline, we used the AGREE instrument, i.e. an established evaluation tool for GLs, in order to evaluate the quality of two major microbiology guidelines, i.e. the SFM GLs and the ASM GLs). Both guidelines remain sub-optimal in their levels of quality, and obtain scores that are not very different from the average scores obtained by many other guidelines in various medical disciplines. We therefore believe that both guidelines need to be modified before they can be recommended without provisos. A higher degree of multi-disciplinary work, including a more formal implication of methodologists, as well as of infectious disease clinicians, and of economists, might perhaps enable future editions of these guidelines to reach higher levels of quality.

Innovative Stormwater Quality Tools by SARA for Holistic Watershed Master Planning

NASA Astrophysics Data System (ADS)

Thomas, S. M.; Su, Y. C.; Hummel, P. R.

2016-12-01

Stormwater management strategies such as Best Management Practices (BMP) and Low-Impact Development (LID) have increasingly gained attention in urban runoff control, becoming vital to holistic watershed master plans. These strategies can help address existing water quality impairments and support regulatory compliance, as well as guide planning and management of future development when substantial population growth and urbanization is projected to occur. However, past efforts have been limited to qualitative planning due to the lack of suitable tools to conduct quantitative assessment. The San Antonio River Authority (SARA), with the assistance of Lockwood, Andrews & Newnam, Inc. (LAN) and AQUA TERRA Consultants (a division of RESPEC), developed comprehensive hydrodynamic and water quality models using the Hydrological Simulation Program-FORTRAN (HSPF) for several urban watersheds in the San Antonio River Basin. These models enabled watershed management to look at water quality issues on a more refined temporal and spatial scale than the limited monitoring data. They also provided a means to locate and quantify potential water quality impairments and evaluate the effects of mitigation measures. To support the models, a suite of software tools were developed. including: 1) SARA Timeseries Utility Tool for managing and processing of large model timeseries files, 2) SARA Load Reduction Tool to determine load reductions needed to achieve screening levels for each modeled constituent on a sub-basin basis, and 3) SARA Enhanced BMP Tool to determine the optimal combination of BMP types and units needed to achieve the required load reductions. Using these SARA models and tools, water quality agencies and stormwater professionals can determine the optimal combinations of BMP/LID to accomplish their goals and save substantial stormwater infrastructure and management costs. The tools can also help regulators and permittees evaluate the feasibility of achieving compliance using BMP/LID. The project has gained national attention, being showcased in multiple newsletters, professional magazines, and conference presentations. The project also won the Texas American Council of Engineering Companies (ACEC) Gold Medal Award and the ACEC National Recognition Award in 2016.

A database and tool for boundary conditions for regional air quality modeling: description and evaluation

NASA Astrophysics Data System (ADS)

Henderson, B. H.; Akhtar, F.; Pye, H. O. T.; Napelenok, S. L.; Hutzell, W. T.

2014-02-01

Transported air pollutants receive increasing attention as regulations tighten and global concentrations increase. The need to represent international transport in regional air quality assessments requires improved representation of boundary concentrations. Currently available observations are too sparse vertically to provide boundary information, particularly for ozone precursors, but global simulations can be used to generate spatially and temporally varying lateral boundary conditions (LBC). This study presents a public database of global simulations designed and evaluated for use as LBC for air quality models (AQMs). The database covers the contiguous United States (CONUS) for the years 2001-2010 and contains hourly varying concentrations of ozone, aerosols, and their precursors. The database is complemented by a tool for configuring the global results as inputs to regional scale models (e.g., Community Multiscale Air Quality or Comprehensive Air quality Model with extensions). This study also presents an example application based on the CONUS domain, which is evaluated against satellite retrieved ozone and carbon monoxide vertical profiles. The results show performance is largely within uncertainty estimates for ozone from the Ozone Monitoring Instrument and carbon monoxide from the Measurements Of Pollution In The Troposphere (MOPITT), but there were some notable biases compared with Tropospheric Emission Spectrometer (TES) ozone. Compared with TES, our ozone predictions are high-biased in the upper troposphere, particularly in the south during January. This publication documents the global simulation database, the tool for conversion to LBC, and the evaluation of concentrations on the boundaries. This documentation is intended to support applications that require representation of long-range transport of air pollutants.

Eelgrass indicator deployment system (EIDS): A low tech tool for short-term evaluation of eelgrass response to water quality

EPA Science Inventory

Eelgrass is often considered a sentinel species that can be used as an indicator of water clarity and quality. I used the Eelgrass Indicator Deployment System (EIDS) in a series of short term experiments to evaluate eelgrass growth and survival at a decline and a control site in...

OPTIMIZING BMP PLACEMENT AT WATERSHED-SCALE USING SUSTAIN

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate alternative plans for environmental quality restoration and protection needs in urban and developing areas. A watershed-scale decision-support system, based on cost optimization, provides an essential tool to suppo...

U.S. EPA's Watershed Management Research Activities

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate alternative plans for environmental quality restoration and protection needs in urban and developing areas. A watershed-scale decision-support system, based on cost optimization, provides an essential tool to suppo...

Examining the Quality of IEPs for Young Children with Autism

ERIC Educational Resources Information Center

Ruble, Lisa A.; McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2010-01-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool's reliability; test the tool on a pilot sample of IEPs of young children; and examine…

A Standards-Based Grading and Reporting Tool for Faculty: Design and Implications

ERIC Educational Resources Information Center

Sadik, Alaa M.

2011-01-01

The use of standard-based assessment, grading and reporting tools is essential to ensure that assessment meets acceptable levels of quality and standardization. This study reports the design, development and evaluation of a standards-based assessment tool for the instructors at Sultan Qaboos University, Sultanate of Oman. The Rapid Applications…

Collecting Poetry for the Academic Library: An Evaluation of Poetry Prizes as Selection Tools

ERIC Educational Resources Information Center

Golomb, Liorah

2011-01-01

This paper examines the usefulness of poetry book prizes as a selection tool by evaluating their fairness, meaningfulness, and reliability as an indication of quality. The results of two surveys, one collecting data on poetry book prizes and the other asking librarians about their collecting practices, suggest that selecting on the basis of prizes…

Application of uncertainty and sensitivity analysis to the air quality SHERPA modelling tool

NASA Astrophysics Data System (ADS)

Pisoni, E.; Albrecht, D.; Mara, T. A.; Rosati, R.; Tarantola, S.; Thunis, P.

2018-06-01

Air quality has significantly improved in Europe over the past few decades. Nonetheless we still find high concentrations in measurements mainly in specific regions or cities. This dimensional shift, from EU-wide to hot-spot exceedances, calls for a novel approach to regional air quality management (to complement EU-wide existing policies). The SHERPA (Screening for High Emission Reduction Potentials on Air quality) modelling tool was developed in this context. It provides an additional tool to be used in support to regional/local decision makers responsible for the design of air quality plans. It is therefore important to evaluate the quality of the SHERPA model, and its behavior in the face of various kinds of uncertainty. Uncertainty and sensitivity analysis techniques can be used for this purpose. They both reveal the links between assumptions and forecasts, help in-model simplification and may highlight unexpected relationships between inputs and outputs. Thus, a policy steered SHERPA module - predicting air quality improvement linked to emission reduction scenarios - was evaluated by means of (1) uncertainty analysis (UA) to quantify uncertainty in the model output, and (2) by sensitivity analysis (SA) to identify the most influential input sources of this uncertainty. The results of this study provide relevant information about the key variables driving the SHERPA output uncertainty, and advise policy-makers and modellers where to place their efforts for an improved decision-making process.

A Review and Analysis of Remote Sensing Capability for Air Quality Measurements as a Potential Decision Support Tool Conducted by the NASA DEVELOP Program

NASA Technical Reports Server (NTRS)

Ross, A.; Richards, A.; Keith, K.; Frew, C.; Boseck, J.; Sutton, S.; Watts, C.; Rickman, D.

2007-01-01

This project focused on a comprehensive utilization of air quality model products as decision support tools (DST) needed for public health applications. A review of past and future air quality measurement methods and their uncertainty, along with the relationship of air quality to national and global public health, is vital. This project described current and future NASA satellite remote sensing and ground sensing capabilities and the potential for using these sensors to enhance the prediction, prevention, and control of public health effects that result from poor air quality. The qualitative uncertainty of current satellite remotely sensed air quality, the ground-based remotely sensed air quality, the air quality/public health model, and the decision making process is evaluated in this study. Current peer-reviewed literature suggests that remotely sensed air quality parameters correlate well with ground-based sensor data. A satellite remote-sensed and ground-sensed data complement is needed to enhance the models/tools used by policy makers for the protection of national and global public health communities

The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials.

PubMed

Yamato, Tie Parma; Maher, Chris; Koes, Bart; Moseley, Anne

2017-06-01

The Physiotherapy Evidence Database (PEDro) scale has been widely used to investigate methodological quality in physiotherapy randomized controlled trials; however, its validity has not been tested for pharmaceutical trials. The aim of this study was to investigate the validity and interrater reliability of the PEDro scale for pharmaceutical trials. The reliability was also examined for the Cochrane Back and Neck (CBN) Group risk of bias tool. This is a secondary analysis of data from a previous study. We considered randomized placebo controlled trials evaluating any pain medication for chronic spinal pain or osteoarthritis. Convergent validity was evaluated by correlating the PEDro score with the summary score of the CBN risk of bias tool. The construct validity was tested using a linear regression analysis to determine the degree to which the total PEDro score is associated with treatment effect sizes, journal impact factor, and the summary score for the CBN risk of bias tool. The interrater reliability was estimated using the Prevalence and Bias Adjusted Kappa coefficient and 95% confidence interval (CI) for the PEDro scale and CBN risk of bias tool. Fifty-three trials were included, with 91 treatment effect sizes included in the analyses. The correlation between PEDro scale and CBN risk of bias tool was 0.83 (95% CI 0.76-0.88) after adjusting for reliability, indicating strong convergence. The PEDro score was inversely associated with effect sizes, significantly associated with the summary score for the CBN risk of bias tool, and not associated with the journal impact factor. The interrater reliability for each item of the PEDro scale and CBN risk of bias tool was at least substantial for most items (>0.60). The intraclass correlation coefficient for the PEDro score was 0.80 (95% CI 0.68-0.88), and for the CBN, risk of bias tool was 0.81 (95% CI 0.69-0.88). There was evidence for the convergent and construct validity for the PEDro scale when used to evaluate methodological quality of pharmacological trials. Both risk of bias tools have acceptably high interrater reliability. Copyright © 2017 Elsevier Inc. All rights reserved.

An agent based simulation tool for scheduling emergency department physicians.

PubMed

Jones, Spencer S; Evans, R Scott

2008-11-06

Emergency department overcrowding is a problem that threatens the public health of communities and compromises the quality of care given to individual patients. The Institute of Medicine recommends that hospitals employ information technology and operations research methods to reduce overcrowding. This paper describes the development of an agent based simulation tool that has been designed to evaluate the impact of various physician staffing configurations on patient waiting times in the emergency department. We evaluate the feasibility of this tool at a single hospital emergency department.

GREENROOF RUNOFF WATER QUALITY

EPA Science Inventory

This project evaluated green roofs as a stormwater management tool. Specifically, runoff quantity and quality from green and flat asphalt roofs was compared. Evapotranspiration from planted green roofs and evaporation unplanted media roofs was also compared, and the influence of ...

Quality Indicators for Learning Analytics

ERIC Educational Resources Information Center

Scheffel, Maren; Drachsler, Hendrik; Stoyanov, Slavi; Specht, Marcus

2014-01-01

This article proposes a framework of quality indicators for learning analytics that aims to standardise the evaluation of learning analytics tools and to provide a mean to capture evidence for the impact of learning analytics on educational practices in a standardised manner. The criteria of the framework and its quality indicators are based on…

Quality Parameterization of Educational Resources from the Perspective of a Teacher

ERIC Educational Resources Information Center

Karolcík, Štefan; Cipková, Elena; Veselský, Milan; Hrubišková, Helena; Matulcíková, Mária

2017-01-01

Objective assessment of the quality of available educational resources presupposes the existence of specific quality standards and specific evaluation tools which consider the specificities of digital products with educational ambitions. The study presents the results of research conducted on a representative sample of teachers who commented on…

Nutrition screening tools: an analysis of the evidence.

PubMed

Skipper, Annalynn; Ferguson, Maree; Thompson, Kyle; Castellanos, Victoria H; Porcari, Judy

2012-05-01

In response to questions about tools for nutrition screening, an evidence analysis project was developed to identify the most valid and reliable nutrition screening tools for use in acute care and hospital-based ambulatory care settings. An oversight group defined nutrition screening and literature search criteria. A trained analyst conducted structured searches of the literature for studies of nutrition screening tools according to predetermined criteria. Eleven nutrition screening tools designed to detect undernutrition in patients in acute care and hospital-based ambulatory care were identified. Trained analysts evaluated articles for quality using criteria specified by the American Dietetic Association's Evidence Analysis Library. Members of the oversight group assigned quality grades to the tools based on the quality of the supporting evidence, including reliability and validity data. One tool, the NRS-2002, received a grade I, and 4 tools-the Simple Two-Part Tool, the Mini-Nutritional Assessment-Short Form (MNA-SF), the Malnutrition Screening Tool (MST), and Malnutrition Universal Screening Tool (MUST)-received a grade II. The MST was the only tool shown to be both valid and reliable for identifying undernutrition in the settings studied. Thus, validated nutrition screening tools that are simple and easy to use are available for application in acute care and hospital-based ambulatory care settings.

Evaluation in undergraduate medical education: Conceptualizing and validating a novel questionnaire for assessing the quality of bedside teaching.

PubMed

Dreiling, Katharina; Montano, Diego; Poinstingl, Herbert; Müller, Tjark; Schiekirka-Schwake, Sarah; Anders, Sven; von Steinbüchel, Nicole; Raupach, Tobias

2017-08-01

Evaluation is an integral part of curriculum development in medical education. Given the peculiarities of bedside teaching, specific evaluation tools for this instructional format are needed. Development of these tools should be informed by appropriate frameworks. The purpose of this study was to develop a specific evaluation tool for bedside teaching based on the Stanford Faculty Development Program's clinical teaching framework. Based on a literature review yielding 47 evaluation items, an 18-item questionnaire was compiled and subsequently completed by undergraduate medical students at two German universities. Reliability and validity were assessed in an exploratory full information item factor analysis (study one) and a confirmatory factor analysis as well as a measurement invariance analysis (study two). The exploratory analysis involving 824 students revealed a three-factor structure. Reliability estimates of the subscales were satisfactory (α = 0.71-0.84). The model yielded satisfactory fit indices in the confirmatory factor analysis involving 1043 students. The new questionnaire is short and yet based on a widely-used framework for clinical teaching. The analyses presented here indicate good reliability and validity of the instrument. Future research needs to investigate whether feedback generated from this tool helps to improve teaching quality and student learning outcome.

Impact of the World Health Organization's Decision-Making Tool for Family Planning Clients and Providers on the quality of family planning services in Iran.

PubMed

Farrokh-Eslamlou, Hamidreza; Aghlmand, Siamak; Eslami, Mohammad; Homer, Caroline S E

2014-04-01

We investigated whether use of the World Health Organization's (WHO's) Decision-Making Tool (DMT) for Family Planning Clients and Providers would improve the process and outcome quality indicators of family planning (FP) services in Iran. The DMT was adapted for the Iranian setting. The study evaluated 24 FP quality key indicators grouped into two main areas, namely process and outcome. The tool was implemented in 52 urban and rural public health facilities in four selected and representative provinces of Iran. A pre-post methodology was undertaken to examine whether use of the tool improved the quality of FP services and client satisfaction with the services. Quantitative data were collected through observations of counselling and exit interviews with clients using structured questionnaires. Different numbers of FP clients were recruited during the baseline and the post-intervention rounds (n=448 vs 547, respectively). The DMT improved many client-provider interaction indicators, including verbal and non-verbal communication (p<0.05). The tool also impacted positively on the client's choice of contraceptive method, providers' technical competence, and quality of information provided to clients (p<0.05). Use of the tool improved the clients' satisfaction with FP services (from 72% to 99%; p<0.05). The adapted WHO's DMT has the potential to improve the quality of FP services.

High-volume image quality assessment systems: tuning performance with an interactive data visualization tool

NASA Astrophysics Data System (ADS)

Bresnahan, Patricia A.; Pukinskis, Madeleine; Wiggins, Michael

1999-03-01

Image quality assessment systems differ greatly with respect to the number and types of mags they need to evaluate, and their overall architectures. Managers of these systems, however, all need to be able to tune and evaluate system performance, requirements often overlooked or under-designed during project planning. Performance tuning tools allow users to define acceptable quality standards for image features and attributes by adjusting parameter settings. Performance analysis tools allow users to evaluate and/or predict how well a system performs in a given parameter state. While image assessment algorithms are becoming quite sophisticated, duplicating or surpassing the human decision making process in their speed and reliability, they often require a greater investment in 'training' or fine tuning of parameters in order to achieve optimum performance. This process may involve the analysis of hundreds or thousands of images, generating a large database of files and statistics that can be difficult to sort through and interpret. Compounding the difficulty is the fact that personnel charged with tuning and maintaining the production system may not have the statistical or analytical background required for the task. Meanwhile, hardware innovations have greatly increased the volume of images that can be handled in a given time frame, magnifying the consequences of running a production site with an inadequately tuned system. In this paper, some general requirements for a performance evaluation and tuning data visualization system are discussed. A custom engineered solution to the tuning and evaluation problem is then presented, developed within the context of a high volume image quality assessment, data entry, OCR, and image archival system. A key factor influencing the design of the system was the context-dependent definition of image quality, as perceived by a human interpreter. This led to the development of a five-level, hierarchical approach to image quality evaluation. Lower-level pass-fail conditions and decision rules were coded into the system. Higher-level image quality states were defined by allowing the users to interactively adjust the system's sensitivity to various image attributes by manipulating graphical controls. Results were presented in easily interpreted bar graphs. These graphs were mouse- sensitive, allowing the user to more fully explore the subsets of data indicated by various color blocks. In order to simplify the performance evaluation and tuning process, users could choose to view the results of (1) the existing system parameter state, (2) the results of any arbitrary parameter values they chose, or (3) the results of a quasi-optimum parameter state, derived by applying a decision rule to a large set of possible parameter states. Giving managers easy- to-use tools for defining the more subjective aspects of quality resulted in a system that responded to contextual cues that are difficult to hard-code. It had the additional advantage of allowing the definition of quality to evolve over time, as users became more knowledgeable as to the strengths and limitations of an automated quality inspection system.

Development of a self-assessment tool for measuring competences of obstetric nurses in rooming-in wards in China

PubMed Central

Zhang, Ju; Ye, Wenqin; Fan, Fan

2015-01-01

Introduction: To provide high-quality nursing care, a reliable and feasible competency assessment tool is critical. Although several questionnaire-based competency assessment tools have been reported, a tool specific for obstetric nurses in rooming-in wards is lacking. Therefore, the purpose of this research is to develop a competency assessment tool for obstetric rooming-in ward nurses. Methods: A literature review was conducted to create an individual intensive interview with 14 nurse managers, educators, and primary nurses in rooming-in wards. Expert reviews (n = 15) were conducted to identify emergent themes in a Delphi fashion. A competency assessment questionnaire was then developed and tested with 246 rooming-in ward nurses in local hospitals. Results: We constructed a three-factor linear model for obstetric rooming-in nurse competency assessment. Further refinement resulted in a self-assessment questionnaire containing three first-tier, 12 second-tier, and 43 third-tier items for easy implementation. The questionnaire was reliable, contained satisfactory content, and had construct validity. Discussion: Our competency assessment tool provides a systematic, easy, and operational subjective evaluation model for nursing managers and administrators to evaluate obstetric rooming-in ward primary nurses. The application of this tool will facilitate various human resources functions, such as nurse training/education effect evaluation, and will eventually promote high-quality nursing care delivery. PMID:26770468

Evaluation of the Iconic Pain Assessment Tool by a heterogeneous group of people in pain

PubMed Central

Lalloo, Chitra; Henry, James L

2011-01-01

The Iconic Pain Assessment Tool (IPAT) is a novel web-based instrument for the self-report of pain quality, intensity and location in the form of a permanent diary. Originally designed for people with central poststroke pain, the tool is being adapted for a larger, more diverse patient population. The present study aimed to collect evaluative feedback on the IPAT from a heterogeneous sample of individuals with chronic pain. The specific study aims were to evaluate participant comfort with the tool including enjoyment, ease of use and comfort with the electronic medium; to assess perceived value of the tool for communicating pain quality, intensity and location; to gauge participant intent to share their pain diaries with others and use the tool on a regular basis to track their pain over time; to assess the perceived descriptiveness of current IPAT icons and the numerical rating scale; and to identify strengths and weaknesses of the tool to refine the existing prototype. Written and verbal feedback from individuals with a variety of chronic pain conditions (n=23) were collected in the context of these objectives. Overall, the IPAT was positively endorsed by this heterogeneous sample of people in pain. The authors concluded that the IPAT is a user-friendly instrument that has the potential to help people express, document and share their personal experience with chronic pain. PMID:21369536

[Confusing the confused: thoughts on impact factor, h(irsch) index, Q value, and other cofactors that influence the researcher's happiness].

PubMed

Quindós, Guillermo

2009-06-30

The need to evaluate curricula for sponsorship for research projects or professional promotion, has led to the search for tools that allow an objective valuation. However, the total number papers published, or citations of articles of a particular author, or the impact factor of the Journal where they are published are inadequate indicators for the evaluation of the quality and productivity of researchers. The h index, proposed by Hirsch, categorises the papers according to the number of citations per article. This tool appears to lack the limitations of other bibliometric tools but is less useful for non English-speaking authors. To propose and debate the usefulness of the existing bibliometric indicators and tools for the evaluation and categorization of researchers and scientific journals. Search for papers on bibliometric tools. There are some hot spots in the debate on the national and international evaluation of researchers' productivity and quality of scientific journals. Opinions on impact factors and h index have been discussed. The positive discrimination, using the Q value, is proposed as an alternative for the evaluation of Spanish and Iberoamerican researchers. It is very important de-mystify the importance of bibliometric indicators. The impact factor is useful for evaluating journals from the same scientific area but not for the evaluation of researchers' curricula. For the comparison of curricula from two or more researchers, we must use the h index or the proposed Q value. the latter allows positive discrimination of the task for Spanish and Iberoamerican researchers.

A new tool to evaluate postgraduate training posts: the Job Evaluation Survey Tool (JEST).

PubMed

Wall, David; Goodyear, Helen; Singh, Baldev; Whitehouse, Andrew; Hughes, Elizabeth; Howes, Jonathan

2014-10-02

Three reports in 2013 about healthcare and patient safety in the UK, namely Berwick, Francis and Keogh have highlighted the need for junior doctors' views about their training experience to be heard. In the UK, the General Medical Council (GMC) quality assures medical training programmes and requires postgraduate deaneries to undertake quality management and monitoring of all training posts in their area. The aim of this study was to develop a simple trainee questionnaire for evaluation of postgraduate training posts based on the GMC, UK standards and to look at the reliability and validity including comparison with a well-established and internationally validated tool, the Postgraduate Hospital Educational Environment Measure (PHEEM). The Job Evaluation Survey Tool (JEST), a fifteen item job evaluation questionnaire was drawn up in 2006, piloted with Foundation doctors (2007), field tested with specialist paediatric registrars (2008) and used over a three year period (2008-11) by Foundation Doctors. Statistical analyses including descriptives, reliability, correlation and factor analysis were undertaken and JEST compared with PHEEM. The JEST had a reliability of 0.91 in the pilot study of 76 Foundation doctors, 0.88 in field testing of 173 Paediatric specialist registrars and 0.91 in three years of general use in foundation training with 3367 doctors completing JEST. Correlation of JEST with PHEEM was 0.80 (p < 0.001). Factor analysis showed two factors, a teaching factor and a social and lifestyle one. The JEST has proved to be a simple, valid and reliable evaluation tool in the monitoring and evaluation of postgraduate hospital training posts.

Quality tools and resources to support organisational improvement integral to high-quality primary care: a systematic review of published and grey literature.

PubMed

Janamian, Tina; Upham, Susan J; Crossland, Lisa; Jackson, Claire L

2016-04-18

To conduct a systematic review of the literature to identify existing online primary care quality improvement tools and resources to support organisational improvement related to the seven elements in the Primary Care Practice Improvement Tool (PC-PIT), with the identified tools and resources to progress to a Delphi study for further assessment of relevance and utility. Systematic review of the international published and grey literature. CINAHL, Embase and PubMed databases were searched in March 2014 for articles published between January 2004 and December 2013. GreyNet International and other relevant websites and repositories were also searched in March-April 2014 for documents dated between 1992 and 2012. All citations were imported into a bibliographic database. Published and unpublished tools and resources were included in the review if they were in English, related to primary care quality improvement and addressed any of the seven PC-PIT elements of a high-performing practice. Tools and resources that met the eligibility criteria were then evaluated for their accessibility, relevance, utility and comprehensiveness using a four-criteria appraisal framework. We used a data extraction template to systematically extract information from eligible tools and resources. A content analysis approach was used to explore the tools and resources and collate relevant information: name of the tool or resource, year and country of development, author, name of the organisation that provided access and its URL, accessibility information or problems, overview of each tool or resource and the quality improvement element(s) it addresses. If available, a copy of the tool or resource was downloaded into the bibliographic database, along with supporting evidence (published or unpublished) on its use in primary care. This systematic review identified 53 tools and resources that can potentially be provided as part of a suite of tools and resources to support primary care practices in improving the quality of their practice, to achieve improved health outcomes.

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Patient information leaflets (PILs) for UK randomised controlled trials: a feasibility study exploring whether they contain information to support decision making about trial participation.

PubMed

Gillies, Katie; Huang, Wan; Skea, Zoë; Brehaut, Jamie; Cotton, Seonaidh

2014-02-18

Informed consent is regarded as a cornerstone of ethical healthcare research and is a requirement for most clinical research studies. Guidelines suggest that prospective randomised controlled trial (RCT) participants should understand a basic amount of key information about the RCTs they are being asked to enrol in in order to provide valid informed consent. This information is usually provided to potential participants in a patient information leaflet (PIL). There is evidence that some trial participants fail to understand key components of trial processes or rationale. As such, the existing approach to information provision for potential RCT participants may not be optimal. Decision aids have been used for a variety of treatment and screening decisions to improve knowledge, but focus more on overall decision quality, and may be helpful to those making decisions about participating in an RCT. We investigated the feasibility of using a tool to identify which items recommended for good quality decision making are present in UK PILs. PILs were sampled from UK registered Clinical Trials Unit websites across a range of clinical areas. The evaluation tool, which is based on standards for supporting decision making, was applied to 20 PILs. Two researchers independently rated each PIL using the tool. In addition, word count and readability were assessed. PILs scored poorly on the evaluation tool with the majority of leaflets scoring less than 50%. Specifically, presenting probabilities, clarifying and expressing values and structured guidance in deliberation and communication sub-sections scored consistently poorly. Tool score was associated with word count (r=0.802, P <0.01); there was no association between score and readability (r=-0.372, P=0.106). The tool was feasible to use to evaluate PILs for UK RCTs. PILs did not meet current standards of information to support good quality decision making. Writers of information leaflets could use the evaluation tool as a framework during PIL development to help ensure that items are included which promote and support more informed decisions about trial participation. Further research is required to evaluate the inclusion of such information.

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Implementing a user-driven online quality improvement toolkit for cancer care.

PubMed

Luck, Jeff; York, Laura S; Bowman, Candice; Gale, Randall C; Smith, Nina; Asch, Steven M

2015-05-01

Peer-to-peer collaboration within integrated health systems requires a mechanism for sharing quality improvement lessons. The Veterans Health Administration (VA) developed online compendia of tools linked to specific cancer quality indicators. We evaluated awareness and use of the toolkits, variation across facilities, impact of social marketing, and factors influencing toolkit use. A diffusion of innovations conceptual framework guided the collection of user activity data from the Toolkit Series SharePoint site and an online survey of potential Lung Cancer Care Toolkit users. The VA Toolkit Series site had 5,088 unique visitors in its first 22 months; 5% of users accounted for 40% of page views. Social marketing communications were correlated with site usage. Of survey respondents (n = 355), 54% had visited the site, of whom 24% downloaded at least one tool. Respondents' awareness of the lung cancer quality performance of their facility, and facility participation in quality improvement collaboratives, were positively associated with Toolkit Series site use. Facility-level lung cancer tool implementation varied widely across tool types. The VA Toolkit Series achieved widespread use and a high degree of user engagement, although use varied widely across facilities. The most active users were aware of and active in cancer care quality improvement. Toolkit use seemed to be reinforced by other quality improvement activities. A combination of user-driven tool creation and centralized toolkit development seemed to be effective for leveraging health information technology to spread disease-specific quality improvement tools within an integrated health care system. Copyright © 2015 by American Society of Clinical Oncology.

Identifying key components for an effective case report poster: an observational study.

PubMed

Willett, Lisa L; Paranjape, Anuradha; Estrada, Carlos

2009-03-01

Residents demonstrate scholarly activity by presenting posters at academic meetings. Although recommendations from national organizations are available, evidence identifying which components are most important is not. To develop and test an evaluation tool to measure the quality of case report posters and identify the specific components most in need of improvement. Faculty evaluators reviewed case report posters and provided on-site feedback to presenters at poster sessions of four annual academic general internal medicine meetings. A newly developed ten-item evaluation form measured poster quality for specific components of content, discussion, and format (5-point Likert scale, 1 = lowest, 5 = highest). Evaluation tool performance, including Cronbach alpha and inter-rater reliability, overall poster scores, differences across meetings and evaluators and specific components of the posters most in need of improvement. Forty-five evaluators from 20 medical institutions reviewed 347 posters. Cronbach's alpha of the evaluation form was 0.84 and inter-rater reliability, Spearman's rho 0.49 (p < 0.001). The median score was 4.1 (Q1 -Q3, 3.7-4.6)(Q1 = 25th, Q3 = 75th percentile). The national meeting median score was higher than the regional meetings (4.4 vs, 4.0, P < 0.001). We found no difference in faculty scores. The following areas were identified as most needing improvement: clearly state learning objectives, tie conclusions to learning objectives, and use appropriate amount of words. Our evaluation tool provides empirical data to guide trainees as they prepare posters for presentation which may improve poster quality and enhance their scholarly productivity.

Evaluating the quality of internet information for breast cancer.

PubMed

Nghiem, A Z; Mahmoud, Y; Som, R

2016-02-01

The internet is frequently used by patients for researching information regarding breast cancer. This study aims to assess the quality of these websites using validated tools. The term 'breast cancer' was searched for in 3 search engines. The top 20 results were selected, and duplicates and irrelevant websites were excluded. 26/34 websites were analysed using the DISCERN Plus tool, HONcode and the JAMA benchmarks. 46% of the websites were classed as 'excellent' when assessed with the DISCERN tool. The range of DISCERN scores was wide (range: 25-74). Nine websites were found to be HONcode certified. Seven websites complied with all four JAMA benchmarks. This study shows the quality of breast cancer information on the internet is on the whole good; however the range of quality is wide. We recommend healthcare professionals use all 3 tools together to establish which websites are best to advise which websites patients should trust. Copyright © 2015 Elsevier Ltd. All rights reserved.

A scoping review of patient discharge from intensive care: opportunities and tools to improve care.

PubMed

Stelfox, Henry T; Lane, Dan; Boyd, Jamie M; Taylor, Simon; Perrier, Laure; Straus, Sharon; Zygun, David; Zuege, Danny J

2015-02-01

We conducted a scoping review to systematically review the literature reporting patient discharge from ICUs, identify facilitators and barriers to high-quality care, and describe tools developed to improve care. We searched Medline, Embase, CINAHL, and the Cochrane Central Register of Controlled Trials. Data were extracted on the article type, study details for research articles, patient population, phase of care during discharge, and dimensions of health-care quality. From 8,154 unique publications we included 224 articles. Of these, 131 articles (58%) were original research, predominantly case series (23%) and cohort (16%) studies; 12% were narrative reviews; and 11% were guidelines/policies. Common themes included patient and family needs/experiences (29% of articles) and the importance of complete and accurate information (26%). Facilitators of high-quality care included provider-patient communication (30%), provider-provider communication (25%), and the use of guidelines/policies (29%). Patient and family anxiety (21%) and limited availability of ICU and ward resources (26%) were reported barriers to high-quality care. A total of 47 tools to facilitate patient discharge from the ICU were identified and focused on patient evaluation for discharge (29%), discharge planning and teaching (47%), and optimized discharge summaries (23%). Common themes, facilitators and barriers related to patient and family needs/experiences, communication, and the use of guidelines/policies to standardize patient discharge from ICU transcend the literature. Candidate tools to improve care are available; comparative evaluation is needed prior to broad implementation and could be tested through local quality-improvement programs.

Evaluation of Arabic Language Learning Program for Non-Native Speakers in Saudi Electronic University According to Total Quality Standards

ERIC Educational Resources Information Center

Alowaydhi, Wafa Hafez

2016-01-01

The current study aimed at standardizing the program of learning Arabic for non-native speakers in Saudi Electronic University according to certain standards of total quality. To achieve its purpose, the study adopted the descriptive analytical method. The author prepared a measurement tool for evaluating the electronic learning programs in light…

Googling NDIS: Evaluating the Quality of Online Information about the National Disability Insurance Scheme for Caregivers of Deaf Children

ERIC Educational Resources Information Center

Simpson, Andrea; Baldwin, Elizabeth Margaret

2017-01-01

This study sought to analyze and evaluate the accessibility, availability and quality of online information regarding the National Disability Insurance Scheme (NDIS) and hearing loss. The most common search engine keyword terms a caregiver may enter when conducting a web search was determined using a keyword search tool. The top websites linked…

Examining the Quality of IEPs for Young Children with Autism

PubMed Central

McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2011-01-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool’s reliability; test the tool on a pilot sample of IEPs of young children; and examine associations between IEP quality and school, teacher, and child characteristics. IEPs for 35 students with autism (Mage = 6.1 years; SD = 1.6) from 35 different classrooms were examined. The IEP tool had adequate interrater reliability (ICC = .70). Results identified no statistically significant association between demographics and IEP quality, and IEPs contained relatively clear descriptions of present levels of performance. Weaknesses of IEPs were described and recommendations provided. PMID:20373007

Evaluation of the sustainability of contrasted pig farming systems: development of a market conformity tool for pork products based on technological quality traits.

PubMed

Gonzàlez, J; Gispert, M; Gil, M; Hviid, M; Dourmad, J Y; de Greef, K H; Zimmer, C; Fàbrega, E

2014-12-01

A market conformity tool, based on technological meat quality parameters, was developed within the Q-PorkChains project, to be included in a global sustainability evaluation of pig farming systems. The specific objective of the market conformity tool was to define a scoring system based on the suitability of meat to elaborate the main pork products, according to their market shares based on industry requirements, in different pig farming systems. The tool was based on carcass and meat quality parameters that are commonly used for the assessment of technological quality, which provide representative and repeatable data and are easily measurable. They were the following: cold carcass weight; lean meat percentage; minimum subcutaneous back fat depth at m. gluteus medius level, 45 postmortem and ultimate pH (measured at 24-h postmortem) in m. longissimus lumborum and semimembranosus; meat colour; drip losses and intramuscular fat content in a m. longissimus sample. Five categories of pork products produced at large scale in Europe were considered in the study: fresh meat, cooked products, dry products, specialties and other meat products. For each of the studied farming systems, the technological meat quality requirements, as well as the market shares for each product category within farming system, were obtained from the literature and personal communications from experts. The tool resulted in an overall conformity score that enabled to discriminate among systems according to the degree of matching of the achieved carcass and meat quality with the requirements of the targeted market. In order to improve feasibility, the tool was simplified by selecting ultimate pH at m. longissimus or semimembranosus, minimum fat thickness measured at the left half carcass over m. gluteus medius and intramuscular fat content in a m. longissimus sample as iceberg indicators. The overall suitability scores calculated by using both the complete and the reduced tools presented good correlation and the results obtained were similar. The tool could be considered as robust enough to discriminate among different systems, since it was tested in a wide range of them. It also can be used to detect improvement opportunities to enhance sustainability of pig farming systems. The final objective of the study was achieved, since the market suitability tool could be used in an integrated sustainability analysis of pig farming systems.

Health system guidance appraisal--concept evaluation and usability testing.

PubMed

Ako-Arrey, Denis E; Brouwers, Melissa C; Lavis, John N; Giacomini, Mita K

2016-01-05

Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability. This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed. Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains. The final tool, named the Appraisal of Guidelines for Research and Evaluation for Health Systems (AGREE-HS) (version 1), defines expectations of HSG and facilitates informed decisions among policymakers on health system delivery, financial, and governance arrangements.

[Evaluation of quality of service in Early Intervention: A systematic review].

PubMed

Jemes Campaña, Inmaculada Concepción; Romero-Galisteo, Rita Pilar; Labajos Manzanares, María Teresa; Moreno Morales, Noelia

2018-06-07

Early Intervention (EI), as a paediatric service, has the duty of quantifying the results and the quality of its services provided. The accessibility of valid and reliable tools allows professionals to evaluate the quality of these services. The aim of this study is to review the scientific literature on tools used to measure the methodological and service quality in EI. A search was made in different databases: Medline (from PubMed), Web of Science, PsycINFO, Cochrane, Scopus, ERIC and Scielo. The methodological quality of the studies was tested using the COSMIN scale. A total of 13 manuscripts met the criteria to be included in this review. Ten of them received a "good" or "reasonable" score based on the COSMIN scale. Despite its importance, there is no consensus among authors on the measurement of service quality in EI. It is often the family of the children attended in EI that are considered the target to study, although the opinion of professionals carries more weight and completes the information. Copyright © 2018. Publicado por Elsevier España, S.L.U.

Quality of patient health information on the Internet: reviewing a complex and evolving landscape.

PubMed

Fahy, Eamonn; Hardikar, Rohan; Fox, Adrian; Mackay, Sean

2014-01-01

The popularity of the Internet has enabled unprecedented access to health information. As a largely unregulated source, there is potential for inconsistency in the quality of information that reaches the patient. To review the literature relating to the quality indicators of health information for patients on the Internet. A search of English language literature was conducted using PubMed, Google Scholar and EMBASE databases. Many articles have been published which assess the quality of information relating to specific medical conditions. Indicators of quality have been defined in an attempt to predict higher quality health information on the Internet. Quality evaluation tools are scoring systems based on indicators of quality. Established tools such as the HONcode may help patients navigate to more reliable information. Google and Wikipedia are important emerging sources of patient health information. The Internet is crucial for modern dissemination of health information, but it is clear that quality varies significantly between sources. Quality indicators for web-information have been developed but there is no agreed standard yet. We envisage that reliable rating tools, effective search engine ranking and progress in crowd-edited websites will enhance patient access to health information on the Internet.

An Automated Treatment Plan Quality Control Tool for Intensity-Modulated Radiation Therapy Using a Voxel-Weighting Factor-Based Re-Optimization Algorithm

PubMed Central

Song, Ting; Li, Nan; Zarepisheh, Masoud; Li, Yongbao; Gautier, Quentin; Zhou, Linghong; Mell, Loren; Jiang, Steve; Cerviño, Laura

2016-01-01

Intensity-modulated radiation therapy (IMRT) currently plays an important role in radiotherapy, but its treatment plan quality can vary significantly among institutions and planners. Treatment plan quality control (QC) is a necessary component for individual clinics to ensure that patients receive treatments with high therapeutic gain ratios. The voxel-weighting factor-based plan re-optimization mechanism has been proved able to explore a larger Pareto surface (solution domain) and therefore increase the possibility of finding an optimal treatment plan. In this study, we incorporated additional modules into an in-house developed voxel weighting factor-based re-optimization algorithm, which was enhanced as a highly automated and accurate IMRT plan QC tool (TPS-QC tool). After importing an under-assessment plan, the TPS-QC tool was able to generate a QC report within 2 minutes. This QC report contains the plan quality determination as well as information supporting the determination. Finally, the IMRT plan quality can be controlled by approving quality-passed plans and replacing quality-failed plans using the TPS-QC tool. The feasibility and accuracy of the proposed TPS-QC tool were evaluated using 25 clinically approved cervical cancer patient IMRT plans and 5 manually created poor-quality IMRT plans. The results showed high consistency between the QC report quality determinations and the actual plan quality. In the 25 clinically approved cases that the TPS-QC tool identified as passed, a greater difference could be observed for dosimetric endpoints for organs at risk (OAR) than for planning target volume (PTV), implying that better dose sparing could be achieved in OAR than in PTV. In addition, the dose-volume histogram (DVH) curves of the TPS-QC tool re-optimized plans satisfied the dosimetric criteria more frequently than did the under-assessment plans. In addition, the criteria for unsatisfied dosimetric endpoints in the 5 poor-quality plans could typically be satisfied when the TPS-QC tool generated re-optimized plans without sacrificing other dosimetric endpoints. In addition to its feasibility and accuracy, the proposed TPS-QC tool is also user-friendly and easy to operate, both of which are necessary characteristics for clinical use. PMID:26930204

Implementation of Systematic Review Tools in IRIS | Science ...

EPA Pesticide Factsheets

Currently, the number of chemicals present in the environment exceeds the ability of public health scientists to efficiently screen the available data in order to produce well-informed human health risk assessments in a timely manner. For this reason, the US EPA’s Integrated Risk Information System (IRIS) program has started implementing new software tools into the hazard characterization workflow. These automated tools aid in multiple phases of the systematic review process including scoping and problem formulation, literature search, and identification and screening of available published studies. The increased availability of these tools lays the foundation for automating or semi-automating multiple phases of the systematic review process. Some of these software tools include modules to facilitate a structured approach to study quality evaluation of human and animal data, although approaches are generally lacking for assessing complex mechanistic information, in particular “omics”-based evidence tools are starting to become available to evaluate these types of studies. We will highlight how new software programs, online tools, and approaches for assessing study quality can be better integrated to allow for a more efficient and transparent workflow of the risk assessment process as well as identify tool gaps that would benefit future risk assessments. Disclaimer: The views expressed here are those of the authors and do not necessarily represent the view

Multiple Watershed Scales Approach for Placement of BMPs in SUSTAIN

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads ...

A Database and Tool for Boundary Conditions for Regional Air Quality Modeling: Description and Evaluation

EPA Science Inventory

Transported air pollutants receive increasing attention as regulations tighten and global concentrations increase. The need to represent international transport in regional air quality assessments requires improved representation of boundary concentrations. Currently available ob...

Quality control and in-service inspection technology for hybrid-composite girder bridges.

DOT National Transportation Integrated Search

2014-08-01

This report describes efforts to develop quality control tools and in-service inspection technologies for the fabrication and construction of Hybrid Composite Beams (HCBs). HCBs are a new bridge technology currently being evaluated by the Missouri De...

Ohio Uses Wetlands Program Development Grants to Protect Wetlands

EPA Pesticide Factsheets

The wetland water quality standards require the use of ORAM score to determine wetland quality. OEPA has also used these tools to evaluate wetland mitigation projects, develop performance standards for wetland mitigation banks and In Lieu Fee programs an.

Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study.

PubMed

Gates, Allison; Gates, Michelle; Duarte, Gonçalo; Cary, Maria; Becker, Monika; Prediger, Barbara; Vandermeer, Ben; Fernandes, Ricardo M; Pieper, Dawid; Hartling, Lisa

2018-06-13

Systematic reviews (SRs) of randomised controlled trials (RCTs) can provide the best evidence to inform decision-making, but their methodological and reporting quality varies. Tools exist to guide the critical appraisal of quality and risk of bias in SRs, but evaluations of their measurement properties are limited. We will investigate the interrater reliability (IRR), usability, and applicability of A MeaSurement Tool to Assess systematic Reviews (AMSTAR), AMSTAR 2, and Risk Of Bias In Systematic reviews (ROBIS) for SRs in the fields of biomedicine and public health. An international team of researchers at three collaborating centres will undertake the study. We will use a random sample of 30 SRs of RCTs investigating therapeutic interventions indexed in MEDLINE in February 2014. Two reviewers at each centre will appraise the quality and risk of bias in each SR using AMSTAR, AMSTAR 2, and ROBIS. We will record the time to complete each assessment and for the two reviewers to reach consensus for each SR. We will extract the descriptive characteristics of each SR, the included studies, participants, interventions, and comparators. We will also extract the direction and strength of the results and conclusions for the primary outcome. We will summarise the descriptive characteristics of the SRs using means and standard deviations, or frequencies and proportions. To test for interrater reliability between reviewers and between the consensus agreements of reviewer pairs, we will use Gwet's AC 1 statistic. For comparability to previous evaluations, we will also calculate weighted Cohen's kappa and Fleiss' kappa statistics. To estimate usability, we will calculate the mean time to complete the appraisal and to reach consensus for each tool. To inform applications of the tools, we will test for statistical associations between quality scores and risk of bias judgments, and the results and conclusions of the SRs. Appraising the methodological and reporting quality of SRs is necessary to determine the trustworthiness of their conclusions. Which tool may be most reliably applied and how the appraisals should be used is uncertain; the usability of newly developed tools is unknown. This investigation of common (AMSTAR) and newly developed (AMSTAR 2, ROBIS) tools will provide empiric data to inform their application, interpretation, and refinement.

The Use of AMET & Automated Scripts for Model Evaluation

EPA Science Inventory

Brief overview of EPA’s new CMAQ website to be launched publically in June, 2017. Details on the upcoming release of the Atmospheric Model Evaluation Tool (AMET) and the creation of automated scripts for post-processing and evaluating air quality model data.

Developing a practical evaluation tool for preceptor use.

PubMed

Walsh, Catherine M; Seldomridge, Lisa A; Badros, Karen K

2008-01-01

After years of dissatisfaction with existing instruments, a tool for preceptors to evaluate an undergraduate student's clinical performance was developed, with preceptors' input in its construction. A 2-year pilot evaluation revealed notable problems including excessively high preceptor ratings and significant disparities between faculty and preceptor ratings. Further revisions were made, reducing indicators to those which the preceptors can actually evaluate on an everyday basis and developing a rubric. Additional recommendations to bolster the quality of ratings are improving orientation and guidance of preceptors and modifying procedures for giving feedback.

A Model of Risk Analysis in Analytical Methodology for Biopharmaceutical Quality Control.

PubMed

Andrade, Cleyton Lage; Herrera, Miguel Angel De La O; Lemes, Elezer Monte Blanco

2018-01-01

One key quality control parameter for biopharmaceutical products is the analysis of residual cellular DNA. To determine small amounts of DNA (around 100 pg) that may be in a biologically derived drug substance, an analytical method should be sensitive, robust, reliable, and accurate. In principle, three techniques have the ability to measure residual cellular DNA: radioactive dot-blot, a type of hybridization; threshold analysis; and quantitative polymerase chain reaction. Quality risk management is a systematic process for evaluating, controlling, and reporting of risks that may affects method capabilities and supports a scientific and practical approach to decision making. This paper evaluates, by quality risk management, an alternative approach to assessing the performance risks associated with quality control methods used with biopharmaceuticals, using the tool hazard analysis and critical control points. This tool provides the possibility to find the steps in an analytical procedure with higher impact on method performance. By applying these principles to DNA analysis methods, we conclude that the radioactive dot-blot assay has the largest number of critical control points, followed by quantitative polymerase chain reaction, and threshold analysis. From the analysis of hazards (i.e., points of method failure) and the associated method procedure critical control points, we conclude that the analytical methodology with the lowest risk for performance failure for residual cellular DNA testing is quantitative polymerase chain reaction. LAY ABSTRACT: In order to mitigate the risk of adverse events by residual cellular DNA that is not completely cleared from downstream production processes, regulatory agencies have required the industry to guarantee a very low level of DNA in biologically derived pharmaceutical products. The technique historically used was radioactive blot hybridization. However, the technique is a challenging method to implement in a quality control laboratory: It is laborious, time consuming, semi-quantitative, and requires a radioisotope. Along with dot-blot hybridization, two alternatives techniques were evaluated: threshold analysis and quantitative polymerase chain reaction. Quality risk management tools were applied to compare the techniques, taking into account the uncertainties, the possibility of circumstances or future events, and their effects upon method performance. By illustrating the application of these tools with DNA methods, we provide an example of how they can be used to support a scientific and practical approach to decision making and can assess and manage method performance risk using such tools. This paper discusses, considering the principles of quality risk management, an additional approach to the development and selection of analytical quality control methods using the risk analysis tool hazard analysis and critical control points. This tool provides the possibility to find the method procedural steps with higher impact on method reliability (called critical control points). Our model concluded that the radioactive dot-blot assay has the larger number of critical control points, followed by quantitative polymerase chain reaction and threshold analysis. Quantitative polymerase chain reaction is shown to be the better alternative analytical methodology in residual cellular DNA analysis. © PDA, Inc. 2018.

Surface Roughness Model Based on Force Sensors for the Prediction of the Tool Wear

PubMed Central

de Agustina, Beatriz; Rubio, Eva María; Sebastián, Miguel Ángel

2014-01-01

In this study, a methodology has been developed with the objective of evaluating the surface roughness obtained during turning processes by measuring the signals detected by a force sensor under the same cutting conditions. In this way, the surface quality achieved along the process is correlated to several parameters of the cutting forces (thrust forces, feed forces and cutting forces), so the effect that the tool wear causes on the surface roughness is evaluated. In a first step, the best cutting conditions (cutting parameters and radius of tool) for a certain quality surface requirement were found for pieces of UNS A97075. Next, with this selection a model of surface roughness based on the cutting forces was developed for different states of wear that simulate the behaviour of the tool throughout its life. The validation of this model reveals that it was effective for approximately 70% of the surface roughness values obtained. PMID:24714391

Process evaluation of software using the international classification of external causes of injuries for collecting burn injury data at burn centers in the United States.

PubMed

Villaveces, Andrés; Peck, Michael; Faraklas, Iris; Hsu-Chang, Naiwei; Joe, Victor; Wibbenmeyer, Lucy

2014-01-01

Detailed information on the cause of burns is necessary to construct effective prevention programs. The International Classification of External Causes of Injury (ICECI) is a data collection tool that allows comprehensive categorization of multiple facets of injury events. The objective of this study was to conduct a process evaluation of software designed to improve the ease of use of the ICECI so as to identify key additional variables useful for understanding the occurrence of burn injuries, and compare this software with existing data-collection practices conducted for burn injuries. The authors completed a process evaluation of the implementation and ease of use of the software in six U.S. burn centers. They also collected preliminary burn injury data and compared them with existing variables reported to the American Burn Association's National Burn Repository (NBR). The authors accomplished their goals of 1) creating a data-collection tool for the ICECI, which can be linked to existing operational programs of the NBR, 2) training registrars in the use of this tool, 3) establishing quality-control mechanisms for ensuring accuracy and reliability, 4) incorporating ICECI data entry into the weekly routine of the burn registrar, and 5) demonstrating the quality differences between data collected using this tool and the NBR. Using this or similar tools with the ICECI structure or key selected variables can improve the quantity and quality of data on burn injuries in the United States and elsewhere and thus can be more useful in informing prevention strategies.

Quality evaluation and control of end cap welds in PHWR fuel elements by ultrasonic examination

NASA Astrophysics Data System (ADS)

Choi, M. S.; Yang, M. S.

1991-02-01

The current quality control procedure of nuclear fuel end cap weld is mainly dependent on the destructive metallographic examination. A nondestructive examination technique, i.e., ultrasonic examination, has been developed to identify and evaluate weld discontinuities. A few interesting results of the weld quality evaluation by applying the developed ultrasonic examination technique to PHWR fuel welds are presented. In addition, the feasibility of the weld quality control by the ultrasonic examination is discussed. This study shows that the ultrasonic examination is effective and reliable method for detecting abnormal weld contours and weld discontinuities such as micro-fissure, crack, upset split and expulsion, and can be used as a quality control tool for the end cap welding process.

[To evaluate the quality of life and peristomal skin ostomy patient with the new device Sensura].

PubMed

Crespo Fontán, Beatriz; Caparrós Sanz, María Rosario; Lainez Pardos, Pilar Lourdes; Davín Durban, Inmaculada

2010-10-01

In 2006, Coloplast launched in several European countries a new device for ostomy care called Sensura. This clinical research report includes only the results of the subpopulation included in Spain as a part of an international study involving many countries such as Denmark, United States, Canada, Australia, Poland, Netherlands, France, Slovakia, Germany, UK, Italy, Iceland, Japan, Czech Republic, Portugal, South Korea and Argentina. OBJECTIVES AND STUDY VARIABLES: The main purpose of the study is to evaluate the experience with Sensura, under normal conditions of use, with special attention to skin condition and quality of life. The main objective of the study is to evaluate the quality of life, through Quality of Life Questionnaire called "Stoma QoL". A secondary objective, is to study the correlation between quality of life and the peristomal skin condition. Other Secondary objectives include the evaluation of the patient's current device at the time of entering the study and by the other hand, the device Sensura and safety evaluation throughout the study. The study was designed as an open label non-comparative, multi-national Post Market study. The study period for each patient is 6 to 8 weeks +/- 4 days, which includes an initial visit and a final visit. The study population included people who carry a colostomy or ileostomy. Regarding Spain, a total of 10 sites participated and included a total of 131 patients. This report only presents results for nine sites and a total of 123 patients. The reason is that the last participating site began the study with a considerable delay The remaining subjects included in this site together with the other centers in Spain and the other participating countries will be included in the final international report, that will present the overall results. MEASUREMENT TOOLS. Stoma-QoL (Quality of Life Questionnaire for people with an ostomy). OST (Ostomy Skin Tool) instrument for the assessment of peristomal skin. As for the quality of life, at baseline we found a mean of 59 out of 100 (SD = 8.8), while the final study visit, mean score was 59.6 out of 100 (SD = 9.3), although the final results on this variable will be presented in the global report, since it has not reached sufficient population in Spain for the analysis of this variable. The study revealed a significant improvement in the peristomal skin condition at the end of the study, measured by the tool OST (Ostomy Skin Tool). Regarding the evaluation of the SenSura device, there was a significant improvement related to the appearance of leakage of effluent, as well as other items evaluated in relation with the device.

Modeling Cover Crop Effectiveness on Maryland's Eastern Shore

USDA-ARS?s Scientific Manuscript database

The value of watershed-scale, hydrologic/water quality models to ecosystem management is increasingly evident as more programs adopt these tools to evaluate the effectiveness of different management scenarios and their impact on the environment. Quality of precipitation data is critical for appropri...

Multiple Watershed Scales Approach for Placement of Best Managemnet Practices in SUSTAIN

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate how best to address environmental quality restoration and protection needs in urban and developing areas. Significant investments are needed to protect and restore water quality, address total maximum daily loads ...

A comprehensive evaluation of assembly scaffolding tools

PubMed Central

2014-01-01

Background Genome assembly is typically a two-stage process: contig assembly followed by the use of paired sequencing reads to join contigs into scaffolds. Scaffolds are usually the focus of reported assembly statistics; longer scaffolds greatly facilitate the use of genome sequences in downstream analyses, and it is appealing to present larger numbers as metrics of assembly performance. However, scaffolds are highly prone to errors, especially when generated using short reads, which can directly result in inflated assembly statistics. Results Here we provide the first independent evaluation of scaffolding tools for second-generation sequencing data. We find large variations in the quality of results depending on the tool and dataset used. Even extremely simple test cases of perfect input, constructed to elucidate the behaviour of each algorithm, produced some surprising results. We further dissect the performance of the scaffolders using real and simulated sequencing data derived from the genomes of Staphylococcus aureus, Rhodobacter sphaeroides, Plasmodium falciparum and Homo sapiens. The results from simulated data are of high quality, with several of the tools producing perfect output. However, at least 10% of joins remains unidentified when using real data. Conclusions The scaffolders vary in their usability, speed and number of correct and missed joins made between contigs. Results from real data highlight opportunities for further improvements of the tools. Overall, SGA, SOPRA and SSPACE generally outperform the other tools on our datasets. However, the quality of the results is highly dependent on the read mapper and genome complexity. PMID:24581555

The Use of AMET and Automated Scripts for Model Evaluation

EPA Science Inventory

The Atmospheric Model Evaluation Tool (AMET) is a suite of software designed to facilitate the analysis and evaluation of meteorological and air quality models. AMET matches the model output for particular locations to the corresponding observed values from one or more networks ...

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions

PubMed Central

Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-01-01

Background Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. Objective The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. Methods As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). Results A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content—a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. Conclusions This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program’s evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. PMID:28325712

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions.

PubMed

Baumel, Amit; Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-03-21

Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content-a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program's evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. ©Amit Baumel, Keren Faber, Nandita Mathur, John M Kane, Fred Muench. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.03.2017.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Towards a new tool for the evaluation of the quality of ultrasound compressed images.

PubMed

Delgorge, Cécile; Rosenberger, Christophe; Poisson, Gérard; Vieyres, Pierre

2006-11-01

This paper presents a new tool for the evaluation of ultrasound image compression. The goal is to measure the image quality as easily as with a statistical criterion, and with the same reliability as the one provided by the medical assessment. An initial experiment is proposed to medical experts and represents our reference value for the comparison of evaluation criteria. Twenty-one statistical criteria are selected from the literature. A cumulative absolute similarity measure is defined as a distance between the criterion to evaluate and the reference value. A first fusion method based on a linear combination of criteria is proposed to improve the results obtained by each of them separately. The second proposed approach combines different statistical criteria and uses the medical assessment in a training phase with a support vector machine. Some experimental results are given and show the benefit of fusion.

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2012 CFR

2012-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2011 CFR

2011-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2013 CFR

2013-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2014 CFR

2014-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

Evaluating Digital Authoring Tools

ERIC Educational Resources Information Center

Wilde, Russ

2004-01-01

As the quality of authoring software increases, online course developers become less reliant on proprietary learning management systems, and develop skills in the design of original, in-house materials and the delivery platforms for them. This report examines the capabilities of digital authoring software tools for the development of learning…

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study

PubMed Central

Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-01-01

Background The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. Objective We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. Methods We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. Results In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. Conclusions This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. PMID:29699970

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

Identifying Key Components for an Effective Case Report Poster: An Observational Study

PubMed Central

Paranjape, Anuradha; Estrada, Carlos

2008-01-01

BACKGROUND Residents demonstrate scholarly activity by presenting posters at academic meetings. Although recommendations from national organizations are available, evidence identifying which components are most important is not. OBJECTIVE To develop and test an evaluation tool to measure the quality of case report posters and identify the specific components most in need of improvement. DESIGN Faculty evaluators reviewed case report posters and provided on-site feedback to presenters at poster sessions of four annual academic general internal medicine meetings. A newly developed ten-item evaluation form measured poster quality for specific components of content, discussion, and format (5-point Likert scale, 1 = lowest, 5 = highest). Main outcome measure(s): Evaluation tool performance, including Cronbach alpha and inter-rater reliability, overall poster scores, differences across meetings and evaluators and specific components of the posters most in need of improvement. RESULTS Forty-five evaluators from 20 medical institutions reviewed 347 posters. Cronbach’s alpha of the evaluation form was 0.84 and inter-rater reliability, Spearman’s rho 0.49 ( < 0.001). The median score was 4.1 (Q1 -Q3, 3.7-4.6)(Q1 = 25th, Q3 = 75th percentile). The national meeting median score was higher than the regional meetings (4.4 vs, 4.0,  < 0.001). We found no difference in faculty scores. The following areas were identified as most needing improvement: clearly state learning objectives, tie conclusions to learning objectives, and use appropriate amount of words. CONCLUSIONS Our evaluation tool provides empirical data to guide trainees as they prepare posters for presentation which may improve poster quality and enhance their scholarly productivity. PMID:19089510

[Quality of the pharmacotherapeutic recommendations for the integrated care procedures in Andalusia].

PubMed

Corte, Rosa María Muñoz; Estepa, Raúl García; Ramos, Bernardo Santos; Paloma, Francisco Javier Bautista

2009-01-01

To evaluate the quality of the pharmacotherapeutic recommendations included in the Integrated Care Procedures (PAIs regarding its initials in Spanish) of the Andalusian Ministry of Health, published up to March 2008, through the design and validation of a tool. The assessment tool was designed based on similar instruments, specifically the AGREE. Other criteria included were taken from various literature sources or were devised by ourselves. The tool was validated prior to being used. After applying it to all the PAIs, we examined the degree of compliance with these pharmacotherapeutic criteria, both as a whole and by PAIs subgroups. The developed tool is a questionnaire of 20 items, divided into 4 sections. The first section consists of the essential criteria, and the rest make reference to more specific, non essential criteria: definition of the level of evidence, thoroughness of information and definition of indicators. It was found that 4 of the 60 PAIs do not contain any type of therapeutic recommendation. No PAI fulfils all the items listed in the tool, however, 70 % of them fulfil the essential quality criteria established. There is a great variability in the content of pharmacotherapeutic recommendations for each PAI. Once the validity of the tool has been proved, it could be used to assess the quality of the therapeutic recommendations in clinical practice guidelines.

ECONOMICS OF SAMPLE COMPOSITING AS A SCREENING TOOL IN GROUND WATER QUALITY MONITORING

EPA Science Inventory

Recent advances in high throughput/automated compositing with robotics/field-screening methods offer seldom-tapped opportunities for achieving cost-reduction in ground water quality monitoring programs. n economic framework is presented in this paper for the evaluation of sample ...

OBJECTIVE REDUCTION OF THE SPACE-TIME DOMAIN DIMENSIONALITY FOR EVALUATING MODEL PERFORMANCE

EPA Science Inventory

In the United States, photochemical air quality models are the principal tools used by governmental agencies to develop emission reduction strategies aimed at achieving National Ambient Air Quality Standards (NAAQS). Before they can be applied with confidence in a regulatory sett...

Evaluation of the Missoula-VITAS Quality of Life Index--revised: research tool or clinical tool?

PubMed

Schwartz, Carolyn E; Merriman, Melanie P; Reed, George; Byock, Ira

2005-02-01

Quality of life (QOL) is a central outcome measure in caring for seriously ill patients. The Missoula-VITAS Quality of Life Index (MVQOLI) is a 25-item patient-centered index that weights each of five QOL dimensions (symptoms, function, interpersonal, wellbeing, transcendence) by its importance to the respondent. The measure has been used to assess QOL for hospice patients, and has been found to be somewhat complex to use and analyze. This study aimed to simplify the measure, and evaluate the reliability and validity of a revised version as either a research or clinical tool (i.e., "psychometric" versus "clinimetric"). Two data collection efforts are described. The psychometric study collected QOL data from 175 patients at baseline, 3-5 days, and 21 days later. The implementation study evaluated the feasibility and utility of the MVQOLI-R during over six weeks of use. End-stage renal patients on dialysis, hospice, or long-term care patients participated in the psychometric study. The implementation study was done in hospice, home health, and palliative care settings. The MVQOLI-R and the Memorial Symptom Assessment Scale. The psychometric and implementation studies suggest that the MVQOLI-R performs well as a clinical tool but is not powerful as an outcome research instrument. The MVQOLI-R has the heterogeneous structure of clinimetric tools, and demonstrated both relevance and responsiveness. Additionally, in a clinical setting the MVQOLI-R was useful therapeutically for stimulating communication about the psychosocial and spiritual issues important to the tasks of life completion and life closure. The MVQOLI-R has clinical utility as a patient QOL assessment tool and may have therapeutic utility as a tool for fostering discussion among patients and their clinicians, as well as for helping patients identify sources of suffering and opportunities during this time in their lives.

Pediatric faculty and residents’ perspectives on In-Training Evaluation Reports (ITERs)

PubMed Central

Patel, Rikin; Drover, Anne; Chafe, Roger

2015-01-01

Background In-training evaluation reports (ITERs) are used by over 90% of postgraduate medical training programs in Canada for resident assessment. Our study examined the perspectives of faculty and residents in one pediatric program as a means to improve the ITER as an evaluation tool. Method Two separate focus groups were conducted, one with eight pediatric residents and one with nine clinical faculty within the pediatrics program of Memorial University’s Faculty of Medicine to discuss their perceptions of, and suggestions for improving, the use of ITERs. Results Residents and faculty shared many similar suggestions for improving the ITER as an evaluation tool. Both the faculty and residents emphasized the importance of written feedback, contextualizing the evaluation and timely follow-up. The biggest challenge appears to be the discrepancy in the quality of feedback sought by the residents and the faculty members’ ability to do so in a time effective manner. Others concerns related to the need for better engagement in setting rotation objectives and more direct observation by the faculty member completing the ITER. Conclusions The ITER is a useful tool in resident evaluations, but a number of issues relating to its actual use could improve the quality of feedback which residents receive. PMID:27004076

Evaluation of websites that contain information relating to malaria in pregnancy.

PubMed

Hamwela, V; Ahmed, W; Bath, P A

2018-04-01

The study identified available websites on malaria in pregnancy on the World Wide Web and sought to evaluate their readability and information quality. A purposeful sample of websites were selected which provided information on Malaria in pregnancy. A total of 31 websites were identified from searches using Google, Yahoo and Bing search engines. Two generic tools (Discern and HON), one specific tool designed to assess information quality of malaria in pregnancy and readability tests (Flesch Reading Ease and Flesh-Kincaid Grade level) were used to evaluate the websites. Most of the websites scored below 50% with the HON Code tool, with most lacking information on the symptoms. One website scored over 70 with the reading ease with two (2) achieving a score of 7 for the reading level test. The readability of the websites was too advanced for an ordinary consumer. The results of this study indicated that the information quality of malaria in pregnancy websites varied from fair to medium. It was also found that the readability of the websites was too advanced for an ordinary consumer. These findings suggest that most websites are not comprehensive in addressing all the relevant aspects of malaria in pregnancy. Copyright © 2018 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Development of a web-based toolkit to support improvement of care coordination in primary care.

PubMed

Ganz, David A; Barnard, Jenny M; Smith, Nina Z Y; Miake-Lye, Isomi M; Delevan, Deborah M; Simon, Alissa; Rose, Danielle E; Stockdale, Susan E; Chang, Evelyn T; Noël, Polly H; Finley, Erin P; Lee, Martin L; Zulman, Donna M; Cordasco, Kristina M; Rubenstein, Lisa V

2018-05-23

Promising practices for the coordination of chronic care exist, but how to select and share these practices to support quality improvement within a healthcare system is uncertain. This study describes an approach for selecting high-quality tools for an online care coordination toolkit to be used in Veterans Health Administration (VA) primary care practices. We evaluated tools in three steps: (1) an initial screening to identify tools relevant to care coordination in VA primary care, (2) a two-clinician expert review process assessing tool characteristics (e.g. frequency of problem addressed, linkage to patients' experience of care, effect on practice workflow, and sustainability with existing resources) and assigning each tool a summary rating, and (3) semi-structured interviews with VA patients and frontline clinicians and staff. Of 300 potentially relevant tools identified by searching online resources, 65, 38, and 18 remained after steps one, two and three, respectively. The 18 tools cover five topics: managing referrals to specialty care, medication management, patient after-visit summary, patient activation materials, agenda setting, patient pre-visit packet, and provider contact information for patients. The final toolkit provides access to the 18 tools, as well as detailed information about tools' expected benefits, and resources required for tool implementation. Future care coordination efforts can benefit from systematically reviewing available tools to identify those that are high quality and relevant.

Role of tool marks inside spherical mitigation pit fabricated by micro-milling on repairing quality of damaged KH2PO4 crystal

PubMed Central

Chen, Ming-Jun; Cheng, Jian; Yuan, Xiao-Dong; Liao, Wei; Wang, Hai-Jun; Wang, Jing-He; Xiao, Yong; Li, Ming-Quan

2015-01-01

Repairing initial slight damage site into stable structures by engineering techniques is the leading strategy to mitigate the damage growth on large-size components used in laser-driven fusion facilities. For KH2PO4 crystals, serving as frequency converter and optoelectronic switch-Pockels cell, micro-milling has been proven the most promising method to fabricate these stable structures. However, tool marks inside repairing pit would be unavoidably introduced due to the wearing of milling cutter in actual repairing process. Here we quantitatively investigate the effect of tool marks on repairing quality of damaged crystal components by simulating its induced light intensification and testing the laser-induced damage threshold. We found that due to the formation of focusing hot spots and interference ripples, the light intensity is strongly enhanced with the presence of tool marks, especially for those on rear surfaces. Besides, the negative effect of tool marks is mark density dependent and multiple tool marks would aggravate the light intensification. Laser damage tests verified the role of tool marks as weak points, reducing the repairing quality. This work offers new criterion to comprehensively evaluate the quality of repaired optical surfaces to alleviate the bottleneck issue of low laser damage threshold for optical components in laser-driven fusion facilities. PMID:26399624

Performance comparison of SNP detection tools with illumina exome sequencing data—an assessment using both family pedigree information and sample-matched SNP array data

PubMed Central

Yi, Ming; Zhao, Yongmei; Jia, Li; He, Mei; Kebebew, Electron; Stephens, Robert M.

2014-01-01

To apply exome-seq-derived variants in the clinical setting, there is an urgent need to identify the best variant caller(s) from a large collection of available options. We have used an Illumina exome-seq dataset as a benchmark, with two validation scenarios—family pedigree information and SNP array data for the same samples, permitting global high-throughput cross-validation, to evaluate the quality of SNP calls derived from several popular variant discovery tools from both the open-source and commercial communities using a set of designated quality metrics. To the best of our knowledge, this is the first large-scale performance comparison of exome-seq variant discovery tools using high-throughput validation with both Mendelian inheritance checking and SNP array data, which allows us to gain insights into the accuracy of SNP calling through such high-throughput validation in an unprecedented way, whereas the previously reported comparison studies have only assessed concordance of these tools without directly assessing the quality of the derived SNPs. More importantly, the main purpose of our study was to establish a reusable procedure that applies high-throughput validation to compare the quality of SNP discovery tools with a focus on exome-seq, which can be used to compare any forthcoming tool(s) of interest. PMID:24831545

A potential non-invasive approach to evaluating blastocyst quality using biodynamic imaging

NASA Astrophysics Data System (ADS)

Li, Zhe; Ehmke, Natalie; Machaty, Zoltan; Nolte, David

2018-02-01

Biodynamic imaging (BDI) is capable of capturing the intracellular dynamics of blastocysts within a relatively short time. Spectroscopic signatures of embryos in the 0.01 Hz - 1 Hz range display responses to external factors before morphology changes take place. Viability evaluation is consistent with results from other non-invasive methods. Biodynamic imaging is a potential tool for selecting high quality embryos in clinical IVF practices.

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Quality assessment of a sample of mobile app-based health behavior change interventions using a tool based on the National Institute of Health and Care Excellence behavior change guidance.

PubMed

McMillan, Brian; Hickey, Eamonn; Patel, Mahendra G; Mitchell, Caroline

2016-03-01

To quality assess a sample of health behavior change apps from the NHS Apps Library using a rating tool based on the 2014 National Institute for Health and Care Excellence behavior change guidance (NICE BCG). A qualitative analysis of the NICE BCG identified themes and questions for a quality assessment of health behavior change apps. These were refined by further discussion and piloting, and applied by two independent raters to a sample of NHS Library apps (N=49). Disagreements were resolved following discussions with a third rater. Themes identified were; purpose, planning, usability, tailoring, behavior change technique (BCT), maintenance, evaluation, data security and documentation. Overall, purpose of the apps was clear, but evidence for collaboration with users or professionals was lacking. Usability information was poor and tailoring disappointing. Most used recognized BCTs but paid less attention to behavior maintenance than initiation. Information on app evaluation and documentation was sparse. This study furthers the work of the NHS Apps Library, adapting the NICE (2014) behavior change guidance for quality assessment of behavior change apps. This study helps lay the foundations for development of a quality assurance tool for mobile health apps aimed at health behavior change. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Online tools for uncovering data quality issues in satellite-based global precipitation products

NASA Astrophysics Data System (ADS)

Liu, Z.; Heo, G.

2015-12-01

Accurate and timely available global precipitation products are important to many applications such as flood forecasting, hydrological modeling, vector-borne disease research, crop yield estimates, etc. However, data quality issues such as biases and uncertainties are common in satellite-based precipitation products and it is important to understand these issues in applications. In recent years, algorithms using multi-satellites and multi-sensors for satellite-based precipitation estimates have become popular, such as the TRMM (Tropical Rainfall Measuring Mission) Multi-satellite Precipitation Analysis (TMPA) and the latest Integrated Multi-satellitE Retrievals for GPM (IMERG). Studies show that data quality issues for multi-satellite and multi-sensor products can vary with space and time and can be difficult to summarize. Online tools can provide customized results for a given area of interest, allowing customized investigation or comparison on several precipitation products. Because downloading data and software is not required, online tools can facilitate precipitation product evaluation and comparison. In this presentation, we will present online tools to uncover data quality issues in satellite-based global precipitation products. Examples will be presented as well.

Quality assessment of systematic reviews on alveolar socket preservation.

PubMed

Moraschini, V; Barboza, E Dos S P

2016-09-01

The aim of this overview was to evaluate and compare the quality of systematic reviews, with or without meta-analysis, that have evaluated studies on techniques or biomaterials used for the preservation of alveolar sockets post tooth extraction in humans. An electronic search was conducted without date restrictions using the Medline/PubMed, Cochrane Library, and Web of Science databases up to April 2015. Eligibility criteria included systematic reviews, with or without meta-analysis, focused on the preservation of post-extraction alveolar sockets in humans. Two independent authors assessed the quality of the included reviews using AMSTAR and the checklist proposed by Glenny et al. in 2003. After the selection process, 12 systematic reviews were included. None of these reviews obtained the maximum score using the quality assessment tools implemented, and the results of the analyses were highly variable. A significant statistical correlation was observed between the scores of the two checklists. A wide structural and methodological variability was observed between the systematic reviews published on the preservation of alveolar sockets post tooth extraction. None of the reviews evaluated obtained the maximum score using the two quality assessment tools implemented. Copyright © 2016 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Identifying high quality medical education websites in Otolaryngology: a guide for medical students and residents.

PubMed

Yang, Nathan; Hosseini, Sarah; Mascarella, Marco A; Young, Meredith; Posel, Nancy; Fung, Kevin; Nguyen, Lily H P

2017-05-25

Learners often utilize online resources to supplement formalized curricula, and to appropriately support learning, these resources should be of high quality. Thus, the objectives of this study are to develop and provide validity evidence supporting an assessment tool designed to assess the quality of educational websites in Otolaryngology- Head & Neck Surgery (ORL-HNS), and identify those that could support effective web-based learning. METHODS: After a literature review, the Modified Education in Otolaryngology Website (MEOW) assessment tool was designed by a panel of experts based on a previously validated website assessment tool. A search strategy using a Google-based search engine was used subsequently to identify websites. Those that were free of charge and in English were included. Websites were coded for whether their content targeted medical students or residents. Using the MEOW assessment tool, two independent raters scored the websites. Inter-rater and intra-rater reliability were evaluated, and scores were compared to recommendations from a content expert. The MEOW assessment tool included a total of 20 items divided in 8 categories related to authorship, frequency of revision, content accuracy, interactivity, visual presentation, navigability, speed and recommended hyperlinks. A total of 43 out of 334 websites identified by the search met inclusion criteria. The scores generated by our tool appeared to differentiate higher quality websites from lower quality ones: websites that the expert "would recommend" scored 38.4 (out of 56; CI [34.4-42.4]) and "would not recommend" 27.0 (CI [23.2-30.9]). Inter-rater and intra-rater intraclass correlation coefficient were greater than 0.7. Using the MEOW assessment tool, high quality ORL-HNS educational websites were identified.

Assessment of SOAP note evaluation tools in colleges and schools of pharmacy.

PubMed

Sando, Karen R; Skoy, Elizabeth; Bradley, Courtney; Frenzel, Jeanne; Kirwin, Jennifer; Urteaga, Elizabeth

2017-07-01

To describe current methods used to assess SOAP notes in colleges and schools of pharmacy. Members of the American Association of Colleges of Pharmacy Laboratory Instructors Special Interest Group were invited to share assessment tools for SOAP notes. Content of submissions was evaluated to characterize overall qualities and how the tools assessed subjective, objective, assessment, and plan information. Thirty-nine assessment tools from 25 schools were evaluated. Twenty-nine (74%) of the tools were rubrics and ten (26%) were checklists. All rubrics included analytic scoring elements, while two (7%) were mixed with holistic and analytic scoring elements. A majority of the rubrics (35%) used a four-item rating scale. Substantial variability existed in how tools evaluated subjective and objective sections. All tools included problem identification in the assessment section. Other assessment items included goals (82%) and rationale (69%). Seventy-seven percent assessed drug therapy; however, only 33% assessed non-drug therapy. Other plan items included education (59%) and follow-up (90%). There is a great deal of variation in the specific elements used to evaluate SOAP notes in colleges and schools of pharmacy. Improved consistency in assessment methods to evaluate SOAP notes may better prepare students to produce standardized documentation when entering practice. Copyright © 2017 Elsevier Inc. All rights reserved.

A Delphi study assessing the utility of quality improvement tools and resources in Australian primary care.

PubMed

Upham, Susan J; Janamian, Tina; Crossland, Lisa; Jackson, Claire L

2016-04-18

To determine the relevance and utility of online tools and resources to support organisational performance development in primary care and to complement the Primary Care Practice Improvement Tool (PC-PIT). A purposively recruited Expert Advisory Panel of 12 end users used a modified Delphi technique to evaluate 53 tools and resources identified through a previously conducted systematic review. The panel comprised six practice managers and six general practitioners who had participated in the PC-PIT pilot study in 2013-2014. Tools and resources were reviewed in three rounds using a standard pre-tested assessment form. Recommendations, scores and reasons for recommending or rejecting each tool or resource were analysed to determine the final suite of tools and resources. The evaluation was conducted from November 2014 to August 2015. Recommended tools and resources scored highly (mean score, 16/20) in Rounds 1 and 2 of review (n = 25). These tools and resources were perceived to be easily used, useful to the practice and supportive of the PC-PIT. Rejected resources scored considerably lower (mean score, 5/20) and were noted to have limitations such as having no value to the practice and poor utility (n = 6). A final review (Round 3) of 28 resources resulted in a suite of 21 to support the elements of the PC-PIT. This suite of tools and resources offers one approach to supporting the quality improvement initiatives currently in development in primary care reform.

Quality Assessment of Medical Apps that Target Medication-Related Problems.

PubMed

Loy, John Shiguang; Ali, Eskinder Eshetu; Yap, Kevin Yi-Lwern

2016-10-01

The advent of smartphones has enabled a plethora of medical apps for disease management. As of 2012, there are 40,000 health care-related mobile apps available in the market. Since most of these medical apps do not go through any stringent quality assessment, there is a risk of consumers being misinformed or misled by unreliable information. In this regard, apps that target medication-related problems (MRPs) are not an exception. There is little information on what constitutes quality in apps that target MRPs and how good the existing apps are. To develop a quality assessment tool for evaluating apps that target MRPs and assess the quality of such apps available in the major mobile app stores (iTunes and Google Play). The top 100 free and paid apps in the medical categories of iTunes and Google Play stores (total of 400 apps) were screened for inclusion in the final analysis. English language apps that targeted MRPs were downloaded on test devices to evaluate their quality. Apps intended for clinicians, patients, or both were eligible for evaluation. The quality assessment tool consisted of 4 sections (appropriateness, reliability, usability, privacy), which determined the overall quality of the apps. Apps that fulfilled the inclusion criteria were classified based on the presence of any 1 or more of the 5 features considered important for apps targeting MRPs (monitoring, interaction checker, dose calculator, medication information, medication record). Descriptive statistics and Mann-Whitney tests were used for analysis. Final analysis was based on 59 apps that fulfilled the study inclusion criteria. Apps with interaction checker (66.9%) and monitoring features (54.8%) had the highest and lowest overall qualities. Paid apps generally scored higher for usability than free apps (P = 0.006) but lower for privacy (P = 0.003). Half of the interaction checker apps were unable to detect interactions with herbal medications. Blood pressure and heart rate monitoring apps had the highest overall quality scores (67.7%), while apps that monitored visual, hearing, and temperature changes scored the lowest (35.5%). A quality assessment tool for evaluating medical apps targeting MRPs has been developed. Clinicians can use this tool to guide their assessments of medical apps that are appropriate for use in the health care setting. Although potentially useful apps were identified, many apps were found to have deficiencies in quality, among which was poor reliability scores for most of the apps. Continued assessments of the quality of apps targeting MRPs are recommended to ensure their usefulness for clinicians and patients. No outside funding supported this study. The authors have no conflicts of interests directly related to this study. Study concept and design were contributed by Loy and Yap. Loy collected the data and took the lead in data interpretation, along with Ali and Yap. The manuscript was primarily written by Loy, along with Yap, and revised primarily by Ali, along with Yap.

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

PubMed

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p < 0.01). Its content validity was excellent (all-item content validity index = 0.79-1.00; scale validity index = 0.92). Evidence of its concurrent validity included strong correlation between the developed tool and Short Form 12 Health Survey (r = 0.734; p < 0.001), and participant scores on the developed tool explained ≈46.2% of the between-subject variation for the participant scores on Short Form 12 Health Survey (Nagelkerke R = 0.462). Confirming its construct validity, principal component analysis revealed that 2 factors explained 81.63% of the total variance found. Known-group analysis evidenced the ability of the questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

Relationship between structural features and water chemistry in boreal headwater streams--evaluation based on results from two water management survey tools suggested for Swedish forestry.

PubMed

Lestander, Ragna; Löfgren, Stefan; Henrikson, Lennart; Ågren, Anneli M

2015-04-01

Forestry may cause adverse impacts on water quality, and the forestry planning process is a key factor for the outcome of forest operation effects on stream water. To optimise environmental considerations and to identify actions needed to improve or maintain the stream biodiversity, two silvicultural water management tools, BIS+ (biodiversity, impact, sensitivity and added values) and Blue targeting, have been developed. In this study, we evaluate the links between survey variables, based on BIS+ and Blue targeting data, and water chemistry in 173 randomly selected headwater streams in the hemiboreal zone. While BIS+ and Blue targeting cannot replace more sophisticated monitoring methods necessary for classifying water quality in streams according to the EU Water Framework Directive (WFD, 2000/60/EC), our results lend support to the idea that the BIS+ protocol can be used to prioritise the protection of riparian forests. The relationship between BIS+ and water quality indicators (concentrations of nutrients and organic matter) together with data from fish studies suggests that this field protocol can be used to give reaches with higher biodiversity and conservation values a better protection. The tools indicate an ability to mitigate forestry impacts on water quality if the operations are adjusted to this knowledge in located areas.

An Evaluation Framework for Lossy Compression of Genome Sequencing Quality Values.

PubMed

Alberti, Claudio; Daniels, Noah; Hernaez, Mikel; Voges, Jan; Goldfeder, Rachel L; Hernandez-Lopez, Ana A; Mattavelli, Marco; Berger, Bonnie

2016-01-01

This paper provides the specification and an initial validation of an evaluation framework for the comparison of lossy compressors of genome sequencing quality values. The goal is to define reference data, test sets, tools and metrics that shall be used to evaluate the impact of lossy compression of quality values on human genome variant calling. The functionality of the framework is validated referring to two state-of-the-art genomic compressors. This work has been spurred by the current activity within the ISO/IEC SC29/WG11 technical committee (a.k.a. MPEG), which is investigating the possibility of starting a standardization activity for genomic information representation.

Higher-Order Factor Analysis as a Score Validity Evaluation Tool: An Example with a Measure of Perceptions of Library Service Quality.

ERIC Educational Resources Information Center

Cook, Colleen; Thompson, Bruce

The SERVQUAL measure was developed by A. Parasuraman, L. Berry, and V. Zeithaml (1988) to measure perceptions of service quality, originally in the retailing sector. However, libraries and other educational institutions are also service providers. Librarians in particular have increasingly become interested in measuring quality of service as the…

Data envelopment analysis in service quality evaluation: an empirical study

NASA Astrophysics Data System (ADS)

Najafi, Seyedvahid; Saati, Saber; Tavana, Madjid

2015-09-01

Service quality is often conceptualized as the comparison between service expectations and the actual performance perceptions. It enhances customer satisfaction, decreases customer defection, and promotes customer loyalty. Substantial literature has examined the concept of service quality, its dimensions, and measurement methods. We introduce the perceived service quality index (PSQI) as a single measure for evaluating the multiple-item service quality construct based on the SERVQUAL model. A slack-based measure (SBM) of efficiency with constant inputs is used to calculate the PSQI. In addition, a non-linear programming model based on the SBM is proposed to delineate an improvement guideline and improve service quality. An empirical study is conducted to assess the applicability of the method proposed in this study. A large number of studies have used DEA as a benchmarking tool to measure service quality. These models do not propose a coherent performance evaluation construct and consequently fail to deliver improvement guidelines for improving service quality. The DEA models proposed in this study are designed to evaluate and improve service quality within a comprehensive framework and without any dependency on external data.

Evaluating supplier quality performance using analytical hierarchy process

NASA Astrophysics Data System (ADS)

Kalimuthu Rajoo, Shanmugam Sundram; Kasim, Maznah Mat; Ahmad, Nazihah

2013-09-01

This paper elaborates the importance of evaluating supplier quality performance to an organization. Supplier quality performance evaluation reflects the actual performance of the supplier exhibited at customer's end. It is critical in enabling the organization to determine the area of improvement and thereafter works with supplier to close the gaps. Success of the customer partly depends on supplier's quality performance. Key criteria as quality, cost, delivery, technology support and customer service are categorized as main factors in contributing to supplier's quality performance. 18 suppliers' who were manufacturing automotive application parts evaluated in year 2010 using weight point system. There were few suppliers with common rating which led to common ranking observed by few suppliers'. Analytical Hierarchy Process (AHP), a user friendly decision making tool for complex and multi criteria problems was used to evaluate the supplier's quality performance challenging the weight point system that was used for 18 suppliers'. The consistency ratio was checked for criteria and sub-criteria. Final results of AHP obtained with no overlap ratings, therefore yielded a better decision making methodology as compared to weight point rating system.

THE ATMOSPHERIC MODEL EVALUATION (AMET): METEOROLOGY MODULE

EPA Science Inventory

An Atmospheric Model Evaluation Tool (AMET), composed of meteorological and air quality components, is being developed to examine the error and uncertainty in the model simulations. AMET matches observations with the corresponding model-estimated values in space and time, and the...

Communicative Access Measures for Stroke: Development and Evaluation of a Quality Improvement Tool.

PubMed

Kagan, Aura; Simmons-Mackie, Nina; Victor, J Charles; Chan, Melodie T

2017-11-01

To (1) develop a systems-level quality improvement tool targeting communicative access to information and decision-making for stroke patients with language disorders; and (2) evaluate the resulting tool-the Communicative Access Measures for Stroke (CAMS). Survey development and evaluation was in line with accepted guidelines and included item generation and reduction, survey formatting and composition, pretesting, pilot testing, and reliability assessment. Development and evaluation were carried out in hospital and community agency settings. The project used a convenience sample of 31 participants for the survey development, and 63 participants for the CAMS reliability study (broken down into 6 administrators/managers, 32 frontline staff, 25 participants with aphasia). Eligible participants invited to the reliability study included individuals from 45 community-based organizations in Ontario as well as 4400 individuals from communities of practice. Not applicable. Data were analyzed using kappa statistics and intraclass correlations for each item score on all surveys. A tool, the CAMS, comprising 3 surveys, was developed for health facilities from the perspectives of (1) administrators/policymakers, (2) staff/frontline health care providers, and (3) patients with aphasia (using a communicatively accessible version). Reliability for items on the CAMS-Administrator and CAMS-Staff surveys was moderate to high (kappa/intraclass correlation coefficients [ICCs], .54-1.00). As expected, reliability was lower for the CAMS-Patient survey, with most items having ICCs between 0.4 and 0.6. These findings suggest that CAMS may provide useful quality improvement information for health care facilities with an interest in improving care for patients with stroke and aphasia. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

An Overview of Atmospheric Chemistry and Air Quality Modeling

NASA Technical Reports Server (NTRS)

Johnson, Matthew S.

2017-01-01

This presentation will include my personal research experience and an overview of atmospheric chemistry and air quality modeling to the participants of the NASA Student Airborne Research Program (SARP 2017). The presentation will also provide examples on ways to apply airborne observations for chemical transport (CTM) and air quality (AQ) model evaluation. CTM and AQ models are important tools in understanding tropospheric-stratospheric composition, atmospheric chemistry processes, meteorology, and air quality. This presentation will focus on how NASA scientist currently apply CTM and AQ models to better understand these topics. Finally, the importance of airborne observation in evaluating these topics and how in situ and remote sensing observations can be used to evaluate and improve CTM and AQ model predictions will be highlighted.

rnaQUAST: a quality assessment tool for de novo transcriptome assemblies.

PubMed

Bushmanova, Elena; Antipov, Dmitry; Lapidus, Alla; Suvorov, Vladimir; Prjibelski, Andrey D

2016-07-15

Ability to generate large RNA-Seq datasets created a demand for both de novo and reference-based transcriptome assemblers. However, while many transcriptome assemblers are now available, there is still no unified quality assessment tool for RNA-Seq assemblies. We present rnaQUAST-a tool for evaluating RNA-Seq assembly quality and benchmarking transcriptome assemblers using reference genome and gene database. rnaQUAST calculates various metrics that demonstrate completeness and correctness levels of the assembled transcripts, and outputs them in a user-friendly report. rnaQUAST is implemented in Python and is freely available at http://bioinf.spbau.ru/en/rnaquast ap@bioinf.spbau.ru Supplementary data are available at Bioinformatics online. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Robotic tool positioning process using a multi-line off-axis laser triangulation sensor

NASA Astrophysics Data System (ADS)

Pinto, T. C.; Matos, G.

2018-03-01

Proper positioning of a friction stir welding head for pin insertion, driven by a closed chain robot, is important to ensure quality repair of cracks. A multi-line off-axis laser triangulation sensor was designed to be integrated to the robot, allowing relative measurements of the surface to be repaired. This work describes the sensor characteristics, its evaluation and the measurement process for tool positioning to a surface point of interest. The developed process uses a point of interest image and a measured point cloud to define the translation and rotation for tool positioning. Sensor evaluation and tests are described. Keywords: laser triangulation, 3D measurement, tool positioning, robotics.

Tools to Promote Shared Decision Making in Serious Illness: A Systematic Review.

PubMed

Austin, C Adrian; Mohottige, Dinushika; Sudore, Rebecca L; Smith, Alexander K; Hanson, Laura C

2015-07-01

Serious illness impairs function and threatens survival. Patients facing serious illness value shared decision making, yet few decision aids address the needs of this population. To perform a systematic review of evidence about decision aids and other exportable tools that promote shared decision making in serious illness, thereby (1) identifying tools relevant to the treatment decisions of seriously ill patients and their caregivers, (2) evaluating the quality of evidence for these tools, and (3) summarizing their effect on outcomes and accessibility for clinicians. We searched PubMed, CINAHL, and PsychInfo from January 1, 1995, through October 31, 2014, and identified additional studies from reference lists and other systematic reviews. Clinical trials with random or nonrandom controls were included if they tested print, video, or web-based tools for advance care planning (ACP) or decision aids for serious illness. We extracted data on the study population, design, results, and risk for bias using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criteria. Each tool was evaluated for its effect on patient outcomes and accessibility. Seventeen randomized clinical trials tested decision tools in serious illness. Nearly all the trials were of moderate or high quality and showed that decision tools improve patient knowledge and awareness of treatment choices. The available tools address ACP, palliative care and goals of care communication, feeding options in dementia, lung transplant in cystic fibrosis, and truth telling in terminal cancer. Five randomized clinical trials provided further evidence that decision tools improve ACP documentation, clinical decisions, and treatment received. Clinicians can access and use evidence-based tools to engage seriously ill patients in shared decision making. This field of research is in an early stage; future research is needed to develop novel decision aids for other serious diagnoses and key decisions. Health care delivery organizations should prioritize the use of currently available tools that are evidence based and effective.

Quality assessment of expert answers to lay questions about cystic fibrosis from various language zones in Europe: the ECORN-CF project.

PubMed

d'Alquen, Daniela; De Boeck, Kris; Bradley, Judy; Vávrová, Věra; Dembski, Birgit; Wagner, Thomas O F; Pfalz, Annette; Hebestreit, Helge

2012-02-06

The European Centres of Reference Network for Cystic Fibrosis (ECORN-CF) established an Internet forum which provides the opportunity for CF patients and other interested people to ask experts questions about CF in their mother language. The objectives of this study were to: 1) develop a detailed quality assessment tool to analyze quality of expert answers, 2) evaluate the intra- and inter-rater agreement of this tool, and 3) explore changes in the quality of expert answers over the time frame of the project. The quality assessment tool was developed by an expert panel. Five experts within the ECORN-CF project used the quality assessment tool to analyze the quality of 108 expert answers published on ECORN-CF from six language zones. 25 expert answers were scored at two time points, one year apart. Quality of answers was also assessed at an early and later period of the project. Individual rater scores and group mean scores were analyzed for each expert answer. A scoring system and training manual were developed analyzing two quality categories of answers: content and formal quality. For content quality, the grades based on group mean scores for all raters showed substantial agreement between two time points, however this was not the case for the grades based on individual rater scores. For formal quality the grades based on group mean scores showed only slight agreement between two time points and there was also poor agreement between time points for the individual grades. The inter-rater agreement for content quality was fair (mean kappa value 0.232 ± 0.036, p < 0.001) while only slight agreement was observed for the grades of the formal quality (mean kappa value 0.105 ± 0.024, p < 0.001). The quality of expert answers was rated high (four language zones) or satisfactory (two language zones) and did not change over time. The quality assessment tool described in this study was feasible and reliable when content quality was assessed by a group of raters. Within ECORN-CF, the tool will help ensure that CF patients all over Europe have equal possibility of access to high quality expert advice on their illness. © 2012 d’Alquen et al; licensee BioMed Central Ltd.

Complex Networks Analysis of Manual and Machine Translations

NASA Astrophysics Data System (ADS)

Amancio, Diego R.; Antiqueira, Lucas; Pardo, Thiago A. S.; da F. Costa, Luciano; Oliveira, Osvaldo N.; Nunes, Maria G. V.

Complex networks have been increasingly used in text analysis, including in connection with natural language processing tools, as important text features appear to be captured by the topology and dynamics of the networks. Following previous works that apply complex networks concepts to text quality measurement, summary evaluation, and author characterization, we now focus on machine translation (MT). In this paper we assess the possible representation of texts as complex networks to evaluate cross-linguistic issues inherent in manual and machine translation. We show that different quality translations generated by MT tools can be distinguished from their manual counterparts by means of metrics such as in- (ID) and out-degrees (OD), clustering coefficient (CC), and shortest paths (SP). For instance, we demonstrate that the average OD in networks of automatic translations consistently exceeds the values obtained for manual ones, and that the CC values of source texts are not preserved for manual translations, but are for good automatic translations. This probably reflects the text rearrangements humans perform during manual translation. We envisage that such findings could lead to better MT tools and automatic evaluation metrics.

How to Assess the External Validity and Model Validity of Therapeutic Trials: A Conceptual Approach to Systematic Review Methodology

PubMed Central

2014-01-01

Background. Evidence rankings do not consider equally internal (IV), external (EV), and model validity (MV) for clinical studies including complementary and alternative medicine/integrative medicine (CAM/IM) research. This paper describe this model and offers an EV assessment tool (EVAT©) for weighing studies according to EV and MV in addition to IV. Methods. An abbreviated systematic review methodology was employed to search, assemble, and evaluate the literature that has been published on EV/MV criteria. Standard databases were searched for keywords relating to EV, MV, and bias-scoring from inception to Jan 2013. Tools identified and concepts described were pooled to assemble a robust tool for evaluating these quality criteria. Results. This study assembled a streamlined, objective tool to incorporate for the evaluation of quality of EV/MV research that is more sensitive to CAM/IM research. Conclusion. Improved reporting on EV can help produce and provide information that will help guide policy makers, public health researchers, and other scientists in their selection, development, and improvement in their research-tested intervention. Overall, clinical studies with high EV have the potential to provide the most useful information about “real-world” consequences of health interventions. It is hoped that this novel tool which considers IV, EV, and MV on equal footing will better guide clinical decision making. PMID:24734111

Application of Quality Management Tools for Evaluating the Failure Frequency of Cutter-Loader and Plough Mining Systems

NASA Astrophysics Data System (ADS)

Biały, Witold

2017-06-01

Failure frequency in the mining process, with a focus on the mining machine, has been presented and illustrated by the example of two coal-mines. Two mining systems have been subjected to analysis: a cutter-loader and a plough system. In order to reduce costs generated by failures, maintenance teams should regularly make sure that the machines are used and operated in a rational and effective way. Such activities will allow downtimes to be reduced, and, in consequence, will increase the effectiveness of a mining plant. The evaluation of mining machines' failure frequency contained in this study has been based on one of the traditional quality management tools - the Pareto chart.

a Free and Open Source Tool to Assess the Accuracy of Land Cover Maps: Implementation and Application to Lombardy Region (italy)

NASA Astrophysics Data System (ADS)

Bratic, G.; Brovelli, M. A.; Molinari, M. E.

2018-04-01

The availability of thematic maps has significantly increased over the last few years. Validation of these maps is a key factor in assessing their suitability for different applications. The evaluation of the accuracy of classified data is carried out through a comparison with a reference dataset and the generation of a confusion matrix from which many quality indexes can be derived. In this work, an ad hoc free and open source Python tool was implemented to automatically compute all the matrix confusion-derived accuracy indexes proposed by literature. The tool was integrated into GRASS GIS environment and successfully applied to evaluate the quality of three high-resolution global datasets (GlobeLand30, Global Urban Footprint, Global Human Settlement Layer Built-Up Grid) in the Lombardy Region area (Italy). In addition to the most commonly used accuracy measures, e.g. overall accuracy and Kappa, the tool allowed to compute and investigate less known indexes such as the Ground Truth and the Classification Success Index. The promising tool will be further extended with spatial autocorrelation analysis functions and made available to researcher and user community.

Contemporary health care economics: an overview.

PubMed

McLaughlin, Nancy; Ong, Michael K; Tabbush, Victor; Hagigi, Farhad; Martin, Neil A

2014-11-01

Economic evaluations provide a decision-making framework in which outcomes (benefits) and costs are assessed for various alternative options. Although the interest in complete and partial economic evaluations has increased over the past 2 decades, the quality of studies has been marginal due to methodological challenges or incomplete cost determination. This paper provides an overview of the main types of complete and partial economic evaluations, reviews key methodological elements to be considered for any economic evaluation, and reviews concepts of cost determination. The goal is to provide the clinician neurosurgeon with the knowledge and tools needed to appraise published economic evaluations and to direct high-quality health economic evaluations.

Evaluating supplier quality performance using fuzzy analytical hierarchy process

NASA Astrophysics Data System (ADS)

Ahmad, Nazihah; Kasim, Maznah Mat; Rajoo, Shanmugam Sundram Kalimuthu

2014-12-01

Evaluating supplier quality performance is vital in ensuring continuous supply chain improvement, reducing the operational costs and risks towards meeting customer's expectation. This paper aims to illustrate an application of Fuzzy Analytical Hierarchy Process to prioritize the evaluation criteria in a context of automotive manufacturing in Malaysia. Five main criteria were identified which were quality, cost, delivery, customer serviceand technology support. These criteria had been arranged into hierarchical structure and evaluated by an expert. The relative importance of each criteria was determined by using linguistic variables which were represented as triangular fuzzy numbers. The Center of Gravity defuzzification method was used to convert the fuzzy evaluations into their corresponding crisps values. Such fuzzy evaluation can be used as a systematic tool to overcome the uncertainty evaluation of suppliers' performance which usually associated with human being subjective judgments.

Zoom Reconstruction Tool: Evaluation of Image Quality and Influence on the Diagnosis of Root Fracture.

PubMed

Queiroz, Polyane Mazucatto; Santaella, Gustavo Machado; Capelozza, Ana Lúcia Alvares; Rosalen, Pedro Luiz; Freitas, Deborah Queiroz; Haiter-Neto, Francisco

2018-04-01

This study evaluated the image quality and the diagnosis of root fractures when using the Zoom Reconstruction tool (J Morita, Kyoto, Japan). A utility wax phantom with a metal sample inside was used for objective evaluation, and a mandible with 27 single-rooted teeth (with and without obturation and with and without vertical or horizontal fractures) was used for diagnostic evaluation. The images were acquired in 3 protocols: protocol 1, field of view (FOV) of 4 × 4 cm and a voxel size of 0.08 mm; protocol 2, FOV of 10 × 10 cm and a voxel size of 0.2 mm; and protocol 3, Zoom Reconstruction of images from protocol 2 (FOV of 4 × 4 cm and a voxel size of 0.08 mm). The objective evaluation was achieved by measuring the image noise, and the diagnosis of fractures was performed by 3 evaluators. The area under the receiver operating characteristic curve was used to calculate accuracy, and analysis of variance compared the accuracy and image quality of the protocols. Regarding quality, protocol 1 was superior to protocol 2 (P < .0001) and Zoom Reconstruction (P < .0001). Additionally, images of protocol 2 presented less noise than the Zoom Reconstruction image (P < .0001); however, for diagnosis, Zoom Reconstruction was superior in relation to protocol 2 (P = .011) and did not differ from protocol 1 (P = .228) for the diagnosis of a vertical root fracture in filled teeth. The Zoom Reconstruction tool allows better accuracy for vertical root fracture detection in filled teeth, making it possible to obtain a higher-resolution image from a lower-resolution examination without having to expose the patient to more radiation. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Finding the State Story in the National Lake Survey Data with an Excel Exploratory Tool

EPA Science Inventory

The National Lakes Assessment (NLA) surveyed over 1200 U.S. lakes in the summer of 2007, evaluating lake quality based on water quality, physical habitat, and indicators of biological and recreational condition. An upcoming national report will summarize survey results primarily ...

Using NEXRAD and Rain Gauge Precipitation Data for Hydrologic Calibration of SWAT in a Northeastern Watershed

USDA-ARS?s Scientific Manuscript database

The value of watershed-scale, hydrologic/water quality models to ecosystem management is increasingly evident as more programs adopt these tools to evaluate the effectiveness of different management scenarios and their impact on the environment. Quality of precipitation data is critical for appropri...

Developing a Mathematics Education Quality Scale

ERIC Educational Resources Information Center

Ciftci, S. Koza; Karadag, Engin

2016-01-01

The aim of this study was to evaluate students' perceptions of the quality of mathematics education and to develop a reliable and valid measurement tool. The research was conducted with 638 (first study) and 407 (second study) secondary school students in Eskisehir, Turkey. Item discrimination, structural validity (exploratory factor analysis and…

EQuIP-ped for Success

ERIC Educational Resources Information Center

Ewing, Molly

2015-01-01

The Educators Evaluating the Quality of Instructional Products (EQuIP) Rubric for science is a new tool for science educators that provides criteria by which to examine the alignment and overall quality of lessons and units with respect to the "Next Generation Science Standards" ("NGSS"). The rubric criteria are divided into…

Spatial and temporal variation of fecal indicator organisms in two creeks in Beltsville, Maryland

USDA-ARS?s Scientific Manuscript database

Evaluation of microbial water quality is commonly achieved by monitoring populations of indicator bacteria such as E. coli and enterococci. Monitoring data are utilized by water managers to predict potential fecal contaminations as well as a decision tool to improve microbial water quality. Both te...

Soil quality evaluation using Soil Management Assessment Framework (SMAF) in Brazilian oxisols with contrasting texture

USDA-ARS?s Scientific Manuscript database

To ensure current land use strategies and management practices are economically, environmentally, and socially sustainable, tools and techniques for assessing and quantifying changes in soil quality/health (SQ) need to be developed through rigorous research and potential use by consultants, and othe...

SUSTAIN – A Framework for Placement of Best Management Practices in Urban Watersheds to Protect Water Quality

EPA Science Inventory

Watershed and stormwater managers need modeling tools to evaluate alternative plans for water quality management and flow abatement techniques in urban and developing areas. A watershed-scale, decision-support framework that is based on cost optimization is needed to support gov...

A semi-automated tool for treatment plan-quality evaluation and clinical trial quality assurance

NASA Astrophysics Data System (ADS)

Wang, Jiazhou; Chen, Wenzhou; Studenski, Matthew; Cui, Yunfeng; Lee, Andrew J.; Xiao, Ying

2013-07-01

The goal of this work is to develop a plan-quality evaluation program for clinical routine and multi-institutional clinical trials so that the overall evaluation efficiency is improved. In multi-institutional clinical trials evaluating the plan quality is a time-consuming and labor-intensive process. In this note, we present a semi-automated plan-quality evaluation program which combines MIMVista, Java/MATLAB, and extensible markup language (XML). More specifically, MIMVista is used for data visualization; Java and its powerful function library are implemented for calculating dosimetry parameters; and to improve the clarity of the index definitions, XML is applied. The accuracy and the efficiency of the program were evaluated by comparing the results of the program with the manually recorded results in two RTOG trials. A slight difference of about 0.2% in volume or 0.6 Gy in dose between the semi-automated program and manual recording was observed. According to the criteria of indices, there are minimal differences between the two methods. The evaluation time is reduced from 10-20 min to 2 min by applying the semi-automated plan-quality evaluation program.

PET-Tool: a software suite for comprehensive processing and managing of Paired-End diTag (PET) sequence data.

PubMed

Chiu, Kuo Ping; Wong, Chee-Hong; Chen, Qiongyu; Ariyaratne, Pramila; Ooi, Hong Sain; Wei, Chia-Lin; Sung, Wing-Kin Ken; Ruan, Yijun

2006-08-25

We recently developed the Paired End diTag (PET) strategy for efficient characterization of mammalian transcriptomes and genomes. The paired end nature of short PET sequences derived from long DNA fragments raised a new set of bioinformatics challenges, including how to extract PETs from raw sequence reads, and correctly yet efficiently map PETs to reference genome sequences. To accommodate and streamline data analysis of the large volume PET sequences generated from each PET experiment, an automated PET data process pipeline is desirable. We designed an integrated computation program package, PET-Tool, to automatically process PET sequences and map them to the genome sequences. The Tool was implemented as a web-based application composed of four modules: the Extractor module for PET extraction; the Examiner module for analytic evaluation of PET sequence quality; the Mapper module for locating PET sequences in the genome sequences; and the Project Manager module for data organization. The performance of PET-Tool was evaluated through the analyses of 2.7 million PET sequences. It was demonstrated that PET-Tool is accurate and efficient in extracting PET sequences and removing artifacts from large volume dataset. Using optimized mapping criteria, over 70% of quality PET sequences were mapped specifically to the genome sequences. With a 2.4 GHz LINUX machine, it takes approximately six hours to process one million PETs from extraction to mapping. The speed, accuracy, and comprehensiveness have proved that PET-Tool is an important and useful component in PET experiments, and can be extended to accommodate other related analyses of paired-end sequences. The Tool also provides user-friendly functions for data quality check and system for multi-layer data management.

MedAd-AppQ: A quality assessment tool for medication adherence apps on iOS and android platforms.

PubMed

Ali, Eskinder Eshetu; Teo, Amanda Kai Sin; Goh, Sherlyn Xue Lin; Chew, Lita; Yap, Kevin Yi-Lwern

2018-02-02

With the recent proliferation of smartphone medication adherence applications (apps), it is increasingly more difficult for patients and clinicians to identify the most useful app. To develop a quality assessment tool for medication adherence apps, and evaluate the quality of such apps from the major app stores. In this study, a Medication Adherence App Quality assessment tool (MedAd-AppQ) was developed and two evaluators independently assessed apps that fulfilled the following criteria: availability in English, had at least a medication reminder feature, non-specific to certain disease conditions (generic apps), free of technical malfunctions and availability on both the iPhone Operating System (iOS) and Android platforms. Descriptive statistics, Mann-Whitney U test, Pearson product moment correlation and Spearman rank-order correlation were used for statistical analysis. MedAd-AppQ was designed to have 24 items (total 43 points) categorized under three sections: content reliability (11 points), feature usefulness (29 points) and feature convenience (3 points). The three sections of MedAd-AppQ were found to have inter-rater correlation coefficients of 0.801 (p-value < .001) or higher. Based on analysis of 52 apps (27 iOS and 25 Android), quality scores ranged between 7/43 (16.3%) and 28/43 (65.1%). There was no significant difference between the quality scores of the Android and iOS versions. None of the apps had features for self-management of side effects. Only two apps in each platform provided disease-related and/or medication information. MedAd-AppQ can be used to reliably assess the quality of adherence apps. Clinicians can use the tool in selecting apps for use by patients. Developers of adherence apps should consider features that provide therapy-related information and help patients in medications and side-effects management. Copyright © 2018 Elsevier Inc. All rights reserved.

Simulation techniques in hyperthermia treatment planning

PubMed Central

Paulides, MM; Stauffer, PR; Neufeld, E; Maccarini, P; Kyriakou, A; Canters, RAM; Diederich, C; Bakker, JF; Van Rhoon, GC

2013-01-01

Clinical trials have shown that hyperthermia (HT), i.e. an increase of tissue temperature to 39-44°C, significantly enhance radiotherapy and chemotherapy effectiveness (1). Driven by the developments in computational techniques and computing power, personalized hyperthermia treatment planning (HTP) has matured and has become a powerful tool for optimizing treatment quality. Electromagnetic, ultrasound, and thermal simulations using realistic clinical setups are now being performed to achieve patient-specific treatment optimization. In addition, extensive studies aimed to properly implement novel HT tools and techniques, and to assess the quality of HT, are becoming more common. In this paper, we review the simulation tools and techniques developed for clinical hyperthermia, and evaluate their current status on the path from “model” to “clinic”. In addition, we illustrate the major techniques employed for validation and optimization. HTP has become an essential tool for improvement, control, and assessment of HT treatment quality. As such, it plays a pivotal role in the quest to establish HT as an efficacious addition to multi-modality treatment of cancer. PMID:23672453

Clinical Evaluation of Baccalaureate Nursing Students Using SBAR Format: Faculty versus Self Evaluation

ERIC Educational Resources Information Center

Saied, Hala; James, Joemol; Singh, Evangelin Jeya; Al Humaied, Lulawah

2016-01-01

Clinical training is of paramount importance in nursing education and clinical evaluation is one of the most challenging responsibilities of nursing faculty. The use of objective tools and criteria and involvement of the students in the evaluation process are some techniques to facilitate quality learning in the clinical setting. Aim: The aim of…

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study.

PubMed

de Leeuw, Robert Adrianus; Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-04-26

The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. ©Robert Adrianus de Leeuw, Kieran Walsh, Michiel Westerman, Fedde Scheele. Originally published in JMIR Medical Education (http://mededu.jmir.org), 26.04.2018.

Innovative Training for Occupational Health and Infection Control Workplace Assessment in Health Care

ERIC Educational Resources Information Center

O'Hara, Lyndsay; Bryce, Elizabeth Ann; Scharf, Sydney; Yassi, Annalee

2012-01-01

A user-friendly, high quality workplace assessment field guide and an accompanying worksheet are invaluable tools for recognizing hazards in the hospital environment. These tools ensure that both front line workers as well as health and safety and infection control professionals can systematically evaluate hazards and formulate recommendations.…

Systematic Documentation: Structures and Tools in a Practice of Communicative Documentation

ERIC Educational Resources Information Center

Alnervik, Karin

2018-01-01

Swedish preschool teachers must systematically document activities in the preschool in order to evaluate the quality of these activities. Pedagogical documentation is one form of documentation that is proposed. The aim of this article is to discuss and create knowledge of structures and tools based on different communicative aspects of pedagogical…

The Course Improvement Flowchart: A Description of a Tool and Process for the Evaluation of University Teaching

ERIC Educational Resources Information Center

Morgan, Philip

2008-01-01

The use of evaluation to examine and improve the quality of teaching and courses is now a component of most universities. However, despite the various methods and opportunities for evaluation, a lack of understanding of the processes, measures and value are some of the major impediments to effective evaluation. Evaluation requires an understanding…

Improving the quality of EHR recording in primary care: a data quality feedback tool.

PubMed

van der Bij, Sjoukje; Khan, Nasra; Ten Veen, Petra; de Bakker, Dinny H; Verheij, Robert A

2017-01-01

Electronic health record (EHR) data are used to exchange information among health care providers. For this purpose, the quality of the data is essential. We developed a data quality feedback tool that evaluates differences in EHR data quality among practices and software packages as part of a larger intervention. The tool was applied in 92 practices in the Netherlands using different software packages. Practices received data quality feedback in 2010 and 2012. We observed large differences in the quality of recording. For example, the percentage of episodes of care that had a meaningful diagnostic code ranged from 30% to 100%. Differences were highly related to the software package. A year after the first measurement, the quality of recording had improved significantly and differences decreased, with 67% of the physicians indicating that they had actively changed their recording habits based on the results of the first measurement. About 80% found the feedback helpful in pinpointing recording problems. One of the software vendors made changes in functionality as a result of the feedback. Our EHR data quality feedback tool is capable of highlighting differences among practices and software packages. As such, it also stimulates improvements. As substantial variability in recording is related to the software package, our study strengthens the evidence that data quality can be improved substantially by standardizing the functionalities of EHR software packages. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Dental Students' Use of AMSTAR to Critically Appraise Systematic Reviews.

PubMed

Teich, Sorin T; Heima, Masahiro; Lang, Lisa

2015-09-01

The idea of basing clinical procedures upon evidence gathered by observation is less than 200 years old, with the first set of evidence-based position papers dating back only to the early 1970s. The relationship between evidence-based education and health outcomes is difficult to test and may be indirect, but teaching critical appraisal skills may be beneficial in developing knowledge. Systematic reviews have a central role in the process of clinical decision making in practice and therefore should be of high quality, following a rigorous protocol that can be evaluated with validated tools. The aim of this study was to assess how dental students utilized the Assessment of Multiple Systematic Reviews (AMSTAR) appraisal tool to evaluate systematic reviews in the context of a treatment planning course. During the in-class final exam, students were required to appraise the quality of a systematic review and to justify their answers. Of the 74 third-year students who took the exam, 100% answered all questions on the AMSTAR form. The mean number of correct answers was nine (SD=1.047, Min=6, Max=10), with no student providing all 11 correct answers. The fact that nearly 90% of the students provided eight or more correct answers suggests that AMSTAR can be used by students to evaluate the methodological quality of systematic reviews. It also was evident that although the AMSTAR tool requires less than 15 minutes to complete an evaluation, using it requires extensive training and repetition to achieve consistent and reliable results.

Measurement tools of resource use and quality of life in clinical trials for dementia or cognitive impairment interventions: protocol for a scoping review.

PubMed

Yang, Fan; Dawes, Piers; Leroi, Iracema; Gannon, Brenda

2017-01-26

Dementia and cognitive impairment could severely impact patients' life and bring heavy burden to patients, caregivers and societies. Some interventions are suggested for the older patients with these conditions to help them live well, but economic evaluation is needed to assess the cost-effectiveness of these interventions. Trial-based economic evaluation is an ideal method; however, little is known about the tools used to collect data of resource use and quality of life alongside the trials. Therefore, the aim of this review is to identify and describe the resource use and quality of life instruments in clinical trials of interventions for older patients with dementia or cognitive impairment. We will perform a search in main electronic databases (Ovid MEDLINE, PsycINFO, EMBASE, CINAHL, Cochrane Databases of Systematic Reviews, Web of Science and Scopus) using the key terms or their synonyms: older, dementia, cognitive impairment, cost, quality of life, intervention and tools. After removing duplicates, two independent reviewers will screen each entry for eligibility, initially by title and abstract, then by full-text. A hand search of the references of included articles and general search, e.g. Google Scholar, will also be conducted to identify potential relevant studies. All disagreements will be resolved by discussion or consultation with a third reviewer if necessary. Data analysis will be completed and reported in a narrative review. This review will identify the instruments used in clinical trials to collect resource use and quality of life data for dementia or cognitive impairment interventions. This will help to guide the study design of future trial-based economic evaluation of these interventions. PROSPERO CRD42016038495.

Reporting of Systematic Reviews of Micronutrients and Health: A Critical Appraisal

USDA-ARS?s Scientific Manuscript database

Context: Systematic review is a valuable tool for evaluating nutrition-related research and formulating nutrition recommendation. Lack of standardized criteria for generating these reviews has restricted their potential utility. Objective: To evaluate the characteristics and reporting quality of pub...

[Evaluation of the quality of clinical practice guidelines published in the Annales de Biologie Clinique with the help of the EFLM checklist].

PubMed

Wils, Julien; Fonfrède, Michèle; Augereau, Christine; Watine, Joseph

2014-01-01

Several tools are available to help evaluate the quality of clinical practice guidelines (CPG). The AGREE instrument (Appraisal of guidelines for research & evaluation) is the most consensual tool but it has been designed to assess CPG methodology only. The European federation of laboratory medicine (EFLM) recently designed a check-list dedicated to laboratory medicine which is supposed to be comprehensive and which therefore makes it possible to evaluate more thoroughly the quality of CPG in laboratory medicine. In the present work we test the comprehensiveness of this check-list on a sample of CPG written in French and published in Annales de biologie clinique (ABC). Thus we show that some work remains to be achieved before a truly comprehensive check-list is designed. We also show that there is some room for improvement for the CPG published in ABC, for example regarding the fact that some of these CPG do not provide any information about allowed durations of transport and of storage of biological samples before analysis, or about standards of minimal analytical performance, or about the sensitivities or the specificities of the recommended tests.

Applications of hyperspectral imaging in chicken meat safety and quality detection and evaluation: a review.

PubMed

Xiong, Zhenjie; Xie, Anguo; Sun, Da-Wen; Zeng, Xin-An; Liu, Dan

2015-01-01

Currently, the issue of food safety and quality is a great public concern. In order to satisfy the demands of consumers and obtain superior food qualities, non-destructive and fast methods are required for quality evaluation. As one of these methods, hyperspectral imaging (HSI) technique has emerged as a smart and promising analytical tool for quality evaluation purposes and has attracted much interest in non-destructive analysis of different food products. With the main advantage of combining both spectroscopy technique and imaging technique, HSI technique shows a convinced attitude to detect and evaluate chicken meat quality objectively. Moreover, developing a quality evaluation system based on HSI technology would bring economic benefits to the chicken meat industry. Therefore, in recent years, many studies have been conducted on using HSI technology for the safety and quality detection and evaluation of chicken meat. The aim of this review is thus to give a detailed overview about HSI and focus on the recently developed methods exerted in HSI technology developed for microbiological spoilage detection and quality classification of chicken meat. Moreover, the usefulness of HSI technique for detecting fecal contamination and bone fragments of chicken carcasses are presented. Finally, some viewpoints on its future research and applicability in the modern poultry industry are proposed.

English and Spanish oral cancer information on the internet: a pilot surface quality and content evaluation of oral cancer web sites.

PubMed

Irwin, Jeannie Y; Thyvalikakath, Thankam; Spallek, Heiko; Wali, Teena; Kerr, Alexander Ross; Schleyer, Titus

2011-01-01

Oral and pharyngeal cancers are responsible for over 7600 deaths each year in the United States. Given the significance of the disease and the fact that many individuals increasingly rely on health information on the Internet, it is important that patients and others can access clear and accurate oral cancer information on the Web. The objective of this study was threefold: (a) develop an initial method to evaluate surface and content quality of selected English- and Spanish-language oral cancer Web sites; (b) conduct a pilot evaluation; and (c) discuss implications of our findings for dental public health. We developed a search strategy to find oral cancer sites frequented by the public using Medline Plus, Google, and Yahoo in English and Spanish. We adapted the Information Quality Tool (IQT) to perform a surface evaluation and developed a novel tool to evaluate site content for 24 sites each in English and Spanish. English-language sites had an average IQT score of 76.6 (out of 100) and an average content score of 52.1 (out of 100). Spanish-language sites had an average IQT score of 50.3 and an average content score of 25.6. The study produced a quality assessment of oral cancer Web sites useful for clinicians and patients. Sites provided more information on clinical presentation, and etiology, and risk factors, than other aspects of oral cancer. The surface and quality of Spanish-language sites was low, possibly putting Hispanic populations at a disadvantage regarding oral cancer information on the Web.

Evaluation of automatic image quality assessment in chest CT - A human cadaver study.

PubMed

Franck, Caro; De Crop, An; De Roo, Bieke; Smeets, Peter; Vergauwen, Merel; Dewaele, Tom; Van Borsel, Mathias; Achten, Eric; Van Hoof, Tom; Bacher, Klaus

2017-04-01

The evaluation of clinical image quality (IQ) is important to optimize CT protocols and to keep patient doses as low as reasonably achievable. Considering the significant amount of effort needed for human observer studies, automatic IQ tools are a promising alternative. The purpose of this study was to evaluate automatic IQ assessment in chest CT using Thiel embalmed cadavers. Chest CT's of Thiel embalmed cadavers were acquired at different exposures. Clinical IQ was determined by performing a visual grading analysis. Physical-technical IQ (noise, contrast-to-noise and contrast-detail) was assessed in a Catphan phantom. Soft and sharp reconstructions were made with filtered back projection and two strengths of iterative reconstruction. In addition to the classical IQ metrics, an automatic algorithm was used to calculate image quality scores (IQs). To be able to compare datasets reconstructed with different kernels, the IQs values were normalized. Good correlations were found between IQs and the measured physical-technical image quality: noise (ρ=-1.00), contrast-to-noise (ρ=1.00) and contrast-detail (ρ=0.96). The correlation coefficients between IQs and the observed clinical image quality of soft and sharp reconstructions were 0.88 and 0.93, respectively. The automatic scoring algorithm is a promising tool for the evaluation of thoracic CT scans in daily clinical practice. It allows monitoring of the image quality of a chest protocol over time, without human intervention. Different reconstruction kernels can be compared after normalization of the IQs. Copyright © 2017 Associazione Italiana di Fisica Medica. Published by Elsevier Ltd. All rights reserved.

A Procedure for High Resolution Satellite Imagery Quality Assessment

PubMed Central

Crespi, Mattia; De Vendictis, Laura

2009-01-01

Data products generated from High Resolution Satellite Imagery (HRSI) are routinely evaluated during the so-called in-orbit test period, in order to verify if their quality fits the desired features and, if necessary, to obtain the image correction parameters to be used at the ground processing center. Nevertheless, it is often useful to have tools to evaluate image quality also at the final user level. Image quality is defined by some parameters, such as the radiometric resolution and its accuracy, represented by the noise level, and the geometric resolution and sharpness, described by the Modulation Transfer Function (MTF). This paper proposes a procedure to evaluate these image quality parameters; the procedure was implemented in a suitable software and tested on high resolution imagery acquired by the QuickBird, WorldView-1 and Cartosat-1 satellites. PMID:22412312

Evaluation of air quality in a megacity using statistics tools

NASA Astrophysics Data System (ADS)

Ventura, Luciana Maria Baptista; de Oliveira Pinto, Fellipe; Soares, Laiza Molezon; Luna, Aderval Severino; Gioda, Adriana

2018-06-01

Local physical characteristics (e.g., meteorology and topography) associate to particle concentrations are important to evaluate air quality in a region. Meteorology and topography affect air pollutant dispersions. This study used statistics tools (PCA, HCA, Kruskal-Wallis, Mann-Whitney's test and others) to a better understanding of the relationship between fine particulate matter (PM2.5) levels and seasons, meteorological conditions and air basins. To our knowledge, it is one of the few studies performed in Latin America involving all parameters together. PM2.5 samples were collected in six sampling sites with different emission sources (industrial, vehicular, soil dust) in Rio de Janeiro, Brazil. The PM2.5 daily concentrations ranged from 1 to 61 µg m-3, with averages higher than the annual limit (15 µg m-3) for some of the sites. The results of the statistics evaluation showed that PM2.5 concentrations were not influenced by seasonality. Furthermore, air basins defined previously were not confirmed, because some sites presented similar emission sources. Therefore, new redefinitions of air basins need to be done, once they are important to air quality management.

Evaluation of air quality in a megacity using statistics tools

NASA Astrophysics Data System (ADS)

Ventura, Luciana Maria Baptista; de Oliveira Pinto, Fellipe; Soares, Laiza Molezon; Luna, Aderval Severino; Gioda, Adriana

2017-03-01

Local physical characteristics (e.g., meteorology and topography) associate to particle concentrations are important to evaluate air quality in a region. Meteorology and topography affect air pollutant dispersions. This study used statistics tools (PCA, HCA, Kruskal-Wallis, Mann-Whitney's test and others) to a better understanding of the relationship between fine particulate matter (PM2.5) levels and seasons, meteorological conditions and air basins. To our knowledge, it is one of the few studies performed in Latin America involving all parameters together. PM2.5 samples were collected in six sampling sites with different emission sources (industrial, vehicular, soil dust) in Rio de Janeiro, Brazil. The PM2.5 daily concentrations ranged from 1 to 61 µg m-3, with averages higher than the annual limit (15 µg m-3) for some of the sites. The results of the statistics evaluation showed that PM2.5 concentrations were not influenced by seasonality. Furthermore, air basins defined previously were not confirmed, because some sites presented similar emission sources. Therefore, new redefinitions of air basins need to be done, once they are important to air quality management.

Intelligent Monitoring? Assessing the ability of the Care Quality Commission's statistical surveillance tool to predict quality and prioritise NHS hospital inspections.

PubMed

Griffiths, Alex; Beaussier, Anne-Laure; Demeritt, David; Rothstein, Henry

2017-02-01

The Care Quality Commission (CQC) is responsible for ensuring the quality of the health and social care delivered by more than 30 000 registered providers in England. With only limited resources for conducting on-site inspections, the CQC has used statistical surveillance tools to help it identify which providers it should prioritise for inspection. In the face of planned funding cuts, the CQC plans to put more reliance on statistical surveillance tools to assess risks to quality and prioritise inspections accordingly. To evaluate the ability of the CQC's latest surveillance tool, Intelligent Monitoring (IM), to predict the quality of care provided by National Health Service (NHS) hospital trusts so that those at greatest risk of providing poor-quality care can be identified and targeted for inspection. The predictive ability of the IM tool is evaluated through regression analyses and χ 2 testing of the relationship between the quantitative risk score generated by the IM tool and the subsequent quality rating awarded following detailed on-site inspection by large expert teams of inspectors. First, the continuous risk scores generated by the CQC's IM statistical surveillance tool cannot predict inspection-based quality ratings of NHS hospital trusts (OR 0.38 (0.14 to 1.05) for Outstanding/Good, OR 0.94 (0.80 to -1.10) for Good/Requires improvement, and OR 0.90 (0.76 to 1.07) for Requires improvement/Inadequate). Second, the risk scores cannot be used more simply to distinguish the trusts performing poorly-those subsequently rated either 'Requires improvement' or 'Inadequate'-from the trusts performing well-those subsequently rated either 'Good' or 'Outstanding' (OR 1.07 (0.91 to 1.26)). Classifying CQC's risk bandings 1-3 as high risk and 4-6 as low risk, 11 of the high risk trusts were performing well and 43 of the low risk trusts were performing poorly, resulting in an overall accuracy rate of 47.6%. Third, the risk scores cannot be used even more simply to distinguish the worst performing trusts-those subsequently rated 'Inadequate'-from the remaining, better performing trusts (OR 1.11 (0.94 to 1.32)). Classifying CQC's risk banding 1 as high risk and 2-6 as low risk, the highest overall accuracy rate of 72.8% was achieved, but still only 6 of the 13 Inadequate trusts were correctly classified as being high risk. Since the IM statistical surveillance tool cannot predict the outcome of NHS hospital trust inspections, it cannot be used for prioritisation. A new approach to inspection planning is therefore required. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Quality and reporting of diagnostic accuracy studies in TB, HIV and malaria: evaluation using QUADAS and STARD standards.

PubMed

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-11-13

Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004-2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases.

Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards

PubMed Central

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-01-01

Background Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. Methods We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004–2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Findings Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Conclusion Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases. PMID:19915664

A New Tool for Identifying Research Standards and Evaluating Research Performance

ERIC Educational Resources Information Center

Bacon, Donald R.; Paul, Pallab; Stewart, Kim A.; Mukhopadhyay, Kausiki

2012-01-01

Much has been written about the evaluation of faculty research productivity in promotion and tenure decisions, including many articles that seek to determine the rank of various marketing journals. Yet how faculty evaluators combine journal quality, quantity, and author contribution to form judgments of a scholar's performance is unclear. A…

Evaluation of the quality and health literacy demand of online renal diet information.

PubMed

Lambert, K; Mullan, J; Mansfield, K; Koukomous, A; Mesiti, L

2017-10-01

Dietary modification is critical in the self-management of chronic kidney disease. The present study describes the accuracy, quality and health literacy demand of renal diet information for adults with kidney disease obtained from the Internet and YouTube (www.youtube.com). A comprehensive content analysis was undertaken in April and July 2015 of 254 eligible websites and 161 YouTube videos. The accuracy of the renal diet information was evaluated by comparing the key messages with relevant evidence-based guidelines for the dietary management of people with kidney disease. The DISCERN tool (www.discern.org.uk) was used to evaluate the quality of the material. Health literacy demand was evaluated using the Patient Education Material Assessment Tool (www.ahrq.gov/professionals/prevention-chronic-care/improve/self-mgmt/pemat/index.html) and seven validated readability calculators. The most frequent renal diet topic found online was generic dietary information for people with chronic kidney disease. The proportion of renal diet information obtained from websites that was accurate was 73%. However, this information was mostly of poor quality with extensive shortcomings, difficult to action and written with a high health literacy demand. By contrast, renal diet information available from YouTube was highly understandable and actionable, although only 18% of the videos were accurate, and a large proportion were of poor quality with extensive shortcomings. The most frequent authors of accurate, good quality, understandable, material were government bodies, dietitians, academic institutions and medical organisations. Renal diet information found online that is written by government bodies, dietitians, academic institutions and medical organisations is recommended. Further work is required to improve the quality and, most importantly, the actionability of renal diet information found online. © 2017 The British Dietetic Association Ltd.

Systematic literature review of clinical trials evaluating pharmacotherapy for overactive bladder in elderly patients: An assessment of trial quality.

PubMed

Kistler, Kristin D; Xu, Yingxin; Zou, Kelly H; Ntanios, Fady; Chapman, Douglass S; Luo, Xuemei

2018-01-01

Overactive bladder (OAB) disproportionately affects older-aged adults, yet most randomized controlled trials (RCTs) underrepresent patients ≥65. This systematic literature review (SLR) identified RCTs evaluating β-3 adrenergic agonists or muscarinic antagonists in elderly patients with OAB, and compared study quality across trials. MEDLINE ® , Embase ® , and Cochrane Collaboration Central Register of Clinical Trials databases were searched from inception through April 28, 2015 to identify published, peer-reviewed RCT reports evaluating β-3 adrenergic agonists or muscarinic antagonists in elderly OAB patients (either ≥65 years or study-described as "elderly"). To assess study quality of RCT reports, we focused on internal/external validity, assessed via two scales: the validated Effective Public Health Practice Project [EPHPP]): Quality Assessment Tool for Quantitative Studies, and a tool commissioned by the Agency for Healthcare Research and Quality (AHRQ). Database searches yielded 1380 records that were then screened according to predefined inclusion/exclusion criteria. We included eight papers meeting study criteria. Despite scientific community efforts to improve RCT reporting standards, published reports still include incomplete and inconsistent reporting-of subject attrition, baseline patient characteristics, inclusion/exclusion criteria, and other important details. Only three of the eight OAB RCTs in this review received quality ratings of Strong (EPHPP) or Fair (AHRQ) and were multicenter with large samples. Despite the prevalence of OAB among older age individuals, relatively few RCTs evaluate OAB treatments explicitly among elderly subjects. The findings from this quality assessment suggest some areas for improvement in both conduct and reporting of future RCTs assessing OAB treatment in elderly. © 2017 Wiley Periodicals, Inc.

Impact of reduced mass of light commercial vehicles on fuel consumption, CO2 emissions, air quality, and socio-economic costs.

PubMed

Cecchel, S; Chindamo, D; Turrini, E; Carnevale, C; Cornacchia, G; Gadola, M; Panvini, A; Volta, M; Ferrario, D; Golimbioschi, R

2018-02-01

This study presents a modelling system to evaluate the impact of weight reduction in light commercial vehicles with diesel engines on air quality and greenhouse gas emissions. The PROPS model assesses the emissions of one vehicle in the aforementioned category and its corresponding reduced-weight version. The results serve as an input to the RIAT+ tool, an air quality integrated assessment modelling system. This paper applies the tools in a case study in the Lombardy region (Italy) and discusses the input data pre-processing, the PROPS-RIAT+ modelling system runs, and the results. Copyright © 2017 Elsevier B.V. All rights reserved.

Chronic Pelvic Pain: Assessment, Evaluation, and Objectivation

PubMed Central

Pota, Vincenzo; Sansone, Pasquale; Aurilio, Caterina; Pace, Maria Caterina

2017-01-01

Chronic Pelvic Pain (CPP) and Chronic Pelvic Pain Syndrome (CPPS) have a significant impact on men and women of reproductive and nonreproductive age, with a considerable burden on overall quality of life (QoL) and on psychological, functional, and behavioural status. Moreover, diagnostic and therapeutic difficulties are remarkable features in many patients. Therefore evaluation, assessment and objectivation tools are often necessary to properly address each patient and consequently his/her clinical needs. Here we review the different tools for pain assessment, evaluation, and objectivation; specific features regarding CPP/CPPS will be highlighted. Also, recent findings disclosed with neuroimaging investigations will be reviewed as they provide new insights into CPP/CPPS pathophysiology and may serve as a tool for CPP assessment and objectivation. PMID:29359045

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Measuring Outcomes in Children's Services.

ERIC Educational Resources Information Center

Christner, Anne Marshall, Ed.

Outcomes evaluation can provide program managers and clinical directors in child welfare, juvenile justice, child mental health, and child protective services the necessary tools for program quality assurance and accountability. This guide describes the outcomes evaluation process and provides a summary of articles and reports detailing current…

Development and Implementation of a Design Metric for Systems Containing Long-Term Fluid Loops

NASA Technical Reports Server (NTRS)

Steele, John W.

2016-01-01

John Steele, a chemist and technical fellow from United Technologies Corporation, provided a water quality module to assist engineers and scientists with a metric tool to evaluate risks associated with the design of space systems with fluid loops. This design metric is a methodical, quantitative, lessons-learned based means to evaluate the robustness of a long-term fluid loop system design. The tool was developed by a cross-section of engineering disciplines who had decades of experience and problem resolution.

[Managing a health research institute: towards research excellence through continuous improvement].

PubMed

Olmedo, Carmen; Buño, Ismael; Plá, Rosa; Lomba, Irene; Bardinet, Thierry; Bañares, Rafael

2015-01-01

Health research institutes are a strategic commitment considered the ideal environment to develop excellence in translational research. Achieving quality research requires not only a powerful scientific and research structure but also the quality and integrity of management systems that support it. The essential instruments in our institution were solid strategic planning integrated into and consistent with the system of quality management, systematic evaluation through periodic indicators, measurement of key user satisfaction and internal audits, and implementation of an innovative information management tool. The implemented management tools have provided a strategic thrust to our institute while ensuring a level of quality and efficiency in the development and management of research that allows progress towards excellence in biomedical research. Copyright © 2015 SESPAS. Published by Elsevier Espana. All rights reserved.

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

Refining prognosis in lung cancer: A report on the quality and relevance of clinical prognostic tools

PubMed Central

Mahar, Alyson L.; Compton, Carolyn; McShane, Lisa M.; Halabi, Susan; Asamura, Hisao; Rami-Porta, Ramon; Groome, Patti A.

2015-01-01

Introduction Accurate, individualized prognostication for lung cancer patients requires the integration of standard patient and pathologic factors, biologic, genetic, and other molecular characteristics of the tumor. Clinical prognostic tools aim to aggregate information on an individual patient to predict disease outcomes such as overall survival, but little is known about their clinical utility and accuracy in lung cancer. Methods A systematic search of the scientific literature for clinical prognostic tools in lung cancer published Jan 1, 1996-Jan 27, 2015 was performed. In addition, web-based resources were searched. A priori criteria determined by the Molecular Modellers Working Group of the American Joint Committee on Cancer were used to investigate the quality and usefulness of tools. Criteria included clinical presentation, model development approaches, validation strategies, and performance metrics. Results Thirty-two prognostic tools were identified. Patients with metastases were the most frequently considered population in non-small cell lung cancer. All tools for small cell lung cancer covered that entire patient population. Included prognostic factors varied considerably across tools. Internal validity was not formally evaluated for most tools and only eleven were evaluated for external validity. Two key considerations were highlighted for tool development: identification of an explicit purpose related to a relevant clinical population and clear decision-points, and prioritized inclusion of established prognostic factors over emerging factors. Conclusions Prognostic tools will contribute more meaningfully to the practice of personalized medicine if better study design and analysis approaches are used in their development and validation. PMID:26313682

The use of UV-visible reflectance spectroscopy as an objective tool to evaluate pearl quality.

PubMed

Agatonovic-Kustrin, Snezana; Morton, David W

2012-07-01

Assessing the quality of pearls involves the use of various tools and methods, which are mainly visual and often quite subjective. Pearls are normally classified by origin and are then graded by luster, nacre thickness, surface quality, size, color and shape. The aim of this study was to investigate the capacity of Artificial Neural Networks (ANNs) to classify and estimate the quality of 27 different pearls from their UV-Visible spectra. Due to the opaque nature of pearls, spectroscopy measurements were performed using the Diffuse Reflectance UV-Visible spectroscopy technique. The spectra were acquired at two different locations on each pearl sample in order to assess surface homogeneity. The spectral data (inputs) were smoothed to reduce the noise, fed into ANNs and correlated to the pearl's quality/grading criteria (outputs). The developed ANNs were successful in predicting pearl type, mollusk growing species, possible luster and color enhancing, donor condition/type, recipient/host color, donor color, pearl luster, pearl color, origin. The results of this study shows that the developed UV-Vis spectroscopy-ANN method could be used as a more objective method of assessing pearl quality (grading) and may become a valuable tool for the pearl grading industry.

[Customer satisfaction with a quality management system according to DIN EN ISO 9001:2000: Increase in the satisfaction of cooperating clinics].

PubMed

Beholz, Sven; Konertz, Wolfgang

2006-01-01

The evaluation of customers' satisfaction is elementary for any quality management system. In our university cardiac surgery unit that has been certified according to DIN EN ISO 9001:2000 the influence of repeated evaluation of the referring physicians' satisfaction conducted in the course of three consecutive years on structures and processes in the scope of the quality management system was examined. Customers' satisfaction with the possibility of access to the department could be increased by targeted interventions. Further interventions in the field of documentation led to a measurable increase in satisfaction with postoperative communication. Repeated annual evaluation of the satisfaction of referring physicians has proved to be a valuable tool in the process of continuous quality improvement.

Effective Documentation Tools

NASA Technical Reports Server (NTRS)

Sleboda, Claire

1997-01-01

Quality assurance programs provide a very effective means to monitor and evaluate medical care. Quality assurance involves: (1) Identify a problem; (2) Determine the source and nature of the problem; (3) Develop policies and methods to effect improvement; (4) Implement those polices; (5) Monitor the methods applied; and (6) Evaluate their effectiveness. Because this definition of quality assurance so closely resembles the Nursing Process, the health unit staff was able to use their knowledge of the nursing process to develop many forms which improve the quality of patient care. These forms include the NASA DFRC Service Report, the occupational injury form (Incident Report), the patient survey (Pre-hospital Evaluation/Care Report), the Laboratory Log Sheet, the 911 Run Sheet, and the Patient Assessment Stamp. Examples and steps which are followed to generate these reports are described.

Web-based Air Quality Screening Tool for Near-port Assessments: Example of Application in Porto, Portugal

EPA Science Inventory

The HARMO conference presents an opportunity to extend and further develop ORD’s collaboration with our European colleagues. This paper describes the C-PORT application in Porto, Portugal as a part of the EU project AIRSHIP designed to evaluate the air quality impacts of m...

Evaluating the APEX model for simulating streamflow and water quality on ten agricultural watersheds in the U.S.

USDA-ARS?s Scientific Manuscript database

Simulation models are increasingly used to assess water quality constituent losses from agricultural systems. Mis-use often gives irrelevant or erroneous answers. The Agricultural Policy Environmental Extender (APEX) model is emerging as one of the premier modeling tools for fields, farms, and agr...

Quality Teaching Rounds in Mathematics Teacher Education

ERIC Educational Resources Information Center

Prieto, Elena; Howley, Peter; Holmes, Kathryn; Osborn, Judy-anne; Roberts, Malcolm; Kepert, Andrew

2015-01-01

The purpose of the study reported in this paper is to evaluate the effectiveness of an implementation of teaching rounds as a practice-based approach to pre-service teacher education in mathematics. The teaching rounds implemented in the study utilised the NSW Quality Teaching model pedagogical framework as a tool for learning about and reflecting…

Does Multimedia Education with 3D Animation Impact Quality and Duration of Urologists' Interactions with their Prostate Cancer Patients?

PubMed

Peltier, Alexandre; Aoun, Fouad; Ameye, Filip; Andrianne, Robert; De Meerleer, Gert; Denis, Louis; Joniau, Steven; Lambrecht, Antoon; Billiet, Ignace; Vanderdonck, Frank; Roumeguère, Thierry; Van Velthoven, Roland

2015-09-01

This large multicenter study aimed to assess the impact of the use of multimedia tools on the duration and the quality of the conversation between healthcare providers (urologists, radiotherapists and nurses) and their patients. 30 urological centers in Belgium used either videos or other instructive tools in their consultation with prostate cancer patients. Each consultation was evaluated for duration and quality using a visual analog scale. In total, 905 patient visits were evaluated: 447 without and 458 with video support. During consultations with video support, an average of 2.3 videos was shown. Video support was judged to be practical and to improve the quality of consultations, without loss of time, regardless of patient age or stage of disease management (p > 0.05). Healthcare providers indicate that the use of videos improved patient comprehension about prostate cancer, as well as the quality information exchange, without increasing consultation time. The use of video material was feasible in daily practice, and was easy to understand, relevant and culturally appropriate, even for the most elderly men. Multimedia education also helped to empower men to actively participate in their healthcare and treatment discussions. Ipsen NV.

[EEQ in clinical embryology: a starting program].

PubMed

Boyer, Pierre; Brugnon, Florence; Levy, Rachel; Pfeffer, Jérôme; Siest, Jean-Pascal

2014-01-01

Every laboratory including those working in assisted reproductive technologies have to be accredited EN ISO 15189 before 2020. This standardisation includes an external quality evaluation (EQE). In order to work out an EQE tool, we used images extracted from our own database developed during daily practice. We achieved an easily online tool called: "EEQ en embryologie clinique", developed on Biologie prospective web site with ART French biologists Association (Blefco) expertise in evaluation of early human embryonic stages. In 2013, 38 ART laboratories participate to the first program with more than 90% of appropriates results. The present article aims at describing this tool and discussing its limits.

How to Assess Quality of Research in Iran, From Input to Impact? Introduction of Peer-Based Research Evaluation Model in Iran.

PubMed

Ebadifar, Asghar; Baradaran Eftekhari, Monir; Owlia, Parviz; Habibi, Elham; Ghalenoee, Elham; Bagheri, Mohammad Reza; Falahat, Katayoun; Eltemasi, Masoumeh; Sobhani, Zahra; Akhondzadeh, Shahin

2017-11-01

Research evaluation is a systematic and objective process to measure relevance, efficiency and effectiveness of research activities, and peer review is one of the most important tools for assessing quality of research. The aim of this study was introducing research evaluation indicators based on peer reviewing. This study was implemented in 4 stages. A list of objective-oriented evaluation indicators were designed in 4 axes, including; governance and leadership, structure, knowledge production and research impact. The top 10% medical sciences research centers (RCs) were evaluated based on peer review. Adequate equipment and laboratory instruments, high quality research publication and national or international cooperation were the main strengths in medical sciences RCs and the most important weaknesses included failure to adhere to strategic plans, parallel actions in similar fields, problems in manpower recruitment, knowledge translation & exchange (KTE) in service providers and policy makers' levels. Peer review evaluation can improve the quality of research.

Analysing Instrument Mixes in Quality Assurance: The Czech and Slovak Accreditation Commissions in the Era of Mass Higher Education

ERIC Educational Resources Information Center

Kohoutek, Jan

2014-01-01

Utilising insights from policy instrument theory, the article analyses the design, functioning and effects of the tools used by the Czech Accreditation Commission (CAC) and the Slovak Accreditation Commission (SAC) in the 2000s. Aside from programme accreditation, the other tools analysed are: institutional approval, institutional evaluations,…

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

[Sensitivity to change].

PubMed

Igl, W; Zwingmann, C; Faller, H

2005-04-01

In rehabilitation research patient questionnaires are widely used for evaluative purposes, i. e. to measure improvements or deteriorations over time. This is only possible if the questionnaires applied appropriately reflect "true" change over time, i. e. they have to be sensitive to change. The aim of this paper is to point out the importance of the "sensitivity to change" concept for evaluative assessment tools and evaluative studies, respectively, considering quality of life research as an example. Various qualitative aspects, e. g. scaling of response options of assessment tools, are covered as well as quantitative methods, i. e. study designs and indices. Furthermore, recommendations for interpretation are given.

Development of Continuing Nursing Education Offerings for the World Wide Web.

ERIC Educational Resources Information Center

Billings, Diane M.; Rowles, Connie J.

2001-01-01

Describes steps for web-based continuing education courses in terms of planning (strategic plan, website development, resource team, marketing plan), implementing (course design, web-based tools, copyright and intellectual property), and evaluating (pilot test, formative/summative evaluation, continuous quality improvement). (Contains 16…

Community Building, Emergent Design and Expecting the Unexpected: Creating a Quality eLearning Experience

ERIC Educational Resources Information Center

Thompson, Terrie Lynn; MacDonald, Colla J.

2005-01-01

Given the extraordinary interest and growth in eLearning as a learning tool and as an industry, it is not surprising there is lively debate on quality. A research-based and tested eLearning model was used to design and evaluate an online M.Ed. course in order to study factors that influence the quality of an eLearning event. Several data…

Quality assurance of nursing web sites: development and implications of the ALEU method.

PubMed

Cambil-Martín, Jacobo; Flynn, Maria; Villaverde-Gutiérrez, Carmen

2011-09-01

This article presents a study that evaluated the physical accessibility, readability, and usability of Spanish nursing Web sites and discusses the quality assurance issues raised, which are relevant to the wider nursing community. The Internet is recognized as an important source of health information for both nurses and the general public. Although it makes health-related information universally available, the wide variation in the overall quality of health Web sites is problematic. This raises many questions for the nursing profession: about what constitutes a good-quality Web site, about the nature of the information that nurses are finding and using to support their professional education, research, and clinical practice, and about the impact that Internet information ultimately has on health interactions and nursing care. The process of completing this small study showed that it is possible to usefully assess dimensions of Web site quality and suggested that it may be feasible to develop tools to help nurses evaluate national and international nursing Web sites. More research is needed to understand how nurses use the Internet to support their everyday professional practices, but the development and application of international Web site quality assurance tools may be important for maintaining professional nursing standards in the Internet age.

QCScreen: a software tool for data quality control in LC-HRMS based metabolomics.

PubMed

Simader, Alexandra Maria; Kluger, Bernhard; Neumann, Nora Katharina Nicole; Bueschl, Christoph; Lemmens, Marc; Lirk, Gerald; Krska, Rudolf; Schuhmacher, Rainer

2015-10-24

Metabolomics experiments often comprise large numbers of biological samples resulting in huge amounts of data. This data needs to be inspected for plausibility before data evaluation to detect putative sources of error e.g. retention time or mass accuracy shifts. Especially in liquid chromatography-high resolution mass spectrometry (LC-HRMS) based metabolomics research, proper quality control checks (e.g. for precision, signal drifts or offsets) are crucial prerequisites to achieve reliable and comparable results within and across experimental measurement sequences. Software tools can support this process. The software tool QCScreen was developed to offer a quick and easy data quality check of LC-HRMS derived data. It allows a flexible investigation and comparison of basic quality-related parameters within user-defined target features and the possibility to automatically evaluate multiple sample types within or across different measurement sequences in a short time. It offers a user-friendly interface that allows an easy selection of processing steps and parameter settings. The generated results include a coloured overview plot of data quality across all analysed samples and targets and, in addition, detailed illustrations of the stability and precision of the chromatographic separation, the mass accuracy and the detector sensitivity. The use of QCScreen is demonstrated with experimental data from metabolomics experiments using selected standard compounds in pure solvent. The application of the software identified problematic features, samples and analytical parameters and suggested which data files or compounds required closer manual inspection. QCScreen is an open source software tool which provides a useful basis for assessing the suitability of LC-HRMS data prior to time consuming, detailed data processing and subsequent statistical analysis. It accepts the generic mzXML format and thus can be used with many different LC-HRMS platforms to process both multiple quality control sample types as well as experimental samples in one or more measurement sequences.

Quality Assessment of Economic Evaluations of Suicide and Self-Harm Interventions.

PubMed

Bustamante Madsen, Lizell; Eddleston, Michael; Schultz Hansen, Kristian; Konradsen, Flemming

2018-03-01

Death following self-harm constitutes a major global public health challenge and there is an urgent need for governments to implement cost-effective, national suicide prevention strategies. To conduct a systematic review and quality appraisal of the economic evaluations of interventions aimed at preventing suicidal behavior. A systematic literature search was performed in several literature databases to identify relevant articles published from 2003 to 2016. Drummond's 10-item appraisal tool was used to assess the methodological quality of the included studies. In total, 25 documents encompassing 30 economic evaluations were included in the review. Of the identified evaluations, 10 studies were found to be of poor quality, 14 were of average quality, and six studies were considered of good quality. The majority of evaluations found the interventions to be cost-effective. Several limitations were identified and discussed in the article. A notable few economic evaluations were identified. The studies were diverse, primarily set in high-income countries, and often based on modeling, emphasizing the need for more primary research into the topic. The discussion of suicide and self-harm prevention should be as nuanced as possible, including health economics along with cultural, social, and political aspects.

Evaluation of Earthquake Detection Performance in Terms of Quality and Speed in SEISCOMP3 Using New Modules Qceval, Npeval and Sceval

NASA Astrophysics Data System (ADS)

Roessler, D.; Weber, B.; Ellguth, E.; Spazier, J.

2017-12-01

The geometry of seismic monitoring networks, site conditions and data availability as well as monitoring targets and strategies typically impose trade-offs between data quality, earthquake detection sensitivity, false detections and alert times. Network detection capabilities typically change with alteration of the seismic noise level by human activity or by varying weather and sea conditions. To give helpful information to operators and maintenance coordinators, gempa developed a range of tools to evaluate earthquake detection and network performance including qceval, npeval and sceval. qceval is a module which analyzes waveform quality parameters in real-time and deactivates and reactivates data streams based on waveform quality thresholds for automatic processing. For example, thresholds can be defined for latency, delay, timing quality, spikes and gaps count and rms. As changes in the automatic processing have a direct influence on detection quality and speed, another tool called "npeval" was designed to calculate in real-time the expected time needed to detect and locate earthquakes by evaluating the effective network geometry. The effective network geometry is derived from the configuration of stations participating in the detection. The detection times are shown as an additional layer on the map and updated in real-time as soon as the effective network geometry changes. Yet another new tool, "sceval", is an automatic module which classifies located seismic events (Origins) in real-time. sceval evaluates the spatial distribution of the stations contributing to an Origin. It confirms or rejects the status of Origins, adds comments or leaves the Origin unclassified. The comments are passed to an additional sceval plug-in where the end user can customize event types. This unique identification of real and fake events in earthquake catalogues allows to lower network detection thresholds. In real-time monitoring situations operators can limit the processing to events with unclassified Origins, reducing their workload. Classified Origins can be treated specifically by other procedures. These modules have been calibrated and fully tested by several complex seismic monitoring networks in the region of Indonesia and Northern Chile.

Measuring antimicrobial prescribing quality in Australian hospitals: development and evaluation of a national antimicrobial prescribing survey tool.

PubMed

James, Rodney; Upjohn, Lydia; Cotta, Menino; Luu, Susan; Marshall, Caroline; Buising, Kirsty; Thursky, Karin

2015-01-01

Antimicrobial stewardship (AMS) programmes have been developed with the intention of reducing inappropriate and unnecessary use of antimicrobials, while improving the quality of patient care and locally helping prevent the development of antimicrobial resistance. An important aspect of AMS programmes is the qualitative assessment of prescribing through antimicrobial prescribing surveys (APS), which are able to provide information about the prescribing behaviour within institutions. Owing to lack of standardization of audit tools and the resources required, qualitative methods for the assessment of antimicrobial use are not often performed. The aim of this study was to design an audit tool that was appropriate for use in all Australian hospitals, suited to local user requirements and included an assessment of the overall appropriateness of the prescription. In November 2011, a pilot APS was conducted across 32 hospitals to assess the usability and generalizability of a newly designed audit tool. Following participant feedback, this tool was revised to reflect the requirements of the respondents. A second pilot study was then performed in November 2012 across 85 hospitals. These surveys identified several areas that can be targets for quality improvement at a national level, including: documentation of indication; surgical prophylaxis prescribed for >24 h; compliance with prescribing guidelines; and the appropriateness of the prescription. By involving the end users in the design and evaluation, we have been able to provide a practical and relevant APS tool for quantitative and qualitative data collection in a wide range of Australian hospital settings. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process

PubMed Central

2011-01-01

Background There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. Methods A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. Results In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. Conclusion Based on experts' opinions, a self-assessment tool was found in order to access quality of PA programmes for the elderly. Information obtained with evaluations would be useful to organizations seeking to improve their services, customer satisfaction and, consequently, adherence to PA programmes, targeting the ageing population. PMID:21958203

The compressed average image intensity metric for stereoscopic video quality assessment

NASA Astrophysics Data System (ADS)

Wilczewski, Grzegorz

2016-09-01

The following article depicts insights towards design, creation and testing of a genuine metric designed for a 3DTV video quality evaluation. The Compressed Average Image Intensity (CAII) mechanism is based upon stereoscopic video content analysis, setting its core feature and functionality to serve as a versatile tool for an effective 3DTV service quality assessment. Being an objective type of quality metric it may be utilized as a reliable source of information about the actual performance of a given 3DTV system, under strict providers evaluation. Concerning testing and the overall performance analysis of the CAII metric, the following paper presents comprehensive study of results gathered across several testing routines among selected set of samples of stereoscopic video content. As a result, the designed method for stereoscopic video quality evaluation is investigated across the range of synthetic visual impairments injected into the original video stream.

An Evaluation of TTS as a Pedagogical Tool for Pronunciation Instruction: The "Foreign" Language Context

ERIC Educational Resources Information Center

Bione, Tiago; Grimshaw, Jennica; Cardoso, Walcir

2017-01-01

Despite positive evidence demonstrating the pedagogical benefits of Text-To-Speech (TTS) synthesisers for second/foreign language learning (Liakin, Cardoso, & Liakina, 2017), there is a need for up-to-date formal evaluations, specifically regarding its potential to promote learning. This study evaluates the voice quality of a TTS system in…

The Relationship between Teachers' Attitudes toward Measurement and Evaluation and Their Perceptions of Professional Well-Being

ERIC Educational Resources Information Center

Yildirim, Kamil; Arastaman, Gökhan; Dasci, Elif

2016-01-01

Problem Statement: The quality of teaching at schools mostly depends on the teachers' competencies. One of these competencies is measurement and evaluation (MaE). Evaluation of the students' cognitive, affective, and psychomotor development requires skills and knowledge about various measuring tools and techniques. It is essential for a teacher to…

Applying a Framework to Evaluate Assignment Marking Software: A Case Study on Lightwork

ERIC Educational Resources Information Center

Heinrich, Eva; Milne, John

2012-01-01

This article presents the findings of a qualitative evaluation on the effect of a specialised software tool on the efficiency and quality of assignment marking. The software, Lightwork, combines with the Moodle learning management system and provides support through marking rubrics and marker allocations. To enable the evaluation a framework has…

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

Social sustainability in healthcare facilities: a rating tool for analysing and improving social aspects in environments of care.

PubMed

Capolongo, Stefano; Gola, Marco; di Noia, Michela; Nickolova, Maria; Nachiero, Dario; Rebecchi, Andrea; Settimo, Gaetano; Vittori, Gail; Buffoli, Maddalena

2016-01-01

Nowadays several rating systems exist for the evaluation of the sustainability of buildings, but often their focus is limited to environmental and efficiency aspects. Hospitals are complex constructions in which many variables affect hospital processes. Therefore, a research group has developed a tool for the evaluation of sustainability in healthcare facilities. The paper analyses social sustainability issues through a tool which evaluates users' perception from a the quality and well-being perspective. It presents a hierarchical structure composed of a criteria and indicators system which is organised through a weighing system calculated by using the Analytic Network Process. The output is the definition of a tool which evaluates how Humanisation, Comfort and Distribution criteria can affect the social sustainability of a building. Starting from its application, it is evident that the instrument enables the improvement of healthcare facilities through several design and organisational suggestions for achieving healing and sustainable architectures.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bunshah, R.F.; Shabaik, A.H.

The process of Activated Reactive Evaporation is used to synthesize superhard materials like carbides, oxides, nitrides and ultrafine grain cermets. The deposits are characterized by hardness, microstructure, microprobe analysis for chemistry and lattice parameter measurements. The synthesis and characterization of TiC-Ni cermets and Al/sub 2/O/sub 3/ are given. High speed steel tool coated with TiC, TiC-Ni and TaC are tested for machining performance at different speeds and feeds. The machining evaluation and the selection of coatings is based on the rate of deterioration of the coating tool temperature, and cutting forces. Tool life tests show coated high speed steel toolsmore » having 150 to 300% improvement in tool life compared to uncoated tools. Variability in the quality of the ground edge on high speed steel inserts produce a great scatter in the machining evaluation data.« less

Beef assessments using functional magnetic resonance imaging and sensory evaluation.

PubMed

Tapp, W N; Davis, T H; Paniukov, D; Brooks, J C; Brashears, M M; Miller, M F

2017-04-01

Functional magnetic resonance imaging (fMRI) has been used to unveil how some foods and basic rewards are processed in the human brain. This study evaluated how resting state functional connectivity in regions of the human brain changed after differing qualities of beef steaks were consumed. Functional images of participants (n=8) were collected after eating high or low quality beef steaks on separate days, after consumption a sensory ballot was administered to evaluate consumers' perceptions of tenderness, juiciness, flavor, and overall liking. Imaging data showed that high quality steak samples resulted in greater functional connectivity to the striatum, medial orbitofrontal cortex, and insular cortex at various stages after consumption (P≤0.05). Furthermore, high quality steaks elicited higher sensory ballot scores for each palatability trait (P≤0.01). Together, these results suggest that resting state fMRI may be a useful tool for evaluating the neural process that follows positive sensory experiences such as the enjoyment of high quality beef steaks. Published by Elsevier Ltd.

Simplified tools for evaluating domestic ventilation systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maansson, L.G.; Orme, M.

1999-07-01

Within an International Energy Agency (IEA) project, Annex 27, experts from 8 countries (Canada, France, Italy, Japan, The Netherlands, Sweden, UK and USA) have developed simplified tools for evaluating domestic ventilation systems during the heating season. Tools for building and user aspects, thermal comfort, noise, energy, life cycle cost, reliability and indoor air quality (IAQ) have been devised. The results can be used both for dwellings at the design stage and after construction. The tools lead to immediate answers and indications about the consequences of different choices that may arise during discussion with clients. This paper presents an introduction tomore » these tools. Examples applications of the indoor air quality and energy simplified tools are also provided. The IAQ tool accounts for constant emission sources, CO{sub 2}, cooking products, tobacco smoke, condensation risks, humidity levels (i.e., for judging the risk for mould and house dust mites), and pressure difference (for identifying the risk for radon or land fill spillage entering the dwelling or problems with indoor combustion appliances). An elaborated set of design parameters were worked out that resulted in about 17,000 combinations. By using multi-variate analysis it was possible to reduce this to 174 combinations for IAQ. In addition, a sensitivity analysis was made using 990 combinations. The results from all the runs were used to develop a simplified tool, as well as quantifying equations relying on the design parameters. A computerized energy tool has also been developed within this project, which takes into account air tightness, climate, window airing pattern, outdoor air flow rate and heat exchange efficiency.« less

Estimating learning outcomes from pre- and posttest student self-assessments: a longitudinal study.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Beißbarth, Tim; Anders, Sven; Pukrop, Tobias; Raupach, Tobias

2013-03-01

Learning outcome is an important measure for overall teaching quality and should be addressed by comprehensive evaluation tools. The authors evaluated the validity of a novel evaluation tool based on student self-assessments, which may help identify specific strengths and weaknesses of a particular course. In 2011, the authors asked 145 fourth-year students at Göttingen Medical School to self-assess their knowledge on 33 specific learning objectives in a pretest and posttest as part of a cardiorespiratory module. The authors compared performance gain calculated from self-assessments with performance gain derived from formative examinations that were closely matched to these 33 learning objectives. Eighty-three students (57.2%) completed the assessment. There was good agreement between performance gain derived from subjective data and performance gain derived from objective examinations (Pearson r=0.78; P<.0001) on the group level. The association between the two measures was much weaker when data were analyzed on the individual level. Further analysis determined a quality cutoff for performance gain derived from aggregated student self-assessments. When using this cutoff, the evaluation tool was highly sensitive in identifying specific learning objectives with favorable or suboptimal objective performance gains. The tool is easy to implement, takes initial performance levels into account, and does not require extensive pre-post testing. By providing valid estimates of actual performance gain obtained during a teaching module, it may assist medical teachers in identifying strengths and weaknesses of a particular course on the level of specific learning objectives.

A CT-based software tool for evaluating compensator quality in passively scattered proton therapy

NASA Astrophysics Data System (ADS)

Li, Heng; Zhang, Lifei; Dong, Lei; Sahoo, Narayan; Gillin, Michael T.; Zhu, X. Ronald

2010-11-01

We have developed a quantitative computed tomography (CT)-based quality assurance (QA) tool for evaluating the accuracy of manufactured compensators used in passively scattered proton therapy. The thickness of a manufactured compensator was measured from its CT images and compared with the planned thickness defined by the treatment planning system. The difference between the measured and planned thicknesses was calculated with use of the Euclidean distance transformation and the kd-tree search method. Compensator accuracy was evaluated by examining several parameters including mean distance, maximum distance, global thickness error and central axis shifts. Two rectangular phantoms were used to validate the performance of the QA tool. Nine patients and 20 compensators were included in this study. We found that mean distances, global thickness errors and central axis shifts were all within 1 mm for all compensators studied, with maximum distances ranging from 1.1 to 3.8 mm. Although all compensators passed manual verification at selected points, about 5% of the pixels still had maximum distances of >2 mm, most of which correlated with large depth gradients. The correlation between the mean depth gradient of the compensator and the percentage of pixels with mean distance <1 mm is -0.93 with p < 0.001, which suggests that the mean depth gradient is a good indicator of compensator complexity. These results demonstrate that the CT-based compensator QA tool can be used to quantitatively evaluate manufactured compensators.

A Survey to Evaluate Facilitators and Barriers to Quality Measurement and Improvement: Adapting Tools for Implementation Research in Palliative Care Programs.

PubMed

Dy, Sydney M; Al Hamayel, Nebras Abu; Hannum, Susan M; Sharma, Ritu; Isenberg, Sarina R; Kuchinad, Kamini; Zhu, Junya; Smith, Katherine; Lorenz, Karl A; Kamal, Arif H; Walling, Anne M; Weaver, Sallie J

2017-12-01

Although critical for improving patient outcomes, palliative care quality indicators are not yet widely used. Better understanding of facilitators and barriers to palliative care quality measurement and improvement might improve their use and program quality. Development of a survey tool to assess palliative care team perspectives on facilitators and barriers to quality measurement and improvement in palliative care programs. We used the adapted Consolidated Framework for Implementation Research to define domains and constructs to select instruments. We assembled a draft survey and assessed content validity through pilot testing and cognitive interviews with experts and frontline practitioners for key items. We analyzed responses using a constant comparative process to assess survey item issues and potential solutions. We developed a final survey using these results. The survey includes five published instruments and two additional item sets. Domains include organizational characteristics, individual and team characteristics, intervention characteristics, and process of implementation. Survey modules include Quality Improvement in Palliative Care, Implementing Quality Improvement in the Palliative Care Program, Teamwork and Communication, Measuring the Quality of Palliative Care, and Palliative Care Quality in Your Program. Key refinements from cognitive interviews included item wording on palliative care team members, programs, and quality issues. This novel, adaptable instrument assesses palliative care team perspectives on barriers and facilitators for quality measurement and improvement in palliative care programs. Next steps include evaluation of the survey's construct validity and how survey results correlate with findings from program quality initiatives. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Computer vision system: a tool for evaluating the quality of wheat in a grain tank

NASA Astrophysics Data System (ADS)

Minkin, Uryi Igorevish; Panchenko, Aleksei Vladimirovich; Shkanaev, Aleksandr Yurievich; Konovalenko, Ivan Andreevich; Putintsev, Dmitry Nikolaevich; Sadekov, Rinat Nailevish

2018-04-01

The paper describes a technology that allows for automatizing the process of evaluating the grain quality in a grain tank of a combine harvester. Special recognition algorithm analyzes photographic images taken by the camera, and that provides automatic estimates of the total mass fraction of broken grains and the presence of non-grains. The paper also presents the operating details of the tank prototype as well as it defines the accuracy of the algorithms designed.

A proposal for assessing study quality: Biomonitoring, Environmental Epidemiology, and Short-lived Chemicals (BEES-C) instrument.

PubMed

LaKind, Judy S; Sobus, Jon R; Goodman, Michael; Barr, Dana Boyd; Fürst, Peter; Albertini, Richard J; Arbuckle, Tye E; Schoeters, Greet; Tan, Yu-Mei; Teeguarden, Justin; Tornero-Velez, Rogelio; Weisel, Clifford P

2014-12-01

The quality of exposure assessment is a major determinant of the overall quality of any environmental epidemiology study. The use of biomonitoring as a tool for assessing exposure to ubiquitous chemicals with short physiologic half-lives began relatively recently. These chemicals present several challenges, including their presence in analytical laboratories and sampling equipment, difficulty in establishing temporal order in cross-sectional studies, short- and long-term variability in exposures and biomarker concentrations, and a paucity of information on the number of measurements required for proper exposure classification. To date, the scientific community has not developed a set of systematic guidelines for designing, implementing and interpreting studies of short-lived chemicals that use biomonitoring as the exposure metric or for evaluating the quality of this type of research for WOE assessments or for peer review of grants or publications. We describe key issues that affect epidemiology studies using biomonitoring data on short-lived chemicals and propose a systematic instrument--the Biomonitoring, Environmental Epidemiology, and Short-lived Chemicals (BEES-C) instrument--for evaluating the quality of research proposals and studies that incorporate biomonitoring data on short-lived chemicals. Quality criteria for three areas considered fundamental to the evaluation of epidemiology studies that include biological measurements of short-lived chemicals are described: 1) biomarker selection and measurement, 2) study design and execution, and 3) general epidemiological study design considerations. We recognize that the development of an evaluative tool such as BEES-C is neither simple nor non-controversial. We hope and anticipate that the instrument will initiate further discussion/debate on this topic. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

A proposal for assessing study quality: Biomonitoring, Environmental Epidemiology, and Short-lived Chemicals (BEES-C) instrument

PubMed Central

LaKind, Judy S.; Sobus, Jon R.; Goodman, Michael; Barr, Dana Boyd; Fürst, Peter; Albertini, Richard J.; Arbuckle, Tye E.; Schoeters, Greet; Tan, Yu-Mei; Teeguarden, Justin; Tornero-Velez, Rogelio; Weisel, Clifford P.

2015-01-01

The quality of exposure assessment is a major determinant of the overall quality of any environmental epidemiology study. The use of biomonitoring as a tool for assessing exposure to ubiquitous chemicals with short physiologic half-lives began relatively recently. These chemicals present several challenges, including their presence in analytical laboratories and sampling equipment, difficulty in establishing temporal order in cross-sectional studies, short- and long-term variability in exposures and biomarker concentrations, and a paucity of information on the number of measurements required for proper exposure classification. To date, the scientific community has not developed a set of systematic guidelines for designing, implementing and interpreting studies of short-lived chemicals that use biomonitoring as the exposure metric or for evaluating the quality of this type of research for WOE assessments or for peer review of grants or publications. We describe key issues that affect epidemiology studies using biomonitoring data on short-lived chemicals and propose a systematic instrument – the Biomonitoring, Environmental Epidemiology, and Short-lived Chemicals (BEES-C) instrument – for evaluating the quality of research proposals and studies that incorporate biomonitoring data on short-lived chemicals. Quality criteria for three areas considered fundamental to the evaluation of epidemiology studies that include biological measurements of short-lived chemicals are described: 1) biomarker selection and measurement, 2) study design and execution, and 3) general epidemiological study design considerations. We recognize that the development of an evaluative tool such as BEES-C is neither simple nor non-controversial. We hope and anticipate that the instrument will initiate further discussion/debate on this topic. PMID:25137624

MEGAPOLI: concept and first results of multi-scale modelling of megacity impacts

NASA Astrophysics Data System (ADS)

Baklanov, A. A.; Lawrence, M.; Pandis, S.

2009-09-01

The European FP7 project MEGAPOLI: ‘Megacities: Emissions, urban, regional and Global Atmospheric POLlution and climate effects, and Integrated tools for assessment and mitigation' (http://megapoli.info), started in October 2008, brings together 27 leading European research groups from 11 countries, state-of-the-art scientific tools and key players from countries outside Europe to investigate the interactions among megacities, air quality and climate. MEGAPOLI bridges the spatial and temporal scales that connect local emissions, air quality and weather with global atmospheric chemistry and climate. The main MEGAPOLI objectives are: 1. to assess impacts of megacities and large air-pollution hot-spots on local, regional and global air quality, 2. to quantify feedbacks among megacity air quality, local and regional climate, and global climate change, 3. to develop improved integrated tools for prediction of air pollution in megacities. In order to achieve these objectives the following tasks are realizing: • Develop and evaluate integrated methods to improve megacity emission data, • Investigate physical and chemical processes starting from the megacity street level, continuing to the city, regional and global scales, • Assess regional and global air quality impacts of megacity plumes, • Determine the main mechanisms of regional meteorology/climate forcing due to megacity plumes, • Assess global megacity pollutant forcing on climate, • Examine feedback mechanisms including effects of climate change on megacity air quality, • Develop integrated tools for prediction of megacity air quality, • Evaluate these integrated tools and use them in case studies, • Develop a methodology to estimate the impacts of different scenarios of megacity development on human health and climate change, • Propose and assess mitigation options to reduce the impacts of megacity emissions. We follow a pyramid strategy of undertaking detailed measurements in one European major city, Paris, performing detailed analysis for 12 megacities with existing air quality datasets and investigate the effects of all megacities on climate and global atmospheric chemistry. The project focuses on the multi-scale modelling of interacting meteorology and air quality, spanning the range from emissions to air quality, effects on climate, and feedbacks and mitigation potentials. Our hypothesis is that megacities around the world have an impact on air quality not only locally, but also regionally and globally and therefore can also influence the climate of our planet. Some of the links between megacities, air quality and climate are reasonably well-understood. However, a complete quantitative picture of these interactions is clearly missing. Understanding and quantifying these missing links is the focus of MEGAPOLI. The current status and modeling results after the first project year on examples of Paris and other European megacities are discussed.

Advancement in modern approaches to mineral production quality control

NASA Astrophysics Data System (ADS)

Freidina, EV; Botvinnik, AA; Dvornikova, AN

2017-02-01

The natural resource potential of mineral deposits is represented by three categories: upside, attainable and investment. A modern methodology is proposed in this paper for production quality control, and its tools aimed at ensuring agreement between the product quality and the market requirements are described. The definitions of the costs of the product quality compliance and incompliance with the consumer requirements are introduced; the latter is suggested to use in evaluating resource potential of mineral deposits at a certain degree of probability.

Evaluation of the Quality of Online Information for Patients with Rare Cancers: Thyroid Cancer.

PubMed

Kuenzel, Ulrike; Monga Sindeu, Tabea; Schroth, Sarah; Huebner, Jutta; Herth, Natalie

2017-01-24

The Internet offers an easy and quick access to a vast amount of patient information. However, several studies point to the poor quality of many websites and the resulting hazards of false information. The aim of this study was to assess quality of information on thyroid cancer. A patients' search for information about thyroid cancer on German websites was simulated using the search engine Google and the patient portal "Patienten-Information.de". The websites were assessed using a standardized instrument with formal and content aspects from the German Cancer Society. Supporting the results of prior studies that analysed patient information on the Internet, the data showed that the quality of patient information on thyroid cancer is highly heterogeneous depending on the website providers. The majority of website providers are represented by media and health providers other than health insurances, practices and professionals offering patient information of relatively poor quality. Moreover, most websites offer patient information of low-quality content. Only a few trustworthy, high-quality websites exist. Especially Google, a common search engine, focuses more on the dissemination of information than on quality aspects. In order to improve the patient information from the Internet, the visibility of high-quality websites must be improved. For that, education programs to improve patients' eHealth literacy are needed. A quick and easy evaluation tool for online information suited for patients should be implemented, and patients should be taught to integrate such a tool into their research process.

Evaluation and development of tools to quantify the impacts of roadside vegetation barriers on near-road air quality

EPA Science Inventory

Regulatory and urban planning programs require an accurate evaluation of how traffic emissions transport and disperse from roads to fully determine exposures and health risks. Roadside vegetation barriers have shown the potential to reduce near-road air pollution concentrations; ...

Sensitivity of simulated conservation practice effectiveness to representation of field and in-stream processes in the Little River Watershed

USDA-ARS?s Scientific Manuscript database

Evaluating the effectiveness of conservation practices (CPs) is an important step to achieving efficient and successful water quality management. Watershed-scale simulation models can provide useful and convenient tools for this evaluation, but simulated conservation practice effectiveness should be...

So You're Going To Have a Fund Raiser.

ERIC Educational Resources Information Center

Lemieux, Russ

1997-01-01

Provides a fundraising checklist for preschools and centers to use as a tool for evaluating companies which provide services and goods, to help providers make informed solicitation decisions. The checklist assists in evaluating product quality and cost, company professionalism, educational value, company history, organization of services, and…

Evaluation of the ToxRTool's ability to rate the reliability of toxicological data for human health hazard assessments

EPA Science Inventory

Regulatory agencies often utilize results from peer reviewed publications for hazard assessments.A problem in doing so is the lack of well-accepted tools to objectively, efficiently and systematically assess the quality of published toxicological studies. Herein, we evaluated the...

Exploring Non-Instructional Factors in Student Evaluations

ERIC Educational Resources Information Center

Ali, Holi Ibrahim Holi; Al Ajmi, Ahmed Ali Saleh

2013-01-01

The use of student ratings to measure instructors' teaching performance and effectiveness in tertiary education has been an important but controversial tool in the improvement of teaching quality during the past few decades. This is an attempt to explore non-instructional factors of student evaluations by discussing and reviewing relevant…

Revamping Teacher Evaluation

ERIC Educational Resources Information Center

Zatynski, Mandy

2012-01-01

In the past two years, as concerns over teacher quality have swelled, teacher evaluation has emerged as a crucial tool for principals and other administrators to improve instructor performance. More states are seeking federal waivers to the stringent benchmarks of No Child Left Behind; others are vying for Race to the Top funds. Both require…

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Prediction Of Abrasive And Diffusive Tool Wear Mechanisms In Machining

NASA Astrophysics Data System (ADS)

Rizzuti, S.; Umbrello, D.

2011-01-01

Tool wear prediction is regarded as very important task in order to maximize tool performance, minimize cutting costs and improve the quality of workpiece in cutting. In this research work, an experimental campaign was carried out at the varying of cutting conditions with the aim to measure both crater and flank tool wear, during machining of an AISI 1045 with an uncoated carbide tool P40. Parallel a FEM-based analysis was developed in order to study the tool wear mechanisms, taking also into account the influence of the cutting conditions and the temperature reached on the tool surfaces. The results show that, when the temperature of the tool rake surface is lower than the activation temperature of the diffusive phenomenon, the wear rate can be estimated applying an abrasive model. In contrast, in the tool area where the temperature is higher than the diffusive activation temperature, the wear rate can be evaluated applying a diffusive model. Finally, for a temperature ranges within the above cited values an adopted abrasive-diffusive wear model furnished the possibility to correctly evaluate the tool wear phenomena.

Application of a simple, affordable quality metric tool to colorectal, upper gastrointestinal, hernia, and hepatobiliary surgery patients: the HARM score.

PubMed

Brady, Justin T; Ko, Bona; Hohmann, Samuel F; Crawshaw, Benjamin P; Leinicke, Jennifer A; Steele, Scott R; Augestad, Knut M; Delaney, Conor P

2018-06-01

Quality is the major driver for both clinical and financial assessment. There remains a need for simple, affordable, quality metric tools to evaluate patient outcomes, which led us to develop the HospitAl length of stay, Readmission and Mortality (HARM) score. We hypothesized that the HARM score would be a reliable tool to assess patient outcomes across various surgical specialties. From 2011 to 2015, we identified colorectal, hepatobiliary, upper gastrointestinal, and hernia surgery admissions using the Vizient Clinical Database. Individual and hospital HARM scores were calculated from length of stay, 30-day readmission, and mortality rates. We evaluated the correlation of HARM scores with complication rates using the Clavien-Dindo classification. We identified 525,083 surgical patients: 206,981 colorectal, 164,691 hepatobiliary, 97,157 hernia, and 56,254 upper gastrointestinal. Overall, 53.8% of patients were admitted electively with a mean HARM score of 2.24; 46.2% were admitted emergently with a mean HARM score of 1.45 (p < 0.0001). All HARM components correlated with patient complications on logistic regression (p < 0.0001). The mean length of stay increased from 3.2 ± 1.8 days for a HARM score < 2 to 15.1 ± 12.2 days for a HARM score > 4 (p < 0.001). In elective admissions, for HARM categories of < 2, 2-< 3, 3-4, and > 4, complication rates were 9.3, 23.2, 38.8, and 71.6%, respectively. There was a similar trend for increasing HARM score in emergent admissions as well. For all surgical procedure categories, increasing HARM score, with and without risk adjustment, correlated with increasing severity of complications by Clavien-Dindo classification. The HARM score is an easy-to-use quality metric that correlates with increasing complication rates and complication severity across multiple surgical disciplines when evaluated on a large administrative database. This inexpensive tool could be adopted across multiple institutions to compare the quality of surgical care.

Factors Influencing Quality of Life of Hungarian Postmenopausal Women Screened by Osteodensitometry

ERIC Educational Resources Information Center

Maroti-Nagy, Agnes; Paulik, Edit

2011-01-01

The aim of our study was to evaluate factors influencing health related quality of life in Hungarian postmenopausal women who underwent osteodensitometry. A questionnaire-based cross-sectional study was carried out; 359 women aged over 40 years were involved, attending the outpatient Bone Densitometry Centre of Szeged. Two kinds of tools were…

Assessing Website Quality in Context: Retrieving Information about Genetically Modified Food on the Web

ERIC Educational Resources Information Center

McInerney, Claire R.; Bird, Nora J.

2005-01-01

Introduction: Knowing the credibility of information about genetically modified food on the Internet is critical to the everyday life information seeking of consumers as they form opinions about this nascent agricultural technology. The Website Quality Evaluation Tool (WQET) is a valuable instrument that can be used to determine the credibility of…

User and System-Based Quality Criteria for Evaluating Information Resources and Services Available from Federal Websites: Final Report.

ERIC Educational Resources Information Center

Wyman, Steven K.; And Others

This exploratory study establishes analytical tools (based on both technical criteria and user feedback) by which federal Web site administrators may assess the quality of their websites. The study combined qualitative and quantitative data collection techniques to achieve the following objectives: (1) identify and define key issues regarding…

Continuous processing and the applications of online tools in pharmaceutical product manufacture: developments and examples.

PubMed

Ooi, Shing Ming; Sarkar, Srimanta; van Varenbergh, Griet; Schoeters, Kris; Heng, Paul Wan Sia

2013-04-01

Continuous processing and production in pharmaceutical manufacturing has received increased attention in recent years mainly due to the industries' pressing needs for more efficient, cost-effective processes and production, as well as regulatory facilitation. To achieve optimum product quality, the traditional trial-and-error method for the optimization of different process and formulation parameters is expensive and time consuming. Real-time evaluation and the control of product quality using an online process analyzer in continuous processing can provide high-quality production with very high-throughput at low unit cost. This review focuses on continuous processing and the application of different real-time monitoring tools used in the pharmaceutical industry for continuous processing from powder to tablets.

Evaluating analytic and risk assessment tools to estimate sediment and nutrients losses from agricultural lands in the southern region of the USA

USDA-ARS?s Scientific Manuscript database

Non-point source pollution from agricultural fields is a critical problem associated with water quality impairment in the USA and a low-oxygen environment in the Gulf of Mexico. The use, development and enhancement of qualitative and quantitative models or tools for assessing agricultural runoff qua...

Investigating Qualities of Teachers' Feedback Conversations for Fostering Reasoning and Feeling of Self-Worth in Learners: A Tool Called Feedback Mapping

ERIC Educational Resources Information Center

Quynn, Jennifer Ann

2013-01-01

Teacher feedback has been identified throughout the educational literature as a powerful classroom intervention. However few tools exist that allow teachers to understand their own feedback practice. This study details a method for evaluating the feedback experiences of students. The feedback conversations of middle school science teachers were…

The usefulness of Quality of Life Childhood Epilepsy (QOLCE) questionnaire in evaluating the quality of life of children with epilepsy.

PubMed

Talarska, D

2007-01-01

Evaluation of quality of life has become a frequently used method in treatment effects supervision. Quality of Life Childhood Epilepsy (QOLCE) questionnaire, which is completed by patients' parents, has been prepared for children with epilepsy. It enables to determine the quality of life in children aged 4-18 years. The aim of the study was to show the usefulness of QOLCE questionnaire in evaluating the quality of life of children with epilepsy. 160 epileptic children, aged 8-18 years and their parents were examined in the Chair and Department of Developmental Neurology, K. Marcinkowski University of Medical Sciences in Poznań. QOLCE questionnaire was completed by parents and "Young people and epilepsy" questionnaire was designed for children. Reliability index of the complete questionnaire in own research and in the original amounted to 0.93 Cronbach alpha coefficient. Epileptic, drug-resistant children constituted 28% of the examined group. Parents of children with controlled seizures evaluated children's functioning in analyzed areas of quality of life higher. 1. QOLCE questionnaire is a suitable tool to evaluate the quality of children's and adolescents' life. 2. The most significant differences in functioning of epileptic, drug-resistant patients and those with controlled seizures were observed in areas of cognitive processes and social activity.

Tracer methodology: an appropriate tool for assessing compliance with accreditation standards?

PubMed

Bouchard, Chantal; Jean, Olivier

2017-10-01

Tracer methodology has been used by Accreditation Canada since 2008 to collect evidence on the quality and safety of care and services, and to assess compliance with accreditation standards. Given the importance of this methodology in the accreditation program, the objective of this study is to assess the quality of the methodology and identify its strengths and weaknesses. A mixed quantitative and qualitative approach was adopted to evaluate consistency, appropriateness, effectiveness and stakeholder synergy in applying the methodology. An online questionnaire was sent to 468 Accreditation Canada surveyors. According to surveyors' perceptions, tracer methodology is an effective tool for collecting useful, credible and reliable information to assess compliance with Qmentum program standards and priority processes. The results show good coherence between methodology components (appropriateness of the priority processes evaluated, activities to evaluate a tracer, etc.). The main weaknesses are the time constraints faced by surveyors and management's lack of cooperation during the evaluation of tracers. The inadequate amount of time allowed for the methodology to be applied properly raises questions about the quality of the information obtained. This study paves the way for a future, more in-depth exploration of the identified weaknesses to help the accreditation organization make more targeted improvements to the methodology. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

What do evaluation instruments tell us about the quality of complementary medicine information on the internet?

PubMed

Breckons, Matthew; Jones, Ray; Morris, Jenny; Richardson, Janet

2008-01-22

Developers of health information websites aimed at consumers need methods to assess whether their website is of "high quality." Due to the nature of complementary medicine, website information is diverse and may be of poor quality. Various methods have been used to assess the quality of websites, the two main approaches being (1) to compare the content against some gold standard, and (2) to rate various aspects of the site using an assessment tool. We aimed to review available evaluation instruments to assess their performance when used by a researcher to evaluate websites containing information on complementary medicine and breast cancer. In particular, we wanted to see if instruments used the same criteria, agreed on the ranking of websites, were easy to use by a researcher, and if use of a single tool was sufficient to assess website quality. Bibliographic databases, search engines, and citation searches were used to identify evaluation instruments. Instruments were included that enabled users with no subject knowledge to make an objective assessment of a website containing health information. The elements of each instrument were compared to nine main criteria defined by a previous study. Google was used to search for complementary medicine and breast cancer sites. The first six results and a purposive six from different origins (charities, sponsored, commercial) were chosen. Each website was assessed using each tool, and the percentage of criteria successfully met was recorded. The ranking of the websites by each tool was compared. The use of the instruments by others was estimated by citation analysis and Google searching. A total of 39 instruments were identified, 12 of which met the inclusion criteria; the instruments contained between 4 and 43 questions. When applied to 12 websites, there was agreement of the rank order of the sites with 10 of the instruments. Instruments varied in the range of criteria they assessed and in their ease of use. Comparing the content of websites against a gold standard is time consuming and only feasible for very specific advice. Evaluation instruments offer gateway providers a method to assess websites. The checklist approach has face validity when results are compared to the actual content of "good" and "bad" websites. Although instruments differed in the range of items assessed, there was fair agreement between most available instruments. Some were easier to use than others, but these were not necessarily the instruments most widely used to date. Combining some of the better features of instruments to provide fewer, easy-to-use methods would be beneficial to gateway providers.

Using Academy Standards of Excellence in Nutrition and Dietetics for organization self-assessment and quality improvement.

PubMed

Price, Joyce A; Kent, Sue; Cox, Sharon A; McCauley, Sharon M; Parekh, Janki; Klein, Catherine J

2014-08-01

Standards of Excellence in Nutrition and Dietetics for an Organization is a self-assessment tool to measure and evaluate an organization's program, services, and initiatives that identify and distinguish the Registered Dietitian Nutritionist (RDN) brand as the professional expert in food and nutrition. The Standards of Excellence will serve as a road map to recognize RDNs as leaders and collaborators. Standards of Excellence criteria apply to all practice segments of nutrition and dietetics: health care, education and research, business and industry, and community nutrition and public health. Given the membership's call to action to be recognized for their professional expertise, the Academy of Nutrition and Dietetics Quality Management Committee developed four Standards of Excellence in Nutrition and Dietetics for Organizations: Quality of Leadership, Quality of Organization, Quality of Practice, and Quality of Outcomes. Within each standard, specific indicators provide strategies for an organization to demonstrate excellence. The Academy will develop a self-evaluation scoring tool to assist the organization in applying and implementing one or more of the strategies in the Standards of Excellence indicators. The organization can use the self-assessment tool to establish itself as a Center of Excellence in Nutrition and Dietetics. The role examples illustrate initiatives RDNs and organizations can take to identify themselves as a Center of Excellence in Nutrition and Dietetics. Achieving the Excellence level is an important collaborative initiative between nutrition and dietetics organizations and the Academy to provide increased autonomy, supportive management, respect within peers and community, opportunities for professional development, support for further education, and compensation for the RDN. For purposes of the Standards, "organization" means workplace or practice setting. Copyright © 2014 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Setting Up Decision-Making Tools toward a Quality-Oriented Participatory Maize Breeding Program

PubMed Central

Alves, Mara L.; Brites, Cláudia; Paulo, Manuel; Carbas, Bruna; Belo, Maria; Mendes-Moreira, Pedro M. R.; Brites, Carla; Bronze, Maria do Rosário; Gunjača, Jerko; Šatović, Zlatko; Vaz Patto, Maria C.

2017-01-01

Previous studies have reported promising differences in the quality of kernels from farmers' maize populations collected in a Portuguese region known to produce maize-based bread. However, several limitations have been identified in the previous characterizations of those populations, such as a limited set of quality traits accessed and a missing accurate agronomic performance evaluation. The objectives of this study were to perform a more detailed quality characterization of Portuguese farmers' maize populations; to estimate their agronomic performance in a broader range of environments; and to integrate quality, agronomic, and molecular data in the setting up of decision-making tools for the establishment of a quality-oriented participatory maize breeding program. Sixteen farmers' maize populations, together with 10 other maize populations chosen for comparison purposes, were multiplied in a common-garden experiment for quality evaluation. Flour obtained from each population was used to study kernel composition (protein, fat, fiber), flour's pasting behavior, and bioactive compound levels (carotenoids, tocopherols, phenolic compounds). These maize populations were evaluated for grain yield and ear weight in nine locations across Portugal; the populations' adaptability and stability were evaluated using additive main effects and multiplication interaction (AMMI) model analysis. The phenotypic characterization of each population was complemented with a molecular characterization, in which 30 individuals per population were genotyped with 20 microsatellites. Almost all farmers' populations were clustered into the same quality-group characterized by high levels of protein and fiber, low levels of carotenoids, volatile aldehydes, α- and δ-tocopherols, and breakdown viscosity. Within this quality-group, variability on particular quality traits (color and some bioactive compounds) could still be found. Regarding the agronomic performance, farmers' maize populations had low, but considerably stable, grain yields across the tested environments. As for their genetic diversity, each farmers' population was genetically heterogeneous; nonetheless, all farmers' populations were distinct from each other's. In conclusion, and taking into consideration different quality improvement objectives, the integration of the data generated within this study allowed the outline and exploration of alternative directions for future breeding activities. As a consequence, more informed choices will optimize the use of the resources available and improve the efficiency of participatory breeding activities. PMID:29312428

Surgical process improvement tools: defining quality gaps and priority areas in gastrointestinal cancer surgery.

PubMed

Wei, A C; Devitt, K S; Wiebe, M; Bathe, O F; McLeod, R S; Urbach, D R

2014-04-01

Surgery is a cornerstone of cancer treatment, but significant differences in the quality of surgery have been reported. Surgical process improvement tools (spits) modify the processes of care as a means to quality improvement (qi). We were interested in developing spits in the area of gastrointestinal (gi) cancer surgery. We report the recommendations of an expert panel held to define quality gaps and establish priority areas that would benefit from spits. The present study used the knowledge-to-action cycle was as a framework. Canadian experts in qi and in gi cancer surgery were assembled in a nominal group workshop. Participants evaluated the merits of spits, described gaps in current knowledge, and identified and ranked processes of care that would benefit from qi. A qualitative analysis of the workshop deliberations using modified grounded theory methods identified major themes. The expert panel consisted of 22 participants. Experts confirmed that spits were an important strategy for qi. The top-rated spits included clinical pathways, electronic information technology, and patient safety tools. The preferred settings for use of spits included preoperative and intraoperative settings and multidisciplinary contexts. Outcomes of interest were cancer-related outcomes, process, and the technical quality of surgery measures. Surgical process improvement tools were confirmed as an important strategy. Expert panel recommendations will be used to guide future research efforts for spits in gi cancer surgery.

Surgical process improvement tools: defining quality gaps and priority areas in gastrointestinal cancer surgery

PubMed Central

Wei, A.C.; Devitt, K.S.; Wiebe, M.; Bathe, O.F.; McLeod, R.S.; Urbach, D.R.

2014-01-01

Background Surgery is a cornerstone of cancer treatment, but significant differences in the quality of surgery have been reported. Surgical process improvement tools (spits) modify the processes of care as a means to quality improvement (qi). We were interested in developing spits in the area of gastrointestinal (gi) cancer surgery. We report the recommendations of an expert panel held to define quality gaps and establish priority areas that would benefit from spits. Methods The present study used the knowledge-to-action cycle was as a framework. Canadian experts in qi and in gi cancer surgery were assembled in a nominal group workshop. Participants evaluated the merits of spits, described gaps in current knowledge, and identified and ranked processes of care that would benefit from qi. A qualitative analysis of the workshop deliberations using modified grounded theory methods identified major themes. Results The expert panel consisted of 22 participants. Experts confirmed that spits were an important strategy for qi. The top-rated spits included clinical pathways, electronic information technology, and patient safety tools. The preferred settings for use of spits included preoperative and intraoperative settings and multidisciplinary contexts. Outcomes of interest were cancer-related outcomes, process, and the technical quality of surgery measures. Conclusions Surgical process improvement tools were confirmed as an important strategy. Expert panel recommendations will be used to guide future research efforts for spits in gi cancer surgery. PMID:24764704

Methods for Evaluating the Performance and Human Stress-Factors of Percussive Riveting

NASA Astrophysics Data System (ADS)

Ahn, Jonathan Y.

The aerospace industry automates portions of their manufacturing and assembly processes. However, mechanics still remain vital to production, especially in areas where automated machines cannot fit, or have yet to match the quality of human craftsmanship. One such task is percussive riveting. Because percussive riveting is associated with a high risk of injury, these tool must be certified prior to release. The major contribution of this thesis is to develop a test bench capable of percussive riveting for ergonomic evaluation purposes. The major issues investigated are: (i) automate the tool evaluation method to be repeatable; (ii) demonstrate use of displacement and force sensors; and (iii) correlate performance and risk exposure of percussive tools. A test bench equipped with servomotors and pneumatic cylinders to control xyz-position of a rivet gun and bucking bar simultaneously, is used to explore this evaluation approach.

Altered States of Consciousness Profile: An Afro-Centric Intrapsychic Evaluation Tool

PubMed Central

Bell, Carl C.; Thompson, Belinda; Shorter-Gooden, Kumea; Mays, Raymond; Shakoor, Bambade

1985-01-01

In an effort to develop an Afro-centric intrapsychic evaluation tool, the Community Mental Health Council, Inc., Altered States of Consciousness Research Team, developed a structured interview used to quantify and qualify the 17 states of consciousness1 that occurred in black control, precare, and aftercare subjects. Differences were noted in the three groups as to the incidence, prevalence, and quality of the various states of consciousness. It was also noted that the profile obtained from the interviews yielded a sharp clinical picture of the subjects' total intrapsychic propensities. PMID:4057274

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

PubMed

Carney, Patricia A; Palmer, Ryan T; Fuqua Miller, Marissa; Thayer, Erin K; Estroff, Sue E; Litzelman, Debra K; Biagioli, Frances E; Teal, Cayla R; Lambros, Ann; Hatt, William J; Satterfield, Jason M

2016-05-01

Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review

PubMed Central

Carney, Patricia A.; Palmer, Ryan T.; Miller, Marissa Fuqua; Thayer, Erin K.; Estroff, Sue E.; Litzelman, Debra K.; Biagioli, Frances E.; Teal, Cayla R.; Lambros, Ann; Hatt, William J.; Satterfield, Jason M.

2015-01-01

Purpose Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. Method The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final, included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. Results Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. Conclusions These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development. PMID:26796091

Measuring Competencies of Higher Education Graduates

ERIC Educational Resources Information Center

Allen, Jim; Ramaekers, Ger; van der Velden, Rolf

2005-01-01

This chapter describes a new conceptual model for measuring competencies of higher education graduates. The proposed instrument can become a valuable tool for higher education quality management, policy evaluation, and scientific research. (Contains 1 figure.)

Quality Evaluation of Nursing Observation Based on a Survey of Nursing Documents Using NursingNAVI.

PubMed

Tsuru, Satoko; Omori, Miho; Inoue, Manami; Wako, Fumiko

2016-01-01

We have identified three foci of the nursing observation and nursing action respectively. Using these frameworks, we have developed the structured knowledge model for a number of diseases and medical interventions. We developed this structure based NursingNAVI^® contents collaborated with some quality centred hospitals. Authors analysed the nursing care documentations of post-gastrectomy patients in light of the standardized nursing care plan in the "NursingNAVI^®" developed by ourselves and revealed the "failure to observe" and "failure to document", which leaded to the volatility of the patients' data, conditions and some situation. This phenomenon should have been avoided if nurses had employed a standardized nursing care plan. So, we developed thinking process support system for planning, delivering, recording and evaluating in daily nursing using NursingNAVI^® contents. It is important to identify the problem of the volatility of the patients' data, conditions and some situation. We developed a survey tool of nursing documents using NursingNAVI^® Content for quality evaluation of nursing observation. We recommended some hospitals to use this survey tool. Fifteen hospitals participated the survey using this tool. It is estimated that the volatilizing situation. A hospital which don't participate this survey, knew the result. So the hospital decided to use NursingNAVI^® contents in HIS. It was suggested that the system has availability for nursing OJT and time reduction of planning and recording without volatilizing situation.

Study of the time and effort signal in cutting operations

NASA Astrophysics Data System (ADS)

Grosset, E.; Maillard, A.; Bouhelier, C.; Gasnier, J.

1990-02-01

Perception and treatment of an effort signal by computer methods is discussed. An automatic control system used to measure the wear of machine tools and carry out quality control throughout the cutting process is described. The testing system is used to evaluate the performance of tools which have been vacuum plated. The system is used as part of the BRITE study, the goal of which is to develop an expert system for measuring the wear of tools used during drilling and perforation operations.

Marky: a tool supporting annotation consistency in multi-user and iterative document annotation projects.

PubMed

Pérez-Pérez, Martín; Glez-Peña, Daniel; Fdez-Riverola, Florentino; Lourenço, Anália

2015-02-01

Document annotation is a key task in the development of Text Mining methods and applications. High quality annotated corpora are invaluable, but their preparation requires a considerable amount of resources and time. Although the existing annotation tools offer good user interaction interfaces to domain experts, project management and quality control abilities are still limited. Therefore, the current work introduces Marky, a new Web-based document annotation tool equipped to manage multi-user and iterative projects, and to evaluate annotation quality throughout the project life cycle. At the core, Marky is a Web application based on the open source CakePHP framework. User interface relies on HTML5 and CSS3 technologies. Rangy library assists in browser-independent implementation of common DOM range and selection tasks, and Ajax and JQuery technologies are used to enhance user-system interaction. Marky grants solid management of inter- and intra-annotator work. Most notably, its annotation tracking system supports systematic and on-demand agreement analysis and annotation amendment. Each annotator may work over documents as usual, but all the annotations made are saved by the tracking system and may be further compared. So, the project administrator is able to evaluate annotation consistency among annotators and across rounds of annotation, while annotators are able to reject or amend subsets of annotations made in previous rounds. As a side effect, the tracking system minimises resource and time consumption. Marky is a novel environment for managing multi-user and iterative document annotation projects. Compared to other tools, Marky offers a similar visually intuitive annotation experience while providing unique means to minimise annotation effort and enforce annotation quality, and therefore corpus consistency. Marky is freely available for non-commercial use at http://sing.ei.uvigo.es/marky. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Handling Qualities Optimization for Rotorcraft Conceptual Design

NASA Technical Reports Server (NTRS)

Lawrence, Ben; Theodore, Colin R.; Berger, Tom

2016-01-01

Over the past decade, NASA, under a succession of rotary-wing programs has been moving towards coupling multiple discipline analyses in a rigorous consistent manner to evaluate rotorcraft conceptual designs. Handling qualities is one of the component analyses to be included in a future NASA Multidisciplinary Analysis and Optimization framework for conceptual design of VTOL aircraft. Similarly, the future vision for the capability of the Concept Design and Assessment Technology Area (CD&A-TA) of the U.S Army Aviation Development Directorate also includes a handling qualities component. SIMPLI-FLYD is a tool jointly developed by NASA and the U.S. Army to perform modeling and analysis for the assessment of flight dynamics and control aspects of the handling qualities of rotorcraft conceptual designs. An exploration of handling qualities analysis has been carried out using SIMPLI-FLYD in illustrative scenarios of a tiltrotor in forward flight and single-main rotor helicopter at hover. Using SIMPLI-FLYD and the conceptual design tool NDARC integrated into a single process, the effects of variations of design parameters such as tail or rotor size were evaluated in the form of margins to fixed- and rotary-wing handling qualities metrics as well as the vehicle empty weight. The handling qualities design margins are shown to vary across the flight envelope due to both changing flight dynamic and control characteristics and changing handling qualities specification requirements. The current SIMPLI-FLYD capability and future developments are discussed in the context of an overall rotorcraft conceptual design process.

The Use of UV-Visible Reflectance Spectroscopy as an Objective Tool to Evaluate Pearl Quality

PubMed Central

Agatonovic-Kustrin, Snezana; Morton, David W.

2012-01-01

Assessing the quality of pearls involves the use of various tools and methods, which are mainly visual and often quite subjective. Pearls are normally classified by origin and are then graded by luster, nacre thickness, surface quality, size, color and shape. The aim of this study was to investigate the capacity of Artificial Neural Networks (ANNs) to classify and estimate the quality of 27 different pearls from their UV-Visible spectra. Due to the opaque nature of pearls, spectroscopy measurements were performed using the Diffuse Reflectance UV-Visible spectroscopy technique. The spectra were acquired at two different locations on each pearl sample in order to assess surface homogeneity. The spectral data (inputs) were smoothed to reduce the noise, fed into ANNs and correlated to the pearl’s quality/grading criteria (outputs). The developed ANNs were successful in predicting pearl type, mollusk growing species, possible luster and color enhancing, donor condition/type, recipient/host color, donor color, pearl luster, pearl color, origin. The results of this study shows that the developed UV-Vis spectroscopy-ANN method could be used as a more objective method of assessing pearl quality (grading) and may become a valuable tool for the pearl grading industry. PMID:22851919

The evolution of clinical audit as a tool for quality improvement.

PubMed

Berk, Michael; Callaly, Thomas; Hyland, Mary

2003-05-01

Clinical auditing practices are recognized universally as a useful tool in evaluating and improving the quality of care provided by a health service. External auditing is a regular activity for mental health services in Australia but internal auditing activities are conducted at the discretion of each service. This paper evaluates the effectiveness of 6 years of internal auditing activities in a mental health service. A review of the scope, audit tools, purpose, sampling and design of the internal audits and identification of the recommendations from six consecutive annual audit reports was completed. Audit recommendations were examined, as well as levels of implementation and reasons for success or failure. Fifty-seven recommendations were identified, with 35% without action, 28% implemented and 33.3% still pending or in progress. The recommendations were more likely to be implemented if they relied on activity, planning and action across a selection of service areas rather than being restricted to individual departments within a service, if they did not involve non-mental health service departments and if they were not reliant on attitudinal change. Tools used, scope and reporting formats have become more sophisticated as part of the evolutionary nature of the auditing process. Internal auditing in the Barwon Health Mental Health Service has been effective in producing change in the quality of care across the organization. A number of evolutionary changes in the audit process have improved the efficiency and effectiveness of the audit.

Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations.

PubMed

Papageorgiou, Spyridon N; Papadopoulos, Moschos A; Athanasiou, Athanasios E

2014-02-01

Ideally meta-analyses (MAs) should consolidate the characteristics of orthodontic research in order to produce an evidence-based answer. However severe flaws are frequently observed in most of them. The aim of this study was to evaluate the statistical methods, the methodology, and the quality characteristics of orthodontic MAs and to assess their reporting quality during the last years. Electronic databases were searched for MAs (with or without a proper systematic review) in the field of orthodontics, indexed up to 2011. The AMSTAR tool was used for quality assessment of the included articles. Data were analyzed with Student's t-test, one-way ANOVA, and generalized linear modelling. Risk ratios with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 80 MAs with 1086 primary studies were included in this evaluation. Using the AMSTAR tool, 25 (27.3%) of the MAs were found to be of low quality, 37 (46.3%) of medium quality, and 18 (22.5%) of high quality. Specific characteristics like explicit protocol definition, extensive searches, and quality assessment of included trials were associated with a higher AMSTAR score. Model selection and dealing with heterogeneity or publication bias were often problematic in the identified reviews. The number of published orthodontic MAs is constantly increasing, while their overall quality is considered to range from low to medium. Although the number of MAs of medium and high level seems lately to rise, several other aspects need improvement to increase their overall quality.

Dynamic extreme values modeling and monitoring by means of sea shores water quality biomarkers and valvometry.

PubMed

Durrieu, Gilles; Pham, Quang-Khoai; Foltête, Anne-Sophie; Maxime, Valérie; Grama, Ion; Tilly, Véronique Le; Duval, Hélène; Tricot, Jean-Marie; Naceur, Chiraz Ben; Sire, Olivier

2016-07-01

Water quality can be evaluated using biomarkers such as tissular enzymatic activities of endemic species. Measurement of molluscs bivalves activity at high frequency (e.g., valvometry) during a long time period is another way to record the animal behavior and to evaluate perturbations of the water quality in real time. As the pollution affects the activity of oysters, we consider the valves opening and closing velocities to monitor the water quality assessment. We propose to model the huge volume of velocity data collected in the framework of valvometry using a new nonparametric extreme values statistical model. The objective is to estimate the tail probabilities and the extreme quantiles of the distribution of valve closing velocity. The tail of the distribution function of valve closing velocity is modeled by a Pareto distribution with parameter t,τ , beyond a threshold τ according to the time t of the experiment. Our modeling approach reveals the dependence between the specific activity of two enzymatic biomarkers (Glutathione-S-transferase and acetylcholinesterase) and the continuous recording of oyster valve velocity, proving the suitability of this tool for water quality assessment. Thus, valvometry allows in real-time in situ analysis of the bivalves behavior and appears as an effective early warning tool in ecological risk assessment and marine environment monitoring.

Pharmaceutical quality assurance of local private distributors: a secondary analysis in 13 low-income and middle-income countries.

PubMed

Van Assche, Kerlijn; Nebot Giralt, Ariadna; Caudron, Jean Michel; Schiavetti, Benedetta; Pouget, Corinne; Tsoumanis, Achilleas; Meessen, Bruno; Ravinetto, Raffaella

2018-01-01

The rapid globalisation of the pharmaceutical production and distribution has not been supported by harmonisation of regulatory systems worldwide. Thus, the supply systems in low-income and middle-income countries (LMICs) remain exposed to the risk of poor-quality medicines. To contribute to estimating this risk in the private sector in LMICs, we assessed the quality assurance system of a convenient sample of local private pharmaceutical distributors. This descriptive study uses secondary data derived from the audits conducted by the QUAMED group at 60 local private pharmaceutical distributors in 13 LMICs. We assessed the distributors' compliance with good distribution practices (GDP), general quality requirements (GQR) and cold chain management (CCM), based on an evaluation tool inspired by the WHO guidelines 'Model Quality Assurance System (MQAS) for procurement agencies'. Descriptive statistics describe the compliance for the whole sample, for distributors in sub-Saharan Africa (SSA) versus those in non-SSA, and for those in low-income countries (LICs) versus middle-income countries (MICs). Local private pharmaceutical distributors in our sample were non-compliant, very low-compliant or low-compliant for GQR (70%), GDP (60%) and CCM (41%). Only 7/60 showed good to full compliance for at least two criteria. Observed compliance varies by geographical region and by income group: maximum values are higher in non-SSA versus SSA and in MICs versus LICs, while minimum values are the same across different groups. The poor compliance with WHO quality standards observed in our sample indicates a concrete risk that patients in LMICs are exposed to poor-quality or degraded medicines. Significant investments are needed to strengthen the regulatory supervision, including on private pharmaceutical distributors. An adapted standardised evaluation tool inspired by the WHO MQAS would be helpful for self-evaluation, audit and inspection purposes.

Sensory and rapid instrumental methods as a combined tool for quality control of cooked ham.

PubMed

Barbieri, Sara; Soglia, Francesca; Palagano, Rosa; Tesini, Federica; Bendini, Alessandra; Petracci, Massimiliano; Cavani, Claudio; Gallina Toschi, Tullia

2016-11-01

In this preliminary investigation, different commercial categories of Italian cooked pork hams have been characterized using an integrated approach based on both sensory and fast instrumental measurements. For these purposes, Italian products belonging to different categories (cooked ham, "selected" cooked ham and "high quality" cooked ham) were evaluated by sensory descriptive analysis and by the application of rapid tools such as image analysis by an "electronic eye" and texture analyzer. The panel of trained assessors identified and evaluated 10 sensory descriptors able to define the quality of the products. Statistical analysis highlighted that sensory characteristics related to appearance and texture were the most significant in discriminating samples belonged to the highest (high quality cooked hams) and the lowest (cooked hams) quality of the product whereas the selected cooked hams, showed intermediate characteristics. In particular, high quality samples were characterized, above all, by the highest intensity of pink intensity, typical appearance and cohesiveness, and, at the same time, by the lowest intensity of juiciness; standard cooked ham samples showed the lowest intensity of all visual attributes and the highest value of juiciness, whereas the intermediate category (selected cooked ham) was not discriminated from the other. Also physical-rheological parameters measured by electronic eye and texture analyzer were effective in classifying samples. In particular, the PLS model built with data obtained from the electronic eye showed a satisfactory performance in terms of prediction of the pink intensity and presence of fat attributes evaluated during the sensory visual phase. This study can be considered a first application of this combined approach that could represent a suitable and fast method to verify if the meat product purchased by consumer match its description in terms of compliance with the claimed quality.

Teacher Evaluation Tools: An Examination of Wyoming Evaluation Models as a Predictor of Student Achievement

ERIC Educational Resources Information Center

Gilbert, Andrea

2014-01-01

The purpose of this study was to understand the relationship between teacher quality, student characteristics, teacher attributes, and student growth in reading. The legislation requirements enacted with NCLB (2002), WAEA (2013), and Chapter 29 (Wyoming Department of Education, 2010) necessitated that student achievement be a primary consideration…

Acoustic measurements on trees and logs: a review and analysis

Treesearch

Xiping Wang

2013-01-01

Acoustic technologies have been well established as material evaluation tools in the past several decades, and their use has become widely accepted in the forest products industry for online quality control and products grading. Recent research developments on acoustic sensing technology offer further opportunities to evaluate standing trees and logs for general wood...

Randomization and Data-Analysis Items in Quality Standards for Single-Case Experimental Studies

ERIC Educational Resources Information Center

Heyvaert, Mieke; Wendt, Oliver; Van den Noortgate, Wim; Onghena, Patrick

2015-01-01

Reporting standards and critical appraisal tools serve as beacons for researchers, reviewers, and research consumers. Parallel to existing guidelines for researchers to report and evaluate group-comparison studies, single-case experimental (SCE) researchers are in need of guidelines for reporting and evaluating SCE studies. A systematic search was…

Development and evaluation of the microbial fate and transport module for the Agricultural Policy/Environmental eXtender (APEX) model

USDA-ARS?s Scientific Manuscript database

Microbial contamination of waters in agricultural watershed is the critical public health issue. The watershed-scale model has been proven to be one of the candidate tools for predicting microbial water quality and evaluating management practices. The Agricultural Policy/Environmental eXtender (APEX...

A condition metric for Eucalyptus woodland derived from expert evaluations.

PubMed

Sinclair, Steve J; Bruce, Matthew J; Griffioen, Peter; Dodd, Amanda; White, Matthew D

2018-02-01

The evaluation of ecosystem quality is important for land-management and land-use planning. Evaluation is unavoidably subjective, and robust metrics must be based on consensus and the structured use of observations. We devised a transparent and repeatable process for building and testing ecosystem metrics based on expert data. We gathered quantitative evaluation data on the quality of hypothetical grassy woodland sites from experts. We used these data to train a model (an ensemble of 30 bagged regression trees) capable of predicting the perceived quality of similar hypothetical woodlands based on a set of 13 site variables as inputs (e.g., cover of shrubs, richness of native forbs). These variables can be measured at any site and the model implemented in a spreadsheet as a metric of woodland quality. We also investigated the number of experts required to produce an opinion data set sufficient for the construction of a metric. The model produced evaluations similar to those provided by experts, as shown by assessing the model's quality scores of expert-evaluated test sites not used to train the model. We applied the metric to 13 woodland conservation reserves and asked managers of these sites to independently evaluate their quality. To assess metric performance, we compared the model's evaluation of site quality with the managers' evaluations through multidimensional scaling. The metric performed relatively well, plotting close to the center of the space defined by the evaluators. Given the method provides data-driven consensus and repeatability, which no single human evaluator can provide, we suggest it is a valuable tool for evaluating ecosystem quality in real-world contexts. We believe our approach is applicable to any ecosystem. © 2017 State of Victoria.

Photomask quality evaluation using lithography simulation and multi-detector MVM-SEM

NASA Astrophysics Data System (ADS)

Ito, Keisuke; Murakawa, Tsutomu; Fukuda, Naoki; Shida, Soichi; Iwai, Toshimichi; Matsumoto, Jun; Nakamura, Takayuki; Matsushita, Shohei; Hagiwara, Kazuyuki; Hara, Daisuke

2013-06-01

The detection and management of mask defects which are transferred onto wafer becomes more important day by day. As the photomask patterns becomes smaller and more complicated, using Inverse Lithography Technology (ILT) and Source Mask Optimization (SMO) with Optical Proximity Correction (OPC). To evaluate photomask quality, the current method uses aerial imaging by optical inspection tools. This technique at 1Xnm node has a resolution limit because small defects will be difficult to detect. We already reported the MEEF influence of high-end photomask using wide FOV SEM contour data of "E3630 MVM-SEM®" and lithography simulator "TrueMask® DS" of D2S Inc. in the prior paper [1]. In this paper we evaluate the correlation between our evaluation method and optical inspection tools as ongoing assessment. Also in order to reduce the defect classification work, we can compose the 3 Dimensional (3D) information of defects and can judge whether repairs of defects would be required. Moreover, we confirm the possibility of wafer plane CD measurement based on the combination between E3630 MVM-SEM® and 3D lithography simulation.

Evaluating the Implementation of a Training Program for Improving Quality Service: An Action Research Study

ERIC Educational Resources Information Center

Pierre, Ketly Dieudonne

2014-01-01

There is a need to implement a comprehensive training program to build employees' knowledge, skills, and attitudes in order to improve quality service at ABC Restaurant because of a surge in customer complaints. The purpose of this study was to develop a training program that included an employee handbook as a training tool, a handbook designed…

Functional Assessments Used by Occupational Therapists with Older Adults at Risk of Activity and Participation Limitations: A Systematic Review

PubMed Central

Wales, Kylie; Clemson, Lindy; Lannin, Natasha; Cameron, Ian

2016-01-01

Introduction The use of functional assessments to evaluate patient change is complicated by a lack of consensus as to which assessment is most suitable for use with older adults. Objective: To identify and appraise the properties of assessments used to evaluate functional abilities in older adults. Methods A systematic review of randomised controlled trials of occupational therapy interventions was conducted up to 2012 to identify assessments used to measure function. Two authors screened and extracted data independently. A second search then identified papers investigating measurement properties of each assessment. Studies from the second search were included if: i) published in English, ii) the assessment was not modified from its original published form, iii) study aim was to evaluate the quality of the tool, iv) and was original research. Translated versions of assessments were excluded. Measurement quality was rated using the COSMIN checklist and Terwee criteria. Results Twenty-eight assessments were identified from the systematic search of occupational therapy interventions provided to older adults. Assessments were of varied measurement quality and many had been adapted (although still evaluated as though the original tool had been administered) potentially altering the conclusions drawn about measurement quality. Synthesis of best evidence established 15 functional assessments have not been tested in an older adult population. Conclusions The Functional Autonomy Measurement System (SMAF) appears to be a promising assessment for use with older adults. Only two tools (the SMAF and the Assessment of Motor and Process Skills (AMPS)) were deemed to be responsive to change when applied to older adults. Health professionals should use functional assessments that have been validated with their population and in their setting. There are reliable and valid assessments to capture the functional performance of older adults in community and hospital settings, although further refinement of these assessments may be necessary. PMID:26859678

Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors

NASA Technical Reports Server (NTRS)

Matthies, Larry; Grandjean, Pierrick

1993-01-01

Statistical modeling and evaluation of the performance of obstacle detection systems for Unmanned Ground Vehicles (UGVs) is essential for the design, evaluation, and comparison of sensor systems. In this report, we address this issue for imaging range sensors by dividing the evaluation problem into two levels: quality of the range data itself and quality of the obstacle detection algorithms applied to the range data. We review existing models of the quality of range data from stereo vision and AM-CW LADAR, then use these to derive a new model for the quality of a simple obstacle detection algorithm. This model predicts the probability of detecting obstacles and the probability of false alarms, as a function of the size and distance of the obstacle, the resolution of the sensor, and the level of noise in the range data. We evaluate these models experimentally using range data from stereo image pairs of a gravel road with known obstacles at several distances. The results show that the approach is a promising tool for predicting and evaluating the performance of obstacle detection with imaging range sensors.

Numerical Implementation of Indicators and Statistical Control Tools in Monitoring and Evaluating CACEI-ISO Indicators of Study Program in Industrial Process by Systematization

ERIC Educational Resources Information Center

Ayala, Gabriela Cota; Real, Francia Angélica Karlos; Ivan, Ramirez Alvarado Edqar

2016-01-01

The research was conducted to determine if the study program of the career of industrial processes Technological University of Chihuahua, 1 year after that it was certified by CACEI, continues achieving the established indicators and ISO 9001: 2008, implementing quality tools, monitoring of essential indicators are determined, flow charts are…

Development and Evaluation of a Riparian Buffer Mapping Tool

USGS Publications Warehouse

Milheim, Lesley E.; Claggett, Peter

2008-01-01

Land use and land cover within riparian areas greatly affect the conditions of adjacent water features. In particular, riparian forests provide many environmental benefits, including nutrient uptake, bank stabilization, steam shading, sediment trapping, aquatic and terrestrial habitat, and stream organic matter. In contrast, residential and commercial development and associated transportation infrastructure increase pollutant and nutrient loading and change the hydrologic characteristics of the landscape, thereby affecting both water quality and habitat. Restoring riparian areas is a popular and cost effective restoration technique to improve and protect water quality. Recognizing this, the Chesapeake Executive Council committed to restoring 10,000 miles of riparian forest buffers throughout the Chesapeake Bay watershed by the year 2010. In 2006, the Chesapeake Executive Council further committed to 'using the best available...tools to identify areas where retention and expansion of forests is most needed to protect water quality'. The Chesapeake Bay watershed encompasses 64,000 square miles, including portions of six States and Washington, D.C. Therefore, the interpretation of remotely sensed imagery provides the only effective technique for comprehensively evaluating riparian forest protection and restoration opportunities throughout the watershed. Although 30-meter-resolution land use and land cover data have proved useful on a regional scale, they have not been equally successful at providing the detail required for local-scale assessment of riparian area characteristics. Use of high-resolution imagery (HRI) provides sufficient detail for local-scale assessments, although at greater cost owing to the cost of the imagery and the skill and time required to process the data. To facilitate the use of HRI for monitoring the extent of riparian forest buffers, the U.S. Forest Service and the U.S. Geological Survey Eastern Geographic Science Center funded the development of a prototype semiautomated image classification tool, RBMapper, that is designed for use by technicians with limited image processing training. This document provides an overview of the RBMapper tool, includes instructions on how to obtain the RBMapper tool and tutorial datasets, and contains a summary evaluation of the tool

Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools.

PubMed

Lichtner, Valentina; Dowding, Dawn; Esterhuizen, Philip; Closs, S José; Long, Andrew F; Corbett, Anne; Briggs, Michelle

2014-12-17

There is evidence of under-detection and poor management of pain in patients with dementia, in both long-term and acute care. Accurate assessment of pain in people with dementia is challenging and pain assessment tools have received considerable attention over the years, with an increasing number of tools made available. Systematic reviews on the evidence of their validity and utility mostly compare different sets of tools. This review of systematic reviews analyses and summarises evidence concerning the psychometric properties and clinical utility of pain assessment tools in adults with dementia or cognitive impairment. We searched for systematic reviews of pain assessment tools providing evidence of reliability, validity and clinical utility. Two reviewers independently assessed each review and extracted data from them, with a third reviewer mediating when consensus was not reached. Analysis of the data was carried out collaboratively. The reviews were synthesised using a narrative synthesis approach. We retrieved 441 potentially eligible reviews, 23 met the criteria for inclusion and 8 provided data for extraction. Each review evaluated between 8 and 13 tools, in aggregate providing evidence on a total of 28 tools. The quality of the reviews varied and the reporting often lacked sufficient methodological detail for quality assessment. The 28 tools appear to have been studied in a variety of settings and with varied types of patients. The reviews identified several methodological limitations across the original studies. The lack of a 'gold standard' significantly hinders the evaluation of tools' validity. Most importantly, the samples were small providing limited evidence for use of any of the tools across settings or populations. There are a considerable number of pain assessment tools available for use with the elderly cognitive impaired population. However there is limited evidence about their reliability, validity and clinical utility. On the basis of this review no one tool can be recommended given the existing evidence.

A web-based screening tool for near-port air quality assessments

PubMed Central

Isakov, Vlad; Barzyk, Timothy M.; Smith, Elizabeth R.; Arunachalam, Saravanan; Naess, Brian; Venkatram, Akula

2018-01-01

The Community model for near-PORT applications (C-PORT) is a screening tool with an intended purpose of calculating differences in annual averaged concentration patterns and relative contributions of various source categories over the spatial domain within about 10 km of the port. C-PORT can inform decision-makers and concerned citizens about local air quality due to mobile source emissions related to commercial port activities. It allows users to visualize and evaluate different planning scenarios, helping them identify the best alternatives for making long-term decisions that protect community health and sustainability. The web-based, easy-to-use interface currently includes data from 21 seaports primarily in the Southeastern U.S., and has a map-based interface based on Google Maps. The tool was developed to visualize and assess changes in air quality due to changes in emissions and/or meteorology in order to analyze development scenarios, and is not intended to support or replace any regulatory models or programs. PMID:29681760

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

Optimal changes in the prepress process: a model for evaluation of state and direction of productivity and quality improvements

NASA Astrophysics Data System (ADS)

Kihlberg, Henrik; Lindgren, Mats

1998-09-01

The demands changes with the customers marketplace which makes it crucial for prepress companies of today and those of tomorrow to be able to change their services. The production tools are becoming more standardized and similar through out the industry. Intelligent tools are developed at a rapid pace which results in possibilities to automate these processes. Key success factors of today and tomorrow are the ability to change and understand the customers' market. The market demands shorter delivery times and lower costs. The total number of printed editions are decreasing while each edition contains an increased numbers of pages and images. The customers requires higher quality with the ability to control and predict the end result. Case studies, interviews and workshops have been carried out at commercial printing companies, prepress houses, image bureau's, advertising agencies and digital photographers in Sweden. A major part of the research focus on the digital image process at eleven companies in the graphic arts industry, all of which have prepress. The analysis has resulted in the thorough knowledge of both the production process and the parameters to measure productivity and quality. A model for the evaluation of changes is presented, with measurable values for productivity and quality. The model can be used to map and compare the states prepress are in, and/or be used to evaluate if changes are needed.

Reliability of specific physical examination tests for the diagnosis of shoulder pathologies: a systematic review and meta-analysis.

PubMed

Lange, Toni; Matthijs, Omer; Jain, Nitin B; Schmitt, Jochen; Lützner, Jörg; Kopkow, Christian

2017-03-01

Shoulder pain in the general population is common and to identify the aetiology of shoulder pain, history, motion and muscle testing, and physical examination tests are usually performed. The aim of this systematic review was to summarise and evaluate intrarater and inter-rater reliability of physical examination tests in the diagnosis of shoulder pathologies. A comprehensive systematic literature search was conducted using MEDLINE, EMBASE, Allied and Complementary Medicine Database (AMED) and Physiotherapy Evidence Database (PEDro) through 20 March 2015. Methodological quality was assessed using the Quality Appraisal of Reliability Studies (QAREL) tool by 2 independent reviewers. The search strategy revealed 3259 articles, of which 18 finally met the inclusion criteria. These studies evaluated the reliability of 62 test and test variations used for the specific physical examination tests for the diagnosis of shoulder pathologies. Methodological quality ranged from 2 to 7 positive criteria of the 11 items of the QAREL tool. This review identified a lack of high-quality studies evaluating inter-rater as well as intrarater reliability of specific physical examination tests for the diagnosis of shoulder pathologies. In addition, reliability measures differed between included studies hindering proper cross-study comparisons. PROSPERO CRD42014009018. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Kaiser Permanente implant registries benefit patient safety, quality improvement, cost-effectiveness.

PubMed

Paxton, Elizabeth W; Kiley, Mary-Lou; Love, Rebecca; Barber, Thomas C; Funahashi, Tadashi T; Inacio, Maria C S

2013-06-01

In response to the increased volume, risk, and cost of medical devices, in 2001 Kaiser Permanente (KP) developed implant registries to enhance patient safety and quality, and to evaluate cost-effectiveness. Using an integrated electronic health record system, administrative databases, and other institutional databases, orthopedic, cardiology, and vascular implant registries were developed in 2001, 2006, and 2011, respectively. These registries monitor patients, implants, clinical practices, and surgical outcomes for KP's 9 million members. Critical to registry success is surgeon leadership and engagement; each geographical region has a surgeon champion who provides feedback on registry initiatives and disseminates registry findings. The registries enhance patient safety by providing a variety of clinical decision tools such as risk calculators, quality reports, risk-adjusted medical center reports, summaries of surgeon data, and infection control reports to registry stakeholders. The registries are used to immediately identify patients with recalled devices, evaluate new and established device technology, and identify outlier implants. The registries contribute to cost-effectiveness initiatives through collaboration with sourcing and contracting groups and confirming adherence to device formulary guidelines. Research studies based on registry data have directly influenced clinical best practices. Registries are important tools to evaluate longitudinal device performance and safety, study the clinical indications for and outcomes of device implantation, respond promptly to recalls and advisories, and contribute to the overall high quality of care of our patients.

ScanRanker: Quality Assessment of Tandem Mass Spectra via Sequence Tagging

PubMed Central

Ma, Ze-Qiang; Chambers, Matthew C.; Ham, Amy-Joan L.; Cheek, Kristin L.; Whitwell, Corbin W.; Aerni, Hans-Rudolf; Schilling, Birgit; Miller, Aaron W.; Caprioli, Richard M.; Tabb, David L.

2011-01-01

In shotgun proteomics, protein identification by tandem mass spectrometry relies on bioinformatics tools. Despite recent improvements in identification algorithms, a significant number of high quality spectra remain unidentified for various reasons. Here we present ScanRanker, an open-source tool that evaluates the quality of tandem mass spectra via sequence tagging with reliable performance in data from different instruments. The superior performance of ScanRanker enables it not only to find unassigned high quality spectra that evade identification through database search, but also to select spectra for de novo sequencing and cross-linking analysis. In addition, we demonstrate that the distribution of ScanRanker scores predicts the richness of identifiable spectra among multiple LC-MS/MS runs in an experiment, and ScanRanker scores assist the process of peptide assignment validation to increase confident spectrum identifications. The source code and executable versions of ScanRanker are available from http://fenchurch.mc.vanderbilt.edu. PMID:21520941

A GIS Tool for evaluating and improving NEXRAD and its application in distributed hydrologic modeling

NASA Astrophysics Data System (ADS)

Zhang, X.; Srinivasan, R.

2008-12-01

In this study, a user friendly GIS tool was developed for evaluating and improving NEXRAD using raingauge data. This GIS tool can automatically read in raingauge and NEXRAD data, evaluate the accuracy of NEXRAD for each time unit, implement several geostatistical methods to improve the accuracy of NEXRAD through raingauge data, and output spatial precipitation map for distributed hydrologic model. The geostatistical methods incorporated in this tool include Simple Kriging with varying local means, Kriging with External Drift, Regression Kriging, Co-Kriging, and a new geostatistical method that was newly developed by Li et al. (2008). This tool was applied in two test watersheds at hourly and daily temporal scale. The preliminary cross-validation results show that incorporating raingauge data to calibrate NEXRAD can pronouncedly change the spatial pattern of NEXRAD and improve its accuracy. Using different geostatistical methods, the GIS tool was applied to produce long term precipitation input for a distributed hydrologic model - Soil and Water Assessment Tool (SWAT). Animated video was generated to vividly illustrate the effect of using different precipitation input data on distributed hydrologic modeling. Currently, this GIS tool is developed as an extension of SWAT, which is used as water quantity and quality modeling tool by USDA and EPA. The flexible module based design of this tool also makes it easy to be adapted for other hydrologic models for hydrological modeling and water resources management.

Contamination and Surface Preparation Effects on Composite Bonding

NASA Technical Reports Server (NTRS)

Kutscha, Eileen O.; Vahey, Paul G.; Belcher, Marcus A.; VanVoast, Peter J.; Grace, William B.; Blohowiak, Kay Y.; Palmieri, Frank L.; Connell, John W.

2017-01-01

Results presented here demonstrate the effect of several prebond surface contaminants (hydrocarbon, machining fluid, latex, silicone, peel ply residue, release film) on bond quality, as measured by fracture toughness and failure modes of carbon fiber reinforced epoxy substrates bonded in secondary and co-bond configurations with paste and film adhesives. Additionally, the capability of various prebond surface property measurement tools to detect contaminants and potentially predict subsequent bond performance of three different adhesives is also shown. Surface measurement methods included water contact angle, Dyne solution wettability, optically stimulated electron emission spectroscopy, surface free energy, inverse gas chromatography, and Fourier transform infrared spectroscopy with chemometrics analysis. Information will also be provided on the effectiveness of mechanical and energetic surface treatments to recover a bondable surface after contamination. The benefits and drawbacks of the various surface analysis tools to detect contaminants and evaluate prebond surfaces after surface treatment were assessed as well as their ability to correlate to bond performance. Surface analysis tools were also evaluated for their potential use as in-line quality control of adhesive bonding parameters in the manufacturing environment.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

Assessing health-related quality of life in patients with breast cancer: a systematic and standardized comparison of available instruments using the EMPRO tool.

PubMed

Maratia, Stefano; Cedillo, Sergio; Rejas, Javier

2016-10-01

The objective was to obtain a standardized evaluation of available specific and generic breast cancer health-related quality-of-life instruments. We carried out systematic literature reviews in the PubMed and EMBASE databases to identify manuscripts which contained information regarding either the development process or metric properties of health-related quality-of-life instruments used among breast cancer patients. Each instrument was evaluated independently by two researchers, and occasionally a third one, using the Evaluating Measures of Patient-Reported Outcomes (EMPRO) tool. An overall score and seven attribute-specific EMPRO scores were calculated (range 0-100, worst to best): concept and measurement model, reliability, validity, responsiveness, interpretability, burden, and alternative forms. FACT-B was the instrument with the best global performance, obtaining an overall EMPRO score of 79.27. It was also the most accurate instrument on the Concept and Measurement Model, Reliability, and Interpretability attributes. Four more instruments scored over 50 points on the overall score, which summarizes the five attribute-specific scores: EORTC BR-23, IBCSG, WHO-QOL BREF, and SF-36. An overall score of at least 50 points implies that the use of these instruments could be recommended for assessing health-related quality of life in breast cancer patients. The FACT-B scored the highest on overall on our EMPRO evaluation of instruments measuring health-related quality of life among breast cancer patients. However, depending on the purpose of the study, several instruments (EORTC BR-23, IBCSG, SF-36, and WHO-QOL BREF) have shown good performance in some of the specific individual dimensions included in the EMPRO.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Study of the questionnaire of the Polytechnic University of Valencia (UPV) teaching staff, using students opinion survey. Statistical treatment

NASA Astrophysics Data System (ADS)

Martinez Gomez, Monica

Quality improvement of university institutions represents the most important challenge in the next years, and the potential tool to achieve it is based on the institutional evaluation in general, and specially the evaluation of the teaching performance. The opinion questionnaire from the students is the most generalised tool used to evaluate the teaching performance at Spanish universities. The general objective of this thesis is to develop a statistical methodology suitable to extract, analyse and interpret the information contained in the Questionnaire of Teaching Evaluation from Student Opinion (CEDA) of the UPV, aimed at optimising its practical use. The study is centred in the application of different multivariate techniques and has been structured in three parts: (1) Evaluation of the reliability, validity and dimensionality of the tool. The multivariate method used for this purpose is the Factorial Analysis. (2) Determination of the capacity of the questionnaire to identify different profiles of lecturers based on the quality perceived by students. This target is conducted with different multivariate classification techniques: hierarchical cluster analysis, non-hierarchical and two-stage analysis. Moreover, those items that best discriminate among the teaching typologies obtained are identified in the questionnaire. (3) Identification of the teaching typologies according to different descriptive characteristics referent to the subject and lecturer, with the use of decision trees. Once identified these typologies, a new discriminant analysis is conducted aimed at identifying those items that best characterise each typology. Finally, a study is carried out with the classification method SIMCA (Soft Independent Modelling of Class Analogy) in order to determine the discriminant loading of every item among the identified teaching typologies, allowing the identification of those that best distinguish the different classes obtained. With the combined use of the proposed techniques, it is expected to optimise the use of CEDA as a measuring tool and an indicator of the teaching quality at the university, that would allow the introduction of actions for the continuous improvement in the teaching processes of the UPV.

The relationship between building design and residents' quality of life in extra care housing schemes.

PubMed

Orrell, Alison; McKee, Kevin; Torrington, Judith; Barnes, Sarah; Darton, Robin; Netten, Ann; Lewis, Alan

2013-05-01

Well-designed housing is recognised as being an important factor in promoting a good quality of life. Specialised housing models incorporating care services, such as extra care housing (ECH) schemes are seen as enabling older people to maintain a good quality of life despite increasing health problems that can accompany ageing. Despite the variation in ECH building design little is known about the impact of ECH building design on the quality of life of building users. The evaluation of older people's living environments (EVOLVE) study collected cross-sectional data on building design and quality of life in 23 ECH schemes in England, UK. Residents' quality of life was assessed using the schedule for the evaluation of individual quality of life-direct weighting (SEIQoL-DW) and on the four domains of control, autonomy, self-realisation and pleasure on the CASP-19. Building design was measured on 12 user-related domains by means of a new tool; the EVOLVE tool. Using multilevel linear regression, significant associations were found between several aspects of building design and quality of life. Furthermore, there was evidence that the relationship between building design and quality of life was partly mediated by the dependency of participants and scheme size (number of living units). Our findings suggest that good quality building design in ECH can support the quality of life of residents, but that designing features that support the needs of both relatively independent and frail users is problematic, with the needs of highly dependent users not currently supported as well as could be hoped by ECH schemes. Copyright © 2013 Elsevier Ltd. All rights reserved.

Developing Oral Case Presentation Skills: Peer and Self-Evaluations as Instructional Tools.

PubMed

Williams, Dustyn E; Surakanti, Shravani

2016-01-01

Oral case presentation is an essential skill in clinical practice that is decidedly varied and understudied in teaching curricula. We developed a curriculum to improve oral case presentation skills in medical students. As part of an internal medicine clerkship, students receive instruction in the elements of a good oral case presentation and then present a real-world case in front of a video camera. Each student self-evaluates his/her presentation and receives evaluations from his/her peers. We expect peer and self-evaluation to be meaningful tools for developing skills in oral presentation. We hope to not only improve the quality of oral case presentations by students but also to reduce the time burden on faculty.

Technical Note: Development and performance of a software tool for quality assurance of online replanning with a conventional Linac or MR-Linac.

PubMed

Chen, Guang-Pei; Ahunbay, Ergun; Li, X Allen

2016-04-01

To develop an integrated quality assurance (QA) software tool for online replanning capable of efficiently and automatically checking radiation treatment (RT) planning parameters and gross plan quality, verifying treatment plan data transfer from treatment planning system (TPS) to record and verify (R&V) system, performing a secondary monitor unit (MU) calculation with or without a presence of a magnetic field from MR-Linac, and validating the delivery record consistency with the plan. The software tool, named ArtQA, was developed to obtain and compare plan and treatment parameters from both the TPS and the R&V system database. The TPS data are accessed via direct file reading and the R&V data are retrieved via open database connectivity and structured query language. Plan quality is evaluated with both the logical consistency of planning parameters and the achieved dose-volume histograms. Beams in between the TPS and R&V system are matched based on geometry configurations. To consider the effect of a 1.5 T transverse magnetic field from MR-Linac in the secondary MU calculation, a method based on modified Clarkson integration algorithm was developed and tested for a series of clinical situations. ArtQA has been used in their clinic and can quickly detect inconsistencies and deviations in the entire RT planning process. With the use of the ArtQA tool, the efficiency for plan check including plan quality, data transfer, and delivery check can be improved by at least 60%. The newly developed independent MU calculation tool for MR-Linac reduces the difference between the plan and calculated MUs by 10%. The software tool ArtQA can be used to perform a comprehensive QA check from planning to delivery with conventional Linac or MR-Linac and is an essential tool for online replanning where the QA check needs to be performed rapidly.

Technical Note: Development and performance of a software tool for quality assurance of online replanning with a conventional Linac or MR-Linac

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, Guang-Pei, E-mail: gpchen@mcw.edu; Ahunbay, Ergun; Li, X. Allen

Purpose: To develop an integrated quality assurance (QA) software tool for online replanning capable of efficiently and automatically checking radiation treatment (RT) planning parameters and gross plan quality, verifying treatment plan data transfer from treatment planning system (TPS) to record and verify (R&V) system, performing a secondary monitor unit (MU) calculation with or without a presence of a magnetic field from MR-Linac, and validating the delivery record consistency with the plan. Methods: The software tool, named ArtQA, was developed to obtain and compare plan and treatment parameters from both the TPS and the R&V system database. The TPS data aremore » accessed via direct file reading and the R&V data are retrieved via open database connectivity and structured query language. Plan quality is evaluated with both the logical consistency of planning parameters and the achieved dose–volume histograms. Beams in between the TPS and R&V system are matched based on geometry configurations. To consider the effect of a 1.5 T transverse magnetic field from MR-Linac in the secondary MU calculation, a method based on modified Clarkson integration algorithm was developed and tested for a series of clinical situations. Results: ArtQA has been used in their clinic and can quickly detect inconsistencies and deviations in the entire RT planning process. With the use of the ArtQA tool, the efficiency for plan check including plan quality, data transfer, and delivery check can be improved by at least 60%. The newly developed independent MU calculation tool for MR-Linac reduces the difference between the plan and calculated MUs by 10%. Conclusions: The software tool ArtQA can be used to perform a comprehensive QA check from planning to delivery with conventional Linac or MR-Linac and is an essential tool for online replanning where the QA check needs to be performed rapidly.« less

Quasi-experimental study designs series-paper 6: risk of bias assessment.

PubMed

Waddington, Hugh; Aloe, Ariel M; Becker, Betsy Jane; Djimeu, Eric W; Hombrados, Jorge Garcia; Tugwell, Peter; Wells, George; Reeves, Barney

2017-09-01

Rigorous and transparent bias assessment is a core component of high-quality systematic reviews. We assess modifications to existing risk of bias approaches to incorporate rigorous quasi-experimental approaches with selection on unobservables. These are nonrandomized studies using design-based approaches to control for unobservable sources of confounding such as difference studies, instrumental variables, interrupted time series, natural experiments, and regression-discontinuity designs. We review existing risk of bias tools. Drawing on these tools, we present domains of bias and suggest directions for evaluation questions. The review suggests that existing risk of bias tools provide, to different degrees, incomplete transparent criteria to assess the validity of these designs. The paper then presents an approach to evaluating the internal validity of quasi-experiments with selection on unobservables. We conclude that tools for nonrandomized studies of interventions need to be further developed to incorporate evaluation questions for quasi-experiments with selection on unobservables. Copyright © 2017 Elsevier Inc. All rights reserved.

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

How does study quality affect the results of a diagnostic meta-analysis?

PubMed Central

Westwood, Marie E; Whiting, Penny F; Kleijnen, Jos

2005-01-01

Background The use of systematic literature review to inform evidence based practice in diagnostics is rapidly expanding. Although the primary diagnostic literature is extensive, studies are often of low methodological quality or poorly reported. There has been no rigorously evaluated, evidence based tool to assess the methodological quality of diagnostic studies. The primary objective of this study was to determine the extent to which variations in the quality of primary studies impact the results of a diagnostic meta-analysis and whether this differs with diagnostic test type. A secondary objective was to contribute to the evaluation of QUADAS, an evidence-based tool for the assessment of quality in diagnostic accuracy studies. Methods This study was conducted as part of large systematic review of tests used in the diagnosis and further investigation of urinary tract infection (UTI) in children. All studies included in this review were assessed using QUADAS, an evidence-based tool for the assessment of quality in systematic reviews of diagnostic accuracy studies. The impact of individual components of QUADAS on a summary measure of diagnostic accuracy was investigated using regression analysis. The review divided the diagnosis and further investigation of UTI into the following three clinical stages: diagnosis of UTI, localisation of infection, and further investigation of the UTI. Each stage used different types of diagnostic test, which were considered to involve different quality concerns. Results Many of the studies included in our review were poorly reported. The proportion of QUADAS items fulfilled was similar for studies in different sections of the review. However, as might be expected, the individual items fulfilled differed between the three clinical stages. Regression analysis found that different items showed a strong association with test performance for the different tests evaluated. These differences were observed both within and between the three clinical stages assessed by the review. The results of regression analyses were also affected by whether or not a weighting (by sample size) was applied. Our analysis was severely limited by the completeness of reporting and the differences between the index tests evaluated and the reference standards used to confirm diagnoses in the primary studies. Few tests were evaluated by sufficient studies to allow meaningful use of meta-analytic pooling and investigation of heterogeneity. This meant that further analysis to investigate heterogeneity could only be undertaken using a subset of studies, and that the findings are open to various interpretations. Conclusion Further work is needed to investigate the influence of methodological quality on the results of diagnostic meta-analyses. Large data sets of well-reported primary studies are needed to address this question. Without significant improvements in the completeness of reporting of primary studies, progress in this area will be limited. PMID:15943861

Analysis of Illumina Microbial Assemblies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Clum, Alicia; Foster, Brian; Froula, Jeff

2010-05-28

Since the emerging of second generation sequencing technologies, the evaluation of different sequencing approaches and their assembly strategies for different types of genomes has become an important undertaken. Next generation sequencing technologies dramatically increase sequence throughput while decreasing cost, making them an attractive tool for whole genome shotgun sequencing. To compare different approaches for de-novo whole genome assembly, appropriate tools and a solid understanding of both quantity and quality of the underlying sequence data are crucial. Here, we performed an in-depth analysis of short-read Illumina sequence assembly strategies for bacterial and archaeal genomes. Different types of Illumina libraries as wellmore » as different trim parameters and assemblers were evaluated. Results of the comparative analysis and sequencing platforms will be presented. The goal of this analysis is to develop a cost-effective approach for the increased throughput of the generation of high quality microbial genomes.« less

Reliability and utility of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII) for auditing and quality development in services for adults with intellectual disability and challenging behaviour.

PubMed

McVilly, K; Webber, L; Paris, M; Sharp, G

2013-08-01

Having an objective means of evaluating the quality of behaviour support plans (BSPs) could assist service providers and statutory authorities to monitor and improve the quality of support provided to people with intellectual disability (ID) who exhibit challenging behaviour. The Behaviour Support Plan Quality Evaluation Guide II (BSP-QEII) was developed to monitor and assess BSPs prepared by teachers to support children with disability in the school system. This study investigated the application of the BSP-QEII to the assessment of BSPs for adults with ID in community support services. The inter-rater reliability of the BSP-QEII was assessed. The utility of the BPS-QEII was then investigated with reference to a time series study of matched pairs of BSPs, developed for the same clients over a period of approximately 3 years. Differences in plan quality measured across a number of service and systemic variables were also investigated. The BSP-QEII was found to have good inter-rater reliability and good utility for audit purposes. It was able to discriminate changes in plan quality over time. Differences in plan quality were also evident across different service types, where specialist staff had or had not been involved, and in some instances where a statutory format for the plan had or had not been used. There were no differences between plans developed by government and community sector agencies, nor were there any regional differences across the jurisdiction. The BSP-QEII could usefully be adopted as an audit tool for measuring the quality of BSPs for adults with ID. In addition to being used for research and administrative auditing, the principles underpinning the BSP-QEII could also be useful to guide policy and educational activities for staff in community based services for adults with ID. © 2012 The Authors. Journal of Intellectual Disability Research © 2012 John Wiley & Sons Ltd, MENCAP & IASSID.

QC-ART: A tool for real-time quality control assessment of mass spectrometry-based proteomics data.

PubMed

Stanfill, Bryan A; Nakayasu, Ernesto S; Bramer, Lisa M; Thompson, Allison M; Ansong, Charles K; Clauss, Therese; Gritsenko, Marina A; Monroe, Matthew E; Moore, Ronald J; Orton, Daniel J; Piehowski, Paul D; Schepmoes, Athena A; Smith, Richard D; Webb-Robertson, Bobbie-Jo; Metz, Thomas O

2018-04-17

Liquid chromatography-mass spectrometry (LC-MS)-based proteomics studies of large sample cohorts can easily require from months to years to complete. Acquiring consistent, high-quality data in such large-scale studies is challenging because of normal variations in instrumentation performance over time, as well as artifacts introduced by the samples themselves, such as those due to collection, storage and processing. Existing quality control methods for proteomics data primarily focus on post-hoc analysis to remove low-quality data that would degrade downstream statistics; they are not designed to evaluate the data in near real-time, which would allow for interventions as soon as deviations in data quality are detected.  In addition to flagging analyses that demonstrate outlier behavior, evaluating how the data structure changes over time can aide in understanding typical instrument performance or identify issues such as a degradation in data quality due to the need for instrument cleaning and/or re-calibration.  To address this gap for proteomics, we developed Quality Control Analysis in Real-Time (QC-ART), a tool for evaluating data as they are acquired in order to dynamically flag potential issues with instrument performance or sample quality.  QC-ART has similar accuracy as standard post-hoc analysis methods with the additional benefit of real-time analysis.  We demonstrate the utility and performance of QC-ART in identifying deviations in data quality due to both instrument and sample issues in near real-time for LC-MS-based plasma proteomics analyses of a sample subset of The Environmental Determinants of Diabetes in the Young cohort. We also present a case where QC-ART facilitated the identification of oxidative modifications, which are often underappreciated in proteomic experiments. Published under license by The American Society for Biochemistry and Molecular Biology, Inc.

Health information on internet: quality, importance, and popularity of persian health websites.

PubMed

Samadbeik, Mahnaz; Ahmadi, Maryam; Mohammadi, Ali; Mohseni Saravi, Beniamin

2014-04-01

The Internet has provided great opportunities for disseminating both accurate and inaccurate health information. Therefore, the quality of information is considered as a widespread concern affecting the human life. Despite the increasingly substantial growth in the number of users, Persian health websites and the proportion of internet-using patients, little is known about the quality of Persian medical and health websites. The current study aimed to first assess the quality, popularity and importance of websites providing Persian health-related information, and second to evaluate the correlation of the popularity and importance ranking with quality score on the Internet. The sample websites were identified by entering the health-related keywords into four most popular search engines of Iranian users based on the Alexa ranking at the time of study. Each selected website was assessed using three qualified tools including the Bomba and Land Index, Google PageRank and the Alexa ranking. The evaluated sites characteristics (ownership structure, database, scope and objective) really did not have an effect on the Alexa traffic global rank, Alexa traffic rank in Iran, Google PageRank and Bomba total score. Most websites (78.9 percent, n = 56) were in the moderate category (8 ≤ x ≤ 11.99) based on their quality levels. There was no statistically significant association between Google PageRank with Bomba index variables and Alexa traffic global rank (P > 0.05). The Persian health websites had better Bomba quality scores in availability and usability guidelines as compared to other guidelines. The Google PageRank did not properly reflect the real quality of evaluated websites and Internet users seeking online health information should not merely rely on it for any kind of prejudgment regarding Persian health websites. However, they can use Iran Alexa rank as a primary filtering tool of these websites. Therefore, designing search engines dedicated to explore accredited Persian health-related Web sites can be an effective method to access high-quality Persian health websites.

Five years on: Revisiting GSN data quality

NASA Astrophysics Data System (ADS)

Gee, L. S.; Nettles, M.; Ekstrom, G.; Davis, J. P.; Ringler, A. T.; Storm, T. L.; Wilson, D.; Anderson, K. R.

2014-12-01

In 2010, the Lamont Waveform Quality Center (WQC) conducted an in-depth review of ten stations in the Global Seismographic Network (GSN). IU stations (CASY, DAV, KIP, KONO, WCI), IC stations (SSE, XAN), and II stations (ALE, DGAR, RPN) were analyzed using a scaling analysis based on data-synthetic comparisons, evaluation of noise levels, assessment of inter-sensor coherence, and polarization analysis. These reports (available from http://www.ldeo.columbia.edu/~ekstrom/Projects/WQC.html) highlighted a number of significant problems in GSN data quality, including the frequency-dependent loss of gain in the STS-1 seismometer (Ekström et al., 2006) that has been attributed to the presence of humidity in the electronics, cables, and connectors (Yuki and Ishihara, 2002; Hutt and Ringler, 2011). The reports from the WQC spurred a number of changes in the operation of the GSN, including the adoption of the policy of annual calibrations and the development of new tools and metrics to monitor, evaluate, and communicate data quality. In parallel, the USGS' Albuquerque Seismological Laboratory (ASL) and UCSD's Project IDA worked with the IRIS Consortium to upgrade GSN stations with new data acquisition systems, to refurbish the STS-1 seismometers with new electronics, and to expand the deployment of secondary broadband sensors. We revisit the 2010 reports, using the tools of the WQC as well as a number of newly developed tools such as the USGS' Data Quality Analyzer and IRIS' MUSTANG, and provide an update on GSN data quality. Our initial focus is on CASY and KIP, the first two stations reviewed by the WQC. Our goal is to evaluate progress in the last five years and assess our ability to quantify data quality as well as to identify potential problems that could compromise data quality in the future. Ekström, G., C. A. Dalton, and M. Nettles (2006). Observations of time-dependent errors in long-period instrument gain at global seismic stations. Seismological Research Letters, 77 (1), 12-22. Hutt, C.R. and A.T. Ringler (2011). Some possible causes of and corrections for STS-1 response changes in the Global Seismographic Network, Seis. Res. Lett., 82 (4), 560-571. Yuki, Y., and Y. Ishihara (2002). Methods for maintaining the performance of STS-1 seismometer. Frontier Research on Earth Evolution 2, 1-5.

Single Phase Dual-energy CT Angiography: One-stop-shop Tool for Evaluating Aneurysmal Subarachnoid Hemorrhage.

PubMed

Ni, Qian Qian; Tang, Chun Xiang; Zhao, Yan E; Zhou, Chang Sheng; Chen, Guo Zhong; Lu, Guang Ming; Zhang, Long Jiang

2016-05-25

Aneurysmal subarachnoid hemorrhages have extremely high case fatality in clinic. Early and rapid identifications of ruptured intracranial aneurysms seem to be especially important. Here we evaluate clinical value of single phase contrast-enhanced dual-energy CT angiograph (DE-CTA) as a one-stop-shop tool in detecting aneurysmal subarachnoid hemorrhage. One hundred and five patients who underwent true non-enhanced CT (TNCT), contrast-enhanced DE-CTA and digital subtraction angiography (DSA) were included. Image quality and detectability of intracranial hemorrhage were evaluated and compared between virtual non-enhanced CT (VNCT) images reconstructed from DE-CTA and TNCT. There was no statistical difference in image quality (P > 0.05) between VNCT and TNCT. The agreement of VNCT and TNCT in detecting intracranial hemorrhage reached 98.1% on a per-patient basis. With DSA as reference standard, sensitivity and specificity on a per-patient were 98.3% and 97.9% for DE-CTA in intracranial aneurysm detection. Effective dose of DE-CTA was reduced by 75.0% compared to conventional digital subtraction CTA. Thus, single phase contrast-enhanced DE-CTA is optimal reliable one-stop-shop tool for detecting intracranial hemorrhage with VNCT and intracranial aneurysms with DE-CTA with substantial radiation dose reduction compared with conventional digital subtraction CTA.

Single Phase Dual-energy CT Angiography: One-stop-shop Tool for Evaluating Aneurysmal Subarachnoid Hemorrhage

PubMed Central

Ni, Qian Qian; Tang, Chun Xiang; Zhao, Yan E; Zhou, Chang Sheng; Chen, Guo Zhong; Lu, Guang Ming; Zhang, Long Jiang

2016-01-01

Aneurysmal subarachnoid hemorrhages have extremely high case fatality in clinic. Early and rapid identifications of ruptured intracranial aneurysms seem to be especially important. Here we evaluate clinical value of single phase contrast-enhanced dual-energy CT angiograph (DE-CTA) as a one-stop-shop tool in detecting aneurysmal subarachnoid hemorrhage. One hundred and five patients who underwent true non-enhanced CT (TNCT), contrast-enhanced DE-CTA and digital subtraction angiography (DSA) were included. Image quality and detectability of intracranial hemorrhage were evaluated and compared between virtual non-enhanced CT (VNCT) images reconstructed from DE-CTA and TNCT. There was no statistical difference in image quality (P > 0.05) between VNCT and TNCT. The agreement of VNCT and TNCT in detecting intracranial hemorrhage reached 98.1% on a per-patient basis. With DSA as reference standard, sensitivity and specificity on a per-patient were 98.3% and 97.9% for DE-CTA in intracranial aneurysm detection. Effective dose of DE-CTA was reduced by 75.0% compared to conventional digital subtraction CTA. Thus, single phase contrast-enhanced DE-CTA is optimal reliable one-stop-shop tool for detecting intracranial hemorrhage with VNCT and intracranial aneurysms with DE-CTA with substantial radiation dose reduction compared with conventional digital subtraction CTA. PMID:27222163

A novel framework for assessing metadata quality in epidemiological and public health research settings

PubMed Central

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly. PMID:27570670

A novel framework for assessing metadata quality in epidemiological and public health research settings.

PubMed

McMahon, Christiana; Denaxas, Spiros

2016-01-01

Metadata are critical in epidemiological and public health research. However, a lack of biomedical metadata quality frameworks and limited awareness of the implications of poor quality metadata renders data analyses problematic. In this study, we created and evaluated a novel framework to assess metadata quality of epidemiological and public health research datasets. We performed a literature review and surveyed stakeholders to enhance our understanding of biomedical metadata quality assessment. The review identified 11 studies and nine quality dimensions; none of which were specifically aimed at biomedical metadata. 96 individuals completed the survey; of those who submitted data, most only assessed metadata quality sometimes, and eight did not at all. Our framework has four sections: a) general information; b) tools and technologies; c) usability; and d) management and curation. We evaluated the framework using three test cases and sought expert feedback. The framework can assess biomedical metadata quality systematically and robustly.

[Total quality management in times of crisis. The case of Argentina].

PubMed

Larroca, Norberto

2003-01-01

Healthcare organizations were faced with so great a challenge following the financial slump that they were forced to 'sharpen their wits' in order to survive. Integrated Quality Management (in Spanish GIC), proved the ideal instrument. GIC has four foundational elements, the application of which allow for successful management of crisis situations. They are as follows: TRAINING of human resources EVALUATION of healthcare institutions SELF-EVALUATION by institutions QUALITY ACCREDITATION of institutions All our organizations have the appropriate tools to carry out these activities which form the basis of our project: CAES (Argentinean Chamber of Healthcare Institutions) -training-, CIDCAM (Inter-institutional Committee for Quality Development in Medical Care) -evaluation and self-evaluation-, CENAS (Specialist Centre for the Standardization and Accreditation in Health Care)-accreditation-. In times of crisis, we play an active part, that is, instead of withdrawing our efforts, we do our best to achieve the best and most adequate objective in order to meet the needs of the population through Integrated Quality Management. Eventually, when the results are examined, medical care that meets the best quality standards is found to be, after all, the most economical (that is best results, better satisfaction of healthcare users and providers as well as less mistakes).

Practical quality control tools for curves and surfaces

NASA Technical Reports Server (NTRS)

Small, Scott G.

1992-01-01

Curves (geometry) and surfaces created by Computer Aided Geometric Design systems in the engineering environment must satisfy two basic quality criteria: the geometric shape must have the desired engineering properties; and the objects must be parameterized in a way which does not cause computational difficulty for geometric processing and engineering analysis. Interactive techniques are described which are in use at Boeing to evaluate the quality of aircraft geometry prior to Computational Fluid Dynamic analysis, including newly developed methods for examining surface parameterization and its effects.

YoungStar in Milwaukee County: An Initial Progress Report as of July 2011

ERIC Educational Resources Information Center

Edie, Dave

2011-01-01

YoungStar is a program of the Department of Children and Families (DCF) created to improve the quality of child care for Wisconsin children. YoungStar is designed to: (1) Evaluate and rate the quality of care given by child care providers; (2) Help parents choose the best child care for their kids; (3) Support providers with tools and training to…

YoungStar in Wisconsin: An Initial Progress Report as of July 2011

ERIC Educational Resources Information Center

Edie, Dave

2011-01-01

YoungStar is a program of the Department of Children and Families (DCF) created to improve the quality of child care for Wisconsin children. YoungStar is designed to: (1) Evaluate and rate the quality of care given by child care providers; (2) Help parents choose the best child care for their kids; (3) Support providers with tools and training to…

Data Use "Multi-State" Spotlight: Using Data Fidelity Tools to Improve Data Quality. Transforming State Systems to Improve Outcomes for Children with Disabilities

ERIC Educational Resources Information Center

Ruedel, Kristin; Nelson, Gena; Bailey, Tessie

2018-01-01

To evaluate interim progress toward the State-identified Measurable Result (SIMR), states require access to high-quality data from local education agencies (LEAs) and early intervention service providers. In a review of 2017 Phase III State Systemic Improvement Plans (SSIP), 43 Part C states noted limitations or concerns related to data and…

Evaluating Quality of Life in Urban Areas (Case Study: Noorabad City, Iran)

ERIC Educational Resources Information Center

Rezvani, Mohammad Reza; Mansourian, Hossain; Sattari, Mohammad Hossain

2013-01-01

Quality of urban life (QOUL) has become an important field within urban studies. The increased level of attention to this topic is due to the increasing importance of QoL studies in monitoring public policies and in the role they can play as effective tools in urban management and planning. The main objective of this study is to measure the QOUL…

A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

ERIC Educational Resources Information Center

Valentine, Jeffrey C.; Cooper, Harris

2008-01-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…

The Fountain of Health: Bringing Seniors’ Mental Health Promotion into Clinical Practice

PubMed Central

Thoo, Vanessa; Freer, Janya; Cassidy, Keri-Leigh

2015-01-01

Background The Fountain of Health (FoH) initiative offers valuable evidence-based mental health knowledge and provides clinicians with evaluated tools for translating knowledge into practice, in order to reduce seniors’ risks of mental disorders, including dementia. Methods A presentation on mental health promotion and educational materials were disseminated to mental health clinicians including physicians and other allied health professionals either in-person or via tele-education through a provincial seniors’ mental health network. Measures included: 1) a tele-education quality evaluation form, 2) a knowledge transfer questionnaire, 3) a knowledge translation-to-practice evaluation tool, and 4) a quality assurance questionnaire. Results A total of 74 mental health clinicians received the FoH education session. There was a highly significant (p < .0001) difference in clinicians’ knowledge transfer questionnaire scores pre- and post-educational session. At a two-month follow-up, 19 (25.7%) participants completed a quality assurance questionnaire, with all 19 (100%) of respondents stating they would positively recommend the FoH information to colleagues and patients. Eleven (20.4%) translation-to-practice forms were also collected at this interval, tracking clinician use of the educational materials. Conclusions The use of a formalized network for knowledge transfer allows for education and evaluation of health-care practitioners in both acquisition of practical knowledge and subsequent clinical behavior change. PMID:26740830

A prototype of mammography CADx scheme integrated to imaging quality evaluation techniques

NASA Astrophysics Data System (ADS)

Schiabel, Homero; Matheus, Bruno R. N.; Angelo, Michele F.; Patrocínio, Ana Claudia; Ventura, Liliane

2011-03-01

As all women over the age of 40 are recommended to perform mammographic exams every two years, the demands on radiologists to evaluate mammographic images in short periods of time has increased considerably. As a tool to improve quality and accelerate analysis CADe/Dx (computer-aided detection/diagnosis) schemes have been investigated, but very few complete CADe/Dx schemes have been developed and most are restricted to detection and not diagnosis. The existent ones usually are associated to specific mammographic equipment (usually DR), which makes them very expensive. So this paper describes a prototype of a complete mammography CADx scheme developed by our research group integrated to an imaging quality evaluation process. The basic structure consists of pre-processing modules based on image acquisition and digitization procedures (FFDM, CR or film + scanner), a segmentation tool to detect clustered microcalcifications and suspect masses and a classification scheme, which evaluates as the presence of microcalcifications clusters as well as possible malignant masses based on their contour. The aim is to provide enough information not only on the detected structures but also a pre-report with a BI-RADS classification. At this time the system is still lacking an interface integrating all the modules. Despite this, it is functional as a prototype for clinical practice testing, with results comparable to others reported in literature.

A Comparative Study of Competency-Based Courses Demonstrating a Potential Measure of Course Quality and Student Success

ERIC Educational Resources Information Center

Krause, Jackie; Dias, Laura Portolese; Schedler, Chris

2015-01-01

While competency-based education is growing, standardized tools for evaluating the unique characteristics of course design in this domain are still under development. This preliminary research study evaluated the effectiveness of a rubric developed for assessing course design of competency-based courses in an undergraduate Information Technology…

An Experiential Approach to Clinical Supervision Training: A Mixed Methods Evaluation of Effectiveness

ERIC Educational Resources Information Center

Fisher, Amy Killen; Simmons, Christopher; Allen, Susan C.

2016-01-01

This study evaluates an intensive experiential exercise designed to facilitate the provision of high-quality supervision in social work. Data from 46 BSW and MSW students suggest that the exercise can be an effective learning tool. Both quantitative and qualitative findings indicated that the students formed a supervisory working alliance; BSW…

A System Evaluation Theory Analyzing Value and Results Chain for Institutional Accreditation in Oman

ERIC Educational Resources Information Center

Paquibut, Rene Ymbong

2017-01-01

Purpose: This paper aims to apply the system evaluation theory (SET) to analyze the institutional quality standards of Oman Academic Accreditation Authority using the results chain and value chain tools. Design/methodology/approach: In systems thinking, the institutional standards are connected as input, process, output and feedback and leads to…

Proposing an Evaluation Framework for Interventions: Focusing on Students' Behaviours in Interactive Science Exhibitions

ERIC Educational Resources Information Center

Hauan, Nils Petter; DeWitt, Jennifer; Kolstø, Stein Dankert

2017-01-01

Materials designed for self-guided experiences such as worksheets and digital applications are widely used as tools to enable interactive science exhibitions to support students' progress towards conceptual understanding. However, there is a need to find expedient ways to evaluate the quality of educational experiences resulting from the use of…

Peer reviews: taking on new meanings.

PubMed

Raia, Lucille

2011-01-01

Peer reviews in nursing are historically used to gauge performance within an individual's scope of practice or as a tool to evaluate a sentinel or adverse event. Quality of care measures, clinical pertinence, and evaluating standards of care have begun as parallel strategies to replace the former uses in assuring the right care at the right time in the right setting.

Assessment of nutritional status and quality of life in patients treated for head and neck cancer.

PubMed

Prevost, V; Joubert, C; Heutte, N; Babin, E

2014-04-01

The purpose of this study was to identify tools for the assessment of nutritional status in head and neck cancer patients, to evaluate the impact of malnutrition on therapeutic management and quality of life and to propose a simple screening approach adapted to routine clinical practice. The authors conducted a review of the literature to identify tools for the assessment of nutritional status in head and neck cancer patients published in French and English. Articles were obtained from the PubMed database and from the references of these articles and selected journals, using the keywords: "nutritional assessment", and "head and neck" and "cancer". Anthropometric indices, laboratory parameters, dietary intake assessment, clinical scores and nutritional risk scores used in patients with head and neck cancers are presented. The relevance of these tools in clinical practice and in research is discussed, together with the links between nutritional status and quality of life. This article is designed to help teams involved in the management of patients with head and neck cancer to choose the most appropriate tools for assessment of nutritional status according to their resources and their objectives. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

The importance of measuring customer satisfaction in palliative care.

PubMed

Turriziani, Adriana; Attanasio, Gennaro; Scarcella, Francesco; Sangalli, Luisa; Scopa, Anna; Genualdo, Alessandra; Quici, Stefano; Nazzicone, Giulia; Ricciotti, Maria Adelaide; La Commare, Francesco

2016-03-01

In the last decades, palliative care has been more and more focused on the evaluation of patients' and families' satisfaction with care. However, the evaluation of customer satisfaction in palliative care presents a number of issues such as the presence of both patients and their families, the frail condition of the patients and the complexity of their needs, and the lack of standard quality indicators and appropriate measurement tools. In this manuscript, we critically review existing evidence and literature on the evaluation of satisfaction in the palliative care context. Moreover, we provide - as a practical example - the preliminary results of our experience in this setting with the development of a dedicated tool for the measurement of satisfaction.

The live donor assessment tool: a psychosocial assessment tool for live organ donors.

PubMed

Iacoviello, Brian M; Shenoy, Akhil; Braoude, Jenna; Jennings, Tiane; Vaidya, Swapna; Brouwer, Julianna; Haydel, Brandy; Arroyo, Hansel; Thakur, Devendra; Leinwand, Joseph; Rudow, Dianne LaPointe

2015-01-01

Psychosocial evaluation is an important part of the live organ donor evaluation process, yet it is not standardized across institutions, and although tools exist for the psychosocial evaluation of organ recipients, none exist to assess donors. We set out to develop a semistructured psychosocial evaluation tool (the Live Donor Assessment Tool, LDAT) to assess potential live organ donors and to conduct preliminary analyses of the tool's reliability and validity. Review of the literature on the psychosocial variables associated with treatment adherence, quality of life, live organ donation outcome, and resilience, as well as review of the procedures for psychosocial evaluation at our center and other centers around the country, identified 9 domains to address; these domains were distilled into several items each, in collaboration with colleagues at transplant centers across the country, for a total of 29 items. Four raters were trained to use the LDAT, and they retrospectively scored 99 psychosocial evaluations conducted on live organ donor candidates. Reliability of the LDAT was assessed by calculating the internal consistency of the items in the scale and interrater reliability between raters; validity was estimated by comparing LDAT scores between those with a "positive" evaluation outcome and "negative" outcome. The LDAT was found to have good internal consistency, inter-rater reliability, and showed signs of validity: LDAT scores differentiated the positive vs. negative outcome groups. The LDAT demonstrated good reliability and validity, but future research on the LDAT and the ability to implement the LDAT prospectively is warranted. Copyright © 2015 The Academy of Psychosomatic Medicine. Published by Elsevier Inc. All rights reserved.

Supporting Goal-Oriented Primary Health Care for Seniors with Complex Care Needs Using Mobile Technology: Evaluation and Implementation of the Health System Performance Research Network, Bridgepoint Electronic Patient Reported Outcome Tool.

PubMed

Steele Gray, Carolyn; Wodchis, Walter P; Upshur, Ross; Cott, Cheryl; McKinstry, Brian; Mercer, Stewart; Palen, Ted E; Ramsay, Tim; Thavorn, Kednapa

2016-06-24

Older adults experiencing multiple chronic illnesses are at high risk of hospitalization and health decline if they are unable to manage the significant challenges posed by their health conditions. Goal-oriented care approaches can provide better care for these complex patients, but clinicians find the process of ascertaining goals "too complex and too-time consuming," and goals are often not agreed upon between complex patients and their providers. The electronic patient reported outcomes (ePRO) mobile app and portal offers an innovative approach to creating and monitoring goal-oriented patient-care plans to improve patient self-management and shared decision-making between patients and health care providers. The ePRO tool also supports proactive patient monitoring by the patient, caregiver(s), and health care provider. It was developed with and for older adults with complex care needs as a means to improve their quality of life. Our proposed project will evaluate the use, effectiveness, and value for money of the ePRO tool in a 12-month multicenter, randomized controlled trial in Ontario; targeting individuals 65 or over with two or more chronic conditions that require frequent health care visits to manage their health conditions. Intervention groups using the ePRO tool will be compared with control groups on measures of quality of life, patient experience, and cost-effectiveness. We will also evaluate the implementation of the tool. The proposed project presented in this paper will be funded through the Canadian Institute for Health Research (CIHR) eHealth Innovation Partnerships Program (eHIPP) program (CIHR-348362). The expected completion date of the study is November, 2019. We anticipate our program of work will support improved quality of life and patient self-management, improved patient-centered primary care delivery, and will encourage the adoption of goal-oriented care approaches across primary health care systems. We have partnered with family health teams and quality improvement organizations in Ontario to ensure that our research is practical and that findings are shared widely. We will work with our established international network to develop an implementation framework to support continued adaptation and adoption across Canada and internationally.

Supporting Goal-Oriented Primary Health Care for Seniors with Complex Care Needs Using Mobile Technology: Evaluation and Implementation of the Health System Performance Research Network, Bridgepoint Electronic Patient Reported Outcome Tool

PubMed Central

Wodchis, Walter P; Upshur, Ross; Cott, Cheryl; McKinstry, Brian; Mercer, Stewart; Palen, Ted E; Ramsay, Tim; Thavorn, Kednapa

2016-01-01

Background Older adults experiencing multiple chronic illnesses are at high risk of hospitalization and health decline if they are unable to manage the significant challenges posed by their health conditions. Goal-oriented care approaches can provide better care for these complex patients, but clinicians find the process of ascertaining goals “too complex and too-time consuming,” and goals are often not agreed upon between complex patients and their providers. The electronic patient reported outcomes (ePRO) mobile app and portal offers an innovative approach to creating and monitoring goal-oriented patient-care plans to improve patient self-management and shared decision-making between patients and health care providers. The ePRO tool also supports proactive patient monitoring by the patient, caregiver(s), and health care provider. It was developed with and for older adults with complex care needs as a means to improve their quality of life. Objective Our proposed project will evaluate the use, effectiveness, and value for money of the ePRO tool in a 12-month multicenter, randomized controlled trial in Ontario; targeting individuals 65 or over with two or more chronic conditions that require frequent health care visits to manage their health conditions. Methods Intervention groups using the ePRO tool will be compared with control groups on measures of quality of life, patient experience, and cost-effectiveness. We will also evaluate the implementation of the tool. Results The proposed project presented in this paper will be funded through the Canadian Institute for Health Research (CIHR) eHealth Innovation Partnerships Program (eHIPP) program (CIHR–143559). The expected completion date of the study is November, 2019. Conclusions We anticipate our program of work will support improved quality of life and patient self-management, improved patient-centered primary care delivery, and will encourage the adoption of goal-oriented care approaches across primary health care systems. We have partnered with family health teams and quality improvement organizations in Ontario to ensure that our research is practical and that findings are shared widely. We will work with our established international network to develop an implementation framework to support continued adaptation and adoption across Canada and internationally. PMID:27341765

Critical appraisal of questionnaires to assess functional impairment in individuals with mild cognitive impairment.

PubMed

Kaur, Navaldeep; Belchior, Patricia; Gelinas, Isabelle; Bier, Nathalie

2016-09-01

Mild deficits in instrumental activities of daily living (IADLs) have consistently been reported in the individuals with mild cognitive impairment (MCI). A variety of functional assessment tools, including self-and informant report questionnaires and performance-based measures, have been employed in MCI. Previously, a limited focus has been directed at appraising the quality of questionnaires. The goal of this study was to identify the questionnaires that have been validated in the MCI population. Additionally, the quality of validation studies and psychometric attributes of these questionnaires were appraised. Relevant articles were systematically searched in PsychINFO, Ovid MEDLINE, and CINAHL against specific eligibility criteria. To evaluate the methodology of the psychometric studies, the COSMIN checklist was employed. Also, the psychometric properties of the assessment tools were evaluated based upon Terwee's criteria. A total of five psychometric studies and questionnaires were critically evaluated. Varying psychometric properties were available for the chosen tools. None of the studies received the best possible rating for their methodological quality. It was found that questionnaires with high discriminative ability to distinguish MCI from other diagnostic groups were: Disability Assessment in Dementia-6 (DAD-6), Functional Activity Questionnaire (FAQ), and Alzheimer's Disease Cooperative Study/Activities of Daily Living scale adapted for MCI patients (ADCS-MCI-ADL-24). Psychometric studies with strong methodological rigor are required in the future. Considering the fact that IADL decline has been associated with dementia, early detection of functional difficulties in MCI needs to be encouraged as it will allow suitable and timely interventions to prolong functional independence of affected individuals.

Automated Assessment of the Quality of Depression Websites

PubMed Central

Tang, Thanh Tin; Hawking, David; Christensen, Helen

2005-01-01

Background Since health information on the World Wide Web is of variable quality, methods are needed to assist consumers to identify health websites containing evidence-based information. Manual assessment tools may assist consumers to evaluate the quality of sites. However, these tools are poorly validated and often impractical. There is a need to develop better consumer tools, and in particular to explore the potential of automated procedures for evaluating the quality of health information on the web. Objective This study (1) describes the development of an automated quality assessment procedure (AQA) designed to automatically rank depression websites according to their evidence-based quality; (2) evaluates the validity of the AQA relative to human rated evidence-based quality scores; and (3) compares the validity of Google PageRank and the AQA as indicators of evidence-based quality. Method The AQA was developed using a quality feedback technique and a set of training websites previously rated manually according to their concordance with statements in the Oxford University Centre for Evidence-Based Mental Health’s guidelines for treating depression. The validation phase involved 30 websites compiled from the DMOZ, Yahoo! and LookSmart Depression Directories by randomly selecting six sites from each of the Google PageRank bands of 0, 1-2, 3-4, 5-6 and 7-8. Evidence-based ratings from two independent raters (based on concordance with the Oxford guidelines) were then compared with scores derived from the automated AQA and Google algorithms. There was no overlap in the websites used in the training and validation phases of the study. Results The correlation between the AQA score and the evidence-based ratings was high and significant (r=0.85, P<.001). Addition of a quadratic component improved the fit, the combined linear and quadratic model explaining 82 percent of the variance. The correlation between Google PageRank and the evidence-based score was lower than that for the AQA. When sites with zero PageRanks were included the association was weak and non-significant (r=0.23, P=.22). When sites with zero PageRanks were excluded, the correlation was moderate (r=.61, P=.002). Conclusions Depression websites of different evidence-based quality can be differentiated using an automated system. If replicable, generalizable to other health conditions and deployed in a consumer-friendly form, the automated procedure described here could represent an important advance for consumers of Internet medical information. PMID:16403723

A systematic review of the PTSD Checklist's diagnostic accuracy studies using QUADAS.

PubMed

McDonald, Scott D; Brown, Whitney L; Benesek, John P; Calhoun, Patrick S

2015-09-01

Despite the popularity of the PTSD Checklist (PCL) as a clinical screening test, there has been no comprehensive quality review of studies evaluating its diagnostic accuracy. A systematic quality assessment of 22 diagnostic accuracy studies of the English-language PCL using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) assessment tool was conducted to examine (a) the quality of diagnostic accuracy studies of the PCL, and (b) whether quality has improved since the 2003 STAndards for the Reporting of Diagnostic accuracy studies (STARD) initiative regarding reporting guidelines for diagnostic accuracy studies. Three raters independently applied the QUADAS tool to each study, and a consensus among the 4 authors is reported. Findings indicated that although studies generally met standards in several quality areas, there is still room for improvement. Areas for improvement include establishing representativeness, adequately describing clinical and demographic characteristics of the sample, and presenting better descriptions of important aspects of test and reference standard execution. Only 2 studies met each of the 14 quality criteria. In addition, study quality has not appreciably improved since the publication of the STARD Statement in 2003. Recommendations for the improvement of diagnostic accuracy studies of the PCL are discussed. (c) 2015 APA, all rights reserved).

Machinability of Minor Wooden Species before and after Modification with Thermo-Vacuum Technology

PubMed Central

Sandak, Jakub; Goli, Giacomo; Cetera, Paola; Sandak, Anna; Cavalli, Alberto; Todaro, Luigi

2017-01-01

The influence of the thermal modification process on wood machinability was investigated with four minor species of low economic importance. A set of representative experimental samples was machined to the form of disks with sharp and dull tools. The resulting surface quality was visually evaluated by a team of experts according to the American standard procedure ASTM D-1666-87. The objective quantification of the surface quality was also done by means of a three dimensions (3D) surface scanner for the whole range of grain orientations. Visual assessment and 3D surface analysis showed a good agreement in terms of conclusions. The best quality of the wood surface was obtained when machining thermally modified samples. The positive effect of the material modification was apparent when cutting deodar cedar, black pine and black poplar in unfavorable conditions (i.e., against the grain). The difference was much smaller for an easy-machinability specie such as Italian alder. The use of dull tools resulted in the worst surface quality. Thermal modification has shown a very positive effect when machining with dull tools, leading to a relevant increment of the final surface smoothness. PMID:28772480

Meeting report: applied biopharmaceutics and quality by design for dissolution/release specification setting: product quality for patient benefit.

PubMed

Selen, Arzu; Cruañes, Maria T; Müllertz, Anette; Dickinson, Paul A; Cook, Jack A; Polli, James E; Kesisoglou, Filippos; Crison, John; Johnson, Kevin C; Muirhead, Gordon T; Schofield, Timothy; Tsong, Yi

2010-09-01

A biopharmaceutics and Quality by Design (QbD) conference was held on June 10-12, 2009 in Rockville, Maryland, USA to provide a forum and identify approaches for enhancing product quality for patient benefit. Presentations concerned the current biopharmaceutical toolbox (i.e., in vitro, in silico, pre-clinical, in vivo, and statistical approaches), as well as case studies, and reflections on new paradigms. Plenary and breakout session discussions evaluated the current state and envisioned a future state that more effectively integrates QbD and biopharmaceutics. Breakout groups discussed the following four topics: Integrating Biopharmaceutical Assessment into the QbD Paradigm, Predictive Statistical Tools, Predictive Mechanistic Tools, and Predictive Analytical Tools. Nine priority areas, further described in this report, were identified for advancing integration of biopharmaceutics and support a more fundamentally based, integrated approach to setting product dissolution/release acceptance criteria. Collaboration among a broad range of disciplines and fostering a knowledge sharing environment that places the patient's needs as the focus of drug development, consistent with science- and risk-based spirit of QbD, were identified as key components of the path forward.

Machinability of Minor Wooden Species before and after Modification with Thermo-Vacuum Technology.

PubMed

Sandak, Jakub; Goli, Giacomo; Cetera, Paola; Sandak, Anna; Cavalli, Alberto; Todaro, Luigi

2017-01-28

The influence of the thermal modification process on wood machinability was investigated with four minor species of low economic importance. A set of representative experimental samples was machined to the form of disks with sharp and dull tools. The resulting surface quality was visually evaluated by a team of experts according to the American standard procedure ASTM D-1666-87. The objective quantification of the surface quality was also done by means of a three dimensions (3D) surface scanner for the whole range of grain orientations. Visual assessment and 3D surface analysis showed a good agreement in terms of conclusions. The best quality of the wood surface was obtained when machining thermally modified samples. The positive effect of the material modification was apparent when cutting deodar cedar, black pine and black poplar in unfavorable conditions (i.e., against the grain). The difference was much smaller for an easy-machinability specie such as Italian alder. The use of dull tools resulted in the worst surface quality. Thermal modification has shown a very positive effect when machining with dull tools, leading to a relevant increment of the final surface smoothness.

Green Roofs for Stormwater Runoff Control - Abstract

EPA Science Inventory

This project evaluated green roofs as a stormwater management tool. Specifically, runoff quantity and quality from green and flat asphalt roofs were compared. Evapotranspiration from planted green roofs and evaporation from unplanted media roofs were also compared. The influence...

Green Roofs for Stormwater Runoff Control

EPA Science Inventory

This project evaluated green roofs as a stormwater management tool. Specifically, runoff quantity and quality from green and flat asphalt roofs were compared. Evapotranspiration from planted green roofs and evaporation from unplanted media roofs were also compared. The influence...

Risk Factor Assessment Branch (RFAB)

Cancer.gov

The Risk Factor Assessment Branch (RFAB) focuses on the development, evaluation, and dissemination of high-quality risk factor metrics, methods, tools, technologies, and resources for use across the cancer research continuum, and the assessment of cancer-related risk factors in the population.

A New Tool for Nutrition App Quality Evaluation (AQEL): Development, Validation, and Reliability Testing

PubMed Central

Huang, Wenhao; Chapman-Novakofski, Karen M

2017-01-01

Background The extensive availability and increasing use of mobile apps for nutrition-based health interventions makes evaluation of the quality of these apps crucial for integration of apps into nutritional counseling. Objective The goal of this research was the development, validation, and reliability testing of the app quality evaluation (AQEL) tool, an instrument for evaluating apps’ educational quality and technical functionality. Methods Items for evaluating app quality were adapted from website evaluations, with additional items added to evaluate the specific characteristics of apps, resulting in 79 initial items. Expert panels of nutrition and technology professionals and app users reviewed items for face and content validation. After recommended revisions, nutrition experts completed a second AQEL review to ensure clarity. On the basis of 150 sets of responses using the revised AQEL, principal component analysis was completed, reducing AQEL into 5 factors that underwent reliability testing, including internal consistency, split-half reliability, test-retest reliability, and interrater reliability (IRR). Two additional modifiable constructs for evaluating apps based on the age and needs of the target audience as selected by the evaluator were also tested for construct reliability. IRR testing using intraclass correlations (ICC) with all 7 constructs was conducted, with 15 dietitians evaluating one app. Results Development and validation resulted in the 51-item AQEL. These were reduced to 25 items in 5 factors after principal component analysis, plus 9 modifiable items in two constructs that were not included in principal component analysis. Internal consistency and split-half reliability of the following constructs derived from principal components analysis was good (Cronbach alpha >.80, Spearman-Brown coefficient >.80): behavior change potential, support of knowledge acquisition, app function, and skill development. App purpose split half-reliability was .65. Test-retest reliability showed no significant change over time (P>.05) for all but skill development (P=.001). Construct reliability was good for items assessing age appropriateness of apps for children, teens, and a general audience. In addition, construct reliability was acceptable for assessing app appropriateness for various target audiences (Cronbach alpha >.70). For the 5 main factors, ICC (1,k) was >.80, with a P value of <.05. When 15 nutrition professionals evaluated one app, ICC (2,15) was .98, with a P value of <.001 for all 7 constructs when the modifiable items were specified for adults seeking weight loss support. Conclusions Our preliminary effort shows that AQEL is a valid, reliable instrument for evaluating nutrition apps’ qualities for clinical interventions by nutrition clinicians, educators, and researchers. Further efforts in validating AQEL in various contexts are needed. PMID:29079554

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties.

PubMed

Cadorin, Lucia; Bressan, Valentina; Palese, Alvisa

2017-11-25

Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL) abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1) identify the instruments for assessment of SDL abilities among nursing students and nurses; 2) critically evaluate the methodological studies quality; and 3) compare the psychometric properties of the available instruments. A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN) panel. Study inclusion, data extraction and quality assessment were performed by researchers independently. Eleven studies were included and four tools based on Knowles's theory have emerged: 1) the Self-Directed Learning Readiness Scale; 2) the Self-Directed Learning Readiness Scale for Nursing Education; 3) the Self-Rating Scale of Self-Directed Learning, and 4) the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument). The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative factor analyses. On the basis of the findings, the Self-Directed-Learning-Instrument can be recommended for the assessment of SDL abilities among nursing students and nurses, given the excellent methodology quality adopted in estimating the psychometric properties. However, rigorous study designs aimed at estimating psychometric properties of tools in wide samples of nursing students and nurses across different stages of professional life, from undergraduate education to professional maturity, in different cultural, educational, and work settings, are strongly recommended.

Easy parallel screening of reagent stability, quality control, and metrology in solid phase peptide synthesis (SPPS) and peptide couplings for microarrays

DOE Office of Scientific and Technical Information (OSTI.GOV)

Achyuthan, Komandoor E.; Wheeler, David R.

Evaluating the stability of coupling reagents, quality control (QC), and surface functionalization metrology are all critical to the production of high quality peptide microarrays. We describe a broadly applicable screening technique for evaluating the fidelity of solid phase peptide synthesis (SPPS), the stability of activation/coupling reagents, and a microarray surface metrology tool. This technique was used to assess the stability of the activation reagent 1-{[1-(Cyano-2-ethoxy-2-oxo-ethylidenaminooxy)dimethylamino-morpholinomethylene]}methaneaminiumHexafluorophosphate (COMU) (Sigma-Aldrich, St. Louis, MO, USA) by SPPS of Leu-Enkephalin (YGGFL) or the coupling of commercially synthesized YGGFL peptides to (3-aminopropyl)triethyoxysilane-modified glass surfaces. Coupling efficiency was quantitated by fluorescence signaling based on immunoreactivity of themore » YGGFL motif. It was concluded that COMU solutions should be prepared fresh and used within 5 h when stored at ~23 °C and not beyond 24 h if stored refrigerated, both in closed containers. Caveats to gauging COMU stability by absorption spectroscopy are discussed. Commercial YGGFL peptides needed independent QC, due to immunoreactivity variations for the same sequence synthesized by different vendors. This technique is useful in evaluating the stability of other activation/coupling reagents besides COMU and as a metrology tool for SPPS and peptide microarrays.« less

Easy parallel screening of reagent stability, quality control, and metrology in solid phase peptide synthesis (SPPS) and peptide couplings for microarrays

DOE PAGES

Achyuthan, Komandoor E.; Wheeler, David R.

2015-08-27

Evaluating the stability of coupling reagents, quality control (QC), and surface functionalization metrology are all critical to the production of high quality peptide microarrays. We describe a broadly applicable screening technique for evaluating the fidelity of solid phase peptide synthesis (SPPS), the stability of activation/coupling reagents, and a microarray surface metrology tool. This technique was used to assess the stability of the activation reagent 1-{[1-(Cyano-2-ethoxy-2-oxo-ethylidenaminooxy)dimethylamino-morpholinomethylene]}methaneaminiumHexafluorophosphate (COMU) (Sigma-Aldrich, St. Louis, MO, USA) by SPPS of Leu-Enkephalin (YGGFL) or the coupling of commercially synthesized YGGFL peptides to (3-aminopropyl)triethyoxysilane-modified glass surfaces. Coupling efficiency was quantitated by fluorescence signaling based on immunoreactivity of themore » YGGFL motif. It was concluded that COMU solutions should be prepared fresh and used within 5 h when stored at ~23 °C and not beyond 24 h if stored refrigerated, both in closed containers. Caveats to gauging COMU stability by absorption spectroscopy are discussed. Commercial YGGFL peptides needed independent QC, due to immunoreactivity variations for the same sequence synthesized by different vendors. This technique is useful in evaluating the stability of other activation/coupling reagents besides COMU and as a metrology tool for SPPS and peptide microarrays.« less

Technical Note: Independent component analysis for quality assurance in functional MRI.

PubMed

Astrakas, Loukas G; Kallistis, Nikolaos S; Kalef-Ezra, John A

2016-02-01

Independent component analysis (ICA) is an established method of analyzing human functional MRI (fMRI) data. Here, an ICA-based fMRI quality control (QC) tool was developed and used. ICA-based fMRI QC tool to be used with a commercial phantom was developed. In an attempt to assess the performance of the tool relative to preexisting alternative tools, it was used seven weeks before and eight weeks after repair of a faulty gradient amplifier of a non-state-of-the-art MRI unit. More specifically, its performance was compared with the AAPM 100 acceptance testing and quality assurance protocol and two fMRI QC protocols, proposed by Freidman et al. ["Report on a multicenter fMRI quality assurance protocol," J. Magn. Reson. Imaging 23, 827-839 (2006)] and Stocker et al. ["Automated quality assurance routines for fMRI data applied to a multicenter study," Hum. Brain Mapp. 25, 237-246 (2005)], respectively. The easily developed and applied ICA-based QC protocol provided fMRI QC indices and maps equally sensitive to fMRI instabilities with the indices and maps of other established protocols. The ICA fMRI QC indices were highly correlated with indices of other fMRI QC protocols and in some cases theoretically related to them. Three or four independent components with slow varying time series are detected under normal conditions. ICA applied on phantom measurements is an easy and efficient tool for fMRI QC. Additionally, it can protect against misinterpretations of artifact components as human brain activations. Evaluating fMRI QC indices in the central region of a phantom is not always the optimal choice.

Full-field digital mammography image data storage reduction using a crop tool.

PubMed

Kang, Bong Joo; Kim, Sung Hun; An, Yeong Yi; Choi, Byung Gil

2015-05-01

The storage requirements for full-field digital mammography (FFDM) in a picture archiving and communication system are significant, so methods to reduce the data set size are needed. A FFDM crop tool for this purpose was designed, implemented, and tested. A total of 1,651 screening mammography cases with bilateral FFDMs were included in this study. The images were cropped using a DICOM editor while maintaining image quality. The cases were evaluated according to the breast volume (1/4, 2/4, 3/4, and 4/4) in the craniocaudal view. The image sizes between the cropped image group and the uncropped image group were compared. The overall image quality and reader's preference were independently evaluated by the consensus of two radiologists. Digital storage requirements for sets of four uncropped to cropped FFDM images were reduced by 3.8 to 82.9 %. The mean reduction rates according to the 1/4-4/4 breast volumes were 74.7, 61.1, 38, and 24 %, indicating that the lower the breast volume, the smaller the size of the cropped data set. The total image data set size was reduced from 87 to 36.7 GB, or a 57.7 % reduction. The overall image quality and the reader's preference for the cropped images were higher than those of the uncropped images. FFDM mammography data storage requirements can be significantly reduced using a crop tool.

A survey of Canadian websites providing information about female urinary incontinence.

PubMed

Farrell, Karen D; Robinson, Lynne M; Baydock, Sandra A; Farrell, Scott A; Irving, Linda E; O'Connell, Colleen M

2006-08-01

Urinary incontinence (UI) is a prevalent health issue that has significant detrimental effects on quality of life. The Internet offers a unique vehicle for incontinent women to access information that could facilitate conservative self-help therapy. An evaluation of Canadian websites offering female UI information was conducted to determine their quality and readability. We evaluated websites using published general quality criteria for health sites and a quality assessment tool compiled by the authors for specific UI information derived from published, peer-reviewed clinical practice guidelines. Three health care professionals reviewed sites for quality, Canadian content, and interactivity. The readability of health information was also evaluated. Fifty-six Canadian sites (18 professional, 22 organizational, 16 commercial) were evaluated. Significant agreement was found among the raters' evaluations on all measures. For all sites, the mean scores were general quality, 9/14; specific UI quality, 30/122; reading ease, 37/100; grade level, 10.9. The median score for Canadian content was high, but for interactivity it was low. The only significant difference between site types was for general quality (F [2,165]=3.38, P=0.036). Post hoc Tukey's tests showed a significant difference between organizational and commercial sites, with organizational sites having higher general quality. Canadian websites providing female UI information have moderately high general quality, low specific UI information quality, minimal interactivity, and more than minimal Canadian content. The reading level of most sites is too high for average consumers. A webliography of the best sites has been developed to guide patients.

A case study: application of statistical process control tool for determining process capability and sigma level.

PubMed

Chopra, Vikram; Bairagi, Mukesh; Trivedi, P; Nagar, Mona

2012-01-01

Statistical process control is the application of statistical methods to the measurement and analysis of variation process. Various regulatory authorities such as Validation Guidance for Industry (2011), International Conference on Harmonisation ICH Q10 (2009), the Health Canada guidelines (2009), Health Science Authority, Singapore: Guidance for Product Quality Review (2008), and International Organization for Standardization ISO-9000:2005 provide regulatory support for the application of statistical process control for better process control and understanding. In this study risk assessments, normal probability distributions, control charts, and capability charts are employed for selection of critical quality attributes, determination of normal probability distribution, statistical stability, and capability of production processes, respectively. The objective of this study is to determine tablet production process quality in the form of sigma process capability. By interpreting data and graph trends, forecasting of critical quality attributes, sigma process capability, and stability of process were studied. The overall study contributes to an assessment of process at the sigma level with respect to out-of-specification attributes produced. Finally, the study will point to an area where the application of quality improvement and quality risk assessment principles for achievement of six sigma-capable processes is possible. Statistical process control is the most advantageous tool for determination of the quality of any production process. This tool is new for the pharmaceutical tablet production process. In the case of pharmaceutical tablet production processes, the quality control parameters act as quality assessment parameters. Application of risk assessment provides selection of critical quality attributes among quality control parameters. Sequential application of normality distributions, control charts, and capability analyses provides a valid statistical process control study on process. Interpretation of such a study provides information about stability, process variability, changing of trends, and quantification of process ability against defective production. Comparative evaluation of critical quality attributes by Pareto charts provides the least capable and most variable process that is liable for improvement. Statistical process control thus proves to be an important tool for six sigma-capable process development and continuous quality improvement.

GeoViQua: quality-aware geospatial data discovery and evaluation

NASA Astrophysics Data System (ADS)

Bigagli, L.; Papeschi, F.; Mazzetti, P.; Nativi, S.

2012-04-01

GeoViQua (QUAlity aware VIsualization for the Global Earth Observation System of Systems) is a recently started FP7 project aiming at complementing the Global Earth Observation System of Systems (GEOSS) with rigorous data quality specifications and quality-aware capabilities, in order to improve reliability in scientific studies and policy decision-making. GeoViQua main scientific and technical objective is to enhance the GEOSS Common Infrastructure (GCI) providing the user community with innovative quality-aware search and evaluation tools, which will be integrated in the GEO-Portal, as well as made available to other end-user interfaces. To this end, GeoViQua will promote the extension of the current standard metadata for geographic information with accurate and expressive quality indicators, also contributing to the definition of a quality label (GEOLabel). GeoViQua proposed solutions will be assessed in several pilot case studies covering the whole Earth Observation chain, from remote sensing acquisition to data processing, to applications in the main GEOSS Societal Benefit Areas. This work presents the preliminary results of GeoViQua Work Package 4 "Enhanced geo-search tools" (WP4), started in January 2012. Its major anticipated technical innovations are search and evaluation tools that communicate and exploit data quality information from the GCI. In particular, GeoViQua will investigate a graphical search interface featuring a coherent and meaningful aggregation of statistics and metadata summaries (e.g. in the form of tables, charts), thus enabling end users to leverage quality constraints for data discovery and evaluation. Preparatory work on WP4 requirements indicated that users need the "best" data for their purpose, implying a high degree of subjectivity in judgment. This suggests that the GeoViQua system should exploit a combination of provider-generated metadata (objective indicators such as summary statistics), system-generated metadata (contextual/tracking information such as provenance of data and metadata), and user-generated metadata (informal user comments, usage information, rating, etc.). Moreover, metadata should include sufficiently complete access information, to allow rich data visualization and propagation. The following main enabling components are currently identified within WP4: - Quality-aware access services, e.g. a quality-aware extension of the OGC Sensor Observation Service (SOS-Q) specification, to support quality constraints for sensor data publishing and access; - Quality-aware discovery services, namely a quality-aware extension of the OGC Catalog Service for the Web (CSW-Q), to cope with quality constrained search; - Quality-augmentation broker (GeoViQua Broker), to support the linking and combination of the existing GCI metadata with GeoViQua- and user-generated metadata required to support the users in selecting the "best" data for their intended use. We are currently developing prototypes of the above quality-enabled geo-search components, that will be assessed in a sensor-based pilot case study in the next months. In particular, the GeoViQua Broker will be integrated with the EuroGEOSS Broker, to implement CSW-Q and federate (either via distribution or harvesting schemes) quality-aware data sources, GeoViQua will constitute a valuable test-bed for advancing the current best practices and standards in geospatial quality representation and exploitation. The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under Grant Agreement n° 265178.

Evaluation of the quality of information on the Internet available to patients undergoing cervical spine surgery.

PubMed

Weil, Alexander G; Bojanowski, Michel W; Jamart, Jacques; Gustin, Thierry; Lévêque, Marc

2014-01-01

To evaluate the quality of information available on the Internet to patients with a cervical pathology undergoing elective cervical spine surgery. Six key words ("cervical discectomy," "cervical foraminotomy," "cervical fusion," "cervical disc replacement," "cervical arthroplasty," "cervical artificial disc") were entered into two different search engines (Google, Yahoo!). For each key word, the first 50 websites were evaluated for accessibility, comprehensibility, and website quality using the DISCERN tool, transparency and honesty criteria, and an accuracy and exhaustivity scale. Of 5,098,500 evaluable websites, 600 were visited; 97 (16%) of these websites were evaluated for quality and comprehensiveness. Overall, 3% of sites obtained an excellent global quality score, 7% obtained a good score, 25% obtained an above average score, 15% obtained an average score, 37% obtained a poor score, and 13% obtained a very poor score. High-quality websites were affiliated with a professional society (P = 0.021), had bibliographical references (P = 0.030), and had a recent update within 6 months (r = 0.277, P < 0.001). No correlation between global quality score and other variables was observed. This study shows that the search for medical information on the Internet is time-consuming and often disappointing. The Internet is a potentially misleading source of information. Surgeons and professional societies must use the Internet as an ally in providing optimal information to patients. Copyright © 2014. Published by Elsevier Inc.

Rationale for Quality Assurance in Fecal Egg Monitoring of Soil-Transmitted Helminthiasis

PubMed Central

Hoekendijk, David J. L.; Hill, Philip C.; Sowerby, Stephen J.

2016-01-01

Substantial investment has been made into the once “neglected” tropical disease, soil-transmitted helminthiasis, and into control programs that operate within a framework of mapping baseline disease distribution, measuring the effectiveness of applied interventions, establishing when to cease drug administration, and for posttreatment evaluations. However, critical to each of these stages is the determination of helminth infection. The limitations of traditional microscope-based fecal egg diagnostics have not provided quality assurance in the monitoring of parasite disease and suboptimal treatment regimes provide for the potential development of parasite resistance to anthelmintic drugs. Improved diagnostic and surveillance tools are required to protect therapeutic effectiveness and to maintain funder confidence. Such tools may be on the horizon with emergent technologies that offer potential for enhanced visualization and quality-assured quantitation of helminth eggs. PMID:27352875

Voice quality outcomes of idiopathic Parkinson's disease medical treatment: A systematic review.

PubMed

Lechien, J R; Blecic, S; Huet, K; Delvaux, V; Piccaluga, M; Roland, V; Harmegnies, B; Saussez, S

2018-06-01

To investigate voice quality (VQ) impairments in idiopathic Parkinson's disease (IPD) and to explore the impact of medical treatments and L-Dopa challenge testing on voice. Relevant studies published between January 1980 and June 2017 describing VQ evaluations in IPD were retrieved using PubMed, Scopus, Biological Abstracts, BioMed Central and Cochrane databases. Issues of clinical relevance, including IPD treatment efficiency and voice quality outcomes, were evaluated for each study. The grade of recommendation for each publication was determined according to the Oxford Centre for Evidence-Based Medicine evidence levels. The database research yielded 106 relevant publications, of which 33 studies met the inclusion criteria, for a total of 964 patients with IPD. Data were extracted by 3 independent physicians who identified 21, 11 and 1 trials with IIIb, IIb and IIa evidence levels, respectively. The main VQ assessment tools used were acoustic testing (N = 27), aerodynamic testing (N = 10), subjective measurements (N = 8) and videolaryngostroboscopy (N = 3). The majority of trials (N = 32/33) identified subjective or objective VQ improvements after medical treatment (N = 10) or better VQ evaluations in healthy subjects compared to patients with IPD (N = 22). Especially, our analysis supports that VQ overall improves during the L-Dopa challenge testing, making the VQ evaluation an additional tool for the IPD diagnosis. The methodology used to assess subjective and objective VQ substantially varied from 1 study to another. All of the included studies took into consideration the patient's clinical profile in the VQ analysis. The majority of studies supported that VQ assessments remain useful as outcome measures of the effectiveness of medical treatment and could be helpful for the IPD diagnosis based on L-Dopa challenge testing. Further controlled studies using standardised and transparent methodology for measuring acoustic parameters are necessary to confirm the place of each tool in both IPD diagnosis and treatment evaluation. © 2018 John Wiley & Sons Ltd.

Remote assessment of acne: the use of acne grading tools to evaluate digital skin images.

PubMed

Bergman, Hagit; Tsai, Kenneth Y; Seo, Su-Jean; Kvedar, Joseph C; Watson, Alice J

2009-06-01

Digital imaging of dermatology patients is a novel approach to remote data collection. A number of assessment tools have been developed to grade acne severity and to track clinical progress over time. Although these tools have been validated when used in a face-to-face setting, their efficacy and reliability when used to assess digital images have not been examined. The main purpose of this study was to determine whether specific assessment tools designed to grade acne during face-to-face visits can be applied to the evaluation of digital images. The secondary purpose was to ascertain whether images obtained by subjects are of adequate quality to allow such assessments to be made. Three hundred (300) digital images of patients with mild to moderate facial inflammatory acne from an ongoing randomized-controlled study were included in this analysis. These images were obtained from 20 patients and consisted of sets of 3 images taken over time. Of these images, 120 images were captured by subjects themselves and 180 were taken by study staff. Subjects were asked to retake their photographs if the initial images were deemed of poor quality by study staff. Images were evaluated by two dermatologists-in-training using validated acne assessment measures: Total Inflammatory Lesion Count, Leeds technique, and the Investigator's Global Assessment. Reliability of raters was evaluated using correlation coefficients and kappa statistics. Of the different acne assessment measures tested, the inter-rater reliability was highest for the total inflammatory lesion count (r = 0.871), but low for the Leeds technique (kappa = 0.381) and global assessment (kappa = 0.3119). Raters were able to evaluate over 89% of all images using each type of acne assessment measure despite the fact that images obtained by study staff were of higher quality than those obtained by patients (p < 0.001). Several existing clinical assessment measures can be used to evaluate digital images obtained from subjects with inflammatory acne lesions. The level of inter-rater agreement is highly variable across assessment measures, and we found the Total Inflammatory Lesion Count to be the most reliable. This measure could be used to allow a dermatologist to remotely track a patient's progress over time.

Developing an Evaluation Tool for Assessing Clinical Ethics Consultation Skills in Simulation Based Education: The ACES Project.

PubMed

Wasson, Katherine; Parsi, Kayhan; McCarthy, Michael; Siddall, Viva Jo; Kuczewski, Mark

2016-06-01

The American Society for Bioethics and Humanities has created a quality attestation (QA) process for clinical ethics consultants; the pilot phase of reviewing portfolios has begun. One aspect of the QA process which is particularly challenging is assessing the interpersonal skills of individual clinical ethics consultants. We propose that using case simulation to evaluate clinical ethics consultants is an approach that can meet this need provided clear standards for assessment are identified. To this end, we developed the Assessing Clinical Ethics Skills (ACES) tool, which identifies and specifies specific behaviors that a clinical ethics consultant should demonstrate in an ethics case simulation. The aim is for the clinical ethics consultant or student to use a videotaped case simulation, along with the ACES tool scored by a trained rater, to demonstrate their competence as part of their QA portfolio. The development and piloting of the tool is described.

Towards high-quality, useful practice guidelines for child and youth mental health disorders: protocol for a systematic review and consensus exercise

PubMed Central

Bennett, Kathryn; Duda, Stephanie; Brouwers, Melissa; Szatmari, Peter; Newton, Amanda; McLennan, John; Sundar, Purnima; Cleverley, Kristin; Charach, Alice; Courtney, Darren; Rice, Maureen

2018-01-01

Introduction The quality of clinical practice guidelines (PGs) has not been evaluated in child and youth mental health (CYMH). To address this gap, we will: (1) conduct a systematic review (SR) to answer the question ‘among eligible PGs relevant to the prevention or treatment of CYMH conditions, which PGs meet criteria for minimum and high quality?’; (2) apply nominal group methods to create recommendations for how CYMH PG quality, completeness and usefulness can be strengthened. Methods and analysis SR: Potentially eligible PGs will be identified in 12 databases using a reproducible search strategy developed by a research librarian. Trained raters will: (1) apply prespecified criteria to identify eligible PGs relevant to depression, anxiety, suicidality, bipolar disorder, behaviour disorder (attention-deficit hyperactivity disorder, oppositional defiant disorder, conduct disorder) and substance use disorder; (2) extract descriptive data and (3) assess PG quality using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Scores on three AGREE II domains (rigour of development, stakeholder involvement, editorial independence) will designate PGs as minimum (≥50%) or high quality (≥70%). Nominal group: Four CYMH PG knowledge user groups (clinicians, mental health service planners, youth and adult family members) will participate in structured exercises derived using nominal group methods to generate recommendations to improve PG quality, completeness and usefulness. Ethics and dissemination Ethics approval is not required. Study products will be disseminated as follows. A cross-platform website will house eligible CYMH PGs and their quality ratings. Twitter and Facebook tools will promote it to a wide variety of PG users. Data from Google Analytics, Twitonomy and Altmetrics will inform usage evaluation. Complementary educational workshops will be conducted for CYMH professionals. Print materials and journal articles will be produced. PROSPERO registration number CRD42017060738. PMID:29437752

Identifying Items to Assess Methodological Quality in Physical Therapy Trials: A Factor Analysis

PubMed Central

Cummings, Greta G.; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-01-01

Background Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. Objective The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). Design A methodological research design was used, and an EFA was performed. Methods Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Results Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Limitation Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. Conclusions To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. PMID:24786942

Identifying items to assess methodological quality in physical therapy trials: a factor analysis.

PubMed

Armijo-Olivo, Susan; Cummings, Greta G; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-09-01

Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). A methodological research design was used, and an EFA was performed. Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. © 2014 American Physical Therapy Association.

Towards high-quality, useful practice guidelines for child and youth mental health disorders: protocol for a systematic review and consensus exercise.

PubMed

Bennett, Kathryn; Duda, Stephanie; Brouwers, Melissa; Szatmari, Peter; Newton, Amanda; McLennan, John; Sundar, Purnima; Cleverley, Kristin; Charach, Alice; Henderson, Joanna; Courtney, Darren; Rice, Maureen

2018-02-06

The quality of clinical practice guidelines (PGs) has not been evaluated in child and youth mental health (CYMH). To address this gap, we will: (1) conduct a systematic review (SR) to answer the question 'among eligible PGs relevant to the prevention or treatment of CYMH conditions, which PGs meet criteria for minimum and high quality?'; (2) apply nominal group methods to create recommendations for how CYMH PG quality, completeness and usefulness can be strengthened. SR: Potentially eligible PGs will be identified in 12 databases using a reproducible search strategy developed by a research librarian. Trained raters will: (1) apply prespecified criteria to identify eligible PGs relevant to depression, anxiety, suicidality, bipolar disorder, behaviour disorder (attention-deficit hyperactivity disorder, oppositional defiant disorder, conduct disorder) and substance use disorder; (2) extract descriptive data and (3) assess PG quality using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Scores on three AGREE II domains (rigour of development, stakeholder involvement, editorial independence) will designate PGs as minimum (≥50%) or high quality (≥70%). Nominal group: Four CYMH PG knowledge user groups (clinicians, mental health service planners, youth and adult family members) will participate in structured exercises derived using nominal group methods to generate recommendations to improve PG quality, completeness and usefulness. Ethics approval is not required. Study products will be disseminated as follows. A cross-platform website will house eligible CYMH PGs and their quality ratings. Twitter and Facebook tools will promote it to a wide variety of PG users. Data from Google Analytics, Twitonomy and Altmetrics will inform usage evaluation. Complementary educational workshops will be conducted for CYMH professionals. Print materials and journal articles will be produced. CRD42017060738. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Cultural competency assessment tool for hospitals: evaluating hospitals' adherence to the culturally and linguistically appropriate services standards.

PubMed

Weech-Maldonado, Robert; Dreachslin, Janice L; Brown, Julie; Pradhan, Rohit; Rubin, Kelly L; Schiller, Cameron; Hays, Ron D

2012-01-01

The U.S. national standards for culturally and linguistically appropriate services (CLAS) in health care provide guidelines on policies and practices aimed at developing culturally competent systems of care. The Cultural Competency Assessment Tool for Hospitals (CCATH) was developed as an organizational tool to assess adherence to the CLAS standards. First, we describe the development of the CCATH and estimate the reliability and validity of the CCATH measures. Second, we discuss the managerial implications of the CCATH as an organizational tool to assess cultural competency. We pilot tested an initial draft of the CCATH, revised it based on a focus group and cognitive interviews, and then administered it in a field test with a sample of California hospitals. The reliability and validity of the CCATH were evaluated using factor analysis, analysis of variance, and Cronbach's alphas. Exploratory and confirmatory factor analyses identified 12 CCATH composites: leadership and strategic planning, data collection on inpatient population, data collection on service area, performance management systems and quality improvement, human resources practices, diversity training, community representation, availability of interpreter services, interpreter services policies, quality of interpreter services, translation of written materials, and clinical cultural competency practices. All the CCATH scales had internal consistency reliability of .65 or above, and the reliability was .70 or above for 9 of the 12 scales. Analysis of variance results showed that not-for-profit hospitals have higher CCATH scores than for-profit hospitals in five CCATH scales and higher CCATH scores than government hospitals in two CCATH scales. The CCATH showed adequate psychometric properties. Managers and policy makers can use the CCATH as a tool to evaluate hospital performance in cultural competency and identify and target improvements in hospital policies and practices that undergird the provision of CLAS.

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

PubMed

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

PubMed Central

Wind, Stefanie A.; Engelhard, George

2015-01-01

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rater-mediated assessments involve complex interactions among many variables, including assessment contexts, student artifacts, rubrics, individual rater characteristics, and others, rater-assigned scores are suitable candidates for Mokken scale analysis. The purposes of this study are to describe a suite of indices that can be used to explore the psychometric quality of data from rater-mediated assessments and to illustrate the substantive interpretation of Mokken-based statistics and displays in this context. Techniques that are commonly used in polytomous applications of Mokken scaling are adapted for use with rater-mediated assessments, with a focus on the substantive interpretation related to individual raters. Overall, the findings suggest that indices of rater monotonicity, rater scalability, and invariant rater ordering based on Mokken scaling provide diagnostic information at the level of individual raters related to the requirements for invariant measurement. These Mokken-based indices serve as an additional suite of diagnostic tools for exploring the quality of data from rater-mediated assessments that can supplement rating quality indices based on parametric models. PMID:29795883

Assessing quality of health services with the SERVQUAL model in Iran. A systematic review and meta-analysis.

PubMed

Teshnizi, Saeed Hosseini; Aghamolaei, Teamur; Kahnouji, Kobra; Teshnizi, Seyyed Mehrdad Hosseini; Ghani, Jalil

2018-03-01

The five-dimension service quality (SERVQUAL) scale is one of the most common tools for evaluating gaps between clients' perceptions and expectations. This study aimed to assess the quality of health services in Iran through a meta-analysis of all Iranian studies which used the SERVQUAL tool. A systematic literature review has been performed in Web of Science, PubMed, Scopus, Google Scholar, Iran Medex, Magiran and Scientific Information Database. All relevant English or Persian studies published between January 2009 and April 2016 were have been selected. Papers were considered if they regarded all five dimensions of the SERVQUAL tool for assessing the quality of health care services. Two reviewer independently extracted mean and standard deviation of five dimensions and characteristics of studies. The quality of studies included in meta-analysis using STROBE checklist. Of 315 studies initially identified, 12 were included in our meta-analysis. All analyses were performed in Stata MP v. 14. Patients' perceptions were lower than their expectations (gap = -1.64). Responsibility (-1.22) and reliability (-1.15) had the lowest gaps, and tangibility and empathy (-1.03) had the largest gaps. Except gender, other variables had no significant associations with gaps. Patients in the cities of Arak (-3.47) and Shiraz (-3.02) had the largest gaps. All dimensions of service quality were negative, which implies that the quality of health services in Iran has not been satisfying to patients and needs to be improved.

Development of a Comprehensive and Interactive Tool to Inform State Violence and Injury Prevention Plans.

PubMed

Wilson, Lauren; Deokar, Angela J; Zaesim, Araya; Thomas, Karen; Kresnow-Sedacca, Marcie-Jo

The Center of Disease Control and Prevention's Core State Violence and Injury Prevention Program (Core SVIPP) provides an opportunity for states to engage with their partners to implement, evaluate, and disseminate strategies that lead to the reduction and prevention of injury and violence. Core SVIPP requires awardees to develop or update their state injury and violence plans. Currently, literature informing state planning efforts is limited, especially regarding materials related to injury and violence. Presumably, plans that are higher quality result in having a greater impact on preventing injury and violence, and literature to improve quality would benefit prevention programming. (1) To create a comprehensive injury-specific index to aid in the development and revision of state injury and violence prevention plans, and (2) to assess the reliability and utility of this index. Through an iterative development process, a workgroup of subject matter experts created the Violence and Injury Prevention: Comprehensive Index Tool (VIP:CIT). The tool was pilot tested on 3 state injury and violence prevention plans and assessed for initial usability. Following revisions to the tool (ie, a rubric was developed to further delineate consistent criteria for rating; items were added and clarified), the same state plans were reassessed to test interrater reliability and tool utility. For the second assessment, reliability of the VIP:CIT improved, indicating that the rubric was a useful addition. Qualitative feedback from states suggested that the tool significantly helped guide plan development and communicate about planning processes. The final VIP:CIT is a tool that can help increase plan quality, decrease the research-to-practice gap, and increase connectivity to emerging public health paradigms. The tool provides an example of tailoring guidance materials to reflect academic literature, and it can be easily adapted to other topic areas to promote quality of strategic plans for numerous outcomes.

Development of a Comprehensive and Interactive Tool to Inform State Violence and Injury Prevention Plans

PubMed Central

Wilson, Lauren; Deokar, Angela J.; Zaesim, Araya; Thomas, Karen; Kresnow-Sedacca, Marcie-jo

2018-01-01

Context The Center of Disease Control and Prevention’s Core State Violence and Injury Prevention Program (Core SVIPP) provides an opportunity for states to engage with their partners to implement, evaluate, and disseminate strategies that lead to the reduction and prevention of injury and violence. Core SVIPP requires awardees to develop or update their state injury and violence plans. Currently, literature informing state planning efforts is limited, especially regarding materials related to injury and violence. Presumably, plans that are higher quality result in having a greater impact on preventing injury and violence, and literature to improve quality would benefit prevention programming. Objective (1) To create a comprehensive injury-specific index to aid in the development and revision of state injury and violence prevention plans, and (2) to assess the reliability and utility of this index. Design Through an iterative development process, a workgroup of subject matter experts created the Violence and Injury Prevention: Comprehensive Index Tool (VIP:CIT). The tool was pilot tested on 3 state injury and violence prevention plans and assessed for initial usability. Following revisions to the tool (ie, a rubric was developed to further delineate consistent criteria for rating; items were added and clarified), the same state plans were reassessed to test interrater reliability and tool utility. Results For the second assessment, reliability of the VIP:CIT improved, indicating that the rubric was a useful addition. Qualitative feedback from states suggested that the tool significantly helped guide plan development and communicate about planning processes. Conclusion The final VIP:CIT is a tool that can help increase plan quality, decrease the research-to-practice gap, and increase connectivity to emerging public health paradigms. The tool provides an example of tailoring guidance materials to reflect academic literature, and it can be easily adapted to other topic areas to promote quality of strategic plans for numerous outcomes. PMID:29189505

Using an innovative combination of quality-by-design and green analytical chemistry approaches for the development of a stability indicating UHPLC method in pharmaceutical products.

PubMed

Boussès, Christine; Ferey, Ludivine; Vedrines, Elodie; Gaudin, Karen

2015-11-10

An innovative combination of green chemistry and quality by design (QbD) approach is presented through the development of an UHPLC method for the analysis of the main degradation products of dextromethorphan hydrobromide. QbD strategy was integrated to the field of green analytical chemistry to improve method understanding while assuring quality and minimizing environmental impacts, and analyst exposure. This analytical method was thoroughly evaluated by applying risk assessment and multivariate analysis tools. After a scouting phase aimed at selecting a suitable stationary phase and an organic solvent in accordance with green chemistry principles, quality risk assessment tools were applied to determine the critical process parameters (CPPs). The effects of the CPPs on critical quality attributes (CQAs), i.e., resolutions, efficiencies, and solvent consumption were further evaluated by means of a screening design. A response surface methodology was then carried out to model CQAs as function of the selected CPPs and the optimal separation conditions were determined through a desirability analysis. Resulting contour plots enabled to establish the design space (DS) (method operable design region) where all CQAs fulfilled the requirements. An experimental validation of the DS proved that quality within the DS was guaranteed; therefore no more robustness study was required before the validation. Finally, this UHPLC method was validated using the concept of total error and was used to analyze a pharmaceutical drug product. Copyright © 2015 Elsevier B.V. All rights reserved.

Quality of Mobile Phone and Tablet Mobile Apps for Speech Sound Disorders: Protocol for an Evidence-Based Appraisal

PubMed Central

Morris, Meg E; Erickson, Shane; Serry, Tanya A

2016-01-01

Background Although mobile apps are readily available for speech sound disorders (SSD), their validity has not been systematically evaluated. This evidence-based appraisal will critically review and synthesize current evidence on available therapy apps for use by children with SSD. Objective The main aims are to (1) identify the types of apps currently available for Android and iOS mobile phones and tablets, and (2) to critique their design features and content using a structured quality appraisal tool. Methods This protocol paper presents and justifies the methods used for a systematic review of mobile apps that provide intervention for use by children with SSD. The primary outcomes of interest are (1) engagement, (2) functionality, (3) aesthetics, (4) information quality, (5) subjective quality, and (6) perceived impact. Quality will be assessed by 2 certified practicing speech-language pathologists using a structured quality appraisal tool. Two app stores will be searched from the 2 largest operating platforms, Android and iOS. Systematic methods of knowledge synthesis shall include searching the app stores using a defined procedure, data extraction, and quality analysis. Results This search strategy shall enable us to determine how many SSD apps are available for Android and for iOS compatible mobile phones and tablets. It shall also identify the regions of the world responsible for the apps’ development, the content and the quality of offerings. Recommendations will be made for speech-language pathologists seeking to use mobile apps in their clinical practice. Conclusions This protocol provides a structured process for locating apps and appraising the quality, as the basis for evaluating their use in speech pathology for children in English-speaking nations. PMID:27899341

Quality of Mobile Phone and Tablet Mobile Apps for Speech Sound Disorders: Protocol for an Evidence-Based Appraisal.

PubMed

Furlong, Lisa M; Morris, Meg E; Erickson, Shane; Serry, Tanya A

2016-11-29

Although mobile apps are readily available for speech sound disorders (SSD), their validity has not been systematically evaluated. This evidence-based appraisal will critically review and synthesize current evidence on available therapy apps for use by children with SSD. The main aims are to (1) identify the types of apps currently available for Android and iOS mobile phones and tablets, and (2) to critique their design features and content using a structured quality appraisal tool. This protocol paper presents and justifies the methods used for a systematic review of mobile apps that provide intervention for use by children with SSD. The primary outcomes of interest are (1) engagement, (2) functionality, (3) aesthetics, (4) information quality, (5) subjective quality, and (6) perceived impact. Quality will be assessed by 2 certified practicing speech-language pathologists using a structured quality appraisal tool. Two app stores will be searched from the 2 largest operating platforms, Android and iOS. Systematic methods of knowledge synthesis shall include searching the app stores using a defined procedure, data extraction, and quality analysis. This search strategy shall enable us to determine how many SSD apps are available for Android and for iOS compatible mobile phones and tablets. It shall also identify the regions of the world responsible for the apps' development, the content and the quality of offerings. Recommendations will be made for speech-language pathologists seeking to use mobile apps in their clinical practice. This protocol provides a structured process for locating apps and appraising the quality, as the basis for evaluating their use in speech pathology for children in English-speaking nations. ©Lisa M Furlong, Meg E Morris, Shane Erickson, Tanya A Serry. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 29.11.2016.

Operational CryoSat Product Quality Assessment

NASA Astrophysics Data System (ADS)

Mannan, Rubinder; Webb, Erica; Hall, Amanda; Bouzinac, Catherine

2013-12-01

The performance and quality of the CryoSat data products are routinely assessed by the Instrument Data quality Evaluation and Analysis Service (IDEAS). This information is then conveyed to the scientific and user community in order to allow them to utilise CryoSat data with confidence. This paper presents details of the Quality Control (QC) activities performed for CryoSat products under the IDEAS contract. Details of the different QC procedures and tools deployed by IDEAS to assess the quality of operational data are presented. The latest updates to the Instrument Processing Facility (IPF) for the Fast Delivery Marine (FDM) products and the future update to Baseline-C are discussed.

A psychometric evaluation of the digital logic concept inventory

NASA Astrophysics Data System (ADS)

Herman, Geoffrey L.; Zilles, Craig; Loui, Michael C.

2014-10-01

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric evaluation). Classical Test Theory and Item Response Theory provide two psychometric frameworks for evaluating the quality of assessment tools. We discuss how these theories can be applied to assessment tools generally and then apply them to the Digital Logic Concept Inventory (DLCI). We demonstrate that the DLCI is sufficiently reliable for research purposes when used in its entirety and as a post-course assessment of students' conceptual understanding of digital logic. The DLCI can also discriminate between students across a wide range of ability levels, providing the most information about weaker students' ability levels.

Outcome Measures in Spinal Cord Injury

PubMed Central

Alexander, Marcalee S.; Anderson, Kim; Biering-Sorensen, Fin; Blight, Andrew R.; Brannon, Ruth; Bryce, Thomas; Creasey, Graham; Catz, Amiram; Curt, Armin; Donovan, William; Ditunno, John; Ellaway, Peter; Finnerup, Nanna B.; Graves, Daniel E.; Haynes, Beth Ann; Heinemann, Allen W.; Jackson, Amie B.; Johnston, Mark; Kalpakjian, Claire Z.; Kleitman, Naomi; Krassioukov, Andrei; Krogh, Klaus; Lammertse, Daniel; Magasi, Susan; Mulcahey, MJ; Schurch, Brigitte; Sherwood, Arthur; Steeves, John D.; Stiens, Steven; Tulsky, David S.; van Hedel, Hubertus J.A.; Whiteneck, Gale

2009-01-01

Study Design review by the Spinal Cord Outcomes Partnership Endeavor (SCOPE), which is a broad-based international consortium of scientists and clinical researchers representing academic institutions, industry, government agencies, not-for-profit organizations and foundations. Objectives assessment of current and evolving tools for evaluating human spinal cord injury (SCI) outcomes for both clinical diagnosis and clinical research studies. Methods a framework for the appraisal of evidence of metric properties was used to examine outcome tools or tests for accuracy, sensitivity, reliability and validity for human SCI. Results imaging, neurological, functional, autonomic, sexual health, bladder/bowel, pain, and psycho-social tools were evaluated. Several specific tools for human SCI studies have or are being developed to allow the more accurate determination for a clinically meaningful benefit (improvement in functional outcome or quality of life) being achieved as a result of a therapeutic intervention. Conclusion significant progress has been made, but further validation studies are required to identify the most appropriate tools for specific targets in a human SCI study or clinical trial. PMID:19381157

Quality and Usability of Arthritic Pain Self-Management Apps for Older Adults: A Systematic Review.

PubMed

Bhattarai, Priyanka; Newton-John, T R O; Phillips, Jane L

2018-03-01

To appraise the quality and usability of currently available pain applications that could be used by community-dwelling older adults to self-manage their arthritic pain. A systematic review. Searches were conducted in App Store and Google Play to identify pain self-management apps relevant to arthritic pain management. English language pain management apps providing pain assessment and documentation function and pain management education were considered for inclusion. A quality evaluation audit tool based on the Stanford Arthritis Self-Management Program was developed a priori to evaluate app content quality. The usability of included apps was assessed using an established usability evaluation tool. Out of the 373 apps that were identified, four met the inclusion criteria. The included apps all included a pain assessment and documentation function and instructions on medication use, communication with health professionals, cognitive behavioral therapy-based pain management, and physical exercise. Management of mood, depression, anxiety, and sleep were featured in most apps (N = 3). Three-quarters (N = 3) of the apps fell below the acceptable moderate usability score (≥3), while one app obtained a moderate score (3.2). Few of the currently available pain apps offer a comprehensive pain self-management approach incorporating evidence-based strategies in accordance with the Stanford Arthritis Self-Management Program. The moderate-level usability across the included apps indicates a need to consider the usability needs of the older population in future pain self-management app development endeavors.

YoungStar in Wisconsin: Analysis of Data as of July 2014. YoungStar Progress Report #5

ERIC Educational Resources Information Center

Wisconsin Council on Children and Families, 2014

2014-01-01

YoungStar is a program of the Department of Children and Families (DCF) designed to improve the quality of child care for Wisconsin children. YoungStar is designed to: (1) evaluate and rate the quality of care given by child care providers; (2) help parents choose the best child care for their kids; (3) support providers with tools and training to…

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Development of a personalized decision aid for breast cancer risk reduction and management.

PubMed

Ozanne, Elissa M; Howe, Rebecca; Omer, Zehra; Esserman, Laura J

2014-01-14

Breast cancer risk reduction has the potential to decrease the incidence of the disease, yet remains underused. We report on the development a web-based tool that provides automated risk assessment and personalized decision support designed for collaborative use between patients and clinicians. Under Institutional Review Board approval, we evaluated the decision tool through a patient focus group, usability testing, and provider interviews (including breast specialists, primary care physicians, genetic counselors). This included demonstrations and data collection at two scientific conferences (2009 International Shared Decision Making Conference, 2009 San Antonio Breast Cancer Symposium). Overall, the evaluations were favorable. The patient focus group evaluations and usability testing (N = 34) provided qualitative feedback about format and design; 88% of these participants found the tool useful and 94% found it easy to use. 91% of the providers (N = 23) indicated that they would use the tool in their clinical setting. BreastHealthDecisions.org represents a new approach to breast cancer prevention care and a framework for high quality preventive healthcare. The ability to integrate risk assessment and decision support in real time will allow for informed, value-driven, and patient-centered breast cancer prevention decisions. The tool is being further evaluated in the clinical setting.

Evaluation of Fly Ash Quality Control Tools

DOT National Transportation Integrated Search

2010-06-30

Many entities currently use fly ash in portland cement concrete (PCC) pavements and structures. Although the body of knowledge is : great concerning the use of fly ash, several projects per year are subject to poor performance where fly ash is named ...

Evaluation of fly ash quality control tools.

DOT National Transportation Integrated Search

2010-06-30

Many entities currently use fly ash in portland cement concrete (PCC) pavements and structures. Although the body of knowledge is : great concerning the use of fly ash, several projects per year are subject to poor performance where fly ash is named ...

LOUISIANA ENVIRONMENTAL MODELING SYSTEM FOR HYPOXIA RELATED ISSUES

EPA Science Inventory

An environmental assessment tool to evaluate the impacts of nonpoint source (NPS) pollutants discharged from Mississippi River basins into the Gulf of Mexico and to assess their effects on receiving water quality will be described. This system (Louisiana Environmental Modeling S...

Quality assurance and the need to evaluate interventions and audit programme outcomes.

PubMed

Zhao, Min; Vaartjes, Ilonca; Klipstein-Grobusch, Kerstin; Kotseva, Kornelia; Jennings, Catriona; Grobbee, Diederick E; Graham, Ian

2017-06-01

Evidence-based clinical guidelines provide standards for the provision of healthcare. However, these guidelines have been poorly implemented in daily practice. Clinical audit is a quality improvement tool to promote quality of care in daily practice and to improve outcomes through the systematic review of care delivery and implementation of changes. A major priority in the management of subjects with cardiovascular disease (CVD) management is secondary prevention by controlling cardiovascular risk factors and providing appropriate medical treatment. Clinical audits can be applied to monitor modifiable risk factors and evaluate quality improvements of CVD management in daily practice. Existing clinical audits have provided an overview of the burden of risk factors in subjects with CVD and reflect real-world risk factor recording and management. However, consistent and representative data from clinic audits are still insufficient to fully monitor quality improvement of CVD management. Data are lacking in particular from low- and middle-income countries, limiting the evaluation of CVD management quality by clinical audit projects in many settings. To support the development of clinical standards, monitor daily practice performance, and improve quality of care in CVD management at national and international levels, more widespread clinical audits are warranted.

Monitoring the sensory quality of canned white asparagus through cluster analysis.

PubMed

Arana, Inés; Ibañez, Francisco C; Torre, Paloma

2016-05-01

White asparagus is one of the 30 vegetables most consumed in the world. This paper unifies the stages of their sensory quality control. The aims of this work were to describe the sensory properties of canned white asparagus and their quality control and to evaluate the applicability of agglomerative hierarchical clustering (AHC) for classifying and monitoring the sensory quality of manufacturers. Sixteen sensory descriptors and their evaluation technique were defined. The sensory profile of canned white asparagus was high flavor characteristic, little acidity and bitterness, medium firmness and very light fibrosity, among other characteristics. The dendrogram established groups of manufacturers that had similar scores in the same set of descriptors, and each cluster grouped the manufacturers that had a similar quality profile. The sensory profile of canned white asparagus was clearly defined through the intensity evaluation of 16 descriptors, and the sensory quality report provided to the manufacturers is in detail and of easy interpretation. AHC grouped the manufacturers according to the highest quality scores in certain descriptors and is a useful tool because it is very visual. © 2015 Society of Chemical Industry. © 2015 Society of Chemical Industry.

Tools for structured team communication in pre-registration health professions education: a Best Evidence Medical Education (BEME) review: BEME Guide No. 41.

PubMed

Buckley, Sharon; Ambrose, Lucy; Anderson, Elizabeth; Coleman, Jamie J; Hensman, Marianne; Hirsch, Christine; Hodson, James; Morley, David; Pittaway, Sarah; Stewart, Jonathan

2016-10-01

Calls for the inclusion of standardized protocols for information exchange into pre-registration health professions curricula have accompanied their introduction into clinical practice. In order to help clinical educators respond to these calls, we have reviewed educational interventions for pre-registration students that incorporate one or more of these ?tools for structured communication?. Searches of 10 databases (1990?2014) were supplemented by hand searches and by citation searches (to January 2015). Studies evaluating an intervention for pre-registration students of any clinical profession and incorporating at least one tool were included. Quality of included studies was assessed using a checklist of 11 indicators and a narrative synthesis of findings undertaken. Fifty studies met our inclusion criteria. Of these, 21 evaluated the specific effect of a tool on educational outcomes, and 27 met seven or more quality indicators. Pre-registration students, particularly those in the US, are learning to use tools for structured communication either in specific sessions or integrated into more extensive courses or programmes; mostly 'Situation Background Assessment Recommendation' and its variants. There is some evidence that learning to use a tool can improve the clarity and comprehensiveness of student communication, their perceived self-confidence and their sense of preparedness for clinical practice. There is, as yet, little evidence for the transfer of these skills to the clinical setting or for any influence of teaching approach on learning outcomes. Educators will need to consider the positioning of such learning with other skills such as clinical reasoning and decision-making.

The Tool for Understanding Residents' Needs as Individual Persons (TURNIP): construction and initial testing.

PubMed

Edvardsson, David; Fetherstonhaugh, Deirdre; Nay, Rhonda

2011-10-01

To construct and evaluate an intervention tool for increasing the person-centredness of care in residential aged care services. Providing care that is person-centred and evidence-based is increasingly being regarded as synonymous with best quality aged care. However, consensus about how person-centred care should be defined, operationalised and implemented has not yet been reached. Literature reviews, expert consultation (n = 22) and stakeholder interviews (n = 67) were undertaken to develop the Tool for Understanding Residents' Needs as Individual Persons (TURNIP). Statistical estimates of validity and reliability were employed to evaluate the tool in an Australian convenience sample of aged care staff (n = 220). The 39 item TURNIP conceptualised person-centred care into five dimensions: (1) the care environment, (2) staff members' attitudes towards dementia, (3) staff members' knowledge about dementia, (4) the care organisation and (5) the content of care provided. Psychometric testing indicated satisfactory validity and reliability, as shown for example in a total Cronbach's alpha of 0·89. The TURNIP adds to current literature on person-centred care by presenting a rigorously developed intervention tool based on an explicit conceptual structure that can inform the design, employment and communication of clinical interventions aiming to promote person-centred care. The TURNIP contains clinically relevant items that are ready to be applied in clinical aged care. The tool can be used as a base for clinical interventions applying discussions in aged care organisations about the quality of current care and how to increase person-centredness of the care provided. © 2011 Blackwell Publishing Ltd.

Fundamentals of Acoustic Measurements on Trees and Logs and Their Implication to Field Application

Treesearch

Xiping Wang

2011-01-01

Acoustic technologies have been well established as material evaluation tools in the past several decades, and their use has become widely accepted in the forest products industry for on-line quality control and products grading. Recent research developments on acoustic sensing technology offer further opportunities to evaluate standing trees and logs for general wood...

An Overview of Key Indicators and Evaluation Tools for Assessing Housing Quality: A Literature Review

NASA Astrophysics Data System (ADS)

Sinha, Rajan Chandra; Sarkar, Satyaki; Mandal, Nikhil Ranjan

2017-09-01

The issue of the housing quality has been addressed for various stakeholders at different levels. There exist varied opinion about its measurability and possible applications. Thus the study is carried out to have an insight into the concept of housing quality and its relevance in the changing demographics, technological, socio-economic and socio-cultural conditions. This study attempts to summarize the literature that addresses past research concerned with factors related to housing quality, its measurement methodology and critically examines the broad key indicators identified to have impact upon enhancing the housing quality. This work discusses the recent techniques which are extensively used for analysis of housing quality.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

From parabolic-trough to metasurface-concentrator: assessing focusing in the wave-optics limit.

PubMed

Hsu, Liyi; Dupré, Matthieu; Ndao, Abdoulaye; Kanté, Boubacar

2017-04-15

Metasurfaces are promising tools toward novel designs for flat optics applications. As such, their quality and tolerance to fabrication imperfections need to be evaluated with specific tools. However, most such tools rely on the geometrical optics approximation and are not straightforwardly applicable to metasurfaces. In this Letter, we introduce and evaluate for metasurfaces parameters such as intercept factor and slope error usually defined for solar concentrators in the realm of ray-optics. After proposing definitions valid in physical optics, we put forward an approach to calculate them. As examples, we design three different concentrators based on three specific unit cells and assess them numerically. The concept allows for comparison of the efficiency of the metasurfaces and their sensitivities to fabrication imperfections and will be critical for practical systems implementation.

What information is used in treatment decision aids? A systematic review of the types of evidence populating health decision aids.

PubMed

Clifford, Amanda M; Ryan, Jean; Walsh, Cathal; McCurtin, Arlene

2017-02-23

Patient decision aids (DAs) are support tools designed to provide patients with relevant information to help them make informed decisions about their healthcare. While DAs can be effective in improving patient knowledge and decision quality, it is unknown what types of information and evidence are used to populate such decision tools. Systematic methods were used to identify and appraise the relevant literature and patient DAs published between 2006 and 2015. Six databases (Academic Search Complete, AMED, CINAHL, Biomedical Reference Collection, General Sciences and MEDLINE) and reference list searching were used. Articles evaluating the effectiveness of the DAs were appraised using the Cochrane Risk of Bias tool. The content, quality and sources of evidence in the decision aids were evaluated using the IPDASi-SF and a novel classification system. Findings were synthesised and a narrative analysis was performed on the results. Thirteen studies representing ten DAs met the inclusion criteria. The IPDASI-SF score ranged from 9 to 16 indicating many of the studies met the majority of quality criteria. Sources of evidence were described but reports were sometimes generic or missing important information. The majority of DAs incorporated high quality research evidence including systematic reviews and meta-analyses. Patient and practice evidence was less commonly employed, with only a third of included DAs using these to populate decision aid content. The quality of practice and patient evidence ranged from high to low. Contextual factors were addressed across all DAs to varying degrees and covered a range of factors. This is an initial study examining the information and evidence used to populate DAs. While research evidence and contextual factors are well represented in included DAs, consideration should be given to incorporating high quality information representing all four pillars of evidence based practice when developing DAs. Further, patient and expert practice evidence should be acquired rigorously and DAs should report the means by which such evidence is obtained with citations clearly provided.

Using Third Party Data to Update a Reference Dataset in a Quality Evaluation Service

NASA Astrophysics Data System (ADS)

Xavier, E. M. A.; Ariza-López, F. J.; Ureña-Cámara, M. A.

2016-06-01

Nowadays it is easy to find many data sources for various regions around the globe. In this 'data overload' scenario there are few, if any, information available about the quality of these data sources. In order to easily provide these data quality information we presented the architecture of a web service for the automation of quality control of spatial datasets running over a Web Processing Service (WPS). For quality procedures that require an external reference dataset, like positional accuracy or completeness, the architecture permits using a reference dataset. However, this reference dataset is not ageless, since it suffers the natural time degradation inherent to geospatial features. In order to mitigate this problem we propose the Time Degradation & Updating Module which intends to apply assessed data as a tool to maintain the reference database updated. The main idea is to utilize datasets sent to the quality evaluation service as a source of 'candidate data elements' for the updating of the reference database. After the evaluation, if some elements of a candidate dataset reach a determined quality level, they can be used as input data to improve the current reference database. In this work we present the first design of the Time Degradation & Updating Module. We believe that the outcomes can be applied in the search of a full-automatic on-line quality evaluation platform.

A flexible tool for hydraulic and water quality performance analysis of green infrastructure

NASA Astrophysics Data System (ADS)

Massoudieh, A.; Alikhani, J.

2017-12-01

Models that allow for design considerations of green infrastructure (GI) practices to control stormwater runoff and associated contaminants have received considerable attention in recent years. To be used to evaluate the effect design configurations on the long-term performance of GIs, models should be able to consider processes within GIs with good fidelity. In this presentation, a sophisticated, yet flexible tool for hydraulic and water quality assessment of GIs will be introduced. The tool can be used by design engineers and researchers to capture and explore the effect of design factors and properties of the media employed in the performance of GI systems at a relatively small scale. We deemed it essential to have a flexible GI modeling tool that is capable of simulating GI system components and specific biogeochemical processes affecting contaminants such as evapotranspiration, plant uptake, reactions, and particle-associated transport accurately while maintaining a high degree of flexibility to account for the myriad of GI alternatives. The mathematical framework for a stand-alone GI performance assessment tool has been developed and will be demonstrated. The process-based model framework developed here can be used to model a diverse range of GI practices such as stormwater ponds, green roofs, retention ponds, bioretention systems, infiltration trench, permeable pavement and other custom-designed combinatory systems. An example of the application of the system to evaluate the performance of a rain-garden system will be demonstrated.

Design of Friction Stir Spot Welding Tools by Using a Novel Thermal-Mechanical Approach

PubMed Central

Su, Zheng-Ming; Qiu, Qi-Hong; Lin, Pai-Chen

2016-01-01

A simple thermal-mechanical model for friction stir spot welding (FSSW) was developed to obtain similar weld performance for different weld tools. Use of the thermal-mechanical model and a combined approach enabled the design of weld tools for various sizes but similar qualities. Three weld tools for weld radii of 4, 5, and 6 mm were made to join 6061-T6 aluminum sheets. Performance evaluations of the three weld tools compared fracture behavior, microstructure, micro-hardness distribution, and welding temperature of welds in lap-shear specimens. For welds made by the three weld tools under identical processing conditions, failure loads were approximately proportional to tool size. Failure modes, microstructures, and micro-hardness distributions were similar. Welding temperatures correlated with frictional heat generation rate densities. Because the three weld tools sufficiently met all design objectives, the proposed approach is considered a simple and feasible guideline for preliminary tool design. PMID:28773800

Design of Friction Stir Spot Welding Tools by Using a Novel Thermal-Mechanical Approach.

PubMed

Su, Zheng-Ming; Qiu, Qi-Hong; Lin, Pai-Chen

2016-08-09

A simple thermal-mechanical model for friction stir spot welding (FSSW) was developed to obtain similar weld performance for different weld tools. Use of the thermal-mechanical model and a combined approach enabled the design of weld tools for various sizes but similar qualities. Three weld tools for weld radii of 4, 5, and 6 mm were made to join 6061-T6 aluminum sheets. Performance evaluations of the three weld tools compared fracture behavior, microstructure, micro-hardness distribution, and welding temperature of welds in lap-shear specimens. For welds made by the three weld tools under identical processing conditions, failure loads were approximately proportional to tool size. Failure modes, microstructures, and micro-hardness distributions were similar. Welding temperatures correlated with frictional heat generation rate densities. Because the three weld tools sufficiently met all design objectives, the proposed approach is considered a simple and feasible guideline for preliminary tool design.

The STAR score: a method for auditing clinical records

PubMed Central

Tuffaha, H

2012-01-01

INTRODUCTION Adequate medical note keeping is critical in delivering high quality healthcare. However, there are few robust tools available for the auditing of notes. The aim of this paper was to describe the design, validation and implementation of a novel scoring tool to objectively assess surgical notes. METHODS An initial ‘path finding’ study was performed to evaluate the quality of note keeping using the CRABEL scoring tool. The findings prompted the development of the Surgical Tool for Auditing Records (STAR) as an alternative. STAR was validated using inter-rater reliability analysis. An audit cycle of surgical notes using STAR was performed. The results were analysed and a structured form for the completion of surgical notes was introduced to see if the quality improved in the next audit cycle using STAR. An education exercise was conducted and all participants said the exercise would change their practice, with 25% implementing major changes. RESULTS Statistical analysis of STAR showed that it is reliable (Cronbach’s a = 0.959). On completing the audit cycle, there was an overall increase in the STAR score from 83.344% to 97.675% (p<0.001) with significant improvements in the documentation of the initial clerking from 59.0% to 96.5% (p<0.001) and subsequent entries from 78.4% to 96.1% (p<0.001). CONCLUSIONS The authors believe in the value of STAR as an effective, reliable and reproducible tool. Coupled with the application of structured forms to note keeping, it can significantly improve the quality of surgical documentation and can be implemented universally. PMID:22613300

Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

PubMed

McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

2012-10-01

To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management of the program.