Characteristics of national registries for occupational diseases: international development and validation of an audit tool (ODIT).

PubMed

Spreeuwers, Dick; de Boer, Angela G E M; Verbeek, Jos H A M; van Dijk, Frank J H

2009-10-23

The aim of the study was to develop quality indicators that can be used for quality assessment of registries of occupational diseases in relation to preventive policy on a national level. The research questions were: 1. Which indicators determine the quality of national registries of occupational diseases with respect to their ability to provide appropriate information for preventive policy? 2. What are the criteria that can distinguish low quality from high quality? First, we performed a literature search to assess which output of registries can be considered appropriate for preventive policy and to develop a set of preliminary indicators and criteria. Second, final indicators and criteria were assessed and their content validity was tested in a Delphi study, for which experts from the 25 EU Member States were invited. The literature search revealed two different types of information output to be appropriate for preventive policy: monitor and alert information. For the evaluation of the quality of the monitor and alert function we developed ten indicators and criteria. Sixteen of the twenty-five experts responded in the first round of the Delphi study, and eleven in the second round. Based on their comments, we assessed the final nine indicators: the completeness of the notification form, coverage of registration, guidelines or criteria for notification, education and training of reporting physicians, completeness of registration, statistical methods used, investigation of special cases, presentation of monitor information, and presentation of alert information. Except for the indicator "coverage of registration" for the alert function, all the indicators met the preset requirements of content validity. We have developed quality indicators and criteria to evaluate registries for occupational diseases on the ability to provide appropriate information for preventive policy on a national level. Together, these indicators form a tool which can be used for quality improvement of registries of occupational diseases.

Psychometric Properties of the Persian Translation of the Sexual Quality of Life–Male Questionnaire

PubMed Central

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2016-01-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life–Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward–backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test–retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M (p < .001). Reliability evaluation indicated a high internal consistency and test–retest reliability. The Cronbach’s alpha coefficient and intraclass correlation coefficients were .96 and .95, respectively. Results indicated that the Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men. PMID:26856758

Psychometric Properties of the Persian Translation of the Sexual Quality of Life-Male Questionnaire.

PubMed

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2017-05-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life-Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward-backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test-retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M ( p < .001). Reliability evaluation indicated a high internal consistency and test-retest reliability. The Cronbach's alpha coefficient and intraclass correlation coefficients were .96 and .95, respectively. Results indicated that the Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men.

How do stakeholder groups vary in a Delphi technique about primary mental health care and what factors influence their ratings?

PubMed

Campbell, S M; Shield, T; Rogers, A; Gask, L

2004-12-01

While mental health is a core part of primary care, there are few validated quality measures and little relevant internationally published research. Consensus panel methods are a useful means of developing quality measures where evidence is sparse and/or opinions are diverse. However, little is known about the dynamics of consensus techniques and the factors that influence the judgements and ratings of panels and individual panelists. (1) To describe differences in panel ratings on the quality of primary mental health care services by patient, carer, professional and managerial panels within a Delphi procedure; and (2) to explore why different panels and panelists rate quality indicators of primary mental health care differently. Two round postal Delphi technique and exploratory semi-structured interviews. 115 panelists across 11 panels. Eleven panelists were subsequently interviewed. 87 of 334 indicators (26%) were rated face valid by all 11 panels. There was little disagreement within panel ratings but significant differences between panels. The GP panel rated the least number of indicators valid (n = 138, 41%) and carers the most (n = 304, 91%). The way in which panelists interpreted and conceptualised the indicators and their definition of quality of mental health care affected the way in which participants made their ratings. Stakeholders in primary mental health care have diverse views of quality of care and these differences translate into how they rate quality indicators. Exploratory interviews suggest that ratings are influenced by past experience, expectations, definitions of quality of care, and perceived power relationships between stakeholders.

Development and validation of the Chinese version of dry eye related quality of life scale.

PubMed

Zheng, Bang; Liu, Xiao-Jing; Sun, Yue-Qian Fiona; Su, Jia-Zeng; Zhao, Yang; Xie, Zheng; Yu, Guang-Yan

2017-07-17

To develop the Chinese version of quality of life scale for dry eye patients based on the Impact of Dry Eye on Everyday Life (IDEEL) questionnaire and to assess the reliability and validity of the developed scale. The original IDEEL was adapted cross-culturally to Chinese language and further developed following standard procedures. A total of 100 Chinese patients diagnosed with dry eye syndrome were included to investigate the psychometric properties of the Chinese version of scale. Psychometric tests included internal consistency (Cronbach's ɑ coefficients), construct validity (exploratory factor analysis), and known-groups validity (the analysis of variance). The Chinese version of Dry Eye Related Quality of Life (CDERQOL) Scale contains 45 items classified into 5 domains. Good to excellent internal consistency reliability was demonstrated for all 5 domains (Cronbach's ɑ coefficients range from 0.716 to 0.913). Construct validity assessment indicated a consistent factorial structure of the CDERQOL scale with hypothesized construct, with the exception of "Dry Eye Symptom-Bother" domain. All domain scores were detected with significant difference across three severity groups of dry eye patients (P < 0.05) except for "Satisfaction with Treatment" domain, indicating good known-groups validity. The results indicated that the CDERQOL scale is a reliable and valid instrument for patients with dry eye syndrome among Chinese population, and could be used as a supplementary diagnostic and treatment-effectiveness measure.

Validity test and its consistency in the construction of patient loyalty model

NASA Astrophysics Data System (ADS)

Yanuar, Ferra

2016-04-01

The main objective of this present study is to demonstrate the estimation of validity values and its consistency based on structural equation model. The method of estimation was then implemented to an empirical data in case of the construction the patient loyalty model. In the hypothesis model, service quality, patient satisfaction and patient loyalty were determined simultaneously, each factor were measured by any indicator variables. The respondents involved in this study were the patients who ever got healthcare at Puskesmas in Padang, West Sumatera. All 394 respondents who had complete information were included in the analysis. This study found that each construct; service quality, patient satisfaction and patient loyalty were valid. It means that all hypothesized indicator variables were significant to measure their corresponding latent variable. Service quality is the most measured by tangible, patient satisfaction is the most mesured by satisfied on service and patient loyalty is the most measured by good service quality. Meanwhile in structural equation, this study found that patient loyalty was affected by patient satisfaction positively and directly. Service quality affected patient loyalty indirectly with patient satisfaction as mediator variable between both latent variables. Both structural equations were also valid. This study also proved that validity values which obtained here were also consistence based on simulation study using bootstrap approach.

Validation of a proposal for evaluating hospital infection control programs.

PubMed

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs in an ethical and scientific manner in order to obtain a quality diagnosis in this field.

[A set of quality and safety indicators for hospitals of the "Agencia Valenciana de Salud"].

PubMed

Nebot-Marzal, C M; Mira-Solves, J J; Guilabert-Mora, M; Pérez-Jover, V; Pablo-Comeche, D; Quirós-Morató, T; Cuesta Peredo, D

2014-01-01

To prepare a set of quality and safety indicators for Hospitals of the «Agencia Valenciana de Salud». The qualitative technique Metaplan® was applied in order to gather proposals on sustainability and nursing. The catalogue of the «Spanish Society of Quality in Healthcare» was adopted as a starting point for clinical indicators. Using the Delphi technique, 207 professionals were invited to participate in the selecting the most reliable and feasible indicators. Lastly, the resulting proposal was validated with the managers of 12 hospitals, taking into account the variability, objectivity, feasibility, reliability and sensitivity, of the indicators. Participation rates varied between 66.67% and 80.71%. Of the 159 initial indicators, 68 were prioritized and selected (21 economic or management indicators, 22 nursing indicators, and 25 clinical or hospital indicators). Three of them were common to all three categories and two did not match the specified criteria during the validation phase, thus obtaining a final catalogue of 63 indicators. A set of quality and safety indicators for Hospitals was prepared. They are currently being monitored using the hospital information systems. Copyright © 2013 SECA. Published by Elsevier Espana. All rights reserved.

Validation of Student Generated Data for Assessment of Groundwater Quality

ERIC Educational Resources Information Center

Peckenham, John M.; Thornton, Teresa; Peckenham, Phoebe

2012-01-01

As part of a research project to evaluate the effects of sand and gravel mining on water quality, students were trained to analyze their own drinking water for simple quality indicators. Indicators analyzed were pH, conductivity, hardness, nitrate, chloride, and dissolved iron. Approximately 523 analyses were completed by students between 2006 and…

Scale indicators of social exchange relationships: a comparison of relative content validity.

PubMed

Colquitt, Jason A; Baer, Michael D; Long, David M; Halvorsen-Ganepola, Marie D K

2014-07-01

Although social exchange theory has become one of the most oft-evoked theories in industrial and organizational psychology, there remains no consensus about how to measure its key mechanism: social exchange relationships (Blau, 1964). Drawing on Cropanzano and Byrne's (2000) review of contemporary social exchange theorizing, we examined the content validity of perceived support, exchange quality, affective commitment, trust, and psychological contract fulfillment as indicators of social exchange relationships. We used Hinkin and Tracey's (1999) quantitative approach to content validation, which asks participants to rate the correspondence between scale items and definitions of intended (and unintended) constructs. Our results revealed that some of the most frequently utilized indicators of social exchange relationships--perceived support and exchange quality--were significantly less content valid than rarely used options like affect-based trust. Our results also revealed that 2 direct measures--Bernerth, Armenakis, Feild, Giles, and Walker's (2007) scale and a scale created for this study--were content valid. We discuss the implications of these results for future applications of social exchange theory.

The Validity of Higher-Order Questions as a Process Indicator of Educational Quality

ERIC Educational Resources Information Center

Renaud, Robert D.; Murray, Harry G.

2007-01-01

One way to assess the quality of education in post-secondary institutions is through the use of performance indicators. Studies that have compared currently popular process indicators (e.g., library size, percentage of faculty with PhD) found that after controlling for incoming student ability, these process indicators tend to be weakly associated…

[Validating an instrument for measuring the perceived quality of services received by people using hospitals in Colombia].

PubMed

Cabrera-Arana, Gustavo A; Londoño-Pimienta, Jaime L; Bello-Parías, León D

2008-01-01

Validating an instrument for measuring the perceived quality of services received by people using hospitals forming part of the Colombian Ministry of Social Protection's restructuring, redesigning and modernisation programme for health-service providing networks. Sánchez and Echeverri's guidelines for validating health quality measurement scales were followed due to the lack of a valid instrument for doing this in Colombia. Conceptual synthesis led to identifying a structure of constituent indicators, domains and sub-domains regarding the perception of health service quality. A list of reactions (having a scale for categorising the replies) was analysed according to the validity of appearance, construct, criteria and utility as criteria for sensitivity and usefulness. Successive revisions and three rounds of field-trials led to producing PECASUSS, an acronym given to the instrument for measuring users' perception of health service quality (Percepción de Calidad Según Usuarios de Servicios de Salud). The guidelines effectively orientated the validation of the instrument required for measuring the perceived quality of health services received by people using hospitals forming part of the programme.

Indices for the assessment of nutritional quality of meals: a systematic review.

PubMed

Gorgulho, B M; Pot, G K; Sarti, F M; Marchioni, D M

2016-06-01

This systematic review aimed to synthesise information on indices developed to evaluate nutritional quality of meals. A strategy for systematic search of the literature was developed using keywords related to assessment of meal quality. Databases searched included ScienceDirect, PubMed, Lilacs, SciELO, Scopus, Cochrane, Embase and Google Scholar. The literature search resulted in seven different meal quality indices. Each article was analysed in order to identify the following items: authors, country, year, study design, population characteristics, type of meal evaluated, dietary assessment method, characteristics evaluated (nutrients or food items), score range, index components, nutritional references, correlations performed, validation and relationship with an outcome (if existing). Two studies developed instruments to assess the quality of breakfast, three analysed lunch, one evaluated dinner and one was applied to all types of meals and snacks. All meal quality indices reviewed were based on the evaluation of presence or absence of food groups and relative contributions of nutrients, according to food-based guidelines or nutrient references, adapting the daily dietary recommendations to one specific meal. Most of the indices included three items as components for meal quality assessment: (I) total fat or some specific type of fat, (II) fruits and vegetables and (III) cereals or whole grains. This systematic review indicates aspects that need further research, particularly the numerous approaches to assessing meals considering different foods and nutrients, and the need for validation studies of meal indices.

Evaluation of biologic occupational risk control practices: quality indicators development and validation.

PubMed

Takahashi, Renata Ferreira; Gryschek, Anna Luíza F P L; Izumi Nichiata, Lúcia Yasuko; Lacerda, Rúbia Aparecida; Ciosak, Suely Itsuko; Gir, Elucir; Padoveze, Maria Clara

2010-05-01

There is growing demand for the adoption of qualification systems for health care practices. This study is aimed at describing the development and validation of indicators for evaluation of biologic occupational risk control programs. The study involved 3 stages: (1) setting up a research team, (2) development of indicators, and (3) validation of the indicators by a team of specialists recruited to validate each attribute of the developed indicators. The content validation method was used for the validation, and a psychometric scale was developed for the specialists' assessment. A consensus technique was used, and every attribute that obtained a Content Validity Index of at least 0.75 was approved. Eight indicators were developed for the evaluation of the biologic occupational risk prevention program, with emphasis on accidents caused by sharp instruments and occupational tuberculosis prevention. The indicators included evaluation of the structure, process, and results at the prevention and biologic risk control levels. The majority of indicators achieved a favorable consensus regarding all validated attributes. The developed indicators were considered validated, and the method used for construction and validation proved to be effective. Copyright (c) 2010 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

Initial validation of the Chinese Quality of Life Questionnaire-Intellectual Disabilities (CQOL-ID): a cultural perspective.

PubMed

Wong, P K S; Wong, D F K; Schalock, R L; Chou, Y-C

2011-06-01

In the field of intellectual disabilities (ID), the quality of life concept has been developing rapidly in Chinese societies including Hong Kong, mainland China and Taiwan. However, there is a lack of locally validated instruments to measure the quality of life of people with ID. The study reported in this paper attempted to validate the Chinese Quality of Life Questionnaire - Intellectual Disabilities adapted from the Quality of Life Questionnaire developed by Schalock & Keith. People with mild/moderate ID aged 15 years or above were recruited from special schools, skills centres, community service units and residential units in different regions of Hong Kong. A number of procedures were followed including reliability tests, factor analysis, content validity and construct validity. A total of 359 participants were recruited for the study. Factor analysis was conducted according to the rotated component matrix method, in which 23 items were extracted from the original 40-item version of the Quality of Life Questionnaire and three domains (renamed satisfaction, competence and daily choice making/interpersonal relations) were observed. The items in each domain were shown to have factor loadings ranging from 0.42 to 0.90. Construct validity tests indicated the positive nature of the relationship between earnings, and that self-determination and social interaction increase with more independent living environments and less segregated work environments achieving higher scores (P<0.000, P<0.01 and P<0.05 respectively). The scale also achieved a good degree of reliability (Cronbach's α=0.79). Initial validity tests indicated that the Chinese Quality of Life Questionnaire - Intellectual Disabilities may be a useful instrument for measuring the quality of life of Chinese people with ID. Cultural issues are discussed and recommendations for future research and service development are made. © 2011 The Authors. Journal of Intellectual Disability Research © 2011 Blackwell Publishing Ltd.

Validity of self-assessment in a quality improvement collaborative in Ecuador.

PubMed

Hermida, Jorge; Broughton, Edward I; Miller Franco, Lynne

2011-12-01

Health care quality improvement (QI) efforts commonly use self-assessment to measure compliance with quality standards. This study investigates the validity of self-assessment of quality indicators. Cross sectional. A maternal and newborn care improvement collaborative intervention conducted in health facilities in Ecuador in 2005. Four external evaluators were trained in abstracting medical records to calculate six indicators reflecting compliance with treatment standards. About 30 medical records per month were examined at 12 participating health facilities for a total of 1875 records. The same records had already been reviewed by QI teams at these facilities (self-assessment). Overall compliance, agreement (using the Kappa statistic), sensitivity and specificity were analyzed. We also examined patterns of disagreement and the effect of facility characteristics on levels of agreement. External evaluators reported compliance of 69-90%, while self-assessors reported 71-92%, with raw agreement of 71-95% and Kappa statistics ranging from fair to almost perfect agreement. Considering external evaluators as the gold standard, sensitivity of self-assessment ranged from 90 to 99% and specificity from 48 to 86%. Simpler indicators had fewer disagreements. When disagreements occurred between self-assessment and external valuators, the former tended to report more positive findings in five of six indicators, but this tendency was not of a magnitude to change program actions. Team leadership, understanding of the tools and facility size had no overall impact on the level of agreement. When compared with external evaluation (gold standard), self-assessment was found to be sufficiently valid for tracking QI team performance. Sensitivity was generally higher than specificity. Simplifying indicators may improve validity.

Developing a framework of, and quality indicators for, general practice management in Europe.

PubMed

Engels, Yvonne; Campbell, Stephen; Dautzenberg, Maaike; van den Hombergh, Pieter; Brinkmann, Henrik; Szécsényi, Joachim; Falcoff, Hector; Seuntjens, Luc; Kuenzi, Beat; Grol, Richard

2005-04-01

To develop a framework for general practice management made up of quality indicators shared by six European countries. Two-round postal Delphi questionnaire in the setting of general practice in Belgium, France, Germany, The Netherlands, Switzerland and the United Kingdom. Six national expert panels, each consisting of 10 members, primarily primary care practitioners and experts in the field of quality in primary care participated in the study. The main outcome measures were: (a) a European framework with indicators for the organization of primary care; and (b) ratings of the face validity of the usefulness of the indicators by expert panels in six countries. Agreement was reached about a definition of practice management across five domains (infrastructure, staff, information, finance, and quality and safety), and a common set of indicators for the organization of general practice. The panellist response rate was 95%. Sixty-two indicators (37%) were rated face valid by all six panels. Examples include out of hours service, accessibility, the content of doctors' bags and staff involvement in quality improvement. No indicators were rated invalid by all six panels. It proved to be possible to develop a European set of indicators for assessing the quality of practice management, despite the differences in health care systems and cultures in the six different countries. These indicators will now be used in a quality assessment procedure of practice management in nine European countries. While organizational indicators are part of the new GMS contract in the UK, this research shows that many practice management issues within primary care are also of relevance in other European countries.

GIS ANALYSIS FOR EPIDEMIOLOGIC RECREATIONAL WATER SUTDIES

EPA Science Inventory

Introduction: The Beaches Act of 2000 requires that the Agency develop new rapid method water quality indicators (2 hours or less) that predict whether or not coastal water is safe for swimming. This new set of water quality indicators must be validated through the epidemiologi...

Reliability and Validity of SERVQUAL Scores Used To Evaluate Perceptions of Library Service Quality.

ERIC Educational Resources Information Center

Thompson, Bruce; Cook, Colleen

Research libraries are increasingly supplementing collection counts with perceptions of service quality as indices of status and productivity. The present study was undertaken to explore the reliability and validity of scores from the SERVQUAL measurement protocol (A. Parasuraman and others, 1991), which has previously been used in this type of…

Selecting clinical quality indicators for laboratory medicine.

PubMed

Barth, Julian H

2012-05-01

Quality in laboratory medicine is often described as doing the right test at the right time for the right person. Laboratory processes currently operate under the oversight of an accreditation body which gives confidence that the process is good. However, there are aspects of quality that are not measured by these processes. These are largely focused on ensuring that the most clinically appropriate test is performed and interpreted correctly. Clinical quality indicators were selected through a two-phase process. Firstly, a series of focus groups of clinical scientists were held with the aim of developing a list of quality indicators. These were subsequently ranked in order by an expert panel of primary and secondary care physicians. The 10 top indicators included the communication of critical results, comprehensive education to all users and adequate quality assurance for point-of-care testing. Laboratories should ensure their tests are used to national standards, that they have clinical utility, are calibrated to national standards and have long-term stability for chronic disease management. Laboratories should have error logs and demonstrate evidence of measures introduced to reduce chances of similar future errors. Laboratories should make a formal scientific evaluation of analytical quality. This paper describes the process of selection of quality indicators for laboratory medicine that have been validated sequentially by deliverers and users of the service. They now need to be converted into measureable variables related to outcome and validated in practice.

[Revision of Quality Indicators for the Endoscopy Quality Improvement Program of the National Cancer Screening Program in Korea].

PubMed

Min, Jun Ki; Cha, Jae Myung; Cho, Yu Kyung; Kim, Jie Hyun; Yoon, Soon Man; Im, Jong Pil; Jung, Yunho; Moon, Jeong Seop; Kim, Jin Oh; Jeen, Yoon Tae

2018-05-25

Gastroscopy and colonoscopy are widely used for the early diagnosis of stomach and colorectal cancer. The present revision integrates recent data regarding previous quality indicators and novel indicators suggested for gastroscopy and colonoscopy procedures for the National Cancer Screening Program in Korea. The new indicators, developed by the Quality Improvement Committee of the Korean Society for Gastrointestinal Endoscopy, vary in the level of supporting evidence, and most are based solely on expert opinion. Updated indicators validated by clinical research were prioritized, but were chosen by expert consensus when such studies were absent. The resultant quality indicators were graded according to the levels of consensus and recommendations. The updated indicators will provide a relevant guideline for high-quality endoscopy. The future direction of quality indicator development should include relevant outcome measures and an evidence-based approach to support proposed performance targets.

Development and pilot of an internationally standardized measure of cardiovascular risk management in European primary care

PubMed Central

2011-01-01

Background Primary care can play an important role in providing cardiovascular risk management in patients with established Cardiovascular Diseases (CVD), patients with a known high risk of developing CVD, and potentially for individuals with a low risk of developing CVD, but who have unhealthy lifestyles. To describe and compare cardiovascular risk management, internationally valid quality indicators and standardized measures are needed. As part of a large project in 9 European countries (EPA-Cardio), we have developed and tested a set of standardized measures, linked to previously developed quality indicators. Methods A structured stepwise procedure was followed to develop measures. First, the research team allocated 106 validated quality indicators to one of the three target populations (established CVD, at high risk, at low risk) and to different data-collection methods (data abstraction from the medical records, a patient survey, an interview with lead practice GP/a practice survey). Secondly, we selected a number of other validated measures to enrich the assessment. A pilot study was performed to test the feasibility. Finally, we revised the measures based on the findings. Results The EPA-Cardio measures consisted of abstraction forms from the medical-records data of established Coronary Heart Disease (CHD)-patients - and high-risk groups, a patient questionnaire for each of the 3 groups, an interview questionnaire for the lead GP and a questionnaire for practice teams. The measures were feasible and accepted by general practices from different countries. Conclusions An internationally standardized measure of cardiovascular risk management, linked to validated quality indicators and tested for feasibility in general practice, is now available. Careful development and pilot testing of the measures are crucial in international studies of quality of healthcare. PMID:21473758

Sound quality indicators for urban places in Paris cross-validated by Milan data.

PubMed

Ricciardi, Paola; Delaitre, Pauline; Lavandier, Catherine; Torchia, Francesca; Aumond, Pierre

2015-10-01

A specific smartphone application was developed to collect perceptive and acoustic data in Paris. About 3400 questionnaires were analyzed, regarding the global sound environment characterization, the perceived loudness of some emergent sources and the presence time ratio of sources that do not emerge from the background. Sound pressure level was recorded each second from the mobile phone's microphone during a 10-min period. The aim of this study is to propose indicators of urban sound quality based on linear regressions with perceptive variables. A cross validation of the quality models extracted from Paris data was carried out by conducting the same survey in Milan. The proposed sound quality general model is correlated with the real perceived sound quality (72%). Another model without visual amenity and familiarity is 58% correlated with perceived sound quality. In order to improve the sound quality indicator, a site classification was performed by Kohonen's Artificial Neural Network algorithm, and seven specific class models were developed. These specific models attribute more importance on source events and are slightly closer to the individual data than the global model. In general, the Parisian models underestimate the sound quality of Milan environments assessed by Italian people.

Quality of College Life (QCL) of Students: Further Validation of a Measure of Well-Being

ERIC Educational Resources Information Center

Sirgy, M. Joseph; Lee, Dong-Jin; Grzeskowiak, Stephan; Yu, Grace B.; Webb, Dave; El-Hasan, Karma; Vega, Jose Jesus Garcia; Ekici, Ahmet; Johar, J. S.; Krishen, Anjala; Kangal, Ayca; Swoboda, Bernhard; Claiborne, C. B.; Maggino, Filomena; Rahtz, Don; Canton, Alicia; Kuruuzum, Ayse

2010-01-01

This paper reports a study designed to further validate a measure of quality of college life (QCL) of university students (Sirgy, Grzeskowiak, Rahtz, "Soc Indic Res" 80(2), 343-360, 2007). Two studies were conducted: a replication study and an extension study. The replication study involved surveys of 10 different college campuses in different…

Quality of care indicators for the rehabilitation of children with traumatic brain injury.

PubMed

Rivara, Frederick P; Ennis, Stephanie K; Mangione-Smith, Rita; MacKenzie, Ellen J; Jaffe, Kenneth M

2012-03-01

To develop measurement tools for assessing compliance with identifiable processes of inpatient care for children with traumatic brain injury (TBI) that are reliable, valid, and amenable to implementation. Literature review and expert panel using the RAND/UCLA Appropriateness Method and a Delphi technique. Not applicable. Children with TBI. Not applicable. Quality of care indicators. A total of 119 indicators were developed across the domains of general management; family-centered care; cognitive-communication, speech, language, and swallowing impairments; gross and fine motor skill impairments; neuropsychologic, social, and behavioral impairments; school reentry; and community integration. There was a high degree of agreement on these indicators as valid and feasible quality measures for children with TBI. These indicators are an important step toward building a better base of evidence about the effectiveness and efficiency of the components of acute inpatient rehabilitation for pediatric patients with TBI. Copyright © 2012 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The Value of Qualitative Methods in Social Validity Research

ERIC Educational Resources Information Center

Leko, Melinda M.

2014-01-01

One quality indicator of intervention research is the extent to which the intervention has a high degree of social validity, or practicality. In this study, I drew on Wolf's framework for social validity and used qualitative methods to ascertain five middle schoolteachers' perceptions of the social validity of System 44®--a phonics-based reading…

Development and Validation of an Agency for Healthcare Research and Quality Indicator for Mortality After Congenital Heart Surgery Harmonized With Risk Adjustment for Congenital Heart Surgery (RACHS-1) Methodology.

PubMed

Jenkins, Kathy J; Koch Kupiec, Jennifer; Owens, Pamela L; Romano, Patrick S; Geppert, Jeffrey J; Gauvreau, Kimberlee

2016-05-20

The National Quality Forum previously approved a quality indicator for mortality after congenital heart surgery developed by the Agency for Healthcare Research and Quality (AHRQ). Several parameters of the validated Risk Adjustment for Congenital Heart Surgery (RACHS-1) method were included, but others differed. As part of the National Quality Forum endorsement maintenance process, developers were asked to harmonize the 2 methodologies. Parameters that were identical between the 2 methods were retained. AHRQ's Healthcare Cost and Utilization Project State Inpatient Databases (SID) 2008 were used to select optimal parameters where differences existed, with a goal to maximize model performance and face validity. Inclusion criteria were not changed and included all discharges for patients <18 years with International Classification of Diseases, Ninth Revision, Clinical Modification procedure codes for congenital heart surgery or nonspecific heart surgery combined with congenital heart disease diagnosis codes. The final model includes procedure risk group, age (0-28 days, 29-90 days, 91-364 days, 1-17 years), low birth weight (500-2499 g), other congenital anomalies (Clinical Classifications Software 217, except for 758.xx), multiple procedures, and transfer-in status. Among 17 945 eligible cases in the SID 2008, the c statistic for model performance was 0.82. In the SID 2013 validation data set, the c statistic was 0.82. Risk-adjusted mortality rates by center ranged from 0.9% to 4.1% (5th-95th percentile). Congenital heart surgery programs can now obtain national benchmarking reports by applying AHRQ Quality Indicator software to hospital administrative data, based on the harmonized RACHS-1 method, with high discrimination and face validity. © 2016 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley Blackwell.

Methodology for developing quality indicators for the care of older people in the Emergency Department

PubMed Central

2013-01-01

Background Compared with younger people, older people have a higher risk of adverse health outcomes when presenting to emergency departments. As the population ages, older people will make up an increasing proportion of the emergency department population. Therefore it is timely that consideration be given to the quality of care received by older persons in emergency departments, and to consideration of those older people with special needs. Particular attention will be focused on important groups of older people, such as patients with cognitive impairment, residents of long term care and patients with palliative care needs. This project will develop a suite of quality indicators focused on the care of older persons in the emergency department. Methods/design Following input from an expert panel, an initial set of structural, process, and outcome indicators will be developed based on thorough systematic search in the scientific literature. All initial indicators will be tested in eight emergency departments for their validity and feasibility. Results of the data from the field studies will be presented to the expert panel at a second meeting. A suite of Quality Indicators for the older emergency department population will be finalised following a formal voting process. Discussion The predicted burgeoning in the number of older persons presenting to emergency departments combined with the recognised quality deficiencies in emergency department care delivery to this population, highlight the need for a quality framework for the care of older persons in emergency departments. Additionally, high quality of care is associated with improved survival & health outcomes of elderly patients. The development of well-selected, validated and economical quality indicators will allow appropriate targeting of resources (financial, education or quality management) to improve quality in areas with maximum potential for improvement. PMID:24314126

Measuring the quality of child health care at first-level facilities.

PubMed

Gouws, Eleanor; Bryce, Jennifer; Pariyo, George; Armstrong Schellenberg, Joanna; Amaral, João; Habicht, Jean-Pierre

2005-08-01

Sound policy and program decisions require timely information based on valid and relevant measures. Recent findings suggest that despite the availability of effective and affordable guidelines for the management of sick children in first-level health facilities in developing countries, the quality and coverage of these services remains low. We report on the development and evaluation of a set of summary indices reflecting the quality of care received by sick children in first-level facilities. The indices were first developed through a consultative process to achieve face validity by involving technical experts and policymakers. The definition of evaluation measures for many public health programs stops at this point. We added a second phase in which standard statistical techniques were used to evaluate the content and construct validity of the indices and their reliability, drawing on data sets from the multi-country evaluation of integrated management of childhood illness (MCE) in Brazil, Tanzania and Uganda. The statistical evaluation identified important conceptual errors in the indices arising from the theory-driven expert review. The experts had combined items into inappropriate indicators resulting in summary indices that were difficult to interpret and had limited validity for program decision making. We propose a revised set of summary indices for the measurement of child health care in developing countries that is supported by both expert and statistical reviews and that led to similar programmatic insights across the three countries. We advocate increased cross-disciplinary research within public health to improve measurement approaches. Child survival policymakers, program planners and implementers can use these tools to improve their monitoring and so increase the health impact of investments in health facility care.

Validation of the Passenger Ride Quality Apparatus (PRQA) for simulation of aircraft motions for ride-quality research

NASA Technical Reports Server (NTRS)

Bigler, W. B., II

1977-01-01

The NASA passenger ride quality apparatus (PRQA), a ground based motion simulator, was compared to the total in flight simulator (TIFS). Tests were made on PRQA with varying stimuli: motions only; motions and noise; motions, noise, and visual; and motions and visual. Regression equations for the tests were obtained and subsequent t-testing of the slopes indicated that ground based simulator tests produced comfort change rates similar to actual flight data. It was recommended that PRQA be used in the ride quality program for aircraft and that it be validated for other transportation modes.

Quality of life and psychological health indicators in the national social life, health, and aging project.

PubMed

Shiovitz-Ezra, Sharon; Leitsch, Sara; Graber, Jessica; Karraker, Amelia

2009-11-01

The National Social Life, Health, and Aging Project (NSHAP) measures seven indicators of quality of life (QoL) and psychological health. The measures used for happiness, self-esteem, depression, and loneliness are well established in the literature. Conversely, measures of anxiety, stress, and self-reported emotional health were modified for their use in this unique project. The purpose of this paper is to provide (a) an overview of NSHAP's QoL assessment and (b) evidence for the adequacy of the modified measures. First, we examined the psychometric properties of the modified measures. Second, the established QoL measures were used to examine the concurrent validity of the modified measures. Finally, gender- and age-group differences were examined for each modified measure. The anxiety index exhibited good internal reliability and concurrent validity. Consistent with the literature, a single-factor structure best fit the data. Stress was satisfactory in terms of concurrent validity but with only fair internal consistency. Self-reported emotional health exhibited good concurrent validity and moderate external validity. The modified indices used in NSHAP tended to exhibit good internal reliability and concurrent validity. These measures can confidently be used in the exploration of QoL and psychological health in later life and its many correlates.

Selecting process quality indicators for the integrated care of vulnerable older adults affected by cognitive impairment or dementia.

PubMed

Kröger, Edeltraut; Tourigny, André; Morin, Diane; Côté, Lise; Kergoat, Marie-Jeanne; Lebel, Paule; Robichaud, Line; Imbeault, Shirley; Proulx, Solange; Benounissa, Zohra

2007-11-29

This study aimed at evaluating face and content validity, feasibility and reliability of process quality indicators developed previously in the United States or other countries. The indicators can be used to evaluate care and services for vulnerable older adults affected by cognitive impairment or dementia within an integrated service system in Quebec, Canada. A total of 33 clinical experts from three major urban centres in Quebec formed a panel representing two medical specialties (family medicine, geriatrics) and seven health or social services specialties (nursing, occupational therapy, psychology, neuropsychology, pharmacy, nutrition, social work), from primary or secondary levels of care, including long-term care. A modified version of the RAND(R)/University of California at Los Angeles (UCLA) appropriateness method, a two-round Delphi panel, was used to assess face and content validity of process quality indicators. The appropriateness of indicators was evaluated according to a) agreement of the panel with three criteria, defined as a median rating of 7-9 on a nine-point rating scale, and b) agreement among panellists, judged by the statistical measure of the interpercentile range adjusted for symmetry. Feasibility of quality assessment and reliability of appropriate indicators were then evaluated within a pilot study on 29 patients affected by cognitive impairment or dementia. For measurable indicators the inter-observer reliability was calculated with the Kappa statistic. Initially, 82 indicators for care of vulnerable older adults with cognitive impairment or dementia were submitted to the panellists. Of those, 72 (88%) were accepted after two rounds. Among 29 patients for whom medical files of the preceding two years were evaluated, 63 (88%) of these indicators were considered applicable at least once, for at least one patient. Only 22 indicators were considered applicable at least once for ten or more out of 29 patients. Four indicators could be measured with the help of a validated questionnaire on patient satisfaction. Inter-observer reliability was moderate (Kappa = 0.57). A multidisciplinary panel of experts judged a large majority of the initial indicators valid for use in integrated care systems for vulnerable older adults in Quebec, Canada. Most of these indicators can be measured using patient files or patient or caregiver interviews and reliability of assessment from patient-files is moderate.

Selecting process quality indicators for the integrated care of vulnerable older adults affected by cognitive impairment or dementia

PubMed Central

Kröger, Edeltraut; Tourigny, André; Morin, Diane; Côté, Lise; Kergoat, Marie-Jeanne; Lebel, Paule; Robichaud, Line; Imbeault, Shirley; Proulx, Solange; Benounissa, Zohra

2007-01-01

Background This study aimed at evaluating face and content validity, feasibility and reliability of process quality indicators developed previously in the United States or other countries. The indicators can be used to evaluate care and services for vulnerable older adults affected by cognitive impairment or dementia within an integrated service system in Quebec, Canada. Methods A total of 33 clinical experts from three major urban centres in Quebec formed a panel representing two medical specialties (family medicine, geriatrics) and seven health or social services specialties (nursing, occupational therapy, psychology, neuropsychology, pharmacy, nutrition, social work), from primary or secondary levels of care, including long-term care. A modified version of the RAND®/University of California at Los Angeles (UCLA) appropriateness method, a two-round Delphi panel, was used to assess face and content validity of process quality indicators. The appropriateness of indicators was evaluated according to a) agreement of the panel with three criteria, defined as a median rating of 7–9 on a nine-point rating scale, and b) agreement among panellists, judged by the statistical measure of the interpercentile range adjusted for symmetry. Feasibility of quality assessment and reliability of appropriate indicators were then evaluated within a pilot study on 29 patients affected by cognitive impairment or dementia. For measurable indicators the inter-observer reliability was calculated with the Kappa statistic. Results Initially, 82 indicators for care of vulnerable older adults with cognitive impairment or dementia were submitted to the panellists. Of those, 72 (88%) were accepted after two rounds. Among 29 patients for whom medical files of the preceding two years were evaluated, 63 (88%) of these indicators were considered applicable at least once, for at least one patient. Only 22 indicators were considered applicable at least once for ten or more out of 29 patients. Four indicators could be measured with the help of a validated questionnaire on patient satisfaction. Inter-observer reliability was moderate (Kappa = 0.57). Conclusion A multidisciplinary panel of experts judged a large majority of the initial indicators valid for use in integrated care systems for vulnerable older adults in Quebec, Canada. Most of these indicators can be measured using patient files or patient or caregiver interviews and reliability of assessment from patient-files is moderate. PMID:18047668

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

PubMed

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Instrument Psychometrics: Parental Satisfaction and Quality Indicators of Perinatal Palliative Care.

PubMed

Wool, Charlotte

2015-10-01

Despite a life-limiting fetal diagnosis, prenatal attachment often occurs in varying degrees resulting in role identification by an individual as a parent. Parents recognize quality care and report their satisfaction when interfacing with health care providers. The aim was to test an instrument measuring parental satisfaction and quality indicators with parents electing to continue a pregnancy after learning of a life-limiting fetal diagnosis. A cross sectional survey design gathered data using a computer-mediated platform. Subjects were parents (n=405) who opted to continue a pregnancy affected by a life-limiting diagnosis. Factor analysis using principal component analysis with Varimax rotation was used to validate the instrument, evaluate components, and summarize the explained variance achieved among quality indicator items. The Prenatal Scale was reduced to 37 items with a three-component solution explaining 66.19% of the variance and internal consistency reliability of 0.98. The Intrapartum Scale included 37 items with a four-component solution explaining 66.93% of the variance and a Cronbach α of 0.977. The Postnatal Scale was reduced to 44 items with a six-component solution explaining 67.48% of the variance. Internal consistency reliability was 0.975. The Parental Satisfaction and Quality Indicators of Perinatal Palliative Care Instrument is a valid and reliable measure for parent-reported quality care and satisfaction. Use of this instrument will enable clinicians and researchers to measure quality indicators and parental satisfaction. The instrument is useful for assessing, analyzing, and reporting data on quality for care delivered during the prenatal, intrapartum, and postnatal periods.

A Perceptually Weighted Rank Correlation Indicator for Objective Image Quality Assessment

NASA Astrophysics Data System (ADS)

Wu, Qingbo; Li, Hongliang; Meng, Fanman; Ngan, King N.

2018-05-01

In the field of objective image quality assessment (IQA), the Spearman's $\\rho$ and Kendall's $\\tau$ are two most popular rank correlation indicators, which straightforwardly assign uniform weight to all quality levels and assume each pair of images are sortable. They are successful for measuring the average accuracy of an IQA metric in ranking multiple processed images. However, two important perceptual properties are ignored by them as well. Firstly, the sorting accuracy (SA) of high quality images are usually more important than the poor quality ones in many real world applications, where only the top-ranked images would be pushed to the users. Secondly, due to the subjective uncertainty in making judgement, two perceptually similar images are usually hardly sortable, whose ranks do not contribute to the evaluation of an IQA metric. To more accurately compare different IQA algorithms, we explore a perceptually weighted rank correlation indicator in this paper, which rewards the capability of correctly ranking high quality images, and suppresses the attention towards insensitive rank mistakes. More specifically, we focus on activating `valid' pairwise comparison towards image quality, whose difference exceeds a given sensory threshold (ST). Meanwhile, each image pair is assigned an unique weight, which is determined by both the quality level and rank deviation. By modifying the perception threshold, we can illustrate the sorting accuracy with a more sophisticated SA-ST curve, rather than a single rank correlation coefficient. The proposed indicator offers a new insight for interpreting visual perception behaviors. Furthermore, the applicability of our indicator is validated in recommending robust IQA metrics for both the degraded and enhanced image data.

Quality indicators for hip fracture care, a systematic review.

PubMed

Voeten, S C; Krijnen, P; Voeten, D M; Hegeman, J H; Wouters, M W J M; Schipper, I B

2018-05-17

Quality indicators are used to measure quality of care and enable benchmarking. An overview of all existing hip fracture quality indicators is lacking. The primary aim was to identify quality indicators for hip fracture care reported in literature, hip fracture audits, and guidelines. The secondary aim was to compose a set of methodologically sound quality indicators for the evaluation of hip fracture care in clinical practice. A literature search according to the PRISMA guidelines and an internet search were performed to identify hip fracture quality indicators. The indicators were subdivided into process, structure, and outcome indicators. The methodological quality of the indicators was judged using the Appraisal of Indicators through Research and Evaluation (AIRE) instrument. For structure and process indicators, the construct validity was assessed. Sixteen publications, nine audits and five guidelines were included. In total, 97 unique quality indicators were found: 9 structure, 63 process, and 25 outcome indicators. Since detailed methodological information about the indicators was lacking, the AIRE instrument could not be applied. Seven indicators correlated with an outcome measure. A set of nine quality indicators was extracted from the literature, audits, and guidelines. Many quality indicators are described and used. Not all of them correlate with outcomes of care and have been assessed methodologically. As methodological evidence is lacking, we recommend the extracted set of nine indicators to be used as the starting point for further clinical research. Future research should focus on assessing the clinimetric properties of the existing quality indicators.

[Validation and adhesion to GESIDA quality indicators in patients with HIV infection].

PubMed

Riera, Melchor; Esteban, Herminia; Suarez, Ignacio; Palacios, Rosario; Lozano, Fernando; Blanco, Jose R; Valencia, Eulalia; Ocampo, Antonio; Amador, Concha; Frontera, Guillem; vonWichmann-de Miguel, Miguel Angel

2016-01-01

The objective of the study is to validate the relevant GESIDA quality indicators for HIV infection, assessing the reliability, feasibility and adherence to them. The reliability was evaluated using the reproducibility of 6 indicators in peer review, with the second observer being an outsider. The feasibility and measurement of the level of adherence to the 22 indicators was conducted with annual fragmented retrospective collection of information from specific databases or the clinical charts of the nine participating hospitals. Reliability was very high, with interobserver agreement levels higher than 95% in 5 of the 6 indicators. The median time to achieve the indicators ranged between 5 and 600minutes, but could be achieved progressively from specific databases, enabling obtaining them automatically. As regards adherence to the indicators related with the initial evaluation of the patients, instructions and suitability of the guidelines for ART, adherence to ART, follow-up in clinics, and achieve an undetectable HIV by PCR at week 48 of the ART. Indicators of quality related to the prevention of opportunistic infections and control of comorbidities, the standards set were not achieved, and significant heterogeneity was observed between hospitals. The GESIDA quality indicators of HIV infection enabled the relevant indicators to be feasibly and reliably measured, and should be collected in all the units that care for patients with HIV infection. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Enfermedades Infecciosas y Microbiología Clínica. All rights reserved.

External Validation of the Acoustic Voice Quality Index Version 03.01 With Extended Representativity.

PubMed

Barsties, Ben; Maryn, Youri

2016-07-01

The Acoustic Voice Quality Index (AVQI) is an objective method to quantify the severity of overall voice quality in concatenated continuous speech and sustained phonation segments. Recently, AVQI was successfully modified to be more representative and ecologically valid because the internal consistency of AVQI was balanced out through equal proportion of the 2 speech types. The present investigation aims to explore its external validation in a large data set. An expert panel of 12 speech-language therapists rated the voice quality of 1058 concatenated voice samples varying from normophonia to severe dysphonia. The Spearman rank-order correlation coefficients (r) were used to measure concurrent validity. The AVQI's diagnostic accuracy was evaluated with several estimates of its receiver operating characteristics (ROC). Finally, 8 of the 12 experts were chosen because of reliability criteria. A strong correlation was identified between AVQI and auditoryperceptual rating (r = 0.815, P = .000). It indicated that 66.4% of the auditory-perceptual rating's variation was explained by AVQI. Additionally, the ROC results showed again the best diagnostic outcome at a threshold of AVQI = 2.43. This study highlights external validation and diagnostic precision of the AVQI version 03.01 as a robust and ecologically valid measurement to objectify voice quality. © The Author(s) 2016.

Validity, reliability and Norwegian adaptation of the Stroke-Specific Quality of Life (SS-QOL) scale

PubMed Central

Pedersen, Synne Garder; Heiberg, Guri Anita; Nielsen, Jørgen Feldbæk; Friborg, Oddgeir; Stabel, Henriette Holm; Anke, Audny; Arntzen, Cathrine

2018-01-01

Background: There is a paucity of stroke-specific instruments to assess health-related quality of life in the Norwegian language. The objective was to examine the validity and reliability of a Norwegian version of the 12-domain Stroke-Specific Quality of Life scale. Methods: A total of 125 stroke survivors were prospectively recruited. Questionnaires were administered at 3 months; 36 test–retests were performed at 12 months post stroke. The translation was conducted according to guidelines. The internal consistency was assessed with Cronbach’s alpha; convergent validity, with item-to-subscale correlations; and test–retest, with Spearman’s correlations. Scaling validity was explored by calculating both floor and ceiling effects. A priori hypotheses regarding the associations between the Stroke-Specific Quality of Life domain scores and scores of established measures were tested. Standard error of measurement was assessed. Results: The Norwegian version revealed no major changes in back translations. The internal consistency values of the domains were Cronbach’s alpha = 0.79–0.93. Rates of missing items were small, and the item-to-subscale correlation coefficients supported convergent validity (0.48–0.87). The observed floor effects were generally small, whereas the ceiling effects had moderate or high values (16%–63%). Test–retest reliability indicated stability in most domains, with Spearman’s rho = 0.67–0.94 (all p < 0.001), whereas the rho was 0.35 (p < 0.05) for the ‘Vision’ domain. Hypothesis testing supported the construct validity of the scale. Standard error of measurement values for each domain were generated to indicate the required magnitudes of detectable change. Conclusions: The Norwegian version of the Stroke-Specific Quality of Life scale is a reliable and valid instrument with good psychometric properties. It is suited for use in health research as well as in individual assessments of persons with stroke. PMID:29344360

Validity, reliability and Norwegian adaptation of the Stroke-Specific Quality of Life (SS-QOL) scale.

PubMed

Pedersen, Synne Garder; Heiberg, Guri Anita; Nielsen, Jørgen Feldbæk; Friborg, Oddgeir; Stabel, Henriette Holm; Anke, Audny; Arntzen, Cathrine

2018-01-01

There is a paucity of stroke-specific instruments to assess health-related quality of life in the Norwegian language. The objective was to examine the validity and reliability of a Norwegian version of the 12-domain Stroke-Specific Quality of Life scale. A total of 125 stroke survivors were prospectively recruited. Questionnaires were administered at 3 months; 36 test-retests were performed at 12 months post stroke. The translation was conducted according to guidelines. The internal consistency was assessed with Cronbach's alpha; convergent validity, with item-to-subscale correlations; and test-retest, with Spearman's correlations. Scaling validity was explored by calculating both floor and ceiling effects. A priori hypotheses regarding the associations between the Stroke-Specific Quality of Life domain scores and scores of established measures were tested. Standard error of measurement was assessed. The Norwegian version revealed no major changes in back translations. The internal consistency values of the domains were Cronbach's alpha = 0.79-0.93. Rates of missing items were small, and the item-to-subscale correlation coefficients supported convergent validity (0.48-0.87). The observed floor effects were generally small, whereas the ceiling effects had moderate or high values (16%-63%). Test-retest reliability indicated stability in most domains, with Spearman's rho = 0.67-0.94 (all p < 0.001), whereas the rho was 0.35 (p < 0.05) for the 'Vision' domain. Hypothesis testing supported the construct validity of the scale. Standard error of measurement values for each domain were generated to indicate the required magnitudes of detectable change. The Norwegian version of the Stroke-Specific Quality of Life scale is a reliable and valid instrument with good psychometric properties. It is suited for use in health research as well as in individual assessments of persons with stroke.

Validation of the Technological Process of the Preparation "Milk by Vidal".

PubMed

Savchenko, L P; Mishchenko, V A; Georgiyants, V A

2017-01-01

Validation was performed on the technological process of the compounded preparation "Milk by Vidal" in accordance with the requirements of the regulatory framework of Ukraine. Critical stages of formulation which can affect the quality of the finished preparation were considered during the research. The obtained results indicated that the quality of the finished preparation met the requirements of the State Pharmacopoeia of Ukraine. Copyright© by International Journal of Pharmaceutical Compounding, Inc.

Development of Quality Indicators to Address Abuse and Neglect in Home-Based Primary Care and Palliative Care.

PubMed

Sheehan, Orla C; Ritchie, Christine S; Fathi, Roya; Garrigues, Sarah K; Saliba, Debra; Leff, Bruce

2016-12-01

To develop candidate quality indicators (QIs) for the quality standard of "addressing abuse and neglect" in the setting of home-based medical care. Systematic literature review of both the peer-reviewed and gray literature. Home-based primary and palliative care practices. Homebound community-dwelling older adults. Articles were identified to inform the development of candidate indicators of the quality by which home-based primary and palliative care practices addressed abuse and neglect. The literature guided the development of patient-level QIs and practice-level quality standards. A technical expert panel (TEP) representing exemplary home-based primary care and palliative care providers then participated in a modified Delphi process to assess the validity and feasibility of each measure and identify candidate QIs suitable for testing in the field. The literature review yielded 4,371 titles and abstracts that were reviewed; 25 publications met final inclusion criteria and informed development of nine candidate QIs. The TEP rated all but one of the nine candidate indicators as having high validity and feasibility. Translating the complex problem of addressing abuse and neglect into QIs may ultimately serve to improve care delivered to vulnerable home-limited adults who receive home-based medical care. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol)

PubMed Central

2011-01-01

Background Public priorities for improvement often differ from those of clinicians and managers. Public involvement has been proposed as a way to bridge the gap between professional and public clinical care priorities but has not been studied in the context of quality-indicator choice. Our objective is to assess the feasibility and impact of public involvement on quality-indicator choice and agreement with public priorities. Methods We will conduct a cluster randomised controlled trial comparing quality-indicator prioritisation with and without public involvement. In preparation for the trial, we developed a 'menu' of quality indicators, based on a systematic review of existing validated indicator sets. Participants (public representatives, clinicians, and managers) will be recruited from six participating sites. In intervention sites, public representatives will be involved through direct participation (public representatives, clinicians, and managers will deliberate together to agree on quality-indicator choice and use) and consultation (individual public recommendations for improvement will be collected and presented to decision makers). In control sites, only clinicians and managers will take part in the prioritisation process. Data on quality-indicator choice and intended use will be collected. Our primary outcome will compare quality-indicator choice and agreement with public priorities between intervention and control groups. A process evaluation based on direct observation, videorecording, and participants' assessment will be conducted to help explain the study's results. The marginal cost of public involvement will also be assessed. Discussion We identified 801 quality indicators that met our inclusion criteria. An expert panel agreed on a final set of 37 items containing validated quality indicators relevant for chronic disease prevention and management in primary care. We pilot tested our public-involvement intervention with 27 participants (11 public representatives and 16 clinicians and managers) and our study instruments with an additional 21 participants, which demonstrated the feasibility of the intervention and generated important insights and adaptations to engage public representatives more effectively. To our knowledge, this study is the first trial of public involvement in quality-indicator prioritisation, and its results could foster more effective upstream engagement of patients and the public in clinical practice improvement. Trial registration NTR2496 (Netherlands National Trial Register, http://www.trialregister.nl). PMID:21554691

Study of the migration phenomena of specific metals in canned tomato paste before and after opening. Validation of a new quality indicator for opened cans.

PubMed

Raptopoulou, Kalomoira G; Pasias, Ioannis N; Thomaidis, Nikolaos S; Proestos, Charalampos

2014-07-01

A method for the simultaneous determination of Cd-Pb, As-Cu, Cr-Ni and Fe-Mn in canned tomato paste samples by Electrothermal Atomic Absorption Spectrometry was developed and validated. The validation procedure was conducted according to the terms of the European regulation for the official control of contaminants in foods. The validated method was applied for the determination of these metals and metalloids in 13 different tomato paste samples and the results showed that Cd content was higher than the maximum permissible value of 0.050 mg kg(-1) as proposed in European Regulation (EC) No 1881/2006 concerning fresh fruits and vegetables. Furthermore, a new quality indicator was evaluated in order to provide information about tomato paste quality and the appropriate storage time of an opened canned tomato paste. Finally, a migration test was accomplished based on the calculation of mass balance and the comparison of the elemental content in canned tomato paste samples and in aseptic paper pack and it was proved that Fe and Pb were the main metals migrating in tomato paste samples. Copyright © 2014 Elsevier Ltd. All rights reserved.

Quality of life in patients with Parkinson's disease: development of a questionnaire.

PubMed Central

de Boer, A G; Wijker, W; Speelman, J D; de Haes, J C

1996-01-01

OBJECTIVES--To develop and test a questionnaire for measuring quality of life in patients with Parkinson's disease. METHODS--An item pool was developed based on the experience of patients with Parkinson's disease and of neurologists; medical literature on the problems of patients with Parkinson's disease; and other quality of life questionnaires. To reduce the item pool, 13 patients identified items that were a problem to them and rated their importance. Items which were most often chosen and rated most important were included in the Parkinson's disease quality of life questionnaire (PDQL). The PDQL consists of 37 items. To evaluate the discriminant validity of the PDQL three groups of severity of disease were compared. To test for convergent validity, the scores of the PDQL were tested for correlation with standard indices of quality of life. RESULTS--The PDQL was filled out by 384 patients with Parkinson's disease. It consisted of four subscales: parkinsonian symptoms, systemic symptoms, emotional functioning, and social functioning. The internal-consistency reliability coefficients of the PDQL subscales were high (0.80-0.87). Patients with higher disease severity had significantly lower quality of life on all PDQL subscales (P < 0.05). Almost all PDQL subscales correlated highly (P < 0.001) with the corresponding scales of the standard quality of life indices. CONCLUSION--The PDQL is a relevant, reliable, and valid measure of the quality of life of patients with Parkinson's disease. Images PMID:8676165

Do treatment quality indicators predict cardiovascular outcomes in patients with diabetes?

PubMed

Sidorenkov, Grigory; Voorham, Jaco; de Zeeuw, Dick; Haaijer-Ruskamp, Flora M; Denig, Petra

2013-01-01

Landmark clinical trials have led to optimal treatment recommendations for patients with diabetes. Whether optimal treatment is actually delivered in practice is even more important than the efficacy of the drugs tested in trials. To this end, treatment quality indicators have been developed and tested against intermediate outcomes. No studies have tested whether these treatment quality indicators also predict hard patient outcomes. A cohort study was conducted using data collected from >10.000 diabetes patients in the Groningen Initiative to Analyze Type 2 Treatment (GIANTT) database and Dutch Hospital Data register. Included quality indicators measured glucose-, lipid-, blood pressure- and albuminuria-lowering treatment status and treatment intensification. Hard patient outcome was the composite of cardiovascular events and all-cause death. Associations were tested using Cox regression adjusting for confounding, reporting hazard ratios (HR) with 95% confidence intervals. Lipid and albuminuria treatment status, but not blood pressure lowering treatment status, were associated with the composite outcome (HR = 0.77, 0.67-0.88; HR = 0.75, 0.59-0.94). Glucose lowering treatment status was associated with the composite outcome only in patients with an elevated HbA1c level (HR = 0.72, 0.56-0.93). Treatment intensification with glucose-lowering but not with lipid-, blood pressure- and albuminuria-lowering drugs was associated with the outcome (HR = 0.73, 0.60-0.89). Treatment quality indicators measuring lipid- and albuminuria-lowering treatment status are valid quality measures, since they predict a lower risk of cardiovascular events and mortality in patients with diabetes. The quality indicators for glucose-lowering treatment should only be used for restricted populations with elevated HbA1c levels. Intriguingly, the tested indicators for blood pressure-lowering treatment did not predict patient outcomes. These results question whether all treatment indicators are valid measures to judge quality of health care and its economics.

European Surveillance of Antimicrobial Consumption (ESAC): quality indicators for outpatient antibiotic use in Europe

PubMed Central

Coenen, Samuel; Ferech, Matus; Haaijer‐Ruskamp, Flora M; Butler, Chris C; Stichele, Robert H Vander; Verheij, Theo J M; Monnet, Dominique L; Little, Paul; Goossens, Herman

2007-01-01

Background and objective Indicators to measure the quality of healthcare are increasingly used by healthcare professionals and policy makers. In the context of increasing antimicrobial resistance, this study aimed to develop valid drug‐specific quality indicators for outpatient antibiotic use in Europe, derived from European Surveillance of Antimicrobial Consumption (ESAC) data. Methods 27 experts (15 countries), in a European Science Foundation workshop, built on the expertise within the European Drug Utilisation Research Group, the General Practice Respiratory Infections Network, the ESCMID Study Group on Primary Care Topics, the Belgian Antibiotic Policy Coordination Committee, the World Health Organization, ESAC, and other experts. A set of proposed indicators was developed using 1997–2003 ESAC data. Participants scored the relevance of each indicator to reducing antimicrobial resistance, patient health benefit, cost effectiveness and public health policy makers (scale: 1 (completely disagree) to 9 (completely agree)). The scores were processed according to the UCLA‐RAND appropriateness method. Indicators were judged relevant if the median score was not in the 1–6 interval and if there was consensus (number of scores within the 1–3 interval was fewer than one third of the panel). From the relevant indicators providing overlapping information, the one with the highest scores was selected for the final set of quality indicators—values were updated with 2004 ESAC data. Results 22 participants (12 countries) completed scoring of a set of 22 proposed indicators. Nine were rated as relevant antibiotic prescribing indicators on all four dimensions; five were rated as relevant if only relevance to reducing antimicrobial resistance and public health policy makers was taken into account. A final set of 12 indicators was selected. Conclusion 12 of the proposed ESAC‐based quality indicators for outpatient antibiotic use in Europe have face validity and are potentially applicable. These indicators could be used to better describe antibiotic use in ambulatory care and assess the quality of national antibiotic prescribing patterns in Europe. PMID:18055888

Environmental education curriculum evaluation questionnaire: A reliability and validity study

NASA Astrophysics Data System (ADS)

Minner, Daphne Diane

The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating that the questionnaire can discriminate differences in quality of environmental education curricula. Of the 35 curricula evaluated, 6 were high quality, 14 were medium quality and 15 were low quality. The criterion-related validity of the instrument is at current time unable to be established due to the lack of comparable measures or a concretely usable set of multidisciplinary standards. Face and content validity were sufficiently demonstrated.

English translation and validation of the SarQoL®, a quality of life questionnaire specific for sarcopenia.

PubMed

Beaudart, Charlotte; Edwards, Mark; Moss, Charlotte; Reginster, Jean-Yves; Moon, Rebecca; Parsons, Camille; Demoulin, Christophe; Rizzoli, René; Biver, Emmanuel; Dennison, Elaine; Bruyere, Olivier; Cooper, Cyrus

2017-03-01

the first quality of life questionnaire specific to sarcopenia, the SarQoL®, has recently been developed and validated in French. To extend the availability and utilisation of this questionnaire, its translation and validation in other languages is necessary. the purpose of this study was therefore to translate the SarQoL® into English and validate the psychometric properties of this new version. cross-sectional. Hertfordshire, UK. in total, 404 participants of the Hertfordshire Cohort Study, UK. the translation part was articulated in five stages: (i) two initial translations from French to English; (ii) synthesis of the two translations; (iii) backward translations; (iv) expert committee to compare the backward translations with the original questionnaire and (v) pre-test. To validate the English SarQoL®, we assessed its validity (discriminative power, construct validity), reliability (internal consistency, test-retest reliability) and floor/ceiling effects. the SarQoL® questionnaire was translated without any major difficulties. Results indicated a good discriminative power (lower score of quality of life for sarcopenic subjects, P = 0.01), high internal consistency (Cronbach's alpha of 0.88), consistent construct validity (high correlations found with domains related to mobility, usual activities, vitality, physical function and low correlations with domains related to anxiety, self-care, mental health and social problems) and excellent test-retest reliability (intraclass coefficient correlation of 0.95, 95%CI 0.92-0.97). Moreover, no floor/ceiling has been found. a valid SarQoL® English questionnaire is now available and can be used with confidence to better assess the disease burden associated with sarcopenia. It could also be used as a treatment outcome indicator in research. © The Author 2016. Published by Oxford University Press on behalf of the British Geriatrics Society.

Quality and rigor of the concept mapping methodology: a pooled study analysis.

PubMed

Rosas, Scott R; Kane, Mary

2012-05-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed. Copyright © 2011 Elsevier Ltd. All rights reserved.

Assessment of patient's experiences across the interface between primary and secondary care: Consumer Quality Index Continuum of care.

PubMed

Berendsen, Annette J; Groenier, Klaas H; de Jong, G Majella; Meyboom-de Jong, Betty; van der Veen, Willem Jan; Dekker, Janny; de Waal, Margot W M; Schuling, Jan

2009-10-01

Development and validation of a questionnaire that measures patients' experiences of collaboration between general practitioners (GPs) and specialists. A questionnaire was developed using the method of the consumer quality index and validated in a cross-sectional study among a random sample of patients referred to medical specialists in the Netherlands. Validation included factor analysis, ascertain internal consistency, and the discriminative ability. The response rate was 65% (1404 patients). Exploratory factor analysis indicated that four domains could be distinguished (i.e. GP Approach; GP Referral; Specialist; Collaboration). Cronbach's alpha coefficients ranged from 0.51 to 0.93 indicating sufficient internal consistency to make comparison of groups of respondents possible. The Pearson correlation coefficients between the domains were <0.4, except between the domains GP Approach and GP Referral. All domains clearly produced discriminating scores for groups with different characteristics. The Consumer Quality Index (CQ-index) Continuum of Care can be a useful instrument to assess aspects of the collaboration between GPs and specialists from patients' perspective. It can be used to give feedback to both medical professionals and policy makers. Such feedback creates an opportunity for implementing specific improvements and evaluating quality improvement projects. 2009 Elsevier Ireland Ltd.

Quality of prenatal care questionnaire: instrument development and testing.

PubMed

Heaman, Maureen I; Sword, Wendy A; Akhtar-Danesh, Noori; Bradford, Amanda; Tough, Suzanne; Janssen, Patricia A; Young, David C; Kingston, Dawn A; Hutton, Eileen K; Helewa, Michael E

2014-06-03

Utilization indices exist to measure quantity of prenatal care, but currently there is no published instrument to assess quality of prenatal care. The purpose of this study was to develop and test a new instrument, the Quality of Prenatal Care Questionnaire (QPCQ). Data for this instrument development study were collected in five Canadian cities. Items for the QPCQ were generated through interviews with 40 pregnant women and 40 health care providers and a review of prenatal care guidelines, followed by assessment of content validity and rating of importance of items. The preliminary 100-item QPCQ was administered to 422 postpartum women to conduct item reduction using exploratory factor analysis. The final 46-item version of the QPCQ was then administered to another 422 postpartum women to establish its construct validity, and internal consistency and test-retest reliability. Exploratory factor analysis reduced the QPCQ to 46 items, factored into 6 subscales, which subsequently were validated by confirmatory factor analysis. Construct validity was also demonstrated using a hypothesis testing approach; there was a significant positive association between women's ratings of the quality of prenatal care and their satisfaction with care (r = 0.81). Convergent validity was demonstrated by a significant positive correlation (r = 0.63) between the "Support and Respect" subscale of the QPCQ and the "Respectfulness/Emotional Support" subscale of the Prenatal Interpersonal Processes of Care instrument. The overall QPCQ had acceptable internal consistency reliability (Cronbach's alpha = 0.96), as did each of the subscales. The test-retest reliability result (Intra-class correlation coefficient = 0.88) indicated stability of the instrument on repeat administration approximately one week later. Temporal stability testing confirmed that women's ratings of their quality of prenatal care did not change as a result of giving birth or between the early postpartum period and 4 to 6 weeks postpartum. The QPCQ is a valid and reliable instrument that will be useful in future research as an outcome measure to compare quality of care across geographic regions, populations, and service delivery models, and to assess the relationship between quality of care and maternal and infant health outcomes.

Linguistic and clinical validation of the Arabic-translated Aberdeen Menorrhagia Severity Scale as an indicator of quality of life for women with abnormal uterine bleeding.

PubMed

Abu-Rafea, Basim F; Vilos, George A; Al Jasser, Rakia S; Al Anazy, Reem M; Javaid, Khalida; Al-Mandeel, Hazem M

2012-08-01

To develop a conceptually and semantically valid Arabic version of a validated disease-specific instrument of quality of life (QoL) for women with abnormal uterine bleeding (AUB). This is a prospective cohort study conducted at the Department of Obstetrics & Gynecology, King Saud University, Riyadh, Kingdom of Saudi Arabia between December 2010 and December 2011 following ethics approval. Forward translation of the Aberdeen Menorrhagia Severity Scale (AMSS) from English into Arabic was followed by backward translation of the consensus target (Arabic) version into the source (English) language. Subsequently, a final target (Arabic) language version was created. Sixty-one Arabic-speaking women of reproductive age participated in the study. The final Arabic questionnaire was administered to 41 women with self-perceived normal menses (Group 1) on 2 occasions 2 weeks apart. Agreement in the answers deems the questionnaire reliable. The final Arabic version was administered to 20 women with self-perceived AUB (Group 2), and their scores were compared with the first response of Group 1. A significant difference between the groups deems the questionnaire valid. For linguistic validation; intra-class correlation coefficient (ICC) of 0.87 and Kappa statistics of 0.56 to 0.87 indicated good to excellent agreement. For clinical validation, there was a significant difference between Group 1 and 2 (p=0.001). The translated Arabic AMSS is a reliable and valid indicator of QoL in Saudi women with AUB.

Quality indicators for the management of Barrett's esophagus, dysplasia, and esophageal adenocarcinoma: international consensus recommendations from the American Gastroenterological Association Symposium.

PubMed

Sharma, Prateek; Katzka, David A; Gupta, Neil; Ajani, Jaffer; Buttar, Navtej; Chak, Amitabh; Corley, Douglas; El-Serag, Hashem; Falk, Gary W; Fitzgerald, Rebecca; Goldblum, John; Gress, Frank; Ilson, David H; Inadomi, John M; Kuipers, Ernest J; Lynch, John P; McKeon, Frank; Metz, David; Pasricha, Pankaj J; Pech, Oliver; Peek, Richard; Peters, Jeffrey H; Repici, Alessandro; Seewald, Stefan; Shaheen, Nicholas J; Souza, Rhonda F; Spechler, Stuart J; Vennalaganti, Prashanth; Wang, Kenneth

2015-11-01

The development of and adherence to quality indicators in gastroenterology, as in all of medicine, is increasing in importance to ensure that patients receive consistent high-quality care. In addition, government-based and private insurers will be expecting documentation of the parameters by which we measure quality, which will likely affect reimbursements. Barrett's esophagus remains a particularly important disease entity for which we should maintain up-to-date guidelines, given its commonality, potentially lethal outcomes, and controversies regarding screening and surveillance. To achieve this goal, a relatively large group of international experts was assembled and, using the modified Delphi method, evaluated the validity of multiple candidate quality indicators for the diagnosis and management of Barrett's esophagus. Several candidate quality indicators achieved >80% agreement. These statements are intended to serve as a consensus on candidate quality indicators for those who treat patients with Barrett's esophagus. Copyright © 2015 AGA Institute. Published by Elsevier Inc. All rights reserved.

Quality Indicators for the Management of Barrett’s Esophagus, Dysplasia, and Esophageal Adenocarcinoma: International Consensus Recommendations from the American Gastroenterological Association Symposium

PubMed Central

Sharma, Prateek; Katzka, David A.; Gupta, Neil; Ajani, Jaffer; Buttar, Navtej; Chak, Amitabh; Corley, Douglas; El-Serag, Hashem; Falk, Gary W.; Fitzgerald, Rebecca; Goldblum, John; Gress, Frank; Ilson, David H.; Inadomi, John M.; Kuipers, Ernest J.; Lynch, John P.; McKeon, Frank; Metz, David; Pasricha, Pankaj J.; Pech, Oliver; Peek, Richard; Peters, Jeffrey H.; Repici, Alessandro; Seewald, Stefan; Shaheen, Nicholas J.; Souza, Rhonda F.; Spechler, Stuart J.; Vennalaganti, Prashanth; Wang, Kenneth

2016-01-01

The development of and adherence to quality indicators in gastroenterology, as in all of medicine, is increasing in importance to ensure that patients receive consistent high-quality care. In addition, government-based and private insurers will be expecting documentation of the parameters by which we measure quality, which will likely affect reimbursements. Barrett’s esophagus remains a particularly important disease entity for which we should maintain up-to-date guidelines, given its commonality, potentially lethal outcomes, and controversies regarding screening and surveillance. To achieve this goal, a relatively large group of international experts was assembled and, using the modified Delphi method, evaluated the validity of multiple candidate quality indicators for the diagnosis and management of Barrett’s esophagus. Several candidate quality indicators achieved >80% agreement. These statements are intended to serve as a consensus on candidate quality indicators for those who treat patients with Barrett’s esophagus. PMID:26296479

Construct and Criterion Validity of the PedsQL™ 4.0 Instrument (Pediatric Quality of Life Inventory) in Colombia.

PubMed

Amaya-Arias, Ana Carolina; Alzate, Juan Pablo; Eslava-Schmalbach, Javier H

2017-01-01

This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. The instrument was applied to 375 children (ages 5-18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale.

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

Validation of the Italian translation of the Inflammatory Bowel Disease Questionnaire.

PubMed

Ciccocioppo, Rachele; Klersy, Catherine; Russo, Maria Luisa; Valli, Monica; Boccaccio, Vincenzo; Imbesi, Venerina; Ardizzone, Sandro; Porro, Gabriele Bianchi; Corazza, Gino Roberto

2011-07-01

Health-related quality of life is an important measure of treatment outcome; its evaluation requires the use of internationally validated ad hoc questionnaires. The McMaster Inflammatory Bowel Disease Questionnaire (IBDQ) is the most used specific instrument. To assess the validity and reliability of the Italian translation of the IBDQ. The IBDQ underwent forward and backward translation; 13 patients were enrolled for cognitive testing of the Italian version to increase clarity. For field testing, 113 patients (65 with Crohn's disease and 48 with ulcerative colitis) completed both the IBDQ and the generic instrument 36-item Short Form Health Survey scale (SF-36). Data quality was optimal with high completeness and low floor and ceiling effect. Item internal consistency was satisfied for 100% of patients, while discriminant validity showed a few items with higher correlations with other scales. Cronbach's alpha coefficient was 0.96. Test-retest correlations indicated good reliability (Pearson R 0.81). Exploratory factor analysis indicated that the original grouping of the item was suboptimal. The score proved sensitive to disease activity, gender and quality of life as measured by the SF-36. The Italian translation of the McMaster Inflammatory Bowel Disease Questionnaire sounds natural and is easy to understand. A field test gave results comparable to other international validations, supporting its use in cross-national surveys. Copyright © 2011 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

[Quality management in a clinical research facility: Evaluation of changes in quality in-house figures and the appraisal of in-house quality indicators].

PubMed

Aden, Bile; Allekotte, Silke; Mösges, Ralph

2016-12-01

For long-term maintenance and improvement of quality within a clinical research institute, the implementation and certification of a quality management system is suitable. Due to the implemented quality management system according to the still valid DIN EN ISO 9001:2008 desired quality objectives are achieved effectively. The evaluation of quality scores and the appraisal of in-house quality indicators make an important contribution in this regard. In order to achieve this and draw quality assurance conclusions, quality indicators as sensible and sensitive as possible are developed. For this, own key objectives, the retrospective evaluation of quality scores, a prospective follow-up and also discussions establish the basis. In the in-house clinical research institute the measures introduced by the quality management led to higher efficiency in work processes, improved staff skills, higher customer satisfaction and overall to more successful outcomes in relation to the self-defined key objectives. Copyright © 2016. Published by Elsevier GmbH.

Reliability and validity of the Daily Cognitive-Communication and Sleep Profile: a new instrument for monitoring sleep, wakefulness and daytime function.

PubMed

Fung, Christina Hoi Ling; Nguyen, Michelle; Moineddin, Rahim; Colantonio, Angela; Wiseman-Hakes, Catherine

2014-06-01

The Daily Cognitive Communicative and Sleep Profile (DCCASP) is a seven-item instrument that captures daily subjective sleep quality, perceived mood, cognitive, and communication functions. The objective of this study was to evaluate the reliability and validity of the DCCASP. The DCCASP was self-administered daily to a convenience sample of young adults (n = 54) for two two-week blocks, interspersed with a two-week rest period. Afterwards, participants completed the Pittsburgh Sleep Quality Index (PSQI). Internal consistency and criterion validity were calculated by Cronbach's α coefficient, Concordance Correlation Coefficient (CCC), and Spearman rank (rs) correlation coefficient, respectively. Results indicated high internal consistency (Cronbach-s α = 0.864-0.938) among mean ratings of sleep quality on the DCCASP. There were significant correlations between mean ratings of sleep quality and all domains (rs=0.38-0.55, p<0.0001). Criterion validity was established between mean sleep quality ratings on the DCCASP and PSQI (rs=0.40, p<0.001). The DCCASP is a reliable and valid self-report instrument to monitor daily sleep quality and perceived mood, cognitive, and communication functions over time, amongst a normative sample of young adults. Further studies on its psychometric properties are necessary to clarify its utility in a clinical population. Copyright © 2014 John Wiley & Sons, Ltd.

Assessing Quality of Kindergarten Classrooms in Singapore: Psychometric Properties of the Early Childhood Environment Rating Scale-Revised

ERIC Educational Resources Information Center

Bull, Rebecca; Yao, Shih-Ying; Ng, Ee Lynn

2017-01-01

The early childhood sector in Singapore has witnessed vast changes in the past two decades. One of the key policy aims is to improve classroom quality. To ensure a rigorous evaluation of the quality of early childhood environments in Singapore, it is important to determine whether commonly used assessments of quality are valid indicators across…

Influence of childhood scleroderma on physical function and quality of life.

PubMed

Baildam, Eileen M; Ennis, Holly; Foster, Helen E; Shaw, Lindsay; Chieng, Alice S E; Kelly, Jane; Herrick, Ariane L; Richards, Helen L

2011-01-01

there have been few studies of quality of life in childhood scleroderma and these focused predominantly on self-perception and the influence of skin lesions. Our cross-sectional study aimed to describe the influence of childhood scleroderma on physical function and quality of life in relation to clinical and demographic measures. children with either localized scleroderma or systemic sclerosis (SSc) attending pediatric rheumatology clinics, together with their parents or guardians, were asked to complete a set of 4 validated measures. Clinical and demographic data were provided by consultant pediatric rheumatologists. in total, 28 children and their parents/guardians participated in the study (68% female, median age 13 yrs; 86% localized scleroderma, 14% SSc). The median Child Health Assessment Questionnaire (CHAQ) score was 0.1 (range 0-3, 0 indicating no impairment), the median Child Dermatology Life Quality Index (CDLQI) score was 5 (range 0-30, 0 indicating no impairment), and the median Child Quality of Life Questionnaire (CQOL) function score was 26 (range 0-105, 0 indicating no impairment). Family activity, measured by the Child Health Questionnaire (CHQ-PF50), was also moderately impaired by scleroderma, with a median score of 83 (0-100, 100 indicating no impairment). scleroderma had only a moderate effect on quality of life and physical function as measured by the 4 validated instruments. Although a small number of children reported greater impairment, this is an encouraging finding, given its potential disfiguring and debilitating effects.

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Development and validation of hospital information system-generated indicators of the appropriateness of oral anticoagulant prescriptions in hospitalised adults: the PACHA study protocol.

PubMed

Petit-Monéger, Aurélie; Thiessard, Frantz; Jouhet, Vianney; Noize, Pernelle; Berdaï, Driss; Kret, Marion; Sitta, Rémi; Salmi, Louis-Rachid; Saillour-Glénisson, Florence

2017-08-31

The appropriateness of oral anticoagulant prescriptions is a major challenge to improve quality and safety of care. As indicators of the appropriateness of oral anticoagulant prescriptions are lacking, the aim of the study is to develop and validate a panel of such indicators, in hospitalised adults, from the hospital information system of two university hospitals in France. The study will be carried out in four steps: (1) a literature review to identify indicators of the appropriateness of oral anticoagulant prescriptions and their conditions of appropriateness; (2) a Delphi consensus method to assess the potential utility and operational implementation of the selected indicators; (3) techniques of medical data search to implement indicators from the hospital information system and; (4) a cross-sectional study to assess the ability of indicators to detect inappropriate oral anticoagulant prescriptions, performance of medical data search techniques for tracking or retrieving information and the ability of tools to be transferred into other institutions. The fourth step will include up to 80 patient hospital stays for each indicator, depending on the prevalence of inappropriate prescriptions estimated in interim analyses. This work addresses the current lack of quality indicators of the appropriateness of oral anticoagulant prescriptions. We aim to develop and validate such indicators for integrating them into hospital clinical practice, as part of a structured approach to improve quality and safety of care. As each hospital information system is different, we will propose tools transferable to other healthcare institutions to allow an automated construction of these indicators. The PACHA study protocol was approved by institutional review boards and ethics committees (CPP Sud-Ouest et Outre Mer III-DC 2016/119; CPP Ile-de-France II-CDW_2016_0014). Clinical Trial.gov registration: NCT02898090. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and validation of hospital information system-generated indicators of the appropriateness of oral anticoagulant prescriptions in hospitalised adults: the PACHA study protocol

PubMed Central

Petit-Monéger, Aurélie; Thiessard, Frantz; Jouhet, Vianney; Noize, Pernelle; Berdaï, Driss; Kret, Marion; Sitta, Rémi; Salmi, Louis-Rachid; Saillour-Glénisson, Florence

2017-01-01

Introduction The appropriateness of oral anticoagulant prescriptions is a major challenge to improve quality and safety of care. As indicators of the appropriateness of oral anticoagulant prescriptions are lacking, the aim of the study is to develop and validate a panel of such indicators, in hospitalised adults, from the hospital information system of two university hospitals in France. Methods and analysis The study will be carried out in four steps: (1) a literature review to identify indicators of the appropriateness of oral anticoagulant prescriptions and their conditions of appropriateness; (2) a Delphi consensus method to assess the potential utility and operational implementation of the selected indicators; (3) techniques of medical data search to implement indicators from the hospital information system and; (4) a cross-sectional study to assess the ability of indicators to detect inappropriate oral anticoagulant prescriptions, performance of medical data search techniques for tracking or retrieving information and the ability of tools to be transferred into other institutions. The fourth step will include up to 80 patient hospital stays for each indicator, depending on the prevalence of inappropriate prescriptions estimated in interim analyses. Ethics and dissemination This work addresses the current lack of quality indicators of the appropriateness of oral anticoagulant prescriptions. We aim to develop and validate such indicators for integrating them into hospital clinical practice, as part of a structured approach to improve quality and safety of care. As each hospital information system is different, we will propose tools transferable to other healthcare institutions to allow an automated construction of these indicators. The PACHA study protocol was approved by institutional review boards and ethics committees (CPP Sud-Ouest et Outre Mer III—DC 2016/119; CPP Ile-de-France II—CDW_2016_0014). Registration details Clinical Trial.gov registration: NCT02898090. PMID:28860229

Development and preliminary validation of an index for indicating the risks of the design of working hours to health and wellbeing.

PubMed

Schomann, Carsten; Giebel, Ole; Nachreiner, Friedhelm

2006-01-01

BASS 4, a computer program for the design and evaluation of workings hours, is an example of an ergonomics-based software tool that can be used by safety practitioners at the shop floor with regard to legal, ergonomic, and economic criteria. Based on experiences with this computer program, a less sophisticated Working-Hours-Risk Index for assessing the quality of work schedules (including flexible work hours) to indicate risks to health and wellbeing has been developed to provide a quick and easy applicable tool for legally required risk assessments. The results of a validation study show that this risk index seems to be a promising indicator for predicting risks of health complaints and wellbeing. The purpose of the Risk Index is to simplify the evaluation process at the shop floor and provide some more general information about the quality of a work schedule that can be used for triggering preventive interventions. Such a risk index complies with practitioners' expectations and requests for easy, useful, and valid instruments.

[Validation of a scale to assess the labour quality of life in public hospitals from Tlaxcala].

PubMed

Hernández-Vicente, Irma Alejandra; Lumbreras-Guzmán, Marivel; Méndez-Hernández, Pablo; Rojas-Lima, Elodia; Cervantes-Rodríguez, Margarita; Juárez-Flores, Clara Arlina

2017-01-01

To validate a scale for assessing the labour quality of life in public hospitals (LQL-PH) from Tlaxcala, Mexico. The instrument was validated among 669 health workers from six hospitals from the Ministry of Health of Tlaxcala, Mexico. Content validity was by inquiry to experts, construct validity by factor analysis, criterion validity by comparing with other scales, and reliability with Cronbach's Alpha. The factor analysis uncovered four dimensions: "individual welfare", "conditions and labour environment", "organization", and "well-being accomplished by the work"; reliability was 0.921. Workers who perceibed better LQL-PH were: under 50 years old, with temporary contract, with less seniority in job, with work schedule at daytime of weekends, and those with academic degree. LQL-PH showed to be an instrument phsycometrically valid and reliable. It's recommendable to prove this scale in other public and private health institutions, as well as its relationship with key health care indicators of labour performance and management.

A New Generation of Crystallographic Validation Tools for the Protein Data Bank

PubMed Central

Read, Randy J.; Adams, Paul D.; Arendall, W. Bryan; Brunger, Axel T.; Emsley, Paul; Joosten, Robbie P.; Kleywegt, Gerard J.; Krissinel, Eugene B.; Lütteke, Thomas; Otwinowski, Zbyszek; Perrakis, Anastassis; Richardson, Jane S.; Sheffler, William H.; Smith, Janet L.; Tickle, Ian J.; Vriend, Gert; Zwart, Peter H.

2011-01-01

Summary This report presents the conclusions of the X-ray Validation Task Force of the worldwide Protein Data Bank (PDB). The PDB has expanded massively since current criteria for validation of deposited structures were adopted, allowing a much more sophisticated understanding of all the components of macromolecular crystals. The size of the PDB creates new opportunities to validate structures by comparison with the existing database, and the now-mandatory deposition of structure factors creates new opportunities to validate the underlying diffraction data. These developments highlighted the need for a new assessment of validation criteria. The Task Force recommends that a small set of validation data be presented in an easily understood format, relative to both the full PDB and the applicable resolution class, with greater detail available to interested users. Most importantly, we recommend that referees and editors judging the quality of structural experiments have access to a concise summary of well-established quality indicators. PMID:22000512

A new generation of crystallographic validation tools for the protein data bank.

PubMed

Read, Randy J; Adams, Paul D; Arendall, W Bryan; Brunger, Axel T; Emsley, Paul; Joosten, Robbie P; Kleywegt, Gerard J; Krissinel, Eugene B; Lütteke, Thomas; Otwinowski, Zbyszek; Perrakis, Anastassis; Richardson, Jane S; Sheffler, William H; Smith, Janet L; Tickle, Ian J; Vriend, Gert; Zwart, Peter H

2011-10-12

This report presents the conclusions of the X-ray Validation Task Force of the worldwide Protein Data Bank (PDB). The PDB has expanded massively since current criteria for validation of deposited structures were adopted, allowing a much more sophisticated understanding of all the components of macromolecular crystals. The size of the PDB creates new opportunities to validate structures by comparison with the existing database, and the now-mandatory deposition of structure factors creates new opportunities to validate the underlying diffraction data. These developments highlighted the need for a new assessment of validation criteria. The Task Force recommends that a small set of validation data be presented in an easily understood format, relative to both the full PDB and the applicable resolution class, with greater detail available to interested users. Most importantly, we recommend that referees and editors judging the quality of structural experiments have access to a concise summary of well-established quality indicators. Copyright © 2011 Elsevier Ltd. All rights reserved.

Construct and Criterion Validity of the PedsQL™ 4.0 Instrument (Pediatric Quality of Life Inventory) in Colombia

PubMed Central

Amaya-Arias, Ana Carolina; Alzate, Juan Pablo; Eslava-Schmalbach, Javier H

2017-01-01

Background: This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Methods: Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. Results: The instrument was applied to 375 children (ages 5–18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. Conclusions: The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale. PMID:28900536

The Children's Report of Sleep Patterns: Validity and Reliability of the Sleep Hygiene Index and Sleep Disturbances Scale in Adolescents

PubMed Central

Meltzer, Lisa J.; Brimeyer, Chasity; Russell, Kathryn; Avis, Kristin T.; Biggs, Sarah; Reynolds, Amy C.; Crabtree, Valerie McLaughlin

2014-01-01

Objective Sleep is critical for adolescent health and well-being. However, there are a limited number of validated self-report measures of sleep for adolescents, and no well-validated measures of sleep that can be used across middle childhood and adolescence. The Children's Report of Sleep Patterns (CRSP) has already been validated in children ages 8-12 years. The purpose of this study was to examine the psychometric properties of the CRSP as a multidimensional, self-report sleep measure for adolescents. Methods Participants included 570 adolescents aged 13 – 18 years, 60% female, recruited from pediatricians’ offices, sleep clinics, children's hospitals, schools, and the general population. A multi-method, multi-reporter approach was used to validate the CRSP. Along with the CRSP, a subset of the sample completed the Adolescent Sleep Hygiene Scale (ASHS), with a different subset of adolescents undergoing polysomnography. Results The CRSP demonstrated good reliability and validity. Group differences on the CRSP were found for adolescents presenting to a sleep or medical clinic (vs. community sample), for older adolescents (vs. younger adolescents), those who regularly napped (vs. infrequently napped), and those with poor sleep quality (vs. good sleep quality). Self-reported sleep quality in adolescents was also associated with higher apnea-hypopnea index scores from polysomnography. Finally, the CRSP Sleep Hygiene Indices were significantly correlated with indices of the ASHS. Conclusions The CRSP is a valid and reliable measure of adolescent sleep hygiene and sleep disturbances. With a parallel version for middle childhood (8-12 years), the CRSP likely provides clinicians and researchers the ability to measure self-reported sleep across development. PMID:25441749

Evaluating the Validity of Portfolio Assessments for Licensure Decisions

ERIC Educational Resources Information Center

Wilson, Mark; Hallam, P. J.; Pecheone, Raymond; Moss, Pamela A.

2014-01-01

This study examines one part of a validity argument for portfolio assessments of teaching practice used as an indicator of teaching quality to inform a licensure decision. We investigate the relationship among portfolio assessment scores, a test of teacher knowledge (ETS's Praxis I and II), and changes in student achievement (on…

Fecal Indicator Bacteria and Environmental Observations: Validation of Virtual Beach

EPA Science Inventory

Contamination of recreational waters by fecal material is often assessed using indicator bacteria such as enterococci. Enumeration based on culturing methods can take up to 48 hours to complete, limiting the accuracy of water quality evaluations. Molecular microbial techniques em...

Impact of syncope on quality of life: validation of a measure in patients undergoing tilt testing.

PubMed

Nave-Leal, Elisabete; Oliveira, Mário; Pais-Ribeiro, José; Santos, Sofia; Oliveira, Eunice; Alves, Teresa; Cruz Ferreira, Rui

2015-03-01

Recurrent syncope has a significant impact on quality of life. The development of measurement scales to assess this impact that are easy to use in clinical settings is crucial. The objective of the present study is a preliminary validation of the Impact of Syncope on Quality of Life questionnaire for the Portuguese population. The instrument underwent a process of translation, validation, analysis of cultural appropriateness and cognitive debriefing. A population of 39 patients with a history of recurrent syncope (>1 year) who underwent tilt testing, aged 52.1 ± 16.4 years (21-83), 43.5% male, most in active employment (n=18) or retired (n=13), constituted a convenience sample. The resulting Portuguese version is similar to the original, with 12 items in a single aggregate score, and underwent statistical validation, with assessment of reliability, validity and stability over time. With regard to reliability, the internal consistency of the scale is 0.9. Assessment of convergent and discriminant validity showed statistically significant results (p<0.01). Regarding stability over time, a test-retest of this instrument at six months after tilt testing with 22 patients of the sample who had not undergone any clinical intervention found no statistically significant changes in quality of life. The results indicate that this instrument is of value for assessing quality of life in patients with recurrent syncope in Portugal. Copyright © 2014 Sociedade Portuguesa de Cardiologia. Published by Elsevier España. All rights reserved.

[Quality indicators for National Disease Management Guidelines using the example of the National Disease Management Guideline for "Chronic Heart Failure"].

PubMed

Nothacker, Monika Judith; Langer, Thomas; Weinbrenner, Susanne

2011-01-01

Together with an expert committee a structured approach to determining quality indicators for National Disease Management Guidelines has been developed. The key steps of this approach include: introducing guideline authors to the methodology at an early stage of the process of guideline development, pre-selecting recommendations of the guideline which are potentially measurable by means of quality indicators, assessing the potentially measurable quality indicators in written form using five criteria (including their importance for the health care system and clarity of definitions) and approving them in a formal consensus process. For lack of a database these quality indicators must be regarded as preliminary. For the National Disease Management Guideline "Chronic Heart Failure" nine rate-based indicators have been chosen. The indicators correspond to important strong recommendations (grade of recommendation: A) from the fields of diagnosis (two), general therapeutic strategy (two), specific treatment (three), clinical monitoring (one) and co-ordination of care (one). In a second step, the quality indicators have to be validated within a pilot project. The determination and assessment of the potential quality indicators have revealed room for improvement of guideline development. In particular, there is a need for more health care data and for specification of recommendations.

Evaluation of the DAVROS (Development And Validation of Risk-adjusted Outcomes for Systems of emergency care) risk-adjustment model as a quality indicator for healthcare

PubMed Central

Wilson, Richard; Goodacre, Steve W; Klingbajl, Marcin; Kelly, Anne-Maree; Rainer, Tim; Coats, Tim; Holloway, Vikki; Townend, Will; Crane, Steve

2014-01-01

Background and objective Risk-adjusted mortality rates can be used as a quality indicator if it is assumed that the discrepancy between predicted and actual mortality can be attributed to the quality of healthcare (ie, the model has attributional validity). The Development And Validation of Risk-adjusted Outcomes for Systems of emergency care (DAVROS) model predicts 7-day mortality in emergency medical admissions. We aimed to test this assumption by evaluating the attributional validity of the DAVROS risk-adjustment model. Methods We selected cases that had the greatest discrepancy between observed mortality and predicted probability of mortality from seven hospitals involved in validation of the DAVROS risk-adjustment model. Reviewers at each hospital assessed hospital records to determine whether the discrepancy between predicted and actual mortality could be explained by the healthcare provided. Results We received 232/280 (83%) completed review forms relating to 179 unexpected deaths and 53 unexpected survivors. The healthcare system was judged to have potentially contributed to 10/179 (8%) of the unexpected deaths and 26/53 (49%) of the unexpected survivors. Failure of the model to appropriately predict risk was judged to be responsible for 135/179 (75%) of the unexpected deaths and 2/53 (4%) of the unexpected survivors. Some 10/53 (19%) of the unexpected survivors died within a few months of the 7-day period of model prediction. Conclusions We found little evidence that deaths occurring in patients with a low predicted mortality from risk-adjustment could be attributed to the quality of healthcare provided. PMID:23605036

Air quality as respiratory health indicator: a critical review.

PubMed

Moshammer, Hanns; Wallner, Peter

2011-09-01

As part of the European Public Health project IMCA II validity and practicability of "air pollution" as a respiratory health indicator were analyzed. The definitions of air quality as an indicator proposed by the WHO project ECOEHIS and by IMCA I were compared. The public availability of the necessary data was checked through access to web-based data-bases. Practicability and interpretation of the indicator were discussed with project partners and external experts. Air quality serves as a kind of benchmark for the good health-related environmental policy. In this sense, it is a relevant health indicator. Although air quality is not directly in the responsibility of health policy, its vital importance for the population's health should not be neglected. In principle, data is available to calculate this IMCA indicator for any chosen area in Europe. The indicator is relevant and informative, but calculation and interpretation need input from local expert knowledge. The European health policy is well advised to take air quality into account. To that end, an interdisciplinary approach is warranted. The proposed definition of air quality as a (respiratory) health indicator is workable, but correct interpretation depends on expert and local knowledge.

Quality of asthma care under different primary care models in Canada: a population-based study.

PubMed

To, Teresa; Guan, Jun; Zhu, Jingqin; Lougheed, M Diane; Kaplan, Alan; Tamari, Itamar; Stanbrook, Matthew B; Simatovic, Jacqueline; Feldman, Laura; Gershon, Andrea S

2015-02-14

Previous research has shown variations in quality of care and patient outcomes under different primary care models. The objective of this study was to use previously validated, evidence-based performance indicators to measure quality of asthma care over time and to compare quality of care between different primary care models. Data were obtained for years 2006 to 2010 from the Ontario Asthma Surveillance Information System, which uses health administrative databases to track individuals with asthma living in the province of Ontario, Canada. Individuals with asthma (n=1,813,922) were divided into groups based on the practice model of their primary care provider (i.e., fee-for-service, blended fee-for-service, blended capitation). Quality of asthma care was measured using six validated, evidence-based asthma care performance indicators. All of the asthma performance indicators improved over time within each of the primary care models. Compared to the traditional fee-for-service model, the blended fee-for-service and blended capitation models had higher use of spirometry for asthma diagnosis and monitoring, higher rates of inhaled corticosteroid prescription, and lower outpatient claims. Emergency department visits were lowest in the blended fee-for-service group. Quality of asthma care improved over time within each of the primary care models. However, the amount by which they improved differed between the models. The newer primary care models (i.e., blended fee-for-service, blended capitation) appear to provide better quality of asthma care compared to the traditional fee-for-service model.

[Output standard in the mental health services of Reggio Emilia, Italy. Methodological issues].

PubMed

Grassi, G

2000-01-01

The project Output Standards of the Mental Health Department (MHD) of Reggio Emilia is set out to define outputs and quality standards and to guarantee transparency and to facilitate organizational improvement. The MHD started an interprofessional working group that defined the MHD outputs as long as process, quality peculiarities, indicators and standards for each output. The MHD Director validated the group results. The MHD defined 9 outputs and its indicators and standards and consequently modified its data registration system, the way to supply free and partially charged services and budget indicators. As a result, a new instrument for management and quality control has been provided. The A. maintains that to define outputs, indicators and standards will allow to compare several services of the Department, get them omogeneous and guarantee and improve quality.

Pre-slaughter cattle welfare indicators for use in commercial abattoirs with voluntary monitoring systems: A systematic review.

PubMed

Losada-Espinosa, Natyieli; Villarroel, Morris; María, Gustavo A; Miranda-de la Lama, Genaro C

2018-04-01

Animal welfare has become an important subject of public, economic and political concern, leading to the need to validate indicators that are feasible to use at abattoirs. A systematic review was carried out, which identified 72 cattle welfare indicators (CWI) that were classified into four categories (physiological, morphometric, behavioral and meat quality). Their validity and feasibility for use in abattoirs were evaluated as potential measures of cattle welfare during transportation to the abattoir and at the abattoir itself. Several highly valid indicators were identified that are useful to assess welfare at abattoirs, including body condition score, human-animal interactions, vocalizations, falling, carcass bruising, and meat pH. In addition, some intermediate valid indicators are useful and should be investigated further. Information along the food chain could be used systematically to provide a basis for a more-risk-based meat inspection. An integrated system based on the use of key indicators defined for each inspection step with the setting of alarm thresholds could be implemented. Copyright © 2017 Elsevier Ltd. All rights reserved.

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

Development of a core set of quality indicators for paediatric primary care practices in Europe, COSI-PPC-EU.

PubMed

Ewald, Dominik A; Huss, Gottfried; Auras, Silke; Caceres, Juan Ruiz-Canela; Hadjipanayis, Adamos; Geraedts, Max

2018-06-01

Paediatric ambulatory healthcare systems in Europe are, because of historical reasons, diverse and show strikingly different outcomes. All across Europe, the benchmarking of structures, processes and outcomes could reveal opportunities for improving Paediatric Primary Care (PPC). The aim of this study was to develop a set of Quality Indicators (QIs) to assess and monitor PPC in Europe. In a three-step process, we used the available external evidence and European expert consensus in a modified RAND/UCLA Appropriateness Method (RAM) to develop an indicator set. (1) A broad literature and online research of published QI and guidelines yielded an inventory of 1516 QI. (2) A collaborative panel of paediatric senior experts from the European Academy of Paediatrics (EAP) and the European Confederation of Primary Care Paediatricians (ECPCP) from 15 European countries participated in a first consensus process to reduce the initial indicator inventory by eliminating not PPC-focused indicators and duplicates. (3) In a second consensus process, the panel rated the QI regarding validity and feasibility. The final QI set "COSI-PPC-EU" consists of 42 indicators in five categories of PPC: (A) health promotion/prevention/screening (13 QI), (B) acute care (9 QI), (C) chronic care (8 QI), (D) practice management (3 QI) and (E) patient safety (9 QI). COSI-PPC-EU represents a consented set of a limited number of valid quality indicators for the application in paediatric primary care in different healthcare systems throughout Europe. What is Known: • Paediatric ambulatory healthcare systems in Europe are diverse and show strikingly different outcomes. • There are known gaps in quality performance measures of paediatric primary care in Europe. Pre-existing sets of quality indicators are predominantly limited to national populations, specific diseases and hospital care. What is New: • A set of 42 quality indicators for primary paediatric care in Europe was developed in a multi-country collaborative effort. The method combined a systematic literature review and a consensus process among European paediatric experts. • The quality indicator set can facilitate quality improvement of PPC. After studying the feasibility, providers can use COSI-PPC-EU to monitor, compare and improve performance of practices, regions and countries.

Validity and reliability of the modified Chinese version of the Older People's Quality of Life Questionnaire (OPQOL) in older people living alone in China.

PubMed

Chen, Yu; Hicks, Allan; While, Alison E

2014-12-01

This study aimed to test the validity and reliability of a modified Chinese version of the OPQOL among older people living alone in China. China has an ageing population with an increasing number of older people living alone who may have a poorer quality of life (QoL) in the light of the traditional culture of collectivism and filial piety. An appropriate instrument is important to assess their QoL. The Older People's Quality of Life Questionnaire (OPQOL) was developed directly from the views of older people and has been validated in England. There has been no psychometric evaluation of the scale in China. The OPQOL was translated and modified prior to being administered to a stratified random cluster sample of 521 older people living alone. Validity was assessed through convergent validity, discriminant validity and construct validity. Reliability was assessed through internal consistency and test-retest reliability. Exploratory factor analysis indicated eight factors accounting for 63.77% of the variance. The convergent validity was supported by moderate correlations with functional ability, social support and loneliness with Spearman's rho of -0.50, 0.49 and -0.53, respectively. The discriminant validity was confirmed by differentiating QoL scores between the depressed and non-depressed groups. The Cronbach's α coefficient was 0.90 for the total scale and over 0.70 for most of its dimensions. The 2-week test-retest reliability ranged from 0.53 to 0.87. The modified Chinese version of the Older People's Quality of Life has acceptable validity and reliability as a useful instrument to measure the QoL of older people living alone in China. © 2013 John Wiley & Sons Ltd.

TURKISH VERSION QUALITY OF LIFE IN ESSENTIAL TREMOR QUESTIONNAIRE (QUEST): VALIDITY AND RELIABILITY STUDY.

PubMed

Güler, Sibel; Turan, F Nesrin

2015-09-30

Our aim was to translate the Quality of Life in Essential Tremor Questionnaire (QUEST) advanced by Troster (2005) and to analyse the validity and reliability of this questionnaire. Two hundred twelve consecutive patients with essential tremor (ET) and forty-three control subjects were included in the study. Permission for the translation and validation of the QUEST scale was obtained. The translation was performed according to the guidelines provided by the publisher. After the translation, the final version of the scale was administered to both groups to determine its reliability and validity. The QUEST Physical, Psychosocial, communication, Hobbies/leisure and Work/finance scores were 0.967, 0.968, 0.933, 0.964 and 0.925, respectively. There were good correlations between each of the QUEST scores that were indicative of good internal consistency. Additionally, we observed that all of the QUEST scores were most strongly related to the right and left arms (p=0.0001). However, we observed that all of the QUEST scores were weakly related to the voice, head and right leg (p=0.0001). These findings support the notion that the Turkish version of the Quality of Life in Essential Tremor (QUEST) questionnaire is a valid and reliable tool for the assessment of the quality of life of patients with ET.

The development and validation of the speech quality instrument.

PubMed

Chen, Stephanie Y; Griffin, Brianna M; Mancuso, Dean; Shiau, Stephanie; DiMattia, Michelle; Cellum, Ilana; Harvey Boyd, Kelly; Prevoteau, Charlotte; Kohlberg, Gavriel D; Spitzer, Jaclyn B; Lalwani, Anil K

2017-12-08

Although speech perception tests are available to evaluate hearing, there is no standardized validated tool to quantify speech quality. The objective of this study is to develop a validated tool to measure quality of speech heard. Prospective instrument validation study of 35 normal hearing adults recruited at a tertiary referral center. Participants listened to 44 speech clips of male/female voices reciting the Rainbow Passage. Speech clips included original and manipulated excerpts capturing goal qualities such as mechanical and garbled. Listeners rated clips on a 10-point visual analog scale (VAS) of 18 characteristics (e.g. cartoonish, garbled). Skewed distribution analysis identified mean ratings in the upper and lower 2-point limits of the VAS (ratings of 8-10, 0-2, respectively); items with inconsistent responses were eliminated. The test was pruned to a final instrument of nine speech clips that clearly define qualities of interest: speech-like, male/female, cartoonish, echo-y, garbled, tinny, mechanical, rough, breathy, soothing, hoarse, like, pleasant, natural. Mean ratings were highest for original female clips (8.8) and lowest for not-speech manipulation (2.1). Factor analysis identified two subsets of characteristics: internal consistency demonstrated Cronbach's alpha of 0.95 and 0.82 per subset. Test-retest reliability of total scores was high, with an intraclass correlation coefficient of 0.76. The Speech Quality Instrument (SQI) is a concise, valid tool for assessing speech quality as an indicator for hearing performance. SQI may be a valuable outcome measure for cochlear implant recipients who, despite achieving excellent speech perception, often experience poor speech quality. 2b. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Voice Quality Modelling for Expressive Speech Synthesis

PubMed Central

Socoró, Joan Claudi

2014-01-01

This paper presents the perceptual experiments that were carried out in order to validate the methodology of transforming expressive speech styles using voice quality (VoQ) parameters modelling, along with the well-known prosody (F 0, duration, and energy), from a neutral style into a number of expressive ones. The main goal was to validate the usefulness of VoQ in the enhancement of expressive synthetic speech in terms of speech quality and style identification. A harmonic plus noise model (HNM) was used to modify VoQ and prosodic parameters that were extracted from an expressive speech corpus. Perception test results indicated the improvement of obtained expressive speech styles using VoQ modelling along with prosodic characteristics. PMID:24587738

Validation of the Beliefs against Volunteering Scale among Chinese Adolescents in Hong Kong

ERIC Educational Resources Information Center

Law, Ben M. F.; Shek, Daniel T. L.

2011-01-01

Participation in volunteer service is an indicator of quality of life. This study attempts to validate the Beliefs Against Volunteering Scale (BAV), an assessment of the negative beliefs about volunteerism among Chinese adolescents in Hong Kong. The BAV was administered to 5,946 Chinese adolescents. The BAV and its subscales were found to be…

Measuring progress in maternal and newborn health care in Mexico: validating indicators of health system contact and quality of care.

PubMed

Blanc, Ann K; Diaz, Claudia; McCarthy, Katharine J; Berdichevsky, Karla

2016-08-30

The majority of births in Mexico take place in a health facility and are attended by a skilled birth attendant, yet maternal mortality has not declined to anticipated levels. Coverage estimates of skilled attendance and other maternal and newborn interventions often rely on women's self-report through a population-based survey, the accuracy of which is not well established. We used a facility-based design to validate women's report of skilled birth attendance, as well as other key elements of maternal, newborn intrapartum, and immediate postnatal care. Women's reports of labor and delivery care were collected by exit interview prior to hospital discharge and were compared against direct observation by a trained third party in a Mexican public hospital (n = 597). For each indicator, validity was assessed at the individual level using the area under the receiver operating curve (AUC) and at the population level using the inflation factor (IF). Five of 47 indicators met both validation criteria (AUC > 0.60 and 0.75 < IF < 1.25): urine sample screen, injection or IV medication received during labor, before the birth of the baby (i.e., uterotonic for either induction or augmentation of labor), episiotomy, excessive bleeding, and receipt of blood products. An additional 9 indicators met criteria for the AUC and 18 met criteria for the IF. A skilled attendant indicator had high sensitivity (90.1 %: 95 % CI: 87.1-92.5 %), low specificity (14.0 %: 95 % CI: 5.8-26.7 %) and was suitable for population-level estimation only. Women are able to give valid reports on some aspects of the content of care, although questions regarding the indication for interventions are less likely to be known. Questions that include technical terms or refer to specific time periods tended to have lower response levels. A key aspect of efforts to improve maternal and newborn health requires valid measurement of women's access to maternal and newborn health interventions and the quality of such services. Additional work on improving measurement of population coverage indicators is warranted.

The Development of Performance Indicators for Prison Libraries.

ERIC Educational Resources Information Center

Lithgow, Susan D.

This report describes a study to investigate the improved efficiency and effectiveness of prison library provision in England and Wales, through the development and validation of relevant performance indicators to be used as part of quality assurance programs. Prison libraries perform important educational, rehabilitative, and recreational…

Potential palliative care quality indicators in heart disease patients: A review of the literature.

PubMed

Mizuno, Atsushi; Miyashita, Mitsunori; Hayashi, Akitoshi; Kawai, Fujimi; Niwa, Koichiro; Utsunomiya, Akemi; Kohsaka, Shun; Kohno, Takashi; Yamamoto, Takeshi; Takayama, Morimasa; Anzai, Toshihisa

2017-10-01

In spite of the increasing interest in palliative care for heart disease, data on the detailed methods of palliative care and its efficacy specifically in heart disease are still lacking. A structured PubMed literature review revealed no quality indicators of palliative care in heart disease. Therefore, we performed a narrative overview of the potential quality indicators in heart disease by reviewing previous literature concerning quality indicators in cancer patients. We summarize seven potential categories of quality indicators in heart disease: (1) presence and availability of a palliative care unit, palliative care team, and outpatient palliative care; (2) human resources such as number of skilled staff; (3) infrastructure; (4) presence and frequency of documentation or family survey; (5) patient-reported outcome measure (PROM) data and disease-specific patient quality of life such as The Kansas City Cardiomyopathy Questionnaire (KCCQ); (6) questionnaires and interviews about the quality of palliative care after death, including bereaved family surveys; and (7) admission-related outcomes such as place of death and intensive care unit length of stay. Although detailed measurements of palliative care quality have not been validated in heart disease, many indicators developed in cancer patients might also be applicable to heart disease. This new categorization might be useful to determine quality indicators in heart disease patients. Copyright © 2017 Japanese College of Cardiology. Published by Elsevier Ltd. All rights reserved.

Development and Validation of a Disease-Specific Instrument to Measure Diet-Targeted Quality of Life for Postoperative Patients with Esophagogastric Cancer.

PubMed

Honda, Michitaka; Wakita, Takafumi; Onishi, Yoshihiro; Nunobe, Souya; Miura, Akinori; Nishigori, Tatsuto; Kusanagi, Hiroshi; Yamamoto, Takatsugu; Boddy, Alexander; Fukuhara, Shunichi

2015-12-01

Patients who have undergone esophagectomy or gastrectomy have certain dietary limitations because of changes to the alimentary tract. This study attempted to develop a psychometric scale, named "Esophago-Gastric surgery and Quality of Dietary life (EGQ-D)," for assessment of impact of upper gastrointestinal surgery on diet-targeted quality of life. Using qualitative methods, the study team interviewed both patients and surgeons involved in esophagogastric cancer surgery, and we prepared an item pool and a draft scale. To evaluate the scale's psychometric reliability and validity, a survey involving a large number of patients was conducted. Items for the final scale were selected by factor analysis and item response theory. Cronbach's alpha was used for assessment of reliability, and correlations with the short form (SF)-12, esophagus and stomach surgery symptom scale (ES(4)), and nutritional indicators were analyzed to assess the criterion-related validity. Through multifaceted discussion and the pilot study, a draft questionnaire comprising 14 items was prepared, and a total of 316 patients were enrolled. On the basis of factor analysis and item response theory, six items were excluded, and the remaining eight items demonstrated strong unidimensionality for the final scale. Cronbach's alpha was 0.895. There were significant associations with all the subscale scores for SF-12, ES(4), and nutritional indicators. The EGQ-D scale has good contents and psychometric validity and can be used to evaluate disease-specific instrument to measure diet-targeted quality of life for postoperative patients with esophagogastric cancer.

Validation of the Acoustic Voice Quality Index in the Japanese Language.

PubMed

Hosokawa, Kiyohito; Barsties, Ben; Iwahashi, Toshihiko; Iwahashi, Mio; Kato, Chieri; Iwaki, Shinobu; Sasai, Hisanori; Miyauchi, Akira; Matsushiro, Naoki; Inohara, Hidenori; Ogawa, Makoto; Maryn, Youri

2017-03-01

The Acoustic Voice Quality Index (AVQI) is a multivariate construct for quantification of overall voice quality based on the analysis of continuous speech and sustained vowel. The stability and validity of the AVQI is well established in several language families. However, the Japanese language has distinct characteristics with respect to several parameters of articulatory and phonatory physiology. The aim of the study was to confirm the criterion-related concurrent validity of AVQI, as well as its responsiveness to change and diagnostic accuracy for voice assessment in the Japanese-speaking population. This is a retrospective study. A total of 336 voice recordings, which included 69 pairs of voice recordings (before and after therapeutic interventions), were eligible for the study. The auditory-perceptual judgment of overall voice quality was evaluated by five experienced raters. The concurrent validity, responsiveness to change, and diagnostic accuracy of the AVQI were estimated. The concurrent validity and responsiveness to change based on the overall voice quality was indicated by high correlation coefficients 0.828 and 0.767, respectively. Receiver operating characteristic analysis revealed an excellent diagnostic accuracy for discrimination between dysphonic and normophonic voices (area under the curve: 0.905). The best threshold level for the AVQI of 3.15 corresponded with a sensitivity of 72.5% and specificity of 95.2%, with the positive and negative likelihood ratios of 15.1 and 0.29, respectively. We demonstrated the validity of the AVQI as a tool for assessment of overall voice quality and that of voice therapy outcomes in the Japanese-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Development and evaluation of an instrument to measure health-related quality of life in Cuban breast cancer patients receiving radiotherapy.

PubMed

Lugo, Josefina; Nápoles, Misleidy; Pérez, Inés; Ordaz, Niurka; Luzardo, Mario; Fernández, Leticia

2014-01-01

INTRODUCTION Although modern technology has extended the survival of breast cancer patients, treatment's adverse effects impact their health-related quality of life. Currently, no instrument exists capable of identifying the range of problems affecting breast cancer patients receiving radiotherapy in Cuba's socioeconomic and cultural context. OBJECTIVES Construct and validate an instrument to measure the effects of breast cancer and radiotherapy on health-related quality of life in Cuban patients. METHODS The study was conducted at the Oncology and Radiobiology Institute, Havana, Cuba, from January 2010 through December 2011. Inclusion criteria were: adult female, histological diagnosis of breast cancer, treated with ambulatory radiotherapy, and written informed consent; patients unable to communicate orally or in writing, or who had neurologic or psychiatric conditions were excluded. Development phase: focus groups guided by a list of questions were carried out with 50 women. The patients reported 61 problems affecting their health-related quality-of-life. A nominal group (six oncologists and two nurses) identified the same problems. A syntactic analysis of the information was performed to create items for study and measurement scales. Content validity was determined by a nominal group of seven experts using professional judgment. Another 20 patients were selected to evaluate face validity. Validation phase: the instrument was applied to 230 patients at three different points: before radiotherapy, at the end of radiotherapy and four weeks after radiotherapy was concluded. Reliability, construct validity, discriminant validity, predictive validity, interpretability and response burden were evaluated. RESULTS The final instrument developed had 33 items distributed in 4 domains: physical functioning, psychological functioning, social and family relationships, and physical and emotional adverse effects of disease and treatment. There were two discrete items: perceived general health and perceived health-related quality of life. Content validity and face validity were assessed as acceptable, by experts and patients respectively. Homogeneity, construct validity, and discriminant validity were satisfactory. The best results were obtained with test-retest reliability, predictive validity, and interpretability; the low rate of unanswered questions indicated that the instrument did not produce excessive patient response burden. CONCLUSION The new instrument fulfilled the requirements for measuring impact of breast cancer and of radiotherapy on health-related quality of life in these Cuban patients, validating its usefulness for inclusion in clinical trial protocols.

Validation of two complementary oral-health related quality of life indicators (OIDP and OSS 0-10 ) in two qualitatively distinct samples of the Spanish population

PubMed Central

Montero, J; Bravo, M; Albaladejo, A

2008-01-01

Background Oral health-related quality of life can be assessed positively, by measuring satisfaction with mouth, or negatively, by measuring oral impact on the performance of daily activities. The study objective was to validate two complementary indicators, i.e., the OIDP (Oral Impacts on Daily Performances) and Oral Satisfaction 0–10 Scale (OSS), in two qualitatively different socio-demographic samples of the Spanish adult population, and to analyse the factors affecting both perspectives of well-being. Methods A cross-sectional study was performed, recruiting a Validation Sample from randomly selected Health Centres in Granada (Spain), representing the general population (n = 253), and a Working Sample (n = 561) randomly selected from active Regional Government staff, i.e., representing the more privileged end of the socio-demographic spectrum of this reference population. All participants were examined according to WHO methodology and completed an in-person interview on their oral impacts and oral satisfaction using the OIDP and OSS 0–10 respectively. The reliability and validity of the two indicators were assessed. An alternative method of describing the causes of oral impacts is presented. Results The reliability coefficient (Cronbach's alpha) of the OIDP was above the recommended 0.7 threshold in both Validation and Occupational samples (0.79 and 0.71 respectively). Test-retest analysis confirmed the external reliability of the OSS (Intraclass Correlation Coefficient, 0.89; p < 0.001) Some subjective factors (perceived need for dental treatment, complaints about mouth and intermediate impacts) were strongly associated with both indicators, supporting their construct and criterion validity. The main cause of oral impact was dental pain. Several socio-demographic, behavioural and clinical variables were identified as modulating factors. Conclusion OIDP and OSS are valid and reliable subjective measures of oral impacts and oral satisfaction, respectively, in an adult Spanish population. Exploring simultaneously these issues may provide useful insights into how satisfaction and impact on well-being are constructed. PMID:19019208

Empirical Evaluation Indicators in Thai Higher Education: Theory-Based Multidimensional Learners' Assessment

ERIC Educational Resources Information Center

Sritanyarat, Dawisa; Russ-Eft, Darlene

2016-01-01

This study proposed empirical indicators which can be validated and adopted in higher education institutions to evaluate quality of teaching and learning, and to serve as an evaluation criteria for human resource management and development of higher institutions in Thailand. The main purpose of this study was to develop empirical indicators of a…

Psychiatric symptoms and response quality to self-rated personality tests: Evidence from the PsyCoLaus study.

PubMed

Dupuis, Marc; Meier, Emanuele; Rudaz, Dominique; Strippoli, Marie-Pierre F; Castelao, Enrique; Preisig, Martin; Capel, Roland; Vandeleur, Caroline L

2017-06-01

Despite the fact that research has demonstrated consistent associations between self-rated measures of personality dimensions and mental disorders, little has been undertaken to investigate the relation between psychiatric symptoms and response patterns to self-rated tests. The aim of this study was to investigate the association between psychiatric symptoms and response quality using indices from our functional method. A sample of 1,784 participants from a Swiss population-based cohort completed a personality inventory (NEO-FFI) and a symptom checklist of 90 items (SCL-90-R). Different indices of response quality were calculated based on the responses given to the NEO-FFI. Associations among the responses to indices of response quality, sociodemographic characteristics and the SCL-90-R dimensions were then established. Psychiatric symptoms were associated with several important differences in response quality, questioning subjects' ability to provide valid information using self-rated instruments. As suggested by authors, psychiatric symptoms seem associated with differences in personality scores. Nonetheless, our study shows that symptoms are also related to differences in terms of response patterns as sources of differences in personality scores. This could constitute a bias for clinical assessment. Future studies could still determine whether certain subpopulations of subjects are more unable to provide valid information to self-rated questionnaires than others. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

Validity and reliability of three commonly used quality of life measures in a large European population of coronary heart disease patients.

PubMed

De Smedt, Delphine; Clays, Els; Doyle, Frank; Kotseva, Kornelia; Prugger, Christof; Pająk, Andrzej; Jennings, Catriona; Wood, David; De Bacquer, Dirk

2013-09-01

To investigate the validity and reliability of the EuroQol-5D (EQ-5D), the 12-item Short-Form Health Survey (SF-12v2), and the Hospital Anxiety and Depression Scale (HADS) in a stable coronary population. Cross-sectional study EUROASPIRE III. Quality of life data (QoL) were available on 8745 patients hospitalized for coronary artery bypass graft (CABG), percutaneous coronary intervention (PCI), acute myocardial infarction (AMI), or myocardial ischemia. They were interviewed and examined at least 6 months after their hospital admission. Reliability and validity of the 3 instruments were tested. Internal consistency, and discriminative, convergent, criterion and construct validity were assessed. Cronbach's alpha indicated good internal consistency for all measures (0.73 to 0.87). Discriminative validity analyses confirmed significant QoL differences between known groups: age, gender, educational level. In addition, all hypothesized correlations between QoL constructs (convergent validity) and items (criterion validity) were confirmed with significant correlations. Confirmatory factor analyses indicated good construct validity for HADS and SF-12v2. On country-specific level, results were roughly similar. The EQ-5D as well as the SF-12v2 and the HADS are reliable and valid instruments for use in a stable coronary population, both on aggregate European level and on country-specific level. However, our results must be generalized with caution, because EUROASPIRE III patients might not be representative for all patients with stable coronary heart disease. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Field testing, refinement, and psychometric evaluation of a new measure of quality of care for assisted living.

PubMed

Rantz, Marilyn J; Aud, Myra A; Zwygart-Stauffacher, Mary; Mehr, David R; Petroski, Gregory F; Owen, Steven V; Madsen, Richard W; Flesner, Marcia; Conn, Vicki; Maas, Meridean

2008-01-01

Field test results are reported for the Observable Indicators of Nursing Home Care Quality Instrument-Assisted Living Version, an instrument designed to measure the quality of care in assisted living facilities after a brief 30-minute walk-through. The OIQ-AL was tested in 207 assisted-living facilities in two states using classical test theory, generalizability theory, and exploratory factor analysis. The 34-item scale has a coherent six-factor structure that conceptually describes the multidimensional concept of care quality in assisted living. The six factors can be logically clustered into process (Homelike and Caring, 21 items) and structure (Access and Choice; Lighting; Plants and Pets; Outdoor Spaces) subscales and for a total quality score. Classical test theory results indicate most subscales and the total quality score from the OIQ-AL have acceptable interrater, test-retest, and strong internal consistency reliabilities. Generalizability theory analyses reveal that dependability of scores from the instrument are strong, particularly by including a second observer who conducts a site visit and independently completes an instrument, or by a single observer conducting two site visits and completing instruments during each visit. Scoring guidelines based on the total sample of observations (N = 358) help guide those who want to use the measure to interpret both subscale and total scores. Content validity was supported by two expert panels of people experienced in the assisted-living field, and a content validity index calculated for the first version of the scale is high (3.43 on a four-point scale). The OIQ-AL gives reliable and valid scores for researchers, and may be useful for consumers, providers, and others interested in measuring quality of care in assisted-living facilities.

Validation of the Neonatal Satisfaction Survey (NSS-8) in six Norwegian neonatal intensive care units: a quantitative cross-sectional study.

PubMed

Hagen, Inger Hilde; Svindseth, Marit Følsvik; Nesset, Erik; Orner, Roderick; Iversen, Valentina Cabral

2018-03-27

The experience of having their new-borns admitted to an intensive care unit (NICU) can be extremely distressing. Subsequent risk of post-incident-adjustment difficulties are increased for parents, siblings, and affected families. Patient and next of kin satisfaction surveys provide key indicators of quality in health care. Methodically constructed and validated survey tools are in short supply and parents' experiences of care in Neonatal Intensive Care Units is under-researched. This paper reports a validation of the Neonatal Satisfaction Survey (NSS-8) in six Norwegian NICUs. Parents' survey returns were collected using the Neonatal Satisfaction Survey (NSS-13). Data quality and psychometric properties were systematically assessed using exploratory factor analysis, tests of internal consistency, reliability, construct, convergent and discriminant validity. Each set of hospital returns were subjected to an apostasy analysis before an overall satisfaction rate was calculated. The survey sample of 568 parents represents 45% of total eligible population for the period of the study. Missing data accounted for 1,1% of all returns. Attrition analysis shows congruence between sample and total population. Exploratory factor analysis identified eight factors of concern to parents,"Care and Treatment", "Doctors", "Visits", "Information", "Facilities", "Parents' Anxiety", "Discharge" and "Sibling Visits". All factors showed satisfactory internal consistency, good reliability (Cronbach's alpha ranged from 0.70-0.94). For the whole scale of 51 items α 0.95. Convergent validity using Spearman's rank between the eight factors and question measuring overall satisfaction was significant on all factors. Discriminant validity was established for all factors. Overall satisfaction rates ranged from 86 to 90% while for each of the eight factors measures of satisfaction varied between 64 and 86%. The NSS-8 questionnaire is a valid and reliable scale for measuring parents' assessment of quality of care in NICU. Statistical analysis confirms the instrument's capacity to gauge parents' experiences of NICU. Further research is indicated to validate the survey questionnaire in other Nordic countries and beyond.

Development and validation of a protocol for optimizing the use of paraffin blocks in molecular epidemiological studies: The example from the HPV-AHEAD study.

PubMed

Mena, Marisa; Lloveras, Belen; Tous, Sara; Bogers, Johannes; Maffini, Fausto; Gangane, Nitin; Kumar, Rekha Vijay; Somanathan, Thara; Lucas, Eric; Anantharaman, Devasena; Gheit, Tarik; Castellsagué, Xavier; Pawlita, Michael; de Sanjosé, Silvia; Alemany, Laia; Tommasino, Massimo

2017-01-01

Worldwide use of formalin-fixed paraffin-embedded blocks (FFPE) is extensive in diagnosis and research. Yet, there is a lack of optimized/standardized protocols to process the blocks and verify the quality and presence of the targeted tissue. In the context of an international study on head and neck cancer (HNC)-HPV-AHEAD, a standardized protocol for optimizing the use of FFPEs in molecular epidemiology was developed and validated. First, a protocol for sectioning the FFPE was developed to prevent cross-contamination and distributed between participating centers. Before processing blocks, all sectioning centers underwent a quality control to guarantee a satisfactory training process. The first and last sections of the FFPEs were used for histopathological assessment. A consensus histopathology evaluation form was developed by an international panel of pathologists and evaluated for four indicators in a pilot analysis in order to validate it: 1) presence/type of tumor tissue, 2) identification of other tissue components that could affect the molecular diagnosis and 3) quality of the tissue. No HPV DNA was found in sections from empty FFPE generated in any histology laboratories of HPV-AHEAD consortium and all centers passed quality assurance for processing after quality control. The pilot analysis to validate the histopathology form included 355 HNC cases. The form was filled by six pathologists and each case was randomly assigned to two of them. Most samples (86%) were considered satisfactory. Presence of >50% of invasive carcinoma was observed in all sections of 66% of cases. Substantial necrosis (>50%) was present in <2% of samples. The concordance for the indicators targeted to validate the histopathology form was very high (kappa > 0.85) between first and last sections and fair to high between pathologists (kappa/pabak 0.21-0.72). The protocol allowed to correctly process without signs of contamination all FFPE of the study. The histopathology evaluation of the cases assured the presence of the targeted tissue, identified the presence of other tissues that could disturb the molecular diagnosis and allowed the assessment of tissue quality.

Evaluating instruments for quality: testing convergent validity of the consumer emergency care satisfaction scale.

PubMed

Davis, Barbara A; Kiesel, Cynthia K; McFarland, Julie; Collard, Adressa; Coston, Kyle; Keeton, Ada

2005-01-01

Having reliable and valid instruments is a necessity for nurses and others measuring concepts such as patient satisfaction. The purpose of this article is to describe the use of convergence to test the construct validity of the Davis Consumer Emergency Care Satisfaction Scale (CECSS). Results indicate convergence of the CECSS with the Risser Patient Satisfaction Scale and 2 single-item visual analogue scales, therefore supporting construct validity. Persons measuring patient satisfaction with nurse behaviors in the emergency department can confidently use the CECSS.

Geriatric Patient Safety Indicators Based on Linked Administrative Health Data to Assess Anticoagulant-Related Thromboembolic and Hemorrhagic Adverse Events in Older Inpatients: A Study Proposal

PubMed Central

Quantin, Catherine; Reich, Oliver; Tuppin, Philippe; Fagot-Campagna, Anne; Paccaud, Fred; Peytremann-Bridevaux, Isabelle; Burnand, Bernard

2017-01-01

Background Frail older people with multiple interacting conditions, polypharmacy, and complex care needs are particularly exposed to health care-related adverse events. Among these, anticoagulant-related thromboembolic and hemorrhagic events are particularly frequent and serious in older inpatients. The growing use of anticoagulants in this population and their substantial risk of toxicity and inefficacy have therefore become an important patient safety and public health concern worldwide. Anticoagulant-related adverse events and the quality of anticoagulation management should thus be routinely assessed to improve patient safety in vulnerable older inpatients. Objective This project aims to develop and validate a set of outcome and process indicators based on linked administrative health data (ie, insurance claims data linked to hospital discharge data) assessing older inpatient safety related to anticoagulation in both Switzerland and France, and enabling comparisons across time and among hospitals, health territories, and countries. Geriatric patient safety indicators (GPSIs) will assess anticoagulant-related adverse events. Geriatric quality indicators (GQIs) will evaluate the management of anticoagulants for the prevention and treatment of arterial or venous thromboembolism in older inpatients. Methods GPSIs will measure cumulative incidences of thromboembolic and bleeding adverse events based on hospital discharge data linked to insurance claims data. Using linked administrative health data will improve GPSI risk adjustment on patients’ conditions that are present at admission and will capture in-hospital and postdischarge adverse events. GQIs will estimate the proportion of index hospital stays resulting in recommended anticoagulation at discharge and up to various time frames based on the same electronic health data. The GPSI and GQI development and validation process will comprise 6 stages: (1) selection and specification of candidate indicators, (2) definition of administrative data-based algorithms, (3) empirical measurement of indicators using linked administrative health data, (4) validation of indicators, (5) analyses of geographic and temporal variations for reliable and valid indicators, and (6) data visualization. Results Study populations will consist of 166,670 Swiss and 5,902,037 French residents aged 65 years and older admitted to an acute care hospital at least once during the 2012-2014 period and insured for at least 1 year before admission and 1 year after discharge. We will extract Swiss data from the Helsana Group data warehouse and French data from the national health insurance information system (SNIIR-AM). The study has been approved by Swiss and French ethics committees and regulatory organizations for data protection. Conclusions Validated GPSIs and GQIs should help support and drive quality and safety improvement in older inpatients, inform health care stakeholders, and enable international comparisons. We discuss several limitations relating to the representativeness of study populations, accuracy of administrative health data, methods used for GPSI criterion validity assessment, and potential confounding bias in comparisons based on GQIs, and we address these limitations to strengthen study feasibility and validity. PMID:28495660

Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel

PubMed Central

Boulkedid, Rym; Sibony, Olivier; Goffinet, François; Fauconnier, Arnaud; Branger, Bernard; Alberti, Corinne

2013-01-01

Objective Measuring the quality of inpatient obstetrical care using quality indicators is becoming increasingly important for both patients and healthcare providers. However, there is no consensus about which measures are optimal. We describe a modified Delphi method to identify a set of indicators for continuously monitoring the quality of maternity care by healthcare professionals. Methodology and Main Findings An international French-speaking multidisciplinary panel comprising 22 obstetricians-gynaecologists, 12 midwives, and 1 paediatrician assessed potential indicators extracted from a medical literature search, using a two-round Delphi procedure followed by a physical meeting. Each panellist rated each indicator based on validity and feasibility. In the first round, 35 panellists from 5 countries and 20 maternity units evaluated 26 indicators including 15 related to the management of the overall population of pregnant women, 3 to the management of women followed from the first trimester of pregnancy, 2 to the management of low-risk pregnant women, and 6 to the management of neonates. 25 quality indicators were kept for next step. In the second round, 27 (27/35: 77%) panellists selected 17 indicators; the remaining 8 indicators were discussed during a physical meeting. The final set comprised 18 indicators. Conclusion A multidisciplinary panel selected indicators that reflect the quality of obstetrical care. This set of indicators could be used to assess and monitor obstetrical care, with the goal of improving the quality of care in maternity units. PMID:23577143

Quality Assessment in Oncology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Albert, Jeffrey M.; Das, Prajnan, E-mail: prajdas@mdanderson.org

2012-07-01

The movement to improve healthcare quality has led to a need for carefully designed quality indicators that accurately reflect the quality of care. Many different measures have been proposed and continue to be developed by governmental agencies and accrediting bodies. However, given the inherent differences in the delivery of care among medical specialties, the same indicators will not be valid across all of them. Specifically, oncology is a field in which it can be difficult to develop quality indicators, because the effectiveness of an oncologic intervention is often not immediately apparent, and the multidisciplinary nature of the field necessarily involvesmore » many different specialties. Existing and emerging comparative effectiveness data are helping to guide evidence-based practice, and the increasing availability of these data provides the opportunity to identify key structure and process measures that predict for quality outcomes. The increasing emphasis on quality and efficiency will continue to compel the medical profession to identify appropriate quality measures to facilitate quality improvement efforts and to guide accreditation, credentialing, and reimbursement. Given the wide-reaching implications of quality metrics, it is essential that they be developed and implemented with scientific rigor. The aims of the present report were to review the current state of quality assessment in oncology, identify existing indicators with the best evidence to support their implementation, and propose a framework for identifying and refining measures most indicative of true quality in oncologic care.« less

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

[Quality management in oncology supported by clinical cancer registries].

PubMed

Klinkhammer-Schalke, Monika; Gerken, Michael; Barlag, Hagen; Tillack, Anett

2015-01-01

Efforts in nationwide quality management for oncology have so far failed to comprehensively document all levels of care. New organizational structures such as population-based clinical cancer registries or certified organ cancer centers were supposed to solve this problem more sufficiently, but they have to be accompanied by valid trans-sectoral documentation and evaluation of clinical data. To measure feasibility and qualitative effectiveness of guideline implementation we approached this problem with a nationwide investigation from 2000 to 2011. The rate of neoadjuvant radio/chemotherapy in stage UICC II/III rectum cancer, cut-off point 80% for separating good from insufficient quality, was used as a quality indicator. The nationwide analysis indicates an increase from 45% to 70%, but only with the implementation strategy of CME. The combination of new structures, evidence-based quality indicators, organ cancer center and clinical cancer registries has shown good feasibility and seems promising. Copyright © 2015. Published by Elsevier GmbH.

Validation of alternative indicators of social support in perinatal outcomes research using quality of the partner relationship.

PubMed

Kruse, Julie A; Low, Lisa Kane; Seng, Julia S

2013-07-01

To test alternatives to the current research and clinical practice of assuming that married or partnered status is a proxy for positive social support. Having a partner is assumed to relate to better health status via the intermediary process of social support. However, women's health research indicates that having a partner is not always associated with positive social support. An exploratory post hoc analysis focused on posttraumatic stress and childbearing was conducted using a large perinatal database from 2005-2009. To operationalize partner relationship, four variables were analysed: partner ('yes' or 'no'), intimate partner violence ('yes' or 'no'), the combination of those two factors, and the woman's appraisal of the quality of her partner relationship via a single item. Construct validity of these four alternative variables was assessed in relation to appraisal of the partner's social support in labour and the postpartum using linear regression standardized betas and adjusted R-squares. Predictive validity was assessed using unadjusted and adjusted linear regression modelling. Four groups were compared. Married, abused women differed most from married, not abused women in relation to the social support, and depression outcomes used for validity checks. The variable representing the women's appraisals of their partner relationships accounts for the most variance in predicting depression scores. Our results support the validity of operationalizing the impact of the partner relationship on outcomes using a combination of partnered status and abuse status or using a subjective rating of quality of the partner relationship. © 2012 Blackwell Publishing Ltd.

Application of process mining to assess the data quality of routinely collected time-based performance data sourced from electronic health records by validating process conformance.

PubMed

Perimal-Lewis, Lua; Teubner, David; Hakendorf, Paul; Horwood, Chris

2016-12-01

Effective and accurate use of routinely collected health data to produce Key Performance Indicator reporting is dependent on the underlying data quality. In this research, Process Mining methodology and tools were leveraged to assess the data quality of time-based Emergency Department data sourced from electronic health records. This research was done working closely with the domain experts to validate the process models. The hospital patient journey model was used to assess flow abnormalities which resulted from incorrect timestamp data used in time-based performance metrics. The research demonstrated process mining as a feasible methodology to assess data quality of time-based hospital performance metrics. The insight gained from this research enabled appropriate corrective actions to be put in place to address the data quality issues. © The Author(s) 2015.

Cultural adaptation and validation of the "Kidney Disease and Quality of Life--Short Form (KDQOL-SF™) version 1.3" questionnaire in Egypt.

PubMed

Abd ElHafeez, Samar; Sallam, Sunny A; Gad, Zahira M; Zoccali, Carmine; Torino, Claudia; Tripepi, Giovanni; ElWakil, Hala S; Awad, Noha M

2012-12-13

Health Related Quality of Life (HRQOL) instruments need disease and country specific validation. In Arab countries, there is no specific validated questionnaire for assessment of HRQOL in chronic kidney disease (CKD) patients. The aim of this study was to present an Arabic translation, adaptation, and the subsequent validation of the kidney disease quality of life-short form (KDQOL-SFTM) version 1.3 questionnaire in a representative series of Egyptian CKD patients. KDQOL-SFTM version 1.3 was translated into Arabic by two independent translators, and then subsequently translated back into English. After translation disparities were reconciled, the final Arabic questionnaire was tested by interviewing 100 pre-dialysis CKD (stage 1-4) patients randomly selected from outpatients attending the Nephrology clinic at the Main Alexandria University Hospital. Test re-test reliability was performed, with a subsample of 50 consecutive CKD patients, by two interviews 7 days apart and internal consistency estimated by Cronbach's α. Discriminant, concept, and construct validity were assessed. All items of SF-36 met the criterion for internal consistency and were reproducible. Of the 10 kidney disease targeted scales, only three had Cronbach's α <0.7: quality of social interaction (0.23), work status (0.28), and cognitive function (0.60). All disease specific scales were reproducible. Results from discriminant validity showed that the study questionnaire could discriminate between patients' subgroups. As for concept validity, the correlation between all domains of the questionnaire with overall health ratewas significant for all domains except for the work status, sexual function, emotional wellbeing, and role emotional. Furthermore, the correlation between the disease specific domains and the two composite summaries of SF-36 (physical and mental composite summaries) was significant for all domains except for sexual function with mental composite summary. Construct validity was indicated by the observation that the majority of the domains of the kidney disease targeted scale of KDQOL-SFTM 1.3 were significantly inter-correlated. Finally, principal component analysis of the kidney disease targeted scale indicated that this part of the questionnaire could be summarized into 10 factors that together explained 70.9% of the variance. The results suggest that this Arabic version of the KDQOL-SFTM 1.3 questionnaire is a valid and reliable tool for use in Egyptian patients with CKD.

Emergency Medicine and Critical Care Blogs and Podcasts: Establishing an International Consensus on Quality.

PubMed

Thoma, Brent; Chan, Teresa M; Paterson, Quinten S; Milne, W Kenneth; Sanders, Jason L; Lin, Michelle

2015-10-01

This study identified the most important quality indicators for online educational resources such as blogs and podcasts. A modified Delphi process that included 2 iterative surveys was used to build expert consensus on a previously defined list of 151 quality indicators divided into 3 themes: credibility, content, and design. Aggregate social media indicators were used to identify an expert population of editors from a defined list of emergency medicine and critical care blogs and podcasts. Survey 1 consisted of the quality indicators and a 7-point Likert scale. The mean score for each quality indicator was included in survey 2, which asked participants whether to "include" or "not include" each quality indicator. The cut point for consensus was defined at greater than 70% "include." Eighty-three percent (20/24) of bloggers and 90.9% (20/22) of podcasters completed survey 1 and 90% (18/20) of bloggers and podcasters completed survey 2. The 70% inclusion criteria were met by 44 and 80 quality indicators for bloggers and podcasters, respectively. Post hoc, a 90% cutoff was used to identify a list of 14 and 26 quality indicators for bloggers and podcasters, respectively. The relative importance of quality indicators for emergency medicine blogs and podcasts was determined. This will be helpful for resource producers trying to improve their blogs or podcasts and for learners, educators, and academic leaders assessing their quality. These results will inform broader validation studies and attempts to develop user-friendly assessment instruments for these resources. Copyright © 2015 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.

Strategies for soil quality assessment using VNIR gyperspectral spectroscopy in a western Kenya Chronosequence

USGS Publications Warehouse

Kinoshita, Rintaro; Moebius-Clune, Bianca N.; van Es, Harold M.; Hively, W. Dean; Bilgilis, A. Volkan

2012-01-01

Visible and near-infrared reflectance spectroscopy (VNIRS) is a rapid and nondestructive method that can predict multiple soil properties simultaneously, but its application in multidimensional soil quality (SQ) assessment in the tropics still needs to be further assessed. In this study, VNIRS (350–2500 nm) was employed to analyze 227 air-dried soil samples of Ultisols from a soil chronosequence in western Kenya and assess 16 SQ indicators. Partial least squares regression (PLSR) was validated using the full-site cross-validation method by grouping samples from each farm or forest site. Most suitable models successfully predicted SQ indicators (R2 ≥ 0.80; ratio of performance to deviation [RPD] ≥ 2.00) including soil organic matter (OMLOI), active C, Ca, cation exchange capacity (CEC), and clay. Moderately-well predicted indicators (0.50 ≤ R2 pwp), and field capacity (Θfc). Poorly predicted indicators (R2 < 0.50; RPD < 1.40) were EC, S, P, available water capacity (AWC), K, Zn, and penetration resistance. Combining VNIRS with selected field- and laboratory-measured SQ indicator values increased predictability. Furthermore, VNIRS showed moderate to substantial agreement in predicting interpretive SQ scores and a composite soil quality index (CSQI) especially when combined with directly measured SQ indicator values. In conclusion, VNIRS has good potential for low cost, rapid assessment of physical and biological SQ indicators but conventional soil chemical tests may need to be retained to provide comprehensive SQ assessments.

The Consumer Quality Index in an accident and emergency department: internal consistency, validity and discriminative capacity.

PubMed

Bos, Nanne; Sturms, Leontien M; Stellato, Rebecca K; Schrijvers, Augustinus J P; van Stel, Henk F

2015-10-01

Patients' experiences are an indicator of health-care performance in the accident and emergency department (A&E). The Consumer Quality Index for the Accident and Emergency department (CQI A&E), a questionnaire to assess the quality of care as experienced by patients, was investigated. The internal consistency, construct validity and discriminative capacity of the questionnaire were examined. In the Netherlands, twenty-one A&Es participated in a cross-sectional survey, covering 4883 patients. The questionnaire consisted of 78 questions. Principal components analysis determined underlying domains. Internal consistency was determined by Cronbach's alpha coefficients, construct validity by Pearson's correlation coefficients and the discriminative capacity by intraclass correlation coefficients and reliability of A&E-level mean scores (G-coefficient). Seven quality domains emerged from the principal components analysis: information before treatment, timeliness, attitude of health-care professionals, professionalism of received care, information during treatment, environment and facilities, and discharge management. Domains were internally consistent (range: 0.67-0.84). Five domains and the 'global quality rating' had the capacity to discriminate among A&Es (significant intraclass correlation coefficient). Four domains and the 'global quality rating' were close to or above the threshold for reliably demonstrating differences among A&Es. The patients' experiences score on the domain timeliness showed the largest range between the worst- and best-performing A&E. The CQI A&E is a validated survey to measure health-care performance in the A&E from patients' perspective. Five domains regarding quality of care aspects and the 'global quality rating' had the capacity to discriminate among A&Es. © 2013 John Wiley & Sons Ltd.

Key performance indicators to benchmark hospital information systems - a delphi study.

PubMed

Hübner-Bloder, G; Ammenwerth, E

2009-01-01

To identify the key performance indicators for hospital information systems (HIS) that can be used for HIS benchmarking. A Delphi survey with one qualitative and two quantitative rounds. Forty-four HIS experts from health care IT practice and academia participated in all three rounds. Seventy-seven performance indicators were identified and organized into eight categories: technical quality, software quality, architecture and interface quality, IT vendor quality, IT support and IT department quality, workflow support quality, IT outcome quality, and IT costs. The highest ranked indicators are related to clinical workflow support and user satisfaction. Isolated technical indicators or cost indicators were not seen as useful. The experts favored an interdisciplinary group of all the stakeholders, led by hospital management, to conduct the HIS benchmarking. They proposed benchmarking activities both in regular (annual) intervals as well as at defined events (for example after IT introduction). Most of the experts stated that in their institutions no HIS benchmarking activities are being performed at the moment. In the context of IT governance, IT benchmarking is gaining importance in the healthcare area. The found indicators reflect the view of health care IT professionals and researchers. Research is needed to further validate and operationalize key performance indicators, to provide an IT benchmarking framework, and to provide open repositories for a comparison of the HIS benchmarks of different hospitals.

A measure of satisfaction with food-related life.

PubMed

Grunert, Klaus G; Dean, Moira; Raats, Monique M; Nielsen, Niels Asger; Lumbers, Margaret

2007-09-01

A measure of satisfaction with food-related life is developed and tested in three studies in eight European countries. Five items are retained from an original pool of seven; these items exhibit good reliability as measured by Cronbach's alpha, good temporal stability, convergent validity with two related measures, and construct validity as indicated by relationships with other indicators of quality of life, including the Satisfaction With Life and the SF-8 scales. It is concluded that this scale will be useful in studies trying to identify factors contributing to satisfaction with food-related life.

A framework to assess management performance in district health systems: a qualitative and quantitative case study in Iran.

PubMed

Tabrizi, Jafar Sadegh; Gholipour, Kamal; Iezadi, Shabnam; Farahbakhsh, Mostafa; Ghiasi, Akbar

2018-01-01

The aim was to design a district health management performance framework for Iran's healthcare system. The mixed-method study was conducted between September 2015 and May 2016 in Tabriz, Iran. In this study, the indicators of district health management performance were obtained by analyzing the 45 semi-structured surveys of experts in the public health system. Content validity of performance indicators which were generated in qualitative part were reviewed and confirmed based on content validity index (CVI). Also content validity ratio (CVR) was calculated using data acquired from a survey of 21 experts in quantitative part. The result of this study indicated that, initially, 81 indicators were considered in framework of district health management performance and, at the end, 53 indicators were validated and confirmed. These indicators were classified in 11 categories which include: human resources and organizational creativity, management and leadership, rules and ethics, planning and evaluation, district managing, health resources management and economics, community participation, quality improvement, research in health system, health information management, epidemiology and situation analysis. The designed framework model can be used to assess the district health management and facilitates performance improvement at the district level.

The Healthy Eating Index-2010 is a valid and reliable measure of diet quality according to the 2010 Dietary Guidelines for Americans.

PubMed

Guenther, Patricia M; Kirkpatrick, Sharon I; Reedy, Jill; Krebs-Smith, Susan M; Buckman, Dennis W; Dodd, Kevin W; Casavale, Kellie O; Carroll, Raymond J

2014-03-01

The Healthy Eating Index (HEI), a measure of diet quality, was updated to reflect the 2010 Dietary Guidelines for Americans and the accompanying USDA Food Patterns. To assess the validity and reliability of the HEI-2010, exemplary menus were scored and 2 24-h dietary recalls from individuals aged ≥2 y from the 2003-2004 NHANES were used to estimate multivariate usual intake distributions and assess whether the HEI-2010 1) has a distribution wide enough to detect meaningful differences in diet quality among individuals, 2) distinguishes between groups with known differences in diet quality by using t tests, 3) measures diet quality independently of energy intake by using Pearson correlation coefficients, 4) has >1 underlying dimension by using principal components analysis (PCA), and 5) is internally consistent by calculating Cronbach's coefficient α. HEI-2010 scores were at or near the maximum levels for the exemplary menus. The distribution of scores among the population was wide (5th percentile = 31.7; 95th percentile = 70.4). As predicted, men's diet quality (mean HEI-2010 total score = 49.8) was poorer than women's (52.7), younger adults' diet quality (45.4) was poorer than older adults' (56.1), and smokers' diet quality (45.7) was poorer than nonsmokers' (53.3) (P < 0.01). Low correlations with energy were observed for HEI-2010 total and component scores (|r| ≤ 0.21). Cronbach's coefficient α was 0.68, supporting the reliability of the HEI-2010 total score as an indicator of overall diet quality. Nonetheless, PCA indicated multiple underlying dimensions, highlighting the fact that the component scores are equally as important as the total. A comparable reevaluation of the HEI-2005 yielded similar results. This study supports the validity and the reliability of both versions of the HEI.

The SCALE Verified, Archived Library of Inputs and Data - VALID

DOE Office of Scientific and Technical Information (OSTI.GOV)

Marshall, William BJ J; Rearden, Bradley T

The Verified, Archived Library of Inputs and Data (VALID) at ORNL contains high quality, independently reviewed models and results that improve confidence in analysis. VALID is developed and maintained according to a procedure of the SCALE quality assurance (QA) plan. This paper reviews the origins of the procedure and its intended purpose, the philosophy of the procedure, some highlights of its implementation, and the future of the procedure and associated VALID library. The original focus of the procedure was the generation of high-quality models that could be archived at ORNL and applied to many studies. The review process associated withmore » model generation minimized the chances of errors in these archived models. Subsequently, the scope of the library and procedure was expanded to provide high quality, reviewed sensitivity data files for deployment through the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). Sensitivity data files for approximately 400 such models are currently available. The VALID procedure and library continue fulfilling these multiple roles. The VALID procedure is based on the quality assurance principles of ISO 9001 and nuclear safety analysis. Some of these key concepts include: independent generation and review of information, generation and review by qualified individuals, use of appropriate references for design data and documentation, and retrievability of the models, results, and documentation associated with entries in the library. Some highlights of the detailed procedure are discussed to provide background on its implementation and to indicate limitations of data extracted from VALID for use by the broader community. Specifically, external users of data generated within VALID must take responsibility for ensuring that the files are used within the QA framework of their organization and that use is appropriate. The future plans for the VALID library include expansion to include additional experiments from the IHECSBE, to include experiments from areas beyond criticality safety, such as reactor physics and shielding, and to include application models. In the future, external SCALE users may also obtain qualification under the VALID procedure and be involved in expanding the library. The VALID library provides a pathway for the criticality safety community to leverage modeling and analysis expertise at ORNL.« less

Confirmatory Factor Analysis of a Family Quality of Life Scale for Taiwanese Families of Children With Intellectual Disability/Developmental Delay.

PubMed

Chiu, Chun-Yu; Seo, Hyojeong; Turnbull, Ann P; Summers, Jean Ann

2017-04-01

The Beach Center Family Quality of Life Scale is an internationally validated instrument for measuring family outcomes. To revise the scale for better alignment with the Family Quality of Life theory, the authors excluded non-outcome items in this revision. In this study, we examined reliability and validity of the revised scale (i.e., the FQoL Scale-21) and its scores for Taiwanese families of children and youth with intellectual disability and developmental delay (age 0-18). Results from 400 Taiwanese respondents suggested that the FQoL Scale-21 has the potential to be used as an indicator of positive outcomes in intervention evaluation, policy making, and service delivery.

Words that describe chronic musculoskeletal pain: implications for assessing pain quality across cultures.

PubMed

Sharma, Saurab; Pathak, Anupa; Jensen, Mark P

2016-01-01

People from different cultures who speak different languages may experience pain differently. This possible variability has important implications for evaluating the validity of pain quality measures that are directly translated into different languages without cultural adaptations. The aim of this study was to evaluate the impact of language and culture on the validity of pain quality measures by comparing the words that individuals with chronic pain from Nepal use to describe their pain with those used by patients from the USA. A total of 101 individuals with chronic musculoskeletal pain in Nepal were asked to describe their pain. The rates of the different pain descriptor domains and phrases used by the Nepali sample were then compared to the published rates of descriptors used by patients from the USA. The content validity of commonly used measures for assessing pain quality was then evaluated. While there was some similarity between patients from Nepal and the USA in how they describe pain, there were also important differences, especially in how pain quality was described. For example, many patients from Nepal used metaphors to describe their pain. Also, the patients from Nepal often used a category of pain descriptor - which describes a physical state - not used by patients from the USA. Only the original McGill Pain Questionnaire was found to have content validity for assessing pain quality in patients from Nepal, although other existing pain quality measures could be adapted to be content valid by adding one or two additional descriptors, depending on the measure in question. The findings indicate that direct translations of measures that are developed using samples of patients from one country or culture are not necessarily content valid for use in other countries or cultures; some adaptations may be required in order for such measures to be most useful in new language and culture.

Development and Validation of a Measure of Quality of Life for the Young Elderly in Sri Lanka.

PubMed

de Silva, Sudirikku Hennadige Padmal; Jayasuriya, Anura Rohan; Rajapaksa, Lalini Chandika; de Silva, Ambepitiyawaduge Pubudu; Barraclough, Simon

2016-01-01

Sri Lanka has one of the fastest aging populations in the world. Measurement of quality of life (QoL) in the elderly needs instruments developed that encompass the sociocultural settings. An instrument was developed to measure QoL in the young elderly in Sri Lanka (QLI-YES), using accepted methods to generate and reduce items. The measure was validated using a community sample. Construct, criterion and predictive validity and reliability were tested. A first-order model of 24 items with 6 domains was found to have good fit indices (CMIN/df = 1.567, RMR = 0.05, CFI = 0.95, and RMSEA = 0.053). Both criterion and predictive validity were demonstrated. Good internal consistency reliability (Cronbach's α = 0.93) was shown. The development of the QLI-YES using a societal perspective relevant to the social and cultural beliefs has resulted in a robust and valid instrument to measure QoL for the young elderly in Sri Lanka. © 2015 APJPH.

Development and Validation of a Measure of Quality of Life for the Young Elderly in Sri Lanka

PubMed Central

de Silva, Sudirikku Hennadige Padmal; Jayasuriya, Anura Rohan; Rajapaksa, Lalini Chandika; de Silva, Ambepitiyawaduge Pubudu; Barraclough, Simon

2016-01-01

Sri Lanka has one of the fastest aging populations in the world. Measurement of quality of life (QoL) in the elderly needs instruments developed that encompass the sociocultural settings. An instrument was developed to measure QoL in the young elderly in Sri Lanka (QLI-YES), using accepted methods to generate and reduce items. The measure was validated using a community sample. Construct, criterion and predictive validity and reliability were tested. A first-order model of 24 items with 6 domains was found to have good fit indices (CMIN/df = 1.567, RMR = 0.05, CFI = 0.95, and RMSEA = 0.053). Both criterion and predictive validity were demonstrated. Good internal consistency reliability (Cronbach’s α = 0.93) was shown. The development of the QLI-YES using a societal perspective relevant to the social and cultural beliefs has resulted in a robust and valid instrument to measure QoL for the young elderly in Sri Lanka. PMID:26712893

Development and validation of the Child Oral Health Impact Profile - Preschool version.

PubMed

Ruff, R R; Sischo, L; Chinn, C H; Broder, H L

2017-09-01

The Child Oral Health Impact Profile (COHIP) is a validated instrument created to measure the oral health-related quality of life of school-aged children. The purpose of this study was to develop and validate a preschool version of the COHIP (COHIP-PS) for children aged 2-5. The COHIP-PS was developed and validated using a multi-stage process consisting of item selection, face validity testing, item impact testing, reliability and validity testing, and factor analysis. A cross-sectional convenience sample of caregivers having children 2-5 years old from four groups completed item clarity and impact forms. Groups were recruited from pediatric health clinics or preschools/daycare centers, speech clinics, dental clinics, or cleft/craniofacial centers. Participants had a variety of oral health-related conditions, including caries, congenital orofacial anomalies, and speech/language deficiencies such as articulation and language disorders. COHIP-PS. The COHIP-PS was found to have acceptable internal validity (a = 0.71) and high test-retest reliability (0.87), though internal validity was below the accepted threshold for the community sample. While discriminant validity results indicated significant differences across study groups, the overall magnitude of differences was modest. Results from confirmatory factor analyses support the use of a four-factor model consisting of 11 items across oral health, functional well-being, social-emotional well-being, and self-image domains. Quality of life is an integral factor in understanding and assessing children's well-being. The COHIP-PS is a validated oral health-related quality of life measure for preschool children with cleft or other oral conditions. Copyright© 2017 Dennis Barber Ltd.

[Development of quality of care indicators to support chronic disease management].

PubMed

Beaulieu, Marie-dominique; Pomey, Marie-pascale; Del Grande, Claudio; Côté, Brigitte; Tremblay, Éric; Ghorbel, Monia; Hua, Phuong

2015-01-01

This article presents the results of a project conducted by the Institut national d'excellence en santé et en services sociaux of Québec to develop quality of care indicators for the management of six chronic illnesses. Indicators were identified through literature searches and analysis of clinical practice guidelines (CPGs). Interdisciplinary expert panels assessed their validity and the strength of the evidence on which they were based. Representatives of patients (N = 19) and professionals (N = 29) were consulted on their relevance and acceptability. Indicators were categorized according to the Chronic Care Model (CCM). A total of 164 indicators were developed, 126 specific to the illnesses under study and 38 on processes and outcomes generic to the CCM. There was convergence between patients and professionals on the relevance of a majority of indicators. Professionals expressed concerns on the indicators measured by means of patient surveys that they considered to be too subjective. The importance given to CPGs as the main source of indicators resulted in a great number of indicators of the technical quality ofcare. Using the CCM contributed to a broader perspective of quality. The consultation process identified some of the concerns of professionals about indicator measurement, thusguidingfuture implementation initiatives.

Near-Infrared Spectroscopy Assay of Key Quality-Indicative Ingredients of Tongkang Tablets.

PubMed

Pan, Wenjie; Ma, Jinfang; Xiao, Xue; Huang, Zhengwei; Zhou, Huanbin; Ge, Fahuan; Pan, Xin

2017-04-01

The objective of this paper is to develop an easy and fast near-infrared spectroscopy (NIRS) assay for the four key quality-indicative active ingredients of Tongkang tablets by comparing the true content of the active ingredients measured by high performance liquid chromatography (HPLC) and the NIRS data. The HPLC values for the active ingredients content of Cimicifuga glycoside, calycosin glucoside, 5-O-methylvisamminol and hesperidin in Tongkang tablets were set as reference values. The NIRS raw spectra of Tongkang tablets were processed using first-order convolution method. The iterative optimization method was chosen to optimize the band for Cimicifuga glycoside and 5-O-methylvisamminol, and correlation coefficient method was used to determine the optimal band of calycosin glucoside and hesperidin. A near-infrared quantitative calibration model was established for each quality-indicative ingredient by partial least-squares method on the basis of the contents detected by HPLC and the obtained NIRS spectra. The correlation coefficient R 2 values of the four models of Cimicifuga glycoside, calycosin glucoside, 5-O-methylvisamminol and hesperidin were 0.9025, 0.8582, 0.9250, and 0.9325, respectively. It was demonstrated that the accuracy of the validation values was approximately 90% by comparison of the predicted results from NIRS models and the HPLC true values, which suggested that NIRS assay was successfully established and validated. It was expected that the quantitative analysis models of the four indicative ingredients could be used to rapidly perform quality control in industrial production of Tongkang tablets.

Validation of the H-SAF precipitation product H03 over Greece using rain gauge data

NASA Astrophysics Data System (ADS)

Feidas, H.; Porcu, F.; Puca, S.; Rinollo, A.; Lagouvardos, C.; Kotroni, V.

2018-01-01

This paper presents an extensive validation of the combined infrared/microwave H-SAF (EUMETSAT Satellite Application Facility on Support to Operational Hydrology and Water Management) precipitation product H03, for a 1-year period, using gauge observations from a relatively dense network of 233 stations over Greece. First, the quality of the interpolated data used to validate the precipitation product is assessed and a quality index is constructed based on parameters such as the density of the station network and the orography. Then, a validation analysis is conducted based on comparisons of satellite (H03) with interpolated rain gauge data to produce continuous and multi-categorical statistics at monthly and annual timescales by taking into account the different geophysical characteristics of the terrain (land, coast, sea, elevation). Finally, the impact of the quality of interpolated data on the validation statistics is examined in terms of different configurations of the interpolation model and the rain gauge network characteristics used in the interpolation. The possibility of using a quality index of the interpolated data as a filter in the validation procedure is also investigated. The continuous validation statistics show yearly root mean squared error (RMSE) and mean absolute error (MAE) corresponding to the 225 and 105 % of the mean rain rate, respectively. Mean error (ME) indicates a slight overall tendency for underestimation of the rain gauge rates, which takes large values for the high rain rates. In general, the H03 algorithm cannot retrieve very well the light (< 1 mm/h) and the convective type (>10 mm/h) precipitation. The poor correlation between satellite and gauge data points to algorithm problems in co-locating precipitation patterns. Seasonal comparison shows that retrieval errors are lower for cold months than in the summer months of the year. The multi-categorical statistics indicate that the H03 algorithm is able to discriminate efficiently the rain from the no rain events although a large number of rain events are missed. The most prominent feature is the very high false alarm ratio (FAR) (more than 70 %), the relatively low probability of detection (POD) (less than 40 %), and the overestimation of the rainy pixels. Although the different geophysical features of the terrain (land, coast, sea, elevation) and the quality of the interpolated data have an effect on the validation statistics, this, in general, is not significant and seems to be more distinct in the categorical than in the continuous statistics.

The Pittsburgh Sleep Quality Index: validation of the Urdu translation.

PubMed

Hashmi, Ali Madeeh; Khawaja, Imran Shuja; Butt, Zeeshan; Umair, Muhammad; Naqvi, Suhaib Haider; Jawad-Ul-Haq

2014-02-01

To translate and validate the Pittsburgh Sleep Quality Index (PSQI), a standardized self-administered questionnaire for the assessment of subjective sleep quality into the Urdu language. Validation study. Mayo Hospital, Lahore, from March to April 2012. The PSQI was translated into Urdu following standard guidelines. The final Urdu version (PSQI-U) was administered to 200 healthy volunteers comprising medical students, nursing staff and doctors. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation of component scores with global score was assessed by calculating Spearman correlation coefficient. Correlation between global PSQI-U scores at baseline with global scores for each PSQI-U and PSQI-E at 4-week interval was evaluated by calculating Spearman correlation coefficient. Moreover, scores on individual items of the scale at baseline were compared with respective scores after 4-week by t-test. One hundred and eighty five (185) participants completed the PSQI-U at baseline. The Cronbach alpha for PSQI-U was 0.56. Scores on individual components of the PSQI-U and composite scores were all highly correlated with each other (all p-values < 0.01). Composite scores for PSQI-U at baseline and PSQI-E at 4-week interval were also highly correlated with each other (Spearman correlation coefficient 0.74, p-value < 0.01) indicating good linguistic interchangeability. Composite scores for PSQI-U at baseline and at 4-week interval were positively correlated with each other (Spearman correlation coefficient 0.70, p < 0.01) indicating good test-retest reliability. The PSQI-U is a valid and reliable instrument for the assessment of sleep quality. It shows good linguistic interchangeability and test-retest reliability in comparison to the original English version when applied to individuals who speak the Urdu language. The PSQI-U can be a tool either for clinical management or research.

European Society of Gynaecologic Oncology Quality Indicators for Advanced Ovarian Cancer Surgery.

PubMed

Querleu, Denis; Planchamp, François; Chiva, Luis; Fotopoulou, Christina; Barton, Desmond; Cibula, David; Aletti, Giovanni; Carinelli, Silvestro; Creutzberg, Carien; Davidson, Ben; Harter, Philip; Lundvall, Lene; Marth, Christian; Morice, Philippe; Rafii, Arash; Ray-Coquard, Isabelle; Rockall, Andrea; Sessa, Cristiana; van der Zee, Ate; Vergote, Ignace; du Bois, Andreas

2016-09-01

The surgical management of advanced ovarian cancer involves complex surgery. Implementation of a quality management program has a major impact on survival. The goal of this work was to develop a list of quality indicators (QIs) for advanced ovarian cancer surgery that can be used to audit and improve the clinical practice. This task has been carried out under the auspices of the European Society of Gynaecologic Oncology (ESGO). Quality indicators were based on scientific evidence and/or expert consensus. A 4-step evaluation process included a systematic literature search for the identification of potential QIs and the documentation of scientific evidence, physical meetings of an ad hoc multidisciplinarity International Development Group, an internal validation of the targets and scoring system, and an external review process involving physicians and patients. Ten structural, process, or outcome indicators were selected. Quality indicators 1 to 3 are related to achievement of complete cytoreduction, caseload in the center, training, and experience of the surgeon. Quality indicators 4 to 6 are related to the overall management, including active participation to clinical research, decision-making process within a structured multidisciplinary team, and preoperative workup. Quality indicator 7 addresses the high value of adequate perioperative management. Quality indicators 8 to 10 highlight the need of recording pertinent information relevant to improvement of quality. An ESGO-approved template for the operative report has been designed. Quality indicators were described using a structured format specifying what the indicator is measuring, measurability specifications, and targets. Each QI was associated with a score, and an assessment form was built. The ESGO quality criteria can be used for self-assessment, for institutional or governmental quality assurance programs, and for the certification of centers. Quality indicators and corresponding targets give practitioners and health administrators a quantitative basis for improving care and organizational processes in the surgical management of advanced ovarian cancer.

A Critical Review of Air Pollution Index Systems in the United States and Canada

ERIC Educational Resources Information Center

Ott, Wayne R.; Thom, Gary C.

1976-01-01

An extensive survey of air pollution indices reveals great diversity in calculation and descriptor categories. This lack of uniformity creates confusion, suggests questionable technical validity, and discourages a national picture. The authors recombined indices currently in use to develop a Standardized Urban Air Quality Index for national use.…

Applying ethological and health indicators to practical animal welfare assessment.

PubMed

Wemelsfelder, F; Mullan, S

2014-04-01

There is a growing effort worldwide to develop objective indicators for animal welfare assessment, which provide information on an animal's quality of life, are scientifically trustworthy, and can readily be used in practice by professionals. Animals are sentient beings capable of positive and negative emotion, and so these indicators should be sensitive not only to their physical health, but also to their experience of the conditions in which they live. This paper provides an outline of ethological research aimed at developing practical welfare assessment protocols. The first section focuses on the development and validation of welfare indicators generally, in terms of their relevance to animal well-being, their interobserver reliability, and the confidence with which the prevalence of described features can be estimated. Challenges in this work include accounting for the ways in which welfare measures may fluctuate over time, and identifying measures suited to monitoring positive welfare states. The second section focuses more specifically on qualitative welfare indicators, which assess the 'whole animal' and describe the expressive qualities of its demeanour (e.g. anxious, content). Such indicators must be validated in the same way as other health and behaviour indicators, with the added challenge of finding appropriate methods of measurement. The potential contribution of qualitative indicators, however, is to disclose an emotional richness in animals that helps to interpret information provided by other indicators, thus enhancing the validity of welfare assessment protocols. In conclusion, the paper emphasises the importance of integrating such different perspectives, showing that new knowledge of animals and new ways of relating to animals are both needed for the successful development of practical welfare assessment tools.

Measuring decision quality: psychometric evaluation of a new instrument for breast cancer surgery

PubMed Central

2012-01-01

Background The purpose of this paper is to examine the acceptability, feasibility, reliability and validity of a new decision quality instrument that assesses the extent to which patients are informed and receive treatments that match their goals. Methods Cross-sectional mail survey of recent breast cancer survivors, providers and healthy controls and a retest survey of survivors. The decision quality instrument includes knowledge questions and a set of goals, and results in two scores: a breast cancer surgery knowledge score and a concordance score, which reflects the percentage of patients who received treatments that match their goals. Hypotheses related to acceptability, feasibility, discriminant validity, content validity, predictive validity and retest reliability of the survey instrument were examined. Results We had responses from 440 eligible patients, 88 providers and 35 healthy controls. The decision quality instrument was feasible to implement in this study, with low missing data. The knowledge score had good retest reliability (intraclass correlation coefficient = 0.70) and discriminated between providers and patients (mean difference 35%, p < 0.001). The majority of providers felt that the knowledge items covered content that was essential for the decision. Five of the 6 treatment goals met targets for content validity. The five goals had moderate to strong retest reliability (0.64 to 0.87). The concordance score was 89%, indicating that a majority had treatments concordant with that predicted by their goals. Patients who had concordant treatment had similar levels of confidence and regret as those who did not. Conclusions The decision quality instrument met the criteria of feasibility, reliability, discriminant and content validity in this sample. Additional research to examine performance of the instrument in prospective studies and more diverse populations is needed. PMID:22681763

Measuring Economic Freedom: Better Without Size of Government.

PubMed

Ott, Jan

2018-01-01

The Heritage Foundation and the Fraser Institute measure economic freedom in nations using indices with ten and five indicators respectively. Eight of the Heritage indicators and four of the Fraser-indicators are about specific types of institutional quality, like rule of law, the protection of property, and the provision of sound money. More of these is considered to denote more economic freedom. Both indices also involve indicators of 'big government', or levels of government activities. More of that is seen to denote less economic freedom. Yet, levels of government spending, consumption, and transfers and subsidies appear to correlate positively with the other indicators related to institutional quality, while this correlation is close to zero for the level of taxation as a percentage of GDP. Using government spending, consumption transfers and subsidies as positive indicators is no alternative, because these levels stand for very different government activities, liberal or less liberal. This means that levels of government activities can better be left out as negative or positive indicators. Thus shortened variants of the indices create a better convergent validity in the measurement of economic freedom, and create higher correlations between economic freedom and alternative types of freedom, and between economic freedom and happiness. The higher correlations indicate a better predictive validity, since they are predictable in view of the findings of previous research and theoretical considerations about the relations between types of freedom, and between freedom and happiness.

Nutrient profiling can help identify foods of good nutritional quality for their price: a validation study with linear programming.

PubMed

Maillot, Matthieu; Ferguson, Elaine L; Drewnowski, Adam; Darmon, Nicole

2008-06-01

Nutrient profiling ranks foods based on their nutrient content. They may help identify foods with a good nutritional quality for their price. This hypothesis was tested using diet modeling with linear programming. Analyses were undertaken using food intake data from the nationally representative French INCA (enquête Individuelle et Nationale sur les Consommations Alimentaires) survey and its associated food composition and price database. For each food, a nutrient profile score was defined as the ratio between the previously published nutrient density score (NDS) and the limited nutrient score (LIM); a nutritional quality for price indicator was developed and calculated from the relationship between its NDS:LIM and energy cost (in euro/100 kcal). We developed linear programming models to design diets that fulfilled increasing levels of nutritional constraints at a minimal cost. The median NDS:LIM values of foods selected in modeled diets increased as the levels of nutritional constraints increased (P = 0.005). In addition, the proportion of foods with a good nutritional quality for price indicator was higher (P < 0.0001) among foods selected (81%) than among foods not selected (39%) in modeled diets. This agreement between the linear programming and the nutrient profiling approaches indicates that nutrient profiling can help identify foods of good nutritional quality for their price. Linear programming is a useful tool for testing nutrient profiling systems and validating the concept of nutrient profiling.

Linguistic and psychometric validation of the Malaysian version of Diabetes Quality of Life-Brief Clinical Inventory (DQoL-BCI).

PubMed

Samah, Syamimi; Neoh, Chin Fen; Wong, Yuet Yen; Hassali, Mohamed Azmi; Shafie, Asrul Akmal; Lim, Siong Meng; Ramasamy, Kalavathy; Mat Nasir, Nafiza; Han, Yung Wen; Burroughs, Thomas

2017-11-01

Quality of life (QoL) assessment provides valuable outcome to support clinical decision-making, particularly for patients with chronic diseases that are incurable. A brief, 15-item diabetes-specific tool [i.e. Diabetes Quality of Life-Brief Clinical Inventory (DQoL-BCI)] is known to be developed in English and validated for use in clinical practice. This simplified tool, however, is not readily available for use in the Malaysian setting. To translate the DQoL-BCI into a Malaysian version and to assess its construct validity (factorial validity, convergent validity and discriminant validity), reliability (internal consistency) and floor and ceiling effects among the Malaysian diabetic population. A forward-backward translation, involving professional translators and experts with vast experience in translation of patient reported outcome measures, was conducted. A total of 202 patients with Type 2 diabetes mellitus (T2DM) who fulfilled the inclusion criteria were invited to complete the translated DQoL-BCI. Data were analysed using SPSS for exploratory factor analysis (EFA), convergent and discriminant validity, reliability and test-retest, and AMOS software for confirmatory factor analysis (CFA). Findings from EFA indicated that the 4-factor structure of the Malaysian version of DQoL-BCI was optimal and explained 50.9% of the variance; CFA confirmed the 4-factor model fit. There was negative, moderate correlation between the scores of DQoL-BCI (Malaysian version) and EQ-5D-3L utility score (r = -0.329, p = 0.003). Patients with higher glycated haemoglobin levels (p = 0.008), diabetes macrovascular (p = 0.017) and microvascular (p = 0.013) complications reported poorer QoL. Cronbach's alpha coefficient and intraclass coefficient correlations (range) obtained were 0.703 and 0.86 (0.734-0.934), indicating good reliability and stability of the translated DQoL-BCI. This study had validated the linguistic and psychometric properties of DQoL-BCI (Malaysian version), thus providing a valid and reliable brief tool for assessing the QoL of Malaysian T2DM patients. Copyright © 2016 Elsevier Inc. All rights reserved.

The psychometric properties of the WHOQOL-BREF in Japanese couples

PubMed Central

Sun, Yi; Sugawara, Masumi; Matsumoto, Satoko; Sakai, Atsushi; Takaoka, Junko; Goto, Noriko

2015-01-01

This study investigated the psychometric properties of the Japanese version of the WHOQOL-BREF among 10,693 community-based married Japanese men and women (4376 couples) who were either expecting or raising a child. Analyses of item-response distributions, internal consistency, criterion validity, and discriminant validity indicated that the scale had acceptable reliability and performed well in preliminary tests of validity. Furthermore, dyadic confirmatory factor analysis revealed that the theoretical factor structure was valid and similar across partners, suggesting that men and women define and value quality of life in a similar way. PMID:28070365

Dutch Musculoskeletal Questionnaire: description and basic qualities.

PubMed

Hildebrandt, V H; Bongers, P M; van Dijk, F J; Kemper, H C; Dul, J

2001-10-10

A questionnaire ('Dutch Musculoskeletal Questionnaire', DMQ) for the analysis of musculoskeletal workload and associated potential hazardous working conditions as well as musculoskeletal symptoms in worker populations is described and its qualities are explored using a database of 1575 workers in various occupations who completed the questionnaire. The 63 questions on musculoskeletal workload and associated potentially hazardous working conditions can be categorized into seven indices (force, dynamic and static load, repetitive load, climatic factors, vibration and ergonomic environmental factors). Together with four separate questions on standing, sitting, walking and uncomfortable postures, the indices constitute a brief overview of the main findings on musculoskeletal workload and associated potentially hazardous working conditions. Homogeneity of the indices is satisfactory. The divergent validity of the indices is fair when compared with an index of psychosocial working conditions and discomfort during exposure to physical loads. Worker groups with contrasting musculoskeletal loads can be differentiated on the basis of the indices and other factors. With respect to the concurrent validity, it appears that most indices and factors show significant associations with low back and/or neck-shoulder symptoms. This questionnaire can be used as a simple and quick inventory for occupational health services to identify worker groups in which a more thorough ergonomic analysis is indicated.

Physical activity promotion in Latin American populations: a systematic review on issues of internal and external validity

PubMed Central

2014-01-01

The purpose of this review was to determine the degree to which physical activity interventions for Latin American populations reported on internal and external validity factors using the RE-AIM framework (reach & representativeness, effectiveness, adoption, implementation, maintenance). We systematically identified English (PubMed; EbscoHost) and Spanish (SCIELO; Biblioteca Virtual en Salud) language studies published between 2001 and 2012 that tested physical activity, exercise, or fitness promotion interventions in Latin American populations. Cross-sectional/descriptive studies, conducted in Brazil or Spain, published in Portuguese, not including a physical activity/fitness/exercise outcome, and with one time point assessment were excluded. We reviewed 192 abstracts and identified 46 studies that met the eligibility criteria (34 in English, 12 in Spanish). A validated 21-item RE-AIM abstraction tool was used to determine the quality of reporting across studies (0-7 = low, 8-14 = moderate, and 15-21 = high). The number of indicators reported ranged from 3–14 (mean = 8.1 ± 2.6), with the majority of studies falling in the moderate quality reporting category. English and Spanish language articles did not differ on the number of indicators reported (8.1 vs. 8.3, respectively). However, Spanish articles reported more across reach indicators (62% vs. 43% of indicators), while English articles reported more across effectiveness indicators (69% vs 62%). Across RE-AIM dimensions, indicators for reach (48%), efficacy/effectiveness (67%), and implementation (41%) were reported more often than indicators of adoption (25%) and maintenance (10%). Few studies reported on the representativeness of participants, staff that delivered interventions, or the settings where interventions were adopted. Only 13% of the studies reported on quality of life and/or potential negative outcomes, 20% reported on intervention fidelity, and 11% on cost of implementation. Outcomes measured after six months of intervention, information on continued delivery and institutionalization of interventions, were also seldom reported. Regardless of language of publication, physical activity intervention research for Latin Americans should increase attention to and measurement of external validity and cost factors that are critical in the decision making process in practice settings and can increase the likelihood of translation into community or clinical practice. PMID:24938641

Physical activity promotion in Latin American populations: a systematic review on issues of internal and external validity.

PubMed

Galaviz, Karla I; Harden, Samantha M; Smith, Erin; Blackman, Kacie Ca; Berrey, Leanna M; Mama, Scherezade K; Almeida, Fabio A; Lee, Rebecca E; Estabrooks, Paul A

2014-06-17

The purpose of this review was to determine the degree to which physical activity interventions for Latin American populations reported on internal and external validity factors using the RE-AIM framework (reach & representativeness, effectiveness, adoption, implementation, maintenance). We systematically identified English (PubMed; EbscoHost) and Spanish (SCIELO; Biblioteca Virtual en Salud) language studies published between 2001 and 2012 that tested physical activity, exercise, or fitness promotion interventions in Latin American populations. Cross-sectional/descriptive studies, conducted in Brazil or Spain, published in Portuguese, not including a physical activity/fitness/exercise outcome, and with one time point assessment were excluded. We reviewed 192 abstracts and identified 46 studies that met the eligibility criteria (34 in English, 12 in Spanish). A validated 21-item RE-AIM abstraction tool was used to determine the quality of reporting across studies (0-7 = low, 8-14 = moderate, and 15-21 = high). The number of indicators reported ranged from 3-14 (mean = 8.1 ± 2.6), with the majority of studies falling in the moderate quality reporting category. English and Spanish language articles did not differ on the number of indicators reported (8.1 vs. 8.3, respectively). However, Spanish articles reported more across reach indicators (62% vs. 43% of indicators), while English articles reported more across effectiveness indicators (69% vs 62%). Across RE-AIM dimensions, indicators for reach (48%), efficacy/effectiveness (67%), and implementation (41%) were reported more often than indicators of adoption (25%) and maintenance (10%). Few studies reported on the representativeness of participants, staff that delivered interventions, or the settings where interventions were adopted. Only 13% of the studies reported on quality of life and/or potential negative outcomes, 20% reported on intervention fidelity, and 11% on cost of implementation. Outcomes measured after six months of intervention, information on continued delivery and institutionalization of interventions, were also seldom reported. Regardless of language of publication, physical activity intervention research for Latin Americans should increase attention to and measurement of external validity and cost factors that are critical in the decision making process in practice settings and can increase the likelihood of translation into community or clinical practice.

Work design and management in the manufacturing sector: development and validation of the Work Organisation Assessment Questionnaire.

PubMed

Griffiths, A; Cox, T; Karanika, M; Khan, S; Tomás, J M

2006-10-01

To examine the factor structure, reliability, and validity of a new context-specific questionnaire for the assessment of work and organisational factors. The Work Organisation Assessment Questionnaire (WOAQ) was developed as part of a risk assessment and risk reduction methodology for hazards inherent in the design and management of work in the manufacturing sector. Two studies were conducted. Data were collected from 524 white- and blue-collar employees from a range of manufacturing companies. Exploratory factor analysis was carried out on 28 items that described the most commonly reported failures of work design and management in companies in the manufacturing sector. Concurrent validity data were also collected. A reliability study was conducted with a further 156 employees. Principal component analysis, with varimax rotation, revealed a strong 28-item, five factor structure. The factors were named: quality of relationships with management, reward and recognition, workload, quality of relationships with colleagues, and quality of physical environment. Analyses also revealed a more general summative factor. Results indicated that the questionnaire has good internal consistency and test-retest reliability and validity. Being associated with poor employee health and changes in health related behaviour, the WOAQ factors are possible hazards. It is argued that the strength of those associations offers some estimation of risk. Feedback from the organisations involved indicated that the WOAQ was easy to use and meaningful for them as part of their risk assessment procedures. The studies reported here describe a model of the hazards to employee health and health related behaviour inherent in the design and management of work in the manufacturing sector. It offers an instrument for their assessment. The scales derived which form the WOAQ were shown to be reliable, valid, and meaningful to the user population.

[Integrated Quality Management System (IQMS): a model for improving the quality of reproductive health care in rural Kenya].

PubMed

Herrler, Claudia; Bramesfeld, Anke; Brodowski, Marc; Prytherch, Helen; Marx, Irmgard; Nafula, Maureen; Richter-Aairijoki, Heide; Musyoka, Lucy; Marx, Michael; Szecsenyi, Joachim

2015-01-01

To develop a model aiming to improve the quality of services for reproductive health care in rural Kenya and designed to measure the quality of reproductive health services in such a way that allows these services to identify measures for improving their performance. The Integrated Quality Management System (IQMS) was developed on the basis of a pre-existing and validated model for quality promotion, namely the European Practice Assessment (EPA). The methodology for quality assessment and feedback of assessment results to the service teams was adopted from the EPA model. Quality assessment methodology included data assessment through staff, patient surveys and service visitation. Quality is assessed by indicators, and so indicators had to be developed that were appropriate for assessing reproductive health care in rural Kenya. A search of the Kenyan and international literature was conducted to identify potential indicators. These were then rated for their relevance and clarity by a panel of Kenyan experts. 260 indicators were rated as relevant and assigned to 29 quality dimensions and 5 domains. The implementation of IQMS in ten facilities showed that IQMS is a feasible model for assessing the quality of reproductive health services in rural Kenya. IQMS enables these services to identify quality improvement targets and necessary improvement measures. Both strengths and limitations of IQMS will be discussed. Copyright © 2015. Published by Elsevier GmbH.

[A Methodological Quality Assessment of South Korean Nursing Research using Structural Equation Modeling in South Korea].

PubMed

Kim, Jung-Hee; Shin, Sujin; Park, Jin-Hwa

2015-04-01

The purpose of this study was to evaluate the methodological quality of nursing studies using structural equation modeling in Korea. Databases of KISS, DBPIA, and National Assembly Library up to March 2014 were searched using the MeSH terms 'nursing', 'structure', 'model'. A total of 152 studies were screened. After removal of duplicates and non-relevant titles, 61 papers were read in full. Of the sixty-one articles retrieved, 14 studies were published between 1992 and 2000, 27, between 2001 and 2010, and 20, between 2011 and March 2014. The methodological quality of the review examined varied considerably. The findings of this study suggest that more rigorous research is necessary to address theoretical identification, two indicator rule, distribution of sample, treatment of missing values, mediator effect, discriminant validity, convergent validity, post hoc model modification, equivalent models issues, and alternative models issues should be undergone. Further research with robust consistent methodological study designs from model identification to model respecification is needed to improve the validity of the research.

[Efficiency versus quality in the NHS, in Portugal: methodologies for evaluation].

PubMed

Giraldes, Maria do Rosário

2008-01-01

To proceed to the evaluation of the efficiency and quality in the NHS, based in methodologies of evaluation of management, indicators of benchmarking and indicators of process and outcome. The 1980 and 1990 decades have seen the proliferation of all forms of process indicators as a way to control health services. It is not a coincidence that the increase in managed care has been accompanied by an explosion of process indicators, as it has happened in the health system of the USA. More recently the attention has turned away from measures of performance, which measure the process (what has been done) to those which measure outcomes (what was the result). Quality indicators have been developed in Europe, first to be used in hospitals, but also to be used in primary health care. Conceptually the justification for the introduction of process indicators comes from the principle that their use will reinforce a modification in the quality of the proceedings, which will give origin to better outcomes as well at population level, as resource saving. Outcome indicators compared with process indicators in health care shows that process indicators have the advantage of being more sensitive than outcome indicators to differences in the quality. Optimizing health care quality has the objective of establishing a quantitative relationship between the quality of the health services and cost-effectiveness. To identify quality indicators and benchmarking and to implement plans to measure the quality of health care. In a study made in a group of senior GP, in the UK, with the objective of determining which process indicators better reflect the quality of the services in primary health care services a Delphi method was used. Only seven indicators were chosen by 75% of the respondents: the percentage of eligible patients receiving cervical screening; the percentage of generic prescribing; the percentage of eligible patients receiving childhood immunization; the percentage of eligible patients receiving influenza vaccinations; ability to see GP within 48 hours; percentage prescribing antibacterial drugs; primary care management (diabetes and asthma). The main characteristics of health indicators are: acceptability--The acceptability of the data collected using a measure will depend upon the extent to which the findings are acceptable to both those being assessed and those undertaking the assessment; feasibility--information about the quality of services is often driven by data availability rather than by epidemiological and clinical considerations. Quality measurement cannot be achieved without accurate and consistent information systems; reliability--indicators should be used to compare organisations/practitioners with similar organisations/practitioners; sensitivity to change--quality measures must be capable of detecting changes in quality of care in order to discriminate between and within subjects; validity--there has been little methodological scrutiny of the validity of consensus methods. Outcome indicators are not good performance indicators in health care. Which causes the variation in outcomes between deliverers of primary health care services are the observed differences due to differences in users, due to age, sex, co-morbidity, severity and socio-economic situation. The Medical Outcomes Study, published in 1989, has brought, for the first time, subjective indicators, based in the evaluation of users, as an important outcome indicator. Clinical indicators are those that are more associated with the outcomes. A few studies exist of the effects of management indicators in outcomes. Several indicators, however, reflect norms related with the local of work. The use of a Composite Indicator presents advantages. In England it has been used a Composite Indicator of process indicators in 302 organizations of primary health care, in 2001-2002. This study has used a mathematical model to select the best indicators which allow the evaluation of performance. It has concluded that the use of a Composite Indicator is of easy construction, interpretation, and acceptable and that has validity. Giraldes (2007) has done an evaluation of health centres in a perspective of management and quality of deliver using a Composite Indicator of Efficiency and Quality. It includes the efficiency indicators concerned with the main activities of the health centre, preventive activities, curative activities and drugs, by main pharmaco therapeutic groups, and auxiliary means of diagnosis (analysis, X Ray, ecographies and CAT by user, weighted according to the relevance of the expenditure in total expenditure). The Composite Quality Indicator includes 12 performance and 5 outcome indicators. From the 10 best health centres in an efficiency and quality perspective 3 are from the Porto Sub-Region (Negrelos, Rebordosa and Paredes) and 2 from the Braga Sub-Region (Vila Verde and Vila Nova de Famalicão I), Leiria (Pedrogão Grande and Batalha), and Vila Real (Mesão Frio and Sabrosa), while 1 belongs to the Aveiro Sub-Region (Sever do Vouga). The more efficient health centres are from the Aveiro Sub-Region, followed by Braga, Porto, and Lisboa. Sub-Regions with very similar values. Giraldes (2007) has made an evaluation of the hospital expenditure by user in an efficiency perspective and to evaluate the quality of the health system process indicators and outcome indicators. In an efficiency perspective the concept of technical efficiency has been chosen, and a correction has been made, as well, in what concerns a case-mix index (CMI). The indicators have been calculated by user in what concerns the main hospital activities (the expenditure in inpatient care by treated patient, in day hospital by treated patient, in outpatient care by consultation, etc.) and as well the auxiliary sections of clinic support and the hotel support services. All the indicators have been corrected according to the relevance of its expenditure in total expenditure. In a quality perspective two types of indicators have been considered; process indicators and outcome indicators. Process indicators, as the percentage of surgeries in ambulatory care, the percentage of cesareans in total deliveries and the rate of autopsy. The outcome indicator number of episodes of inpatient care due to surgery infection in total days of inpatient care. Those indicators have been aggregated, by a mean. The Composite Indicator of Efficiency and Quality is the mean of the Composite Indicator of Efficiency and the Composite Indicator of Quality, having this one been converted in inverse base.

First quality score for referral letters in gastroenterology—a validation study

PubMed Central

Eskeland, Sigrun Losada; Brunborg, Cathrine; Seip, Birgitte; Wiencke, Kristine; Hovde, Øistein; Owen, Tanja; Skogestad, Erik; Huppertz-Hauss, Gert; Halvorsen, Fred-Arne; Garborg, Kjetil; Aabakken, Lars; de Lange, Thomas

2016-01-01

Objective To create and validate an objective and reliable score to assess referral quality in gastroenterology. Design An observational multicentre study. Setting and participants 25 gastroenterologists participated in selecting variables for a Thirty Point Score (TPS) for quality assessment of referrals to gastroenterology specialist healthcare for 9 common indications. From May to September 2014, 7 hospitals from the South-Eastern Norway Regional Health Authority participated in collecting and scoring 327 referrals to a gastroenterologist. Main outcome measure Correlation between the TPS and a visual analogue scale (VAS) for referral quality. Results The 327 referrals had an average TPS of 13.2 (range 1–25) and an average VAS of 4.7 (range 0.2–9.5). The reliability of the score was excellent, with an intra-rater intraclass correlation coefficient (ICC) of 0.87 and inter-rater ICC of 0.91. The overall correlation between the TPS and the VAS was moderate (r=0.42), and ranged from fair to substantial for the various indications. Mean agreement was good (ICC=0.47, 95% CI (0.34 to 0.57)), ranging from poor to good. Conclusions The TPS is reliable, objective and shows good agreement with the subjective VAS. The score may be a useful tool for assessing referral quality in gastroenterology, particularly important when evaluating the effect of interventions to improve referral quality. PMID:27855107

Indicators for the automated analysis of drug prescribing quality.

PubMed

Coste, J; Séné, B; Milstein, C; Bouée, S; Venot, A

1998-01-01

Irrational and inconsistent drug prescription has considerable impact on morbidity, mortality, health service utilization, and community burden. However, few studies have addressed the methodology of processing the information contained in these drug orders used to study the quality of drug prescriptions and prescriber behavior. We present a comprehensive set of quantitative indicators for the quality of drug prescriptions which can be derived from a drug order. These indicators were constructed using explicit a priori criteria which were previously validated on the basis of scientific data. Automatic computation is straightforward, using a relational database system, such that large sets of prescriptions can be processed with minimal human effort. We illustrate the feasibility and value of this approach by using a large set of 23,000 prescriptions for several diseases, selected from a nationally representative prescriptions database. Our study may result in direct and wide applications in the epidemiology of medical practice and in quality control procedures.

Geriatric Patient Safety Indicators Based on Linked Administrative Health Data to Assess Anticoagulant-Related Thromboembolic and Hemorrhagic Adverse Events in Older Inpatients: A Study Proposal.

PubMed

Le Pogam, Marie-Annick; Quantin, Catherine; Reich, Oliver; Tuppin, Philippe; Fagot-Campagna, Anne; Paccaud, Fred; Peytremann-Bridevaux, Isabelle; Burnand, Bernard

2017-05-11

Frail older people with multiple interacting conditions, polypharmacy, and complex care needs are particularly exposed to health care-related adverse events. Among these, anticoagulant-related thromboembolic and hemorrhagic events are particularly frequent and serious in older inpatients. The growing use of anticoagulants in this population and their substantial risk of toxicity and inefficacy have therefore become an important patient safety and public health concern worldwide. Anticoagulant-related adverse events and the quality of anticoagulation management should thus be routinely assessed to improve patient safety in vulnerable older inpatients. This project aims to develop and validate a set of outcome and process indicators based on linked administrative health data (ie, insurance claims data linked to hospital discharge data) assessing older inpatient safety related to anticoagulation in both Switzerland and France, and enabling comparisons across time and among hospitals, health territories, and countries. Geriatric patient safety indicators (GPSIs) will assess anticoagulant-related adverse events. Geriatric quality indicators (GQIs) will evaluate the management of anticoagulants for the prevention and treatment of arterial or venous thromboembolism in older inpatients. GPSIs will measure cumulative incidences of thromboembolic and bleeding adverse events based on hospital discharge data linked to insurance claims data. Using linked administrative health data will improve GPSI risk adjustment on patients' conditions that are present at admission and will capture in-hospital and postdischarge adverse events. GQIs will estimate the proportion of index hospital stays resulting in recommended anticoagulation at discharge and up to various time frames based on the same electronic health data. The GPSI and GQI development and validation process will comprise 6 stages: (1) selection and specification of candidate indicators, (2) definition of administrative data-based algorithms, (3) empirical measurement of indicators using linked administrative health data, (4) validation of indicators, (5) analyses of geographic and temporal variations for reliable and valid indicators, and (6) data visualization. Study populations will consist of 166,670 Swiss and 5,902,037 French residents aged 65 years and older admitted to an acute care hospital at least once during the 2012-2014 period and insured for at least 1 year before admission and 1 year after discharge. We will extract Swiss data from the Helsana Group data warehouse and French data from the national health insurance information system (SNIIR-AM). The study has been approved by Swiss and French ethics committees and regulatory organizations for data protection. Validated GPSIs and GQIs should help support and drive quality and safety improvement in older inpatients, inform health care stakeholders, and enable international comparisons. We discuss several limitations relating to the representativeness of study populations, accuracy of administrative health data, methods used for GPSI criterion validity assessment, and potential confounding bias in comparisons based on GQIs, and we address these limitations to strengthen study feasibility and validity. ©Marie-Annick Le Pogam, Catherine Quantin, Oliver Reich, Philippe Tuppin, Anne Fagot-Campagna, Fred Paccaud, Isabelle Peytremann-Bridevaux, Bernard Burnand. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 11.05.2017.

Improving quality of care in general practices by self-audit, benchmarking and quality circles.

PubMed

Mahlknecht, Angelika; Abuzahra, Muna E; Piccoliori, Giuliano; Enthaler, Nina; Engl, Adolf; Sönnichsen, Andreas

2016-10-01

Guideline adherence of general practitioners (GP) regarding treatment of chronic conditions shows room for improvement. Thus, concepts have to be designed to promote quality of care. The aim of the interventional study "Improvement of Quality by Benchmarking" was to assess whether quality can be improved by self-auditing, benchmarking and quality circles in Salzburg (Austria) and South Tyrol (Italy). In this publication we present the Austrian results. Quality indicators were developed in a consensus process for eight chronic diseases based on pre-existing quality management systems. A quality score consisting of 35 indicators was calculated (0-5 points per indicator depending on fulfilment, maximum 175 points). Data were extracted from the electronic health records of participating practices in 2012, 2013 and 2014. A statistical pre-post analysis was performed using Wilcoxon signed-rank tests. A total of 20 GPs participated in the project. The mean quality score increased from 62.0 at baseline to 84.0 at the second follow-up (p = 0.003). Regarding the individual quality indicators, strong improvements were achieved between baseline and first follow-up, especially in process indicators concerning documentation. Between the first and second follow-up, quality remained in most cases at the same level. The validity of results is limited because of structural and technical problems. Due to the uncontrolled pre-post design we cannot exclude external influences on the results. Nevertheless, the intervention was able to improve measured quality of care. Barriers were detected that should be considered in a possible implementation of quality control programs.

Psychometric properties of a Chinese asthma quality of life questionnaire.

PubMed

Wang, Ningqun; Huang, Xiaobo; Chen, Wenqiang; Zhang, Xiaomei; Zhang, Yongsheng; Chen, Yujing

2017-12-01

To assess the acceptability, reliability, validity, and responsiveness of the Chinese Asthma Quality of Life Questionnaire (C-AQLQ) in a sample of Chinese asthma patients. The C-AQLQ and Short Form 36 Health Survey (SF-36) scales were administered to patients at baseline and 3 months later. Asthma severity condition and lung function were evaluated. Necessary data were gathered to assess the psychometric properties such as the feasibility, internal consistency, test-retest reliability, structural validity, discriminant validity, convergent validity, and responsiveness of the C-AQLQ. One hundred and thirty-seven patients completed the investigation. The Cronbach's alpha coefficient for the total scale was 0.96. Factor analysis yielded five factors that generally corresponded to the five proposed subscales. Patients with mild asthma reported higher scores than patients with moderate/severe asthma on all subscales other than environmental stimuli. Lung function measurement and the asthma severity score correlated significantly with domains of the C-AQOL but with fewer domains of the SF-36. The questionnaire detected within-subject changes in patients' asthma status during follow-up. Results indicated preliminary support that the C-AQLQ is a reliable, valid, discriminating, and responsive measure of quality of life in Chinese asthma patients. It is more sensitive than the generic SF-36 in detecting differences in asthma severity.

Translation, cultural adaptation, and validation of the Sleep Apnea Quality of Life Index (SAQLI) in Persian-speaking patients with obstructive sleep apnea.

PubMed

Rahavi-Ezabadi, Sara; Amali, Amin; Sadeghniiat-Haghighi, Khosro; Montazeri, Ali; Nedjat, Saharnaz

2016-05-01

The aim of this study was the translation, cross-cultural adaptation, and validation of the Sleep Apnea Quality of Life Index (SAQLI) in Persian-speaking patients with obstructive sleep apnea (OSA). Ninety-six patients with OSA completed a series of questionnaires including SAQLI, Epworth Sleepiness Scale (ESS),10-item Functional Outcomes of Sleep Questionnaire (FOSQ-10), and Medical Outcome Survey Short form 12 (SF-12) for assessment of reliability, validity, and responsiveness of Persian version of SAQLI. The Persian version of SAQLI had a very good internal consistency and also demonstrated good test-retest reliability. Concurrent validity was confirmed by significant correlations with ESS, FOSQ-10 and SF-12 subscale scores. Comparison of SAQLI scores in groups of patients categorized by ESS showed the high discriminative power of this instrument. However, there was no significant difference in the SAQLI scores of patients with mild, moderate, and severe sleep apnea. The results of sensitivity to change verified that the SAQLI was able to detect changes after continuous positive airway pressure (CPAP) treatment. The findings of this study indicate that the Persian version of SAQLI is a reliable, valid, and responsive measure for evaluation of quality of life in patients with OSA.

Development of a quality-of-life instrument for autoimmune bullous disease: the Autoimmune Bullous Disease Quality of Life questionnaire.

PubMed

Sebaratnam, Deshan F; Hanna, Anna Marie; Chee, Shien-ning; Frew, John W; Venugopal, Supriya S; Daniel, Benjamin S; Martin, Linda K; Rhodes, Lesley M; Tan, Jeremy Choon Kai; Wang, Charles Qian; Welsh, Belinda; Nijsten, Tamar; Murrell, Dédée F

2013-10-01

Quality-of-life (QOL) evaluation is an increasingly important outcome measure in dermatology, with disease-specific QOL instruments being the most sensitive to changes in disease status. To develop a QOL instrument specific to autoimmune bullous disease (AIBD). A comprehensive item generation process was used to build a 45-item pilot Autoimmune Bullous Disease Quality of Life (ABQOL) questionnaire, distributed to 70 patients with AIBD. Experts in bullous disease refined the pilot ABQOL before factor analysis was performed to yield the final ABQOL questionnaire of 17 questions. We evaluated validity and reliability across a range of indices. Australian dermatology outpatient clinics and private dermatology practices. PATIENTS AND EXPOSURE: Patients with a histological diagnosis of AIBD. The development of an AIBD-specific QOL instrument. Face and content validity were established through the comprehensive patient interview process and expert review. In terms of convergent validity, the ABQOL was found to have a moderate correlation with scores on the Dermatology Life Quality Index (R = 0.63) and the General Health subscale of the 36-Item Short Form Health Survey (R = 0.69; P = .009) and low correlation with the Pemphigus Disease Area Index (R = 0.42) and Autoimmune Bullous Disease Skin Disorder Intensity Score (R = 0.48). In terms of discriminant validity, the ABQOL was found to be more sensitive than the Dermatology Life Quality Index (P = .02). The ABQOL was also found to be a reliable instrument evaluated by internal consistency (Cronbach α coefficient, 0.84) and test-retest reliability (mean percentage variation, 0.92). The ABQOL has been shown to be a valid and reliable instrument that may serve as an end point in clinical trials. Future work should include incorporating patient weighting on questions to further increase content validity and translation of the measure to other languages. anzctr.org.au Identifier: ACTRN12612000750886.

A reduced factor structure for the PROQOL-HIV questionnaire provided reliable indicators of health-related quality of life.

PubMed

Lalanne, Christophe; Chassany, Olivier; Carrieri, Patrizia; Marcellin, Fabienne; Armstrong, Andrew R; Lert, France; Spire, Bruno; Dray-Spira, Rosemary; Duracinsky, Martin

2016-04-01

To identify a simplified factor structure for the PROQOL-human immunodeficiency virus (HIV) questionnaire to improve the measurement of the health-related quality of life (HRQL) of HIV-positive patients in clinical care and research settings. HRQL data were collected using the eight-dimension PROQOL-HIV questionnaire from 2,537 patients (VESPA2 study). Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) validated a simpler four-factor structure and assessed measurement invariance (MI). Multigroup analysis assessed the effect of sex, age, and antiretroviral therapy (ART) on the resulting factor scores. Correlations with symptom and Short Form (SF)-12 self-reports assessed convergent validity. Item analysis, EFA, and CFAs confirmed the validity [comparative fit index (CFI), 0.948; root mean square error of approximation, 0.064] and reliability (α's ≥ 0.8) of four dimensions: physical health and symptoms, health concerns and mental distress, social and intimate relationships, and treatment-related impact. Strong MI was demonstrated across sex and age (decrease in CFI <0.01). A multiple-cause multiple-indicator model indicated that HRQL correlated as expected with sex, age, and the ART status. Correlations of HRQL, symptom reports, and SF-12 scores evidenced convergent validity criterion. The simplified factor structure and scoring scheme for PROQOL-HIV will allow clinicians to monitor with greater reliability the HRQL of patients in clinical care and research settings. Copyright © 2016 Elsevier Inc. All rights reserved.

Combining natural background levels (NBLs) assessment with indicator kriging analysis to improve groundwater quality data interpretation and management.

PubMed

Ducci, Daniela; de Melo, M Teresa Condesso; Preziosi, Elisabetta; Sellerino, Mariangela; Parrone, Daniele; Ribeiro, Luis

2016-11-01

The natural background level (NBL) concept is revisited and combined with indicator kriging method to analyze the spatial distribution of groundwater quality within a groundwater body (GWB). The aim is to provide a methodology to easily identify areas with the same probability of exceeding a given threshold (which may be a groundwater quality criteria, standards, or recommended limits for selected properties and constituents). Three case studies with different hydrogeological settings and located in two countries (Portugal and Italy) are used to derive NBL using the preselection method and validate the proposed methodology illustrating its main advantages over conventional statistical water quality analysis. Indicator kriging analysis was used to create probability maps of the three potential groundwater contaminants. The results clearly indicate the areas within a groundwater body that are potentially contaminated because the concentrations exceed the drinking water standards or even the local NBL, and cannot be justified by geogenic origin. The combined methodology developed facilitates the management of groundwater quality because it allows for the spatial interpretation of NBL values. Copyright © 2016 Elsevier B.V. All rights reserved.

Developing a measure of medication-related quality of life for people with polypharmacy.

PubMed

Tseng, Hsu-Min; Lee, Chia-Hui; Chen, Yin-Jen; Hsu, Hsiang-Hao; Huang, Li-Yueh; Huang, Jing-Long

2016-05-01

To develop a measure of medication-related quality of life (MRQoL) and to validate the measure in a hospital-based population of patients with polypharmacy. The Medication-Related Quality of Life Scale version 1.0 (MRQoLS-v1.0) included 14 items developed on the basis of interviews with elderly patients with polypharmacy, defined as taking five or more medications simultaneously. This scale was tested in 219 outpatients (99 with polypharmacy and 120 without polypharmacy). Two measures were used to establish construct validity the Psychological Distress Checklist, for convergent validity, and the Medication Adherence Behavior Scale (MABS), for discriminant validity. The 14-item scale was found to be both reliable and valid. Internal consistency reliability evaluated using Cronbach's alpha for this scale was 0.91. Scores on the MRQoLS-v1.0 correlated statistically significantly and negatively with those on the Psychological Distress Checklist. Discriminant validity was demonstrated by low correlation with MABS, indicating that the MRQoLS-v1.0 measured concepts different from medication adherence. Significant differences in the MRQoLS-v1.0 between patients with polypharmacy and those without polypharmacy provided evidence for known-group validity. The study presents a psychometric evaluation of a measure used to assess MRQoL of patients with polypharmacy. The instrument is practical to administer in clinics and provides a valuable adjunct to the outcome measurement for patients with polypharmacy. Further research on the sensitivity of this instrument to medication change in multi-medicated patients is warranted.

Validity and Reliability of Accelerometers in Patients With COPD: A SYSTEMATIC REVIEW.

PubMed

Gore, Shweta; Blackwood, Jennifer; Guyette, Mary; Alsalaheen, Bara

2018-05-01

Reduced physical activity is associated with poor prognosis in chronic obstructive pulmonary disease (COPD). Accelerometers have greatly improved quantification of physical activity by providing information on step counts, body positions, energy expenditure, and magnitude of force. The purpose of this systematic review was to compare the validity and reliability of accelerometers used in patients with COPD. An electronic database search of MEDLINE and CINAHL was performed. Study quality was assessed with the Strengthening the Reporting of Observational Studies in Epidemiology checklist while methodological quality was assessed using the modified Quality Appraisal Tool for Reliability Studies. The search yielded 5392 studies; 25 met inclusion criteria. The SenseWear Pro armband reported high criterion validity under controlled conditions (r = 0.75-0.93) and high reliability (ICC = 0.84-0.86) for step counts. The DynaPort MiniMod demonstrated highest concurrent validity for step count using both video and manual methods. Validity of the SenseWear Pro armband varied between studies especially in free-living conditions, slower walking speeds, and with addition of weights during gait. A high degree of variability was found in the outcomes used and statistical analyses performed between studies, indicating a need for further studies to measure reliability and validity of accelerometers in COPD. The SenseWear Pro armband is the most commonly used accelerometer in COPD, but measurement properties are limited by gait speed variability and assistive device use. DynaPort MiniMod and Stepwatch accelerometers demonstrated high validity in patients with COPD but lack reliability data.

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda.

PubMed

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-12-02

The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda.

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda

PubMed Central

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-01-01

Background The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. Methods A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. Results The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. Conclusion This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda. PMID:19055716

Validation of the Korean Version of the Mini-Sleep Questionnaire-Insomnia in Korean College Students.

PubMed

Kim, Hee-Ju

2017-03-01

This study aimed to evaluate the reliability and validity of the Korean version of the Mini-Sleep Questionnaire-Insomnia in Korean college students. A total of 470 students from six nursing colleges in South Korea participated in the study. The translation and linguistic validation of the Mini-Sleep Questionnaire-Insomnia was performed based on guidelines. The Pittsburgh Sleep Quality Index and the Perceived Stress Scale were used to validate the measure. Cronbach α, item-total correlation for internal consistency reliability and intraclass correlation coefficient for test-retest reliability were evaluated. Exploratory factor analysis for construct validity, Pearson's correlation with the Pittsburgh Sleep Quality Index and the Perceived Stress Scale for concurrent validity, and the receiver operating character curve for predictive validity were assessed. The 4-item Mini-Sleep Questionnaire-Insomnia had a Cronbach α of .69 and the item-total correlations were higher than .30. Cronbach α increased to .73 if the item assessing the use of sleeping pills and tranquilizers was deleted. This item had marked skewness and kurtosis issues. Factor analysis indicated unidimensionality, explaining 53.0% of the total variance. The measure showed high test-retest reliability (i.e., intraclass correlation coefficient = .84), acceptable concurrent validity (r with the Pittsburg Sleep Quality Index = .69; r with the Perceived Stress Scale = .31) and predictive validity [area under curve = .85; 95% confidence interval (0.81, 0.90)]. The Mini-Sleep Questionnaire-Insomnia showed acceptable reliability and validity. Yet, the limited distribution in sleep medications warrants further evaluations in the clinical population. Copyright © 2017. Published by Elsevier B.V.

Using the HSE stress indicator tool in a military context.

PubMed

Bridger, Robert S; Dobson, Karen; Davison, Hannah

2016-01-01

An assessment of the Health and Safety Executive's (HSE) stress indicator tool was conducted to determine whether it was suitable for use with Ministry of Defence (MoD) personnel. A total of 1031 respondents from the Army, Navy, Air Force and MoD civilians completed a questionnaire containing the HSE tool and supplementary measures of work-life balance, engagement, deployment, leave taken and hours of work. Six measures of adverse reaction to the stressors were also reported: perceptions of job stress, job stress and health, psychological strain, fatigue after work, work ability and quality of working life. The stressor scales, particularly the 'demands' and 'relationships' scales, were associated with adverse outcomes as was the work-life balance scale. The HSE tool had some validity when used with MoD personnel, but its content was too narrow. The content validity of the tool can be improved for use in a military context with the addition of a 'work-life balance' scale'. The HSE stress tool was tested with a mixed sample of MoD employees. The ‘Demands and “Relationships” scales were associated with adverse outcomes. An additional Work–Life Balance’ scale improved the content validity, demonstrating the importance of assessing the psychometric qualities of scales when used within particular contexts to ensure validity.

Initial Ada components evaluation

NASA Technical Reports Server (NTRS)

Moebes, Travis

1989-01-01

The SAIC has the responsibility for independent test and validation of the SSE. They have been using a mathematical functions library package implemented in Ada to test the SSE IV and V process. The library package consists of elementary mathematical functions and is both machine and accuracy independent. The SSE Ada components evaluation includes code complexity metrics based on Halstead's software science metrics and McCabe's measure of cyclomatic complexity. Halstead's metrics are based on the number of operators and operands on a logical unit of code and are compiled from the number of distinct operators, distinct operands, and total number of occurrences of operators and operands. These metrics give an indication of the physical size of a program in terms of operators and operands and are used diagnostically to point to potential problems. McCabe's Cyclomatic Complexity Metrics (CCM) are compiled from flow charts transformed to equivalent directed graphs. The CCM is a measure of the total number of linearly independent paths through the code's control structure. These metrics were computed for the Ada mathematical functions library using Software Automated Verification and Validation (SAVVAS), the SSE IV and V tool. A table with selected results was shown, indicating that most of these routines are of good quality. Thresholds for the Halstead measures indicate poor quality if the length metric exceeds 260 or difficulty is greater than 190. The McCabe CCM indicated a high quality of software products.

Detecting adverse events in surgery: comparing events detected by the Veterans Health Administration Surgical Quality Improvement Program and the Patient Safety Indicators.

PubMed

Mull, Hillary J; Borzecki, Ann M; Loveland, Susan; Hickson, Kathleen; Chen, Qi; MacDonald, Sally; Shin, Marlena H; Cevasco, Marisa; Itani, Kamal M F; Rosen, Amy K

2014-04-01

The Patient Safety Indicators (PSIs) use administrative data to screen for select adverse events (AEs). In this study, VA Surgical Quality Improvement Program (VASQIP) chart review data were used as the gold standard to measure the criterion validity of 5 surgical PSIs. Independent chart review was also used to determine reasons for PSI errors. The sensitivity, specificity, and positive predictive value of PSI software version 4.1a were calculated among Veterans Health Administration hospitalizations (2003-2007) reviewed by VASQIP (n = 268,771). Nurses re-reviewed a sample of hospitalizations for which PSI and VASQIP AE detection disagreed. Sensitivities ranged from 31% to 68%, specificities from 99.1% to 99.8%, and positive predictive values from 31% to 72%. Reviewers found that coding errors accounted for some PSI-VASQIP disagreement; some disagreement was also the result of differences in AE definitions. These results suggest that the PSIs have moderate criterion validity; however, some surgical PSIs detect different AEs than VASQIP. Future research should explore using both methods to evaluate surgical quality. Published by Elsevier Inc.

The association between dietary glycemic index, glycemic load and diet quality indices in Iranian adults: results from Isfahan Healthy Heart Program.

PubMed

Azadbakht, Leila; Mohammadifard, Noushin; Akhavanzanjani, Mohsen; Taheri, Marzieh; Golshahi, Jafar; Haghighatdoost, Fahimeh

2016-01-01

To assess the association between dietary glycemic index (GI), glycemic load (GL) and dietary quality indices in Iranian adults. This cross section was conducted among 1571 Iranian adults aged  ≥19 years. GI, GL and diet quality indices were estimated by 24-h recall and DDS was calculated using a validated 48-item food frequency questionnaire. Participants who were in the top tertile of GI had lower healthy eating index (HEI) (57.2 ± 7.8 versus 55.6 ± 8.7; p < 0.001), dietary diversity score (DDS) (3.6 ± 0.9 versus 3.3 ± 1.1; p < 0.001) and nutrient adequacy ratios (NARs) for Zn, Ca, vitamin C and B2. Individuals in the lowest tertile of GL had lower HEI, MAR and NARs for Zn, vitamin B2, B3, B6, B12, vitamin D. Both GI and GL were positively related to dietary diversity score (DED) (p < 0.001). The inverse associations for GI and GL with diet quality indices may suggest the relevance of carbohydrate source in determining the diet quality indices.

Quality of longer term mental health facilities in Europe: validation of the quality indicator for rehabilitative care against service users' views.

PubMed

Killaspy, Helen; White, Sarah; Wright, Christine; Taylor, Tatiana L; Turton, Penny; Kallert, Thomas; Schuster, Mirjam; Cervilla, Jorge A; Brangier, Paulette; Raboch, Jiri; Kalisova, Lucie; Onchev, Georgi; Alexiev, Spiridon; Mezzina, Roberto; Ridente, Pina; Wiersma, Durk; Visser, Ellen; Kiejna, Andrzej; Piotrowski, Patryk; Ploumpidis, Dimitris; Gonidakis, Fragiskos; Caldas-de-Almeida, José Miguel; Cardoso, Graça; King, Michael

2012-01-01

The Quality Indicator for Rehabilitative Care (QuIRC) is a staff rated, international toolkit that assesses care in longer term hospital and community based mental health facilities. The QuIRC was developed from review of the international literature, an international Delphi exercise with over 400 service users, practitioners, carers and advocates from ten European countries at different stages of deinstitutionalisation, and review of the care standards in these countries. It can be completed in under an hour by the facility manager and has robust content validity, acceptability and inter-rater reliability. In this study, we investigated the internal validity of the QuIRC. Our aim was to identify the QuIRC domains of care that independently predicted better service user experiences of care. At least 20 units providing longer term care for adults with severe mental illness were recruited in each of ten European countries. Service users completed standardised measures of their experiences of care, quality of life, autonomy and the unit's therapeutic milieu. Unit managers completed the QuIRC. Multilevel modelling allowed analysis of associations between service user ratings as dependent variables with unit QuIRC domain ratings as independent variables. 1750/2495 (70%) users and the managers of 213 units from across ten European countries participated. QuIRC ratings were positively associated with service users' autonomy and experiences of care. Associations between QuIRC ratings and service users' ratings of their quality of life and the unit's therapeutic milieu were explained by service user characteristics (age, diagnosis and functioning). A hypothetical 10% increase in QuIRC rating resulted in a clinically meaningful improvement in autonomy. Ratings of the quality of longer term mental health facilities made by service managers were positively associated with service users' autonomy and experiences of care. Interventions that improve quality of care in these settings may promote service users' autonomy.

Involving patients in detecting quality gaps in a fragmented healthcare system: development of a questionnaire for Patients' Experiences Across Health Care Sectors (PEACS)

PubMed Central

Noest, Stefan; Ludt, Sabine; Klingenberg, Anja; Glassen, Katharina; Heiss, Friederike; Ose, Dominik; Rochon, Justine; Bozorgmehr, Kayvan; Wensing, Michel; Szecsenyi, Joachim

2014-01-01

Objective The purpose of this study was to develop and validate a generic questionnaire to evaluate experiences and reported outcomes in patients who receive treatment across a range of healthcare sectors. Design Mixed-methods design including focus groups, pretests and field test. Setting The patient questionnaire was developed in the context of a nationwide program in Germany aimed at quality improvements across the healthcare sectors. Participants For the field test, 589 questionnaires were distributed to patients via 47 general practices. Main Measurements Descriptive item analyzes non-responder analysis and factor analysis (PCA). Retest coefficients (r) calculated by correlation of sum scores of PCA factors. Quality gaps were assessed by the proportion of responders choosing a response category defined as indicating shortcomings in quality of care. Results The conceptual phase showed good content validity. Four hundred and seventy-four patients who received a range of treatment across a range of sectors were included (response rate: 80.5%). Data analysis confirmed the construct, oriented to the patient care journey with a focus on transitions between healthcare sectors. Quality gaps were assessed for the topics ‘Indication’, including shared-decision-making (6 items, 24.5–62.9%) and ‘Discharge and Transition’ (10 items; 20.7–48.2%). Retest coefficients ranged from r = 0.671 until r = 0.855 and indicated good reliability. Low ratios of item-non-response (0.8–9.3%) confirmed a high acceptance by patients. Conclusions The number of patients with complex healthcare needs is increasing. Initiatives to expand quality assurance across organizational borders and healthcare sectors are therefore urgently needed. A validated questionnaire (called PEACS 1.0) is available to measure patients' experiences across healthcare sectors with a focus on quality improvement. PMID:24758750

Reliability and validity of the Chinese version of the autoimmune bullous disease quality of life (ABQOL) questionnaire.

PubMed

Yang, Baoqi; Chen, Guo; Yang, Qing; Yan, Xiaoxiao; Zhang, Zhaoxia; Murrell, Dédée F; Zhang, Furen

2017-02-02

The autoimmune bullous diseases quality of life (ABQOL) questionnaire was recently developed by an Australian group and has been validated in Australian and North American patient cohorts. It is a 17-item, multidimensional, self-administered English questionnaire. The study aimed to validate the Chinese version of the ABQOL questionnaire and evaluate the reliability in Chinese patients. The Chinese version of the ABQOL questionnaire was produced by forward-backward translation and cross-cultural adaptation of the original English version. The ABQOL questionnaire was then distributed to a total of 101 patients with autoimmune bullous diseases (AIBDs) together with the Dermatology Life Quality Index (DLQI) and the 36-item Short Form Health Survey (SF-36). Validity was analyzed across a range of indices and reliability was assessed using internal consistency and test-retest methods. The Chinese version of the ABQOL questionnaire has a high internal consistency (Cronbach's alpha coefficient, 0.88) and test-retest reliability (the intraclass correlation coefficient, 0.87). Face and content validity were satisfactory. Convergent validity testing showed that the correlation coefficients for the ABQOL and DLQI was 0.77 and for the ABQOL and SF-36 was -0.62. In terms of discriminant validity, there was no significant difference between the proportions of insensitive items in ABQOL and DLQI (p = 0.236). There was no significant difference between the proportions of insensitive items in ABQOL and SF-36 (p = 0.823). The Chinese version of the ABQOL questionnaire has adequate validity and reliability. It may constitute a useful instrument to measure disease burden in Chinese patients with AIBDs.

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method.

PubMed

Kunz, Derek; Pariyadath, Manoj; Wittler, Mary; Askew, Kim; Manthey, David; Hartman, Nicholas

2017-06-01

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality. We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States. We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency. Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts. © 2017 by the American Institute of Ultrasound in Medicine.

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study

PubMed Central

Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-01-01

Background The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. Objective We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. Methods We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. Results In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. Conclusions This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. PMID:29699970

Comparing the outcomes of two strategies for colorectal tumor detection: policy-promoted screening program versus health promotion service.

PubMed

Wu, Ping-Hsiu; Lin, Yu-Min; Liao, Chao-Sheng; Chang, Hung-Chuen; Chen, Yu-Hung; Yang, Kuo-Ching; Shih, Chia-Hui

2013-06-01

The Taiwanese government has proposed a population-based colorectal tumor detection program for the average-risk population. This study's objectives were to understand the outcomes of these screening policies and to evaluate the effectiveness of the program. We compared two databases compiled in one medical center. The "policy-promoted cancer screening" (PPS) database was built on the basis of the policy of the Taiwan Bureau of National Health Insurance for cancer screening. The "health promotion service" (HPS) database was built to provide health check-ups for self-paid volunteers. Both the PPS and HPS databases employ the immunochemical fecal occult blood test (iFOBT) and colonoscopy for colorectal tumor screening using different strategies. A comparison of outcomes between the PPS and HPS included: (1) quality indicators-compliance rate, cecum reaching rate, and tumor detection rate; and (2) validity indicators-sensitivity, specificity, positive, and negative predictive values for detecting colorectal neoplasms. A total of 10,563 and 1481 individuals were enrolled in PPS and HPS, respectively. Among quality indicators, there was no statistically significant difference in the cecum reaching rate between PPS and HPS. The compliance rates were 56.1% for PPS and 91.8% for HPS (p < 0.001). The advanced adenoma detection rates of PPS and HPS were 1.0% and 3.6%, respectively (p < 0.01). The carcinoma detection rates were 0.3% and 0.4%, respectively (p = 0.59). For validity indicators, PPS provides only a positive predictive value for colorectal tumor detection. HPS provides additional validity indicators, including sensitivity, specificity, positive predictive value, and negative predictive value, for colorectal tumor screening. In comparison with the outcomes of the HPS database, the screening efficacy of the PPS database is even for detecting colorectal carcinoma but is limited in detecting advanced adenoma. HPS may provide comprehensive validity indicators and will be helpful in adjusting current policies for improving screening performance. Copyright © 2013. Published by Elsevier B.V.

Private healthcare quality: applying a SERVQUAL model.

PubMed

Butt, Mohsin Muhammad; de Run, Ernest Cyril

2010-01-01

This paper seeks to develop and test the SERVQUAL model scale for measuring Malaysian private health service quality. The study consists of 340 randomly selected participants visiting a private healthcare facility during a three-month data collection period. Data were analyzed using means, correlations, principal component and confirmatory factor analysis to establish the modified SERVQUAL scale's reliability, underlying dimensionality and convergent, discriminant validity. Results indicate a moderate negative quality gap for overall Malaysian private healthcare service quality. Results also indicate a moderate negative quality gap on each service quality scale dimension. However, scale development analysis yielded excellent results, which can be used in wider healthcare policy and practice. Respondents were skewed towards a younger population, causing concern that the results might not represent all Malaysian age groups. The study's major contribution is that it offers a way to assess private healthcare service quality. Second, it successfully develops a scale that can be used to measure health service quality in Malaysian contexts.

[Validation of two indices of biological integrity (IBI) for the Angulo River subbasin in Central Mexico].

PubMed

Ramírez-Herrejón, Juan Pablo; Mercado-Silva, Norman; Medina-Nava, Martina; Domínguez-Domínguez, Omar

2012-12-01

Efforts to halt freshwater ecosystem degradation in central Mexico can benefit from using bio-monitoring tools that reflect the condition of their biotic integrity. We analyzed the applicability of two fish-based indices of biotic integrity using data from lotic and lentic systems in the Angulo River subbasin (Lerma-Chapala basin). Both independent data from our own collections during two consecutive years, and existing information detailing the ecological attributes of each species, were used to calculate indices of biological integrity for 16 sites in lotic and lentic habitats. We assessed environmental quality by combining independent evaluations water and habitat quality for each site. We found sites with poor, regular and good biotic integrity. Our study did not find sites with good environmental quality. Fish-based IBI scores were strongly and significantly correlated with scores from independent environmental assessment techniques. IBI scores were adequate at representing environmental conditions in most study sites. These results expand the area where a lotic system fish-based IBI can be used, and constitute an initial validation of a lentic system fish-based IBI. Our results suggest that these bio-monitoring tools can be used in future conservation efforts in freshwater ecosystems in the Middle Lerma Basin.

Development and evaluation of oral Cancer quality-of-life questionnaire (QOL-OC).

PubMed

Nie, Min; Liu, Chang; Pan, Yi-Chen; Jiang, Chen-Xi; Li, Bao-Ru; Yu, Xi-Jie; Wu, Xin-Yu; Zheng, Shu-Ning

2018-05-03

In this study scales and items for the Oral Cancer Quality-of-life Questionnaire (QOL-OC) were designed and the instrument was evaluated. The QOL-OC was developed and modified using the international definition of quality of life (QOL) promulgated by the European Organization for Research and Treatment of Cancer (EORTC) and analysis of the precedent measuring instruments. The contents of each item were determined in the context of the specific characteristics of oral cancer. Two hundred thirteen oral cancer patients were asked to complete both the EORTC core quality of life questionnaire (EORTC QLC-C30) and the QOL-OC. Data collected was used to conduct factor analysis, test-retest reliability, internal consistency, and construct validity. Questionnaire compliance was relatively high. Fourteen of the 213 subjects accepted the same tests after 24 to 48 h demonstrating a high test-retest reliability for all five scales. Overall internal consistency surpasses 0.8. The outcome of the factor analysis coincides substantially with our theoretical conception. Each item shows a higher correlation coefficient within its own scale than the others which indicates high construct validity. QOL-OC demonstrates fairly good statistical reliability, validity, and feasibility. However, further tests and modification are needed to ensure its applicability to the quality-of-life assessment of Chinese oral cancer patients.

The Severe Heart Failure Questionnaire: Italian translation and linguistic validation.

PubMed

Scarinzi, C; Berchialla, P; Ghidina, M; Rozbowsky, P; Pilotto, L; Albanese, M C; Fioretti, P M; Gregori, D

2008-12-01

The quality of life (QoL) is an important outcome indicator for heart failure management. As the use of a validate questionnaire in a different cultural context can affect data interpretation our main objective is the Italian translation and linguistic validation of the Severe Heart Failure Questionnaire (SHF) and its comparison with the MLHF (Minnesota Living with Heart Failure) Questionnaire. The SHF and "The Minnesota Living with Heart Failure Questionnaire" were translated. A consensus involving parallel back-translations was established among a group of cardiologists, psychologists and biostatisticians. SHF and MLHF were both administrated to a sample of 50 patients. The patients' median age was 63 years. Ace inhibitors therapy was administered in 88% of cases and betablockers in 56% of cases. Finally the Italian version of SHF correlates well with MLHF for all domains, except life satisfaction SHF domain. The Italian version of the SHF correlates well with MLHF for almost all domains and it represents a valid alternative for quality of life assessment in heart failure patients.

The Outcome and Assessment Information Set (OASIS): A Review of Validity and Reliability

PubMed Central

O’CONNOR, MELISSA; DAVITT, JOAN K.

2015-01-01

The Outcome and Assessment Information Set (OASIS) is the patient-specific, standardized assessment used in Medicare home health care to plan care, determine reimbursement, and measure quality. Since its inception in 1999, there has been debate over the reliability and validity of the OASIS as a research tool and outcome measure. A systematic literature review of English-language articles identified 12 studies published in the last 10 years examining the validity and reliability of the OASIS. Empirical findings indicate the validity and reliability of the OASIS range from low to moderate but vary depending on the item studied. Limitations in the existing research include: nonrepresentative samples; inconsistencies in methods used, items tested, measurement, and statistical procedures; and the changes to the OASIS itself over time. The inconsistencies suggest that these results are tentative at best; additional research is needed to confirm the value of the OASIS for measuring patient outcomes, research, and quality improvement. PMID:23216513

Validation of an image-based technique to assess the perceptual quality of clinical chest radiographs with an observer study

NASA Astrophysics Data System (ADS)

Lin, Yuan; Choudhury, Kingshuk R.; McAdams, H. Page; Foos, David H.; Samei, Ehsan

2014-03-01

We previously proposed a novel image-based quality assessment technique1 to assess the perceptual quality of clinical chest radiographs. In this paper, an observer study was designed and conducted to systematically validate this technique. Ten metrics were involved in the observer study, i.e., lung grey level, lung detail, lung noise, riblung contrast, rib sharpness, mediastinum detail, mediastinum noise, mediastinum alignment, subdiaphragm-lung contrast, and subdiaphragm area. For each metric, three tasks were successively presented to the observers. In each task, six ROI images were randomly presented in a row and observers were asked to rank the images only based on a designated quality and disregard the other qualities. A range slider on the top of the images was used for observers to indicate the acceptable range based on the corresponding perceptual attribute. Five boardcertificated radiologists from Duke participated in this observer study on a DICOM calibrated diagnostic display workstation and under low ambient lighting conditions. The observer data were analyzed in terms of the correlations between the observer ranking orders and the algorithmic ranking orders. Based on the collected acceptable ranges, quality consistency ranges were statistically derived. The observer study showed that, for each metric, the averaged ranking orders of the participated observers were strongly correlated with the algorithmic orders. For the lung grey level, the observer ranking orders completely accorded with the algorithmic ranking orders. The quality consistency ranges derived from this observer study were close to these derived from our previous study. The observer study indicates that the proposed image-based quality assessment technique provides a robust reflection of the perceptual image quality of the clinical chest radiographs. The derived quality consistency ranges can be used to automatically predict the acceptability of a clinical chest radiograph.

A method of groundwater quality assessment based on fuzzy network-CANFIS and geographic information system (GIS)

NASA Astrophysics Data System (ADS)

Gholami, V.; Khaleghi, M. R.; Sebghati, M.

2017-11-01

The process of water quality testing is money/time-consuming, quite important and difficult stage for routine measurements. Therefore, use of models has become commonplace in simulating water quality. In this study, the coactive neuro-fuzzy inference system (CANFIS) was used to simulate groundwater quality. Further, geographic information system (GIS) was used as the pre-processor and post-processor tool to demonstrate spatial variation of groundwater quality. All important factors were quantified and groundwater quality index (GWQI) was developed. The proposed model was trained and validated by taking a case study of Mazandaran Plain located in northern part of Iran. The factors affecting groundwater quality were the input variables for the simulation, whereas GWQI index was the output. The developed model was validated to simulate groundwater quality. Network validation was performed via comparison between the estimated and actual GWQI values. In GIS, the study area was separated to raster format in the pixel dimensions of 1 km and also by incorporation of input data layers of the Fuzzy Network-CANFIS model; the geo-referenced layers of the effective factors in groundwater quality were earned. Therefore, numeric values of each pixel with geographical coordinates were entered to the Fuzzy Network-CANFIS model and thus simulation of groundwater quality was accessed in the study area. Finally, the simulated GWQI indices using the Fuzzy Network-CANFIS model were entered into GIS, and hence groundwater quality map (raster layer) based on the results of the network simulation was earned. The study's results confirm the high efficiency of incorporation of neuro-fuzzy techniques and GIS. It is also worth noting that the general quality of the groundwater in the most studied plain is fairly low.

Brief Assessment of Parental Perception (BAPP): Development and validation of a new measure for assessing paediatric outcomes after bilateral cochlear implantation.

PubMed

Samuel, V; Gamble, C; Cullington, H; Bathgate, F; Bennett, E; Coop, N; Cropper, J; Emond, A; Kentish, R; Edwards, L

2016-11-01

In contrast to previous clinical practice, current guidelines recommend bilateral cochlear implantation in children, resulting in a cohort of children who initially received one implant, but have subsequently had a second, contralateral implant. This study aimed to explore satisfaction and quality of life in children implanted simultaneously or sequentially. A novel measure of satisfaction and quality of life following paediatric bilateral cochlear implantation (the Brief Assessment of Parental Perception; BAPP) was developed and preliminary validation undertaken as part of a large, national project of bilateral implantation. Children's parents completed the measure yearly for up to three years following implantation. Children from 14 UK implant centres were recruited into the study; data were available for 410 children one year post-implantation. The BAPP was found to have good face and convergent validity, and internal consistency. Results indicated very high levels of satisfaction with the devices, and improvements in quality of life. However there was evidence that children implanted sequentially were less willing to wear their second implant in the first two years than those children receiving simultaneous implants. Simultaneous and sequential cochlear implants have a positive impact on the quality of life of deaf children.

Behavioral Indicators on a Mobile Sensing Platform Predict Clinically Validated Psychiatric Symptoms of Mood and Anxiety Disorders

PubMed Central

Place, Skyler; Rubin, Channah; Gorrostieta, Cristina; Mead, Caroline; Kane, John; Marx, Brian P; Feast, Joshua; Deckersbach, Thilo; Pentland, Alex “Sandy”; Nierenberg, Andrew; Azarbayejani, Ali

2017-01-01

Background There is a critical need for real-time tracking of behavioral indicators of mental disorders. Mobile sensing platforms that objectively and noninvasively collect, store, and analyze behavioral indicators have not yet been clinically validated or scalable. Objective The aim of our study was to report on models of clinical symptoms for post-traumatic stress disorder (PTSD) and depression derived from a scalable mobile sensing platform. Methods A total of 73 participants (67% [49/73] male, 48% [35/73] non-Hispanic white, 33% [24/73] veteran status) who reported at least one symptom of PTSD or depression completed a 12-week field trial. Behavioral indicators were collected through the noninvasive mobile sensing platform on participants’ mobile phones. Clinical symptoms were measured through validated clinical interviews with a licensed clinical social worker. A combination hypothesis and data-driven approach was used to derive key features for modeling symptoms, including the sum of outgoing calls, count of unique numbers texted, absolute distance traveled, dynamic variation of the voice, speaking rate, and voice quality. Participants also reported ease of use and data sharing concerns. Results Behavioral indicators predicted clinically assessed symptoms of depression and PTSD (cross-validated area under the curve [AUC] for depressed mood=.74, fatigue=.56, interest in activities=.75, and social connectedness=.83). Participants reported comfort sharing individual data with physicians (Mean 3.08, SD 1.22), mental health providers (Mean 3.25, SD 1.39), and medical researchers (Mean 3.03, SD 1.36). Conclusions Behavioral indicators passively collected through a mobile sensing platform predicted symptoms of depression and PTSD. The use of mobile sensing platforms can provide clinically validated behavioral indicators in real time; however, further validation of these models and this platform in large clinical samples is needed. PMID:28302595

Development and application of a tyrosinase-based time-temperature indicator (TTI) for determining the quality of turbot sashimi

NASA Astrophysics Data System (ADS)

Xu, Fengjuan; Ge, Lei; Li, Zhenxing; Lin, Hong; Mao, Xiangzhao

2017-10-01

Time-temperature indicators (TTIs) are convenient intuitive devices that are widely used to predict food quality. The aim of this study is to develop a new simple device which can be attached to food packages as a quality indicator for turbot sashimi. In this study, a solid TTI based on the reaction between tyrosinase and tyrosine was developed. The Arrhenius behavior of this enzymatic TTI was studied. The kinetics of the tyrosinase-based TTI was investigated in the form of color change from colorless to dark black induced by the enzymatic reaction. The mathematical formula for the color alterations as a function of time and temperature was established. The longest indication time for the developed TTI was 50 hours at 4°C. The activation energy of the tyrosinase-based TTI was 0.409 kJ mol-1. The suitability of the tyrosinase-based TTI was validated for turbot sashimi using total plate count. The feasibility of using this TTI as a quality indicator for turbot sashimi was assessed based on the activation energy and indication time. Therefore, the tyrosinasebased TTI system developed in this study could be used as an effective tool for monitoring the quality changes of turbot sashimi during the distribution and storage.

Psychometric testing of the Spiritual Well-Being Scale-Mandarin version in Taiwanese cancer patients.

PubMed

Tang, Woung-Ru; Kao, Chen-Yi

2017-06-01

The spiritual well-being of terminally ill cancer patients is an important indicator of the quality of their lives and of the quality of hospice care, but no validated tools are available for assessing this indicator in Taiwan. The present cross-sectional study validated the Spiritual Well-Being Scale-Mandarin version (SWBS-M) by testing its psychometric properties in 243 cancer patients from five teaching hospitals throughout Taiwan. Construct validity was tested by factor analysis and hypothesis testing. Patients' spiritual well-being and quality of life were assessed using the SWBS-M and the McGill Quality of Life Questionnaire (MQoL), respectively. Overall, the SWBS-M had an internal consistency/reliability of 0.89. Exploratory factor analysis showed that the SWBS-M had an underlying two-factor structure, explaining 46.94% of the variance. SWBS-M scores correlated moderately with MQoL scores (r = 0.48, p < 0.01). Terminally ill cancer patients' spiritual well-being was inversely related to their average pain level during the previous 24 hours (r = -0.183, p = 0.006). Cancer patients' spiritual well-being also differed significantly with their experience of pain (t = -3.67, p < 0.001); terminally ill cancer patients with pain during the previous 24 hours had a lower sense of spiritual well-being than those without pain. Our findings support a two-factor model for the SWBS-M in terminally ill Taiwanese cancer patients. We recommend testing the psychometric properties of the SWBS-M in different patient populations to verify its factorial structure in other Asian countries.

Health-related quality of life for pediatric emergency department febrile illnesses: an evaluation of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales.

PubMed

Mistry, Rakesh D; Stevens, Molly W; Gorelick, Marc H

2009-01-29

We sought to assess the validity and short-term responsiveness of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales (PedsQL) for febrile illnesses evaluated in the pediatric emergency department (ED). Prospective cohort study of children 2-18 years discharged after ED evaluation for fever (>or= 38 degrees C). Self-administered, parent-report of health-related quality of life (HRQOL) was assessed using the PedsQL Acute Version, a validated HRQOL instrument. HRQOL was measured on ED presentation and at 7-10 day follow-up. At follow-up, duration of fever, child functional impairment, missed daycare/school, and disrupted family unit functioning, were assessed. Of 160 subjects enrolled, 97 (61%) completed the study; mean follow-up was 8.7 days. Mean total HRQOL score on ED presentation was 76.4; mean follow-up score was 86.3. Compared to subjects that returned to baseline, statistically significant differences in HRQOL were noted for those with prolonged fever, child functional impairment, and relapse. Significant correlation was observed between HRQOL at follow-up and days of daycare/school missed (r = -0.35, p = .003) and days of family disruption (r = -0.43, p < .001). Mean change in HRQOL within subjects, from ED visit to follow-up, was +9.8 (95% CI: 5.6-14.6). Effect size was 0.53, indicating moderate responsiveness. The PedsQL appears to be a valid and responsive indicator of HRQOL for short-term febrile illnesses evaluated in the ED.

[Creation and validation of the scale for measuring quality of life in patients with cancer: Puerto Rican version (ECVCA-PR). ].

PubMed

Sanoguet, Janelly Muriel; Gómez, José Rodríguez

2013-01-01

The aim of this pioneer study is to begin to create and validate a scale to measure Quality of Life in cancer patients in Puerto Rico (ECVCA-PR) in order to provide local health professionals with a reliable instrument that help to measure attitudes that could affect different patient's quality of life aspects and allows knowing the needs of those cancer patients. Sample consisted of 32 patients (9 men, 23 women), between ages of 30 to 83 years that were receiving services (i.e., hospitalization, treatment, and follow up) at Dr. Isaac González Martínez Oncological Hospital in San Juan, Puerto Rico. The psychometric properties of the instrument indicate a reliability index (Cronbach's Alpha) of 0.927 with 164 items, an excellent index according to the literature.

Nurse Reported Quality of Care: A Measure of Hospital Quality

PubMed Central

McHugh, Matthew D.; Stimpfel, Amy Witkoski

2013-01-01

As the primary providers of round-the-clock bedside care, nurses are well positioned to report on hospital quality of care. Researchers have not examined how nurses’ reports of quality correspond with standard process or outcomes measures of quality. We assess the validity of evaluating hospital quality by aggregating hospital nurses’ responses to a single item that asks them to report on quality of care. We found that a 10% increment in the proportion of nurses reporting excellent quality of care was associated with lower odds of mortality and failure to rescue; greater patient satisfaction; and higher composite process of care scores for acute myocardial infarction, pneumonia, and surgical patients. Nurse reported quality of care is a useful indicator of hospital performance. PMID:22911102

Validation of the Italian version of the Laval questionnaire: health-related quality of life in subjects with obesity.

PubMed

Donini, Lorenzo Maria; Rosano, Aldo; Di Lazzaro, Luca; Poggiogalle, Eleonora; Lubrano, Carla; Migliaccio, Silvia; Carbonelli, Mariagrazia; Pinto, Alessandro; Lenzi, Andrea

2017-05-15

Obesity is associated to increased risk of metabolic comorbidity as well as increased mortality. Notably, obesity is also associated to the impairment of the psychological status and of quality of life. Only three questionnaires are available in the Italian language evaluating the health-related quality of life in subjects with obesity. The aim of the present study was to test the validity and reliability of the Italian version of the Laval Questionnaire. The original French version was translated into Italian and back-translated by a French native speaker. 273 subjects with obesity (Body Mass Index ≥ 30 kg/m 2 ) were enrolled; the Italian version of the Laval Questionnaire and the O.R.Well-97 questionnaire were administered in order to assess health- related quality of life. The Laval questionnaire consists of 44 items distributed in 6 domains (symptoms, activity/mobility, personal hygiene/clothing, emotions, social interaction, sexual life). Disability and overall psychopathology levels were assessed through the TSD-OC test (SIO test for obesity correlated disabilities) and the SCL-90 (Symptom Checklist-90) questionnaire, respectively. To verify the validity of the Italian version, the analysis of internal consistency, test-retest reliability, and construct validity were performed. The observed proportion of agreement concordance of results was 50.2% with Cohen's K = 0.336 (CI 95%: 0.267-0.404), indicating a fair agreement between the two tests. Test-retest correlation was statistically significant (ρ = 0.82; p < 0.01); validity (standardized Chronbach's alpha) was considered reliable (α > 0.70). The analysis of construct validity showed a statistically significant association in terms of both total score (ρ = -0.66) and scores at each single domain (p < 0.01). A high correlation (p < 0.01) was observed between Laval questionnaire total and single domain scores and other related measures (Body Mass Index, TSD-OC scores, SCL-90 global severity index), revealing a high construct validity of the test. The Italian version of the Laval Questionnaire is a valid and reliable measure to assess the health-related quality of life in subjects with obesity.

The ProQOL-21: A revised version of the Professional Quality of Life (ProQOL) scale based on Rasch analysis

PubMed Central

Rees, Clare S.; Hegney, Desley G.

2018-01-01

The Professional Quality of Life scale is a measure intended to provide practitioners and researchers with an indication of a caring professional’s compassion satisfaction, burnout, and secondary traumatic stress. While this measure has been used extensively in nursing research, owing to the relevancy of patient-care associated satisfaction and fatigue within this profession, information regarding the construct validity of this measure is less well represented in the literature. We examined the construct validity of the Professional Quality of Life scale using a Rasch analysis procedure on each of its three scales, as a means of substantiating their measurement adequacy. Responses on the Professional Quality of Life scale from 1615 registered nurses (age x̅ = 46.48 years, SD = 11.78) were analysed. While support for the measurement adequacy (invariance, person/item fit, and unidimensionality) of the compassion satisfaction scale was found, the burnout and secondary traumatic stress scales did not demonstrate adequate measurement properties. We instead present an alternative measurement model of these subscales, involving items from each, to form a robust measure of compassion fatigue, and provide recoding, scoring, and normed scores for both measures. Our findings indicate that use of the Professional Quality of Life scale’s burnout and secondary traumatic stress scales may require caution, while our revised compassion satisfaction and fatigue scales provide robust measurement options for practitioners and researchers. PMID:29489875

The ProQOL-21: A revised version of the Professional Quality of Life (ProQOL) scale based on Rasch analysis.

PubMed

Heritage, Brody; Rees, Clare S; Hegney, Desley G

2018-01-01

The Professional Quality of Life scale is a measure intended to provide practitioners and researchers with an indication of a caring professional's compassion satisfaction, burnout, and secondary traumatic stress. While this measure has been used extensively in nursing research, owing to the relevancy of patient-care associated satisfaction and fatigue within this profession, information regarding the construct validity of this measure is less well represented in the literature. We examined the construct validity of the Professional Quality of Life scale using a Rasch analysis procedure on each of its three scales, as a means of substantiating their measurement adequacy. Responses on the Professional Quality of Life scale from 1615 registered nurses (age x̅ = 46.48 years, SD = 11.78) were analysed. While support for the measurement adequacy (invariance, person/item fit, and unidimensionality) of the compassion satisfaction scale was found, the burnout and secondary traumatic stress scales did not demonstrate adequate measurement properties. We instead present an alternative measurement model of these subscales, involving items from each, to form a robust measure of compassion fatigue, and provide recoding, scoring, and normed scores for both measures. Our findings indicate that use of the Professional Quality of Life scale's burnout and secondary traumatic stress scales may require caution, while our revised compassion satisfaction and fatigue scales provide robust measurement options for practitioners and researchers.

The predictive validity of quality of evidence grades for the stability of effect estimates was low: a meta-epidemiological study.

PubMed

Gartlehner, Gerald; Dobrescu, Andreea; Evans, Tammeka Swinson; Bann, Carla; Robinson, Karen A; Reston, James; Thaler, Kylie; Skelly, Andrea; Glechner, Anna; Peterson, Kimberly; Kien, Christina; Lohr, Kathleen N

2016-02-01

To determine the predictive validity of the U.S. Evidence-based Practice Center (EPC) approach to GRADE (Grading of Recommendations Assessment, Development and Evaluation). Based on Cochrane reports with outcomes graded as high quality of evidence (QOE), we prepared 160 documents which represented different levels of QOE. Professional systematic reviewers dually graded the QOE. For each document, we determined whether estimates were concordant with high QOE estimates of the Cochrane reports. We compared the observed proportion of concordant estimates with the expected proportion from an international survey. To determine the predictive validity, we used the Hosmer-Lemeshow test to assess calibration and the C (concordance) index to assess discrimination. The predictive validity of the EPC approach to GRADE was limited. Estimates graded as high QOE were less likely, estimates graded as low or insufficient QOE more likely to remain stable than expected. The EPC approach to GRADE could not reliably predict the likelihood that individual bodies of evidence remain stable as new evidence becomes available. C-indices ranged between 0.56 (95% CI, 0.47 to 0.66) and 0.58 (95% CI, 0.50 to 0.67) indicating a low discriminatory ability. The limited predictive validity of the EPC approach to GRADE seems to reflect a mismatch between expected and observed changes in treatment effects as bodies of evidence advance from insufficient to high QOE. Copyright © 2016 Elsevier Inc. All rights reserved.

A systematic approach towards the development of quality indicators for postnatal care after discharge in Flanders, Belgium.

PubMed

Helsloot, Kaat; Walraevens, Mieke; Besauw, Saskia Van; Van Parys, An-Sofie; Devos, Hanne; Holsbeeck, Ann Van; Roelens, Kristien

2017-05-01

to develop a set of quality indicators for postnatal care after discharge from the hospital, using a systematic approach. key elements of qualitative postnatal care were defined by performing a systematic review and the literature was searched for potential indicators (step 1). The potential indicators were evaluated by five criteria (validity, reliability, sensitivity, feasibility and acceptability) and by making use of the 'Appraisal of Guidelines for Research and Evaluation', the AIRE-instrument (step 2). In a modified Delphi-survey, the quality indicators were presented to a panel of experts in the field of postnatal care using an online tool (step 3). The final results led to a Flemish model of postnatal care (step 4). Flanders, Belgium PARTICIPANTS: health care professionals, representatives of health care organisations and policy makers with expertise in the field of postnatal care. after analysis 57 research articles, 10 reviews, one book and eight other documents resulted in 150 potential quality indicators in seven critical care domains. Quality assessment of the indicators resulted in 58 concept quality indicators which were presented to an expert-panel of health care professionals. After two Delphi-rounds, 30 quality indicators (six structure, 17 process, and seven outcome indicators) were found appropriate to monitor and improve the quality of postnatal care after discharge from the hospital. KEY CONCLUSIONS AND IMPLICATIONS FOR CLINICAL PRACTICE: the quality indicators resulted in a Flemish model of qualitative postnatal care that was implemented by health authorities as a minimum standard in the context of shortened length of stay. Postnatal care should be adjusted to a flexible length of stay and start in pregnancy with an individualised care plan that follows mother and new-born throughout pregnancy, childbirth and postnatal period. Criteria for discharge and local protocols about the organisation and content of care are essential to facilitate continuity of care. Copyright © 2017 Elsevier Ltd. All rights reserved.

Determination of colonoscopy indication from administrative claims data.

PubMed

Ko, Cynthia W; Dominitz, Jason A; Neradilek, Moni; Polissar, Nayak; Green, Pam; Kreuter, William; Baldwin, Laura-Mae

2014-04-01

Colonoscopy outcomes, such as polyp detection or complication rates, may differ by procedure indication. To develop methods to classify colonoscopy indications from administrative data, facilitating study of colonoscopy quality and outcomes. We linked 14,844 colonoscopy reports from the Clinical Outcomes Research Initiative, a national repository of endoscopic reports, to the corresponding Medicare Carrier and Outpatient File claims. Colonoscopy indication was determined from the procedure reports. We developed algorithms using classification and regression trees and linear discriminant analysis (LDA) to classify colonoscopy indication. Predictor variables included ICD-9CM and CPT/HCPCS codes present on the colonoscopy claim or in the 12 months prior, patient demographics, and site of colonoscopy service. Algorithms were developed on a training set of 7515 procedures, then validated using a test set of 7329 procedures. Sensitivity was lowest for identifying average-risk screening colonoscopies, varying between 55% and 86% for the different algorithms, but specificity for this indication was consistently over 95%. Sensitivity for diagnostic colonoscopy varied between 77% and 89%, with specificity between 55% and 87%. Algorithms with classification and regression trees with 7 variables or LDA with 10 variables had similar overall accuracy, and generally lower accuracy than the algorithm using LDA with 30 variables. Algorithms using Medicare claims data have moderate sensitivity and specificity for colonoscopy indication, and will be useful for studying colonoscopy quality in this population. Further validation may be needed before use in alternative populations.

A research review of quality assessment for software

NASA Technical Reports Server (NTRS)

1991-01-01

Measures were recommended to assess the quality of software submitted to the AdaNet program. The quality factors that are important to software reuse are explored and methods of evaluating those factors are discussed. Quality factors important to software reuse are: correctness, reliability, verifiability, understandability, modifiability, and certifiability. Certifiability is included because the documentation of many factors about a software component such as its efficiency, portability, and development history, constitute a class for factors important to some users, not important at all to other, and impossible for AdaNet to distinguish between a priori. The quality factors may be assessed in different ways. There are a few quantitative measures which have been shown to indicate software quality. However, it is believed that there exists many factors that indicate quality and have not been empirically validated due to their subjective nature. These subjective factors are characterized by the way in which they support the software engineering principles of abstraction, information hiding, modularity, localization, confirmability, uniformity, and completeness.

Validation of a Conceptual Quality Framework for Online and Blended Learning with Success Factors and Indicators in Adult Education: A Qualitative Study

ERIC Educational Resources Information Center

Blieck, Yves; Ooghe, Ilse; Zhu, Chang; Depryck, Koen; Struyven, Katrien; Pynoo, Bram; Van Laer, Hilde

2017-01-01

This qualitative study was designed to identify a framework for the quality of OBL in adult education (AE), which are of interest to the needs of students. Following a review of the literature, we opted for the theoretical framework as proposed by Ossiannilsson and Landgren (2012). This framework suggests success factors for OBL that are of…

Validation of a digital mammographic unit model for an objective and highly automated clinical image quality assessment.

PubMed

Perez-Ponce, Hector; Daul, Christian; Wolf, Didier; Noel, Alain

2013-08-01

In mammography, image quality assessment has to be directly related to breast cancer indicator (e.g. microcalcifications) detectability. Recently, we proposed an X-ray source/digital detector (XRS/DD) model leading to such an assessment. This model simulates very realistic contrast-detail phantom (CDMAM) images leading to gold disc (representing microcalcifications) detectability thresholds that are very close to those of real images taken under the simulated acquisition conditions. The detection step was performed with a mathematical observer. The aim of this contribution is to include human observers into the disc detection process in real and virtual images to validate the simulation framework based on the XRS/DD model. Mathematical criteria (contrast-detail curves, image quality factor, etc.) are used to assess and to compare, from the statistical point of view, the cancer indicator detectability in real and virtual images. The quantitative results given in this paper show that the images simulated by the XRS/DD model are useful for image quality assessment in the case of all studied exposure conditions using either human or automated scoring. Also, this paper confirms that with the XRS/DD model the image quality assessment can be automated and the whole time of the procedure can be drastically reduced. Compared to standard quality assessment methods, the number of images to be acquired is divided by a factor of eight. Copyright © 2012 IPEM. Published by Elsevier Ltd. All rights reserved.

First quality score for referral letters in gastroenterology-a validation study.

PubMed

Eskeland, Sigrun Losada; Brunborg, Cathrine; Seip, Birgitte; Wiencke, Kristine; Hovde, Øistein; Owen, Tanja; Skogestad, Erik; Huppertz-Hauss, Gert; Halvorsen, Fred-Arne; Garborg, Kjetil; Aabakken, Lars; de Lange, Thomas

2016-10-08

To create and validate an objective and reliable score to assess referral quality in gastroenterology. An observational multicentre study. 25 gastroenterologists participated in selecting variables for a Thirty Point Score (TPS) for quality assessment of referrals to gastroenterology specialist healthcare for 9 common indications. From May to September 2014, 7 hospitals from the South-Eastern Norway Regional Health Authority participated in collecting and scoring 327 referrals to a gastroenterologist. Correlation between the TPS and a visual analogue scale (VAS) for referral quality. The 327 referrals had an average TPS of 13.2 (range 1-25) and an average VAS of 4.7 (range 0.2-9.5). The reliability of the score was excellent, with an intra-rater intraclass correlation coefficient (ICC) of 0.87 and inter-rater ICC of 0.91. The overall correlation between the TPS and the VAS was moderate (r=0.42), and ranged from fair to substantial for the various indications. Mean agreement was good (ICC=0.47, 95% CI (0.34 to 0.57)), ranging from poor to good. The TPS is reliable, objective and shows good agreement with the subjective VAS. The score may be a useful tool for assessing referral quality in gastroenterology, particularly important when evaluating the effect of interventions to improve referral quality. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A new approach for measuring the work and quality of histopathology reporting.

PubMed

Sharma, Vijay; Davey, Jonathan G N; Humphreys, Catherine; Johnston, Peter W

2013-07-01

Cancer datasets drive report quality, but require more work to inform compliant reports. The aim of this study was to correlate the number of words with measures of quality, to examine the impact of the drive for improved quality on the workload of histopathology reporting over time. We examined the first 10 reports of colon, breast, renal, lung and ovarian carcinoma, melanoma resection, nodal lymphoma appendicitis and seborrhoeic keratosis (SK) issued in 1991, 2001 and 2011. Correlations were analysed using Pearson's partial correlation coefficients. Word count increased significantly over time for most specimen types examined. Word count almost always correlated with units of information, indicating that the word count was a good measure of the amount of information contained within the reports; this correlation was preserved following correction for the effect of time. A good correlation with compliance with cancer datasets was also observed, but was weakened or lost following correction for the increase in word count and units of information that occurred between time points. These data indicate that word count could potentially be used as a measure of information content if its integrity and usefulness are continuously validated. Further prospective studies are required to assess and validate this approach. © 2013 John Wiley & Sons Ltd.

Quality of radiotherapy services in post-Soviet countries: An IAEA survey.

PubMed

Rosenblatt, Eduardo; Fidarova, Elena; Ghosh, Sunita; Zubizarreta, Eduardo; Unterkirhere, Olga; Semikoz, Natalia; Sinaika, Valery; Kim, Viktor; Karamyan, Nerses; Isayev, Isa; Akbarov, Kamal; Lomidze, Darejan; Bondareva, Oksana; Tuzlucov, Piotr; Zardodkhonova, Manzura; Tkachev, Sergey; Kislyakova, Marina; Alimov, Jamshid; Pidlubna, Tetiana; Barton, Michael; Mackillop, William

2018-04-25

The quality of radiotherapy services in post-Soviet countries has not yet been studied following a formal methodology. The IAEA conducted a survey using two sets of validated radiation oncology quality indicators (ROIs). Eleven post-Soviet countries were assessed. A coordinator was designated for each country and acted as the liaison between the country and the IAEA. The methodology was a one-time cross-sectional survey using a 58-question tool in Russian. The questionnaire was based on two validated sets of ROIs: for radiotherapy centres, the indicators proposed by Cionini et al., and for data at the country level, the Australasian ROIs. The overall response ratio was 66.3%, but for the Russian Federation, it was 24%. Data were updated on radiotherapy infrastructure and equipment. 256 radiotherapy centres are operating 275 linear accelerators and 337 Cobalt-60 units. 61% of teletherapy machines are older than ten years. Analysis of ROIs revealed significant differences between these countries and radiotherapy practices in the West. Naming, task profile and education programmes of radiotherapy professionals are different than in the West. Most countries need modernization of their radiotherapy infrastructure coupled with adequate staffing numbers and updated education programmes focusing on evidence-based medicine, quality, and safety. Copyright © 2018 Elsevier B.V. All rights reserved.

Validation of the Chinese version of functional assessment of anorexia-cachexia therapy (FAACT) scale for measuring quality of life in cancer patients with cachexia.

PubMed

Zhou, Ting; Yang, Kaixiang; Thapa, Sudip; Fu, Qiang; Jiang, Yongsheng; Yu, Shiying

2017-04-01

The assessment of quality of life (QOL) is an important part of cachexia management for cancer patients. Functional assessment of anorexia-cachexia therapy (FAACT), a specific QOL instrument for cachexia patients, has not been validated in Chinese population. The aim of this study was to validate the FAACT scale in Chinese cancer patients for its future use. Eligible cancer patients were included in our study. Patients' demographic and clinical characteristics were collected from the electronic medical records. Patients were asked to complete the Chinese version of FAACT scale and the MD Anderson symptom inventory (MDASI), and then the reliability and validity were analyzed. A total of 285 patients were enrolled in our study, data of 241 patients were evaluated. Coefficients of Cronbach's alpha, test-retest and split-half analyses were all greater than 0.8, which indicated an excellent reliability for FAACT scale. In item-subscale correlation analysis and factor analysis, good construct validity for FAACT scale was found. The correlation between FAACT and MDASI interference subscale showed reasonable criterion-related validity, and for further clinical validation, the FAACT scale showed excellent discriminative validity for distinguishing patients in different cachexia status and in different performance status. The Chinese version of FAACT scale has good reliability and validity and is suitable for measuring QOL of cachexia patients in Chinese population.

Development and testing of an assessment instrument for the formative peer review of significant event analyses.

PubMed

McKay, J; Murphy, D J; Bowie, P; Schmuck, M-L; Lough, M; Eva, K W

2007-04-01

To establish the content validity and specific aspects of reliability for an assessment instrument designed to provide formative feedback to general practitioners (GPs) on the quality of their written analysis of a significant event. Content validity was quantified by application of a content validity index. Reliability testing involved a nested design, with 5 cells, each containing 4 assessors, rating 20 unique significant event analysis (SEA) reports (10 each from experienced GPs and GPs in training) using the assessment instrument. The variance attributable to each identified variable in the study was established by analysis of variance. Generalisability theory was then used to investigate the instrument's ability to discriminate among SEA reports. Content validity was demonstrated with at least 8 of 10 experts endorsing all 10 items of the assessment instrument. The overall G coefficient for the instrument was moderate to good (G>0.70), indicating that the instrument can provide consistent information on the standard achieved by the SEA report. There was moderate inter-rater reliability (G>0.60) when four raters were used to judge the quality of the SEA. This study provides the first steps towards validating an instrument that can provide educational feedback to GPs on their analysis of significant events. The key area identified to improve instrument reliability is variation among peer assessors in their assessment of SEA reports. Further validity and reliability testing should be carried out to provide GPs, their appraisers and contractual bodies with a validated feedback instrument on this aspect of the general practice quality agenda.

Are performance indicators used for hospital quality management: a qualitative interview study amongst health professionals and quality managers in The Netherlands.

PubMed

Botje, Daan; Ten Asbroek, Guus; Plochg, Thomas; Anema, Helen; Kringos, Dionne S; Fischer, Claudia; Wagner, Cordula; Klazinga, Niek S

2016-10-13

Hospitals are under increasing pressure to share indicator-based performance information. These indicators can also serve as a means to promote quality improvement and boost hospital performance. Our aim was to explore hospitals' use of performance indicators for internal quality management activities. We conducted a qualitative interview study among 72 health professionals and quality managers in 14 acute care hospitals in The Netherlands. Concentrating on orthopaedic and oncology departments, our goal was to gain insight into data collection and use of performance indicators for two conditions: knee and hip replacement surgery and breast cancer surgery. The semi-structured interviews were recorded and summarised. Based on the data, themes were synthesised and the analyses were executed systematically by two analysts independently. The findings were validated through comparison. The hospitals we investigated collect data for performance indicators in different ways. Similarly, these hospitals have different ways of using such data to support their quality management, while some do not seem to use the data for this purpose at all. Factors like 'linking pin champions', pro-active quality managers and engaged medical specialists seem to make a difference. In addition, a comprehensive hospital data infrastructure with electronic patient records and robust data collection software appears to be a prerequisite to produce reliable external performance indicators for internal quality improvement. Hospitals often fail to use performance indicators as a means to support internal quality management. Such data, then, are not used to its full potential. Hospitals are recommended to focus their human resource policy on 'linking pin champions', the engagement of professionals and a pro-active quality manager, and to invest in a comprehensive data infrastructure. Furthermore, the differences in data collection processes between Dutch hospitals make it difficult to draw comparisons between outcomes of performance indicators.

International validation of quality indicators for evaluating priority setting in low income countries: process and key lessons.

PubMed

Kapiriri, Lydia

2017-06-19

While there have been efforts to develop frameworks to guide healthcare priority setting; there has been limited focus on evaluation frameworks. Moreover, while the few frameworks identify quality indicators for successful priority setting, they do not provide the users with strategies to verify these indicators. Kapiriri and Martin (Health Care Anal 18:129-147, 2010) developed a framework for evaluating priority setting in low and middle income countries. This framework provides BOTH parameters for successful priority setting and proposes means of their verification. Before its use in real life contexts, this paper presents results from a validation process of the framework. The framework validation involved 53 policy makers and priority setting researchers at the global, national and sub-national levels (in Uganda). They were requested to indicate the relative importance of the proposed parameters as well as the feasibility of obtaining the related information. We also pilot tested the proposed means of verification. Almost all the respondents evaluated all the parameters, including the contextual factors, as 'very important'. However, some respondents at the global level thought 'presence of incentives to comply', 'reduced disagreements', 'increased public understanding,' 'improved institutional accountability' and 'meeting the ministry of health objectives', which could be a reflection of their levels of decision making. All the proposed means of verification were assessed as feasible with the exception of meeting observations which would require an insider. These findings results were consistent with those obtained from the pilot testing. These findings are relevant to policy makers and researchers involved in priority setting in low and middle income countries. To the best of our knowledge, this is one of the few initiatives that has involved potential users of a framework (at the global and in a Low Income Country) in its validation. The favorable validation of all the parameters at the national and sub-national levels implies that the framework has potential usefulness at those levels, as is. The parameters that were disputed at the global level necessitate further discussion when using the framework at that level. The next step is to use the validated framework in evaluating actual priority setting at the different levels.

Cluster designs to assess the prevalence of acute malnutrition by lot quality assurance sampling: a validation study by computer simulation.

PubMed

Olives, Casey; Pagano, Marcello; Deitchler, Megan; Hedt, Bethany L; Egge, Kari; Valadez, Joseph J

2009-04-01

Traditional lot quality assurance sampling (LQAS) methods require simple random sampling to guarantee valid results. However, cluster sampling has been proposed to reduce the number of random starting points. This study uses simulations to examine the classification error of two such designs, a 67x3 (67 clusters of three observations) and a 33x6 (33 clusters of six observations) sampling scheme to assess the prevalence of global acute malnutrition (GAM). Further, we explore the use of a 67x3 sequential sampling scheme for LQAS classification of GAM prevalence. Results indicate that, for independent clusters with moderate intracluster correlation for the GAM outcome, the three sampling designs maintain approximate validity for LQAS analysis. Sequential sampling can substantially reduce the average sample size that is required for data collection. The presence of intercluster correlation can impact dramatically the classification error that is associated with LQAS analysis.

A Chinese Mandarin translation and validation of the Myocardial Infarction Dimensional Assessment Scale (MIDAS).

PubMed

Wang, W; Lopez, V; Thompson, D R

2006-09-01

To evaluate the validity, reliability, and cultural relevance of the Chinese Mandarin version of Myocardial Infarction Dimensional Assessment Scale (MIDAS) as a disease-specific quality of life measure. The cultural relevance and content validity of the Chinese Mandarin version of the MIDAS (CM-MIDAS) was evaluated by an expert panel. Measurement performance was tested on 180 randomly selected Chinese MI patents. Thirty participants from the primary group completed the CM-MIDAS for test-retest reliability after 2 weeks. Reliability, validity and discriminatory power of the CM-MIDAS were calculated. Two items were modified as suggested by the expert panel. The overall CM-MIDAS had acceptable internal consistency with Cronbach's alpha coefficient 0.93 for the scale and 0.71-0.94 for the seven domains. Test-retest reliability by intraclass correlations was 0.85 for the overall scale and 0.74-0.94 for the seven domains. There was acceptable concurrent validity with significant (p < 0.05) correlations between the CM-MDAS and the Chinese Version of the Short Form 36. The principal components analysis extracted seven factors that explained 67.18% of the variance with high factor loading indicating good construct validity. Empirical data support CM-MIDAS as a valid and reliable disease-specific quality of life measure for Chinese Mandarin speaking patients with myocardial infarction.

Systematic review of studies of staffing and quality in nursing homes.

PubMed

Bostick, Jane E; Rantz, Marilyn J; Flesner, Marcia K; Riggs, C Jo

2006-07-01

To evaluate a range of staffing measures and data sources for long-term use in public reporting of staffing as a quality measure in nursing homes. Eighty-seven research articles and government documents published from 1975 to 2003 were reviewed and summarized. Relevant content was extracted and organized around 3 themes: staffing measures, quality measures, and risk adjustment variables. Data sources for staffing information were also identified. There is a proven association between higher total staffing levels (especially licensed staff) and improved quality of care. Studies also indicate a significant relationship between high turnover and poor resident outcomes. Functional ability, pressure ulcers, and weight loss are the most sensitive quality indicators linked to staffing. The best national data sources for staffing and quality include the Minimum Data Set (MDS) and On-line Survey and Certification Automated Records (OSCAR). However, the accuracy of this self-reported information requires further reliability and validity testing. A nationwide instrument needs to be developed to accurately measure staff turnover. Large-scale studies using payroll data to measure staff retention and its impact on resident outcomes are recommended. Future research should use the most nurse-sensitive quality indicators such as pressure ulcers, functional status, and weight loss.

Nursing Home Administrator Quality Improvement Self-Efficacy Scale.

PubMed

Siegel, Elena O; Zisberg, Anna; Bakerjian, Debra; Zysberg, Leehu

Nursing home (NH) quality improvement (QI) is challenging. The critical role of NH leaders in successful QI is well established; however, current options for assessing the QI capabilities of leaders such as the licensed NH administrator are limited. This article presents the development and preliminary validation of an instrument to measure NH administrator self-efficacy in QI. We used a mixed-methods cross-sectional design to develop and test the measure. For item generation, 39 NH leaders participated in qualitative interviews. Item reduction and content validity were established with a sample of eight subject matter experts. A random sample of 211 administrators from NHs with the lowest and highest Centers for Medicare and Medicaid Services Five-Star Quality ratings completed the measure. We conducted exploratory and confirmatory factor analyses and tested the measure for internal reliability and convergent, discriminant, and known group validity. The final measure included five subscales and 32 items. Confirmatory factor analysis reaffirmed the factorial structure with good fit indices. The new measure's subscales correlated with valid measures of self-efficacy and locus of control, supporting the measure's convergent and discriminant validity. Significant differences in most of the subscales were found between the objective (Centers for Medicare and Medicaid Services Five-Star Quality rating) and subjective (Self-Rated Facility QI Index) quality outcomes, supporting the measure's known group validity. The instrument has usefulness to both NH organizations and individual NH administrators as a diagnostic tool to identify administrators with higher/lower chances of successfully implementing QI. Organizations and individuals can use this diagnostic to identify the administrator's professional development needs for QI, in general, and specific to the instrument's five subscales, informing directions for in-house training, mentoring, and outside professional development. Attending to NH administrators' QI professional development needs prior to implementing QI holds promise to enhance the chances for successful implementation of QI, which is urgently needed in many NHs.

Cross-Cultural Validation of the Korean Version of the Chalder Fatigue Scale.

PubMed

Ha, Hyeju; Jeong, Donghee; Hahm, Bong-Jin; Shim, Eun-Jung

2018-06-01

University students are vulnerable to fatigue. If not adequately dealt with, fatigue might develop into various health problems and negatively affect quality of life (QOL). The present study examined psychometric properties of the Korean version of the Chalder Fatigue Scale (K-CFQ) in university students. Data were obtained from two samples of undergraduate students in Korea. The first dataset (N = 557) was collected in a cross-sectional survey in 2015 and the second dataset (N = 338) from a longitudinal survey with three time points over a semester period in 2016. Participants completed measures of fatigue, QOL, depression, anxiety, and sleep quality. Three-factor model (physical fatigue, low energy, and mental fatigue) rather than the original two-factor model (physical and mental fatigue) provided a better goodness of fit indices to the data. Internal consistency of the K-CFQ was satisfactory, with Cronbach's α value of 0.88 for the total scale and those of subscales ranging from 0.73 to 0.87. Its convergent validity was supported by its significant association with anxiety, depression, sleep quality, and QOL. Significant association between T1 K-CFQ with physical QOL at T2 and T3 supported its predictive validity. Its known-group validity was proven with higher K-CFQ scores observed in the participants with depression and those with poor sleep quality. Current results suggest that K-CFQ is a valid and reliable measure of fatigue, and a better model fit of the three-factor structure of the K-CFQ implies potential cross-cultural differences in the dimensionality of fatigue.

Using quality indicators in anaesthesia: feeding back data to improve care.

PubMed

Benn, J; Arnold, G; Wei, I; Riley, C; Aleva, F

2012-07-01

After recent UK policy developments, considerable attention has been focused upon how clinical specialties measure and report on the quality of care delivered to patients. Defining the right indicators alone is insufficient to close the feedback loop. This narrative review aims to describe and synthesize a diverse body of research relevant to the question of how information from quality indicators can be fed back and used effectively to improve care. Anaesthesia poses certain challenges in the identification of valid outcome indicators sensitive to variations in anaesthetic care. Metrics collected during the immediate post-anaesthetic recovery period, such as patient temperature, patient-reported quality of recovery, and pain and nausea, provide potentially useful information for the anaesthetist, yet this information is not routinely fed back. Reviews of the effects of feeding back performance data to healthcare providers suggest that this may result in small to moderate positive effects upon outcomes and professional practice, with stronger effects where feedback is integrated within a broader quality improvement strategy. The dominant model for use of data within quality improvement is based upon the industrial process control approach, in which care processes are monitored continuously for process changes which are rapidly detectable for corrective action. From this review and experience of implementing these principles in practice, effective feedback from quality indicators is timely, credible, confidential, tailored to the recipient, and continuous. Considerable further work is needed to understand how information from quality indicators can be fed back in an effective way to clinicians and clinical units, in order to support revalidation and continuous improvement.

Reliability and validity assessment of administrative databases in measuring the quality of rectal cancer management.

PubMed

Corbellini, Carlo; Andreoni, Bruno; Ansaloni, Luca; Sgroi, Giovanni; Martinotti, Mario; Scandroglio, Ildo; Carzaniga, Pierluigi; Longoni, Mauro; Foschi, Diego; Dionigi, Paolo; Morandi, Eugenio; Agnello, Mauro

2018-01-01

Measurement and monitoring of the quality of care using a core set of quality measures are increasing in health service research. Although administrative databases include limited clinical data, they offer an attractive source for quality measurement. The purpose of this study, therefore, was to evaluate the completeness of different administrative data sources compared to a clinical survey in evaluating rectal cancer cases. Between May 2012 and November 2014, a clinical survey was done on 498 Lombardy patients who had rectal cancer and underwent surgical resection. These collected data were compared with the information extracted from administrative sources including Hospital Discharge Dataset, drug database, daycare activity data, fee-exemption database, and regional screening program database. The agreement evaluation was performed using a set of 12 quality indicators. Patient complexity was a difficult indicator to measure for lack of clinical data. Preoperative staging was another suboptimal indicator due to the frequent missing administrative registration of tests performed. The agreement between the 2 data sources regarding chemoradiotherapy treatments was high. Screening detection, minimally invasive techniques, length of stay, and unpreventable readmissions were detected as reliable quality indicators. Postoperative morbidity could be a useful indicator but its agreement was lower, as expected. Healthcare administrative databases are large and real-time collected repositories of data useful in measuring quality in a healthcare system. Our investigation reveals that the reliability of indicators varies between them. Ideally, a combination of data from both sources could be used in order to improve usefulness of less reliable indicators.

Validation of the Spine Oncology Study Group-Outcomes Questionnaire to assess quality of life in patients with metastatic spine disease.

PubMed

Janssen, Stein J; Teunis, Teun; van Dijk, Eva; Ferrone, Marco L; Shin, John H; Hornicek, Francis; Schwab, Joseph H

2017-06-01

General questionnaires are often used to assess quality of life in patients with spine metastases, although a disease-specific survey did not exist until recently. The Spine Oncology Study Group has developed an outcomes questionnaire (SOSG-OQ) to measure quality of life in these patients. However, a scoring system was not developed, and the questionnaire was not validated in a group of patients, nor was it compared with other general quality of life questionnaires such as the EuroQol 5 Dimensions (EQ-5D) questionnaire. Our primary null hypothesis is that there is no association between the SOSG-OQ and EQ-5D. Our secondary null hypothesis is that there is no difference in coverage and internal consistency between the SOSG-OQ and EQ-5D. We also assess coverage, consistency, and validity of the domains within the SOSG-OQ. A survey study from a tertiary care spine referral center was used for this study. The patient sample consisted of 82 patients with spine metastases, myeloma, or lymphoma. The SOSG-OQ (27 questions, 6 domains) score ranges from 0 to 80, with a higher score indicating worse quality of life. The EQ-5D (5 questions, 5 domains) index score ranges from 0 to 1, with a higher score indicating better quality of life. The association between the SOSG-OQ and EQ-5D index score was assessed using the Spearman rank correlation. Instrument coverage and precision were assessed by determining item completion rate, median score with range, and floor and ceiling effect. Internal consistency was assessed using Cronbach alpha. Multitrait analysis and exploratory factor analysis were used to analyze properties of the individual domains in the SOSG-OQ. The Spearman rank correlation between the SOSG-OQ and EQ-5D questionnaire was high (r=-0.83, p<.001). Internal consistency of the SOSG-OQ (0.92, 95% CI: 0.89-0.94) was higher as compared to the internal consistency of the EQ-5D (0.73, 95% CI: 0.63-0.84; p<.001). The SOSG-OQ score had no floor or ceiling effect indicating good coverage (median 30, range 3-64), whereas the EQ-5D had a ceiling effect of 10% (median 0.71, range 0.05-1). In conclusion, our study proposes a scoring methodology-after reversing four inversely scored items-for the SOSG-OQ and shows that the questionnaire is a valid tool for the assessment of quality of life in patients with metastatic spine disease. The SOSG-OQ is superior to the EQ-5D in terms of coverage and internal consistency but consists of more questions. Copyright © 2015 Elsevier Inc. All rights reserved.

A pressure ulcer and fall rate quality composite index for acute care units: A measure development study.

PubMed

Boyle, Diane K; Jayawardhana, Ananda; Burman, Mary E; Dunton, Nancy E; Staggs, Vincent S; Bergquist-Beringer, Sandra; Gajewski, Byron J

2016-11-01

Composite indices are single measures that combine the strengths of two or more individual measures and provide broader, easy-to-use measures for evaluation of provider performance and comparisons across units and hospitals to support quality improvement. The study objective was to develop a unit-level inpatient composite nursing care quality performance index-the Pressure Ulcer and Fall Rate Quality Composite Index. Two-phase measure development study. 5144 patient care units in 857 United States hospitals participating in the National Database of Nursing Quality Indictors ® during the year 2013. The Pressure Ulcer and Fall Rate Quality Composite Index was developed in two phases. In Phase 1 the formula was generated using a utility function and generalized penalty analysis. Experts with experience in healthcare quality measurement provided the point of indicator equivalence. In Phase 2 initial validity evidence was gathered based on hypothesized relationships between the Pressure Ulcer and Fall Rate Quality Composite Index and other variables using two-level (unit, hospital) hierarchical linear mixed modeling. The Pressure Ulcer and Fall Rate Quality Composite Index=100-PUR-FR, where PUR is pressure ulcer rate and FR is total fall rate. Higher scores indicate better quality. Bland-Altman plots demonstrated agreement between pairs of experts and provided evidence for inter-rater reliability of the formula. The validation process demonstrated that higher registered nurse skill mix, higher percent of registered nurses with a baccalaureate in nursing or higher degree, higher percent of registered nurses with national specialty certification, and lower percent of hours supplied by agency staff were significantly associated with higher Pressure Ulcer and Fall Rate Quality Composite Index scores. Higher percentages of unit patients at risk for a hospital-acquired pressure ulcer and higher unit rates of physical restraint use were not associated with higher Pressure Ulcer and Fall Rate Quality Composite Index scores. The Pressure Ulcer and Fall Rate Quality Composite Index is a step toward providing a more holistic perspective of unit level nursing quality than individual measures and may help nurses nursing administrators obtain a broader view of which patient care units are the higher and lower performers. Further study is needed to examine the usability of the Pressure Ulcer and Fall Rate Quality Composite Index. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

A PRESSURE ULCER AND FALL RATE QUALITY COMPOSITE INDEX FOR ACUTE CARE UNITS: A MEASURE DEVELOPMENT STUDY

PubMed Central

Jayawardhana, Ananda; Burman, Mary E.; Dunton, Nancy E.; Staggs, Vincent S.; Bergquist-Beringer, Sandra; Gajewski, Byron J.

2016-01-01

Background Composite indices are single measures that combine the strengths of two or more individual measures and provide broader, easy-to-use measures for evaluation of provider performance and comparisons across units and hospitals to support quality improvement. Objective The study objective was to develop a unit-level inpatient composite nursing care quality performance index – the Pressure Ulcer and Fall Rate Quality Composite Index. Design Two-phase measure development study. Settings 5,144 patient care units in 857 United States hospitals participating in the National Database of Nursing Quality Indictors® during the year 2013. Methods The Pressure Ulcer and Fall Rate Quality Composite Index was developed in two phases. In Phase 1 the formula was generated using a utility function and generalized penalty analysis. Experts with experience in healthcare quality measurement provided the point of indicator equivalence. In Phase 2 initial validity evidence was gathered based on hypothesized relationships between the Pressure Ulcer and Fall Rate Quality Composite Index and other variables using two-level (unit, hospital) hierarchical linear mixed modeling. Results The Pressure Ulcer and Fall Rate Quality Composite Index = 100 − PUR − FR, where PUR is pressure ulcer rate and FR is total fall rate. Higher scores indicate better quality. Bland-Altman plots demonstrated agreement between pairs of experts and provided evidence for inter-rater reliability of the formula. The validation process demonstrated that higher registered nurse skill mix, higher percent of registered nurses with a baccalaureate in nursing or higher degree, higher percent of registered nurses with national specialty certification, and lower percent of hours supplied by agency staff were significantly associated with higher Pressure Ulcer and Fall Rate Quality Composite Index scores. Higher percentages of unit patients at risk for a hospital-acquired pressure ulcer and higher unit rates of physical restraint use were not associated with higher Pressure Ulcer and Fall Rate Quality Composite Index scores. Conclusions The Pressure Ulcer and Fall Rate Quality Composite Index is a step toward providing a more holistic perspective of unit level nursing quality than individual measures and may help nurses nursing administrators obtain a broader view of which patient care units are the higher and lower performers. Further study is needed to examine the usability of the Pressure Ulcer and Fall Rate Quality Composite Index. PMID:27607602

Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study.

PubMed

de Leeuw, Robert Adrianus; Walsh, Kieran; Westerman, Michiel; Scheele, Fedde

2018-04-26

The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. ©Robert Adrianus de Leeuw, Kieran Walsh, Michiel Westerman, Fedde Scheele. Originally published in JMIR Medical Education (http://mededu.jmir.org), 26.04.2018.

Validation of the kidney disease quality of life-short form: a cross-sectional study of a dialysis-targeted health measure in Singapore.

PubMed

Joshi, Veena D; Mooppil, Nandakumar; Lim, Jeremy Fy

2010-12-20

In Singapore, the prevalence of end-stage renal disease (ESRD) and the number of people on dialysis is increasing. The impact of ESRD on patient quality of life has been recognized as an important outcome measure. The Kidney Disease Quality Of Life-Short Form (KDQOL-SF™) has been validated and is widely used as a measure of quality of life in dialysis patients in many countries, but not in Singapore. We aimed to determine the reliability and validity of the KDQOL-SF™ for haemodialysis patients in Singapore. From December 2006 through January 2007, this cross-sectional study gathered data on patients ≥21 years old, who were undergoing haemodialysis at National Kidney Foundation in Singapore. We used exploratory factor analysis to determine construct validity of the eight KDQOL-SF™ sub-scales, Cronbach's alpha coefficient to determine internal consistency reliability, correlation of the overall health rating with kidney disease-targeted scales to confirm validity, and correlation of the eight sub-scales with age, income and education to determine convergent and divergent validity. Of 1980 haemodialysis patients, 1180 (59%) completed the KDQOL-SF™. Full information was available for 980 participants, with a mean age of 56 years. The sample was representative of the total dialysis population in Singapore, except Indian ethnicity that was over-represented. The instrument designers' proposed eight sub-scales were confirmed, which together accounted for 68.4% of the variance. All sub-scales had a Cronbach's α above the recommended minimum value of 0.7 to indicate good reliability (range: 0.72 to 0.95), except for Social function (0.66). Correlation of items within subscales was higher than correlation of items outside subscales in 90% of the cases. The overall health rating positively correlated with kidney disease-targeted scales, confirming validity. General health subscales were found to have significant associations with age, income and education, confirming convergent and divergent validity. The psychometric properties of the KDQOL-SF™ resulting from this first-time administration of the instrument support the validity and reliability of the KDQOL-SF™ as a measure of quality of life of haemodialysis patients in Singapore. It is, however, necessary to determine the test-retest reliability of the KDQOL-SF™ among the haemodialysis population of Singapore.

The methodological quality of nurse-sensitive indicators in Dutch hospitals: A descriptive exploratory research study.

PubMed

Kieft, R A M M; Stalpers, D; Jansen, A P M; Francke, A L; Delnoij, D M J

2018-06-01

Nurse-sensitive indicators (NSIs) are increasingly being developed and used to establish quality of nursing care in Western countries. The objective was to gain insights into the methodological quality of mandatory NSIs in Dutch hospitals, including indicators for pain, wound care, malnutrition and delirium. A descriptive exploratory design was used, starting with desk research into publicly available documents and reports describing the development of the NSIs included in this study. We used the validated Appraisal of Indicators through Research and Evaluation (AIRE) instrument to evaluate the methodological quality. Although the purpose and relevance of each individual NSI have been described, no detailed information about the criteria for selecting these topics is available. It is not clear which specific stakeholders participated and how their input was used. We found no information about the process of collecting and compiling scientific evidence. It is unclear whether and to what extent the usability of NSIs has been tested. The methodological quality of NSIs used in Dutch hospitals is less than optimal in various ways and it is therefore questionable if the indicators are accurate enough to identify changes or improve nursing practice. Our study also provides an example of how the methodological quality of NSIs can be assessed systematically, which is relevant considering the increasing use of NSIs in various countries. Copyright © 2018 Elsevier B.V. All rights reserved.

Benchmarking network for clinical and humanistic outcomes in diabetes (BENCH-D) study: protocol, tools, and population.

PubMed

Nicolucci, Antonio; Rossi, Maria C; Pellegrini, Fabio; Lucisano, Giuseppe; Pintaudi, Basilio; Gentile, Sandro; Marra, Giampiero; Skovlund, Soren E; Vespasiani, Giacomo

2014-01-01

In the context of the DAWN-2 initiatives, the BENCH-D Study aims to test a model of regional benchmarking to improve not only the quality of diabetes care, but also patient-centred outcomes. As part of the AMD-Annals quality improvement program, 32 diabetes clinics in 4 Italian regions extracted clinical data from electronic databases for measuring process and outcome quality indicators. A random sample of patients with type 2 diabetes filled in a questionnaire including validated instruments to assess patient-centred indicators: SF-12 Health Survey, WHO-5 Well-Being Index, Diabetes Empowerment Scale, Problem Areas in Diabetes, Health Care Climate Questionnaire, Patients Assessment of Chronic Illness Care, Barriers to Medications, Patient Support, Diabetes Self-care Activities, and Global Satisfaction for Diabetes Treatment. Data were discussed with participants in regional meetings. Main problems, obstacles and solutions were identified through a standardized process, and a regional mandate was produced to drive the priority actions. Overall, clinical indicators on 78,854 patients have been measured; additionally, 2,390 patients filled-in the questionnaire. The regional mandates were officially launched in March 2012. Clinical and patient-centred indicators will be evaluated again after 18 months. A final assessment of clinical indicators will take place after 30 months. In the context of the BENCH-D study, a set of instruments has been validated to measure patient well-being and satisfaction with the care. In the four regional meetings, different priorities were identified, reflecting different organizational resources of the different areas. In all the regions, a major challenge was represented by the need of skills and instruments to address psychosocial issues of people with diabetes. The BENCH-D study allows a field testing of benchmarking activities focused on clinical and patient-centred indicators.

Translation, cultural adaptation, cross-validation of the Turkish diabetes quality-of-life (DQOL) measure.

PubMed

Yildirim, Aysegul; Akinci, Fevzi; Gozu, Hulya; Sargin, Haluk; Orbay, Ekrem; Sargin, Mehmet

2007-06-01

The aim of this study was to test the validity and reliability of the Turkish version of the diabetes quality of life (DQOL) questionnaire for use with patients with diabetes. Turkish version of the generic quality of life (QoL) scale 15D and DQOL, socio-demographics and clinical parameter characteristics were administered to 150 patients with type 2 diabetes. Study participants were randomly sampled from the Endocrinology and Diabetes Outpatient Department of Dr. Lutfi Kirdar Kartal Education and Research Hospital in Istanbul, Turkey. The Cronbach alpha coefficient of the overall DQOL scale was 0.89; the Cronbach alpha coefficient ranged from 0.80 to 0.94 for subscales. Distress, discomfort and its symptoms, depression, mobility, usual activities, and vitality on the 15 D scale had statistically significant correlations with social/vocational worry and diabetes-related worry on the DQOL scale indicating good convergent validity. Factor analysis identified four subscales: satisfaction", impact", "diabetes-related worry", and "social/vocational worry". Statistical analyses showed that the Turkish version of the DQOL is a valid and reliable instrument to measure disease related QoL in patients with diabetes. It is a simple and quick screening tool with about 15 +/- 5.8 min administration time for measuring QoL in this population.

Evaluation of the theory-based Quality Improvement in Physical Therapy (QUIP) programme: a one-group, pre-test post-test pilot study.

PubMed

Rutten, Geert M; Harting, Janneke; Bartholomew, L Kay; Schlief, Angelique; Oostendorp, Rob A B; de Vries, Nanne K

2013-05-25

Guideline adherence in physical therapy is far from optimal, which has consequences for the effectiveness and efficiency of physical therapy care. Programmes to enhance guideline adherence have, so far, been relatively ineffective. We systematically developed a theory-based Quality Improvement in Physical Therapy (QUIP) programme aimed at the individual performance level (practicing physiotherapists; PTs) and the practice organization level (practice quality manager; PQM). The aim of the study was to pilot test the multilevel QUIP programme's effectiveness and the fidelity, acceptability and feasibility of its implementation. A one-group, pre-test, post-test pilot study (N = 8 practices; N = 32 PTs, 8 of whom were also PQMs) done between September and December 2009. Guideline adherence was measured using clinical vignettes that addressed 12 quality indicators reflecting the guidelines' main recommendations. Determinants of adherence were measured using quantitative methods (questionnaires). Delivery of the programme and management changes were assessed using qualitative methods (observations, group interviews, and document analyses). Changes in adherence and determinants were tested in the paired samples T-tests and expressed in effect sizes (Cohen's d). Overall adherence did not change (3.1%; p = .138). Adherence to three quality indicators improved (8%, 24%, 43%; .000 ≤ p ≤ .023). Adherence to one quality indicator decreased (-15.7%; p = .004). Scores on various determinants of individual performance improved and favourable changes at practice organizational level were observed. Improvements were associated with the programme's multilevel approach, collective goal setting, and the application of self-regulation; unfavourable findings with programme deficits. The one-group pre-test post-test design limits the internal validity of the study, the self-selected sample its external validity. The QUIP programme has the potential to change physical therapy practice but needs considerable revision to induce the ongoing quality improvement process that is required to optimize overall guideline adherence. To assess its value, the programme needs to be tested in a randomized controlled trial.

Designing a Method with Physician Participation to Assess and Improve Quality of Healthcare in Otolaryngology.

PubMed

Arce, José M; Martín Cleary, Catalina; Cenjor, Carlos; Ramos, Ángel; Ortiz, Alberto

2017-04-01

Patient choice of healthcare centers to be treated for specific diseases is compromised by the low accessibility of understandable information. Physicians are rarely involved in healthcare quality assessment, despite their potentially valuable input. The purpose of this study was to develop a methodology for evaluating the quality of care that specifically incorporates advice from medical specialists and provides accessible information for patients in search of high-quality healthcare. A pilot Delphi study was conducted among 28 Spanish otolaryngology experts, seeking their opinion on the quality-of-care indicators and on their ability to recommend the most suitable department for the treatment of specific otolaryngologic diseases. The average acceptance rate was 91.9% for quality-of-care indicator and 96.5% for the resources needed for improving the quality of care. Furthermore, 93% experts reported that patients frequently ask for physician advice on which center provides better care for a specific disease, 92.6% experts believe they could recommend the best centers for specific otolaryngologic diseases, and 80% experts agreed that expert opinion on the quality of care offered by different centers would be a valuable addition to quality-of-care assessment. The incorporation of physician advice into healthcare quality assessment may improve the usefulness of healthcare quality indicators for patients. Assessment tools incorporating physician advice should be developed and validated.

Personality and Job Performance: Evidence of Incremental Validity.

ERIC Educational Resources Information Center

Day, David V.; Silverman, Stanley B.

1989-01-01

Investigated relationship between personality variables and job performance in 43 accountants. Results indicated that, even with effects of cognitive ability taken into account, 3 personality scales (orientation toward work, degree of ascendancy, and degree and quality of interpersonal orientation) were significantly related to important aspects…

Anatomy of a physics test: Validation of the physics items on the Texas Assessment of Knowledge and Skills

NASA Astrophysics Data System (ADS)

Marshall, Jill A.; Hagedorn, Eric A.; O'Connor, Jerry

2009-06-01

We report the results of an analysis of the Texas Assessment of Knowledge and Skills (TAKS) designed to determine whether the TAKS is a valid indicator of whether students know and can do physics at the level necessary for success in future coursework, STEM careers, and life in a technological society. We categorized science items from the 2003 and 2004 10th and 11th grade TAKS by content area(s) covered, knowledge and skills required to select the correct answer, and overall quality. We also analyzed a 5000 student sample of item-level results from the 2004 11th grade exam, performing full-information factor analysis, calculating classical test indices, and determining each item's response curve using item response theory. Triangulation of our results revealed strengths and weaknesses of the different methods of analysis. The TAKS was found to be only weakly indicative of physics preparation and we make recommendations for increasing the validity of standardized physics testing.

The challenges of measuring quality-of-care indicators in rural emergency departments: a cross-sectional descriptive study.

PubMed

Layani, Géraldine; Fleet, Richard; Dallaire, Renée; Tounkara, Fatoumata K; Poitras, Julien; Archambault, Patrick; Chauny, Jean-Marc; Ouimet, Mathieu; Gauthier, Josée; Dupuis, Gilles; Tanguay, Alain; Lévesque, Jean-Frédéric; Simard-Racine, Geneviève; Haggerty, Jeannie; Légaré, France

2016-01-01

Evidence-based indicators of quality of care have been developed to improve care and performance in Canadian emergency departments. The feasibility of measuring these indicators has been assessed mainly in urban and academic emergency departments. We sought to assess the feasibility of measuring quality-of-care indicators in rural emergency departments in Quebec. We previously identified rural emergency departments in Quebec that offered medical coverage with hospital beds 24 hours a day, 7 days a week and were located in rural areas or small towns as defined by Statistics Canada. A standardized protocol was sent to each emergency department to collect data on 27 validated quality-of-care indicators in 8 categories: duration of stay, patient safety, pain management, pediatrics, cardiology, respiratory care, stroke and sepsis/infection. Data were collected by local professional medical archivists between June and December 2013. Fifteen (58%) of the 26 emergency departments invited to participate completed data collection. The ability to measure the 27 quality-of-care indicators with the use of databases varied across departments. Centres 2, 5, 6 and 13 used databases for at least 21 of the indicators (78%-92%), whereas centres 3, 8, 9, 11, 12 and 15 used databases for 5 (18%) or fewer of the indicators. On average, the centres were able to measure only 41% of the indicators using heterogeneous databases and manual extraction. The 15 centres collected data from 15 different databases or combinations of databases. The average data collection time for each quality-of-care indicator varied from 5 to 88.5 minutes. The median data collection time was 15 minutes or less for most indicators. Quality-of-care indicators were not easily captured with the use of existing databases in rural emergency departments in Quebec. Further work is warranted to improve standardized measurement of these indicators in rural emergency departments in the province and to generalize the information gathered in this study to other health care environments.

Developing clinical indicators for the secondary health system in India.

PubMed

Thakur, Harshad; Chavhan, S; Jotkar, Raju; Mukherjee, Kanchan

2008-08-01

One of the prime goals of any health system is to deliver good and competent quality of healthcare. Through World Bank-assisted Maharashtra Health Systems Development Project, Government of Maharashtra in India developed and implemented clinical indicators to improve quality. During this, clinical areas eligible for monitoring quality of care and roles of health staff working at various levels were identified. Brainstorming discussion sessions were conducted to refine list of potential clinical indicators and to identify implementation problems. It was implemented in four stages. (a) Self-explanatory tool of record, standard operating procedures and training manual were prepared during tools preparation stage. (b) Pilot implementation was done to monitor the usefulness of indicators, document the experiences and standardize the system accordingly. (c) The final selection of indicators was done taking into consideration points like data reliability, indicator usefulness etc. For final implementation, 15 indicators for district and 6 indicators for rural hospitals were selected. (d) Transfer of skills was done through training of various hospital functionaries. Selection and prioritization of clinical indicators is the most crucial part. Active participation of local employees is essential for sustainability of the scheme. It is also important to ensure that data recorded/reported is both reliable and valid, to conduct monthly review of the scheme at various levels and to link it with the quality improvement programme.

Work design and management in the manufacturing sector: development and validation of the Work Organisation Assessment Questionnaire

PubMed Central

Griffiths, A; Cox, T; Karanika, M; Khan, S; Tomás, J‐M

2006-01-01

Objectives To examine the factor structure, reliability, and validity of a new context‐specific questionnaire for the assessment of work and organisational factors. The Work Organisation Assessment Questionnaire (WOAQ) was developed as part of a risk assessment and risk reduction methodology for hazards inherent in the design and management of work in the manufacturing sector. Method Two studies were conducted. Data were collected from 524 white‐ and blue‐collar employees from a range of manufacturing companies. Exploratory factor analysis was carried out on 28 items that described the most commonly reported failures of work design and management in companies in the manufacturing sector. Concurrent validity data were also collected. A reliability study was conducted with a further 156 employees. Results Principal component analysis, with varimax rotation, revealed a strong 28‐item, five factor structure. The factors were named: quality of relationships with management, reward and recognition, workload, quality of relationships with colleagues, and quality of physical environment. Analyses also revealed a more general summative factor. Results indicated that the questionnaire has good internal consistency and test‐retest reliability and validity. Being associated with poor employee health and changes in health related behaviour, the WOAQ factors are possible hazards. It is argued that the strength of those associations offers some estimation of risk. Feedback from the organisations involved indicated that the WOAQ was easy to use and meaningful for them as part of their risk assessment procedures. Conclusions The studies reported here describe a model of the hazards to employee health and health related behaviour inherent in the design and management of work in the manufacturing sector. It offers an instrument for their assessment. The scales derived which form the WOAQ were shown to be reliable, valid, and meaningful to the user population. PMID:16858081

Assessing leadership decision-making styles: psychometric properties of the Leadership Judgement Indicator.

PubMed

Faraci, Palmira; Lock, Michael; Wheeler, Robert

2013-01-01

This study aimed to validate the Italian version of the Leadership Judgement Indicator, an unconventional instrument devoted to measurement of leaders' judgments and preferred styles, ie, directive, consultative, consensual, or delegative, when dealing with a range of decision-making scenarios. After forward-translation and back-translation, its psychometric properties were estimated for 299 managers at various levels, who were asked to put themselves in the position of leader and to rate the appropriateness of certain ways of responding to challenge. Differences between several groups of managers, ranked in order of seniority, provided evidence for discriminant validity. Internal consistency was adequate. The findings show that the Italian adaptation of the Leadership Judgement Indicator has promising psychometric qualities, suggesting its suitability for use to improve outcomes in both organizational and selection settings.

Feasibility of evaluating quality cancer care using registry data and electronic health records: a population-based study.

PubMed

Caldarella, Adele; Amunni, Gianni; Angiolini, Catia; Crocetti, Emanuele; Di Costanzo, Francesco; Di Leo, Angelo; Giusti, Francesco; Pegna, Andrea Lopes; Mantellini, Paola; Luzzatto, Lucio; Paci, Eugenio

2012-08-01

To evaluate the quality of patients care, a set of indicators of the standards of cancer care were defined. We developed a set of indicators to assess the implementation in daily practice of recommendation produced by a regional network (Istituto Toscano Tumori). This set was tested in a retrospective study in the resident population of the Tuscany Region; the regional health system is organized on 12 local health authorities which refer to three macro areas (Area Vasta). The study included incident colorectal, lung and breast cancer cases listed in 2004 for the Tuscan Cancer Registry, a population-based registry which collected tumor cases diagnosed in all residents in Tuscany. Electronic data from registry database were used to determine the compliance with each indicator for patients in 2004. To validate the results, an ad hoc clinical survey including the same geographical area for the year 2006 was performed. None. The proportion of patients who fulfilled each of the indicators. Our study showed the feasibility of the evaluation of the quality of cancer care using cancer registry population-based data and major computerized information systems. The estimation of the selected indicators confirmed a good homogeneity among areas, and globally revealed a good intraregional performance. Further work is needed to develop specific quality measures, particularly about structural data and to continually revise indicators of quality of care. Data from a cancer registry, however, can be useful to evaluate quality of cancer care.

Using an innovative combination of quality-by-design and green analytical chemistry approaches for the development of a stability indicating UHPLC method in pharmaceutical products.

PubMed

Boussès, Christine; Ferey, Ludivine; Vedrines, Elodie; Gaudin, Karen

2015-11-10

An innovative combination of green chemistry and quality by design (QbD) approach is presented through the development of an UHPLC method for the analysis of the main degradation products of dextromethorphan hydrobromide. QbD strategy was integrated to the field of green analytical chemistry to improve method understanding while assuring quality and minimizing environmental impacts, and analyst exposure. This analytical method was thoroughly evaluated by applying risk assessment and multivariate analysis tools. After a scouting phase aimed at selecting a suitable stationary phase and an organic solvent in accordance with green chemistry principles, quality risk assessment tools were applied to determine the critical process parameters (CPPs). The effects of the CPPs on critical quality attributes (CQAs), i.e., resolutions, efficiencies, and solvent consumption were further evaluated by means of a screening design. A response surface methodology was then carried out to model CQAs as function of the selected CPPs and the optimal separation conditions were determined through a desirability analysis. Resulting contour plots enabled to establish the design space (DS) (method operable design region) where all CQAs fulfilled the requirements. An experimental validation of the DS proved that quality within the DS was guaranteed; therefore no more robustness study was required before the validation. Finally, this UHPLC method was validated using the concept of total error and was used to analyze a pharmaceutical drug product. Copyright © 2015 Elsevier B.V. All rights reserved.

Quality improvement of interdisciplinary rounds by leadership training based on essential quality indicators of the Interdisciplinary Rounds Assessment Scale.

PubMed

Ten Have, Elsbeth C M; Nap, Raoul E; Tulleken, Jaap E

2013-10-01

The implementation of interdisciplinary teams in the intensive care unit (ICU) has focused attention on leadership behavior. Daily interdisciplinary rounds (IDRs) in ICUs integrate leadership behavior and interdisciplinary teamwork. The purpose of this intervention study was to measure the effect of leadership training on the quality of IDRs in the ICU. A nonrandomized intervention study was conducted in four ICUs for adults. The intervention was a 1-day training session in a simulation environment and workplace-based feedback sessions. Measurement included 28 videotaped IDRs (total, 297 patient presentations) that were assessed with 10 essential quality indicators of the validated IDR Assessment Scale. Participants were 19 intensivists who previously had no formal training in leading IDRs. They were subdivided by cluster sampling into a control group (ten experienced intensivists) and intervention group (nine intensive care fellows). Mann-Whitney U test was used to compare results between control and intervention groups. Baseline measurements of control and intervention groups revealed two indicators that differed significantly. The frequency of yes ratings for the intervention group significantly increased for seven of the ten indicators from before to after intervention. The frequency of yes ratings after training was significantly greater in the intervention than control groups for eight of the ten essential quality indicators. The leadership training improved the quality of the IDRs performed in the ICUs. This may improve quality and safety of patient care.

Validation of the psychometrics properties of a French quality of life questionnaire among a cohort of renal transplant recipients less than one year.

PubMed

Beauger, Davy; Fruit, Dorothée; Villeneuve, Claire; Laroche, Marie-Laure; Jouve, Elisabeth; Rousseau, Annick; Boyer, Laurent; Gentile, Stéphanie

2016-09-01

Renal transplantation is considered as the treatment of choice for patients with end-stage renal disease. Health-related quality of life (HRQoL) of renal transplant recipients (RTR) is very important to assess, especially during the first year after transplantation. To provide new evidence about the suitability of HRQoL measures in RTR during the first post-transplant year, we explored the internal structure, reliability and external validity of a French specific HRQoL instrument, the Renal Transplant Quality of life Questionnaire Second Version (RTQ V2). The data were issued from the French multicenter cohort of renal transplant patients followed during 4 years (EPIGREN). The HRQoL of RTR was assessed five times (at 1, 3, 6, 9 and 12 months after transplantation) with the RTQ V2, a specific instrument consisting of 32 items describing five dimensions. Socio-demographic information, clinical characteristics and HRQoL (i.e., RTQ V2 and SF-36) were collected. For the five times, psychometric properties of the RTQ V2 were compared to those reported from the reference population assessed in the validation study. Three hundred and thirty-four patients were enrolled. The proportions of well-projected items, item-internal consistency, item-discriminant validity, floor and ceiling effects, Cronbach's alpha coefficients and item goodness-of-fit statistics were satisfactory for each dimension at the five times of the study. The suitability indices of construct validity were higher than 90 % for each time (minimum-maximum: 90.8-97.4 %). The external validity was less satisfactory, with a suitability indices ranged from 46.7 % at M1 to 66.7 % at M12. However, the discrepancies with the reference population (mainly for the gender) appeared logical considering the scientific literature on HRQoL of RTR during the first post-transplant year and may not compromise the external validity. These results support the validity and reliability of the RTQ V2 for evaluating HRQoL in RTR during the first post-transplant year, and confirm that the RTQ V2 is a useful tool to assess the HRQoL precociously after transplant.

Exercise stereotypes and health-related outcomes in French people living with HIV: development and validation of an HIV Exercise Stereotypes Scale (HIVESS).

PubMed

Gray, Laura; Falzon, Charlène; Bergamaschi, Alessandro; Schuft, Laura; Durant, Jacques; Rosenthal, Eric; Pradier, Christian; Duracinsky, Martin; Rouanet, Isabelle; Colson, Serge S; d'Arripe-Longueville, Fabienne

2016-11-14

The main objective of the current study was to develop and validate a French exercise stereotype scale for people living with HIV (PLHIV) in order to gain visibility to the possible barriers and facilitators for exercise in PLHIV and thus enhance their quality of life. A series of four complementary studies was carried out with a total sample of 524 participants to: (a) develop a preliminary version of the HIV Exercise Stereotype Scale (HIVESS) (Stage 1), (b) confirm the factorial structure of the instrument (Stage 2), (c) evaluate the stability of the instrument (Stage 3), and (d) examine the construct and divergent validity of the scale (Stage 4). Results provided support for a 14-item scale with three sub-scales reporting stereotypes related to exercise benefits, exercise risks and lack of capacity for exercise with Cronbach's alphas of .77, .69 and .76 respectively. Results showed good factorial structure, strong reliability and indicators of convergent validity relating to self-efficacy, exercise and quality of life. The HIVESS presented satisfactory psychometric properties, constitutes a reliable and valid instrument to measure exercise stereotypes among PLHIV and has applications for future research and clinical practice.

Convergent validity between SF-36 and WHOQOL-BREF in older adults

PubMed Central

Castro, Paula Costa; Driusso, Patrícia; Oishi, Jorge

2014-01-01

OBJECTIVE To compare the reliability and convergent validity of instruments assessing quality of life in Brazilian older adults. METHODS Cross-sectional study of 278 literate, community-dwelling older adults attending a municipal university for the elderly in Sao Carlos, SP, Southeastern Brazil between 2006 and 2008. The Brazilian versions of the SF-36 and WHOQOL-BREF instruments to assess quality of life were compared. Cronbach’s alpha coefficient was used to estimate reliability and Pearson’s correlation for comparison between the two scales. RESULTS Most of participants were women (87.8%) with a mean age of 63.83±7.22 years. Both scales showed an acceptable internal consistency – WHOQOL-BREF Cronbach’s alpha was 0.832 and SF-36 was 0.868. There was a weak (r ≤ 0.6) correlation between the related fields in the two questionnaires. CONCLUSIONS The SF-36 and WHOQOL-BREF are reliable instruments for clinical and research uses in Brazilian older women. To select one, researchers should consider which aspects of quality of life they aim to capture because of weak convergent validity signs. This study’s results indicate that WHOQOL-BREF may be more relevant to evaluate changes in the quality of life of older women because it prioritizes responses to the aging process and avoids focusing on impairment. PMID:24789638

[Quality of the pharmacotherapeutic recommendations for the integrated care procedures in Andalusia].

PubMed

Corte, Rosa María Muñoz; Estepa, Raúl García; Ramos, Bernardo Santos; Paloma, Francisco Javier Bautista

2009-01-01

To evaluate the quality of the pharmacotherapeutic recommendations included in the Integrated Care Procedures (PAIs regarding its initials in Spanish) of the Andalusian Ministry of Health, published up to March 2008, through the design and validation of a tool. The assessment tool was designed based on similar instruments, specifically the AGREE. Other criteria included were taken from various literature sources or were devised by ourselves. The tool was validated prior to being used. After applying it to all the PAIs, we examined the degree of compliance with these pharmacotherapeutic criteria, both as a whole and by PAIs subgroups. The developed tool is a questionnaire of 20 items, divided into 4 sections. The first section consists of the essential criteria, and the rest make reference to more specific, non essential criteria: definition of the level of evidence, thoroughness of information and definition of indicators. It was found that 4 of the 60 PAIs do not contain any type of therapeutic recommendation. No PAI fulfils all the items listed in the tool, however, 70 % of them fulfil the essential quality criteria established. There is a great variability in the content of pharmacotherapeutic recommendations for each PAI. Once the validity of the tool has been proved, it could be used to assess the quality of the therapeutic recommendations in clinical practice guidelines.

Examining the ecological validity of the Talent Development Environment Questionnaire.

PubMed

Martindale, Russell J J; Collins, Dave; Douglas, Carl; Whike, Ally

2013-01-01

It is clear that high class expertise and effective practice exists within many talent development environments across the world. However, there is also a general consensus that widespread evidence-based policy and practice is lacking. As such, it is crucial to develop solutions which can facilitate effective dissemination of knowledge and promotion of evidence-based talent development systems. While the Talent Development Environment Questionnaire (Martindale et al., 2010 ) provides a method through which this could be facilitated, its ecological validity has remained untested. As such, this study aimed to investigate the real world applicability of the questionnaire through discriminant function analysis. Athletes across ten distinct regional squads and academies were identified and separated into two broad levels, 'higher quality' (n = 48) and 'lower quality' (n = 51) environments, based on their process quality and productivity. Results revealed that the Talent Development Environment Questionnaire was able to discriminate with 77.8% accuracy. Furthermore, in addition to the questionnaire as a whole, two individual features, 'quality preparation' (P < 0.01) and 'understanding the athlete' (P < 0.01), were found to be significant discriminators. In conclusion, the results indicate robust structural properties and sound ecological validity, allowing the questionnaire to be used with more confidence in applied and research settings.

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

PubMed

Mokkink, Lidwine B; Terwee, Caroline B; Patrick, Donald L; Alonso, Jordi; Stratford, Paul W; Knol, Dirk L; Bouter, Lex M; de Vet, Henrica C W

2010-05-01

Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'. Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.

The SATISPSY-22: development and validation of a French hospitalized patients' satisfaction questionnaire in psychiatry.

PubMed

Zendjidjian, X Y; Auquier, P; Lançon, C; Loundou, A; Parola, N; Faugère, M; Boyer, L

2015-01-01

The aim of our study was to develop a specific French self-administered instrument for measuring hospitalized patients' satisfaction in psychiatry based on exclusive patient point of view: the SATISPSY-22. The development of the SATISPSY was undertaken in three steps: item generation, item reduction, and validation. The content of the SATISPSY was derived from 80 interviews with patients hospitalized in psychiatry. Using item response and classical test theories, item reduction was performed in 2 hospitals on 270 responders. The validation was based on construct validity, reliability, and some aspects of external validity. The SATISPSY contains 22 items describing 6 dimensions (staff, quality of care, personal experience, information, activity, and food). The six-factor structure accounted for 78.0% of the total variance. Each item achieved the 0.40 standard for item-internal consistency, and the Cronbach's alpha coefficients were>0.70. Scores of dimensions were strongly positively correlated with Visual Analogue Scale scores. Significant associations with socioeconomic and clinical indicators showed good discriminant and external validity. INFIT statistics were ranged from 0.71 to 1.25. The SATISPSY-22 presents satisfactory psychometric properties, enabling patient feedback to be incorporated in a continuous quality health care improvement strategy. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

Development and Evaluation of a Measure of Library Automation.

ERIC Educational Resources Information Center

Pungitore, Verna L.

1986-01-01

Construct validity and reliability estimates indicate that study designed to measure utilization of automation in public and academic libraries was successful in tentatively identifying and measuring three subdimensions of level of automation: quality of hardware, method of software development, and number of automation specialists. Questionnaire…

Validating Migraine-Specific Quality of Life Questionnaire v2.1 in episodic and chronic migraine.

PubMed

Bagley, Christine L; Rendas-Baum, Regina; Maglinte, Gregory A; Yang, Min; Varon, Sepideh F; Lee, Jeff; Kosinski, Mark

2012-03-01

To provide evidence for the reliability and validity of the Migraine-Specific Quality of Life Questionnaire Version 2.1 (MSQ) for use in chronic migraine (CM) in adults. MSQ is one of the most frequently utilized disease-specific tools assessing impact of migraine on health-related quality of life (HRQL). However, evidence for its reliability and validity are based on studies in episodic migraine (EM) populations. Additional studies assessing the reliability and validity of the MSQ in patients with CM are needed. Cross-sectional data were collected via web-based survey in 9 countries/regions. Participants were classified as having CM (≥15 headache days/month) or EM (<15 headache days/month). Three MSQ domains - Role Function-Preventive (RP), Role Function-Restrictive (RR), and Emotional Function (EF) - were rescaled to 0-100, where higher scores indicate better HRQL, and analyzed for internal consistency reliability (Cronbach's α), construct validity (correlations between MSQ scales and measures of depression/anxiety [Patient Health Questionnaire; PHQ-4], disability [Migraine Disability Assessment Questionnaire; MIDAS], and functional impact [Headache Impact Test; HIT-6], where lower scores indicate better HRQL for each measure), as well as discriminant validity across migraine groups. A total of 8726 eligible respondents were classified: 5.7% CM (n = 499) and 94.3% EM (n = 8227). Subjects were mostly female (83.5%) with a mean (±SD) age of 40.3 ± 11.4, and were similar between the 2 groups. MSQ domain scores for CM and EM groups, respectively, were: RP = 61.4 ± 26.1 and 71.7 ± 24.0; RR = 44.4 ± 22.1 and 56.5 ± 24.1; EF = 48.3 ± 28.1 and 67.2 ± 26.7. Internal consistency of the overall sample for RP, RR, and EF was 0.90, 0.96, and 0.87, respectively. Similar values were observed for CM and EM. MSQ scores for the overall sample correlated moderately to highly with scores from the PHQ-4 (r = -0.21 to -0.42), MIDAS (r = -0.38 to -0.39), and HIT-6 (r = -0.60 to -0.71). Similar values were observed for CM and EM. Known-groups validity indicated significant differences (P < .0001) in the hypothesized direction between CM and EM for RP (F = 86.19), RR (F = 119.24), and EF (F = 235.90). The MSQ is a reliable and valid questionnaire in the CM population that can differentiate the functional impact between CM and EM. The MSQ can assist researchers in evaluating treatment effectiveness by obtaining input directly from the patients on multidimensional aspects other than frequency of headache days. © 2011 American Headache Society.

Measuring personal recovery - psychometric properties of the Swedish Questionnaire about the Process of Recovery (QPR-Swe).

PubMed

Argentzell, Elisabeth; Hultqvist, Jenny; Neil, Sandra; Eklund, Mona

2017-10-01

Personal recovery, defined as an individual process towards meaning, is an important target within mental health services. Measuring recovery hence requires reliable and valid measures. The Process of Recovery Questionnaire (QPR) was developed for that purpose. The aim was to develop a Swedish version of the QPR (QPR-Swe) and explore its psychometric properties in terms of factor structure, internal consistency, construct validity and sensitivity to change. A total of 226 participants entered the study. The factor structure was investigated by Principal Component Analysis and Scree plot. Construct validity was addressed in terms of convergent validity against indicators of self-mastery, self-esteem, quality of life and self-rated health. A one-factor solution of QPR-Swe received better support than a two-factor solution. Good internal consistency was indicated, α = 0.92, and construct validity was satisfactory. The QPR-Swe showed preliminary sensitivity to change. The QPR-Swe showed promising initial psychometric properties in terms of internal consistency, convergent validity and sensitivity to change. The QPR-Swe is recommended for use in research and clinical contexts to assess personal recovery among people with mental illness.

Improvement in Quality of Life Questionnaire Measures (PCOSQ) in Obese Adolescent Females with PCOS treated with Lifestyle Changes and Oral Contraceptives, with or without Metformin

PubMed Central

Harris-Glocker, Miranda; Davidson, Kristin; Kochman, Lynda; Guzick, David; Hoeger, Kathleen

2013-01-01

We studied the effect of metformin or placebo in a lifestyle modification program (LSM) combined with oral contraceptives (OC) on quality of life parameters measured by the PCOS questionnaire (PCOSQ) in obese adolescent women with validated PCOS. The quality of life indicators were measured at baseline and conclusion for 5 domains on the PCOSQ, with equal improvement in scores in both placebo and Metformin groups, suggesting metformin addition does not add improvement to quality of life measures above those observed with lifestyle modification and oral contraceptive treatment. PMID:19781696

Training quality job interviews with adults with developmental disabilities.

PubMed

Mozingo, D; Ackley, G B; Bailey, J S

1994-01-01

Supported work models of vocational integration have increased the employability of individuals with developmental disabilities. Interview questions most frequently used and corresponding responses considered most beneficial to job applicants were derived from an empirical analysis of the "hiring community" and served as a basis for the development of the verbal job interview skills training package evaluated in this research. Dependent measures were objective, behavioral indices of the quality of job interview responses. One-to-one training by a direct training staff, job coach, and a trained behavior analyst resulted in improved responding by all subjects as indicated in a multiple baseline design across interview questions. Improved quality in responding to questions generalized to variations in interview questions, to a novel interviewer, and in an in vivo interview situation. Finally, global measures of social validity support the value of the quality-of-response training.

Cross-cultural adaptation, reliability, and validity of the Turkish version of PedsQL 3.0 Arthritis Module: a quality-of-life measure for patients with juvenile idiopathic arthritis in Turkey.

PubMed

Tarakci, E; Baydogan, S N; Kasapcopur, O; Dirican, A

2013-04-01

The aim of this study was to describe the cultural adaptation, validity, and reliability of a Turkish version of the pediatric quality-of-life inventory (PedsQL) 3.0 Arthritis Module in a population with juvenile idiopathic arthritis (JIA). A total of 169 patients with JIA and their parents were enrolled in the study. The Turkish version of the childhood health assessment questionnaire (CHAQ) was used to evaluate the validity of related domains in the PedsQL 3.0 Arthritis Module. Both the PedsQL 3.0 Arthritis Module and CHAQ were filled out by children over 8 years of age and by the parents of children 2-7 years of age. Internal reliability was poor to excellent (Cronbach's alpha coefficients 0.56-0.84 for self-reporting and 0.63-0.82 for parent reporting), and interobserver reliability varied from good to excellent (intraclass correlation coefficient (ICC) 0.79-0.91 for self-reporting and 0.80-0.88 for parent reporting) for the total scores of the PedsQL 3.0 Arthritis Module. Parent-child concordance for all scores was moderate to excellent (ICC 0.42-0.92). The PedsQL 3.0 Arthritis Module and CHAQ were highly positively correlated, with coefficients from 0.21 to 0.76, indicating concurrent validity. We demonstrated the reliability and validity of quality-of-life measurement using the Turkish version of the PedsQL 3.0 Arthritis Module in our sociocultural context. The PedsQL 3.0 Arthritis Module can be utilized as a tool for the evaluation of quality of life in patients with JIA aged 2-18 years.

Derivation, Validation and Application of a Pragmatic Risk Prediction Index for Benchmarking of Surgical Outcomes.

PubMed

Spence, Richard T; Chang, David C; Kaafarani, Haytham M A; Panieri, Eugenio; Anderson, Geoffrey A; Hutter, Matthew M

2018-02-01

Despite the existence of multiple validated risk assessment and quality benchmarking tools in surgery, their utility outside of high-income countries is limited. We sought to derive, validate and apply a scoring system that is both (1) feasible, and (2) reliably predicts mortality in a middle-income country (MIC) context. A 5-step methodology was used: (1) development of a de novo surgical outcomes database modeled around the American College of Surgeons' National Surgical Quality Improvement Program (ACS-NSQIP) in South Africa (SA dataset), (2) use of the resultant data to identify all predictors of in-hospital death with more than 90% capture indicating feasibility of collection, (3) use these predictors to derive and validate an integer-based score that reliably predicts in-hospital death in the 2012 ACS-NSQIP, (4) apply the score in the original SA dataset and demonstrate its performance, (5) identify threshold cutoffs of the score to prompt action and drive quality improvement. Following step one-three above, the 13 point Codman's score was derived and validated on 211,737 and 109,079 patients, respectively, and includes: age 65 (1), partially or completely dependent functional status (1), preoperative transfusions ≥4 units (1), emergency operation (2), sepsis or septic shock (2) American Society of Anesthesia score ≥3 (3) and operative procedure (1-3). Application of the score to 373 patients in the SA dataset showed good discrimination and calibration to predict an in-hospital death. A Codman Score of 8 is an optimal cutoff point for defining expected and unexpected deaths. We have designed a novel risk prediction score specific for a MIC context. The Codman Score can prove useful for both (1) preoperative decision-making and (2) benchmarking the quality of surgical care in MIC's.

Psychometric evaluation of the pediatric and parent-proxy Patient-Reported Outcomes Measurement Information System and the Neurology and Traumatic Brain Injury Quality of Life measurement item banks in pediatric traumatic brain injury.

PubMed

Bertisch, Hilary; Rivara, Frederick P; Kisala, Pamela A; Wang, Jin; Yeates, Keith Owen; Durbin, Dennis; Zonfrillo, Mark R; Bell, Michael J; Temkin, Nancy; Tulsky, David S

2017-07-01

The primary objective is to provide evidence of convergent and discriminant validity for the pediatric and parent-proxy versions of the Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety, Depression, Anger, Peer Relations, Mobility, Pain Interference, and Fatigue item banks, the Neurology Quality of Life measurement system (Neuro-QOL) Cognition-General Concerns and Stigma item banks, and the Traumatic Brain Injury Quality of Life (TBI-QOL) Executive Function and Headache item banks in a pediatric traumatic brain injury (TBI) sample. Participants were 134 parent-child (ages 8-18 years) days. Children all sustained TBI and the dyads completed outcome ratings 6 months after injury at one of six medical centers across the United States. Ratings included PROMIS, Neuro-QOL, and TBI-QOL item banks, as well as the Pediatric Quality of Life inventory (PedsQL), the Health Behavior Inventory (HBI), and the Strengths and Difficulties Questionnaire (SDQ) as legacy criterion measures against which these item banks were validated. The PROMIS, Neuro-QOL, and TBI-QOL item banks demonstrated good convergent validity, as evidenced by moderate to strong correlations with comparable scales on the legacy measures. PROMIS, Neuro-QOL, and TBI-QOL item banks showed weaker correlations with ratings of unrelated constructs on legacy measures, providing evidence of discriminant validity. Our results indicate that the constructs measured by the PROMIS, Neuro-QOL, and TBI-QOL item banks are valid in our pediatric TBI sample and that it is appropriate to use these standardized scores for our primary study analyses.

Is the content of the Chinese Quality of Life Instrument (ChQOL) really valid in the context of traditional Chinese medicine in Hong Kong?

PubMed

Wong, Wendy; Lam, Cindy L K; Leung, K F; Zhao, L

2009-01-01

Content validity is crucial in quality of life instrument development but there is very little literature on this in Chinese culture. The Chinese Quality of Life Instrument (ChQOL) was developed in Mainland China to capture the health-related quality of life (HRQOL) concepts specific to traditional Chinese medicine (TCM). The aim of this study was to evaluate the content validity of ChQOL in a Chinese population whose spoken dialect and health-care system are different from those of Mainland China to find out whether the instrument is generalizable. 8 TCM practitioners and 10 patients rated the clarity, relevance and appropriateness of each of the 50 items of the ChQOL (HK version), and completed qualitative cognitive debriefing interviews. The content of ChQOL was rated valid by TCM practitioners with CVIs on clarity, relevance and appropriateness ranging from 80 to 100%. 49 out of 50 items were well understood by patients, but 12 items had CVI on relevance and 5 items had CVI on appropriateness lower than 70% among patients. After reviewing the patients and TCM practitioners' opinions, revisions were made for three items (2, 8 and 29) to form the ChQOL (HK version)-2008. In general, the ChQOL was found to be too long which called for shorter version. The content of ChQOL was shown to be really valid in the context of Chinese Medicine for Cantonese speaking Chinese. There was some discrepancy between the judgments of TCM practitioners and patients indicating the importance of evaluation by both experts and lay persons.

The european organization for research and treatment of cancer quality of life questionnaire-BR 23 breast cancer-specific quality of life questionnaire: psychometric properties in a Moroccan sample of breast cancer patients

PubMed Central

2014-01-01

Background Quality of life (QOL) and its measurement in cancer patients is becoming increasingly important. Breast cancer diagnosis and treatment are often associated with psychological distress and reduced QoL. In Arabic-speaking countries, QoL of patients with cancer is inadequately studied. The aim of this study was to test the reliability and validity of the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer (EORTC) Breast Cancer-Specific Quality of Life Questionnaire (QLQ-BR23). Methods After translation and cross-cultural adaptation, the questionnaire was tested on breast cancer patients. The participants’ number for the test and the retest were 105 and 37 respectively. Internal consistency was tested using Cronbach’s alpha coefficient (α), the test-retest reliability using intraclass correlation coefficients (ICC). Construct validity was assessed by examining item-convergent and divergent validity. Results The questionnaire was administered to 105 patients. The mean age of patients was 48 years (SD: 16), 62.9% were married. 68.6% of all participants lived in urban area. The average time to complete the QLQ- BR23 was 15 min. Cronbach’s alpha coefficient, were all >0.7, with the exception of breast symptoms and arm symptoms. All items exceeded the 0.4 criterion for convergent validity except item 20 and 23 related to pain and skin problems in the affected breast respectively. Conclusion In general, the findings of this study indicated that the Moroccan Arabic version of the EORTC QLQ-BR23 is a reliable and valid supplementary measure of the QOL in breast cancer patients and can be used in clinical trials and studies of outcome research in oncology. PMID:24447401

QUOTEchemo: a patient-centred instrument to measure quality of communication preceding chemotherapy treatment through the patient's eyes.

PubMed

van Weert, Julia C M; Jansen, Jesse; de Bruijn, Gert-Jan; Noordman, Janneke; van Dulmen, Sandra; Bensing, Jozien M

2009-11-01

Knowing patients' needs is a prerequisite to ensure high quality cancer care. This study describes the development and psychometric properties of a patient-centred instrument to measure needs and actual experiences with communication preceding chemotherapy treatment: QUOTE(chemo). QUOTE-questionnaires (Quality Of care Through the patients' Eyes) are widely used to gain insight into unmet needs, but no validated, standardised questionnaire combining patients' needs and experiences surrounding chemotherapy treatment is available yet. To evaluate the psychometric properties of the QUOTE(chemo), content validity, internal structure and convergent validity were investigated amongst 345 cancer patients, new to chemotherapy, from 10 different hospitals. Literature study, focus group discussions and a categorisation procedure of 67 relevant topics revealed seven main themes: Treatment-related information, Prognosis information, Rehabilitation information, Coping information, Interpersonal communication, Tailored communication and Affective communication. Confirmatory factor analysis using structural equation modelling indicated that the measurement model provided good fit to the data with factor loadings ranging from .43 to .77. The seven QUOTE(chemo) dimensions captured relevant issues of concern with good internal consistency (alpha .72-.92), satisfactory item-total correlations (.35-.79) and satisfactory convergent validity. Affective communication, Treatment-related information and Rehabilitation information were perceived most important by patients. The instrument also appeared to be able to determine which aspects need improvement to ensure high quality care. The highest need for improvement was found for communicating Prognosis information and Rehabilitation information and for Interpersonal communication. These findings provide preliminary evidence of the reliability and validity of the QUOTE(chemo) for use in cancer care surrounding chemotherapy treatment. Researchers and health care providers can use the instrument to measure patients' needs and experiences with communication to identify aspects that need improvement.

The European Organization for Research and Treatment of Cancer quality of life questionnaire-BR23 Breast Cancer-Specific Quality of Life Questionnaire: psychometric properties in a Moroccan sample of breast cancer patients.

PubMed

El Fakir, Samira; Abda, Naima; Bendahhou, Karima; Zidouh, Ahmed; Bennani, Maria; Errihani, Hassan; Benider, Abdelatif; Bekkali, Rachid; Nejjari, Chakib

2014-01-21

Quality of life (QOL) and its measurement in cancer patients is becoming increasingly important. Breast cancer diagnosis and treatment are often associated with psychological distress and reduced QoL. In Arabic-speaking countries, QoL of patients with cancer is inadequately studied.The aim of this study was to test the reliability and validity of the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer (EORTC) Breast Cancer-Specific Quality of Life Questionnaire (QLQ-BR23). After translation and cross-cultural adaptation, the questionnaire was tested on breast cancer patients. The participants' number for the test and the retest were 105 and 37 respectively. Internal consistency was tested using Cronbach's alpha coefficient (α), the test-retest reliability using intraclass correlation coefficients (ICC). Construct validity was assessed by examining item-convergent and divergent validity. The questionnaire was administered to 105 patients. The mean age of patients was 48 years (SD: 16), 62.9% were married. 68.6% of all participants lived in urban area.The average time to complete the QLQ- BR23 was 15 min. Cronbach's alpha coefficient, were all >0.7, with the exception of breast symptoms and arm symptoms. All items exceeded the 0.4 criterion for convergent validity except item 20 and 23 related to pain and skin problems in the affected breast respectively. In general, the findings of this study indicated that the Moroccan Arabic version of the EORTC QLQ-BR23 is a reliable and valid supplementary measure of the QOL in breast cancer patients and can be used in clinical trials and studies of outcome research in oncology.

Development of quality indicators to evaluate antibiotic treatment of patients with community-acquired pneumonia in Indonesia.

PubMed

Farida, Helmia; Rondags, Angelique; Gasem, M Hussein; Leong, Katharina; Adityana, A; van den Broek, Peterhans J; Keuter, Monique; Natsch, Stephanie

2015-04-01

To develop an instrument for evaluating the quality of antibiotic management of patients with community-acquired pneumonia (CAP) applicable in a middle-income developing country. A previous study and Indonesian guidelines were reviewed to derive potential quality of care indicators (QIs). An expert panel performed a two-round Delphi consensus procedure on the QI's relevance to patient recovery, reduction of antimicrobial resistance and cost containment. Applicability in practice, including reliability, feasibility and opportunity for improvement, was determined in a data set of 128 patients hospitalised with CAP in Semarang, Indonesia. Fifteen QIs were selected by the consensus procedure. Five QIs did not pass feasibility criteria, because of inappropriate documentation, inefficient laboratory services or patient factors. Three QIs provided minor opportunity for improvement. Two QIs contradicted each other; one of these was considered not valid and excluded. A final set of six QIs was defined for use in the Indonesian setting. Using the Delphi method, we defined a list of QIs for assessing the quality of care, in particular antibiotic treatment, for CAP in Indonesia. For further improvement, a modified Delphi method that includes discussion, a sound medical documentation system, improvement of microbiology laboratory services, and multi-center applicability tests are needed to develop a valid and applicable QI list for the Indonesian setting. © 2014 John Wiley & Sons Ltd.

Validation of the Spanish Version of the Food Allergy Quality of Life Questionnaire-Parent Form (S-FAQLQ-PF).

PubMed

Manso, L; Pineda, R; Huertas, B; Fernández-Rivas, M; Diéguez, M C; Cerecedo, I; Muriel, A; Fernández, F B; DunnGalvin, A; Antolín-Amérigo, D; De la Hoz, B

2017-01-01

Food allergy is an emerging health problem. Several questionnaires can be used to establish health-related quality of life (HRQOL) in food allergy patients. Current questionnaires should be translated in such a way that they take account of the culture of the country in which they are to be used. Objective: To translate and perform a cross-sectional validation of the Food Allergy Quality of Life Questionnaire-Parent Form (FAQLQ-PF). The parents of 54 children diagnosed with food allergy were recruited to assess the Spanish version of the FAQLQ-PF (S-FQLQ-PF). The S-FQLQ-PF was translated into Spanish according to WHO guidelines (including a forward-backward translation). The statistical analysis showed that feasibility, reliability, and internal consistency were very good for the global S-FAQLQ-PF score and for the different domains. Assessment of construct validity indicated that S-FAQLQ-PF has reduced capacity for measurement of HRQOL in younger children. Cross-sectional validation of the S-FAQLQ-PF demonstrated that HRQOL of a Spanish pediatric population was affected by patient age, severity of symptoms, and number of reactions. HRQOL was not affected by sex, food implicated, number of foods implicated, ingestion of the implicated food, or presence of anaphylaxis. Translation into Spanish and cultural validation of the FAQLQ-PF demonstrated the influence of factors, such as patient age, severity of symptoms, and number of reactions on the HRQOL of a pediatric Spanish population.

Development and validation of a short version of the Partnership Self-Assessment Tool (PSAT) among professionals in Dutch disease-management partnerships.

PubMed

Cramm, Jane M; Strating, Mathilde Mh; Nieboer, Anna P

2011-06-30

The extent to which partnership synergy is created within quality improvement programmes in the Netherlands is unknown. In this article, we describe the psychometric testing of the Partnership Self-Assessment Tool (PSAT) among professionals in twenty-two disease-management partnerships participating in quality improvement projects focused on chronic care in the Netherlands. Our objectives are to validate the PSAT in the Netherlands and to reduce the number of items of the original PSAT while maintaining validity and reliability. The Dutch version of the PSAT was tested in twenty-two disease-management partnerships with 218 professionals. We tested the instrument by means of structural equation modelling, and examined its validity and reliability. After eliminating 14 items, the confirmatory factor analyses revealed good indices of fit with the resulting 15-item PSAT-Short version (PSAT-S). Internal consistency as represented by Cronbach's alpha ranged from acceptable (0.75) for the 'efficiency' subscale to excellent for the 'leadership' subscale (0.87). Convergent validity was provided with high correlations of the partnership dimensions and partnership synergy (ranged from 0.512 to 0.609) and high correlations with chronic illness care (ranged from 0.447 to 0.329). The psychometric properties and convergent validity of the PSAT-S were satisfactory rendering it a valid and reliable instrument for assessing partnership synergy and its dimensions of partnership functioning.

[Psychometric properties of a self-efficacy scale for physical activity in Brazilian adults].

PubMed

Rech, Cassiano Ricardo; Sarabia, Tais Taiana; Fermino, Rogério César; Hallal, Pedro Curi; Reis, Rodrigo Siqueira

2011-04-01

To test the validity and reliability of a self-efficacy scale for physical activity (PA) in Brazilian adults. A self-efficacy scale was applied jointly with a multidimensional questionnaire through face-to-face interviews with 1,418 individuals (63.4% women) aged ≥ 18 years. The scale was submitted to validity (factorial and construct) and reliability analysis (internal consistency and temporal stability). A test-retest procedure was conducted with 74 individuals to evaluate temporal stability. Exploratory factor analyses revealed two independent factors: self-efficacy for walking and self-efficacy for moderate and vigorous PA (MVPA). Together, these two factors explained 65.4% of the total variance of the scale (20.9% and 44.5% for walking and MVPA, respectively). Cronbach's alpha values were 0.83 for walking and 0.90 for MVPA, indicating high internal consistency. Both factors were significantly and positively correlated (rho ≥ 0.17, P < 0.001) with quality of life indicators (health perception, self-satisfaction, and energy for daily activities), indicating an adequate construct validity. The scale's validity, internal consistency, and reliability were adequate to evaluate self-efficacy for PA in Brazilian adults.

Does adding clinical data to administrative data improve agreement among hospital quality measures?

PubMed

Hanchate, Amresh D; Stolzmann, Kelly L; Rosen, Amy K; Fink, Aaron S; Shwartz, Michael; Ash, Arlene S; Abdulkerim, Hassen; Pugh, Mary Jo V; Shokeen, Priti; Borzecki, Ann

2017-09-01

Hospital performance measures based on patient mortality and readmission have indicated modest rates of agreement. We examined if combining clinical data on laboratory tests and vital signs with administrative data leads to improved agreement with each other, and with other measures of hospital performance in the nation's largest integrated health care system. We used patient-level administrative and clinical data, and hospital-level data on quality indicators, for 2007-2010 from the Veterans Health Administration (VA). For patients admitted for acute myocardial infarction (AMI), heart failure (HF) and pneumonia we examined changes in hospital performance on 30-d mortality and 30-d readmission rates as a result of adding clinical data to administrative data. We evaluated whether this enhancement yielded improved measures of hospital quality, based on concordance with other hospital quality indicators. For 30-d mortality, data enhancement improved model performance, and significantly changed hospital performance profiles; for 30-d readmission, the impact was modest. Concordance between enhanced measures of both outcomes, and with other hospital quality measures - including Joint Commission process measures, VA Surgical Quality Improvement Program (VASQIP) mortality and morbidity, and case volume - remained poor. Adding laboratory tests and vital signs to measure hospital performance on mortality and readmission did not improve the poor rates of agreement across hospital quality indicators in the VA. Efforts to improve risk adjustment models should continue; however, evidence of validation should precede their use as reliable measures of quality. Published by Elsevier Inc.

The truthful signalling hypothesis: an explicit general equilibrium model.

PubMed

Hausken, Kjell; Hirshleifer, Jack

2004-06-21

In mating competition, the truthful signalling hypothesis (TSH), sometimes known as the handicap principle, asserts that higher-quality males signal while lower-quality males do not (or else emit smaller signals). Also, the signals are "believed", that is, females mate preferentially with higher-signalling males. Our analysis employs specific functional forms to generate analytic solutions and numerical simulations that illuminate the conditions needed to validate the TSH. Analytic innovations include: (1) A Mating Success Function indicates how female mating choices respond to higher and lower signalling levels. (2) A congestion function rules out corner solutions in which females would mate exclusively with higher-quality males. (3) A Malthusian condition determines equilibrium population size as related to per-capita resource availability. Equilibria validating the TSH are achieved over a wide range of parameters, though not universally. For TSH equilibria it is not strictly necessary that the high-quality males have an advantage in terms of lower per-unit signalling costs, but a cost difference in favor of the low-quality males cannot be too great if a TSH equilibrium is to persist. And although the literature has paid less attention to these points, TSH equilibria may also fail if: the quality disparity among males is too great, or the proportion of high-quality males in the population is too large, or if the congestion effect is too weak. Signalling being unprofitable in aggregate, it can take off from a no-signalling equilibrium only if the trait used for signalling is not initially a handicap, but instead is functionally useful at low levels. Selection for this trait sets in motion a bandwagon, whereby the initially useful indicator is pushed by male-male competition into the domain where it does indeed become a handicap.

Quality of life of patients undergoing surgery by videolaparoscopy for GERD treatment.

PubMed

Andrade, Francisco José Cavalcante; de Almeida, Eliete Rodrigues; dos Santos, Maria Teresa Botti Rodrigues; Soares-Filho, Eurípedes; Lopes, João Batista; Veras e Silva, Roberto Cavalcante

2012-01-01

Gastroesophageal reflux disease is a chronic disease of high prevalence in Western countries, with negative effects on quality of life. Surgery is indicated for patients with intolerance to continuous medication, prolonged treatment or control, or in complicated forms of the disease. To evaluate the quality of life of patients undergoing surgery by videolaparoscopy for gastroesophageal reflux disease treatment. Sample comprised 43 patients of both genders (mean age = 51.4 years). For quality of life evaluation was made using the questionnaire Gastroesophageal Reflux Disease Health Related Quality of Life, translated and validated into Portuguese. Data were analyzed by Epi Info version 3.5.1, using Duncan test and Pearson's correlation coefficient, with 5% for null hypothesis (p ≤ 0.05). Over 50% of participants showed good quality of life (scores <5 of the questionnaire), more than 90% indicated satisfaction with their health. A significant positive correlation between most variables related to heartburn and the time after surgery was observed (p ≤ 0.05). Patients presented good quality of life and high level of satisfaction with their postoperative condition.

Validation of Physics Standardized Test Items

NASA Astrophysics Data System (ADS)

Marshall, Jill

2008-10-01

The Texas Physics Assessment Team (TPAT) examined the Texas Assessment of Knowledge and Skills (TAKS) to determine whether it is a valid indicator of physics preparation for future course work and employment, and of the knowledge and skills needed to act as an informed citizen in a technological society. We categorized science items from the 2003 and 2004 10th and 11th grade TAKS by content area(s) covered, knowledge and skills required to select the correct answer, and overall quality. We also analyzed a 5000 student sample of item-level results from the 2004 11th grade exam using standard statistical methods employed by test developers (factor analysis and Item Response Theory). Triangulation of our results revealed strengths and weaknesses of the different methods of analysis. The TAKS was found to be only weakly indicative of physics preparation and we make recommendations for increasing the validity of standardized physics testing..

Evaluation in undergraduate medical education: Conceptualizing and validating a novel questionnaire for assessing the quality of bedside teaching.

PubMed

Dreiling, Katharina; Montano, Diego; Poinstingl, Herbert; Müller, Tjark; Schiekirka-Schwake, Sarah; Anders, Sven; von Steinbüchel, Nicole; Raupach, Tobias

2017-08-01

Evaluation is an integral part of curriculum development in medical education. Given the peculiarities of bedside teaching, specific evaluation tools for this instructional format are needed. Development of these tools should be informed by appropriate frameworks. The purpose of this study was to develop a specific evaluation tool for bedside teaching based on the Stanford Faculty Development Program's clinical teaching framework. Based on a literature review yielding 47 evaluation items, an 18-item questionnaire was compiled and subsequently completed by undergraduate medical students at two German universities. Reliability and validity were assessed in an exploratory full information item factor analysis (study one) and a confirmatory factor analysis as well as a measurement invariance analysis (study two). The exploratory analysis involving 824 students revealed a three-factor structure. Reliability estimates of the subscales were satisfactory (α = 0.71-0.84). The model yielded satisfactory fit indices in the confirmatory factor analysis involving 1043 students. The new questionnaire is short and yet based on a widely-used framework for clinical teaching. The analyses presented here indicate good reliability and validity of the instrument. Future research needs to investigate whether feedback generated from this tool helps to improve teaching quality and student learning outcome.

Measuring Family Members' Satisfaction with End-of-Life Care in Long-Term Care: Adaptation of the CANHELP Lite Questionnaire.

PubMed

Nadin, Shevaun; Miandad, Mohammed Ali; Kelley, Mary Lou; Marcella, Jill; Heyland, Daren K

2017-01-01

Improving end-of-life care (EOLC) in long-term care (LTC) homes requires quality measurement tools that assess families' satisfaction with care. This research adapted and pilot-tested an EOLC satisfaction measure (Canadian Health Care Evaluation Project (CANHELP) Lite Questionnaire) for use in LTC to measure families' perceptions of the EOLC experience and to be self-administered. Phase 1 . A literature review identified key domains of satisfaction with EOLC in LTC, and original survey items were assessed for inclusiveness and relevance. Items were modified, and one item was added. The revised questionnaire was administered to 118 LTC family members and cognitive interviews were conducted. Further modifications were made including reformatting to be self-administered. The new instrument was pilot-tested with 134 family members. Importance ratings indicated good content and face validity. Cronbach's alpha coefficients (range: .88-.94) indicated internal consistency. This research adapted and pilot-tested the CANHELP for use in LTC. This paper introduces the new, valid, internally consistent, self-administered tool (CANHELP Lite Family Caregiver LTC) that can be used to measure families' perceptions of and satisfaction with EOLC. Future research should further validate the instrument and test its usefulness for quality improvement and care planning.

Measuring Family Members' Satisfaction with End-of-Life Care in Long-Term Care: Adaptation of the CANHELP Lite Questionnaire

PubMed Central

Miandad, Mohammed Ali; Marcella, Jill; Heyland, Daren K.

2017-01-01

Rationale Improving end-of-life care (EOLC) in long-term care (LTC) homes requires quality measurement tools that assess families' satisfaction with care. This research adapted and pilot-tested an EOLC satisfaction measure (Canadian Health Care Evaluation Project (CANHELP) Lite Questionnaire) for use in LTC to measure families' perceptions of the EOLC experience and to be self-administered. Methods and Results Phase 1. A literature review identified key domains of satisfaction with EOLC in LTC, and original survey items were assessed for inclusiveness and relevance. Items were modified, and one item was added. Phase 2 The revised questionnaire was administered to 118 LTC family members and cognitive interviews were conducted. Further modifications were made including reformatting to be self-administered. Phase 3 The new instrument was pilot-tested with 134 family members. Importance ratings indicated good content and face validity. Cronbach's alpha coefficients (range: .88–.94) indicated internal consistency. Conclusion This research adapted and pilot-tested the CANHELP for use in LTC. This paper introduces the new, valid, internally consistent, self-administered tool (CANHELP Lite Family Caregiver LTC) that can be used to measure families' perceptions of and satisfaction with EOLC. Future research should further validate the instrument and test its usefulness for quality improvement and care planning. PMID:28706945

Complicating Methodological Transparency

ERIC Educational Resources Information Center

Bridges-Rhoads, Sarah; Van Cleave, Jessica; Hughes, Hilary E.

2016-01-01

A historical indicator of the quality, validity, and rigor of qualitative research has been the documentation and disclosure of the behind-the-scenes work of the researcher. In this paper, we use what we call "methodological data" as a tool to complicate the possibility and desirability of such transparency. Specifically, we draw on our…

Quality-of-life in insect venom allergy: validation of the Turkish version of the "Vespid Allergy Quality of Life Questionnaire" (VQLQ-T).

PubMed

Sin, Betül Ayşe; Öztuna, Derya; Gelincik, Aslı; Gürlek, Feridun; Baysan, Abdullah; Sin, Aytül Zerrin; Aydın, Ömür; Mısırlıgil, Zeynep

2016-01-01

"Vespid Allergy Quality of Life Questionnaire (VQLQ)" has been used to assess psychological burden of disease. The aim of this study was to evaluate validity, reliability and responsiveness to interventions of the Turkish version. The Turkish language Questionnaire (VQLQ-T) was administered to 81 patients with bee allergy and 65 patients with vespid allergy from different groups to achieve cross-sectional validation. To establish longitudinal validity, the questionnaire was administered to 36 patients treated with venom immunotherapy. The cross-sectional validation in patients with vespid venom allergy showed a correlation coefficient of 0.97 (Cronbach α). Spearman's correlation coefficient of the pretreatment VQLQ-T score with Expectation of Outcome (EoO) questionnaire score was 0.55 (p < 0.001). After treatment, correlation between VQLQ-T score and EoO score was 0.64 (p = 0.003) in these patients. The cross-sectional instrument validation for non-beekeepers with bee venom allergy yielded a correlation coefficient of 0.96 (Cronbach α). Spearman's correlation coefficient between pretreatment VQLQ-T score and EoO score was 0.47 (p < 0.001) and after treatment, correlation between VQLQ-T score and EoO score was 0.78 (p = 0.008) in these patients. These findings indicate cross-sectional validity of VQLQ-T. In the longitudinal validation, there was a positive correlation between EoO and VQLQ-T with a correlation coefficient of 0.562 (p < 0.001). While mean (±SD) VQLQ-T score was 5.27 (±1.29) in pretreatment, it was 2.78 (±1.01) after treatment (p < 0.001). The correlation between the mean change in VQLQ-T score and the mean change in EoO score was 0.42 (p = 0.011). The Turkish version of VQLQ-T enables measurement of Quality of Life (QoL) in patients with either vespid or bee venom allergy. Furthermore, responsiveness of this instrument demonstrates the questionnaire's ability to detect changes over time.

Validation of the Six Sigma Z-score for the quality assessment of clinical laboratory timeliness.

PubMed

Ialongo, Cristiano; Bernardini, Sergio

2018-03-28

The International Federation of Clinical Chemistry and Laboratory Medicine has introduced in recent times the turnaround time (TAT) as mandatory quality indicator for the postanalytical phase. Classic TAT indicators, namely, average, median, 90th percentile and proportion of acceptable test (PAT), are in use since almost 40 years and to date represent the mainstay for gauging the laboratory timeliness. In this study, we investigated the performance of the Six Sigma Z-score, which was previously introduced as a device for the quantitative assessment of timeliness. A numerical simulation was obtained modeling the actual TAT data set using the log-logistic probability density function. Five thousand replicates for each size of the artificial TAT random sample (n=20, 50, 250 and 1000) were generated, and different laboratory conditions were simulated manipulating the PDF in order to generate more or less variable data. The Z-score and the classic TAT indicators were assessed for precision (%CV), robustness toward right-tailing (precision at different sample variability), sensitivity and specificity. Z-score showed sensitivity and specificity comparable to PAT (≈80% with n≥250), but superior precision that ranged within 20% by moderately small sized samples (n≥50); furthermore, Z-score was less affected by the value of the cutoff used for setting the acceptable TAT, as well as by the sample variability that reflected into the magnitude of right-tailing. The Z-score was a valid indicator of laboratory timeliness and a suitable device to improve as well as to maintain the achieved quality level.

Spectral signature verification using statistical analysis and text mining

NASA Astrophysics Data System (ADS)

DeCoster, Mallory E.; Firpi, Alexe H.; Jacobs, Samantha K.; Cone, Shelli R.; Tzeng, Nigel H.; Rodriguez, Benjamin M.

2016-05-01

In the spectral science community, numerous spectral signatures are stored in databases representative of many sample materials collected from a variety of spectrometers and spectroscopists. Due to the variety and variability of the spectra that comprise many spectral databases, it is necessary to establish a metric for validating the quality of spectral signatures. This has been an area of great discussion and debate in the spectral science community. This paper discusses a method that independently validates two different aspects of a spectral signature to arrive at a final qualitative assessment; the textual meta-data and numerical spectral data. Results associated with the spectral data stored in the Signature Database1 (SigDB) are proposed. The numerical data comprising a sample material's spectrum is validated based on statistical properties derived from an ideal population set. The quality of the test spectrum is ranked based on a spectral angle mapper (SAM) comparison to the mean spectrum derived from the population set. Additionally, the contextual data of a test spectrum is qualitatively analyzed using lexical analysis text mining. This technique analyzes to understand the syntax of the meta-data to provide local learning patterns and trends within the spectral data, indicative of the test spectrum's quality. Text mining applications have successfully been implemented for security2 (text encryption/decryption), biomedical3 , and marketing4 applications. The text mining lexical analysis algorithm is trained on the meta-data patterns of a subset of high and low quality spectra, in order to have a model to apply to the entire SigDB data set. The statistical and textual methods combine to assess the quality of a test spectrum existing in a database without the need of an expert user. This method has been compared to other validation methods accepted by the spectral science community, and has provided promising results when a baseline spectral signature is present for comparison. The spectral validation method proposed is described from a practical application and analytical perspective.

Validation of the German version of the late adolescence and young adulthood survivorship-related quality of life measure (LAYA-SRQL).

PubMed

Richter, Diana; Mehnert, Anja; Schepper, Florian; Leuteritz, Katja; Park, Crystal; Ernst, Jochen

2018-01-04

Cancer has adverse effects on patient's quality of life. As such, measuring quality of life (QoL) has become an integral part of psycho-oncological health care. Because adolescent and young adult patients have different needs in contrast to children and older cancer patients, instruments for adequately measuring QoL of cancer survivors in this age range are essential. As there is not a corresponding instrument in Germany, we aimed to validate the German version of the Late Adolescence and Young Adulthood Survivorship-Related Quality of Life Measure (LAYA-SRQL), a 30-item questionnaire covering 10 dimensions related to QoL. The LAYA-SRQL was translated into German following state-of-the-art criteria. We enrolled 234 adolescent and young adult (AYA) cancer patients with different tumour entities aged between 16 and 39 years old. Factorial structure was tested using confirmatory factor analysis. Internal consistency was determined by Cronbach's α. The Short Form Survey quality of life questionnaire (SF-12v2) was used to examine convergent validity. The 10-factor structure of the LAYA-SRQL was confirmed in the German sample, and the model shows high values of fit indicators: χ 2  = 723.32 (df = 360, p < 0.001), CFI = 0.92, TLI = 0.90, SRMR = 0.074, RMSEA = 0.066). Subscales showed acceptable to excellent internal consistencies with Cronbach's α > 0.70 and total Cronbach's α of 0.93. Convergent validity was demonstrated by high positive correlations between the LAYA-SRQL and the physical (r = 0.45) and mental component (r = 0.65) of the SF-12v2. The German version of the LAYA-SRQL showed good psychometric properties. The instrument proved to be a highly reliable and valid instrument that can be recommended for use in the follow-up care of AYAs and for clinical research.

Development and field validation of a regional, management-scale habitat model: A koala Phascolarctos cinereus case study.

PubMed

Law, Bradley; Caccamo, Gabriele; Roe, Paul; Truskinger, Anthony; Brassil, Traecey; Gonsalves, Leroy; McConville, Anna; Stanton, Matthew

2017-09-01

Species distribution models have great potential to efficiently guide management for threatened species, especially for those that are rare or cryptic. We used MaxEnt to develop a regional-scale model for the koala Phascolarctos cinereus at a resolution (250 m) that could be used to guide management. To ensure the model was fit for purpose, we placed emphasis on validating the model using independently-collected field data. We reduced substantial spatial clustering of records in coastal urban areas using a 2-km spatial filter and by modeling separately two subregions separated by the 500-m elevational contour. A bias file was prepared that accounted for variable survey effort. Frequency of wildfire, soil type, floristics and elevation had the highest relative contribution to the model, while a number of other variables made minor contributions. The model was effective in discriminating different habitat suitability classes when compared with koala records not used in modeling. We validated the MaxEnt model at 65 ground-truth sites using independent data on koala occupancy (acoustic sampling) and habitat quality (browse tree availability). Koala bellows ( n  = 276) were analyzed in an occupancy modeling framework, while site habitat quality was indexed based on browse trees. Field validation demonstrated a linear increase in koala occupancy with higher modeled habitat suitability at ground-truth sites. Similarly, a site habitat quality index at ground-truth sites was correlated positively with modeled habitat suitability. The MaxEnt model provided a better fit to estimated koala occupancy than the site-based habitat quality index, probably because many variables were considered simultaneously by the model rather than just browse species. The positive relationship of the model with both site occupancy and habitat quality indicates that the model is fit for application at relevant management scales. Field-validated models of similar resolution would assist in guiding management of conservation-dependent species.

Confirmatory factor analysis of the Chinese version of the Pediatric Quality-of-Life Inventory Cancer Module.

PubMed

Li, Ho Cheung William; Williams, Phoebe D; Williams, Arthur R; Chung, Joyce O K; Chiu, Sau Ying; Lopez, Violeta

2013-01-01

Before the Chinese version of the Pediatric Quality-of-Life Inventory Cancer Module can be used to assess the multidimensional construct of quality of life among Hong Kong Chinese pediatric patients with cancer, its psychometric properties need to be further empirically tested. The objectives of the study were to establish the construct validity, including hypothesis testing and a confirmatory factor analysis of factor structure, of the Chinese version of the Pediatric Quality-of-Life Inventory Cancer Module. A cross-sectional study was used; 200 children hospitalized with cancer (9- to 16-year-olds) were recruited. Participants were asked to respond to the Chinese version of the Cancer Module, Therapy-Related Symptom Checklist, and Rosenberg's Self-esteem Scale. The results showed that there was a strong positive correlation between children's self-esteem and quality of life (r = 0.50) and a strong negative correlation between children's therapy-related symptoms and quality of life (r = -0.65). Confirmatory factor analysis indicated that there were 7 factors underlying the Chinese version of the Cancer Module. The study added further evidence of the construct validity of the Chinese version of the Cancer Module, patient version. The Cancer Module can be used to assess and evaluate psychological interventions directed toward promoting the quality of life of children hospitalized with cancer.

Assessing leadership decision-making styles: psychometric properties of the Leadership Judgement Indicator

PubMed Central

Faraci, Palmira; Lock, Michael; Wheeler, Robert

2013-01-01

This study aimed to validate the Italian version of the Leadership Judgement Indicator, an unconventional instrument devoted to measurement of leaders’ judgments and preferred styles, ie, directive, consultative, consensual, or delegative, when dealing with a range of decision-making scenarios. After forward-translation and back-translation, its psychometric properties were estimated for 299 managers at various levels, who were asked to put themselves in the position of leader and to rate the appropriateness of certain ways of responding to challenge. Differences between several groups of managers, ranked in order of seniority, provided evidence for discriminant validity. Internal consistency was adequate. The findings show that the Italian adaptation of the Leadership Judgement Indicator has promising psychometric qualities, suggesting its suitability for use to improve outcomes in both organizational and selection settings. PMID:24204179

Validity of the Agency for Health Care Research and Quality Patient Safety Indicators and the Centers for Medicare and Medicaid Hospital-acquired Conditions: A Systematic Review and Meta-Analysis.

PubMed

Winters, Bradford D; Bharmal, Aamir; Wilson, Renee F; Zhang, Allen; Engineer, Lilly; Defoe, Deidre; Bass, Eric B; Dy, Sydney; Pronovost, Peter J

2016-12-01

The Agency for Health Care Research and Quality Patient Safety Indicators (PSIs) and Centers for Medicare and Medicaid Services Hospital-acquired Conditions (HACs) are increasingly being used for pay-for-performance and public reporting despite concerns over their validity. Given the potential for these measures to misinform patients, misclassify hospitals, and misapply financial and reputational harm to hospitals, these need to be rigorously evaluated. We performed a systematic review and meta-analysis to assess PSI and HAC measure validity. We searched MEDLINE and the gray literature from January 1, 1990 through January 14, 2015 for studies that addressed the validity of the HAC measures and PSIs. Secondary outcomes included the effects of present on admission (POA) modifiers, and the most common reasons for discrepancies. We developed pooled results for measures evaluated by ≥3 studies. We propose a threshold of 80% for positive predictive value or sensitivity for pay-for-performance and public reporting suitability. Only 5 measures, Iatrogenic Pneumothorax (PSI 6/HAC 17), Central Line-associated Bloodstream Infections (PSI 7), Postoperative hemorrhage/hematoma (PSI 9), Postoperative deep vein thrombosis/pulmonary embolus (PSI 12), and Accidental Puncture/Laceration (PSI 15), had sufficient data for pooled meta-analysis. Only PSI 15 (Accidental Puncture and Laceration) met our proposed threshold for validity (positive predictive value only) but this result was weakened by considerable heterogeneity. Coding errors were the most common reasons for discrepancies between medical record review and administrative databases. POA modifiers may improve the validity of some measures. This systematic review finds that there is limited validity for the PSI and HAC measures when measured against the reference standard of a medical chart review. Their use, as they currently exist, for public reporting and pay-for-performance, should be publicly reevaluated in light of these findings.

From patient care to research: a validation study examining the factors contributing to data quality in a primary care electronic medical record database.

PubMed

Coleman, Nathan; Halas, Gayle; Peeler, William; Casaclang, Natalie; Williamson, Tyler; Katz, Alan

2015-02-05

Electronic Medical Records (EMRs) are increasingly used in the provision of primary care and have been compiled into databases which can be utilized for surveillance, research and informing practice. The primary purpose of these records is for the provision of individual patient care; validation and examination of underlying limitations is crucial for use for research and data quality improvement. This study examines and describes the validity of chronic disease case definition algorithms and factors affecting data quality in a primary care EMR database. A retrospective chart audit of an age stratified random sample was used to validate and examine diagnostic algorithms applied to EMR data from the Manitoba Primary Care Research Network (MaPCReN), part of the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). The presence of diabetes, hypertension, depression, osteoarthritis and chronic obstructive pulmonary disease (COPD) was determined by review of the medical record and compared to algorithm identified cases to identify discrepancies and describe the underlying contributing factors. The algorithm for diabetes had high sensitivity, specificity and positive predictive value (PPV) with all scores being over 90%. Specificities of the algorithms were greater than 90% for all conditions except for hypertension at 79.2%. The largest deficits in algorithm performance included poor PPV for COPD at 36.7% and limited sensitivity for COPD, depression and osteoarthritis at 72.0%, 73.3% and 63.2% respectively. Main sources of discrepancy included missing coding, alternative coding, inappropriate diagnosis detection based on medications used for alternate indications, inappropriate exclusion due to comorbidity and loss of data. Comparison to medical chart review shows that at MaPCReN the CPCSSN case finding algorithms are valid with a few limitations. This study provides the basis for the validated data to be utilized for research and informs users of its limitations. Analysis of underlying discrepancies provides the ability to improve algorithm performance and facilitate improved data quality.

Towards objective hand hygiene technique assessment: validation of the ultraviolet-dye-based hand-rubbing quality assessment procedure.

PubMed

Lehotsky, Á; Szilágyi, L; Bánsághi, S; Szerémy, P; Wéber, G; Haidegger, T

2017-09-01

Ultraviolet spectrum markers are widely used for hand hygiene quality assessment, although their microbiological validation has not been established. A microbiology-based assessment of the procedure was conducted. Twenty-five artificial hand models underwent initial full contamination, then disinfection with UV-dyed hand-rub solution, digital imaging under UV-light, microbiological sampling and cultivation, and digital imaging of the cultivated flora were performed. Paired images of each hand model were registered by a software tool, then the UV-marked regions were compared with the pathogen-free sites pixel by pixel. Statistical evaluation revealed that the method indicates correctly disinfected areas with 95.05% sensitivity and 98.01% specificity. Copyright © 2017 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

Psychometric evaluation of the Korean Version of the Self-Efficacy for Exercise Scale for older adults.

PubMed

Choi, Mona; Ahn, Sangwoo; Jung, Dukyoo

2015-01-01

We evaluated the psychometric properties of the Korean version of the Self-Efficacy for Exercise Scale (SEE-K). The SEE-K consists of nine items and was translated into Korean using the forward-backward translation method. We administered it to 212 community-dwelling older adults along with measures of outcome expectation for exercise, quality of life, and physical activity. The validity was determined using confirmatory factor analysis and Rasch analysis with INFIT and OUTFIT statistics, which showed acceptable model fit. The concurrent validity was confirmed according to positive correlations between the SEE-K, outcome expectation for exercise, and quality of life. Furthermore, the high physical activity group had higher SEE-K scores. Finally, the reliability of the SEE-K was deemed acceptable based on Cronbach's alpha, coefficients of determination, and person and item separation indices with reliability. Thus, the SEE-K appears to have satisfactory validity and reliability among older adults in South Korea. Copyright © 2015 Elsevier Inc. All rights reserved.

Cluster designs to assess the prevalence of acute malnutrition by lot quality assurance sampling: a validation study by computer simulation

PubMed Central

Olives, Casey; Pagano, Marcello; Deitchler, Megan; Hedt, Bethany L; Egge, Kari; Valadez, Joseph J

2009-01-01

Traditional lot quality assurance sampling (LQAS) methods require simple random sampling to guarantee valid results. However, cluster sampling has been proposed to reduce the number of random starting points. This study uses simulations to examine the classification error of two such designs, a 67×3 (67 clusters of three observations) and a 33×6 (33 clusters of six observations) sampling scheme to assess the prevalence of global acute malnutrition (GAM). Further, we explore the use of a 67×3 sequential sampling scheme for LQAS classification of GAM prevalence. Results indicate that, for independent clusters with moderate intracluster correlation for the GAM outcome, the three sampling designs maintain approximate validity for LQAS analysis. Sequential sampling can substantially reduce the average sample size that is required for data collection. The presence of intercluster correlation can impact dramatically the classification error that is associated with LQAS analysis. PMID:20011037

Measuring quality of life in low-income, Spanish-speaking Puerto Ricans with type 2 diabetes residing in the mainland U.S.

PubMed

Lemon, Stephenie C; Rosal, Milagros C; Welch, Garry

2011-11-01

This study assessed the psychometric properties of the Audit of Diabetes-Dependent Quality of Life (ADDQoL) modified for low-income, low-education, Spanish-speaking Puerto Ricans with type 2 diabetes residing in the northeastern United States. Cross-sectional data from 226 patients were analyzed. Scale modifications included simplification of instructions, question wording and response format, and oral administration. Reliability was assessed with Cronbach's alpha coefficient and internal structure by exploratory factor analysis. Criterion validity was assessed using correlation analysis and linear and logistic regression models assessing the association of the ADDQoL with standardized physical health status, mental health status, depression, and comorbidity indices. Two ADDQoL items were dropped. The modified scale had excellent internal consistency and supported the original scale factor structure. Criterion validity results supported the validity of this measure. The modified ADDQoL showed psychometric properties that support its use in low-income, Spanish-speaking Puerto Ricans with type 2 diabetes who reside in mainland U.S.

Understanding and Measuring Health Care Insecurity

PubMed Central

Tomsik, Philip E.; Smith, Samantha; Mason, Mary Jane; Zyzanski, Stephen J.; Stange, Kurt C.; Werner, James J.; Flocke, Susan A.

2015-01-01

Purpose To define the concept of “health care insecurity,” validate a new self-report measure, and examine the impact of beginning care at a free clinic on uninsured patients’ health care insecurity. Methods Consecutive new patients presenting at a free clinic completed 15 items assessing domains of health care insecurity (HCI) at their first visit and again four to eight weeks later. Psychometrics and change of the HCI measure were examined. Results The HCI measure was found to have high internal consistency (α=0.94). Evidence of concurrent validity was indicated by negative correlation with VR-12 health-related quality of life physical and mental health components and positive correlation with the Perceived Stress Scale. Predictive validity was shown among the 83% of participants completing follow-up: HCI decreased after beginning care at a free clinic (p<.001). Conclusion Reliably assessing patient experience of health care insecurity is feasible and has potential to inform efforts to improve quality and access to care among underserved populations. PMID:25418245

The use of sequential indicator simulation to characterize geostatistical uncertainty; Yucca Mountain Site Characterization Project

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hansen, K.M.

1992-10-01

Sequential indicator simulation (SIS) is a geostatistical technique designed to aid in the characterization of uncertainty about the structure or behavior of natural systems. This report discusses a simulation experiment designed to study the quality of uncertainty bounds generated using SIS. The results indicate that, while SIS may produce reasonable uncertainty bounds in many situations, factors like the number and location of available sample data, the quality of variogram models produced by the user, and the characteristics of the geologic region to be modeled, can all have substantial effects on the accuracy and precision of estimated confidence limits. It ismore » recommended that users of SIS conduct validation studies for the technique on their particular regions of interest before accepting the output uncertainty bounds.« less

Intercomparison and validation of MODIS and GLASS leaf area index (LAI) products over mountain areas: A case study in southwestern China

NASA Astrophysics Data System (ADS)

Jin, Huaan; Li, Ainong; Bian, Jinhu; Nan, Xi; Zhao, Wei; Zhang, Zhengjian; Yin, Gaofei

2017-03-01

The validation study of leaf area index (LAI) products over rugged surfaces not only gives additional insights into data quality of LAI products, but deepens understanding of uncertainties regarding land surface process models depended on LAI data over complex terrain. This study evaluated the performance of MODIS and GLASS LAI products using the intercomparison and direct validation methods over southwestern China. The spatio-temporal consistencies, such as the spatial distributions of LAI products and their statistical relationship as a function of topographic indices, time, and vegetation types, respectively, were investigated through intercomparison between MODIS and GLASS products during the period 2011-2013. The accuracies and change ranges of these two products were evaluated against available LAI reference maps over 10 sampling regions which standed for typical vegetation types and topographic gradients in southwestern China. The results show that GLASS LAI exhibits higher percentage of good quality data (i.e. successful retrievals) and smoother temporal profiles than MODIS LAI. The percentage of successful retrievals for MODIS and GLASS is vulnerable to topographic indices, especially to relief amplitude. Besides, the two products do not capture seasonal dynamics of crop, especially in spring over heterogeneously hilly regions. The yearly mean LAI differences between MODIS and GLASS are within ±0.5 for 64.70% of the total retrieval pixels over southwestern China. The spatial distribution of mean differences and temporal profiles of these two products are inclined to be dominated by vegetation types other than topographic indices. The spatial and temporal consistency of these two products is good over most area of grasses/cereal crops; however, it is poor for evergreen broadleaf forest. MODIS presents more reliable change range of LAI than GLASS through comparison with fine resolution reference maps over most of sampling regions. The accuracies of direct validation are obtained for GLASS LAI (r = 0.35, RMSE = 1.72, mean bias = -0.71) and MODIS LAI (r = 0.49, RMSE = 1.75, mean bias = -0.67). GLASS performs similarly to MODIS, but may be marginally inferior to MODIS based on our direct validation results. The validation experience demonstrates the necessity and importance of topographic consideration for LAI estimation over mountain areas. Considerable attention will be paid to the improvements of surface reflectance, retrieval algorithm and land cover types so as to enhance the quality of LAI products in topographically complex terrain.

Colonoscopy Quality: Metrics and Implementation

PubMed Central

Calderwood, Audrey H.; Jacobson, Brian C.

2013-01-01

Synopsis Colonoscopy is an excellent area for quality improvement 1 because it is high volume, has significant associated risk and expense, and there is evidence that variability in its performance affects outcomes. The best endpoint for validation of quality metrics in colonoscopy is colorectal cancer incidence and mortality, but because of feasibility issues, a more readily accessible metric is the adenoma detection rate (ADR). Fourteen quality metrics were proposed by the joint American Society of Gastrointestinal Endoscopy/American College of Gastroenterology Task Force on “Quality Indicators for Colonoscopy” in 2006, which are described in further detail below. Use of electronic health records and quality-oriented registries will facilitate quality measurement and reporting. Unlike traditional clinical research, implementation of quality improvement initiatives involves rapid assessments and changes on an iterative basis, and can be done at the individual, group, or facility level. PMID:23931862

Biomagnetic monitoring as a validation tool for local air quality models: a case study for an urban street canyon.

PubMed

Hofman, Jelle; Samson, Roeland

2014-09-01

Biomagnetic monitoring of tree leaf deposited particles has proven to be a good indicator of the ambient particulate concentration. The objective of this study is to apply this method to validate a local-scale air quality model (ENVI-met), using 96 tree crown sampling locations in a typical urban street canyon. To the best of our knowledge, the application of biomagnetic monitoring for the validation of pollutant dispersion modeling is hereby presented for the first time. Quantitative ENVI-met validation showed significant correlations between modeled and measured results throughout the entire in-leaf period. ENVI-met performed much better at the first half of the street canyon close to the ring road (r=0.58-0.79, RMSE=44-49%), compared to second part (r=0.58-0.64, RMSE=74-102%). The spatial model behavior was evaluated by testing effects of height, azimuthal position, tree position and distance from the main pollution source on the obtained model results and magnetic measurements. Our results demonstrate that biomagnetic monitoring seems to be a valuable method to evaluate the performance of air quality models. Due to the high spatial and temporal resolution of this technique, biomagnetic monitoring can be applied anywhere in the city (where urban green is present) to evaluate model performance at different spatial scales. Copyright © 2014 Elsevier Ltd. All rights reserved.

Impact of rain gauge quality control and interpolation on streamflow simulation: an application to the Warwick catchment, Australia

NASA Astrophysics Data System (ADS)

Liu, Shulun; Li, Yuan; Pauwels, Valentijn R. N.; Walker, Jeffrey P.

2017-12-01

Rain gauges are widely used to obtain temporally continuous point rainfall records, which are then interpolated into spatially continuous data to force hydrological models. However, rainfall measurements and interpolation procedure are subject to various uncertainties, which can be reduced by applying quality control and selecting appropriate spatial interpolation approaches. Consequently, the integrated impact of rainfall quality control and interpolation on streamflow simulation has attracted increased attention but not been fully addressed. This study applies a quality control procedure to the hourly rainfall measurements obtained in the Warwick catchment in eastern Australia. The grid-based daily precipitation from the Australian Water Availability Project was used as a reference. The Pearson correlation coefficient between the daily accumulation of gauged rainfall and the reference data was used to eliminate gauges with significant quality issues. The unrealistic outliers were censored based on a comparison between gauged rainfall and the reference. Four interpolation methods, including the inverse distance weighting (IDW), nearest neighbors (NN), linear spline (LN), and ordinary Kriging (OK), were implemented. The four methods were firstly assessed through a cross-validation using the quality-controlled rainfall data. The impacts of the quality control and interpolation on streamflow simulation were then evaluated through a semi-distributed hydrological model. The results showed that the Nash–Sutcliffe model efficiency coefficient (NSE) and Bias of the streamflow simulations were significantly improved after quality control. In the cross-validation, the IDW and OK methods resulted in good interpolation rainfall, while the NN led to the worst result. In term of the impact on hydrological prediction, the IDW led to the most consistent streamflow predictions with the observations, according to the validation at five streamflow-gauged locations. The OK method performed second best according to streamflow predictions at the five gauges in the calibration period (01/01/2007–31/12/2011) and four gauges during the validation period (01/01/2012–30/06/2014). However, NN produced the worst prediction at the outlet of the catchment in the validation period, indicating a low robustness. While the IDW exhibited the best performance in the study catchment in terms of accuracy, robustness and efficiency, more general recommendations on the selection of rainfall interpolation methods need to be further explored.

Impact of rain gauge quality control and interpolation on streamflow simulation: an application to the Warwick catchment, Australia

NASA Astrophysics Data System (ADS)

Liu, Shulun; Li, Yuan; Pauwels, Valentijn R. N.; Walker, Jeffrey P.

2018-01-01

Rain gauges are widely used to obtain temporally continuous point rainfall records, which are then interpolated into spatially continuous data to force hydrological models. However, rainfall measurements and interpolation procedure are subject to various uncertainties, which can be reduced by applying quality control and selecting appropriate spatial interpolation approaches. Consequently, the integrated impact of rainfall quality control and interpolation on streamflow simulation has attracted increased attention but not been fully addressed. This study applies a quality control procedure to the hourly rainfall measurements obtained in the Warwick catchment in eastern Australia. The grid-based daily precipitation from the Australian Water Availability Project was used as a reference. The Pearson correlation coefficient between the daily accumulation of gauged rainfall and the reference data was used to eliminate gauges with significant quality issues. The unrealistic outliers were censored based on a comparison between gauged rainfall and the reference. Four interpolation methods, including the inverse distance weighting (IDW), nearest neighbors (NN), linear spline (LN), and ordinary Kriging (OK), were implemented. The four methods were firstly assessed through a cross-validation using the quality-controlled rainfall data. The impacts of the quality control and interpolation on streamflow simulation were then evaluated through a semi-distributed hydrological model. The results showed that the Nash–Sutcliffe model efficiency coefficient (NSE) and Bias of the streamflow simulations were significantly improved after quality control. In the cross-validation, the IDW and OK methods resulted in good interpolation rainfall, while the NN led to the worst result. In term of the impact on hydrological prediction, the IDW led to the most consistent streamflow predictions with the observations, according to the validation at five streamflow-gauged locations. The OK method performed second best according to streamflow predictions at the five gauges in the calibration period (01/01/2007–31/12/2011) and four gauges during the validation period (01/01/2012–30/06/2014). However, NN produced the worst prediction at the outlet of the catchment in the validation period, indicating a low robustness. While the IDW exhibited the best performance in the study catchment in terms of accuracy, robustness and efficiency, more general recommendations on the selection of rainfall interpolation methods need to be further explored.

OECD Health Care Quality Indicator Project. The expert panel on primary care prevention and health promotion.

PubMed

Marshall, Martin; Klazinga, Niek; Leatherman, Sheila; Hardy, Charlie; Bergmann, Eckhard; Pisco, Luis; Mattke, Soeren; Mainz, Jan

2006-09-01

This article describes a project undertaken as part of the Organization for Economic Co-operation and Development (OECD)'s Healthcare Quality Indicator (HCQI) Project, which aimed to develop a set of quality indicators representing the domains of primary care, prevention and health promotion, and which could be used to assess the performance of primary care systems. Existing quality indicators from around the world were mapped to an organizing framework which related primary care, prevention, and health promotion. The indicators were judged against the US Institute of Medicine's assessment criteria of importance and scientific soundness, and only those which met these criteria and were likely to be feasible were included. An initial large set of indicators was reduced by the primary care expert panel using a modified Delphi process. A set of 27 indicators was produced. Six of them were related to health promotion, covering health-related behaviours that are typically targeted by health education and outreach campaigns, 13 to preventive care with a focus on prenatal care and immunizations and eight to primary clinical care mainly addressing activities related to risk reduction. The indicators selected placed a strong emphasis on the public health aspects of primary care. This project represents an important but preliminary step towards a set of measures to evaluate and compare primary care quality. Further work is required to assess the operational feasibility of the indicators and the validity of any benchmarking data drawn from international comparisons. A conceptual framework needs to be developed that comprehensively captures the complex construct of primary care as a basis for the selection of additional indicators.

Quality indicators to compare accredited independent pharmacies and accredited chain pharmacies in Thailand.

PubMed

Arkaravichien, Wiwat; Wongpratat, Apichaya; Lertsinudom, Sunee

2016-08-01

Background Quality indicators determine the quality of actual practice in reference to standard criteria. The Community Pharmacy Association (Thailand), with technical support from the International Pharmaceutical Federation, developed a tool for quality assessment and quality improvement at community pharmacies. This tool has passed validity and reliability tests, but has not yet had feasibility testing. Objective (1) To test whether this quality tool could be used in routine settings. (2) To compare quality scores between accredited independent and accredited chain pharmacies. Setting Accredited independent pharmacies and accredited chain pharmacies in the north eastern region of Thailand. Methods A cross sectional study was conducted in 34 accredited independent pharmacies and accredited chain pharmacies. Quality scores were assessed by observation and by interviewing the responsible pharmacists. Data were collected and analyzed by independent t-test and Mann-Whitney U test as appropriate. Results were plotted by histogram and spider chart. Main outcome measure Domain's assessable scores, possible maximum scores, mean and median of measured scores. Results Domain's assessable scores were close to domain's possible maximum scores. This meant that most indicators could be assessed in most pharmacies. The spider chart revealed that measured scores in the personnel, drug inventory and stocking, and patient satisfaction and health promotion domains of chain pharmacies were significantly higher than those of independent pharmacies (p < 0.05). There was no statistical difference between independent pharmacies and chain pharmacies in the premise and facility or dispensing and patient care domains. Conclusion Quality indicators developed by the Community Pharmacy Association (Thailand) could be used to assess quality of practice in pharmacies in routine settings. It is revealed that the quality scores of chain pharmacies were higher than those of independent pharmacies.

Quality evaluation of Yin Chen Hao Tang extract based on fingerprint chromatogram and simultaneous determination of five bioactive constituents.

PubMed

Wang, Xijun; Lv, Haitao; Sun, Hui; Jiang, Xingang; Wu, Zeming; Sun, Wenjun; Wang, Ping; Liu, Lian; Bi, Kaishun

2008-01-01

A completely validated method based on HPLC coupled with photodiode array detector (HPLC-UV) was described for evaluating and controlling quality of Yin Chen Hao Tang extract (YCHTE). First, HPLC-UV fingerprint chromatogram of YCHTE was established for preliminarily elucidating amount and chromatographic trajectory of chemical constituents in YCHTE. Second, for the first time, five mainly bioactive constituents in YCHTE were simultaneously determined based on fingerprint chromatogram for furthermore controlling the quality of YCHTE quantitatively. The developed method was applied to analyze 12 batches of YCHTE samples which consisted of herbal drugs from different places of production, showed acceptable linearity, intraday (RSD <5%), interday precision (RSD <4.80%), and accuracy (RSD <2.80%). As a result, fingerprint chromatogram determined 15 representative general fingerprint peaks, and the fingerprint chromatogram resemblances are all better than 0.9996. The contents of five analytes in different batches of YCHTE samples do not indicate significant difference. So, it is concluded that the developed HPLC-UV method is a more fully validated and complete method for evaluating and controlling the quality of YCHTE.

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

PubMed Central

Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel

2016-01-01

Background The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users’ satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=−.35, P<.001) and perceived stress (r=−.48, P<.001) demonstrated the construct validity of the scale. Conclusions The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user’s general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user’s perspective in the overall evaluation of Web-based health interventions. PMID:27582341

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions.

PubMed

Boß, Leif; Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel

2016-08-31

The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

[Alfalfa quality evaluation in the field by near-infrared reflectance spectroscopy].

PubMed

Xu, Rui-Xuan; Li, Dong-Ning; Yang, Dong-Hai; Lin, Jian-Hai; Xiang, Min; Zhang, Ying-Jun

2013-11-01

To explore the feasibility of using near-infrared reflectance spectroscopy (NIRS) to evaluate alfalfa quality rapidly in the field and try to find the appropriate machine and sample preparation method, the representative population of 170 fresh alfalfa samples collected from different regions with different stages and different cuts were scanned by a portable NIRS spectrometer (1 100 - 1 800 nm). This is the first time to build models of fresh alfalfa to rapidly estimate quality in the field for harvesting in time. The calibrations of dry matter (DM), crude protein (CP), neutral detergent fiber (NDF) and acid detergent fiber (ADF) were developed through the partial least squares regression (PLS). The determination coefficients of cross-validation (R2((CV)) were 0.831 4, 0.597 9, 0.803 6, 0.786 1 for DM, CP, NDF, ADF, respectively; the root mean standard error of cross-validation (RMSECV) were 1.241 1, 0.261 4, 0.990 3, 0.830 6; The determination coefficients of validation (R2(V)) were 0.815 0, 0.401 1, 0.784 9, 0.752 1 and the root mean standard errors of validation(RMSEP)were 1.06, 0.31, 0.95, 0.80 for DM, CP, NDF, ADF, respectively. For fresh alfalfa ,the calibration of DM, NDF, ADF can do rough quantitative analysis but the CP's calibration is failed. however, as CP in alfalfa hay is enough for animal and the DM, NDF and ADF is the crucial indicator for evaluating havest time, the model of DM, NDF and ADF can be used for evaluating the alfalfa quality rapidly in the field.

Reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales in adolescents.

PubMed

Amiri, Parisa; M Ardekani, Emad; Jalali-Farahani, Sara; Hosseinpanah, Farhad; Varni, James W; Ghofranipour, Fazlollah; Montazeri, Ali; Azizi, Fereidoun

2010-12-01

The objective of this study was to investigate the reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales in adolescents After linguistic validation, the Iranian version of the PedsQL™ 4.0 was completed by 848 healthy and 26 chronically ill adolescents aged 13-18 years and their parents. The internal consistency as measured by Cronbach's alpha coefficients exceeded the minimum reliability standard of .70. No floor effects were observed. Ceiling effects detected ranged from 1.5% for adolescent self-report total scale score to 42.2% for self-report social functioning. All monotrait-multimethod correlations were higher than multitrait-multimethod correlations. The intraclass correlation coefficients (ICC) between adolescent self-report and parent proxy-report showed good to excellent agreement. Exploratory factor analysis supported mainly comparable results with the original US English dialect version. The results of the confirmatory factor analysis for 5-factor models for both self-report and proxy-report indicated acceptable fit for the proposed models. Regarding gender and health status, as hypothesized from previous studies, girls reported lower health-related quality of life than boys on the total score, physical and emotional functioning, and healthy adolescents reported significantly higher health-related quality of life than those with chronic illnesses. The findings support the initial reliability and validity of the Iranian version of the PedsQL™ 4.0 as a generic instrument to measure HRQOL of adolescents in Iran.

Quality of life of Chinese urologists: a cross-sectional study using WHOQOL-BREF.

PubMed

Wei, Y B; Yin, Z; Gao, Y L; Yan, B; Wang, Z; Yang, J R

2015-06-01

In recent years, Chinese hospital settings are under violent threats. The exact status of quality of life of Chinese doctors under these disastrous situations remains obscure. The aim of this study was to assess the quality of life of Chinese urologists and analyse its potential affecting factors. Cross-sectional survey. Beijing, China. Overall, 1000 participants from more than 30 areas of China, who participated in the 20th National Urology Conference in Beijing in 2013, were surveyed. The brief version of the World Health Organization Quality of Life (WHOQOL-BREF) Chinese version was used to assess the quality of life among these urologists. The relationship between quality of life and the affecting factors was analysed. Of the 1000 questionnaires, 856 were completed and returned, and 708 questionnaires were valid for analysis. Approximately 46% of the respondents came from provincial capitals, 54.2% of them felt stress from medical environment, while 76.0% felt stress from research work, and 85.3% from promotion. Cronbach's α coefficient of the instrument was 0.825, Kaiser-Meyer-Olkin measure was 0.841, and P value of Bartlett's sphericity was <0.001. The results of binary logistic regression indicated gender, work years, and medical environment as potential affecting factors of quality of life only influenced one domain. In contrast, research work and promotion influenced three domains of the WHOQOL-BREF. The study indicated that the WHOQOL-BREF may be a reliable and valid tool to assess quality of life of Chinese urologists. In China it is true that the deteriorative medical environment negatively affects medical practice according to previous studies, and policies are recommended to improve the situation. Nevertheless, we should not be too pessimistic about it, as in today's context research work and promotion may be the most extensive and significant affecting factors on doctors' quality of life.

Service Quality Assessment of Hospitals in Asian Context: An Empirical Evidence From Pakistan

PubMed Central

Shafiq, Muhammad; Naeem, Muhammad Azhar; Munawar, Zartasha; Fatima, Iram

2017-01-01

Hospitals vary from one another in terms of their specialty, services offered, and resource availability. Their services are widely measured with scales that gauge patients’ perspective. Therefore, there is a need for research to develop a scale that measures hospital service quality in Asian hospitals, regardless of their nature or ownership. To address this research need, this study adapted the SERVQUAL instrument to develop a service quality measurement scale. Data were collected from inpatients and outpatients at 9 different hospitals, and the scale was developed using structural equation modeling. The developed scale was then validated by identifying service quality gaps and ranking the areas that require managerial effort. The findings indicated that all 5 dimensions of SERVQUAL are valid in Asian countries such as Pakistan, with 13 items retained. Reliability, tangibility, responsiveness, empathy, and assurance were ranked first, second, third, fourth, and fifth, respectively, in terms of the size of the quality gap. The gaps were statistically significant, with values ≤.05; therefore, hospital administrators must focus on each of these areas. By focusing on the identified areas of improvement, health care authorities, managers, practitioners, and decision makers can bring substantial change within hospitals. PMID:28660771

Service Quality Assessment of Hospitals in Asian Context: An Empirical Evidence From Pakistan.

PubMed

Shafiq, Muhammad; Naeem, Muhammad Azhar; Munawar, Zartasha; Fatima, Iram

2017-01-01

Hospitals vary from one another in terms of their specialty, services offered, and resource availability. Their services are widely measured with scales that gauge patients' perspective. Therefore, there is a need for research to develop a scale that measures hospital service quality in Asian hospitals, regardless of their nature or ownership. To address this research need, this study adapted the SERVQUAL instrument to develop a service quality measurement scale. Data were collected from inpatients and outpatients at 9 different hospitals, and the scale was developed using structural equation modeling. The developed scale was then validated by identifying service quality gaps and ranking the areas that require managerial effort. The findings indicated that all 5 dimensions of SERVQUAL are valid in Asian countries such as Pakistan, with 13 items retained. Reliability, tangibility, responsiveness, empathy, and assurance were ranked first, second, third, fourth, and fifth, respectively, in terms of the size of the quality gap. The gaps were statistically significant, with values ≤.05; therefore, hospital administrators must focus on each of these areas. By focusing on the identified areas of improvement, health care authorities, managers, practitioners, and decision makers can bring substantial change within hospitals.

[Evaluation of the quality of life in people with Autistic Spectrum Disorder].

PubMed

Cuesta Gómez, José L; Casado Muñoz, Raquel; Lezcano Barbero, Fernando

2010-01-01

The search for quality of life and the trend towards continual improvement has today become a true reference which guides most social organizations. The bodies which offer support to persons with Autistic Spectrum Disorder (referred to hereon as ASD) have not gone untouched by the influence of this concept of quality. The serious difficulties which are associated with this disorder affect the main areas of one ??s personal development: socialisation, communication, comprehension, and adaptation to ones environment, and they require that organizations promote integral networks of resources which guarantee a lifetime of quality services and support. The difficulties of assessing quality of life in persons with ASD from the subjective perspective, make it especially necessary to find valid indicators that help us to favour certain conditions in the ASD person ??s environment. This identified need is justification for the objective put forward: to design an instrument capable of being used to assess the quality of life of persons with ASD, made up of a Guide of Indicators, which organizations and programmes can then use to promote favourable conditions.

Automated Assessment of the Quality of Depression Websites

PubMed Central

Tang, Thanh Tin; Hawking, David; Christensen, Helen

2005-01-01

Background Since health information on the World Wide Web is of variable quality, methods are needed to assist consumers to identify health websites containing evidence-based information. Manual assessment tools may assist consumers to evaluate the quality of sites. However, these tools are poorly validated and often impractical. There is a need to develop better consumer tools, and in particular to explore the potential of automated procedures for evaluating the quality of health information on the web. Objective This study (1) describes the development of an automated quality assessment procedure (AQA) designed to automatically rank depression websites according to their evidence-based quality; (2) evaluates the validity of the AQA relative to human rated evidence-based quality scores; and (3) compares the validity of Google PageRank and the AQA as indicators of evidence-based quality. Method The AQA was developed using a quality feedback technique and a set of training websites previously rated manually according to their concordance with statements in the Oxford University Centre for Evidence-Based Mental Health’s guidelines for treating depression. The validation phase involved 30 websites compiled from the DMOZ, Yahoo! and LookSmart Depression Directories by randomly selecting six sites from each of the Google PageRank bands of 0, 1-2, 3-4, 5-6 and 7-8. Evidence-based ratings from two independent raters (based on concordance with the Oxford guidelines) were then compared with scores derived from the automated AQA and Google algorithms. There was no overlap in the websites used in the training and validation phases of the study. Results The correlation between the AQA score and the evidence-based ratings was high and significant (r=0.85, P<.001). Addition of a quadratic component improved the fit, the combined linear and quadratic model explaining 82 percent of the variance. The correlation between Google PageRank and the evidence-based score was lower than that for the AQA. When sites with zero PageRanks were included the association was weak and non-significant (r=0.23, P=.22). When sites with zero PageRanks were excluded, the correlation was moderate (r=.61, P=.002). Conclusions Depression websites of different evidence-based quality can be differentiated using an automated system. If replicable, generalizable to other health conditions and deployed in a consumer-friendly form, the automated procedure described here could represent an important advance for consumers of Internet medical information. PMID:16403723

[Effective coverage to manage domestic violence against women in Mexican municipalities: limits of metrics].

PubMed

Viviescas-Vargas, Diana P; Idrovo, Alvaro Javier; López-López, Erika; Uicab-Pool, Gloria; Herrera-Trujillo, Mónica; Balam-Gómez, Maricela; Hidalgo-Solórzano, Elisa

2013-08-01

The study estimated the effective coverage of health services in primary care for the management of domestic violence against women in three municipalities in Mexico. We estimated the prevalence and severity of violence using a validated scale, and the effective coverage proposed by Shengelia and partners with any modifications. Quality care was considered when there was a suggestion to report it to authorities. The use and quality of care was low in the three municipalities analyzed, used most frequently when there was sexual or physical violence. Effective coverage was 29.41%, 16.67% and zero in Guachochi, Jojutla and Tizimín, respectively. The effective coverage indicator had difficulties in measuring events and responses that were not based on biomedical models. Findings suggest that the indicator can be improved by incorporating other dimensions of quality.

Item generation in the development of an inpatient experience questionnaire: a qualitative study

PubMed Central

2013-01-01

Background Patient experience is a key feature of quality improvement in modern health-care delivery. Measuring patient experience is one of several tools used to assess and monitor the quality of health services. This study aims to develop a tool for assessing patient experience with inpatient care in public hospitals in Hong Kong. Methods Based on the General Inpatient Questionnaire (GIQ) framework of the Care Quality Commission as a discussion guide, a qualitative study involving focus group discussions and in-depth individual interviews with patients was employed to develop a tool for measuring inpatient experience in Hong Kong. Results All participants agreed that a patient satisfaction survey is an important platform for collecting patients’ views on improving the quality of health-care services. Findings of the focus group discussions and in-depth individual interviews identified nine key themes as important hospital quality indicators: prompt access, information provision, care and involvement in decision making, physical and emotional needs, coordination of care, respect and privacy, environment and facilities, handling of patient feedback, and overall care from health-care professionals and quality of care. Privacy, complaint mechanisms, patient involvement, and information provision were further highlighted as particularly important areas for item revision by the in-depth individual interviews. Thus, the initial version of the Hong Kong Inpatient Experience Questionnaire (HKIEQ), comprising 58 core items under nine themes, was developed. Conclusions A set of dimensions and core items of the HKIEQ was developed and the instrument will undergo validity and reliability tests through a validation survey. A valid and reliable tool is important in accurately assessing patient experience with care delivery in hospitals to improve the quality of health-care services. PMID:23835186

Development and validation of Arabic version of the postoperative quality of recovery-40 questionnaire.

PubMed

Terkawi, Abdullah Sulieman; Myles, Paul S; Riad, Waleed; Nassar, Sumaya Nemer; Mahmoud, Maissa; AlKahtani, Ghadah Jumaan; Sala, Fatima Jaina; Abdulrahman, Anas; Doais, Khaled S; Terkawi, Rayan Suliman; Tsang, Siny

2017-05-01

The postoperative quality of recovery-40 (QoR-40) is one of the most frequently used tools to assess the quality of recovery after surgery. The aim of the current study was to translate, culturally adapt, and validate the QoR-40 questionnaire in Arabic. A systematic translation process was used to translate the original English QoR-40 into Arabic. After the pilot study, the translated version was validated among patients who underwent different types of surgeries. The reliability (using internal consistency) and validity of our translated Arabic version was examined. To investigate the responsiveness of the translated QoR-40, the questionnaire was administered five times among the same group of patients (once before surgery as baseline measure, and four times after surgery, up to 1 week after surgery). A total of 182 participants (7 men, 175 women) were included in the study. The QoR-40 total scale and all subscales showed excellent internal consistencies over time, with the exception of the QoR-40 pain subscale at postoperative day 1. The QoR-40 total and subscale scores were inversely associated with patients' self-report pain scores but positively correlated with patients' self-report recovery scores. Patients' QoR-40 total, comfort, emotions, and physical subscale scores increased over time after surgery, indicating a general trend of recovery over time. Patients' scores in the QoR-40 pain and support subscales remained stable over time, suggesting no substantial changes were reported in these two domains. Quality of recovery was also found to be related to patients' ages, American Society of Anesthesiologists Physical Status, and the extent of surgery (major vs. minor). Most patients found the Arabic QoR-40 questions to be clear and easy to understand and thought the questionnaire items covered all their problem areas regarding their quality of recovery. Our translated version of QoR-40 was reliable and valid for use among Arabic-speaking patients. In addition, the QoR-40 was able to assess the quality of recovery in several domains among patients who underwent surgical procedures.

Development and validation of a new questionnaire assessing quality of life in adults with hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ).

PubMed

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach's alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism.

Quality of care assessment in geriatric evaluation and management units: construction of a chart review tool for a tracer condition.

PubMed

Kergoat, Marie-Jeanne; Leclerc, Bernard-Simon; Leduc, Nicole; Latour, Judith; Berg, Katherine; Bolduc, Aline

2009-07-29

The number of elderly people requiring hospital care is growing, so, quality and assessment of care for elders are emerging and complex areas of research. Very few validated and reliable instruments exist for the assessment of quality of acute care in this field. This study's objective was to create such a tool for Geriatric Evaluation and Management Units (GEMUs). The methodology involved a reliability and feasibility study of a retrospective chart review on 934 older inpatients admitted in 49 GEMUs during the year 2002-2003 for fall-related trauma as a tracer condition. Pertinent indicators for a chart abstraction tool, the Geriatric Care Tool (GCT), were developed and validated according to five dimensions: access to care, comprehensiveness, continuity of care, patient-centred care and appropriateness. Consensus methods were used to develop the content. Participants were experts representing eight main health care professions involved in GEMUs from 19 different sites. Items associated with high quality of care at each step of the multidisciplinary management of patients admitted due to falls were identified. The GCT was tested for intra- and inter-rater reliability using 30 medical charts reviewed by each of three independent and blinded trained nurses. Kappa and agreement measures between pairs of chart reviewers were computed on an item-by-item basis. Three quarters of 169 items identifying the process of care, from the case history to discharge planning, demonstrated good agreement (kappa greater than 0.40 and agreement over 70%). Indicators for the appropriateness of care showed less reliability. Content validity and reliability results, as well as the feasibility of the process, suggest that the chart abstraction tool can gather standardized and pertinent clinical information for further evaluating quality of care in GEMU using admission due to falls as a tracer condition. However, the GCT should be evaluated in other models of acute geriatric units and new strategies should be developed to improve reliability of peer assessments in characterizing the quality of care for elderly patients with complex conditions.

Cross-cultural adaptation and validation of the Chinese Comfort, Afford, Respect, and Expect scale of caring nurse-patient interaction competence.

PubMed

Chung, Hui-Chun; Hsieh, Tsung-Cheng; Chen, Yueh-Chih; Chang, Shu-Chuan; Hsu, Wen-Lin

2017-11-29

To investigate the construct validity and reliability of the Chinese Comfort, Afford, Respect, and Expect scale, which can be used to determine clinical nurses' competence. The results can also serve to promote nursing competence and improve patient satisfaction. Nurse-patient interaction is critical for improving nursing care quality. However, to date, no relevant validated instrument has been proposed for assessing caring nurse-patient interaction competence in clinical practice. This study adapted and validated the Chinese version of the caring nurse-patient interaction scale. A cross-cultural adaptation and validation study. A psychometric analysis of the four major constructs of the Chinese Comfort, Afford, Respect, and Expect scale was conducted on a sample of 356 nurses from a medical centre in China. Item analysis and exploratory factor analysis were adopted to extract the main components, both the internal consistency and correlation coefficients were used to examine reliability and a confirmatory factor analysis was adopted to verify the construct validity. The goodness-of-fit results of the model were strong. The standardised factor loadings of the Chinese Comfort, Afford, Respect, and Expect scale ranged from 0.73-0.95, indicating that the validity and reliability of this instrument were favourable. Moreover, the 12 extracted items explained 95.9% of the measured content of the Chinese Comfort, Afford, Respect, and Expect scale. The results serve as empirical evidence regarding the validity and reliability of the Chinese Comfort, Afford, Respect, and Expect scale. Hospital nurses increasingly demand help from patients and their family members in identifying health problems and assisting with medical decision-making. Therefore, enhancing nurses' competence in nurse-patient interactions is crucial for nursing and hospital managers to improve nursing care quality. The Chinese caring nurse-patient interaction scale can serve as an effective tool for nursing and hospital managers to evaluate the caring nurse-patient interaction confidence of nurses and improve inpatient satisfaction and quality of care. © 2017 John Wiley & Sons Ltd.

Development of a Healthy Dietary Habits Index for New Zealand Adults.

PubMed

Wong, Jyh Eiin; Haszard, Jillian J; Howe, Anna S; Parnell, Winsome R; Skidmore, Paula M L

2017-05-03

Healthful dietary habits are individually associated with better nutrient intake and positive health outcomes; however, this information is rarely examined together to validate an indicator of diet quality. This study developed a 15-item Healthy Dietary Habits Index (HDHI) based on self-reported dietary habits information collected in the 2008/09 New Zealand Adult Nutrition Survey. The validity of HDHI as a diet quality index was examined in relation to sociodemographic factors, 24-diet recall derived nutrient intakes, and nutritional biomarkers in a representative sample of adults aged 19 years and above. Linear regression models were employed to determine associations between HDHI quintiles and energy-adjusted nutrient data and nutritional biomarkers. Significantly higher HDHI scores were found among women, older age groups, Non-Māori or Pacific ethnic groups, and less socioeconomically-deprived groups (all p < 0.001). Increasing quintiles of HDHI were associated with higher intakes of dietary fibre and seven micronutrients including calcium, iron, and vitamin C, and lower intakes of energy, macronutrients, sodium, zinc, vitamins B6 and B12. Associations in the expected directions were also found for urinary sodium, whole blood folate, serum and red blood cell folate, and plasma selenium (all p < 0.001). The present findings suggest that the HDHI is a valid measure of diet quality as it is capable of discerning quality of diets of subgroups and ranking nutrient intakes among NZ adults.

Development of a Healthy Dietary Habits Index for New Zealand Adults

PubMed Central

Wong, Jyh Eiin; Haszard, Jillian J.; Howe, Anna S.; Parnell, Winsome R.; Skidmore, Paula M. L.

2017-01-01

Healthful dietary habits are individually associated with better nutrient intake and positive health outcomes; however, this information is rarely examined together to validate an indicator of diet quality. This study developed a 15-item Healthy Dietary Habits Index (HDHI) based on self-reported dietary habits information collected in the 2008/09 New Zealand Adult Nutrition Survey. The validity of HDHI as a diet quality index was examined in relation to sociodemographic factors, 24-diet recall derived nutrient intakes, and nutritional biomarkers in a representative sample of adults aged 19 years and above. Linear regression models were employed to determine associations between HDHI quintiles and energy-adjusted nutrient data and nutritional biomarkers. Significantly higher HDHI scores were found among women, older age groups, Non-Māori or Pacific ethnic groups, and less socioeconomically-deprived groups (all p < 0.001). Increasing quintiles of HDHI were associated with higher intakes of dietary fibre and seven micronutrients including calcium, iron, and vitamin C, and lower intakes of energy, macronutrients, sodium, zinc, vitamins B6 and B12. Associations in the expected directions were also found for urinary sodium, whole blood folate, serum and red blood cell folate, and plasma selenium (all p < 0.001). The present findings suggest that the HDHI is a valid measure of diet quality as it is capable of discerning quality of diets of subgroups and ranking nutrient intakes among NZ adults. PMID:28467392

Adiposity, compared with masculinity, serves as a more valid cue to immunocompetence in human mate choice.

PubMed

Rantala, Markus J; Coetzee, Vinet; Moore, Fhionna R; Skrinda, Ilona; Kecko, Sanita; Krama, Tatjana; Kivleniece, Inese; Krams, Indrikis

2013-01-22

According to the 'good genes' hypothesis, females choose males based on traits that indicate the male's genetic quality in terms of disease resistance. The 'immunocompetence handicap hypothesis' proposed that secondary sexual traits serve as indicators of male genetic quality, because they indicate that males can contend with the immunosuppressive effects of testosterone. Masculinity is commonly assumed to serve as such a secondary sexual trait. Yet, women do not consistently prefer masculine looking men, nor is masculinity consistently related to health across studies. Here, we show that adiposity, but not masculinity, significantly mediates the relationship between a direct measure of immune response (hepatitis B antibody response) and attractiveness for both body and facial measurements. In addition, we show that circulating testosterone is more closely associated with adiposity than masculinity. These findings indicate that adiposity, compared with masculinity, serves as a more important cue to immunocompetence in female mate choice.

The challenges of measuring quality-of-care indicators in rural emergency departments: a cross-sectional descriptive study

PubMed Central

Layani, Géraldine; Fleet, Richard; Dallaire, Renée; Tounkara, Fatoumata K.; Poitras, Julien; Archambault, Patrick; Chauny, Jean-Marc; Ouimet, Mathieu; Gauthier, Josée; Dupuis, Gilles; Tanguay, Alain; Lévesque, Jean-Frédéric; Simard-Racine, Geneviève; Haggerty, Jeannie; Légaré, France

2016-01-01

Background: Evidence-based indicators of quality of care have been developed to improve care and performance in Canadian emergency departments. The feasibility of measuring these indicators has been assessed mainly in urban and academic emergency departments. We sought to assess the feasibility of measuring quality-of-care indicators in rural emergency departments in Quebec. Methods: We previously identified rural emergency departments in Quebec that offered medical coverage with hospital beds 24 hours a day, 7 days a week and were located in rural areas or small towns as defined by Statistics Canada. A standardized protocol was sent to each emergency department to collect data on 27 validated quality-of-care indicators in 8 categories: duration of stay, patient safety, pain management, pediatrics, cardiology, respiratory care, stroke and sepsis/infection. Data were collected by local professional medical archivists between June and December 2013. Results: Fifteen (58%) of the 26 emergency departments invited to participate completed data collection. The ability to measure the 27 quality-of-care indicators with the use of databases varied across departments. Centres 2, 5, 6 and 13 used databases for at least 21 of the indicators (78%-92%), whereas centres 3, 8, 9, 11, 12 and 15 used databases for 5 (18%) or fewer of the indicators. On average, the centres were able to measure only 41% of the indicators using heterogeneous databases and manual extraction. The 15 centres collected data from 15 different databases or combinations of databases. The average data collection time for each quality-of-care indicator varied from 5 to 88.5 minutes. The median data collection time was 15 minutes or less for most indicators. Interpretation: Quality-of-care indicators were not easily captured with the use of existing databases in rural emergency departments in Quebec. Further work is warranted to improve standardized measurement of these indicators in rural emergency departments in the province and to generalize the information gathered in this study to other health care environments. PMID:27730103

Hot Flashes among Prostate Cancer Patients Undergoing Androgen Deprivation Therapy: Psychosocial and Quality of Life Issues

DTIC Science & Technology

2006-12-01

SCL magnitude indicative of hot flashes in menopausal women is valid for PCS (Carpenter, 2005b). Due to a lack of validation studies, we aimed to...objective assessment of hot flashes has been based entirely on studies of menopausal women and women with breast cancer, and ours is the first study to...presence of chest hair proved to be an obstacle to ease of use. Removal of chest hair was not an option, as this also removes skin which, in turn

Cross-cultural adaptation and validation of the Turkish version of the pain catastrophizing scale among patients with ankylosing spondylitis

PubMed Central

İlçin, Nursen; Gürpınar, Barış; Bayraktar, Deniz; Savcı, Sema; Çetin, Pınar; Sarı, İsmail; Akkoç, Nurullah

2016-01-01

[Purpose] This study describes the cultural adaptation, validation, and reliability of the Turkish version of the Pain Catastrophizing Scale in patients with ankylosing spondylitis. [Methods] The validity of the Turkish version of the Pain Catastrophizing Scale was assessed by evaluating data quality (missing data and floor and ceiling effects), principal components analysis, internal consistency (Cronbach’s alpha), and construct validity (Spearman’s rho). Reproducibility analyses included standard measurement error, minimum detectable change, limits of agreement, and intraclass correlation coefficients. [Results] Sixty-four adult patients with ankylosing spondylitis with a mean age of 42.2 years completed the study. Factor analysis revealed that all questionnaire items could be grouped into two factors. Excellent internal consistency was found, with a Chronbach’s alpha value of 0.95. Reliability analyses showed an intraclass correlation coefficient (95% confidence interval) of 0.96 for the total score. There was a low correlation coefficient between the Turkish version of the Pain Catastrophizing Scale and body mass index, pain levels at rest and during activity, health-related quality of life, and fear and avoidance behaviors. [Conclusion] The results of this study indicate that the Turkish version of the Pain Catastrophizing Scale is a valid and reliable clinical and research tool for patients with ankylosing spondylitis. PMID:26957778

Monitoring and evaluating the quality of cancer care in Japan using administrative claims data.

PubMed

Iwamoto, Momoko; Nakamura, Fumiaki; Higashi, Takahiro

2016-01-01

The importance of measuring the quality of cancer care has been well recognized in many developed countries, but has never been successfully implemented on a national level in Japan. We sought to establish a wide-scale quality monitoring and evaluation program for cancer by measuring 13 process-of-care quality indicators (QI) using a registry-linked claims database. We measured two QI on pre-treatment testing, nine on adherence to clinical guidelines on therapeutic treatments, and two on supportive care, for breast, prostate, colorectal, stomach, lung, liver and cervical cancer patients who were diagnosed in 2011 from 178 hospitals. We further assessed the reasons for non-adherence for patients who did not receive the indicated care in 26 hospitals. QI for pretreatment testing were high in most hospitals (above 80%), but scores on adjuvant radiation and chemoradiation therapies were low (20-37%), except for breast cancer (74%). QI for adjuvant chemotherapy and supportive care were more widely distributed across hospitals (45-68%). Further analysis in 26 hospitals showed that most of the patients who did not receive adjuvant chemotherapy had clinically valid reasons for not receiving the specified care (above 70%), but the majority of the patients did not have sufficient reasons for not receiving adjuvant radiotherapy (52-69%) and supportive care (above 80%). We present here the first wide-scale quality measurement initiative of cancer patients in Japan. Patients without clinically valid reasons for non-adherence should be examined further in future to improve care. © 2015 The Authors. Cancer Science published by Wiley Publishing Asia Pty Ltd on behalf of Japanese Cancer Association.

Validation of the Social Provisions Scale in people with multiple sclerosis.

PubMed

Chiu, Chung-Yi; Motl, Robert W; Ditchman, Nicole

2016-08-01

This study examined the factorial and construct validity of the Social Provisions Scale (SPS) in a sample of people with multiple sclerosis (MS). Participants included 292 individuals with MS (83.9% women) recruited from the Greater Illinois, Gateway, and Indiana chapters of the National Multiple Sclerosis Society. Participants completed the SPS and pain, fatigue, depression, anxiety, MS self-efficacy, quality of life, and satisfaction with life measures. Factorial validity was tested using confirmatory factor analysis (CFA), and construct validity was examined based on the strength of bivariate correlations with scores on related measures. Findings from the CFA indicated that a first-order, 6-factor measurement model provided a good fit for the 24 items of the SPS (CFI = .94, TLI = .93, RMSEA = 0.07) and that the 6 factors could be described by a single, second-order factor of the overall social provisions (CFI = .93, TLI = .92, RMSEA = 0.08). Cronbach's alpha was .89 for the global score and between .66 and .81 for the 6 subscales. The SPS global and subscale scores correlated significantly with satisfaction with life, depression, anxiety, MS self-efficacy, and quality of life measures. Findings from this study support the factorial validity, construct validity, and reliability of the SPS as a measure of social provisions for use with people with MS. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

CODEMamb - an observational communication behavior assessment tool for use in ambulatory dementia care.

PubMed

Knebel, Maren; Haberstroh, Julia; Kümmel, Anne; Pantel, Johannes; Schröder, Johannes

2016-12-01

Communication improves well-being and quality of life for both people with dementia and their professional and family caregivers. Individualized communication, as required in informed consent procedures and psychosocial interventions, can improve quality of life, especially in ambulatory settings. However, few valid and reliable instruments exist that enable communication to be assessed and communication and behavioral resources to be identified. We, therefore, extended and adapted the newly developed observational instrument CODEM for use in ambulatory settings (CODEM amb ). Reliability and validity of the new instrument were studied in a total of 171 patients, whereby principal component analysis revealed three important factors: relationship aspects, verbal communication behavior and nonverbal communication behavior. CODEM amb [Formula: see text]s internal consistency, interrater and retest reliability were satisfactory to excellent. Convergent validity indices, as shown by examining correlations with similar but not identical constructs (CERAD-NP verbal subscales), were medium-high, while the divergent validity index (constructional praxis) was relatively low. The relationship to peer-rating remained nonsignificant. Criterion validity was investigated in groups of patients in accordance with their cognitive status. As expected, verbal communication abilities deteriorate faster than the relationship aspects of communication as the disease progresses. In summary, CODEM amb is a reliable and valid instrument that can be used to collect important information with the ultimate aim of supporting communication with people with dementia.

Donabedian's structure-process-outcome quality of care model: Validation in an integrated trauma system.

PubMed

Moore, Lynne; Lavoie, André; Bourgeois, Gilles; Lapointe, Jean

2015-06-01

According to Donabedian's health care quality model, improvements in the structure of care should lead to improvements in clinical processes that should in turn improve patient outcome. This model has been widely adopted by the trauma community but has not yet been validated in a trauma system. The objective of this study was to assess the performance of an integrated trauma system in terms of structure, process, and outcome and evaluate the correlation between quality domains. Quality of care was evaluated for patients treated in a Canadian provincial trauma system (2005-2010; 57 centers, n = 63,971) using quality indicators (QIs) developed and validated previously. Structural performance was measured by transposing on-site accreditation visit reports onto an evaluation grid according to American College of Surgeons criteria. The composite process QI was calculated as the average sum of proportions of conformity to 15 process QIs derived from literature review and expert opinion. Outcome performance was measured using risk-adjusted rates of mortality, complications, and readmission as well as hospital length of stay (LOS). Correlation was assessed with Pearson's correlation coefficients. Statistically significant correlations were observed between structure and process QIs (r = 0.33), and process and outcome QIs (r = -0.33 for readmission, r = -0.27 for LOS). Significant positive correlations were also observed between outcome QIs (r = 0.37 for mortality-readmission; r = 0.39 for mortality-LOS and readmission-LOS; r = 0.45 for mortality-complications; r = 0.34 for readmission-complications; 0.63 for complications-LOS). Significant correlations between quality domains observed in this study suggest that Donabedian's structure-process-outcome model is a valid model for evaluating trauma care. Trauma centers that perform well in terms of structure also tend to perform well in terms of clinical processes, which in turn has a favorable influence on patient outcomes. Prognostic study, level III.

Performance indicators for public mental healthcare: a systematic international inventory

PubMed Central

2012-01-01

Background The development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations. Methods Publications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated. Results A total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others. Conclusions PI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI. PMID:22433251

Assessing the Reliability of Self- and Peer Rating in Student Group Work

ERIC Educational Resources Information Center

Zhang, Bo; Johnston, Lucy; Kilic, Gulsen Bagci

2008-01-01

Peer and self-ratings have been strongly recommended as the means to adjust individual contributions to group work. To evaluate the quality of student ratings, previous research has primarily explored the validity of these ratings, as indicated by the degree of agreement between student and teacher ratings. This research describes a…

NASA NDE Program

NASA Technical Reports Server (NTRS)

Generazio, Ed; Burke, Eric

2015-01-01

The current activities in the National Aeronautics and Space Administration Nondestructive Evaluation (NDE) Program are presented. The topics covered include organizational communications, orbital weld inspection, electric field imaging, fracture critical probability of detection validation, monitoring of thermal protection systems, physical and document standards, image quality indicators, integrity of composite pressure vessels, and NDE for additively manufactured components.

Measuring Adjustment to College: Construct Validity of the Student Adaptation to College Questionnaire

ERIC Educational Resources Information Center

Feldt, Ronald C.; Graham, Melody; Dew, Dennis

2011-01-01

This study employed confirmatory factor analysis to examine the quality of fit of two measurement models of the Student Adaptation to College Questionnaire (N = 305). Following the observation of poor fit, exploratory factor analysis was used. Results indicated six factors that account for the variance in Student Adaptation to College…

A Validation of Object-Oriented Design Metrics as Quality Indicators

NASA Technical Reports Server (NTRS)

Basili, Victor R.; Briand, Lionel C.; Melo, Walcelio

1997-01-01

This paper presents the results of a study in which we empirically investigated the suits of object-oriented (00) design metrics introduced in another work. More specifically, our goal is to assess these metrics as predictors of fault-prone classes and, therefore, determine whether they can be used as early quality indicators. This study is complementary to the work described where the same suite of metrics had been used to assess frequencies of maintenance changes to classes. To perform our validation accurately, we collected data on the development of eight medium-sized information management systems based on identical requirements. All eight projects were developed using a sequential life cycle model, a well-known 00 analysis/design method and the C++ programming language. Based on empirical and quantitative analysis, the advantages and drawbacks of these 00 metrics are discussed. Several of Chidamber and Kamerer's 00 metrics appear to be useful to predict class fault-proneness during the early phases of the life-cycle. Also, on our data set, they are better predictors than 'traditional' code metrics, which can only be collected at a later phase of the software development processes.

Determining the validity and reliability of the Chinese version of the Kidney Disease Quality of Life Questionnaire (KDQOL-36™)

PubMed Central

2014-01-01

Background Health-related quality of life is a crucial outcome for the chronic kidney disease population, the Kidney Disease Quality of Life (KDQOL) questionnaire is commonly used as an integral part of clinical evaluations. The abbreviated version of the KDQOL-36™ has been translated into Mandarin Chinese, but has not been tested for use in the Chinese patients. The aim of the study was to evaluate the validity and reliability of the KDQOL-36™ with a sample of Chinese patients. Methods The Mandarin Chinese version of the KDQOL-36™ has been translated by Amgen, Inc. and the MAPI Institution following the instrument translation specifications provided by the RAND health. The translated instrument was further reviewed by a Chinese expert panel for content validity and translational equivalence. The KDQOL-36™ along with Beck depression Inventory-II were administrated to 103 chronic renal disease patients recruited through convenience sampling procedure from the renal wards and an outpatient dialysis clinic. The convergent validity was determined through investigating the correlational evidence of the KDQOL-36™ with the Beck depression Inventory-II and the overall health rating. Known-group validity was supported by the evidence that the instrument could differentiate subgroups of patients. The internal consistency was estimated using Cronbach’s α and test-retest reliability was examined using an intraclass correlation coefficient. Results For the convergent validity, there were positive correlations between the overall health rating and most of the KDQOL-36™ subscales, and the Beck depression inventory score was inversely correlated with the mental component summary score and disease-specific scores of the scale. Significant correlations were noted between disease-targeted and generic dimensions of the KDQOL-36™. The results of the known-group comparisons indicated females, the unemployed, and patients had a longer dialysis history reported a worse quality of life. With regard to the reliability, the Cronbach’s alpha ranged from 0.69 to 0.78, and the intraclass correlation test-retest was higher than 0.70. Conclusions The Mandarin Chinese version of the KDQOL-36™ is a brief, valid, and reliable instrument for use in examining the quality of life of chronic kidney disease patients in China. PMID:25015224

Delphi Method Validation of a Procedural Performance Checklist for Insertion of an Ultrasound-Guided Internal Jugular Central Line.

PubMed

Hartman, Nicholas; Wittler, Mary; Askew, Kim; Manthey, David

2016-01-01

Placement of ultrasound-guided central lines is a critical skill for physicians in several specialties. Improving the quality of care delivered surrounding this procedure demands rigorous measurement of competency, and validated tools to assess performance are essential. Using the iterative, modified Delphi technique and experts in multiple disciplines across the United States, the study team created a 30-item checklist designed to assess competency in the placement of ultrasound-guided internal jugular central lines. Cronbach α was .94, indicating an excellent degree of internal consistency. Further validation of this checklist will require its implementation in simulated and clinical environments. © The Author(s) 2014.

Implementation and validation of a conceptual benchmarking framework for patient blood management.

PubMed

Kastner, Peter; Breznik, Nada; Gombotz, Hans; Hofmann, Axel; Schreier, Günter

2015-01-01

Public health authorities and healthcare professionals are obliged to ensure high quality health service. Because of the high variability of the utilisation of blood and blood components, benchmarking is indicated in transfusion medicine. Implementation and validation of a benchmarking framework for Patient Blood Management (PBM) based on the report from the second Austrian Benchmark trial. Core modules for automatic report generation have been implemented with KNIME (Konstanz Information Miner) and validated by comparing the output with the results of the second Austrian benchmark trial. Delta analysis shows a deviation <0.1% for 95% (max. 1.4%). The framework provides a reliable tool for PBM benchmarking. The next step is technical integration with hospital information systems.

The best interest of the child-questionnaire, reliability and validity: preliminary data on the question 'where to live after detention or secure treatment?'.

PubMed

Kalverboer, Margrite; Ten Brummelaar, Mijntje; Post, Wendy; Zijlstra, Elianne; Harder, Annemiek; Knorth, Erik

2012-02-01

The Best Interest of the Child-Questionnaire (BIC-Q) has been designed as an instrument for screening the quality of the rearing situation of children with behavioural problems or delinquency. It is intended to aid legal decisions in juvenile and family law. The aim of the study was to establish the reliability and validation of the BIC-Q. Records of 83 children in detention or secure treatment centres and 58 children with no delinquent behaviours were rated by trained researchers. Interrater reliability was tested with a sub-sample of 31 of the former. Content validity was evaluated across the whole group, using Cronbach's alpha to check internal consistency, Spearman's rho to examine correlations and explorative principal component analysis (PCA) to test the extent to which variance in the 14 underlying conditions could be accounted for by a single factor 'quality of rearing'. Interrater reliability was good (r = 0.89). The PCA lent support to the content validity of the questionnaire with four factors, which together explained 66% of the variance in child rearing: (1) attachment and bonding; (2) rules and provisions; (3) health care and physical care in the family context; and (4) care and models provided for in the societal environment. The BIC-Q is a reliable and valid measure of the overall quality of child rearing. Preliminary results indicate that the BIC-Q may be applied to support court decisions on where the child should live after detention or secure treatment. Copyright © 2011 John Wiley & Sons, Ltd.

Self-reported quality of life measure is reliable and valid in adult patients suffering from schizophrenia with executive impairment.

PubMed

Baumstarck, Karine; Boyer, Laurent; Boucekine, Mohamed; Aghababian, Valérie; Parola, Nathalie; Lançon, Christophe; Auquier, Pascal

2013-06-01

Impaired executive functions are among the most widely observed in patients suffering from schizophrenia. The use of self-reported outcomes for evaluating treatment and managing care of these patients has been questioned. The aim of this study was to provide new evidence about the suitability of self-reported outcome for use in this specific population by exploring the internal structure, reliability and external validity of a specific quality of life (QoL) instrument, the Schizophrenia Quality of Life questionnaire (SQoL18). cross-sectional study. age over 18 years, diagnosis of schizophrenia according to the DSM-IV criteria. sociodemographic (age, gender, and education level) and clinical data (duration of illness, Positive and Negative Syndrome Scale, Calgary Depression Scale for Schizophrenia); QoL (SQoL18); and executive performance (Stroop test, lexical and verbal fluency, and trail-making test). Non-impaired and impaired populations were defined for each of the three tests. For the six groups, psychometric properties were compared to those reported from the reference population assessed in the validation study. One hundred and thirteen consecutive patients were enrolled. The factor analysis performed in the impaired groups showed that the questionnaire structure adequately matched the initial structure of the SQoL18. The unidimensionality of the dimensions was preserved, and the internal/external validity indices were close to those of the non-impaired groups and the reference population. Our study suggests that executive dysfunction did not compromise the reliability or validity of self-reported disease-specific QoL questionnaire. Copyright © 2013 Elsevier B.V. All rights reserved.

Longitudinal construct validity of the minimum data set health status index.

PubMed

Jones, Aaron; Feeny, David; Costa, Andrew P

2018-05-24

The Minimum Data Set Health Status Index (MDS-HSI) is a generic, preference-based health-related quality of life (HRQOL) measure derived by mapping items from the Resident Assessment Instrument - Minimum Data Set (RAI-MDS) assessment onto the Health Utilities Index Mark 2 classification system. While the validity of the MDS-HSI has been examined in cross-sectional settings, the longitudinal validity has not been explored. The objective of this study was to investigate the longitudinal construct validity of the MDS-HSI in a home care population. This study utilized a retrospective cohort of home care patients in the Hamilton-Niagara-Haldimand-Brant health region of Ontario, Canada with at least two RAI-MDS Home Care assessments between January 2010 and December 2014. Convergent validity was assessed by calculating Spearman rank correlations between the change in MDS-HSI and changes in six validated indices of health domains that can be calculated from the RAI-MDS assessment. Known-groups validity was investigated by fitting multivariable linear regression models to estimate the mean change in MDS-HSI associated with clinically important changes in the six health domain indices and 15 disease symptoms from the RAI-MDS Home Care assessment, controlling for age and sex. The cohort contained 25,182 patients with two RAI-MDS Home Care assessments. Spearman correlations between the MDS-HSI change and changes in the health domain indices were all statistically significant and in the hypothesized small to moderate range [0.1 < ρ < 0.5]. Clinically important changes in all of the health domain indices and 13 of the 15 disease symptoms were significantly associated with clinically important changes in the MDS-HSI. The findings of this study support the longitudinal construct validity of the MDS-HSI in home care populations. In addition to evaluating changes in HRQOL among home care patients in clinical research, economic evaluation, and health technology assessment, the MDS-HSI may be used in system-level applications using routinely collected population-level data.

Developing and testing the CHORDS: Characteristics of Responsible Drinking Survey.

PubMed

Barry, Adam E; Goodson, Patricia

2011-01-01

Report on the development and psychometric testing of a theoretically and evidence-grounded instrument, the Characteristics of Responsible Drinking Survey (CHORDS). Instrument subjected to four phases of pretesting (cognitive validity, cognitive and motivational qualities, pilot test, and item evaluation) and a final posttest implementation. Large public university in Texas. Randomly selected convenience sample (n  =  729) of currently enrolled students. This 78-item questionnaire measures individuals' responsible drinking beliefs, motivations, intentions, and behaviors. Cronbach α, split-half reliability, principal components analysis and Spearman ρ were conducted to investigate reliability, stability, and validity. Measures in the CHORDS exhibited high internal consistency reliability and strong correlations of split-half reliability. Factor analyses indicated five distinct scales were present, as proposed in the theoretical model. Subscale composite scores also exhibited a correlation to alcohol consumption behaviors, indicating concurrent validity. The CHORDS represents the first instrument specifically designed to assess responsible drinking beliefs and behaviors. It was found to elicit valid and reliable data among a college student sample. This instrument holds much promise for practitioners who desire to empirically investigate dimensions of responsible drinking.

Examining the validity of AHRQ's patient safety indicators (PSIs): is variation in PSI composite score related to hospital organizational factors?

PubMed

Shin, Marlena H; Sullivan, Jennifer L; Rosen, Amy K; Solomon, Jeffrey L; Dunn, Edward J; Shimada, Stephanie L; Hayes, Jennifer; Rivard, Peter E

2014-12-01

Increasing use of Agency for Healthcare Research and Quality's Patient Safety Indicators (PSIs) for hospital performance measurement intensifies the need to critically assess their validity. Our study examined the extent to which variation in PSI composite score is related to differences in hospital organizational structures or processes (i.e., criterion validity). In site visits to three Veterans Health Administration hospitals with high and three with low PSI composite scores ("low performers" and "high performers," respectively), we interviewed a cross-section of hospital staff. We then coded interview transcripts for evidence in 13 safety-related domains and assessed variation across high and low performers. Evidence of leadership and coordination of work/communication (organizational process domains) was predominantly favorable for high performers only. Evidence in the other domains was either mixed, or there were insufficient data to rate the domains. While we found some evidence of criterion validity, the extent to which variation in PSI rates is related to differences in hospitals' organizational structures/processes needs further study. © The Author(s) 2014.

Reliability and validity of a Tutorial Group Effectiveness Instrument.

PubMed

Singaram, Veena S; Van Der Vleuten, Cees P M; Van Berkel, Henk; Dolmans, Diana H J M

2010-01-01

Tutorial group effectiveness is essential for the success of learning in problem-based learning (PBL). Less effective and dysfunctional groups compromise the quality of students learning in PBL. This article aims to report on the reliability and validity of an instrument aimed at measuring tutorial group effectiveness in PBL. The items within the instrument are clustered around motivational and cognitive factors based on Slavin's theoretical framework. A confirmatory factor analysis (CFA) was carried out to estimate the validity of the instrument. Furthermore, generalizability studies were conducted and alpha coefficients were computed to determine the reliability and homogeneity of each factor. The CFA indicated that a three-factor model comprising 19 items showed a good fit with the data. Alpha coefficients per factor were high. The findings of the generalizability studies indicated that at least 9-10 student responses are needed in order to obtain reliable data at the tutorial group level. The instrument validated in this study has the potential to provide faculty and students with diagnostic information and feedback about student behaviors that enhance and hinder tutorial group effectiveness.

The validity of upper-limb neurodynamic tests for detecting peripheral neuropathic pain.

PubMed

Nee, Robert J; Jull, Gwendolen A; Vicenzino, Bill; Coppieters, Michel W

2012-05-01

The validity of upper-limb neurodynamic tests (ULNTs) for detecting peripheral neuropathic pain (PNP) was assessed by reviewing the evidence on plausibility, the definition of a positive test, reliability, and concurrent validity. Evidence was identified by a structured search for peer-reviewed articles published in English before May 2011. The quality of concurrent validity studies was assessed with the Quality Assessment of Diagnostic Accuracy Studies tool, where appropriate. Biomechanical and experimental pain data support the plausibility of ULNTs. Evidence suggests that a positive ULNT should at least partially reproduce the patient's symptoms and that structural differentiation should change these symptoms. Data indicate that this definition of a positive ULNT is reliable when used clinically. Limited evidence suggests that the median nerve test, but not the radial nerve test, helps determine whether a patient has cervical radiculopathy. The median nerve test does not help diagnose carpal tunnel syndrome. These findings should be interpreted cautiously, because diagnostic accuracy might have been distorted by the investigators' definitions of a positive ULNT. Furthermore, patients with PNP who presented with increased nerve mechanosensitivity rather than conduction loss might have been incorrectly classified by electrophysiological reference standards as not having PNP. The only evidence for concurrent validity of the ulnar nerve test was a case study on cubital tunnel syndrome. We recommend that researchers develop more comprehensive reference standards for PNP to accurately assess the concurrent validity of ULNTs and continue investigating the predictive validity of ULNTs for prognosis or treatment response.

Development and validation of a short version of the Partnership Self-Assessment Tool (PSAT) among professionals in Dutch disease-management partnerships

PubMed Central

2011-01-01

Background The extent to which partnership synergy is created within quality improvement programmes in the Netherlands is unknown. In this article, we describe the psychometric testing of the Partnership Self-Assessment Tool (PSAT) among professionals in twenty-two disease-management partnerships participating in quality improvement projects focused on chronic care in the Netherlands. Our objectives are to validate the PSAT in the Netherlands and to reduce the number of items of the original PSAT while maintaining validity and reliability. Methods The Dutch version of the PSAT was tested in twenty-two disease-management partnerships with 218 professionals. We tested the instrument by means of structural equation modelling, and examined its validity and reliability. Results After eliminating 14 items, the confirmatory factor analyses revealed good indices of fit with the resulting 15-item PSAT-Short version (PSAT-S). Internal consistency as represented by Cronbach's alpha ranged from acceptable (0.75) for the 'efficiency' subscale to excellent for the 'leadership' subscale (0.87). Convergent validity was provided with high correlations of the partnership dimensions and partnership synergy (ranged from 0.512 to 0.609) and high correlations with chronic illness care (ranged from 0.447 to 0.329). Conclusion The psychometric properties and convergent validity of the PSAT-S were satisfactory rendering it a valid and reliable instrument for assessing partnership synergy and its dimensions of partnership functioning. PMID:21714931

Evaluation of the theory-based Quality Improvement in Physical Therapy (QUIP) programme: a one-group, pre-test post-test pilot study

PubMed Central

2013-01-01

Background Guideline adherence in physical therapy is far from optimal, which has consequences for the effectiveness and efficiency of physical therapy care. Programmes to enhance guideline adherence have, so far, been relatively ineffective. We systematically developed a theory-based Quality Improvement in Physical Therapy (QUIP) programme aimed at the individual performance level (practicing physiotherapists; PTs) and the practice organization level (practice quality manager; PQM). The aim of the study was to pilot test the multilevel QUIP programme’s effectiveness and the fidelity, acceptability and feasibility of its implementation. Methods A one-group, pre-test, post-test pilot study (N = 8 practices; N = 32 PTs, 8 of whom were also PQMs) done between September and December 2009. Guideline adherence was measured using clinical vignettes that addressed 12 quality indicators reflecting the guidelines’ main recommendations. Determinants of adherence were measured using quantitative methods (questionnaires). Delivery of the programme and management changes were assessed using qualitative methods (observations, group interviews, and document analyses). Changes in adherence and determinants were tested in the paired samples T-tests and expressed in effect sizes (Cohen’s d). Results Overall adherence did not change (3.1%; p = .138). Adherence to three quality indicators improved (8%, 24%, 43%; .000 ≤ p ≤ .023). Adherence to one quality indicator decreased (−15.7%; p = .004). Scores on various determinants of individual performance improved and favourable changes at practice organizational level were observed. Improvements were associated with the programme’s multilevel approach, collective goal setting, and the application of self-regulation; unfavourable findings with programme deficits. The one-group pre-test post-test design limits the internal validity of the study, the self-selected sample its external validity. Conclusions The QUIP programme has the potential to change physical therapy practice but needs considerable revision to induce the ongoing quality improvement process that is required to optimize overall guideline adherence. To assess its value, the programme needs to be tested in a randomized controlled trial. PMID:23705912

A cluster randomized trial for the implementation of an antibiotic checklist based on validated quality indicators: the AB-checklist.

PubMed

van Daalen, Frederike V; Prins, Jan M; Opmeer, Brent C; Boermeester, Marja A; Visser, Caroline E; van Hest, Reinier M; Hulscher, Marlies E J L; Geerlings, Suzanne E

2015-03-19

Recently we developed and validated generic quality indicators that define 'appropriate antibiotic use' in hospitalized adults treated for a (suspected) bacterial infection. Previous studies have shown that with appropriate antibiotic use a reduction of 13% of length of hospital stay can be achieved. Our main objective in this project is to provide hospitals with an antibiotic checklist based on these quality indicators, and to evaluate the introduction of this checklist in terms of (cost-) effectiveness. The checklist applies to hospitalized adults with a suspected bacterial infection for whom antibiotic therapy is initiated, at first via the intravenous route. A stepped wedge study design will be used, comparing outcomes before and after introduction of the checklist in nine hospitals in the Netherlands. At least 810 patients will be included in both the control and the intervention group. The primary endpoint is length of hospital stay. Secondary endpoints are appropriate antibiotic use measured by the quality indicators, admission to and duration of intensive care unit stay, readmission within 30 days, mortality, total antibiotic use, and costs associated with implementation and hospital stay. Differences in numerical endpoints between the two periods will be evaluated with mixed linear models; for dichotomous outcomes generalized estimating equation models will be used. A process evaluation will be performed to evaluate the professionals' compliance with use of the checklist. The key question for the economic evaluation is whether the benefits of the checklist, which include reduced antibiotic use, reduced length of stay and associated costs, justify the costs associated with implementation activities as well as daily use of the checklist. If (cost-) effective, the AB-checklist will provide physicians with a tool to support appropriate antibiotic use in adult hospitalized patients who start with intravenous antibiotics. Dutch trial registry: NTR4872.

Publishing nutrition research: validity, reliability, and diagnostic test assessment in nutrition-related research.

PubMed

Gleason, Philip M; Harris, Jeffrey; Sheean, Patricia M; Boushey, Carol J; Bruemmer, Barbara

2010-03-01

This is the sixth in a series of monographs on research design and analysis. The purpose of this article is to describe and discuss several concepts related to the measurement of nutrition-related characteristics and outcomes, including validity, reliability, and diagnostic tests. The article reviews the methodologic issues related to capturing the various aspects of a given nutrition measure's reliability, including test-retest, inter-item, and interobserver or inter-rater reliability. Similarly, it covers content validity, indicators of absolute vs relative validity, and internal vs external validity. With respect to diagnostic assessment, the article summarizes the concepts of sensitivity and specificity. The hope is that dietetics practitioners will be able to both use high-quality measures of nutrition concepts in their research and recognize these measures in research completed by others. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Affordances in the home environment for motor development: Validity and reliability for the use in daycare setting.

PubMed

Müller, Alessandra Bombarda; Valentini, Nadia Cristina; Bandeira, Paulo Felipe Ribeiro

2017-05-01

The range of stimuli provided by physical space, toys and care practices contributes to the motor, cognitive and social development of children. However, assessing the quality of child education environments is a challenge, and can be considered a health promotion initiative. This study investigated the validity of the criterion, content, construct and reliability of the Affordances in the Home Environment for Motor Development - Infant Scale (AHEMD-IS), version 3-18 months, for the use in daycare settings. Content validation was conducted with the participation of seven motor development and health care experts; and, face validity by 20 specialists in health and education. The results indicate the suitability of the adapted AHEMD-IS, evidencing its validity for the daycare setting a potential tool to assess the opportunities that the collective context offers to child development. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluation of Animal-Based Indicators to Be Used in a Welfare Assessment Protocol for Sheep.

PubMed

Richmond, Susan E; Wemelsfelder, Francoise; de Heredia, Ina Beltran; Ruiz, Roberto; Canali, Elisabetta; Dwyer, Cathy M

2017-01-01

Sheep are managed under a variety of different environments (continually outdoors, partially outdoors with seasonal or diurnal variation, continuously indoors) and for different purposes, which makes assessing welfare challenging. This diversity means that resource-based indicators are not particularly useful and, thus, a welfare assessment scheme for sheep, focusing on animal-based indicators, was developed. We focus specifically on ewes, as the most numerous group of sheep present on farm, although many of the indicators may also have relevance to adult male sheep. Using the Welfare Quality ® framework of four Principles and 12 Criteria, we considered the validity, reliability, and feasibility of 46 putative animal-based indicators derived from the literature for these criteria. Where animal-based indicators were potentially unreliably or were not considered feasible, we also considered the resource-based indicators of access to water, stocking density, and floor slipperiness. With the exception of the criteria "Absence of prolonged thirst," we suggest at least one animal-based indicator for each welfare criterion. As a minimum, face validity was available for all indicators; however, for many, we found evidence of convergent validity and discriminant validity (e.g., lameness as measured by gait score, body condition score). The reliability of most of the physical and health measures has been tested in the field and found to be appropriate for use in welfare assessment. However, for the majority of the proposed behavioral indicators (lying synchrony, social withdrawal, postures associated with pain, vocalizations, stereotypy, vigilance, response to surprise, and human approach test), this still needs to be tested. In conclusion, the comprehensive assessment of sheep welfare through largely animal-based measures is supported by the literature through the use of indicators focusing on specific aspects of sheep biology. Further work is required for some indicators to ensure that measures are reliable when used in commercial settings.

Evaluation of Animal-Based Indicators to Be Used in a Welfare Assessment Protocol for Sheep

PubMed Central

Richmond, Susan E.; Wemelsfelder, Francoise; de Heredia, Ina Beltran; Ruiz, Roberto; Canali, Elisabetta; Dwyer, Cathy M.

2017-01-01

Sheep are managed under a variety of different environments (continually outdoors, partially outdoors with seasonal or diurnal variation, continuously indoors) and for different purposes, which makes assessing welfare challenging. This diversity means that resource-based indicators are not particularly useful and, thus, a welfare assessment scheme for sheep, focusing on animal-based indicators, was developed. We focus specifically on ewes, as the most numerous group of sheep present on farm, although many of the indicators may also have relevance to adult male sheep. Using the Welfare Quality® framework of four Principles and 12 Criteria, we considered the validity, reliability, and feasibility of 46 putative animal-based indicators derived from the literature for these criteria. Where animal-based indicators were potentially unreliably or were not considered feasible, we also considered the resource-based indicators of access to water, stocking density, and floor slipperiness. With the exception of the criteria “Absence of prolonged thirst,” we suggest at least one animal-based indicator for each welfare criterion. As a minimum, face validity was available for all indicators; however, for many, we found evidence of convergent validity and discriminant validity (e.g., lameness as measured by gait score, body condition score). The reliability of most of the physical and health measures has been tested in the field and found to be appropriate for use in welfare assessment. However, for the majority of the proposed behavioral indicators (lying synchrony, social withdrawal, postures associated with pain, vocalizations, stereotypy, vigilance, response to surprise, and human approach test), this still needs to be tested. In conclusion, the comprehensive assessment of sheep welfare through largely animal-based measures is supported by the literature through the use of indicators focusing on specific aspects of sheep biology. Further work is required for some indicators to ensure that measures are reliable when used in commercial settings. PMID:29322048

A Survey to Evaluate Facilitators and Barriers to Quality Measurement and Improvement: Adapting Tools for Implementation Research in Palliative Care Programs.

PubMed

Dy, Sydney M; Al Hamayel, Nebras Abu; Hannum, Susan M; Sharma, Ritu; Isenberg, Sarina R; Kuchinad, Kamini; Zhu, Junya; Smith, Katherine; Lorenz, Karl A; Kamal, Arif H; Walling, Anne M; Weaver, Sallie J

2017-12-01

Although critical for improving patient outcomes, palliative care quality indicators are not yet widely used. Better understanding of facilitators and barriers to palliative care quality measurement and improvement might improve their use and program quality. Development of a survey tool to assess palliative care team perspectives on facilitators and barriers to quality measurement and improvement in palliative care programs. We used the adapted Consolidated Framework for Implementation Research to define domains and constructs to select instruments. We assembled a draft survey and assessed content validity through pilot testing and cognitive interviews with experts and frontline practitioners for key items. We analyzed responses using a constant comparative process to assess survey item issues and potential solutions. We developed a final survey using these results. The survey includes five published instruments and two additional item sets. Domains include organizational characteristics, individual and team characteristics, intervention characteristics, and process of implementation. Survey modules include Quality Improvement in Palliative Care, Implementing Quality Improvement in the Palliative Care Program, Teamwork and Communication, Measuring the Quality of Palliative Care, and Palliative Care Quality in Your Program. Key refinements from cognitive interviews included item wording on palliative care team members, programs, and quality issues. This novel, adaptable instrument assesses palliative care team perspectives on barriers and facilitators for quality measurement and improvement in palliative care programs. Next steps include evaluation of the survey's construct validity and how survey results correlate with findings from program quality initiatives. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Development and pilot test of a new set of good practice indicators for chronic non-malignant pain management.

PubMed

Saturno, Pedro Jesus; Angel-García, Daniel; Martínez-Nicolás, Ismael; López Soriano, Francisco; Escolar Reina, Maria Pilar; Guerrero Díaz, María Beatriz; Ros Martínez, María Encarnación; Medina Mirapeix, Francesc; Saturno Marcos, Mayo

2018-06-08

This study was designed to address the current relative void of valid measures by developing evidence-based quality indicators for pain management of chronic non-malignant pain. We performed a 10-year literature search to identify guidelines and review articles on chronic pain management to identify evidence-based recommendations for the different conditions associated to chronic pain. A complementary search of indicators and indicator-related articles was also performed. Then, we built new indicators or adapted existing ones to cover all the evidence-based recommendations we found. The resulting set was pilot-tested for feasibility, reliability (kappa) and usefulness to identify quality problems, using the Lot Quality Acceptance method, α≤0.05 y β≤0.01, for 75% (40% threshold) and 95% (70% threshold) compliance standards, and estimates with binomial exact 95% confidence intervals. The study reviews clinical records from a primary-care centre, a medium-size hospital (250 beds) and a large hospital (500 beds). Forty-six indicators were developed (six general and forty condition-specific). Thirty-three were feasible in primary care and/or hospitals. Feasible indicators were also reliable (most kappa>0.7). Regarding compliance, four quality indicators obtained compliance levels over 60%, addressing pharmacological treatment, multimodal approach and appropriate use of neuro-image tests; while sixteen obtained compliance scores under 15% (six with 0% compliance). The created set has tested to be feasible, reliable, and useful, with the capacity to serve as the baseline for developing the necessary strategies to improve the management of chronic non-malignant pain, by monitoring and evaluating quality of care. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Reliability and validity of a visual analogue scale used by owners to measure chronic pain attributable to osteoarthritis in their dogs.

PubMed

Hielm-Björkman, Anna K; Kapatkin, Amy S; Rita, Hannu J

2011-05-01

To assess validity and reliability for a visual analogue scale (VAS) used by owners to measure chronic pain in their osteoarthritic dogs. 68, 61, and 34 owners who completed a questionnaire. Owners answered questionnaires at 5 time points. Criterion validity of the VAS was evaluated for all dogs in the intended-to-treat population by correlating scores for the VAS with scores for the validated Helsinki Chronic Pain Index (HCPI) and a relative quality-of-life scale. Intraclass correlation was used to assess repeatability of the pain VAS at 2 baseline evaluations. To determine sensitivity to change and face validity of the VAS, 2 blinded, randomized control groups (17 dogs receiving carprofen and 17 receiving a placebo) were analyzed over time. Significant correlations existed between the VAS score and the quality-of-life scale and HCPI scores. Intraclass coefficient (r = 0.72; 95% confidence interval, 0.57 to 0.82) for the VAS indicated good repeatability. In the carprofen and placebo groups, there was poor correlation between the 2 pain evaluation methods (VAS and HCPI items) at the baseline evaluation, but the correlation improved in the carprofen group over time. No correlation was detected for the placebo group over time. Although valid and reliable, the pain VAS was a poor tool for untrained owners because of poor face validity (ie, owners could not recognize their dogs' behavior as signs of pain). Only after owners had seen pain diminish and then return (after starting and discontinuing NSAID use) did the VAS have face validity.

Resilience, age, and perceived symptoms in persons with long-term physical disabilities.

PubMed

Terrill, Alexandra L; Molton, Ivan R; Ehde, Dawn M; Amtmann, Dagmar; Bombardier, Charles H; Smith, Amanda E; Jensen, Mark P

2016-05-01

Resilience may mitigate impact of secondary symptoms such as pain and fatigue on quality of life in persons aging with disability. This study examined resilience in a large sample of individuals with disabling medical conditions by validating the Connor-Davidson Resilience Scale, obtaining descriptive information about resilience and evaluating resilience as a mediator among key secondary symptoms and quality of life using structural equation modeling. Results indicated that the measure's psychometric properties were adequate in this sample. Resilience was lowest among participants who were middle-aged or younger, and participants with depression. Resilience mediated associations between secondary symptoms and quality of life. © The Author(s) 2014.

An empirical comparison of key statistical attributes among potential ICU quality indicators.

PubMed

Brown, Sydney E S; Ratcliffe, Sarah J; Halpern, Scott D

2014-08-01

Good quality indicators should have face validity, relevance to patients, and be able to be measured reliably. Beyond these general requirements, good quality indicators should also have certain statistical properties, including sufficient variability to identify poor performers, relative insensitivity to severity adjustment, and the ability to capture what providers do rather than patients' characteristics. We assessed the performance of candidate indicators of ICU quality on these criteria. Indicators included ICU readmission, mortality, several length of stay outcomes, and the processes of venous-thromboembolism and stress ulcer prophylaxis provision. Retrospective cohort study. One hundred thirty-eight U.S. ICUs from 2001-2008 in the Project IMPACT database. Two hundred sixty-eight thousand eight hundred twenty-four patients discharged from U.S. ICUs. None. We assessed indicators' (1) variability across ICU-years; (2) degree of influence by patient vs. ICU and hospital characteristics using the Omega statistic; (3) sensitivity to severity adjustment by comparing the area under the receiver operating characteristic curve (AUC) between models including vs. excluding patient variables, and (4) correlation between risk adjusted quality indicators using a Spearman correlation. Large ranges of among-ICU variability were noted for all quality indicators, particularly for prolonged length of stay (4.7-71.3%) and the proportion of patients discharged home (30.6-82.0%), and ICU and hospital characteristics outweighed patient characteristics for stress ulcer prophylaxis (ω, 0.43; 95% CI, 0.34-0.54), venous thromboembolism prophylaxis (ω, 0.57; 95% CI, 0.53-0.61), and ICU readmissions (ω, 0.69; 95% CI, 0.52-0.90). Mortality measures were the most sensitive to severity adjustment (area under the receiver operating characteristic curve % difference, 29.6%); process measures were the least sensitive (area under the receiver operating characteristic curve % differences: venous thromboembolism prophylaxis, 3.4%; stress ulcer prophylaxis, 2.1%). None of the 10 indicators was clearly and consistently correlated with a majority of the other nine indicators. No indicator performed optimally across assessments. Future research should seek to define and operationalize quality in a way that is relevant to both patients and providers.

Measuring, managing and maximizing performance of mineral processing plants

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bascur, O.A.; Kennedy, J.P.

1995-12-31

The implementation of continuous quality improvement is the confluence of Total Quality Management, People Empowerment, Performance Indicators and Information Engineering. The supporting information technologies allow a mineral processor to narrow the gap between management business objectives and the process control level. One of the most important contributors is the user friendliness and flexibility of the personal computer in a client/server environment. This synergistic combination when used for real time performance monitoring translates into production cost savings, improved communications and enhanced decision support. Other savings come from reduced time to collect data and perform tedious calculations, act quickly with fresh newmore » data, generate and validate data to be used by others. This paper presents an integrated view of plant management. The selection of the proper tools for continuous quality improvement are described. The process of selecting critical performance monitoring indices for improved plant performance are discussed. The importance of a well balanced technological improvement, personnel empowerment, total quality management and organizational assets are stressed.« less

Development of ACRODAT®, a new software medical device to assess disease activity in patients with acromegaly.

PubMed

van der Lely, Aart J; Gomez, Roy; Pleil, Andreas; Badia, Xavier; Brue, Thierry; Buchfelder, Michael; Burman, Pia; Clemmons, David; Ghigo, Ezio; Jørgensen, Jens Otto Lunde; Luger, Anton; van der Lans-Bussemaker, Joli; Webb, Susan M; Strasburger, Christian J

2017-12-01

Despite availability of multimodal treatment options for acromegaly, achievement of long-term disease control is suboptimal in a significant number of patients. Furthermore, disease control as defined by biochemical normalization may not always show concordance with disease-related symptoms or patient's perceived quality of life. We developed and validated a tool to measure disease activity in acromegaly to support decision-making in clinical practice. An international expert panel (n = 10) convened to define the most critical indicators of disease activity. Patient scenarios were constructed based on these chosen parameters. Subsequently, a panel of 21 renowned endocrinologists at pituitary centers (Europe and Canada) categorized each scenario as stable, mild, or significant disease activity in an online validation study. From expert opinion, five parameters emerged as the best overall indicators to evaluate disease activity: insulin-like growth factor I (IGF-I) level, tumor status, presence of comorbidities (cardiovascular disease, diabetes, sleep apnea), symptoms, and health-related quality of life. In the validation study, IGF-I and tumor status became the predominant parameters selected for classification of patients with moderate or severe disease activity. If IGF-I level was ≤1.2x upper limit of normal and tumor size not significantly increased, the remaining three parameters contributed to the decision in a compensatory manner. The validation study underlined IGF-I and tumor status for routine clinical decision-making, whereas patient-oriented outcome measures received less medical attention. An Acromegaly Disease Activity Tool (ACRODAT) is in development that might assist clinicians towards a more holistic approach to patient management in acromegaly.

Evaluation of quality indicators and disease damage in childhood-onset systemic lupus erythematosus patients.

PubMed

Harris, Julia G; Maletta, Kristyn I; Kuhn, Evelyn M; Olson, Judyann C

2017-02-01

The aim of this study was to describe compliance with select quality indicators and assess organ-specific dysfunction in a childhood-onset systemic lupus erythematosus population by using a validated damage index and to evaluate associations between compliance with quality indicators and disease damage. A retrospective chart review was performed on patients diagnosed with systemic lupus erythematosus prior to age 18 followed at a single center in the USA from 1999 to 2012 (n = 75). Data regarding quality indicators and outcome variables, including the Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index, were collected. The median disease duration was 3.8 years. The proportion of patients or patient-years in which care complied with the proposed quality measures was 94.4% for hydroxychloroquine use, 84.3% for vitamin D recommendation,75.8% for influenza vaccination (patient-years), 67.2% for meningococcal vaccination, 49.0% for ophthalmologic examination (patient-years), 31.7% for pneumococcal vaccination, and 28.6% for bone mineral density evaluation. Disease damage was present in 41.3% of patients at last follow-up, with an average damage index score of 0.81. Disease damage at last follow-up was associated with minority race/ethnicity (p = 0.008), bone mineral density evaluation (p = 0.035), and vitamin D recommendation (p = 0.018). Adherence to quality indicators in a childhood-onset systemic lupus erythematosus population is varied, and disease damage is prevalent. This study highlights the importance of quality improvement initiatives aimed at optimizing care delivery to reduce disease damage in pediatric lupus patients.

Translation and validation of the Functional Assessment of Cancer Therapy-Bone Marrow Transplant (FACT-BMT) version 4 quality of life instrument into Arabic language.

PubMed

Soudy, Hussein; Maghfoor, Irfan; Elhassan, Tusneem Ahmed M; Abdullah, Eman; Rauf, Shahzad M; Al Zahrani, Ahmed; Akhtar, Saad

2018-03-12

Functional Assessment of Cancer Therapy-Bone Marrow Transplant (FACT-BMT) has been translated from English into several languages. Currently, there is no validated translation of FACT-BMT in Arabic. Here, we are reporting the first Arabic translation and validation of the FACT-BMT. The study was approved by the Institutional Research Advisory Council. The Arabic translation followed the standard Functional Assessment of Chronic Illness Therapy (FACIT.org) translation methodology (with permission). Arabic FACT-BMT (50- items) was statistically validated. Cronbach's alpha for internal consistency, Spearman's rank correlation coefficients method for Inter-scale correlations and Principal Component Analysis for factorial construct validity was used. One hundred and eight consecutive relapsed /refractory lymphoma patients who underwent high dose chemotherapy and autologous stem cell transplant were enrolled. There were 68 males (63%) and 40 females (37%) with a median age of 29 years (range 14-62). After Arabic questionnaire pre-testing (Cronbach's alpha 0.744), the study included 108 patients. Cronbach's alpha for the entire FACT-BMT indicated an excellent internal consistency (0.90); range (0.67 to 0.91). Cronbach's alpha for sub-groups of social (0.78), emotional (0.67) and functional wellbeing was (0.88). Cronbach's alpha for bone marrow transplant (0.81), FACT-General (0.89), and FACT- Trial Outcome Index (TOI); (0.91) also revealed excellent internal consistency. Patients had high scores in all domains of quality of life, indicating that most patients were leading a normal life. This translation of FACT-BMT in Arabic was reviewed and approved for submission by the FACIT.org. Our data reports the first translated, validated and approved Arabic version of FACT-BMT. This will help large numbers of Arabic speaking patients undergoing stem cell/bone marrow transplantation, across the globe.

Count every newborn; a measurement improvement roadmap for coverage data.

PubMed

Moxon, Sarah G; Ruysen, Harriet; Kerber, Kate J; Amouzou, Agbessi; Fournier, Suzanne; Grove, John; Moran, Allisyn C; Vaz, Lara M E; Blencowe, Hannah; Conroy, Niall; Gülmezoglu, A; Vogel, Joshua P; Rawlins, Barbara; Sayed, Rubayet; Hill, Kathleen; Vivio, Donna; Qazi, Shamim A; Sitrin, Deborah; Seale, Anna C; Wall, Steve; Jacobs, Troy; Ruiz Peláez, Juan; Guenther, Tanya; Coffey, Patricia S; Dawson, Penny; Marchant, Tanya; Waiswa, Peter; Deorari, Ashok; Enweronu-Laryea, Christabel; Arifeen, Shams; Lee, Anne C C; Mathai, Matthews; Lawn, Joy E

2015-01-01

The Every Newborn Action Plan (ENAP), launched in 2014, aims to end preventable newborn deaths and stillbirths, with national targets of ≤12 neonatal deaths per 1000 live births and ≤12 stillbirths per 1000 total births by 2030. This requires ambitious improvement of the data on care at birth and of small and sick newborns, particularly to track coverage, quality and equity. In a multistage process, a matrix of 70 indicators were assessed by the Every Newborn steering group. Indicators were graded based on their availability and importance to ENAP, resulting in 10 core and 10 additional indicators. A consultation process was undertaken to assess the status of each ENAP core indicator definition, data availability and measurement feasibility. Coverage indicators for the specific ENAP treatment interventions were assigned task teams and given priority as they were identified as requiring the most technical work. Consultations were held throughout. ENAP published 10 core indicators plus 10 additional indicators. Three core impact indicators (neonatal mortality rate, maternal mortality ratio, stillbirth rate) are well defined, with future efforts needed to focus on improving data quantity and quality. Three core indicators on coverage of care for all mothers and newborns (intrapartum/skilled birth attendance, early postnatal care, essential newborn care) have defined contact points, but gaps exist in measuring content and quality of the interventions. Four core (antenatal corticosteroids, neonatal resuscitation, treatment of serious neonatal infections, kangaroo mother care) and one additional coverage indicator for newborns at risk or with complications (chlorhexidine cord cleansing) lack indicator definitions or data, especially for denominators (population in need). To address these gaps, feasible coverage indicator definitions are presented for validity testing. Measurable process indicators to help monitor health service readiness are also presented. A major measurement gap exists to monitor care of small and sick babies, yet signal functions could be tracked similarly to emergency obstetric care. The ENAP Measurement Improvement Roadmap (2015-2020) outlines tools to be developed (e.g., improved birth and death registration, audit, and minimum perinatal dataset) and actions to test, validate and institutionalise proposed coverage indicators. The roadmap presents a unique opportunity to strengthen routine health information systems, crosslinking these data with civil registration and vital statistics and population-based surveys. Real measurement change requires intentional transfer of leadership to countries with the greatest disease burden and will be achieved by working with centres of excellence and existing networks.

Data Quality in Institutional Arthroplasty Registries: Description of a Model of Validation and Report of Preliminary Results.

PubMed

Bautista, Maria P; Bonilla, Guillermo A; Mieth, Klaus W; Llinás, Adolfo M; Rodríguez, Fernanda; Cárdenas, Laura L

2017-07-01

Arthroplasty registries are a relevant source of information for research and quality improvement in patient care and its value depends on the quality of the recorded data. The purpose of this study is to describe a model of validation and present the findings of validation of an Institutional Arthroplasty Registry (IAR). Information from 209 primary arthroplasties and revision surgeries of the hip, knee, and shoulder recorded in the IAR between March and September 2015 were analyzed in the following domains. Adherence is defined as the proportion of patients included in the registry, completeness is defined as the proportion of data effectively recorded, and accuracy is defined as the proportion of data consistent with medical records. A random sample of 53 patients (25.4%) was selected to assess the latest 2 domains. A direct comparison between the registry's database and medical records was performed. In total, 324 variables containing information on demographic data, surgical procedure, clinical outcomes, and key performance indicators were analyzed. Two hundred nine of 212 patients who underwent surgery during the study period were included in the registry, accounting for an adherence of 98.6%. Completeness was 91.7% and accuracy was 85.8%. Most errors were found in the preoperative range of motion and timely administration of prophylactic antibiotics and thromboprophylaxis. This model provides useful information regarding the quality of the recorded data since it identified deficient areas within the IAR. We recommend that institutional arthroplasty registries be constantly monitored for data quality before using their information for research or quality improvement purposes. Copyright © 2017 Elsevier Inc. All rights reserved.

Sexual function and quality of life in genitourinary medicine (GUM) outpatients and preliminary validation of a self-report questionnaire measure.

PubMed

Daker-White, Gavin; Crowley, Tessa

2003-05-01

A cross-sectional questionnaire survey of 216 men and 191 women attending a genitourinary medicine (GUM) clinic was undertaken to explore the relationship between sexual symptoms and quality of sexual life, and to test the psychometric validity of a pilot self-report measure of Sexual Function and Quality of Sexual Life (SFQoSL). Statistical comparisons were made with three reference groups: volunteers attending GUM for psychosexual counselling, outpatients at an Obstetrics and Gynaecology Department, and staff. Exploratory principal components analysis (with varimax rotation) of questionnaire item responses suggested an 11 (in women) and 13 (in men) factor solution, incorporating four multi-item scales. Internal consistency (Cronbach's alpha) of core items was 0.84 in 186 women (19 items) and 0.87 in 210 men (22 items). Construct validity was supported in comparisons with reference groups using one-way analysis of variance and post-hoc Scheffé testing. Overall, 116 (54%) male and 132 (69%) female GUM outpatients had scores indicating sexual dysfunction. Thirty-seven (17%) men reported erectile dysfunction; 54 (28%) women reported vaginal dryness affecting sex; 48 (25%) women reported genital changes affecting sex; 45 (21%) men and 64 (34%) women reported problems reaching orgasm.

Measuring verbal and non-verbal communication in aphasia: reliability, validity, and sensitivity to change of the Scenario Test.

PubMed

van der Meulen, Ineke; van de Sandt-Koenderman, W Mieke E; Duivenvoorden, Hugo J; Ribbers, Gerard M

2010-01-01

This study explores the psychometric qualities of the Scenario Test, a new test to assess daily-life communication in severe aphasia. The test is innovative in that it: (1) examines the effectiveness of verbal and non-verbal communication; and (2) assesses patients' communication in an interactive setting, with a supportive communication partner. To determine the reliability, validity, and sensitivity to change of the Scenario Test and discuss its clinical value. The Scenario Test was administered to 122 persons with aphasia after stroke and to 25 non-aphasic controls. Analyses were performed for the entire group of persons with aphasia, as well as for a subgroup of persons unable to communicate verbally (n = 43). Reliability (internal consistency, test-retest reliability, inter-judge, and intra-judge reliability) and validity (internal validity, convergent validity, known-groups validity) and sensitivity to change were examined using standard psychometric methods. The Scenario Test showed high levels of reliability. Internal consistency (Cronbach's alpha = 0.96; item-rest correlations = 0.58-0.82) and test-retest reliability (ICC = 0.98) were high. Agreement between judges in total scores was good, as indicated by the high inter- and intra-judge reliability (ICC = 0.86-1.00). Agreement in scores on the individual items was also good (square-weighted kappa values 0.61-0.92). The test demonstrated good levels of validity. A principal component analysis for categorical data identified two dimensions, interpreted as general communication and communicative creativity. Correlations with three other instruments measuring communication in aphasia, that is, Spontaneous Speech interview from the Aachen Aphasia Test (AAT), Amsterdam-Nijmegen Everyday Language Test (ANELT), and Communicative Effectiveness Index (CETI), were moderate to strong (0.50-0.85) suggesting good convergent validity. Group differences were observed between persons with aphasia and non-aphasic controls, as well as between persons with aphasia unable to use speech to convey information and those able to communicate verbally; this indicates good known-groups validity. The test was sensitive to changes in performance, measured over a period of 6 months. The data support the reliability and validity of the Scenario Test as an instrument for examining daily-life communication in aphasia. The test focuses on multimodal communication; its psychometric qualities enable future studies on the effect of Alternative and Augmentative Communication (AAC) training in aphasia.

Assessing quality of life in young adult cancer survivors: development of the Survivorship-Related Quality of Life scale.

PubMed

Park, Crystal L; Wortmann, Jennifer H; Hale, Amy E; Cho, Dalnim; Blank, Thomas O

2014-10-01

Scientific advances in treatments and outcomes for those diagnosed with cancer in late adolescence and early adulthood depend, in part, on the availability of adequate assessment tools to measure health-related quality of life (HRQOL) for survivors in this age group. Domains especially relevant to late adolescence and young adulthood (LAYA; e.g., education and career, committed romantic relationships, worldview formation) are typically overlooked in studies assessing the impact of cancer, usually more appropriate for middle-aged or older survivors. Current HRQOL measures also tend to assess issues that are salient during or shortly after treatment rather than reflecting life years after treatment. To develop a new measure to better capture the experience of LAYA cancer survivors in longer-term survivorship (the LAYA Survivorship-Related Quality of Life measure, LAYA-SRQL), we completed an extensive measure development process. After a literature review and focus groups with LAYA cancer survivors, we generated items and ran confirmatory factor and reliability analyses using a sample of 292 LAYA cancer survivors. We then examined validity using existing measures of physical and mental health, quality of life, and impact of cancer. The final model consisted of two domains (satisfaction and impact), each consisting of ten factors: existential/spirituality, coping, relationship, dependence, vitality, health care, education/career, fertility, intimacy/sexuality, and cognition/memory. Confirmatory factor analysis and validity analyses indicated that the LAYA-SRQL is a psychometrically sound instrument with good validity. The LAYA-SRQL fills an important need in survivorship research, providing a way to assess HRQOL in LAYAs in a developmentally informed way.

Development and validation of a new condition-specific instrument for evaluation of smile esthetics-related quality of life.

PubMed

Saltovic, Ema; Lajnert, Vlatka; Saltovic, Sabina; Kovacevic Pavicic, Daniela; Pavlic, Andrej; Spalj, Stjepan

2018-03-01

Orofacial esthetics raises psychosocial issues. The purpose was to create and validate new short instrument for psychosocial impacts of altered smile esthetics. A team of an orthodontist, two prosthodontists, psychologist, and a dental student generated items that could draw up specific hypothetical psychosocial dimensions (69 items initially, 39 in final analysis). The sample consisted of 261 Caucasian subjects attending local high schools and university (26% male) aged 14 to 28 years that have self-administrated the designed questionnaire. Factorial analysis, Cronbach's alpha, Pearson correlation, paired samples t-test and analysis of variance were used for analyses of internal consistency, construct validity, responsiveness, and test-retest. Three dimensions of psychosocial impacts of altered smile esthetics were identified: dental self-consciousness, dental self-confidence and social contacts that can be best fitted by 12 items, 4 items in each dimension. Internal consistency was good (α in range 0.85-0.89). Good stability in test-retest was confirmed. In responsiveness testing, tooth whitening induced increase in dental self-confidence (P = 0.002), but no significant changes in other dimensions. The new instrument, Smile Esthetics-Related Quality of Life (SERQoL), is short and has proven to be a good indicator of psychosocial dimensions related to perception of smile esthetics. Smile Esthetics-Related Quality of Life questionnaire might have practical validity when applied in esthetic dental clinical procedures. © 2017 Wiley Periodicals, Inc.

Cross-Cultural Analyses of Determinants of Quality of Life and Mental Health: Results from the Eurohis Study

ERIC Educational Resources Information Center

Schmidt, Silke; Power, Mick

2006-01-01

Recent projects on international instrument development have produced a wide array of health indicators that may be used for cross-cultural field-testing, however more information on their cross-cultural performance in relation to health determinants is necessary. The current study approaches one step for international conceptual validation by…

Estimated Student Score Gain on the ACT COMP Exam: Valid Tool for Institutional Assessment?

ERIC Educational Resources Information Center

Banta, Trudy W.; And Others

1987-01-01

An institution can test seniors with the ACT College Outcome Measures Project (COMP) exam, then subtract from the senior score an estimated freshman score. Studies at the University of Tennessee, Knoxville, indicate that this method is not reliable to make judgments about the quality of general education programs. (Author/MLW)

Reliability and Validity in Measuring the Value Added of Schools

ERIC Educational Resources Information Center

van de Grift, Wim

2009-01-01

Instability in the school population between school entrance and school leaving is not "just a problem of missing data" but often the visible result of the educational problems in some schools and is, therefore, not merely to be treated as missing data but as indicator for the quality of educational processes. Even the most superior…

Recess before Lunch in Elementary Schools: Development of a Best Practice Checklist

ERIC Educational Resources Information Center

Rainville, Alice Jo; Lofton, Kristi L.; Carr, Deborah H.

2009-01-01

Purpose/Objectives: The purpose of this study was to determine the best practices (quality indicators) related to recess placement before lunch in elementary schools; compile a best practices checklist that can be used as an assessment tool for school nutrition programs; and validate and evaluate the usefulness of the best practices checklist.…

The Use of Occupational Licensure Examination Results in Outcomes Assessment. AIR 1994 Annual Forum Paper.

ERIC Educational Resources Information Center

Bragg, Theresa A.

This paper discusses the validity of licensure examination results as an indicator of the performance of higher educational institutions. Licensure examination scores are available to departments for a variety of disciplines and analysis is best performed within the departments. The quality of feedback may dictate the usefulness of results. Using…

Development and Validation of a New Questionnaire Assessing Quality of Life in Adults with Hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ)

PubMed Central

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

Objective To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. Methods We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Results Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach’s alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. Conclusion The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism. PMID:22984490

Behavioral Indicators on a Mobile Sensing Platform Predict Clinically Validated Psychiatric Symptoms of Mood and Anxiety Disorders.

PubMed

Place, Skyler; Blanch-Hartigan, Danielle; Rubin, Channah; Gorrostieta, Cristina; Mead, Caroline; Kane, John; Marx, Brian P; Feast, Joshua; Deckersbach, Thilo; Pentland, Alex Sandy; Nierenberg, Andrew; Azarbayejani, Ali

2017-03-16

There is a critical need for real-time tracking of behavioral indicators of mental disorders. Mobile sensing platforms that objectively and noninvasively collect, store, and analyze behavioral indicators have not yet been clinically validated or scalable. The aim of our study was to report on models of clinical symptoms for post-traumatic stress disorder (PTSD) and depression derived from a scalable mobile sensing platform. A total of 73 participants (67% [49/73] male, 48% [35/73] non-Hispanic white, 33% [24/73] veteran status) who reported at least one symptom of PTSD or depression completed a 12-week field trial. Behavioral indicators were collected through the noninvasive mobile sensing platform on participants' mobile phones. Clinical symptoms were measured through validated clinical interviews with a licensed clinical social worker. A combination hypothesis and data-driven approach was used to derive key features for modeling symptoms, including the sum of outgoing calls, count of unique numbers texted, absolute distance traveled, dynamic variation of the voice, speaking rate, and voice quality. Participants also reported ease of use and data sharing concerns. Behavioral indicators predicted clinically assessed symptoms of depression and PTSD (cross-validated area under the curve [AUC] for depressed mood=.74, fatigue=.56, interest in activities=.75, and social connectedness=.83). Participants reported comfort sharing individual data with physicians (Mean 3.08, SD 1.22), mental health providers (Mean 3.25, SD 1.39), and medical researchers (Mean 3.03, SD 1.36). Behavioral indicators passively collected through a mobile sensing platform predicted symptoms of depression and PTSD. The use of mobile sensing platforms can provide clinically validated behavioral indicators in real time; however, further validation of these models and this platform in large clinical samples is needed. ©Skyler Place, Danielle Blanch-Hartigan, Channah Rubin, Cristina Gorrostieta, Caroline Mead, John Kane, Brian P Marx, Joshua Feast, Thilo Deckersbach, Alex “Sandy” Pentland, Andrew Nierenberg, Ali Azarbayejani. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 16.03.2017.

Overview of the O3M SAF GOME-2 operational atmospheric composition and UV radiation data products and data availability

NASA Astrophysics Data System (ADS)

Hassinen, S.; Balis, D.; Bauer, H.; Begoin, M.; Delcloo, A.; Eleftheratos, K.; Gimeno Garcia, S.; Granville, J.; Grossi, M.; Hao, N.; Hedelt, P.; Hendrick, F.; Hess, M.; Heue, K.-P.; Hovila, J.; Jønch-Sørensen, H.; Kalakoski, N.; Kiemle, S.; Kins, L.; Koukouli, M. E.; Kujanpää, J.; Lambert, J.-C.; Lerot, C.; Loyola, D.; Määttä, A.; Pedergnana, M.; Pinardi, G.; Romahn, F.; van Roozendael, M.; Lutz, R.; De Smedt, I.; Stammes, P.; Steinbrecht, W.; Tamminen, J.; Theys, N.; Tilstra, L. G.; Tuinder, O. N. E.; Valks, P.; Zerefos, C.; Zimmer, W.; Zyrichidou, I.

2015-07-01

The three GOME-2 instruments will provide unique and long data sets for atmospheric research and applications. The complete time period will be 2007-2022, including the period of ozone depletion as well as the beginning of ozone layer recovery. Besides ozone chemistry, the GOME-2 products are important e.g. for air quality studies, climate modeling, policy monitoring and hazard warnings. The heritage for GOME-2 is in the ERS/GOME and Envisat/SCIAMACHY instruments. The current Level 2 (L2) data cover a wide range of products such as trace gas columns (NO2, BrO, H2CO, H2O, SO2), tropospheric columns of NO2, total ozone columns and vertical ozone profiles in high and low spatial resolution, absorbing aerosol indices from the main science channels as well as from the polarization channels (AAI, AAI-PMD), Lambertian-equivalent reflectivity database, clear-sky and cloud-corrected UV indices and surface UV fields with different weightings and photolysis rates. The Ozone Monitoring and Atmospheric Composition Satellite Application Facility (O3M SAF) processing and data dissemination is operational and running 24/7. Data quality is quarantined by the detailed review processes for the algorithms, validation of the products as well as by a continuous quality monitoring of the products and processing. This is an overview paper providing the O3M SAF project background, current status and future plans to utilization of the GOME-2 data. An important focus is the provision of summaries of the GOME-2 products including product principles and validation examples together with the product sample images. Furthermore, this paper collects the references to the detailed product algorithm and validation papers.

Development and validity of a method for the evaluation of printed education material

PubMed Central

Castro, Mauro Silveira; Pilger, Diogo; Fuchs, Flávio Danni; Ferreira, Maria Beatriz Cardoso

Objectives To develop and study the validity of an instrument for evaluation of Printed Education Materials (PEM); to evaluate the use of acceptability indices; to identify possible influences of professional aspects. Methods An instrument for PEM evaluation was developed which included tree steps: domain identification, item generation and instrument design. A reading to easy PEM was developed for education of patient with systemic hypertension and its treatment with hydrochlorothiazide. Construct validity was measured based on previously established errors purposively introduced into the PEM, which served as extreme groups. An acceptability index was applied taking into account the rate of professionals who should approve each item. Participants were 10 physicians (9 men) and 5 nurses (all women). Results Many professionals identified intentional errors of crude character. Few participants identified errors that needed more careful evaluation, and no one detected the intentional error that required literature analysis. Physicians considered as acceptable 95.8% of the items of the PEM, and nurses 29.2%. The differences between the scoring were statistically significant in 27% of the items. In the overall evaluation, 66.6% were considered as acceptable. The analysis of each item revealed a behavioral pattern for each professional group. Conclusions The use of instruments for evaluation of printed education materials is required and may improve the quality of the PEM available for the patients. Not always are the acceptability indices totally correct or represent high quality of information. The professional experience, the practice pattern, and perhaps the gendre of the reviewers may influence their evaluation. An analysis of the PEM by professionals in communication, in drug information, and patients should be carried out to improve the quality of the proposed material. PMID:25214924

Development and validation of the Cancer Exercise Stereotypes Scale.

PubMed

Falzon, Charlène; Sabiston, Catherine; Bergamaschi, Alessandro; Corrion, Karine; Chalabaev, Aïna; D'Arripe-Longueville, Fabienne

2014-01-01

The objective of this study was to develop and validate a French-language questionnaire measuring stereotypes related to exercise in cancer patients: The Cancer Exercise Stereotypes Scale (CESS). Four successive steps were carried out with 806 participants. First, a preliminary version was developed on the basis of the relevant literature and qualitative interviews. A test of clarity then led to the reformulation of six of the 30 items. Second, based on the modification indices of the first confirmatory factorial analysis, 11 of the 30 initial items were deleted. A new factorial structure analysis showed a good fit and validated a 19-item instrument with five subscales. Third, the stability of the instrument was tested over time. Last, tests of construct validity were conducted to examine convergent validity and discriminant validity. The French-language CESS appears to have good psychometric qualities and can be used to test theoretical tenets and inform intervention strategies on ways to foster exercise in cancer patients.

Service quality assessment of workers compensation health care delivery programs in New York using SERVQUAL.

PubMed

Arunasalam, Mark; Paulson, Albert; Wallace, William

2003-01-01

Preferred provider organizations (PPOs) provide healthcare services to an expanding proportion of the U.S. population. This paper presents a programmatic assessment of service quality in the workers' compensation environment using two different models: the PPO program model and the fee-for-service (FFS) payor model. The methodology used here will augment currently available research in workers' compensation, which has been lacking in measuring service quality determinants and assessing programmatic success/failure of managed care type programs. Results indicated that the SERVQUAL tool provided a reliable and valid clinical quality assessment tool that ascertained that PPO marketers should focus on promoting physician outreach (to show empathy) and accessibility (to show reliability) for injured workers.

Improvement in quality-of-life questionnaire measures in obese adolescent females with polycystic ovary syndrome treated with lifestyle changes and oral contraceptives, with or without metformin.

PubMed

Harris-Glocker, Miranda; Davidson, Kristin; Kochman, Lynda; Guzick, David; Hoeger, Kathleen

2010-02-01

We studied the effect of metformin or placebo in a lifestyle modification program combined with oral contraceptives (OC) on quality-of-life parameters measured by the polycystic ovary syndrome (PCOS) questionnaire in obese adolescent women with validated PCOS. The quality-of-life indicators were measured at baseline and conclusion for five domains on the PCOS questionnaire, with equal improvement in scores in both placebo and metformin groups, suggesting that the addition of metformin does not add improvement to quality-of-life measures above those observed with lifestyle modification and OC treatment. Copyright 2010 American Society for Reproductive Medicine. Published by Elsevier Inc. All rights reserved.

Conceptualization, development and validation of T-QoL© (Teenagers' Quality of Life): a patient-focused measure to assess quality of life of adolescents with skin diseases.

PubMed

Basra, M K A; Salek, M S; Fenech, D; Finlay, A Y

2018-01-01

Skin disease can affect the quality of life (QoL) of teenagers in a variety of different ways, some being unique to this age group. To develop and validate a dermatology-specific QoL instrument for adolescents with skin diseases. Qualitative semistructured interviews were conducted with adolescents with skin disease to gain in-depth understanding of how skin diseases affect their QoL. A prototype instrument based on the themes identified from content analysis of interviews was tested in several stages, using classical test theory and item response theory models to develop this new tool and conduct its psychometric evaluation. Thirty-three QoL issues were identified from semistructured interviews with 50 adolescents. A questionnaire based on items derived from content analysis of interviews was subjected to Rasch analysis: factor analysis identified three domains, therefore not supporting the validity of T-QoL as a unidimensional measure. Psychometric evaluation of the final 18-item questionnaire was carried out in a cohort of 203 adolescents. Convergent validity was demonstrated by significant correlation with Skindex-Teen and Dermatology Life Quality Index (DLQI) or Children's DLQI. The T-QoL showed excellent internal consistency reliability: Cronbach's α = 0·89 for total scale score and 0·85, 0·60 and 0·74, respectively, for domains 1, 2 and 3. Test-retest reliability was high in stable volunteers. T-QoL showed sensitivity to change in two subgroups of patients who indicated change in their self-assessed disease severity. Built on rich qualitative data from patients, the T-QoL is a simple and valid tool to quantify the impact of skin disease on adolescents' QoL; it could be used as an outcome measure in both clinical practice and clinical research. © 2017 British Association of Dermatologists.

Are university rankings useful to improve research? A systematic review.

PubMed

Vernon, Marlo M; Balas, E Andrew; Momani, Shaher

2018-01-01

Concerns about reproducibility and impact of research urge improvement initiatives. Current university ranking systems evaluate and compare universities on measures of academic and research performance. Although often useful for marketing purposes, the value of ranking systems when examining quality and outcomes is unclear. The purpose of this study was to evaluate usefulness of ranking systems and identify opportunities to support research quality and performance improvement. A systematic review of university ranking systems was conducted to investigate research performance and academic quality measures. Eligibility requirements included: inclusion of at least 100 doctoral granting institutions, be currently produced on an ongoing basis and include both global and US universities, publish rank calculation methodology in English and independently calculate ranks. Ranking systems must also include some measures of research outcomes. Indicators were abstracted and contrasted with basic quality improvement requirements. Exploration of aggregation methods, validity of research and academic quality indicators, and suitability for quality improvement within ranking systems were also conducted. A total of 24 ranking systems were identified and 13 eligible ranking systems were evaluated. Six of the 13 rankings are 100% focused on research performance. For those reporting weighting, 76% of the total ranks are attributed to research indicators, with 24% attributed to academic or teaching quality. Seven systems rely on reputation surveys and/or faculty and alumni awards. Rankings influence academic choice yet research performance measures are the most weighted indicators. There are no generally accepted academic quality indicators in ranking systems. No single ranking system provides a comprehensive evaluation of research and academic quality. Utilizing a combined approach of the Leiden, Thomson Reuters Most Innovative Universities, and the SCImago ranking systems may provide institutions with a more effective feedback for research improvement. Rankings which extensively rely on subjective reputation and "luxury" indicators, such as award winning faculty or alumni who are high ranking executives, are not well suited for academic or research performance improvement initiatives. Future efforts should better explore measurement of the university research performance through comprehensive and standardized indicators. This paper could serve as a general literature citation when one or more of university ranking systems are used in efforts to improve academic prominence and research performance.

Assessment of the quality of fall detection and management in primary care in the Netherlands based on the ACOVE quality indicators.

PubMed

Askari, M; Eslami, S; van Rijn, M; Medlock, S; Moll van Charante, E P; van der Velde, N; de Rooij, S E; Abu-Hanna, A

2016-02-01

We determined adherence to nine fall-related ACOVE quality indicators to investigate the quality of management of falls in the elderly population by general practitioners in the Netherlands. Our findings demonstrate overall low adherence to these indicators, possibly indicating insufficiency in the quality of fall management. Most indicators showed a positive association between increased risk for functional decline and adherence, four of which with statistical significance. This study aims to investigate the quality of detection and management of falls in the elderly population by general practitioners in the Netherlands, using the Assessing Care of Vulnerable Elders (ACOVE) quality indicators. Community-dwelling persons aged 70 years or above, registered in participating general practices, were asked to fill in a questionnaire designed to determine general practitioner (GP) adherence to fall-related indicators. We used logistic regression to estimate the association between increased risk for functional decline-quantified by the Identification of Seniors At Risk for Primary Care score-and adherence. We then cross-validated the self-reported falls with medical records. Of the 950 elders responding to our questionnaire, only 10.6 % reported that their GP proactively asked them about falls. Of the 160 patients who reported two or more falls, or one fall for which they visited the GP, only 23.1 % had fall documentation in their records. Adherence ranged between 13.6 and 48.6 %. There was a significant positive association between the ISAR-PC scores and adherence in four QIs. Documentation of falls was highest (36.7 %) in patients whom the GP had proactively asked about falls. Based on patient self-reports, adherence to the ACOVE fall-related indicators was poor, suggesting that the quality of evaluation and management of falls in community-dwelling older persons in the Netherlands is poor. The documentation of falls and fall-related risk factors was also poor. However, for most QIs, adherence to them increased with the increase in the risk of functional decline.

The Global Streamflow Indices and Metadata Archive (GSIM) - Part 2: Quality control, time-series indices and homogeneity assessment

NASA Astrophysics Data System (ADS)

Gudmundsson, Lukas; Do, Hong Xuan; Leonard, Michael; Westra, Seth

2018-04-01

This is Part 2 of a two-paper series presenting the Global Streamflow Indices and Metadata Archive (GSIM), which is a collection of daily streamflow observations at more than 30 000 stations around the world. While Part 1 (Do et al., 2018a) describes the data collection process as well as the generation of auxiliary catchment data (e.g. catchment boundary, land cover, mean climate), Part 2 introduces a set of quality controlled time-series indices representing (i) the water balance, (ii) the seasonal cycle, (iii) low flows and (iv) floods. To this end we first consider the quality of individual daily records using a combination of quality flags from data providers and automated screening methods. Subsequently, streamflow time-series indices are computed for yearly, seasonal and monthly resolution. The paper provides a generalized assessment of the homogeneity of all generated streamflow time-series indices, which can be used to select time series that are suitable for a specific task. The newly generated global set of streamflow time-series indices is made freely available with an digital object identifier at https://doi.pangaea.de/10.1594/PANGAEA.887470 and is expected to foster global freshwater research, by acting as a ground truth for model validation or as a basis for assessing the role of human impacts on the terrestrial water cycle. It is hoped that a renewed interest in streamflow data at the global scale will foster efforts in the systematic assessment of data quality and provide momentum to overcome administrative barriers that lead to inconsistencies in global collections of relevant hydrological observations.

Conference presentation to publication: a retrospective study evaluating quality of abstracts and journal articles in medical education research.

PubMed

Stephenson, Christopher R; Vaa, Brianna E; Wang, Amy T; Schroeder, Darrell R; Beckman, Thomas J; Reed, Darcy A; Sawatsky, Adam P

2017-11-09

There is little evidence regarding the comparative quality of abstracts and articles in medical education research. The Medical Education Research Study Quality Instrument (MERSQI), which was developed to evaluate the quality of reporting in medical education, has strong validity evidence for content, internal structure, and relationships to other variables. We used the MERSQI to compare the quality of reporting for conference abstracts, journal abstracts, and published articles. This is a retrospective study of all 46 medical education research abstracts submitted to the Society of General Internal Medicine 2009 Annual Meeting that were subsequently published in a peer-reviewed journal. We compared MERSQI scores of the abstracts with scores for their corresponding published journal abstracts and articles. Comparisons were performed using the signed rank test. Overall MERSQI scores increased significantly for published articles compared with conference abstracts (11.33 vs 9.67; P < .001) and journal abstracts (11.33 vs 9.96; P < .001). Regarding MERSQI subscales, published articles had higher MERSQI scores than conference abstracts in the domains of sampling (1.59 vs 1.34; P = .006), data analysis (3.00 vs 2.43; P < .001), and validity of evaluation instrument (1.04 vs 0.28; P < .001). Published articles also had higher MERSQI scores than journal abstracts in the domains of data analysis (3.00 vs 2.70; P = .004) and validity of evaluation instrument (1.04 vs 0.26; P < .001). To our knowledge, this is the first study to compare the quality of medical education abstracts and journal articles using the MERSQI. Overall, the quality of articles was greater than that of abstracts. However, there were no significant differences between abstracts and articles for the domains of study design and outcomes, which indicates that these MERSQI elements may be applicable to abstracts. Findings also suggest that abstract quality is generally preserved from original presentation to publication.

Mapping by sequencing in cotton (Gossypium hirsutum) line MD52ne identified candidate genes for fiber strength and its related quality attributes.

PubMed

Islam, Md S; Zeng, Linghe; Thyssen, Gregory N; Delhom, Christopher D; Kim, Hee Jin; Li, Ping; Fang, David D

2016-06-01

Three QTL regions controlling three fiber quality traits were validated and further fine-mapped with 27 new single nucleotide polymorphism (SNP) markers. Transcriptome analysis suggests that receptor-like kinases found within the validated QTLs are potential candidate genes responsible for superior fiber strength in cotton line MD52ne. Fiber strength, length, maturity and fineness determine the market value of cotton fibers and the quality of spun yarn. Cotton fiber strength has been recognized as a critical quality attribute in the modern textile industry. Fine mapping along with quantitative trait loci (QTL) validation and candidate gene prediction can uncover the genetic and molecular basis of fiber quality traits. Four previously-identified QTLs (qFBS-c3, qSFI-c14, qUHML-c14 and qUHML-c24) related to fiber bundle strength, short fiber index and fiber length, respectively, were validated using an F3 population that originated from a cross of MD90ne × MD52ne. A group of 27 new SNP markers generated from mapping-by-sequencing (MBS) were placed in QTL regions to improve and validate earlier maps. Our refined QTL regions spanned 4.4, 1.8 and 3.7 Mb of physical distance in the Gossypium raimondii reference genome. We performed RNA sequencing (RNA-seq) of 15 and 20 days post-anthesis fiber cells from MD52ne and MD90ne and aligned reads to the G. raimondii genome. The QTL regions contained 21 significantly differentially expressed genes (DEGs) between the two near-isogenic parental lines. SNPs that result in non-synonymous substitutions to amino acid sequences of annotated genes were identified within these DEGs, and mapped. Taken together, transcriptome and amino acid mutation analysis indicate that receptor-like kinase pathway genes are likely candidates for superior fiber strength and length in MD52ne. MBS along with RNA-seq demonstrated a powerful strategy to elucidate candidate genes for the QTLs that control complex traits in a complex genome like tetraploid upland cotton.

Application and partial validation of a habitat model for moose in the Lake Superior region

USGS Publications Warehouse

Allen, A.W.; Terrell, J.W.; Mangus, W.L.; Lindquist, E.L.

1991-01-01

A modified version of the dormant-season portion of a Habitat Suitability Index (HSI) model developed for assessing moose (Alces alces) habitat in the Lake Superior Region was incorporated in a Geographic Information System (GIS) for 490 km2 of Minnesota's Superior National Forest. Moose locations (n=235) were plotted during aerial surveys conducted in December 1988 and January 1990-1991. Dormant-season forage and cover quality for 1,000-m, 500-m, and 200-m radii plots around random points and moose locations were compared using U.S. Forest Service stand examination data. Cover quality indices were lower than forage quality indices within all plots. The median value for the average cover quality index was greater (P=0.003) within 200-m plots around cow moose locations than for plots around random points for the most severe winter of the study. The proportion of highest-quality winter cover, such as mixed stands dominated by mid-age class white spruce (Picea glauca) and balsam fir (Abies balsanea), was greater within 500-m and 200-m plots around cow moose than within similar plots around random points during the two most severe winters. These results indicate that suboptimum ratings of winter habitat quality used in the GIS for dormant-season forage >100 m from cover, as suggested in the original HSI model, are reasonable. Integrating the habitat model with forest stand data using a GIS permitted analysis of moose habitat within a relatively large geographic area. Simulation of habitat quality indicated a potential shortage of late-winter cover in the study area. The effects of forest management actions on moose habitat quality can be simulated without collecting additional data.

Development and validation of the impact of dry eye on everyday life (IDEEL) questionnaire, a patient-reported outcomes (PRO) measure for the assessment of the burden of dry eye on patients.

PubMed

Abetz, Linda; Rajagopalan, Krithika; Mertzanis, Polyxane; Begley, Carolyn; Barnes, Rod; Chalmers, Robin

2011-12-08

To develop and validate a comprehensive patient-reported outcomes instrument focusing on the impact of dry eye on everyday life (IDEEL). Development and validation of the IDEEL occurred in four phases: 1) focus groups with 45 dry eye patients to develop a draft instrument, 2) item generation, 3) pilot study to assess content validity in 16 patients and 4) psychometric validation in 210 subjects: 130 with non-Sjögren's keratoconjunctivitis sicca, 32 with Sjögren's syndrome and 48 controls, and subsequent item reduction. Focus groups identified symptoms and the associated bother, the impact of dry eye on daily life and the patients' satisfaction with their treatment as the central concepts in patients' experience of dry eye. Qualitative analysis indicated that saturation was achieved for these concepts and yielded an initial 112-item draft instrument. Patients understood the questionnaire and found the items to be relevant indicating content validity. Patient input, item descriptive statistics and factor analysis identified 55 items that could be deleted. The final 57-item IDEEL assesses dry eye impact constituting 3 modules: dry eye symptom-bother, dry eye impact on daily life comprising impact on daily activities, emotional impact, impact on work, and dry eye treatment satisfaction comprising satisfaction with treatment effectiveness and treatment-related bother/inconvenience. The psychometric analysis results indicated that the IDEEL met the criteria for item discriminant validity, internal consistency reliability, test-retest reliability and floor/ceiling effects. As expected, the correlations between IDEEL and the Dry Eye Questionnaire (a habitual symptom questionnaire) were higher than between IDEEL and Short-Form-36 and EuroQoL-5D, indicating concurrent validity. The IDEEL is a reliable, valid and comprehensive questionnaire relevant to issues that are specific to dry eye patients, and meets current FDA patient-reported outcomes guidelines. The use of this questionnaire will provide assessment of the impact of dry eye on patient dry eye-related quality of life, impact of treatment on patient outcomes in clinical trials, and may aid in treatment effectiveness evaluation.

Determining the value of disease management programs.

PubMed

Selby, Joe V; Scanlon, Dennis; Lafata, Jennifer Elston; Villagra, Victor; Beich, Jeff; Salber, Patricia R

2003-09-01

Increasing prevalence, rising costs, and persisting deficiencies in quality of care for chronic diseases pose economic and policy challenges to providers and purchasers. Disease management (DM) programs may address these challenges, but neither purchasers nor providers can assess their value. The potpourri of current quality indicators provides limited insight into the actual clinical benefit achieved. A conference sponsored by the Agency for Healthcare Research and Quality (AHRQ) and held in October 2002 explored new approaches to measuring and reporting the value of DM for diabetes mellitus. Quantifying the value of DM requires measuring clinical benefit and net impact on health care costs for the entire population with diabetes. If quality is measured with indicators that are clearly linked to outcomes, clinical benefit can be estimated. Natural history models combine the expected benefits of improvements in multiple indicators to yield a single, composite measure, the quality-adjusted life-year. Such metrics could fairly express, in terms of survival and complications prevention, relatively disparate DM programs' benefits. Measuring and comparing health care costs requires data validation and appropriate case-mix adjustment. Comparing value across programs may provide more accurate assessments of performance, enhance quality improvement efforts within systems, and contribute generalizable knowledge on the utility of DM approaches. Conference attendees recommended pilot projects to further explore use of natural history models for measuring and reporting the value of DM.

Methodological considerations of the GRADE method.

PubMed

Malmivaara, Antti

2015-02-01

The GRADE method (Grading of Recommendations, Assessment, Development, and Evaluation) provides a tool for rating the quality of evidence for systematic reviews and clinical guidelines. This article aims to analyse conceptually how well grounded the GRADE method is, and to suggest improvements. The eight criteria for rating the quality of evidence as proposed by GRADE are here analysed in terms of each criterion's potential to provide valid information for grading evidence. Secondly, the GRADE method of allocating weights and summarizing the values of the criteria is considered. It is concluded that three GRADE criteria have an appropriate conceptual basis to be used as indicators of confidence in research evidence in systematic reviews: internal validity of a study, consistency of the findings, and publication bias. In network meta-analyses, the indirectness of evidence may also be considered. It is here proposed that the grade for the internal validity of a study could in some instances justifiably decrease the overall grade by three grades (e.g. from high to very low) instead of the up to two grade decrease, as suggested by the GRADE method.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Testing a healthcare provider-patient communicative relationship quality model of pharmaceutical care in hospitals.

PubMed

Wang, Dan; Liu, Chenxi; Zhang, Zinan; Ye, Liping; Zhang, Xinping

2018-06-01

Background Patient-centeredness and participatory care is increasingly regarded as a proxy for high-quality interpersonal care. Considering the development of patient-centeredness and participatory care relationship model in pharmacist-patient domain, it is of great significance to explore the mechanism of how pharmacist and patient participative behaviors influence relationship quality and patient outcomes. Objective To validate pharmacist-patient relationship quality model in Chinese hospitals. Four tertiary hospitals in 2017. Methods The provision of pharmaceutical care was investigated. A cross-sectional questionnaire survey covering different constructs of communicative relationship quality model was conducted and the associations among pairs of the study constructs were explored. Based on the results of confirmatory factor analysis, path analysis was conducted to validate the proposed communicative relationship quality model. Main outcome measure Model fit indicators including Tucker-Lewis index (TLI), comparative fit index (CFI), root mean square error of approximation (RMSEA) and weighted root mean square residual(WRMR). Results There were 589 patients included in our study. The final path model had an excellent fit (TLI = 0.98, CFI = 0.98, RMSEA = 0.05; WRMR = 1.06). HCP participative behavior/patient-centeredness (β = 0.79, p < 0.001) and interpersonal communication (β = 0.13, p < 0.001) directly impact the communicative relationship quality. But patient participative behavior was not a predictor of either communicative relationship quality or patient satisfaction. Conclusion HCP participative behavior/patient-centeredness and interpersonal communication are positively related to relationship quality, and relationship quality is mediator between HCP participative behavior and interpersonal communication with patient satisfaction.

[Shared decision-making as a new quality indicator in nephrology: a nationwide survey in Germany].

PubMed

Scheibler, Fülöp; Stoffel, Markus P; Barth, Claudia; Kuch, Christine; Steffen, Petra; Baldamus, Conrad A; Pfaff, Holger

2005-04-15

Shared decision-making (SDM) as a model in physician-patient interaction is gaining relevance in the German health system. By applying this model, mid- and long-term improvements are expected especially in the outcomes of chronic diseases. Up to now, there has hardly been any empirical data available in German health services research regarding the state and development of SDM. This study establishes a baseline and provides actual data on this subject based on a German-wide survey of end-stage renal disease (ESRD) patients. Standardized German-wide survey of 6,614 patients with ESRD. The questionnaire included an instrument to measure the patients' perceived involvement in care (PICS) which had been translated and validated before. 82% of the questioned patients feel their physicians facilitated involvement in decision making. 81% of the patients actively inform themselves concerning their disease and treatment options. 69% state that SDM has taken place. Age, years on dialysis and gender correlate with perceived involvement. This paper provides a valid baseline for the prospective research of SDM in ESRD. The results indicate that dialysis patients are willing to participate in the process of medical decision-making. Characteristics and preferences of the patients should be taken into account not only in everyday clinical interactions. They could be monitored systematically within the framework of quality management and used as potential for quality improvement.

Validity testing of the quality of life scale, Swedish version: focus group interviews of women with fibromyalgia.

PubMed

Liedberg, Gunilla M; Eddy, Linda L; Burckhardt, Carol S

2012-12-01

Focus group interviews were used to examine validity of the Quality of Life Scale, Swedish version (QOLS-S) for use with women with fibromyalgia. Five interviews with 18 women with fibromyalgia were completed. The opening question was "What does quality of life mean to you?" Later, participants were asked to respond to questions about the specific domains and items in the QOLS-S. The transcribed interviews were analysed, and categories were identified. Opinions concerning domains and items in the QOLS-S were linked to domains of the QOLS-S. Four categories emerged from the opening question: finances, to be an active person and participate in society, relations with others, and health. Overall, the women's perceptions of quality of life were congruent with the domains of QOLS-S. However, further attention should be given to the translation of certain items and apparent overlaps in some items indicate that they can be combined. Also, the instrument needs to be scrutinized from a cultural perspective because some items in the "social, community and civic activities" domain were not endorsed by the participants. Copyright © 2012 John Wiley & Sons, Ltd.

Development and preliminary validation of a measure of social inclusion for use in people with mental health problems: the SInQUE.

PubMed

Mezey, Gillian; White, Sarah; Thachil, Ajoy; Berg, Rachel; Kallumparam, Sen; Nasiruddin, Omar; Wright, Christine; Killaspy, Helen

2013-08-01

Social exclusion can be both a cause and a consequence of mental health problems. Socially inclusive practice by mental health professionals can mitigate against the stigmatizing and excluding effects of severe mental illness. To develop and test the validity of a measure of social inclusion for individuals with severe mental illness - the Social Inclusion Questionnaire User Experience (SInQUE). The domains of the SInQUE were chosen to reflect the domains of social inclusion identified in the Poverty and Social Exclusion Survey. Patients with severe mental illness were recruited from rehabilitation, general and forensic psychiatric services and were asked to complete the questionnaire in an individual interview with a researcher. Sixty six patients with schizophrenia and schizoaffective disorder completed the SInQUE, alongside measures of psychiatric symptoms, needs and quality of life, to assess its acceptability, and concurrent and construct (convergent and discriminant) validity. The SInQUE took 45 minutes to complete and was found to have good concurrent and discriminant validity. Convergent validity was established for two domains: social integration and productivity. Preliminary findings suggest that the SInQUE may be a useful tool for assessing and monitoring social inclusion in individuals with severe mental illness. It has construct and concurrent validity with measures of unmet need and quality of life in this group. Further testing of the reliability of the SInQUE on a larger population is indicated.

Perception of occupational balance by people with mental illness: A new methodology.

PubMed

Eklund, Mona; Argentzell, Elisabeth

2016-07-01

Aims The aims were to (i) investigate initial construct validity of a tool for assessment of time allocation in occupational balance, and (ii) describe perceived occupational balance and its relationship with socio-demographics, well-being, and personal recovery among people with mental illness. Methods Satisfaction with Daily Occupations and Occupational Balance (SDO-OB) was administered to 226 persons. SDO-OB reflects balance in five occupational domains: work, leisure, home chores, self-care, and overall occupational balance. Indicators for assessing construct validity were: satisfaction with everyday occupations, occupational value, symptom severity, and psychosocial functioning. For the second aim, the data collection included socio-demographics, life quality, self-esteem, self-mastery, and personal recovery. Results Occupational balance ratings indicated the participants were either under-occupied or in balance. Few were over-occupied. Feeling in balance was related to greater well-being and recovery compared with being under-occupied. Risk factors for under-occupation were younger age (in relation to work), and higher education (in relation to overall balance). Conclusions Associations with the indicators suggest initial construct validity. The SDO-OB is promising for assessment of occupational balance among people with mental illness. Being under-occupied was detrimental to well-being and recovery, and this indicates the importance of offering more occupational opportunities for people with mental illness.

The validity of socioeconomic status measures among adolescents based on self-reported information about parents occupations, FAS and perceived SES; implication for health related quality of life studies.

PubMed

Svedberg, P; Nygren, J M; Staland-Nyman, C; Nyholm, M

2016-04-29

Research has shown inconsistencies in results and difficulties in conceptualization of assessment of socioeconomic status (SES) among adolescents. The aim of this study was thus to test the validity of self-reported information on SES in two age-groups (11-13 and 14-16 years old) in an adolescent population and to evaluate its relationship to self-reported health related quality of life (HRQOL). Different measures of SES commonly used in research in relation to HRQOL were tested in this study; parent's occupations status, family material affluence status (FAS) and perceived SES. A cross-sectional study, with a sample of 948 respondents (n = 467, 11-13 years old and n = 481, 14-16 years old) completed questionnaires about SES and HRQOL. The adolescents' completion rates were used, with chi2-test, to investigate differences between gender and age-group. Correlation was used for convergent validity and ANOVA for concurrent validity. We found a low completion rate for both fathers' (41.7 %) and mothers' (37.5 %) occupation status, and a difference in completion rate between gender and age-groups. FAS had the highest completion rate (100 %) compared to parent's occupations status and perceived SES. The convergent validity between the SES-indicators was weak (Spearman correlation coefficient below 0.3), suggesting that the indicators measured different dimensions of SES. Both FAS and perceived SES showed a gradient in mean HRQOL between low and high SES in relation to HRQOL, this was significant only for perceived SES (p < 0.01, both age-groups). This study indicates the need for considering different approaches to measures of SES among adolescences and when evaluating SES in relation to HRQOL. Further research is needed to investigate sustainable ways to measure SES, delineating the relevance of tangible measures of education, occupation and income in relation to the perceived socioeconomic status in comparison with others in immediate social networks and in society at large.

Validation and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women.

PubMed

Abay, Halime; Kaplan, Sena

2016-04-01

There are a limited number of menopause-specific quality-of-life scales for the Turkish population. This study was conducted to evaluate the validity and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women. The study group was comprised of 250 postmenopausal women who applied to a training and research hospital's menopause clinic in Turkey. A survey form and the Turkish Utian quality-of-Life Scale were used to collect data, and the Turkish version of Short Form-36 was used to evaluate reliability with an equivalent form. Language-validity, content-validity, and construct-validity methods were used to assess the validity of the scale, and Cronbach's α coefficient calculation and the equivalent-form reliability methods were used to assess the reliability of the scale. The Turkish Utian Quality-of-Life Scale was determined to be a valid and reliable instrument for measuring the quality of life of postmenopausal women. Confirmatory factor analysis demonstrates that the instrument fits well with 23 items and a four-factor model. The Cronbach's α coefficient for the quality-of-life domains were as follows: 0.88 overall, 0.79 health, 0.78 emotional, 0.76 sexual, and 0.75 occupational. Reliability of the instrument was confirmed through significant correlations between scores on the Turkish version of the Utian Quality-of-Life Scale and the Turkish version of the Short Form-36 (r = 0.745, P < 0.001). This research emphasizes that the Turkish Utian Quality-of-Life Scale is reliable and valid in postmenopausal women-it is a useful instrument for measuring quality of life during menopause.

Artificial intelligence techniques: An efficient new approach to challenge the assessment of complex clinical fields such as airway clearance techniques in patients with cystic fibrosis?

PubMed

Slavici, Titus; Almajan, Bogdan

2013-04-01

To construct an artificial intelligence application to assist untrained physiotherapists in determining the appropriate physiotherapy exercises to improve the quality of life of patients with cystic fibrosis. A total of 42 children (21 boys and 21 girls), age range 6-18 years, participated in a clinical survey between 2001 and 2005. Data collected during the clinical survey were entered into a neural network in order to correlate the health state indicators of the patients and the type of physiotherapy exercise to be followed. Cross-validation of the network was carried out by comparing the health state indicators achieved after following a certain physiotherapy exercise and the health state indicators predicted by the network. The lifestyle and health state indicators of the survey participants improved. The network predicted the health state indicators of the participants with an accuracy of 93%. The results of the cross-validation test were within the error margins of the real-life indicators. Using data on the clinical state of individuals with cystic fibrosis, it is possible to determine the most effective type of physiotherapy exercise for improving overall health state indicators.

Cross-cultural adaptation and validation of the osteoporosis assessment questionnaire short version (OPAQ-SV) for Chinese osteoporotic fracture females.

PubMed

Zhang, Yin-Ping; Wei, Huan-Huan; Wang, Wen; Xia, Ru-Yi; Zhou, Xiao-Ling; Porr, Caroline; Lammi, Mikko

2016-04-01

The Osteoporosis Assessment Questionnaire Short Version (OPAQ-SV) was cross-culturally adapted to measure health-related quality of life in Chinese osteoporotic fracture females and then validated in China for its psychometric properties. Cross-cultural adaptation, including translation of the original OPAQ-SV into Mandarin Chinese language, was performed according to published guidelines. Validation of the newly cross-culturally adapted OPAQ-SV was conducted by sampling 234 Chinese osteoporotic fracture females and also a control group of 235 Chinese osteoporotic females without fractures, producing robust content, construct, and discriminant validation results. Major categories of reliability were also met: the Cronbach alpha coefficient was 0.975, indicating good internal consistency; the test-retest reliability was 0.80; and principal component analysis resulted in a 6-factor structure explaining 75.847 % of the total variance. Further, the Comparative Fit Index result was 0.922 following the modified model confirmatory factor analysis, and the chi-squared test was 1.98. The root mean squared error of approximation was 0.078. Moreover, significant differences were revealed between females with fractures and those without fractures across all domains (p < 0.001). Overall, the newly cross-culturally adapted OPAQ-SV appears to possess adequate validity and reliability and may be utilized in clinical trials to assess the health-related quality of life in Chinese osteoporotic fracture females.

Chinese version of Impact of Weight on Quality of Life for Kids: psychometric properties in a large school-based sample.

PubMed

He, Jinbo; Zhu, Hong; Luo, Xingwei; Cai, Taisheng; Wu, Siyao; Lu, Yao

2016-06-01

The Impact of Weight on Quality of Life for Kids (IWQOL-Kids) is the first self-report questionnaire for assessing weight-related quality of life for youth. However, there is no Chinese version of IWQOL-Kids. Thus, the objective of this research was to translate IWQOL-Kids into Mandarin and evaluate its psychometric properties in a large school-based sample. The total sample included 2282 participants aged 11-18 years old, including 1703 non-overweight, 386 overweight and 193 obese students. IWQOL-Kids was translated and culturally adapted by following the international guidelines for instrument linguistic validation procedures. The psychometric evaluation included internal consistency, test-retest reliability, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), convergent validity and discriminant validity. Cronbach's α for the Chinese version of IWQOL-Kids (IWQOL-Kids-C) was 0.956 and ranged from 0.891 to 0.927 for subscales. IWQOL-Kids-C showed a test-retest coefficient of 0.937 after 2 weeks and ranged from 0.847 to 0.903 for subscales. The original four-factor model was reproduced by EFA after seven iterations, accounting for 69.28% of the total variance. CFA demonstrated that the four-factor model had good fit indices with comparative fit index = 0.92, normed fit index = 0.91, goodness of fit index = 0.86, root mean square error of approximation = 0.07 and root mean square residual = 0.03. Convergent validity and discriminant validity were demonstrated with higher correlations between similar constructs and lower correlations between dissimilar constructs of IWQOL-Kids-C and PedsQL™ 4.0. The significant differences were found across the body mass index groups, and IWQOL-Kids-C had higher effect sizes than PedsQL™4.0 when comparing non-overweight and obese groups, supporting the sensitivity of IWQOL-Kids-C. IWQOL-Kids-C is a satisfactory, valid and reliable instrument to assess weight-related quality of life for Chinese children and adolescents aged 11-18 years old. © The Author 2015. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Clinical Decision Support System to Enhance Quality Control of Spirometry Using Information and Communication Technologies

PubMed Central

2014-01-01

Background We recently demonstrated that quality of spirometry in primary care could markedly improve with remote offline support from specialized professionals. It is hypothesized that implementation of automatic online assessment of quality of spirometry using information and communication technologies may significantly enhance the potential for extensive deployment of a high quality spirometry program in integrated care settings. Objective The objective of the study was to elaborate and validate a Clinical Decision Support System (CDSS) for automatic online quality assessment of spirometry. Methods The CDSS was done through a three step process including: (1) identification of optimal sampling frequency; (2) iterations to build-up an initial version using the 24 standard spirometry curves recommended by the American Thoracic Society; and (3) iterations to refine the CDSS using 270 curves from 90 patients. In each of these steps the results were checked against one expert. Finally, 778 spirometry curves from 291 patients were analyzed for validation purposes. Results The CDSS generated appropriate online classification and certification in 685/778 (88.1%) of spirometry testing, with 96% sensitivity and 95% specificity. Conclusions Consequently, only 93/778 (11.9%) of spirometry testing required offline remote classification by an expert, indicating a potential positive role of the CDSS in the deployment of a high quality spirometry program in an integrated care setting. PMID:25600957

[Monitoring evaluation system for high-specialty hospitals].

PubMed

Fajardo Dolci, Germán; Aguirre Gas, Héctor G; Robledo Galván, Héctor

2011-01-01

Hospital evaluation is a fundamental process to identify medical units' objective compliance, to analyze efficiency of resource use and allocation, institutional values and mission alignment, patient safety and quality standards, contributions to research and medical education, and the degree of coordination among medical units and the health system as a whole. We propose an evaluation system for highly specialized regional hospitals through the monitoring of performance indicators. The following are established as base thematic elements in the construction of indicators: safe facilities and equipment, financial situation, human resources management, policy management, organizational climate, clinical activity, quality and patient safety, continuity of care, patients' and providers' rights and obligations, teaching, research, social responsibility, coordination mechanisms. Monitoring refers to the planned and systematic evaluation of valid and reliable indicators, aimed at identifying problems and opportunity areas. Moreover, evaluation is a powerful tool to strengthen decision-making and accountability in medical units.

The Quality of Rare Disease Registries: Evaluation and Characterization.

PubMed

Coi, Alessio; Santoro, Michele; Villaverde-Hueso, Ana; Lipucci Di Paola, Michele; Gainotti, Sabina; Taruscio, Domenica; Posada de la Paz, Manuel; Bianchi, Fabrizio

2016-01-01

The focus on the quality of the procedures for data collection, storing, and analysis in the definition and implementation of a rare disease registry (RDR) is the basis for developing a valid and long-term sustainable tool. The aim of this study was to provide useful information for characterizing a quality profile for RDRs using an analytical approach applied to RDRs participating in the European Platform for Rare Disease Registries 2011-2014 (EPIRARE) survey. An indicator of quality was defined by choosing a small set of quality-related variables derived from the survey. The random forest method was used to identify the variables best defining a quality profile for RDRs. Fisher's exact test was employed to assess the association with the indicator of quality, and the Cochran-Armitage test was used to check the presence of a linear trend along different levels of quality. The set of variables found to characterize high-quality RDRs focused on ethical and legal issues, governance, communication of activities and results, established procedures to regulate access to data and security, and established plans to ensure long-term sustainability. The quality of RDRs is usually associated with a good oversight and governance mechanism and with durable funding. The results suggest that RDRs would benefit from support in management, information technology, epidemiology, and statistics. © 2016 S. Karger AG, Basel.

Psychometric characteristics of the Functional Assessment of Cancer Therapy-General when applied to Brazilian cancer patients: a cross-cultural adaptation and validation.

PubMed

Campos, Juliana Alvares Duarte Bonini; Spexoto, Maria Cláudia Bernardes; Serrano, Sergio Vicente; Maroco, João

2016-01-13

The psychometric properties of an instrument should be evaluated routinely when using different samples. This study evaluated the psychometric properties of the Functional Assessment of Cancer Therapy-General (FACT-G) when applied to a sample of Brazilian cancer patients. The face, content, and construct (factorial, convergent, and discriminant) validities of the FACT-G were estimated. Confirmatory factor analysis (CFA) was conducted the ratio chi-square by degrees of freedom (χ (2)/df), the comparative fit index (CFI), the Tucker-Lewis index (TLI), and the root mean square error of approximation (RMSEA) as indices. The invariance of the best model was assessed with multi-group analysis using the difference of chi-squares method (Δχ(2)). Convergent validity was assessed using Average Variance Extracted (AVE) and discriminant validity was determined via correlational analysis. Internal consistency was assessed using the Cronbach's alpha (α) coefficient, and the Composite Reliability (CR) was estimated. A total of 975 cancer patients participated in the study, with a mean age of 53.3 (SD = 13.0) years. Of these participants, 61.5 % were women. In CFA, five correlations between errors were included to fit the FACT-G to the sample (χ (2)/df = 8.611, CFI = .913, TLI = .902, RMSEA = .088). The model did not indicate invariant independent samples (Δχ(2): μ: p < .001, i: p < .958, Cov: p < .001, Res: p < .001). While there was adequate convergent validity for the physical well-being (AVE = .54) and social and family Well-being factors (AVE = .55), there was low convergent validity for the other factors. Reliability was adequate (CR = .76-.89 and α = .71-.82). Functional well-being, emotional well-being, and physical well-being were the factors that demonstrated a strong contribution to patients' health-related quality of life (β = -.99, .88, and .64, respectively). The FACT-G was found to be a valid and reliable assessment of health-related quality of life in a Brazilian sample of patients with cancer.

Hospital quality of care: does information technology matter? The relationship between information technology adoption and quality of care.

PubMed

Menachemi, Nir; Chukmaitov, Askar; Saunders, Charles; Brooks, Robert G

2008-01-01

Hospitals have been slow to adopt information technology (IT) largely because of a lack of generalizable evidence of the value associated with such adoption. To explore the relationship between IT adoption and quality of care in acute-care hospitals. Primary data on hospital IT adoption were combined with secondary hospital discharge data. Regression analyses were used to examine the relationship between various measures of IT adoption and several quality indicators after controlling for confounders. Adoption of IT was measured using a previously validated method that considers clinical, administrative, and strategic IT capabilities of acute-care hospitals. Quality measures included the Inpatient Quality Indicators developed by the Agency for Healthcare Research and Quality. Data from 98 hospitals were available for analyses. Hospitals adopted an average of 11.3 (45.2%) clinical IT applications, 15.7 (74.8%) administrative IT applications, and 5 (50%) strategic IT applications. In multivariate regression analyses, hospitals that adopted a greater number of IT applications were significantly more likely to have desirable quality outcomes on seven Inpatient Quality Indicator measures, including risk-adjusted mortality from percutaneous transluminal coronary angioplasty, gastrointestinal hemorrhage, and acute myocardial infarction. An increase in clinical IT applications was also inversely correlated with utilization of incidental appendectomy, and an increase in the adoption of strategic IT applications was inversely correlated with risk-adjusted mortality from craniotomy and laparoscopic cholecystectomy. Hospital adoption of IT is associated with desirable quality outcomes across hospitals in Florida. These findings will assist hospital leaders interested in understanding better the effect of costly IT adoption on quality of care in their institutions.

[Evaluation of the quality of care of transient tachypnea in newborns affiliated with the Medical Insurance Siglo XXI program].

PubMed

Pérez-Cuevas, Ricardo; Jasso Gutiérrez, Luis; Doubova, Svetlana; Flores Hernández, Sergio; Mantilla Trollé, Clara; González Guerra, Eduardo; Muñoz Hernández, Onofre

Evaluation of the quality of care of the newborn with complications is an indispensable element for the improvement of strategies directed to reduce newborn mortality rates. The aim of this work was to evaluate the quality of technical and interpersonal care in the management of transient tachypnea of the newborn (TTN) of patients affiliated with the program "Medical Insurance Siglo XXI". A cross-sectional study was conducted in 61 hospitals affiliated with the Health Ministry with at least two cases of TTN during the first semester of 2011. Variables such as mother's health, pregnancy, birth and birth complication characteristics were analyzed. Also, newborn interventions and health conditions upon discharge were included. To measure the quality of care according to prevention, diagnosis and treatment, quality indicators were defined and validated. We analyzed 256 case files with a diagnosis of TTN; 8.9% of the mothers presented risk factors (asthma, diabetes) and 53.5% had complications during pregnancy. There were 60% of cases with TTN born by cesarean delivery; one third of these children had low birth weight and 14% were transferred to another hospital. As for the quality indicators in the area of prevention, more than 90% of risk factors (smoking, asthma, cesarean delivery) were identified. Diagnostic indicators showed that 86-98% of respiratory distress symptoms were sought. Indicators of treatment achieved satisfactory figures for monitoring and support measures. Prevention, diagnosis and treatment indicators made it possible to consider that most TTN cases received appropriate treatment. It is advisable to develop effective strategies to prevent TTN, such as increasing efforts to reduce the increasing rates of cesarean deliveries. Copyright © 2014 Hospital Infantil de México Federico Gómez. Publicado por Masson Doyma México S.A. All rights reserved.

Evaluating the quality of a cell counting measurement process via a dilution series experimental design.

PubMed

Sarkar, Sumona; Lund, Steven P; Vyzasatya, Ravi; Vanguri, Padmavathy; Elliott, John T; Plant, Anne L; Lin-Gibson, Sheng

2017-12-01

Cell counting measurements are critical in the research, development and manufacturing of cell-based products, yet determining cell quantity with accuracy and precision remains a challenge. Validating and evaluating a cell counting measurement process can be difficult because of the lack of appropriate reference material. Here we describe an experimental design and statistical analysis approach to evaluate the quality of a cell counting measurement process in the absence of appropriate reference materials or reference methods. The experimental design is based on a dilution series study with replicate samples and observations as well as measurement process controls. The statistical analysis evaluates the precision and proportionality of the cell counting measurement process and can be used to compare the quality of two or more counting methods. As an illustration of this approach, cell counting measurement processes (automated and manual methods) were compared for a human mesenchymal stromal cell (hMSC) preparation. For the hMSC preparation investigated, results indicated that the automated method performed better than the manual counting methods in terms of precision and proportionality. By conducting well controlled dilution series experimental designs coupled with appropriate statistical analysis, quantitative indicators of repeatability and proportionality can be calculated to provide an assessment of cell counting measurement quality. This approach does not rely on the use of a reference material or comparison to "gold standard" methods known to have limited assurance of accuracy and precision. The approach presented here may help the selection, optimization, and/or validation of a cell counting measurement process. Published by Elsevier Inc.

The Birth Satisfaction Scale-Revised Indicator (BSS-RI).

PubMed

Martin, Colin R; Hollins Martin, Caroline; Redshaw, Maggie

2017-08-29

The current study sought to develop a short birth satisfaction indicator utilising items from the Birth Satisfaction Scale-Revised (BSS-R) for use as a brief measure of birth satisfaction and as a possible key performance indicator for perinatal service delivery evaluation. Building on the recently developed BSS-R, the study aimed to develop a simplified version of the instrument to assess birth satisfaction easily that could work as a short evaluative measure of clinical service delivery for labour and birth that is consistent with policy documents, placing women at the centre of the birth experience. The six item Birth Satisfaction Scale-Revised Indicator (BSS-RI) was embedded within the 2014 National Maternity Survey for England. A random selection of mothers who had given birth in a two week period in England were surveyed three months after the birth. Using a two-stage design and split-half dataset, exploratory factor analysis, confirmatory factor analysis, internal consistency, convergent, divergent and known-groups discriminant validity evaluation were conducted in a secondary analysis of the survey data. Using this large population based survey of recent mothers the short revised measure was found to comprise two distinct domains of birth satisfaction, 'stress and emotional response to labour and birth' and 'quality of care'. The psychometric qualities of the tool were robust as were the indices of validity and reliability evaluated. The BSS-RI represents a short easily administered and scored measure of women's satisfaction with care and the experience of labour and birth. The instrument is potentially useful for researchers, service evaluation and policy makers.

Relationships between In-Course Alignment Indicators and Post-Course Criteria of Quality Teaching and Learning in Higher Education.

ERIC Educational Resources Information Center

Bastick, Tony

The research literature on student evaluation of teaching (SET) is filled with criticisms of the process, its applications, and the student feedback questionnaire it uses. SETs are still used, however, because there has seemed to be no economical, valid, and reliable alternative. This paper reports on an alternative alignment process for…

Adiposity, compared with masculinity, serves as a more valid cue to immunocompetence in human mate choice

PubMed Central

Rantala, Markus J.; Coetzee, Vinet; Moore, Fhionna R.; Skrinda, Ilona; Kecko, Sanita; Krama, Tatjana; Kivleniece, Inese; Krams, Indrikis

2013-01-01

According to the ‘good genes’ hypothesis, females choose males based on traits that indicate the male's genetic quality in terms of disease resistance. The ‘immunocompetence handicap hypothesis’ proposed that secondary sexual traits serve as indicators of male genetic quality, because they indicate that males can contend with the immunosuppressive effects of testosterone. Masculinity is commonly assumed to serve as such a secondary sexual trait. Yet, women do not consistently prefer masculine looking men, nor is masculinity consistently related to health across studies. Here, we show that adiposity, but not masculinity, significantly mediates the relationship between a direct measure of immune response (hepatitis B antibody response) and attractiveness for both body and facial measurements. In addition, we show that circulating testosterone is more closely associated with adiposity than masculinity. These findings indicate that adiposity, compared with masculinity, serves as a more important cue to immunocompetence in female mate choice. PMID:23193134

The relationship between external and internal validity of randomized controlled trials: A sample of hypertension trials from China.

PubMed

Zhang, Xin; Wu, Yuxia; Ren, Pengwei; Liu, Xueting; Kang, Deying

2015-10-30

To explore the relationship between the external validity and the internal validity of hypertension RCTs conducted in China. Comprehensive literature searches were performed in Medline, Embase, Cochrane Central Register of Controlled Trials (CCTR), CBMdisc (Chinese biomedical literature database), CNKI (China National Knowledge Infrastructure/China Academic Journals Full-text Database) and VIP (Chinese scientific journals database) as well as advanced search strategies were used to locate hypertension RCTs. The risk of bias in RCTs was assessed by a modified scale, Jadad scale respectively, and then studies with 3 or more grading scores were included for the purpose of evaluating of external validity. A data extract form including 4 domains and 25 items was used to explore relationship of the external validity and the internal validity. Statistic analyses were performed by using SPSS software, version 21.0 (SPSS, Chicago, IL). 226 hypertension RCTs were included for final analysis. RCTs conducted in university affiliated hospitals (P < 0.001) or secondary/tertiary hospitals (P < 0.001) were scored at higher internal validity. Multi-center studies (median = 4.0, IQR = 2.0) were scored higher internal validity score than single-center studies (median = 3.0, IQR = 1.0) (P < 0.001). Funding-supported trials had better methodological quality (P < 0.001). In addition, the reporting of inclusion criteria also leads to better internal validity (P = 0.004). Multivariate regression indicated sample size, industry-funding, quality of life (QOL) taken as measure and the university affiliated hospital as trial setting had statistical significance (P < 0.001, P < 0.001, P = 0.001, P = 0.006 respectively). Several components relate to the external validity of RCTs do associate with the internal validity, that do not stand in an easy relationship to each other. Regarding the poor reporting, other possible links between two variables need to trace in the future methodological researches.

Lack of evidence and standardization in care pathway documents for patients with ST-elevated myocardial infarction.

PubMed

Aeyels, Daan; Van Vugt, Stijn; Sinnaeve, Peter R; Panella, Massimiliano; Van Zelm, Ruben; Sermeus, Walter; Vanhaecht, Kris

2016-04-01

Clinical practice variation and the subsequent burden on health care quality has been documented for patients with ST-elevated myocardial infarction (STEMI). Reduction of clinical practice variation is possible by increasing guideline adherence. Care pathway documents can increase guideline adherence by implementing evidence-based key interventions and quality indicators in daily practice. This study aims to examine guideline adherence of care pathway documents for patients with STEMI. Lay-out, size and timeframe of submitted care pathways documents were analysed. Two independent reviewers used a checklist to systematically assess the guideline adherence of care pathway documents. The checklist comprised a set of key interventions and quality indicators extracted from evidence and international guidelines. The checklist distinguished the evidence level for each item and was validated by expert consensus. Results were verified by inviting participating hospitals to provide feedback. Fifteen out of 25 invited hospitals submitted care pathway documents for STEMI. The care pathway documents differed in timeframe, lay-out and size. Analysis of the care pathway documents showed important variation in formalizing adherence to evidence: between hospitals, inclusion of 24 key interventions in care pathway documents varied from 13 to 97%. Inclusion of 11 essential quality indicators varied from 0 to 40%. Care pathway documents for patients with STEMI differ considerably in lay-out, timeframe and size. This study showed variation in, and suboptimal inclusion of, evidence-based key interventions and quality indicators in care pathway documents. The use of these care pathway documents might result in suboptimal quality of care for STEMI patients. © The European Society of Cardiology 2015.

A Compound Sensor for Simultaneous Measurement of Packing Density and Moisture Content of Silage.

PubMed

Meng, Delun; Meng, Fanjia; Sun, Wei; Deng, Shuang

2017-12-28

Packing density and moisture content are important factors in investigating the ensiling quality. Low packing density is a major cause of loss of sugar content. The moisture content also plays a determinant role in biomass degradation. To comprehensively evaluate the ensiling quality, this study focused on developing a compound sensor. In it, moisture electrodes and strain gauges were embedded into an ASABE Standard small cone for the simultaneous measurements of the penetration resistance (PR) and moisture content (MC) of silage. In order to evaluate the performance of the designed sensor and the theoretical analysis being used, relevant calibration and validation tests were conducted. The determination coefficients are 0.996 and 0.992 for PR calibration and 0.934 for MC calibration. The validation indicated that this measurement technique could determine the packing density and moisture content of the silage simultaneously and eliminate the influence of the friction between the penetration shaft and silage. In this study, we not only design a compound sensor but also provide an alternative way to investigate the ensiling quality which would be useful for further silage research.

Dysphagia-related quality of life in oculopharyngeal muscular dystrophy: Psychometric properties of the SWAL-QOL instrument.

PubMed

Youssof, Sarah; Romero-Clark, Carol; Warner, Teddy; Plowman, Emily

2017-07-01

The Swallowing Quality of Life instrument (SWAL-QOL) is a patient-reported outcome measure of swallowing-related quality of life (SR-QoL). Its psychometric properties in oculopharyngeal muscular dystrophy (OPMD) are not known. We administered the SWAL-QOL to U.S. OPMD Registry participants. We described SR-QoL profiles and assessed reliability and validity. The mean composite score in 113 individuals with OPMD was 54.4 ± 20.7, indicating moderate impairment. Severe impairments were observed in eating duration, burden, and fatigue scales. Internal consistency reliability of all scales was found to be satisfactory, and 9 of 10 scales demonstrated adequate test-retest reliability. Data confirmed 86% of hypotheses, supporting construct validity. The SWAL-QOL limitations in OPMD include: floor/ceiling effects in 7 of 10 scales and low specificity of sleep, fatigue, and communication scales for dysphagia. SR-QoL is reduced in OPMD. Given several limitations of the SWAL-QOL, development of an improved dysphagia-specific QoL instrument for OPMD is warranted. Muscle Nerve 56: 28-35, 2017. © 2016 Wiley Periodicals, Inc.

A comprehensive clinical assessment tool to inform policy and practice: applications of the minimum data set.

PubMed

Mor, Vincent

2004-04-01

The Minimum Data Set (MDS) for nursing home (NH) resident assessment, designed to assess elders functional status and care needs, exemplifies how the information needs of clinical practice are congruent with those of research. Building on a review of the published literature, this article describes the development of the MDS, its reliability and validity testing, as well as the variety of different policy and research uses to which it has been applied. Interrater reliability of items and internal consistency of MDS summary scales is generally good to excellent. Validation studies reveal good correspondence to research quality instruments for cognition, activities of daily living, and diagnoses with more variable results for vision, pain, mood, and behavior scales. To date, no consistent evidence suggests that applications of MDS data for case-mix reimbursement and quality indicator monitoring systematically bias the data. Although facility variation in data quality could compromise some applications, creation of the MDS as a clinical tool for care planning provides an example of how assessment tools with clinical use can be used in administrative databases for research and policy applications.

[Pay for performance in dental care: A systematic narrative review of quality P4P models in dental care].

PubMed

Chenot, Regine

2017-11-01

Pay for performance (P4P) links reimbursement to the achievement of quality objectives. Experiences with P4P instruments and studies on their effects are available for the inpatient sector. A systematic narrative review brings together findings concerning the use and the effects of P4P, especially in dental care. A systematic literature search in PubMed and the Cochrane Library for reimbursement models using quality indicators provided 77 publications. Inclusion criteria were: year of publication not older than 2007, dental sector, models of quality-oriented remuneration, quality of care, quality indicators. 27 publications met the inclusion criteria and were evaluated with regard to the instruments and effects of P4P. The database search was supplemented by a free search on the Internet as well as a search in indicator databases and portals. The results of the included studies were extracted and summarized narratively. 27 studies were included in the review. Performance-oriented remuneration is an instrument of quality competition. In principle, P4P is embedded in an existing remuneration system, i.e., it does not occur in isolation. In the United States, England and Scandinavia, models are currently being tested for quality-oriented remuneration in dental care, based on quality indicators. The studies identified by the literature search are very heterogeneous and do not yield comparable endpoints. Difficulties are seen in the reproducibility of the quality of dental care with regard to certain characteristics which still have to be defined as quality-promoting properties. Risk selection cannot be ruled out, which may have an impact on structural quality (access to care, coordination). There were no long-term effects of P4P on the quality of care. In the short and medium term, adverse effects on the participants' motivation as well as shifting effects towards the private sector are described. A prerequisite for the functioning of P4P is the definition of clear targets and measuring parameters. Furthermore, evidence-based quality indicators have to be developed that validly depict quality differences. It is yet unknown whether P4P will have long-term effects or whether the quality of dental care will increase. Copyright © 2017. Published by Elsevier GmbH.

Physician level reporting of surgical and pathology performance indicators: a regional study to assess feasibility and impact on quality.

PubMed

McFadyen, Craig; Lankshear, Sara; Divaris, Dimitrios; Berry, Mark; Hunter, Amber; Srigley, John; Irish, Jonathan

2015-02-01

There is increased awareness that, to minimize variation in clinician practice and improve quality, performance reporting should be implemented at the provider level. This optimizes physician engagement and creates a sense of professional responsibility for quality and performance measurement at the individual and organizational levels. Individual provider level reporting was implemented within a provincial health region involving 56 clinicians (general surgeons, surgical oncologists, urologists and pathologists). The 2 surgical pathology indicators chosen were colorectal cancer (CRC) lymph node retrieval rate and pT2 prostate cancer margin positivity rate. Surgical resections for all prostate and colorectal cancer performed between Jan. 1, 2011, and Mar. 30, 2012, were included. We used a pre- and postsurvey design to obtain physician perceptions and focus groups with program leadership to determine organizational impact. Survey results showed that respondents felt the data provided in the reports were valid (67%), consistent with expectations (70%), maintained confidentiality (80%) and were not used in a punitive manner (77%). During the study period the pT2 prostate margin positivity rate decreased from 57.1% to 27.5%. For the CRC lymph node retrieval rate indicator, high baseline performance was maintained. We developed a robust process for providing physicians with confidential, individualized surgical and pathology quality indicator reports. Our results reinforce the importance of individual physician feedback as a strategy for improving and sustaining quality in surgical and diagnostic oncology.

Development of Evaluation Indicators for Hospice and Palliative Care Professionals Training Programs in Korea.

PubMed

Kang, Jina; Park, Kyoung-Ok

2017-01-01

The importance of training for Hospice and Palliative Care (HPC) professionals has been increasing with the systemization of HPC in Korea. Hence, the need and importance of training quality for HPC professionals are growing. This study evaluated the construct validity and reliability of the Evaluation Indicators for standard Hospice and Palliative Care Training (EIHPCT) program. As a framework to develop evaluation indicators, an invented theoretical model combining Stufflebeam's CIPP (Context-Input-Process-Product) evaluation model with PRECEDE-PROCEED model was used. To verify the construct validity of the EIHPCT program, a structured survey was performed with 169 professionals who were the HPC training program administrators, trainers, and trainees. To examine the validity of the areas of the EIHPCT program, exploratory factor analysis and confirmatory factor analysis were conducted. First, in the exploratory factor analysis, the indicators with factor loadings above 0.4 were chosen as desirable items, and some cross-loaded items that loaded at 0.4 or higher on two or more factors were adjusted as the higher factor. Second, the model fit of the modified EIHPCT program was quite good in the confirmatory factor analysis (Goodness-of-Fit Index > 0.70, Comparative Fit Index > 0.80, Normed Fit Index > 0.80, Root Mean square of Residuals < 0.05). The modified model of the EIHPCT comprised 4 areas, 13 subdomains, and 61 indicators. The evaluation indicators of the modified model will be valuable references for improving the HPC professional training program.

Data Validation & Laboratory Quality Assurance for Region 9

EPA Pesticide Factsheets

In all hazardous site investigations it is essential to know the quality of the data used for decision-making purposes. Validation of data requires that appropriate quality assurance and quality control (QA/QC) procedures be followed.

[Reliability and validity of Professional Quality of Life Scale among government staff in earthquake - stricken areas in China].

PubMed

Dang, Weimin; Cheng, Wenhong; Ma, Hong; Lin, Jin; Wu, Baoming; Ma, Ning; Wang, Rongke; Xu, Junting; Zhou, Tianhang; Yu, Xin

2015-06-01

To evaluate the reliability and validity of Professional Quality of Life Scale (ProQOL-30, 4th version, 30 items) among government staff in the Wenchuan earthquake-stricken areas A total of 1,175 members of government staff in the Wenchuan earthquake-stricken areas were selected by convenience sampling and required to complete the ProQOL and Self-Reporting Questionnair (SRQ). The reliability and validity of the scale was evaluated by correlation analysis, t-test, and confirmatory factor analysis. Item-total correlation coefficients of the three subscales were 0.590 - 0.752, 0.389 - 0.603, and 0.340 - 0.647, respectively (P<0.05), and the average coefficients were 0.672, 0.482, and 0.555 respectively (P<0.05). The Cronbach's α coefficients of the three subscales were 0.864, 0.569, and 0.742 respectively, and the split-half reliabilities were 0.829, 0.490, and 0.677, respectively. P value was 0.88 in thE chi-square test of confirmatory factor analysis model. Goodness-of-fit indices of ProQOL-30 included GFI=0.895 NFI=0.856, CFI=0.895, RMSEA=0.063, and AGFI=0.912. For the ProQOL-28 as an optimized version o ProQOL-30, the Cronbach's a coefficients for burnout and trauma/compassion fatigue increased to 0.616 and 0.757, respectively. P value was 0.91 in the chi-square test of confirmatory factor analysis model test. Goodness-of-fit indices of ProQOL-28 were GFI =0.913, AGFI =0.924, NFI =0.900, CFI =0.913, and RMSEA =0.031 CONCLUSION: ProQOL-28 has good reliability and validity among government staff in the earthquake-stricker areas in China.

Automated characterization of perceptual quality of clinical chest radiographs: Validation and calibration to observer preference

DOE Office of Scientific and Technical Information (OSTI.GOV)

Samei, Ehsan, E-mail: samei@duke.edu; Lin, Yuan; Choudhury, Kingshuk R.

Purpose: The authors previously proposed an image-based technique [Y. Lin et al. Med. Phys. 39, 7019–7031 (2012)] to assess the perceptual quality of clinical chest radiographs. In this study, an observer study was designed and conducted to validate the output of the program against rankings by expert radiologists and to establish the ranges of the output values that reflect the acceptable image appearance so the program output can be used for image quality optimization and tracking. Methods: Using an IRB-approved protocol, 2500 clinical chest radiographs (PA/AP) were collected from our clinical operation. The images were processed through our perceptual qualitymore » assessment program to measure their appearance in terms of ten metrics of perceptual image quality: lung gray level, lung detail, lung noise, rib–lung contrast, rib sharpness, mediastinum detail, mediastinum noise, mediastinum alignment, subdiaphragm–lung contrast, and subdiaphragm area. From the results, for each targeted appearance attribute/metric, 18 images were selected such that the images presented a relatively constant appearance with respect to all metrics except the targeted one. The images were then incorporated into a graphical user interface, which displayed them into three panels of six in a random order. Using a DICOM calibrated diagnostic display workstation and under low ambient lighting conditions, each of five participating attending chest radiologists was tasked to spatially order the images based only on the targeted appearance attribute regardless of the other qualities. Once ordered, the observer also indicated the range of image appearances that he/she considered clinically acceptable. The observer data were analyzed in terms of the correlations between the observer and algorithmic rankings and interobserver variability. An observer-averaged acceptable image appearance was also statistically derived for each quality attribute based on the collected individual acceptable ranges. Results: The observer study indicated that, for each image quality attribute, the averaged observer ranking strongly correlated with the algorithmic ranking (linear correlation coefficient R > 0.92), with highest correlation (R = 1) for lung gray level and the lowest (R = 0.92) for mediastinum noise. There was a strong concordance between the observers in terms of their rankings (i.e., Kendall’s tau agreement > 0.84). The observers also generally indicated similar tolerance and preference levels in terms of acceptable ranges, as 85% of the values were close to the overall tolerance or preference levels and the differences were smaller than 0.15. Conclusions: The observer study indicates that the previously proposed technique provides a robust reflection of the perceptual image quality in clinical images. The results established the range of algorithmic outputs for each metric that can be used to quantitatively assess and qualify the appearance quality of clinical chest radiographs.« less

Weighted-MSE based on saliency map for assessing video quality of H.264 video streams

NASA Astrophysics Data System (ADS)

Boujut, H.; Benois-Pineau, J.; Hadar, O.; Ahmed, T.; Bonnet, P.

2011-01-01

Human vision system is very complex and has been studied for many years specifically for purposes of efficient encoding of visual, e.g. video content from digital TV. There have been physiological and psychological evidences which indicate that viewers do not pay equal attention to all exposed visual information, but only focus on certain areas known as focus of attention (FOA) or saliency regions. In this work, we propose a novel based objective quality assessment metric, for assessing the perceptual quality of decoded video sequences affected by transmission errors and packed loses. The proposed method weights the Mean Square Error (MSE), Weighted-MSE (WMSE), according to the calculated saliency map at each pixel. Our method was validated trough subjective quality experiments.

A systematic review of reliable and valid tools for the measurement of patient participation in healthcare.

PubMed

Phillips, Nicole Margaret; Street, Maryann; Haesler, Emily

2016-02-01

Patient participation in healthcare is recognised internationally as essential for consumer-centric, high-quality healthcare delivery. Its measurement as part of continuous quality improvement requires development of agreed standards and measurable indicators. This systematic review sought to identify strategies to measure patient participation in healthcare and to report their reliability and validity. In the context of this review, patient participation was constructed as shared decision-making, acknowledging the patient as having critical knowledge regarding their own health and care needs and promoting self-care/autonomy. Following a comprehensive search, studies reporting reliability or validity of an instrument used in a healthcare setting to measure patient participation, published in English between January 2004 and March 2014 were eligible for inclusion. From an initial search, which identified 1582 studies, 156 studies were retrieved and screened against inclusion criteria. Thirty-three studies reporting 24 patient participation measurement tools met inclusion criteria, and were critically appraised. The majority of studies were descriptive psychometric studies using prospective, cross-sectional designs. Almost all the tools completed by patients, family caregivers, observers or more than one stakeholder focused on aspects of patient-professional communication. Few tools designed for completion by patients or family caregivers provided valid and reliable measures of patient participation. There was low correlation between many of the tools and other measures of patient satisfaction. Few reliable and valid tools for measurement of patient participation in healthcare have been recently developed. Of those reported in this review, the dyadic Observing Patient Involvement in Decision Making (dyadic-OPTION) tool presents the most promise for measuring core components of patient participation. There remains a need for further study into valid, reliable and feasible strategies for measuring patient participation as part of continuous quality improvement. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Psychometric Validation of the Traditional Chinese Version of the Early Onset Scoliosis-24 Item Questionnaire (EOSQ-24).

PubMed

Cheung, Jason Pui Yin; Cheung, Prudence Wing Hang; Wong, Carlos King Ho; Samartzis, Dino; Luk, Keith Dip-Kei; Lam, Cindy Lo Kuen; Cheung, Kenneth Man Chee

2016-12-15

Questionnaire translation and validation. The aim of this study was to translate and cross-culturally adapt the Early Onset Scoliosis-24 item Questionnaire (EOSQ-24) into traditional Chinese, and to assess its validity, reliability, and sensitivity in Southern-Chinese patients diagnosed with early onset scoliosis (EOS). Relying on radiographs alone for assessing treatment outcomes in EOS patients is inadequate. To properly gauge health-related quality of life, a disease-specific instrument that assesses patient quality of life and the burden of primary caregivers is necessary. The EOSQ-24 was created for this purpose, but it has not been adapted to the Chinese language. The translation and cross-cultural adaptation of the original English EOSQ-24 were performed using the method of double forward and single backward translations, followed by a panel review. EOS patients of Southern-Chinese descent were recruited, via convenience sampling from a scoliosis specialty clinic. These patients' parents/caretakers were then administered the traditional Chinese EOSQ-24, Likert Scale regarding the understanding of completed EOSQ-24, and the Child Health Questionnaire Parent Form 50 (CHQ-PF50) (Traditional Chinese). Reliability was analyzed using Cronbach alpha. Construct validity of domains and subdomains was assessed using Spearman correlation test against CHQ-PF50 domains with similar constructs. Sensitivity of the EOSQ-24 scores was determined by performing known group comparisons. A total of 100 EOS patients were recruited. A very good reliability was demonstrated (Cronbach α: 0.896) and internal consistency of all domains was excellent (Cronbach α: 0.829-0.919). Subdomain scores of EOSQ-24 and CHQ-PF50 had significant correlations (P < 0.001), indicating a good construct validity. This is the first psychometric study to translate and adapt the EOSQ-24 questionnaire for Chinese EOS patients and it has been found to have satisfactory validity, reliability, and sensitivity. It is a useful disease-specific instrument for assessing patients' quality of life and the burden of caregivers. 2.

Invited review: Animal-based indicators for on-farm welfare assessment for dairy goats.

PubMed

Battini, M; Vieira, A; Barbieri, S; Ajuda, I; Stilwell, G; Mattiello, S

2014-11-01

This paper reviews animal-based welfare indicators to develop a valid, reliable, and feasible on-farm welfare assessment protocol for dairy goats. The indicators were considered in the light of the 4 accepted principles (good feeding, good housing, good health, appropriate behavior) subdivided into 12 criteria developed by the European Welfare Quality program. We will only examine the practical indicators to be used on-farm, excluding those requiring the use of specific instruments or laboratory analysis and those that are recorded at the slaughterhouse. Body condition score, hair coat condition, and queuing at the feed barrier or at the drinker seem the most promising indicators for the assessment of the "good feeding" principle. As to "good housing," some indicators were considered promising for assessing "comfort around resting" (e.g., resting in contact with a wall) or "thermal comfort" (e.g., panting score for the detection of heat stress and shivering score for the detection of cold stress). Several indicators related to "good health," such as lameness, claw overgrowth, presence of external abscesses, and hair coat condition, were identified. As to the "appropriate behavior" principle, different criteria have been identified: agonistic behavior is largely used as the "expression of social behavior" criterion, but it is often not feasible for on-farm assessment. Latency to first contact and the avoidance distance test can be used as criteria for assessing the quality of the human-animal relationship. Qualitative behavior assessment seems to be a promising indicator for addressing the "positive emotional state" criterion. Promising indicators were identified for most of the considered criteria; however, no valid indicator has been identified for "expression of other behaviors." Interobserver reliability has rarely been assessed and warrants further attention; in contrast, short-term intraobserver reliability is frequently assessed and some studies consider mid- and long-term reliability. The feasibility of most of the reviewed indicators in commercial farms still needs to be carefully evaluated, as several studies were performed under experimental conditions. Our review highlights some aspects of goat welfare that have been widely studied, but some indicators need to be investigated further and drafted before being included in a valid, reliable, and feasible welfare assessment protocol. The indicators selected and examined may be an invaluable starting point for the development of an on-farm welfare assessment protocol for dairy goats. Copyright © 2014 American Dairy Science Association. Published by Elsevier Inc. All rights reserved.

Development and validation of a vision-specific quality-of-life questionnaire for Timor-Leste.

PubMed

du Toit, Rènée; Palagyi, Anna; Ramke, Jacqueline; Brian, Garry; Lamoureux, Ecosse L

2008-10-01

To develop and determine the reliability and validity of a vision-specific quality-of-life instrument (TL-VSQOL) designed to assess the impact of distance and near vision impairment in adults living in Timor-Leste. A vision-specific quality-of-life questionnaire was developed, piloted, and administered to 704 Timorese aged >or=40 years during a population-based eye health rapid assessment. Rasch analysis was performed on the data of 457 participants with presenting near vision worse than N8 (78.5%) and/or distance vision worse than 6/18 (69.8%). Unidimensionality, item fit to the model, response category performance, differential item functioning, and targeting of items to participants were assessed. Initially, the questionnaire lacked fit to the Rasch model. Removal of two items concerning emotional well-being resulted in a fit of the data (overall item-trait interaction: chi(2) (df) = 81 (51); mean (SD) person and item fit residual values: -0.30 (1.02) and -0.32 (1.46), and good targeting of person ability and item difficulty was evident. Poorer distance and near visual acuities were significantly associated with worse quality-of-life scores (P < 0.001). Person separation reliability was substantial (0.93), indicating that the instrument can discriminate between groups with normal and impaired vision. All 17 items were free of differential item functioning, and there was no evidence of multidimensionality. This 17-item TL-VSQOL has high reliability, construct, and criterion validity and effective targeting. It can effectively assess the impact on quality of life of adult Timorese with distance and near vision impairment. The TL-VSQOL could be adapted for use in other low-resource settings.

RhinAsthma patient perspective: A Rasch validation study.

PubMed

Molinengo, Giorgia; Baiardini, Ilaria; Braido, Fulvio; Loera, Barbara

2018-02-01

In daily practice, Health-Related Quality of Life (HRQoL) tools are useful for supplementing clinical data with the patient's perspective. To encourage their use by clinicians, the availability of tools that can quickly provide valid results is crucial. A new HRQoL tool has been proposed for patients with asthma and rhinitis: the RhinAsthma Patient Perspective-RAPP. The aim of this study was to evaluate the psychometric robustness of the RAPP using the Item Response Theory (IRT) approach, to evaluate the scalability of items and test whether or not patients use the items response scale correctly. 155 patients (53.5% women, mean age 39.1, range 16-76) were recruited during a multicenter study. RAPP metric properties were investigated using IRT models. Differential item functioning (DIF) was used for gender, age, and asthma control test (ACT). The RAPP adequately fitted the Rating Scale model, demonstrating the equality of the rating scale structure for all items. All statistics on items were satisfactory. The RAPP had adequate internal reliability and showed good ability to discriminate among different groups of participants. DIF analysis indicated that there were no differential item functioning issues for gender. One item showed a DIF by age and four items by ACT. The psychometric evaluation performed using IRT models demonstrated that the RAPP met all the criteria to be considered a reliable and valid method of measurement. From a clinical perspective, this will allow physicians to confidently interpret scores as good indicators of Quality of Life of patients with asthma.

A poverty-related quality of life questionnaire can help to detect health inequalities in emergency departments.

PubMed

Boyer, Laurent; Baumstarck, Karine; Iordanova, Teodora; Fernandez, Jessica; Jean, Philippe; Auquier, Pascal

2014-03-01

This study aimed to develop a self-administered, multidimensional, poverty-related quality of life (PQoL) questionnaire for individuals seeking care in emergency departments (EDs): the PQoL-17. The development of the PQoL was undertaken in three steps: item generation, item reduction, and validation. The content of the PQoL was derived from 80 interviews with patients seeking care in EDs. Using item response and classical test theories, item reduction was performed in 3 EDs on 300 patients and validation was completed in 10 EDs on 619 patients. The PQoL contains 17 items describing seven dimensions (self-esteem/vitality, psychological well-being, relationships with family, relationships with friends, autonomy, physical well-being/access to care, and future perception). The seven-factor structure accounted for 75.1% of the total variance. This model showed a good fit (indices from the LISREL model: root mean square error of approximation, 0.055; comparative fit index, 0.97; general fit index, 0.96; standardized root mean square residual, 0.058). Each item achieved the 0.40 standard for item internal consistency, and Cronbach α coefficients were >0.70. Significant associations with socioeconomic and clinical indicators showed good discriminant and external validity. Infit statistics ranged from 0.82 to 1.16. The PQoL-17 presents satisfactory psychometric properties and can be completed quickly, thereby fulfilling the goal of brevity sought in EDs. Copyright © 2014 Elsevier Inc. All rights reserved.

Modelling End-User of Electronic-Government Service: The Role of Information quality, System Quality and Trust

NASA Astrophysics Data System (ADS)

Witarsyah Jacob, Deden; Fudzee, Mohd Farhan Md; Aizi Salamat, Mohamad; Kasim, Shahreen; Mahdin, Hairulnizam; Azhar Ramli, Azizul

2017-08-01

Many governments around the world increasingly use internet technologies such as electronic government to provide public services. These services range from providing the most basic informational website to deploying sophisticated tools for managing interactions between government agencies and beyond government. Electronic government (e-government) aims to provide a more accurate, easily accessible, cost-effective and time saving for the community. In this study, we develop a new model of e-government adoption service by extending the Unified Theory of Acceptance and Use of Technology (UTAUT) through the incorporation of some variables such as System Quality, Information Quality and Trust. The model is then tested using a large-scale, multi-site survey research of 237 Indonesian citizens. This model will be validated by using Structural Equation Modeling (SEM). The result indicates that System Quality, Information Quality and Trust variables proven to effect user behavior. This study extends the current understanding on the influence of System Quality, Information Quality and Trust factors to researchers, practitioners, and policy makers.

Psychometric Performance of the Arabic Versions of the Cancer Behavior Inventory-Brief and the Functional Assessment of Cancer Therapy-Breast.

PubMed

Algamdi, Maaidah M; Hanneman, Sandra K

2018-02-14

Valid and reliable instruments in Arabic are needed to measure self-efficacy and quality of life for Arabic patients with cancer. The aim of this study was to test the psychometric performance of the Cancer Behavior Inventory-Brief Arabic (CBI-BA), including participant understanding of items, and the Functional Assessment of Cancer Therapy-Breast Arabic (FACT-BA). Using a cross-sectional design, 438 cancer patients completed the CBI-BA, 30 of whom completed cognitive interviews. A subsample 167 women with breast cancer also completed the FACT-BA. Internal consistency evidence was assessed with Cronbach's α and construct validity with principal axis factoring. Internal consistency estimates were acceptable for the total CBI-BA (α = .81) and FACT-BA (α = .88) scales. Exploratory factor analyses showed evidence of construct validity for the CBI-BA; 1 factor was derived, compared with four in the original English version. Cognitive interviews indicated satisfactory patient understanding of CBI-BA items. The Arabic version of the general FACT-General scale had 4 factors according to expectation. The CBI-BA has adequate psychometric performance for the measurement of self-efficacy for coping with cancer in Arabic patients. The FACT-General Arabic has adequate evidence of reliability and validity for the measurement of quality of life in Arabic women with breast cancer. The availability of culturally sensitive and psychometrically sound instruments for Arabic patients diagnosed with cancer should be valuable for healthcare clinicians and researchers to assess self-efficacy for coping with cancer and quality of life.

Modeling Major Adverse Outcomes of Pediatric and Adult Patients With Congenital Heart Disease Undergoing Cardiac Catheterization: Observations From the NCDR IMPACT Registry (National Cardiovascular Data Registry Improving Pediatric and Adult Congenital Treatment).

PubMed

Jayaram, Natalie; Spertus, John A; Kennedy, Kevin F; Vincent, Robert; Martin, Gerard R; Curtis, Jeptha P; Nykanen, David; Moore, Phillip M; Bergersen, Lisa

2017-11-21

Risk standardization for adverse events after congenital cardiac catheterization is needed to equitably compare patient outcomes among different hospitals as a foundation for quality improvement. The goal of this project was to develop a risk-standardization methodology to adjust for patient characteristics when comparing major adverse outcomes in the NCDR's (National Cardiovascular Data Registry) IMPACT Registry (Improving Pediatric and Adult Congenital Treatment). Between January 2011 and March 2014, 39 725 consecutive patients within IMPACT undergoing cardiac catheterization were identified. Given the heterogeneity of interventional procedures for congenital heart disease, new procedure-type risk categories were derived with empirical data and expert opinion, as were markers of hemodynamic vulnerability. A multivariable hierarchical logistic regression model to identify patient and procedural characteristics predictive of a major adverse event or death after cardiac catheterization was derived in 70% of the cohort and validated in the remaining 30%. The rate of major adverse event or death was 7.1% and 7.2% in the derivation and validation cohorts, respectively. Six procedure-type risk categories and 6 independent indicators of hemodynamic vulnerability were identified. The final risk adjustment model included procedure-type risk category, number of hemodynamic vulnerability indicators, renal insufficiency, single-ventricle physiology, and coagulation disorder. The model had good discrimination, with a C-statistic of 0.76 and 0.75 in the derivation and validation cohorts, respectively. Model calibration in the validation cohort was excellent, with a slope of 0.97 (standard error, 0.04; P value [for difference from 1] =0.53) and an intercept of 0.007 (standard error, 0.12; P value [for difference from 0] =0.95). The creation of a validated risk-standardization model for adverse outcomes after congenital cardiac catheterization can support reporting of risk-adjusted outcomes in the IMPACT Registry as a foundation for quality improvement. © 2017 American Heart Association, Inc.

A succinct rating scale for radiology report quality

PubMed Central

Yang, Chengwu; Ouyang, Tao; Peterson, Christine M; Sarwani, Nabeel I; Tappouni, Rafel; Bruno, Michael

2014-01-01

Context: Poorly written radiology reports are common among residents and are a significant challenge for radiology education. While training may improve report quality, a professionally developed reliable and valid scale to measure report quality does not exist. Objectives: To develop a measurement tool for report quality, the quality of report scale, with rigorous validation through empirical data. Methods: A research team of an experienced psychometrician and six senior radiologists conducted qualitative and quantitative studies. Five items were identified for the quality of report scale, each measuring a distinct aspect of report quality. Two dedicated training sessions were designed and implemented to help residents generate high-quality reports. In a blinded fashion, the quality of report scale was applied to 804 randomly selected reports issued before (n = 403) and after (n = 401) training. Full-scale psychometrical assessments were implemented onto the quality of report scale’s item- and scale-scores from the reports. The quality of report scale scores were correlated with report professionalism and attendings’ preference and were compared pre-/post-training. Results: The quality of report scale showed sound psychometrical properties, with high validity and reliability. Reports with higher quality of report scale score were more professional and preferable by attendings. Training improved the quality of report scale score, empirically validating the quality of report scale further. Conclusion: While succinct and practitioner friendly, the quality of report scale is a reliable and valid measure of radiology report quality and has the potential to be easily adapted to other fields such as pathology, where similar training would be beneficial. PMID:26770756

Validation of a quality-of-life instrument for patients with nonmelanoma skin cancer.

PubMed

Rhee, John S; Matthews, B Alex; Neuburg, Marcy; Logan, Brent R; Burzynski, Mary; Nattinger, Ann B

2006-01-01

To validate a disease-specific quality-of-life instrument--the Skin Cancer Index--intended to measure quality-of-life issues relevant to patients with nonmelanoma skin cancer. Internal reliability, convergent and divergent validity with existing scales, and factor analyses were performed in a cross-sectional study of 211 patients presenting with cervicofacial nonmelanoma skin cancer to a dermatologic surgery clinic. Factor analyses of the Skin Cancer Index confirmed a multidimensional scale with 3 distinct subscales-emotional, social, and appearance. Excellent internal validity of the 3 subscales was demonstrated. Substantial evidence was observed for convergent validity with the Dermatology Life Quality Index, Rosenberg Self-Esteem Scale, Lerman's Cancer Worry Scale, and Medical Outcomes Survey Short-Form 12 domains for vitality, emotion, social function, and mental health. These findings validate a new disease-specific quality-of-life instrument for patients with cervicofacial nonmelanoma skin cancer. Studies on the responsiveness of the Skin Cancer Index to clinical intervention are currently under way.

Psychological and psychosocial functioning of children with burn scarring using cosmetic camouflage: a multi-centre prospective randomised controlled trial.

PubMed

Maskell, Jessica; Newcombe, Peter; Martin, Graham; Kimble, Roy

2014-02-01

Burns leave patients with long-term physical scarring. Children with scarring are required to face challenges of reintegration into their community, including acceptance of an altered appearance and acceptance by others. This can be difficult given society's preoccupation with physical appearance. Limited research exists investigating validity of cosmetic camouflage as a psychosocial intervention for children with scarring. This study investigated whether using cosmetic camouflage (Microskin™) had a positive impact on health-related quality of life, self-concept and psychopathology for children and adolescents (8-17 years) with burn scarring. A prospective multi-centre randomised controlled trial was conducted across Australian and New Zealand paediatric hospitals. 63 participants (49 females, mean age 12.7 ± 2.1 years) were enrolled. Data points were baseline (Time 1) and at 8 weeks (Time 2) using reliable and valid psychometric measures. Findings indicate there were significant improvements in socialisation, school and appearance scales on the Paediatric Quality of Life Inventory and psychopathology scores particularly peer problems decreased. However self-concept remained stable from baseline throughout intervention use. Cosmetic camouflage appears to have a positive impact on quality of life particularly socialisation. Cosmetic camouflage is a valid tool to assist children with scarring to actively participate socially within their communities. Copyright © 2013 Elsevier Ltd and ISBI. All rights reserved.

Spanish translation and linguistic validation of the quality of life in neurological disorders (Neuro-QoL) measurement system.

PubMed

Correia, H; Pérez, B; Arnold, B; Wong, Alex W K; Lai, J S; Kallen, M; Cella, D

2015-03-01

The quality of life in neurological disorders (Neuro-QoL) measurement system is a 470-item compilation of health-related quality of life domains for adults and children with neurological disorders. It was developed and cognitively debriefed in English and Spanish, with general population and clinical samples in the USA. This paper describes the Spanish translation and linguistic validation process. The translation methodology combined forward and back-translations, multiple reviews, and cognitive debriefing with 30 adult and 30 pediatric Spanish-speaking respondents in the USA. The adult Fatigue bank was later also tested in Spain and Argentina. A universal approach to translation was adopted to produce a Spanish version that can be used in various countries. Translators from several countries were involved in the process. Cognitive debriefing results indicated that most of the 470 Spanish items were well understood. Translations were revised as needed where difficulty was reported or where participants' comments revealed misunderstanding of an item's intended meaning. Additional testing of the universal Spanish adult Fatigue item bank in Spain and Argentina confirmed good understanding of the items and that no country-specific word changes were necessary. All the adult and pediatric Neuro-QoL measures have been linguistically validated with Spanish speakers in the USA. Instruments are available for use at www.assessmentcenter.net.

Spanish translation and linguistic validation of the quality of life in neurological disorders (Neuro-QoL) measurement system

PubMed Central

Pérez, B.; Arnold, B.; Wong, Alex W. K.; Lai, JS; Kallen, M.; Cella, D.

2017-01-01

Introduction The quality of life in neurological disorders (Neuro-QoL) measurement system is a 470-item compilation of health-related quality of life domains for adults and children with neurological disorders. It was developed and cognitively debriefed in English and Spanish, with general population and clinical samples in the USA. This paper describes the Spanish translation and linguistic validation process. Methods The translation methodology combined forward and back-translations, multiple reviews, and cognitive debriefing with 30 adult and 30 pediatric Spanish-speaking respondents in the USA. The adult Fatigue bank was later also tested in Spain and Argentina. A universal approach to translation was adopted to produce a Spanish version that can be used in various countries. Translators from several countries were involved in the process. Results Cognitive debriefing results indicated that most of the 470 Spanish items were well understood. Translations were revised as needed where difficulty was reported or where participants’ comments revealed misunderstanding of an item’s intended meaning. Additional testing of the universal Spanish adult Fatigue item bank in Spain and Argentina confirmed good understanding of the items and that no country-specific word changes were necessary. Conclusion All the adult and pediatric Neuro-QoL measures have been linguistically validated with Spanish speakers in the USA. Instruments are available for use at www.assessmentcenter.net. PMID:25236708

The construction and validity analysis of AQHI based on mortality risk: A case study in Guangzhou, China.

PubMed

Li, Xing; Xiao, Jianpeng; Lin, Hualiang; Liu, Tao; Qian, Zhengmin; Zeng, Weilin; Guo, Lingchuan; Ma, Wenjun

2017-01-01

The current air quality indices have been criticized for not capturing combined health effects of multiple air pollutants. We proposed an Air Quality Health Index (AQHI) based on the air pollution-mortality associations for communicating health risks of air pollution. Time-series studies were conducted to estimate the associations between air pollutants including sulfur dioxide (SO 2 ), nitrogen dioxide (NO 2 ), ozone (O 3 ), suspended particulate matter smaller than 2.5 μm in aerodynamic diameter (PM 2.5 ) and mortality in Guangzhou from 2012 to 2015. The sum of excess mortality risk was calculated to construct the AQHI, which was then adjusted to an arbitrary scale. We then assessed the validity of AQHI. An interquartile increase (IQR) of AQHI was associated with 3.61% [95% confidence interval (95% CI), 2.85%-4.37%], 3.73% (95%CI, 2.18%-5.27%) and 4.19% (95%CI, 2.87%-5.52%) increase of mortality, respiratory and cardiovascular hospital admissions, respectively. Compared with the currently used Air Quality Index (AQI), AQHI had higher effects on mortality and morbidity. Our study suggests that AQHI might comprehensively capture the combined effects of air pollution, which make it be a more valid communication tool of air pollution-related health risk. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and validation of a stability-indicating LC method for the assay of lodenafil carbonate in tablets.

PubMed

Codevilla, Cristiane Franco; Lemos, Alice Machado; Delgado, Leila Schreiner; Rolim, Clarice Madalena Bueno; Adams, Andréa Inês Horn; Bergold, Ana Maria

2011-08-01

A stability-indicating liquid chromatographic method has been developed for the quantitative determination of lodenafil carbonate in tablets. The method employs a Synergi Fusion C18 column (250 × 4.6 mm, i.d., 4 μm particle size), with mobile phase consisting of a mixture of methanol-acetic acid 0.1% pH 4.0 (65:35, v/v) and UV detection at 290 nm, using a photodiode array detector. A linear response (r = 0.9999) was observed in the range of 10-80 μg/mL. The method showed good recoveries (average 100.3%) and also intra and inter-day precision (RSD < 2.0%). Validation parameters as specificity and robustness were also determined. Specificity analysis showed that no impurities or degradation products were co-eluting with the lodenafil carbonate peak. The method was found to be stability-indicating and due to its simplicity and accuracy can be applied for routine quality control analysis of lodenafil carbonate in tablets.

Validation of Medical Tourism Service Quality Questionnaire (MTSQQ) for Iranian Hospitals.

PubMed

Qolipour, Mohammad; Torabipour, Amin; Khiavi, Farzad Faraji; Malehi, Amal Saki

2017-03-01

Assessing service quality is one of the basic requirements to develop the medical tourism industry. There is no valid and reliable tool to measure service quality of medical tourism. This study aimed to determine the reliability and validity of a Persian version of medical tourism service quality questionnaire for Iranian hospitals. To validate the medical tourism service quality questionnaire (MTSQQ), a cross-sectional study was conducted on 250 Iraqi patients referred to hospitals in Ahvaz (Iran) from 2015. To design a questionnaire and determine its content validity, the Delphi Technique (3 rounds) with the participation of 20 medical tourism experts was used. Construct validity of the questionnaire was assessed through exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach's alpha coefficient. Data were analyzed by Excel 2007, SPSS version18, and Lisrel l8.0 software. The content validity of the questionnaire with CVI=0.775 was confirmed. According to exploratory factor analysis, the MTSQQ included 31 items and 8 dimensions (tangibility, reliability, responsiveness, assurance, empathy, exchange and travel facilities, technical and infrastructure facilities and safety and security). Construct validity of the questionnaire was confirmed, based on the goodness of fit quantities of model (RMSEA=0.032, CFI= 0.98, GFI=0.88). Cronbach's alpha coefficient was 0.837 and 0.919 for expectation and perception questionnaire. The results of the study showed that the medical tourism SERVQUAL questionnaire with 31 items and 8 dimensions was a valid and reliable tool to measure service quality of medical tourism in Iranian hospitals.

Measuring service quality and its relationship to future consumer behavior.

PubMed

Headley, D E; Miller, S J

1993-01-01

The authors adapt the SERVQUAL scale for medical care services and examine it for reliability, dimensionality, and validity in a primary care clinic setting. In addition, they explore the possibility of a link between perceived service quality--and its various dimensions--and a patient's future intent to complain, compliment, repeat purchase, and switch providers. Findings from 159 matched-pair responses indicate that the SERVQUAL scale can be adapted reliably to a clinic setting and that the dimensions of reliability, dependability, and empathy are most predictive of a patient's intent to complain, compliment, repeat purchase, and switch providers.

Does Expert Advice Improve Educational Choice?

PubMed Central

2015-01-01

This paper reports evidence that an individual meeting with a study counselor at high school significantly improves the quality of choice of tertiary educational field, as self-assessed 18 months after graduation from college. To address endogeneity, we explore the variation in study counseling practices between schools as an instrumental variable (IV). Following careful scrutiny of the validity of the IV, our results indicate a significant and positive influence of study counseling on the quality of educational choice, foremost among males and those with low educated parents. The overall result is stable across a number of robustness checks. PMID:26692388

Advances in the mechanisms and early warning indicators of the postoperative cognitive dysfunction after the extracorporeal circulation.

PubMed

Liu, Chao; Han, Jian-ge

2015-02-01

The high incidence of postoperative cognitive dysfunction (POCD) after extracorporeal circulation has seriously affected the prognosis and quality of life. Its mechanism may involve the inflammatory response and oxidative stress,the excessive phosphorylation of tau protein, the decreased blood volume and oxygen in the cerebral cortex. Appropriate early warning indicators of POCD after the extracorporeal circulation should be chosen to facilitate the cross validation of the results obtained different technical approaches and thus promote the early diagnosis and treatment of POCD.

Construction and application of an indicator system to assess the ergonomic performance of large and medium-sized construction companies.

PubMed

Bezerra, Isabela Xavier Barbalho; de Carvalho, Ricardo José Matos

2012-01-01

This article proposes a system of indicators to evaluate the performance of companies in ergonomics for buildings. The system was developed based primarily on studies related to the performance evaluation of the construction industry and on Brazilian standards of ergonomics and work safety and had also the contribution of national and international indicators related to ergonomics, work safety, quality, sustainability, quality of work life and to organizational behavior. The indicators were named, classified and their components were assigned to compose the theoretical model SIDECE--System of Performance Indicators in Ergonomics for Building Construction (as for the Portuguese acronym), serving the major goals of ergonomics: health, safety and workers' satisfaction and production efficiency. The SIDECE is being validated along with the building construction companies in the city of Natal, Brazil, whose practical results, deriving from the application of instruments to collect field data, are under process, to be presented on the occasion of the 18th World Congress on Ergonomics. It is intended that the SIDECE be used by building construction companies as a support tool for excellence management.

Count every newborn; a measurement improvement roadmap for coverage data

PubMed Central

2015-01-01

Background The Every Newborn Action Plan (ENAP), launched in 2014, aims to end preventable newborn deaths and stillbirths, with national targets of ≤12 neonatal deaths per 1000 live births and ≤12 stillbirths per 1000 total births by 2030. This requires ambitious improvement of the data on care at birth and of small and sick newborns, particularly to track coverage, quality and equity. Methods In a multistage process, a matrix of 70 indicators were assessed by the Every Newborn steering group. Indicators were graded based on their availability and importance to ENAP, resulting in 10 core and 10 additional indicators. A consultation process was undertaken to assess the status of each ENAP core indicator definition, data availability and measurement feasibility. Coverage indicators for the specific ENAP treatment interventions were assigned task teams and given priority as they were identified as requiring the most technical work. Consultations were held throughout. Results ENAP published 10 core indicators plus 10 additional indicators. Three core impact indicators (neonatal mortality rate, maternal mortality ratio, stillbirth rate) are well defined, with future efforts needed to focus on improving data quantity and quality. Three core indicators on coverage of care for all mothers and newborns (intrapartum/skilled birth attendance, early postnatal care, essential newborn care) have defined contact points, but gaps exist in measuring content and quality of the interventions. Four core (antenatal corticosteroids, neonatal resuscitation, treatment of serious neonatal infections, kangaroo mother care) and one additional coverage indicator for newborns at risk or with complications (chlorhexidine cord cleansing) lack indicator definitions or data, especially for denominators (population in need). To address these gaps, feasible coverage indicator definitions are presented for validity testing. Measurable process indicators to help monitor health service readiness are also presented. A major measurement gap exists to monitor care of small and sick babies, yet signal functions could be tracked similarly to emergency obstetric care. Conclusions The ENAP Measurement Improvement Roadmap (2015-2020) outlines tools to be developed (e.g., improved birth and death registration, audit, and minimum perinatal dataset) and actions to test, validate and institutionalise proposed coverage indicators. The roadmap presents a unique opportunity to strengthen routine health information systems, crosslinking these data with civil registration and vital statistics and population-based surveys. Real measurement change requires intentional transfer of leadership to countries with the greatest disease burden and will be achieved by working with centres of excellence and existing networks. PMID:26391444

QualityML: a dictionary for quality metadata encoding

NASA Astrophysics Data System (ADS)

Ninyerola, Miquel; Sevillano, Eva; Serral, Ivette; Pons, Xavier; Zabala, Alaitz; Bastin, Lucy; Masó, Joan

2014-05-01

The scenario of rapidly growing geodata catalogues requires tools focused on facilitate users the choice of products. Having quality fields populated in metadata allow the users to rank and then select the best fit-for-purpose products. In this direction, we have developed the QualityML (http://qualityml.geoviqua.org), a dictionary that contains hierarchically structured concepts to precisely define and relate quality levels: from quality classes to quality measurements. Generically, a quality element is the path that goes from the higher level (quality class) to the lowest levels (statistics or quality metrics). This path is used to encode quality of datasets in the corresponding metadata schemas. The benefits of having encoded quality, in the case of data producers, are related with improvements in their product discovery and better transmission of their characteristics. In the case of data users, particularly decision-makers, they would find quality and uncertainty measures to take the best decisions as well as perform dataset intercomparison. Also it allows other components (such as visualization, discovery, or comparison tools) to be quality-aware and interoperable. On one hand, the QualityML is a profile of the ISO geospatial metadata standards providing a set of rules for precisely documenting quality indicator parameters that is structured in 6 levels. On the other hand, QualityML includes semantics and vocabularies for the quality concepts. Whenever possible, if uses statistic expressions from the UncertML dictionary (http://www.uncertml.org) encoding. However it also extends UncertML to provide list of alternative metrics that are commonly used to quantify quality. A specific example, based on a temperature dataset, is shown below. The annual mean temperature map has been validated with independent in-situ measurements to obtain a global error of 0.5 ° C. Level 0: Quality class (e.g., Thematic accuracy) Level 1: Quality indicator (e.g., Quantitative attribute correctness) Level 2: Measurement field (e.g., DifferentialErrors1D) Level 3: Statistic or Metric (e.g., Half-lengthConfidenceInterval) Level 4: Units (e.g. Celsius degrees) Level 5: Value (e.g.0.5) Level 6: Specifications. Additional information on how the measurement took place, citation of the reference data, the traceability of the process and a publication describing the validation process encoded using new 19157 elements or the GeoViQua (http://www.geoviqua.org) Quality Model (PQM-UQM) extensions to the ISO models. Finally, keep in mind, that QualityML is not just suitable for encoding dataset level but also considers pixel and object level uncertainties. This is done by link the metadata quality descriptions with layers representing not just the data but the uncertainty values associated with each geospatial element.

Validity and reliability of food security measures.

PubMed

Cafiero, Carlo; Melgar-Quiñonez, Hugo R; Ballard, Terri J; Kepple, Anne W

2014-12-01

This paper reviews some of the existing food security indicators, discussing the validity of the underlying concept and the expected reliability of measures under reasonably feasible conditions. The main objective of the paper is to raise awareness on existing trade-offs between different qualities of possible food security measurement tools that must be taken into account when such tools are proposed for practical application, especially for use within an international monitoring framework. The hope is to provide a timely, useful contribution to the process leading to the definition of a food security goal and the associated monitoring framework within the post-2015 Development Agenda. © 2014 New York Academy of Sciences.

Development and validation of a disease-specific scale to assess psychosocial well-being of patients living with unruptured intracranial aneurysm.

PubMed

Fujishima-Hachiya, Asami; Inoue, Tomoko

2012-12-01

Although the detection rate for unruptured intracranial aneurysm (UIA) has improved since the 1990s, the quality of life and psychosocial status of patients living with UIA have been negatively affected. However, a comprehensive assessment tool for UIA patients is still awaited. This study aimed to develop and validate a disease-specific scale to assess UIA patients' psychosocial well-being in their daily lives. On the basis of previous qualitative research, 52 items on a six-dimension scale were generated. After a pilot study, statistical analysis was conducted to examine construct validity-including convergent validity, discriminant and known-group validity, and internal reliability. Between 2010 and 2011, 124 patients across three hospitals in Japan were tested using a tentative scale. As a result of exploratory factor analysis, we identified 25 items based on five conceptually derived dimensions (psychological stability, trust in healthcare resources, satisfaction with the decision-making process, positive perception of self-management, and confidence in UIA knowledge) as a final psychosocial well-being scale for UIA patients (UIA-PW scale). Cronbach's alpha coefficients for each subscale ranged between .76 and .90, with .83 for the total score, which indicated satisfactory internal consistency. The total score for the UIA-PW scale correlated significantly with the existing quality of life and mental health scales, but it is important to note that psychological stability and positive perception of self-management were negatively correlated. Although additional investigation is needed, the UIA-PW scale shows reasonable validity and reliability in assessing psychosocial well-being of patients living with UIA.

A systematic review on the quality, validity and usefulness of current cost-effectiveness studies for treatments of neovascular age-related macular degeneration.

PubMed

Elshout, Mari; Webers, Carroll A B; van der Reis, Margriet I; Schouten, Jan S A G

2018-06-04

Ophthalmologists increasingly depend on new drugs to advance their treatment options. These options are limited by restraints on reimbursements for new and expensive drugs. These restraints are put in place through health policy decisions based on cost-effectiveness analyses (CEA). Cost-effectiveness analyses need to be valid and of good quality to support correct decisions to create new treatment opportunities. In this study, we report the quality, validity and usefulness of CEAs for therapies for nAMD. A systematic review in PubMed, EMBASE and Cochrane was performed to include CEAs. Quality and validity assessment was based on current general quality criteria and on elements that are specific to the field of ophthalmology. Forty-eight CEAs were included in the review. Forty-four CEAs did not meet four basic model quality and validity criteria specific to CEAs in the field of ophthalmology (both eyes analysed instead of one; a time horizon extending beyond 4 years; extrapolating VA and treatment intervals beyond trial data realistically; and including the costs of low-vision). Four CEAs aligned with the quality and validity criteria. In two of these CEAs bevacizumab as-needed (PRN) was more cost-effective than bevacizumab monthly; aflibercept (VIEW); or ranibizumab monthly or PRN. In two CEAs, ranibizumab (PRN or treat and extent) was dominant over aflibercept. In two other CEAs, aflibercept was either more cost-effective or dominant over ranibizumab monthly or PRN. Two of the CEAs of sufficient quality and validity show that bevacizumab PRN is the most cost-effective treatment. Comparing ranibizumab and aflibercept, either treatment can be more cost-effective depending on the assumptions used for drug prices and treatment frequencies. The majority of the published CEAs are of insufficient quality and validity. They wrongly inform decision-makers at the cost of opportunities for ophthalmologists to treat patients. As such, they may negatively influence overall patient outcomes and societal costs. For future ophthalmic treatments, CEAs need to be improved and only published when they are of sufficient quality and validity. © 2018 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Evaluation of the Fecal Incontinence Quality of Life Scale (FIQL) using item response theory reveals limitations and suggests revisions.

PubMed

Peterson, Alexander C; Sutherland, Jason M; Liu, Guiping; Crump, R Trafford; Karimuddin, Ahmer A

2018-06-01

The Fecal Incontinence Quality of Life Scale (FIQL) is a commonly used patient-reported outcome measure for fecal incontinence, often used in clinical trials, yet has not been validated in English since its initial development. This study uses modern methods to thoroughly evaluate the psychometric characteristics of the FIQL and its potential for differential functioning by gender. This study analyzed prospectively collected patient-reported outcome data from a sample of patients prior to colorectal surgery. Patients were recruited from 14 general and colorectal surgeons in Vancouver Coastal Health hospitals in Vancouver, Canada. Confirmatory factor analysis was used to assess construct validity. Item response theory was used to evaluate test reliability, describe item-level characteristics, identify local item dependence, and test for differential functioning by gender. 236 patients were included for analysis, with mean age 58 and approximately half female. Factor analysis failed to identify the lifestyle, coping, depression, and embarrassment domains, suggesting lack of construct validity. Items demonstrated low difficulty, indicating that the test has the highest reliability among individuals who have low quality of life. Five items are suggested for removal or replacement. Differential test functioning was minimal. This study has identified specific improvements that can be made to each domain of the Fecal Incontinence Quality of Life Scale and to the instrument overall. Formatting, scoring, and instructions may be simplified, and items with higher difficulty developed. The lifestyle domain can be used as is. The embarrassment domain should be significantly revised before use.

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

2018-02-15

This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

Meeting the ambition of measuring the quality of hospitals' stroke care using routinely collected administrative data: a feasibility study.

PubMed

Palmer, William L; Bottle, Alex; Davie, Charlie; Vincent, Charles A; Aylin, Paul

2013-09-01

To examine the potential for using routinely collected administrative data to compare the quality and safety of stroke care at a hospital level, including evaluating any bias due to variations in coding practice. A retrospective cohort study of English hospitals' performance against six process and outcome indicators covering the acute care pathway. We used logistic regression to adjust the outcome measures for case mix. Hospitals in England. Stroke patients (ICD-10 I60-I64) admitted to English National Health Service public acute hospitals between April 2009 and March 2010, accounting for 91 936 admissions. The quality and safety were measured using six indicators spanning the hospital care pathway, from timely access to brain scans to emergency readmissions following discharge after stroke. There were 182 occurrences of hospitals performing statistically differently from the national average at the 99.8% significance level across the six indicators. Differences in coding practice appeared to only partially explain the variation. Hospital administrative data provide a practical and achievable method for evaluating aspects of stroke care across the acute pathway. However, without improvements in coding and further validation, it is unclear whether the cause of the variation is the quality of care or the result of different local care pathways and data coding accuracy.

School Improvement under Test-Driven Accountability: A Comparison of High- and Low-Performing Middle Schools in California. CSE Report 717

ERIC Educational Resources Information Center

Mintrop, Heinrich; Trujillo, Tina

2007-01-01

Based on in-depth data from nine demographically similar schools, the study asks five questions in regard to key aspects of the improvement process and that speak to the consequential validity of accountability indicators: Do schools that differ widely according to system performance criteria also differ on the quality of the educational…

Development and validation of health related quality of life questionnaire (Indian scenario) in diabetic foot ulcer patients.

PubMed

Kateel, Ramya; Augustine, Alfred J; Ullal, Sheetal; Prabhu, Shivananda; Bhat, Rahul; Adhikari, Prabha

2017-12-01

To develop and validate Health Related Quality of Life Questionnaire in Diabetic Foot Ulcer Patients (HRQLQDFU) for Indian scenario. This study was conducted in two phases. First phase was Development of HRQLQDFU which included literature search and expert interview. Second phase was validation of HRQLQDFL which included face validation, content validation and construct validation. Face validation was done by ten diabetic foot ulcer patients, ten practicing nurses and ten care givers. They were asked to read and respond to questionnaire and report any difficulty in understanding the questions. Further they were asked to add any item to the questionnaire which according to them has a significant effect on quality of life. Content validation was done by six subject experts who judged the content relevance of questionnaire with score ranging from zero to four; zero being least relevant and four being most relevant. Content validity index was calculated for each question. Questions having content validity index≥0.8 were selected for the study. Reliability was tested by calculating Cronbach's alpha. In the development phase a questionnaire containing 37 questions with six domains was developed. None of patient had difficulty in understanding questions. After content validation a new questionnaire containing 20 questions was developed. Cronbach's alpha was 0.86 which shows good reliability. The new health related quality of life questionnaire on diabetic foot ulcer patients for an Indian scenario is validated and can be a reliably measure for quality of life in diabetic foot ulcer patients. Copyright © 2017 Diabetes India. Published by Elsevier Ltd. All rights reserved.

[Definition of low threshold volumes for quality assurance: conceptual and methodological issues involved in the definition and evaluation of thresholds for volume outcome relations in clinical care].

PubMed

Wetzel, Hermann

2006-01-01

In a large number of mostly retrospective association studies, a statistical relationship between volume and quality of health care has been reported. However, the relevance of these results is frequently limited by methodological shortcomings. In this article, criteria for the evidence and definition of thresholds for volume-outcome relations are proposed, e.g. the specification of relevant outcomes for quality indicators, analysis of volume as a continuous variable with an adequate case-mix and risk adjustment, accounting for cluster effects and considering mathematical models for the derivation of cut-off values. Moreover, volume thresholds are regarded as surrogate parameters for the indirect classification of the quality of care, whose diagnostic validity and effectiveness in improving health care quality need to be evaluated in prospective studies.

Translation and validation of the German version of the Mother-Generated Index and its application during the postnatal period.

PubMed

Grylka-Baeschlin, Susanne; van Teijlingen, Edwin; Stoll, Kathrin; Gross, Mechthild M

2015-01-01

the Mother-Generated Index (MGI) is a validated tool to assess postnatal quality of life. It is usually administered several weeks or months after birth and correlates with indices of post partum mood states and physical complaints. The instrument had not been translated into German before or validated for use among German-speaking women, nor have the results of the tool been assessed specifically for the administration directly after birth. This paper aims to describe the systematic translation process of the MGI into German and to assess the convergent validity of the German version of the instrument directly after birth and seven weeks post partum. prospective two-stage survey. two rural hospitals in the south of Germany and in the north of Switzerland. all women giving birth between 1st October and 15th December 2012 with sufficient knowledge of German and whose babies were not referred to a neonatal care unit; 226 women were eligible to participate. two questionnaires including questions relating to socio-demographic factors and perinatal care, and incorporating the MGI, the Hospital Anxiety and Depression Scale (HADS) and the Postnatal Morbidity Index (PMI). All instruments were subjected to forward and back translation and pilot-tested; the first questionnaire was then administered in the first two days after birth and the second six weeks post partum. Parametric and non-parametric tests were computed using SPSS. 129 surveys were returned an average of three days after birth and 83 after seven weeks. Higher postnatal quality of life showed a significant correlation with a lower anxiety and depression score (p<0.01), fewer maternal physical complaints (p<0.05) and more favourable baby adjective scores (p<0.05) after birth. Significant associations were found between MGI scores and sufficient help (p=0.03) as well as ability to cope at home (p<0.01). MGI scores three days and seven weeks after birth correlated highly significantly and positively (p<0.001). convergent validity of the MGI with the HADS and the PMI suggests that the German version of the MGI is a valid indicator of physical and emotional post partum well-being. the German version of the MGI can be used in the post partum period to identify women whose quality of life is impaired during the first days after birth, in order to initiate extended midwifery care and referral if necessary. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

[Impact of pharmaceutical interventions on antibiotic therapy of urinary tract infections in rehabilitation center].

PubMed

Rochefolle, A; Maison, O; Chazaud, C; Rioufol, C; Rode, G; Luaute, J; Jacquin-Courtois, S; Guinet-Lacoste, A; Carré, E

2017-06-01

The aim of this study was to assess the impact of medico-pharmaceutical partnership on the quality of antibiotic treatment in urinary tract infection (UTI) within rehabilitation center. All antibiotic prescriptions were validated by the pharmacist at the start of treatment and twice a week. All patients with symptomatic urinary tract infection between January 1, 2014 to December 31, 2015 were included in this study. Addition to awareness among specifiers to promoting the appropriate use of antibiotics, the pharmacist suggested pharmaceutical interventions (PI) in order to improve the quality of antibiotic treatments. At the same time, 3 quality indicators (QI) were followed: duration, dosage, antibiotic susceptibility. The compliance rates of this 3 QI allowed to assess the quality of the antibiotic treatment in urinary tract infection. The study population included 154 patients corresponding to 252 UTI. Sixty-eight PI were made by pharmacist about urinary tract infection treatment (overdosage or under-dosing, duration unknown, inadequate route of administration). These QI achieved 96.4% compliance with duration, 98.8% compliance with dosage and 99.2% with the antibiotic susceptibility. This study allowed showing the medico-pharmaceutical impact on the quality of antibiotic treatments in UTI. The awareness among specifiers with a daily validation of prescription by the pharmacist allowed to improve urinary tract infections care in rehabilitation center. 4. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

A portable device for rapid nondestructive detection of fresh meat quality

NASA Astrophysics Data System (ADS)

Lin, Wan; Peng, Yankun

2014-05-01

Quality attributes of fresh meat influence nutritional value and consumers' purchasing power. In order to meet the demand of inspection department for portable device, a rapid and nondestructive detection device for fresh meat quality based on ARM (Advanced RISC Machines) processor and VIS/NIR technology was designed. Working principal, hardware composition, software system and functional test were introduced. Hardware system consisted of ARM processing unit, light source unit, detection probe unit, spectral data acquisition unit, LCD (Liquid Crystal Display) touch screen display unit, power unit and the cooling unit. Linux operating system and quality parameters acquisition processing application were designed. This system has realized collecting spectral signal, storing, displaying and processing as integration with the weight of 3.5 kg. 40 pieces of beef were used in experiment to validate the stability and reliability. The results indicated that prediction model developed using PLSR method using SNV as pre-processing method had good performance, with the correlation coefficient of 0.90 and root mean square error of 1.56 for validation set for L*, 0.95 and 1.74 for a*，0.94 and 0.59 for b*, 0.88 and 0.13 for pH, 0.79 and 12.46 for tenderness, 0.89 and 0.91 for water content, respectively. The experimental result shows that this device can be a useful tool for detecting quality of meat.

A network-based method to evaluate quality of reproducibility of differential expression in cancer genomics studies

PubMed Central

Geng, Haijiang; Li, Zhihui; Li, Jiabing; Lu, Tao; Yan, Fangrong

2015-01-01

BACKGROUND Personalized cancer treatments depend on the determination of a patient's genetic status according to known genetic profiles for which targeted treatments exist. Such genetic profiles must be scientifically validated before they is applied to general patient population. Reproducibility of findings that support such genetic profiles is a fundamental challenge in validation studies. The percentage of overlapping genes (POG) criterion and derivative methods produce unstable and misleading results. Furthermore, in a complex disease, comparisons between different tumor subtypes can produce high POG scores that do not capture the consistencies in the functions. RESULTS We focused on the quality rather than the quantity of the overlapping genes. We defined the rank value of each gene according to importance or quality by PageRank on basis of a particular topological structure. Then, we used the p-value of the rank-sum of the overlapping genes (PRSOG) to evaluate the quality of reproducibility. Though the POG scores were low in different studies of the same disease, the PRSOG was statistically significant, which suggests that sets of differentially expressed genes might be highly reproducible. CONCLUSIONS Evaluations of eight datasets from breast cancer, lung cancer and four other disorders indicate that quality-based PRSOG method performs better than a quantity-based method. Our analysis of the components of the sets of overlapping genes supports the utility of the PRSOG method. PMID:26556852

[Quality assessment in anesthesia].

PubMed

Kupperwasser, B

1996-01-01

Quality assessment (assurance/improvement) is the set of methods used to measure and improve the delivered care and the department's performance against pre-established criteria or standards. The four stages of the self-maintained quality assessment cycle are: problem identification, problem analysis, problem correction and evaluation of corrective actions. Quality assessment is a measurable entity for which it is necessary to define and calibrate measurement parameters (indicators) from available data gathered from the hospital anaesthesia environment. Problem identification comes from the accumulation of indicators. There are four types of quality indicators: structure, process, outcome and sentinel indicators. The latter signal a quality defect, are independent of outcomes, are easier to analyse by statistical methods and closely related to processes and main targets of quality improvement. The three types of methods to analyse the problems (indicators) are: peer review, quantitative methods and risks management techniques. Peer review is performed by qualified anaesthesiologists. To improve its validity, the review process should be explicited and conclusions based on standards of practice and literature references. The quantitative methods are statistical analyses applied to the collected data and presented in a graphic format (histogram, Pareto diagram, control charts). The risks management techniques include: a) critical incident analysis establishing an objective relationship between a 'critical' event and the associated human behaviours; b) system accident analysis, based on the fact that accidents continue to occur despite safety systems and sophisticated technologies, checks of all the process components leading to the impredictable outcome and not just the human factors; c) cause-effect diagrams facilitate the problem analysis in reducing its causes to four fundamental components (persons, regulations, equipment, process). Definition and implementation of corrective measures, based on the findings of the two previous stages, are the third step of the evaluation cycle. The Hawthorne effect is an outcome improvement, before the implementation of any corrective actions. Verification of the implemented actions is the final and mandatory step closing the evaluation cycle.

Shifting the focus to practice quality improvement in radiation oncology.

PubMed

Crozier, Cheryl; Erickson-Wittmann, Beth; Movsas, Benjamin; Owen, Jean; Khalid, Najma; Wilson, J Frank

2011-09-01

To demonstrate how the American College of Radiology, Quality Research in Radiation Oncology (QRRO) process survey database can serve as an evidence base for assessing quality of care in radiation oncology. QRRO has drawn a stratified random sample of radiation oncology facilities in the USA and invited those facilities to participate in a Process Survey. Information from a prior QRRO Facilities Survey has been used along with data collected under the current National Process Survey to calculate national averages and make statistically valid inferences for national process measures for selected cancers in which radiation therapy plays a major role. These measures affect outcomes important to patients and providers and measure quality of care. QRRO's survey data provides national benchmark data for numerous quality indicators. The Process Survey is "fully qualified" as a Practice Quality Improvement project by the American Board of Radiology under its Maintenance of Certification requirements for radiation oncology and radiation physics. © 2011 National Association for Healthcare Quality.

Development and validation of a stability-indicating gas chromatographic method for quality control of residual solvents in blonanserin: a novel atypical antipsychotic agent.

PubMed

Peng, Ming; Liu, Jin; Lu, Dan; Yang, Yong-Jian

2012-09-01

Blonanserin is a novel atypical antipsychotic agent for the treatment of schizophrenia. Ethyl alcohol, isopropyl alcohol and toluene are utilized in the synthesis route of this bulk drug. A new validated gas chromatographic (GC) method for the simultaneous determination of residual solvents in blonanserin is described in this paper. Blonanserin was dissolved in N, N-dimethylformamide to make a sample solution that was directly injected into a DB-624 column. A postrun oven temperature at 240°C for approximately 2 h after the analysis cycle was performed to wash out blonanserin residue in the GC column. Quantitation was performed by external standard analyses and the validation was carried out according to International Conference on Harmonization validation guidelines Q2A and Q2B. The method was shown to be specific (no interference in the blank solution), linear (correlation coefficients ≥0.99998, n = 10), accurate (average recoveries between 94.1 and 101.7%), precise (intra-day and inter-day precision ≤2.6%), sensitive (limit of detection ≤0.2 ng, and limit of quantitation ≤0.7 ng), robust (small variations of carrier gas flow, initial oven temperature, temperature ramping rate, injector and detector temperatures did not significantly affect the system suitability test parameters and peak areas) and stable (reference standard and sample solutions were stable over 48 h). This extensively validated method is ready to be used for the quality control of blonanserin.

The Most Common Geometric and Semantic Errors in CityGML Datasets

NASA Astrophysics Data System (ADS)

Biljecki, F.; Ledoux, H.; Du, X.; Stoter, J.; Soon, K. H.; Khoo, V. H. S.

2016-10-01

To be used as input in most simulation and modelling software, 3D city models should be geometrically and topologically valid, and semantically rich. We investigate in this paper what is the quality of currently available CityGML datasets, i.e. we validate the geometry/topology of the 3D primitives (Solid and MultiSurface), and we validate whether the semantics of the boundary surfaces of buildings is correct or not. We have analysed all the CityGML datasets we could find, both from portals of cities and on different websites, plus a few that were made available to us. We have thus validated 40M surfaces in 16M 3D primitives and 3.6M buildings found in 37 CityGML datasets originating from 9 countries, and produced by several companies with diverse software and acquisition techniques. The results indicate that CityGML datasets without errors are rare, and those that are nearly valid are mostly simple LOD1 models. We report on the most common errors we have found, and analyse them. One main observation is that many of these errors could be automatically fixed or prevented with simple modifications to the modelling software. Our principal aim is to highlight the most common errors so that these are not repeated in the future. We hope that our paper and the open-source software we have developed will help raise awareness for data quality among data providers and 3D GIS software producers.

Adaptation of the osteoarthritis-specific quality of life scale (the OAQoL) for use in Germany, Hungary, Italy, Spain and Turkey.

PubMed

Wilburn, Jeanette; McKenna, Stephen P; Kutlay, Şehim; Bender, Tamas; Braun, Jürgen; Castillo-Gallego, Concepcion; Favero, Marta; Geher, Pal; Kiltz, Uta; Martin-Mola, Emilio; Ramonda, Roberta; Rouse, Matthew; Tennant, Alan; Küçükdeveci, Ayşe A

2017-05-01

The Osteoarthritis Quality of Life scale (OAQoL) is specific to individuals with osteoarthritis. The present study describes the adaptation of the OAQoL for use in the following five European languages: German, Hungarian, Italian, Spanish and Turkish. The study involved three stages in each language; translation, cognitive debriefing (face and content validity) and validation. The validation stage assessed internal consistency (Cronbach's alpha), reproducibility (test-retest reliability using Spearman's rank correlations), convergent and divergent validity (correlations with the Health Assessment Questionnaire, The Western Ontario and McMaster Universities Index of osteoarthritis and Nottingham Health Profile) and known group validity. The OAQoL was successfully translated into the target languages with minimal problems. Cognitive debriefing interviewees found the measures easy to complete and identified few problems with content. Internal consistency ranged from 0.94 to 0.97 and test-retest reliability (reproducibility) from 0.87 to 0.98. These values indicate that the new language versions produce very low levels of measurement error. Median OAQoL scores were higher for patients reporting a current flare of osteoarthritis in all countries. Scores were also related, as expected, to perceived severity of osteoarthritis. The OAQoL was successfully adapted for use in Germany, Hungary, Italy, Spain and Turkey. The addition of these new language versions will prove valuable to multinational clinical trials and to clinical practice in the respective countries.

Are university rankings useful to improve research? A systematic review

PubMed Central

Momani, Shaher

2018-01-01

Introduction Concerns about reproducibility and impact of research urge improvement initiatives. Current university ranking systems evaluate and compare universities on measures of academic and research performance. Although often useful for marketing purposes, the value of ranking systems when examining quality and outcomes is unclear. The purpose of this study was to evaluate usefulness of ranking systems and identify opportunities to support research quality and performance improvement. Methods A systematic review of university ranking systems was conducted to investigate research performance and academic quality measures. Eligibility requirements included: inclusion of at least 100 doctoral granting institutions, be currently produced on an ongoing basis and include both global and US universities, publish rank calculation methodology in English and independently calculate ranks. Ranking systems must also include some measures of research outcomes. Indicators were abstracted and contrasted with basic quality improvement requirements. Exploration of aggregation methods, validity of research and academic quality indicators, and suitability for quality improvement within ranking systems were also conducted. Results A total of 24 ranking systems were identified and 13 eligible ranking systems were evaluated. Six of the 13 rankings are 100% focused on research performance. For those reporting weighting, 76% of the total ranks are attributed to research indicators, with 24% attributed to academic or teaching quality. Seven systems rely on reputation surveys and/or faculty and alumni awards. Rankings influence academic choice yet research performance measures are the most weighted indicators. There are no generally accepted academic quality indicators in ranking systems. Discussion No single ranking system provides a comprehensive evaluation of research and academic quality. Utilizing a combined approach of the Leiden, Thomson Reuters Most Innovative Universities, and the SCImago ranking systems may provide institutions with a more effective feedback for research improvement. Rankings which extensively rely on subjective reputation and “luxury” indicators, such as award winning faculty or alumni who are high ranking executives, are not well suited for academic or research performance improvement initiatives. Future efforts should better explore measurement of the university research performance through comprehensive and standardized indicators. This paper could serve as a general literature citation when one or more of university ranking systems are used in efforts to improve academic prominence and research performance. PMID:29513762

Interpreting Quality of Life after Brain Injury Scores: Cross-Walk with the Short Form-36.

PubMed

Wilson, Lindsay; Marsden-Loftus, Isaac; Koskinen, Sanna; Bakx, Wilbert; Bullinger, Monika; Formisano, Rita; Maas, Andrew; Neugebauer, Edmund; Powell, Jane; Sarajuuri, Jaana; Sasse, Nadine; von Steinbuechel, Nicole; von Wild, Klaus; Truelle, Jean-Luc

2017-01-01

The Quality of Life after Brain Injury (QOLIBRI) instruments are traumatic brain injury (TBI)-specific assessments of health-related quality of life (HRQoL), with established validity and reliability. The purpose of the study is to help improve the interpretability of the two QOLIBRI summary scores (the QOLIBRI Total score and the QOLBRI Overall Scale [OS] score). An analysis was conducted of 761 patients with TBI who took part in the QOLIBRI validation studies. A cross-walk between QOLIBRI scores and the SF-36 Mental Component Summary norm-based scoring system was performed using geometric mean regression analysis. The exercise supports a previous suggestion that QOLIBRI Total scores <60 indicate low or impaired HRQoL and indicate that the corresponding score on the QOLIBRI-OS is <52. The percentage of cases in the sample that fell into the "impaired HRQoL" category was 36% for the Mental Component Summary, 38% for the QOLIBRI Total, and 39% for the QOLIBRI-OS. Relationships between the QOLIBRI scales and the Glasgow Outcome Scale-Extended (GOSE), as a measure of global function, are presented in the form of means and standard deviations that allow comparison with other studies, and data on age and sex are presented for the QOLIBRI-OS. While bearing in mind the potential imprecision of the comparison, the findings provide a framework for evaluating QOLIBRI summary scores in relation to generic HRQoL that improves their interpretability.

Needs Assessment for the Use of NASA Remote Sensing Data in the Development and Implementation of Estuarine and Coastal Water Quality Standards

NASA Technical Reports Server (NTRS)

Spiering, Bruce; Underwood, Lauren; Ellis, Chris; Lehrter, John; Hagy, Jim; Schaeffer, Blake

2010-01-01

The goals of the project are to provide information from satellite remote sensing to support numeric nutrient criteria development and to determine data processing methods and data quality requirements to support nutrient criteria development and implementation. The approach is to identify water quality indicators that are used by decision makers to assess water quality and that are related to optical properties of the water; to develop remotely sensed data products based on algorithms relating remote sensing imagery to field-based observations of indicator values; to develop methods to assess estuarine water quality, including trends, spatial and temporal variability, and seasonality; and to develop tools to assist in the development and implementation of estuarine and coastal nutrient criteria. Additional slides present process, criteria development, typical data sources and analyses for criteria process, the power of remote sensing data for the process, examples from Pensacola Bay, spatial and temporal variability, pixel matchups, remote sensing validation, remote sensing in coastal waters, requirements for remotely sensed data products, and needs assessment. An additional presentation examines group engagement and information collection. Topics include needs assessment purpose and objectives, understanding water quality decision making, determining information requirements, and next steps.

Geospatial Modeling of Watershed Quality as an Indicator for Environmental Health

NASA Astrophysics Data System (ADS)

Archer, R.

2016-12-01

The impact of urbanization of rural Tennessee counties on environmental quality and human health and wellbeing has not been well studied, especially in the context of water quality. Between 2015 and 2025, Williamson County, TN is projected to see the strongest rate of population growth in the region, expanding by 33.7 percent. Water quality directly affects the condition of soils, vegetation, and other life forms that depend on water for survival, and therefore is a valid indicator of environmental health. Current reliable data is available on less than half (47%) of waterways in Tennessee. GIS is applied to model the impact of urbanization on rural communities within the Mill Creek watershed in Williamson County, Tennessee. Water quality measurements are integrated with data identifying urbanization and other land development influences assessed over a previous decades in order to identify influences of environmental change impacts on the watershed. The study examines the threat of urbanization to soils, vegetation and other related natural resources as well as the distance of farm areas, pasture grazing, cattle access and manure runoff, construction and landscaping to collection systems leading into the watershed. Combining spatial analysis with water quality interpretation helped to identify and display potential causes and sources of Mill Creek Watershed pollution as well as vulnerable locations susceptible to risk of declining environmental health.

Validation of the translation of an instrument to measure reliability of written information on treatment choices: a study on attention deficit/hyperactivity disorder (ADHD).

PubMed

Montoya, A; Llopis, N; Gilaberte, I

2011-12-01

DISCERN is an instrument designed to help patients assess the reliability of written information on treatment choices. Originally created in English, there is no validated Spanish version of this instrument. This study seeks to validate the Spanish translation of the DISCERN instrument used as a primary measure on a multicenter study aimed to assess the reliability of web-based information on treatment choices for attention deficit/hyperactivity disorder (ADHD). We used a modified version of a method for validating translated instruments in which the original source-language version is formally compared with the back-translated source-language version. Each item was ranked in terms of comparability of language, similarity of interpretability, and degree of understandability. Responses used Likert scales ranging from 1 to 7, where 1 indicates the best interpretability, language and understandability, and 7 indicates the worst. Assessments were performed by 20 raters fluent in the source language. The Spanish translation of DISCERN, based on ratings of comparability, interpretability and degree of understandability (mean score (SD): 1.8 (1.1), 1.4 (0.9) and 1.6 (1.1), respectively), was considered extremely comparable. All items received a score of less than three, therefore no further revision of the translation was needed. The validation process showed that the quality of DISCERN translation was high, validating the comparable language of the tool translated on assessing written information on treatment choices for ADHD.

Cross-cultural adaptation and validation of the Peripheral Artery Questionnaire: Korean version for patients with peripheral vascular diseases.

PubMed

Lee, Ji Hyun; Cho, Kyoung Im; Spertus, John; Kim, Seong Man

2012-08-01

The Peripheral Artery Questionnaire (PAQ), as developed in US English, is a validated scale to evaluate the health status of patients with peripheral artery disease (PAD). The aim of this study was to translate the PAQ into Korean and to evaluate its reliability and validity. A multi-step process of forward-translation, reconciliation, consultation with the developer, back-translation and proofreading was conducted. The test-retest reliability was evaluated at a 2-week interval using the intra-class correlation coefficient (ICC). The validity was assessed by identifying associations between Korean PAQ (KPAQ) scores and Korean Health Assessment Questionnaire (KHAQ) scores. A total of 100 PAD patients were enrolled: 63 without and 37 with severe claudication. The reliability of the KPAQ was adequate, with an ICC of 0.71. There were strong correlations between KPAQ's subscales. Cronbach's alpha for the summary score was 0.94, indicating good internal consistency and congruence with the original US version. The validity was supported by a significant correlation between the total KHAQ score and KPAQ physical function, stability, symptom, social limitation and quality of life scores (r = -0.24 to -0.90; p < 0.001) as well as between the KHAQ walking subscale and the KPAQ physical function score (r = -0.55, p < 0.001). Our results indicate that the KPAQ is a reliable, valid instrument to evaluate the health status of Korean patients with PAD.

Assessing the validity and reliability of the Malagasy version of Oral Impacts on Daily Performance (OIDP): a cross-sectional study.

PubMed

Razanamihaja, Noeline; Ranivoharilanto, Eva

2017-01-01

Evaluating health needs includes measures of the impact of state of health on the quality of life. This entails evaluating the psychosocial aspects of health. To achieve this, several tools for measuring the quality of life related to oral health have been developed. However, it is vital to evaluate the psychometric properties of these tools so they can be used in a new context and on a new population. The purpose of this study was to evaluate the reliability and validity of the Malagasy version of a questionnaire for studying the impacts of oral-dental health on daily activities (Oral Impacts on Daily Performance), and analyse the interrelations between the scores obtained and the oral health indicators. A cross-sectional study was performed for the transcultural adaptation of the Oral Impacts on Daily Performance questionnaire forward translated and back-translated from English to Malagasy and from Malagasy to English, respectively. The psychometric characteristics of the Malagasy version of the Oral Impacts on Daily Performance were then evaluated in terms of internal reliability, test-retest, and construct, criteria and discriminant validity. Four hundred and six adults responded in face-to-face interviews to the Malagasy version of the Oral Impacts on Daily Performance questionnaire. Nearly 74% of the participants indicated impacts of their oral health on their performance in their daily lives during the 6 months prior to the survey. The activities most affected were: "smiling", "eating" and "sleeping and relaxing". Cronbach's alpha was 0.87. The construct validity was demonstrated by a significant association between the Oral Impacts on Daily Performance scores and the subjective evaluation of oral health ( p <0.001). Discriminant validity was demonstrated by the fact that the Oral Impacts on Daily Performance scores were significantly higher in subjects with more than ten missing teeth, compared to those with fewer than ten missing teeth ( p  < 0.001). The Malagasy version of the Oral Impacts on Daily Performance index is a valid and reliable measure for use in Malagasy adults over 55 years old.

Validation of an instrument to measure moral distress within the Australian residential and community care environments.

PubMed

Burston, Adam; Eley, Robert; Parker, Deborah; Tuckett, Anthony

2017-06-01

The aim of this study was to gain insight into the experience of moral distress within the aged care workforce. The objective of this study was to use and validate an existing instrument to measure moral distress within the aged care setting. Moral distress, a phenomenon associated with worker satisfaction and retention, is common within nursing. Instruments to measure moral distress exist; however, there are no validated instruments to measure moral distress within an aged care setting. An existing instrument, the Moral Distress Scale (Revised) was identified and amended. Amendments were subject to expert review for face and content validity. Data were collected from aged care nurses working in residential and community aged care, in Australia. Reliability was assessed using Cronbach's alpha with exploratory factor analysis undertaken for construct validity. 106 participants completed the survey, 93 (87.7%) identified as female and 13 (12.3%) male. Participants ranged in age from 21 to 73 years, with a mean time working in nursing of 20.6 years. The frequency component of the instrument demonstrated an alpha of 0.89, the intensity component 0.95 and the instrument as a whole 0.94. Three factors were identified and labelled as: Quality of Care, Capacity of Team and Professional Practice. Mean scores indicate a low occurrence of moral distress, but this distress, when experienced, was felt with a moderate level of intensity. Primary causes of moral distress were insufficient staff competency levels, poor quality care because of poor communication and delays in implementing palliation. The instrument demonstrates validity and reliability within the Australian aged care setting. Further analysis with larger populations is required to support these findings. Australian aged care workers do experience moral distress. They suffer adverse consequences of this distress and quality of care is negatively impacted. This newly validated instrument can be used to quantify the occurrence of moral distress and to inform targeted interventions to reduce the occurrence and intensity of the experience. © 2016 John Wiley & Sons Ltd.

The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials.

PubMed

Yamato, Tie Parma; Maher, Chris; Koes, Bart; Moseley, Anne

2017-06-01

The Physiotherapy Evidence Database (PEDro) scale has been widely used to investigate methodological quality in physiotherapy randomized controlled trials; however, its validity has not been tested for pharmaceutical trials. The aim of this study was to investigate the validity and interrater reliability of the PEDro scale for pharmaceutical trials. The reliability was also examined for the Cochrane Back and Neck (CBN) Group risk of bias tool. This is a secondary analysis of data from a previous study. We considered randomized placebo controlled trials evaluating any pain medication for chronic spinal pain or osteoarthritis. Convergent validity was evaluated by correlating the PEDro score with the summary score of the CBN risk of bias tool. The construct validity was tested using a linear regression analysis to determine the degree to which the total PEDro score is associated with treatment effect sizes, journal impact factor, and the summary score for the CBN risk of bias tool. The interrater reliability was estimated using the Prevalence and Bias Adjusted Kappa coefficient and 95% confidence interval (CI) for the PEDro scale and CBN risk of bias tool. Fifty-three trials were included, with 91 treatment effect sizes included in the analyses. The correlation between PEDro scale and CBN risk of bias tool was 0.83 (95% CI 0.76-0.88) after adjusting for reliability, indicating strong convergence. The PEDro score was inversely associated with effect sizes, significantly associated with the summary score for the CBN risk of bias tool, and not associated with the journal impact factor. The interrater reliability for each item of the PEDro scale and CBN risk of bias tool was at least substantial for most items (>0.60). The intraclass correlation coefficient for the PEDro score was 0.80 (95% CI 0.68-0.88), and for the CBN, risk of bias tool was 0.81 (95% CI 0.69-0.88). There was evidence for the convergent and construct validity for the PEDro scale when used to evaluate methodological quality of pharmacological trials. Both risk of bias tools have acceptably high interrater reliability. Copyright © 2017 Elsevier Inc. All rights reserved.

Psychometric testing of the short version of the world health organization quality of life (WHOQOL-BREF) questionnaire among pulmonary tuberculosis patients in Taiwan

PubMed Central

2012-01-01

Background Studies on the effects of tuberculosis on a patient’s quality of life (QOL) are scant. The objective of this study was to evaluate the psychometric properties of the Taiwan short version of the World Health Organization Quality of Life (WHOQOL-BREF) questionnaire using patients with tuberculosis in Taiwan and healthy referents. Methods The Taiwanese short version of the WHOQOL-BREF was administered to patients with tuberculosis undergoing treatment and healthy referents from March 2007 to July 2007. Patients with tuberculosis (n = 140) and healthy referents (n = 130), matched by age, sex, and ethnicity, agreed to an interview. All participants lived in eastern Taiwan. Reliability assessments included internal consistency, whereas validity assessments included construct validity, convergent validity, and discriminant validity. Results More than half of these patients and referents were men (70.7% and 66.2%, respectively), and their average ages were 50.1 and 47.9 years, respectively. Approximately 60% of patients and referents were aboriginal Taiwanese (60.7% and 61.1%, respectively). The proportion with low socioeconomic status was greater for these patients. The internal consistency reliability coefficients were .92 and .93 for the patients and healthy referents, respectively. Exploratory factor analysis on the healthy referents displayed a 4-domain model, which was compatible with the original WHOQOL-BREF 4-domain model. However, for the TB patient group, after deleting 3 items, both exploratory and confirmatory factor analysis revealed a 6-domain model. Conclusion Psychometric evaluation of the Taiwan short version of the WHOQOL-BREF indicates that it has adequate reliability for use in research with TB patients in Taiwan. However, the factor structure generated from this TB patient sample differed from the WHO’s original 4-factor model, which raised a validity concern to apply the Taiwan short version of the WHOQOL-BREF to Taiwanese TB patients. Future research recruiting another sample to revisit this validity issue must be conducted to determine the validity of the WHOQOL-BREF TW in patients with TB. PMID:22877305

Validation of the German patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE™).

PubMed

Hagelstein, V; Ortland, I; Wilmer, A; Mitchell, S A; Jaehde, U

2016-12-01

Integrating the patient's perspective has become an increasingly important component of adverse event reporting. The National Cancer Institute has developed a Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE™). This instrument has been translated into German and linguistically validated; however, its quantitative measurement properties have not been evaluated. A German language survey that included 31 PRO-CTCAE items, as well as the EORTC QLQ-C30 and the Oral Mucositis Daily Questionnaire (OMDQ), was distributed at 10 cancer treatment settings in Germany and Austria. Item quality was assessed by analysis of acceptability and comprehensibility. Reliability was evaluated by using Cronbach's' alpha and validity by principal components analysis (PCA), multitrait-multimethod matrix (MTMM) and known groups validity techniques. Of 660 surveys distributed to the study centres, 271 were returned (return rate 41%), and data from 262 were available for analysis. Participants' median age was 59.7 years, and 69.5% of the patients were female. Analysis of item quality supported the comprehensibility of the 31 PRO-CTCAE items. Reliability was very good; Cronbach's' alpha correlation coefficients were >0.9 for almost all item clusters. Construct validity of the PRO-CTCAE core item set was shown by identifying 10 conceptually meaningful item clusters via PCA. Moreover, construct validity was confirmed by the MTMM: monotrait-heteromethod comparison showed 100% high correlation, whereas heterotrait-monomethod comparison indicated 0% high correlation. Known groups validity was supported; PRO-CTCAE scores were significantly lower for those with impaired versus preserved health-related quality of life. A set of 31 items drawn from the German PRO-CTCAE item library demonstrated favourable measurement properties. These findings add to the body of evidence that PRO-CTCAE provides a rigorous method to capture patient self-reports of symptomatic toxicity for use in cancer clinical trials. © The Author 2016. Published by Oxford University Press on behalf of the European Society for Medical Oncology. All rights reserved. For permissions, please email: journals.permissions@oup.com.

The EQ-5D-5L is a valid approach to measure health related quality of life in patients undergoing bariatric surgery.

PubMed

Fermont, Jilles M; Blazeby, Jane M; Rogers, Chris A; Wordsworth, Sarah

2017-01-01

Bariatric surgery is considered an effective treatment for individuals with severe and complex obesity. Besides reducing weight and improving obesity related comorbidities such as diabetes, bariatric surgery could improve patients' health-related quality of life. However, the frequently used instrument to measure quality of life, the EQ-5D has not been validated for use in bariatric surgery, which is a major limitation to its use in this clinical context. Our study undertook a psychometric validation of the 5 level EQ-5D (EQ-5D-5L) using clinical trial data to measure health-related quality of life in patients with severe and complex obesity undergoing bariatric surgery. Health-related quality of life was assessed at baseline (before randomisation) and six months later in 189 patients in a randomised controlled trial of bariatric surgery. Patients completed two generic health-related quality of life instruments, the EQ-5D-5L and SF-12, which were used together for the validation using data from all patients in the trial as the trial is ongoing. Psychometric analyses included construct and criterion validity and responsiveness to change. Of the 189 validation patients, 141 (75%) were female, the median age was 49 years old (range 23-70 years) and body mass index ranged from 33-70 kg/m2. For construct validity, there were significant improvements in the distribution of responses in all EQ-5D dimensions between baseline and 6 months after randomisation. For criterion validity, the highest degree of correlation was between the EQ-5D pain/discomfort and SF-12 bodily pain domain. For responsiveness the EQ-5D and SF-12 showed statistically significant improvements in health-related quality of life between baseline and 6 months after randomisation. The EQ-5D-5L is a valid generic measure for measuring health-related quality of life in bariatric surgery patients.

[Development of key indicators for nurses performance evaluation and estimation of their weights for management by objectives].

PubMed

Lee, Eun Hwa; Ahn, Sung Hee

2010-02-01

This methodological research was designed to develop performance evaluation key indicators (PEKIs) for management by objectives (MBO) and to estimate their weights for hospital nurses. The PEKIs were developed by selecting preliminary indicators from a literature review, examining content validity and identifying their level of importance. Data were collected from November 14, 2007 to February 18, 2008. Data set for importance of indicators was obtained from 464 nurses and weights of PEKIs domain was from 453 nurses, who worked for at least 2 yr in one of three hospitals. Data were analyzed using X(2)-test, factor analysis, and the Analytical Hierarchy Process. Based upon Content Validity Index of .8 or above, 61 indicators were selected from the 100 preliminary indicators. Finally, 40 PEKIs were developed from the 61 indicators, and categorized into 10 domains. The highest weight of the 10 domains was customer satisfaction, which was followed by patient education, direct nursing care, profit increase, safety management, improvement of nursing quality, completeness of nursing records, enhancing competence of nurses, indirect nursing care, and cost reduction, in that order. PEKIs and their weights can be utilized for impartial evaluation and MBO for hospital nurses. Further research to verify PEKIs would lead to successful implementation of MBO.

The quality improvement attitude survey: Development and preliminary psychometric characteristics.

PubMed

Dunagan, Pamela B

2017-12-01

To report the development of a tool to measure nurse's attitudes about quality improvement in their practice setting and to examine preliminary psychometric characteristics of the Quality Improvement Nursing Attitude Scale. Human factors such as nursing attitudes of complacency have been identified as root causes of sentinel events. Attitudes of nurses concerning use of Quality and Safety Education for nurse's competencies can be most challenging to teach and to change. No tool has been developed measuring attitudes of nurses concerning their role in quality improvement. A descriptive study design with preliminary psychometric evaluation was used to examine the preliminary psychometric characteristics of the Quality Improvement Nursing Attitude Scale. Registered bedside clinical nurses comprised the sample for the study (n = 57). Quantitative data were analysed using descriptive statistics and Cronbach's alpha reliability. Total score and individual item statistics were evaluated. Two open-ended items were used to collect statements about nurses' feelings regarding their experience in quality improvement efforts. Strong support for the internal consistency reliability and face validity of the Quality Improvement Nursing Attitude Scale was found. Total scale scores were high indicating nurse participants valued Quality and Safety Education for Nurse competencies in practice. However, item-level statistics indicated nurses felt powerless when other nurses deviate from care standards. Additionally, the sample indicated they did not consistently report patient safety issues and did not have a feeling of value in efforts to improve care. Findings suggested organisational culture fosters nurses' reporting safety issues and feeling valued in efforts to improve care. Participants' narrative comments and item analysis revealed the need to generate new items for the Quality Improvement Nursing Attitude Scale focused on nurses' perception of their importance in quality and safety and their power to enact principles. The Quality Improvement Nursing Attitude Scale-Revised edition was designed to help in understanding nurses' attitudes and values. It can be used to further explore broad concepts of quality improvement efforts. © 2017 John Wiley & Sons Ltd.

Development and validation of a rapid capillary zone electrophoresis method for the determination of aconite alkaloids in aconite roots.

PubMed

Song, Jing-Zheng; Han, Quan-Bin; Qiao, Chun-Feng; But, Paul Pui-Hay; Xu, Hong-Xi

2010-01-01

Aconites, with aconite alkaloids as the major therapeutic and toxic components, are used for the treatment of analgesic, antirheumatic and neurological symptoms. Quantification of the aconite alkaloids is important for the quality control of aconite-containing drugs. To establish a validated capillary zone electrophoresis (CZE) method for the simultaneous determination of six major alkaloids, namely aconitine, mesaconitine, hypaconitine, benzoylaconine, benzoylmesaconine and benzoylhypaconine, in crude and processed aconite roots. The CZE method was optimised and validated using a stability-indicating method. The optimised running buffer was a mixture of 200 mm Tris, 150 mm perchloric acid and 40% 1,4-dioxane (pH 7.8) with the capillary thermostated at 25 degrees C. Using the optimised method, six aconite alkaloids were well separated. The established method showed good precision, accuracy and recovery. Contents of these alkaloids in crude and processed aconites were determined and it was observed that the levels of individual alkaloids varied between samples. The developed CZE method was reliable for the quality control of aconites contained in herbal medicines. The method could also be used as an approach for toxicological studies.

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

Validation of Medical Tourism Service Quality Questionnaire (MTSQQ) for Iranian Hospitals

PubMed Central

Qolipour, Mohammad; Torabipour, Amin; Khiavi, Farzad Faraji; Malehi, Amal Saki

2017-01-01

Introduction Assessing service quality is one of the basic requirements to develop the medical tourism industry. There is no valid and reliable tool to measure service quality of medical tourism. This study aimed to determine the reliability and validity of a Persian version of medical tourism service quality questionnaire for Iranian hospitals. Methods To validate the medical tourism service quality questionnaire (MTSQQ), a cross-sectional study was conducted on 250 Iraqi patients referred to hospitals in Ahvaz (Iran) from 2015. To design a questionnaire and determine its content validity, the Delphi Technique (3 rounds) with the participation of 20 medical tourism experts was used. Construct validity of the questionnaire was assessed through exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach’s alpha coefficient. Data were analyzed by Excel 2007, SPSS version18, and Lisrel l8.0 software. Results The content validity of the questionnaire with CVI=0.775 was confirmed. According to exploratory factor analysis, the MTSQQ included 31 items and 8 dimensions (tangibility, reliability, responsiveness, assurance, empathy, exchange and travel facilities, technical and infrastructure facilities and safety and security). Construct validity of the questionnaire was confirmed, based on the goodness of fit quantities of model (RMSEA=0.032, CFI= 0.98, GFI=0.88). Cronbach’s alpha coefficient was 0.837 and 0.919 for expectation and perception questionnaire. Conclusion The results of the study showed that the medical tourism SERVQUAL questionnaire with 31 items and 8 dimensions was a valid and reliable tool to measure service quality of medical tourism in Iranian hospitals. PMID:28461863

Development and validation of a visual grading scale for assessing image quality of AP pelvis radiographic images.

PubMed

Mraity, Hussien A A B; England, Andrew; Cassidy, Simon; Eachus, Peter; Dominguez, Alejandro; Hogg, Peter

2016-01-01

The aim of this article was to apply psychometric theory to develop and validate a visual grading scale for assessing the visual perception of digital image quality anteroposterior (AP) pelvis. Psychometric theory was used to guide scale development. Seven phantom and seven cadaver images of visually and objectively predetermined quality were used to help assess scale reliability and validity. 151 volunteers scored phantom images, and 184 volunteers scored cadaver images. Factor analysis and Cronbach's alpha were used to assess scale validity and reliability. A 24-item scale was produced. Aggregated mean volunteer scores for each image correlated with the rank order of the visually and objectively predetermined image qualities. Scale items had good interitem correlation (≥0.2) and high factor loadings (≥0.3). Cronbach's alpha (reliability) revealed that the scale has acceptable levels of internal reliability for both phantom and cadaver images (α = 0.8 and 0.9, respectively). Factor analysis suggested that the scale is multidimensional (assessing multiple quality themes). This study represents the first full development and validation of a visual image quality scale using psychometric theory. It is likely that this scale will have clinical, training and research applications. This article presents data to create and validate visual grading scales for radiographic examinations. The visual grading scale, for AP pelvis examinations, can act as a validated tool for future research, teaching and clinical evaluations of image quality.

Development and validation of a visual grading scale for assessing image quality of AP pelvis radiographic images

PubMed Central

England, Andrew; Cassidy, Simon; Eachus, Peter; Dominguez, Alejandro; Hogg, Peter

2016-01-01

Objective: The aim of this article was to apply psychometric theory to develop and validate a visual grading scale for assessing the visual perception of digital image quality anteroposterior (AP) pelvis. Methods: Psychometric theory was used to guide scale development. Seven phantom and seven cadaver images of visually and objectively predetermined quality were used to help assess scale reliability and validity. 151 volunteers scored phantom images, and 184 volunteers scored cadaver images. Factor analysis and Cronbach's alpha were used to assess scale validity and reliability. Results: A 24-item scale was produced. Aggregated mean volunteer scores for each image correlated with the rank order of the visually and objectively predetermined image qualities. Scale items had good interitem correlation (≥0.2) and high factor loadings (≥0.3). Cronbach's alpha (reliability) revealed that the scale has acceptable levels of internal reliability for both phantom and cadaver images (α = 0.8 and 0.9, respectively). Factor analysis suggested that the scale is multidimensional (assessing multiple quality themes). Conclusion: This study represents the first full development and validation of a visual image quality scale using psychometric theory. It is likely that this scale will have clinical, training and research applications. Advances in knowledge: This article presents data to create and validate visual grading scales for radiographic examinations. The visual grading scale, for AP pelvis examinations, can act as a validated tool for future research, teaching and clinical evaluations of image quality. PMID:26943836

Improvement of a stability-indicating method by Quality-by-Design versus Quality-by-Testing: a case of a learning process.

PubMed

Hubert, C; Lebrun, P; Houari, S; Ziemons, E; Rozet, E; Hubert, Ph

2014-01-01

The understanding of the method is a major concern when developing a stability-indicating method and even more so when dealing with impurity assays from complex matrices. In the presented case study, a Quality-by-Design approach was applied in order to optimize a routinely used method. An analytical issue occurring at the last stage of a long-term stability study involving unexpected impurities perturbing the monitoring of characterized impurities needed to be resolved. A compliant Quality-by-Design (QbD) methodology based on a Design of Experiments (DoE) approach was evaluated within the framework of a Liquid Chromatography (LC) method. This approach allows the investigation of Critical Process Parameters (CPPs), which have an impact on Critical Quality Attributes (CQAs) and, consequently, on LC selectivity. Using polynomial regression response modeling as well as Monte Carlo simulations for error propagation, Design Space (DS) was computed in order to determine robust working conditions for the developed stability-indicating method. This QbD compliant development was conducted in two phases allowing the use of the Design Space knowledge acquired during the first phase to define the experimental domain of the second phase, which constitutes a learning process. The selected working condition was then fully validated using accuracy profiles based on statistical tolerance intervals in order to evaluate the reliability of the results generated by this LC/ESI-MS stability-indicating method. A comparison was made between the traditional Quality-by-Testing (QbT) approach and the QbD strategy, highlighting the benefit of this QbD strategy in the case of an unexpected impurities issue. On this basis, the advantages of a systematic use of the QbD methodology were discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

Chinese version of the treatment of autoimmune bullous disease quality of life questionnaire: Reliability and validity.

PubMed

Chen, Guo; Yang, Baoqi; Zhang, Zhaoxia; Yang, Qing; Yan, Xiaoxiao; Murrell, Dédée F; Zhang, Furen

2018-01-01

Treatments for autoimmune blistering disease carry significant risks of medical complications and can affect the patient's quality of life. Recently, the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire was developed in Australia. The objective of this study was to evaluate the reliability and validity of the Chinese version of the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire in Chinese patients with autoimmune blistering diseases. The Chinese version of the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire was produced by forward-backward translation and cross-cultural adaptation of the original English version. Autoimmune blistering disease patients recruited in the study self-administered the Chinese Treatment of Autoimmune Bullous Disease Quality of Life questionnaire, the Dermatology Life Quality Index and the 36-item Short-Form Health Survey. Reliability of the Chinese Treatment of Autoimmune Bullous Disease Quality of Life was evaluated using internal consistency and test-retest (days 0 and 7) methods. Validity was analyzed by face, content, construct, convergent and discriminant validity measures. A total of 86 autoimmune blistering disease patients were recruited for the study. Cronbach's alpha coefficient was 0.883 and the intraclass correlation coefficient was 0.871. Face and content validities were satisfactory. Convergent validity testing revealed correlation coefficients of 0.664 for the Treatment of Autoimmune Bullous Disease Quality of Life and Dermatology Life Quality Index and -0.577 for the Treatment of Autoimmune Bullous Disease Quality of Life and 36-item Short-Form Health Survey. With respect to discriminant validity, no significant differences were observed in the Treatment of Autoimmune Bullous Disease Quality of Life scores of men and women (t = 0.251, P = 0.802), inpatients and outpatients (t = 0.447, P = 0.656), patients on steroids and steroid-sparing medications (t = 0.672, P = 0.503) and patients with different autoimmune blistering disease subtypes (F = 0.030, P = 0.971). Illiterate patients were excluded from the study. The patients were from a single hospital and most of their conditions were in a relatively stable status. The Chinese version of the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire is a reliable and valid instrument to measure treatment burden and to serve as an end point in clinical trials in Chinese autoimmune blistering disease patients.

A new approach to assess movements and isometric postures of spine and trunk at the workplace.

PubMed

Wunderlich, Max; Rüther, Thomas; Essfeld, Dieter; Erren, Thomas C; Piekarski, Claus; Leyk, Dieter

2011-08-01

Low back pain is regarded as the primary cause of occupational disability in many countries worldwide. However, there is a lack of valid assessment of kinematic spine and trunk parameters to provide further insight into occupational spine loads. A new 3-dimensional mobile measurement system (3D-SpineMoveGuard) was developed and evaluated by means of repeated dynamic and isometric trunk positions by 10 male and 10 female volunteers. The interclass correlation coefficient indicates high test-retest reliability (r = 0.975-0.999) of the 3D-SpineMoveGuard. Moreover, analysis of validity revealed almost identical results for the new measurement system. The evaluation study indicates a good scientific quality for the use in occupational task analyses. The objective assessment of indirectly measured spine and trunk kinematics will give further insight to predict and prevent job-related spine loads.

Psychometric evaluation of the Multidimensional Assessment of Fatigue scale for use with pregnant and postpartum women.

PubMed

Fairbrother, Nichole; Hutton, Eileen K; Stoll, Kathrin; Hall, Wendy; Kluka, Sandy

2008-06-01

Although fatigue is a common experience for pregnant women and new mothers, few measures of fatigue have been validated for use with this population. To address this gap, the authors assessed psychometric properties of the Multidimensional Assessment of Fatigue (MAF) scale, which was used in 2 independent samples of pregnant women. Results indicated that the psychometric properties of the scale were very similar across samples and time points. The scale possesses a high level of internal consistency, has good convergent validity with measures of sleep quality and depression, and discriminates well from a measure of social support. Contrary to previous evaluations of the MAF, data strongly suggest that the scale represents a unidimensional construct best represented by a single factor. Results indicate that the MAF is a useful measure of fatigue among pregnant and postpartum women.

Organizational culture and organizational effectiveness: a meta-analytic investigation of the competing values framework's theoretical suppositions.

PubMed

Hartnell, Chad A; Ou, Amy Yi; Kinicki, Angelo

2011-07-01

We apply Quinn and Rohrbaugh's (1983) competing values framework (CVF) as an organizing taxonomy to meta-analytically test hypotheses about the relationship between 3 culture types and 3 major indices of organizational effectiveness (employee attitudes, operational performance [i.e., innovation and product and service quality], and financial performance). The paper also tests theoretical suppositions undergirding the CVF by investigating the framework's nomological validity and proposed internal structure (i.e., interrelationships among culture types). Results based on data from 84 empirical studies with 94 independent samples indicate that clan, adhocracy, and market cultures are differentially and positively associated with the effectiveness criteria, though not always as hypothesized. The findings provide mixed support for the CVF's nomological validity and fail to support aspects of the CVF's proposed internal structure. We propose an alternative theoretical approach to the CVF and delineate directions for future research.

Towards a full integration of optimization and validation phases: An analytical-quality-by-design approach.

PubMed

Hubert, C; Houari, S; Rozet, E; Lebrun, P; Hubert, Ph

2015-05-22

When using an analytical method, defining an analytical target profile (ATP) focused on quantitative performance represents a key input, and this will drive the method development process. In this context, two case studies were selected in order to demonstrate the potential of a quality-by-design (QbD) strategy when applied to two specific phases of the method lifecycle: the pre-validation study and the validation step. The first case study focused on the improvement of a liquid chromatography (LC) coupled to mass spectrometry (MS) stability-indicating method by the means of the QbD concept. The design of experiments (DoE) conducted during the optimization step (i.e. determination of the qualitative design space (DS)) was performed a posteriori. Additional experiments were performed in order to simultaneously conduct the pre-validation study to assist in defining the DoE to be conducted during the formal validation step. This predicted protocol was compared to the one used during the formal validation. A second case study based on the LC/MS-MS determination of glucosamine and galactosamine in human plasma was considered in order to illustrate an innovative strategy allowing the QbD methodology to be incorporated during the validation phase. An operational space, defined by the qualitative DS, was considered during the validation process rather than a specific set of working conditions as conventionally performed. Results of all the validation parameters conventionally studied were compared to those obtained with this innovative approach for glucosamine and galactosamine. Using this strategy, qualitative and quantitative information were obtained. Consequently, an analyst using this approach would be able to select with great confidence several working conditions within the operational space rather than a given condition for the routine use of the method. This innovative strategy combines both a learning process and a thorough assessment of the risk involved. Copyright © 2015 Elsevier B.V. All rights reserved.

Quality of life in children with epilepsy.

PubMed

Aggarwal, Anju; Datta, Varsha; Thakur, L C

2011-11-11

Quality of life was assessed in 108 epileptic children (6-15 years) using a hindi translation of Quality of Life in Children with Epilepsy (QOLCE) questionnaire. The questionnaire consist of 76 items with 16 subscales covering five domains of life: physical function, social function, cognition, emotional and behavioral well being. Overall score was 62.62±21.32. Chronbachs-a for all 13 multi-item subscales was above 0.70, indicating good internal consistency and reliability. Pearson correlation revealed good construct validity. Overall quality of life was affected by age, type of epilepsy, seizure frequency and maternal education (P<0.05). Energy levels, language and attention (P<0.05) were better in older children whereas younger children had better self esteem and lower levels of anxiety. Seizure frequency compromised all fields except stigma, attention, and energy levels (P>0.05).

Development and validation testing of a short nutrition questionnaire to identify dietary risk factors in preschoolers aged 12–36 months

PubMed Central

Rice, Niamh; Gibbons, Helena; McNulty, Breige A.; Walton, Janette; Flynn, Albert; Gibney, Michael J.; Nugent, Anne P.

2015-01-01

Background Although imbalances in dietary intakes can have short and longer term influences on the health of preschool children, few tools exist to quickly and easily identify nutritional risk in otherwise healthy young children. Objectives To develop and test the validity of a parent-administered questionnaire (NutricheQ) as a means of evaluating dietary risk in young children (12–36 months). Design Following a comprehensive development process and internal reliability assessment, the NutricheQ questionnaire was validated in a cohort of 371 Irish preschool children as part of the National Preschool Nutrition Survey. Dietary risk was rated on a scale ranging from 0 to 22 from 11 questions, with a higher score indicating higher risk. Results Children with higher NutricheQ scores had significantly (p<0.05) lower mean daily intakes of key nutrients such as iron, zinc, vitamin D, riboflavin, niacin, folate, phosphorous, potassium, carotene, retinol, and dietary fibre. They also had lower (p<0.05) intakes of vegetables, fish and fish dishes, meat and infant/toddler milks and higher intakes of processed foods and non-milk beverages, confectionery, sugars and savoury snack foods indicative of poorer dietary quality. Areas under the curve values of 84.7 and 75.6% were achieved for ‘medium’ and ‘high’ dietary risk when compared with expert risk ratings indicating good consistency between the two methods. Conclusion NutricheQ is a valid method of quickly assessing dietary quality in preschoolers and in identifying those at increased nutritional risk. In Context Analysis of data from national food and nutrition surveys typically identifies shortfalls in dietary intakes or quality of young children. This can relate to intakes of micronutrients such as iron or vitamin D as well as to the balance of macronutrients they consume (e.g. fat or sugar). Alongside this lie concerns regarding overweight and obesity and physical inactivity. This combination of risk factors has potential negative effects for both short and longer term health. Hence, screening tools, such as NutricheQ described here, offer an opportunity for early identification and subsequent appropriate timely intervention from 12 months of age. This paper describes the development and validation of NutricheQ, a short user-friendly questionnaire. Designed to be administered by parents or carers, it aims to help healthcare professionals identify children at risk based on known, evidence-based nutritional risk factors. It is hoped in the longer term that this tool can be adapted for use globally and improve child health through early identification, which can be followed up by targeted, cost-effective interventions. PMID:26058751

A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS).

PubMed

Dambi, Jermaine M; Corten, Lieselotte; Chiwaridzo, Matthew; Jack, Helen; Mlambo, Tecla; Jelsma, Jennifer

2018-05-02

Social support (SS) has been identified as an essential buffer to stressful life events. Consequently, there has been a surge in the evaluation of SS as a wellbeing indicator. The Multidimensional Perceived Social Support Scale (MSPSS) has evolved as one of the most extensively translated and validated social support outcome measures. Due to linguistic and cultural differences, there is need to test the psychometrics of the adapted versions. However, there is a paucity of systematic evidence of the psychometrics of adapted and translated versions of the MSPSS across settings. To understand the psychometric properties of the MSPSS for non-English speaking populations by conducting a systematic review of studies that examine the psychometric properties of non-English versions of the MSPSS. We searched Africa-Wide Information, CINAHL, Medline and PsycINFO, for articles published in English on the translation and or validation of the MSPSS. Methodological quality and quality of psychometric properties of the retrieved translations were assessed using the COSMIN checklist and a validated quality assessment criterion, respectively. The two assessments were combined to produce the best level of evidence per language/translation. Seventy articles evaluating the MSPSS in 22 languages were retrieved. Most translations [16/22] were not rigorously translated (only solitary backward-forward translations were performed, reconciliation was poorly described, or were not pretested). There was poor evidence for structural validity, as confirmatory factor analysis was performed in only nine studies. Internal consistency was reported in all studies. Most attained a Cronbach's alpha of at least 0.70 against a backdrop of fair methodological quality. There was poor evidence for construct validity. There is limited evidence supporting the psychometric robustness of the translated versions of the MSPSS, and given the variability, the individual psychometrics of a translation must be considered prior to use. Responsiveness, measurement error and cut-off values should also be assessed to increase the clinical utility and psychometric robustness of the translated versions of the MSPSS. PROSPERO - CRD42016052394.

Ride qualities criteria validation/pilot performance study: Flight test results

NASA Technical Reports Server (NTRS)

Nardi, L. U.; Kawana, H. Y.; Greek, D. C.

1979-01-01

Pilot performance during a terrain following flight was studied for ride quality criteria validation. Data from manual and automatic terrain following operations conducted during low level penetrations were analyzed to determine the effect of ride qualities on crew performance. The conditions analyzed included varying levels of turbulence, terrain roughness, and mission duration with a ride smoothing system on and off. Limited validation of the B-1 ride quality criteria and some of the first order interactions between ride qualities and pilot/vehicle performance are highlighted. An earlier B-1 flight simulation program correlated well with the flight test results.

[Quality prescription indicators in defined daily doses. Are we getting it right?].

PubMed

Caamaño-Isorna, Francisco; Alvarez-Gil, Rosa

2008-01-01

Quality prescription indicators of use potential level (UPLI) are defined as the proportion that represents consumption of specific active principles as opposed to the total consumption of the anatomical therapeutic category. The UPLIs that have gradually been defined in Spain employ the defined daily dose (DDD) as the unit of measurement. Although the DDD is not necessarily the same as the therapeutic equivalent dose (TED), some authors have argued that the DDD is a standard unit of measurement and is therefore valid. However, this view may not be correct, given that the relationships between the TED and the DDD differ, depending on the drug, even within the same anatomical therapeutic category. Therefore, the use of DDDs in UPLI s may lead to prescription of a medicine being encouraged or discouraged depending on its TED/DDD ratio.

Comparison of Methods for Estimating Prevalence of Chronic Diseases and Health Behaviors for Small Geographic Areas: Boston Validation Study, 2013

PubMed Central

Holt, James B.; Zhang, Xingyou; Lu, Hua; Shah, Snehal N.; Dooley, Daniel P.; Matthews, Kevin A.; Croft, Janet B.

2017-01-01

Introduction Local health authorities need small-area estimates for prevalence of chronic diseases and health behaviors for multiple purposes. We generated city-level and census-tract–level prevalence estimates of 27 measures for the 500 largest US cities. Methods To validate the methodology, we constructed multilevel logistic regressions to predict 10 selected health indicators among adults aged 18 years or older by using 2013 Behavioral Risk Factor Surveillance System (BRFSS) data; we applied their predicted probabilities to census population data to generate city-level, neighborhood-level, and zip-code–level estimates for the city of Boston, Massachusetts. Results By comparing the predicted estimates with their corresponding direct estimates from a locally administered survey (Boston BRFSS 2010 and 2013), we found that our model-based estimates for most of the selected health indicators at the city level were close to the direct estimates from the local survey. We also found strong correlation between the model-based estimates and direct survey estimates at neighborhood and zip code levels for most indicators. Conclusion Findings suggest that our model-based estimates are reliable and valid at the city level for certain health outcomes. Local health authorities can use the neighborhood-level estimates if high quality local health survey data are not otherwise available. PMID:29049020

Asthma and Air Quality in the Presence of Fires - A Foundation for Public Health Policy in Florida

NASA Technical Reports Server (NTRS)

Crosson, William; Al-Hamdan, Mohammad; Estes, Maurice, Jr.; Estes, Sue; Luvall, Jeffrey; Sifford, Cody; Young, Linda

2012-01-01

Outdoor air quality and its associated impacts on respiratory problems in Florida are of public health significance. Air quality in Florida can be poor during the extended wildfire season, threatening persons with compromised respiratory systems each year. Studies have demonstrated that particulate matter, which is generally elevated in the vicinity of wildfires, is associated with increases in hospital admissions and occurrences of acute asthma exacerbations. However, few studies have examined the modifying effect of socio-demographic characteristics of cities or regional areas on the relationship between air quality and health outcomes. In an ongoing university/multi-agency project, asthma hospital/emergency room (patient) data are being used to create a health outcome indicator of human response to environmental air quality. Environmental data are derived from satellite measurements, with special attention being given to the effect of wildfires and prescribed burns on air quality. This presentation will focus on the environmental data sets particulate matter, location of fires, smoke plumes that are being collected and processed for linkage with health data. After this linkage has been performed, space-time models of asthma rates as a function of air quality data and socio-demographic variables will be developed and validated. The Florida Department of Health (FDOH) will work with county health department staff and representatives from the medical community to establish a protocol with triggers for issuing public health advisories/alerts based on the developed and validated health outcome indicators. From this effort, a science-based policy for issuing public health advisories/alerts for asthma relating to air quality will be developed, giving FDOH the ability to (1) predict, with stated levels of uncertainty, case load of hospital admissions based on air quality, (2) reduce asthma exacerbations by forewarning asthmatics to limit outside activities on poor air quality days, (3) apply management practices on the rates of hospital/emergency room visits for asthma, and (4) provide information that would help translate interventions into policy decisions, thereby reducing the economic burden and increasing well being of asthmatics. Further, the results of the study will be incorporated into Florida s Environmental Public Health Tracking (EPHT) program, which is part of the Centers for Disease Control and Prevention's (CDC's) EPHT network.

The Quality of Life in Hand Eczema Questionnaire (QOLHEQ): validation of the German version of a new disease-specific measure of quality of life for patients with hand eczema.

PubMed

Ofenloch, R F; Weisshaar, E; Dumke, A-K; Molin, S; Diepgen, T L; Apfelbacher, C

2014-08-01

Health-related quality of life (HRQOL) is widely used as a patient-reported outcome to evaluate clinical trials. In routine care it can also be used to improve treatment strategies or to enhance patients' self-awareness and empowerment. Therefore a disease-specific instrument is needed that assesses in detail all the impairments caused by the disease of interest. For patients with hand eczema (HE) such an instrument was developed by an international expert group, but its measurement properties are unknown. To validate the German version of the Quality of Life in Hand Eczema Questionnaire (QOLHEQ), which covers the domains of (i) symptoms, (ii) emotions, (iii) functioning and (iv) treatment and prevention. The QOLHEQ was assessed up to three times in 316 patients with HE to test reliability and sensitivity to change. To test construct validity we also assessed several reference measures. The scale structure was analysed using the Rasch model for each subscale and a structural equation model was used to test the multi domain structure of the QOLHEQ. After minor adaptions of the scoring structure, all four subscales of the QOLHEQ did not significantly misfit the Rasch model (α > 0·05). The fit indices of the structural equation model showed a good fit of the multi domain construct with four subscales assessing HRQOL. Nearly all a priori-defined hypotheses relating to construct validity could be confirmed. The QOLHEQ showed a sensitivity to change that was superior compared with all reference measures. The QOLHEQ is ready to be used in its German version as a sensitive outcome measure in clinical trials and for routine monitoring. The treatment-relevant subscales enable its use to enhance patients' self-awareness and to monitor treatment decisions. © 2014 British Association of Dermatologists.

An Examination of the Food Allergy Quality of Life Questionnaire Performance in a Countrywide American Sample of Children: Cross-Cultural Differences in Age and Impact in the United States and Europe.

PubMed

DunnGalvin, Audrey; Koman, Elizabeth; Raver, Elizabeth; Frome, Hayley; Adams, Melissa; Keena, Aisleen; Hourihane, Jonathan O'B; Gallagher, Patricia Leahy; Flokstra-de Blok, Bertine; Dubois, Anthony; Pyrz, Katarzyna; Bindslev-Jensen, Cartsen; Stensgaard, Anette; Boyle, Robert; Vickers, Bea; Smith, Jared; Thisanayagam, Umasunthar; Greenhawt, Matthew

It is important to ensure that tools are valid and reliable in the context in which they are used. The development of age and country norms is part of this process. The primary aim of the present study was to examine the performance of the Food Allergy Quality of Life Questionnaire - Parent Form (FAQLQ-PF) in a countrywide American sample of children with food allergy. The secondary aim was to compare age differences in impact across 9 European countries. In a cross-sectional quantitative design, questionnaires were completed by the parents of 1029 food-allergic children (0-12 years). Participants were recruited via support groups and allergists. Data were analyzed by using multivariate analysis of variance and tests for internal consistency and validity. The average score was calculated for each age group in 15 studies in Ireland, Switzerland, the Netherlands, Spain, Portugal, Germany, Italy, Denmark, Israel, and the United Kingdom. The FAQLQ-PF has high convergent validity (child: r = 0.49, n = 695, P = .01; parent: r = 0.36, n = 696, P = .01) and discriminant validity, parent: t (719) = 4.67, P = .001 (anaphylaxis yes vs no); t (513), P = .009 (single vs multiple allergens). Internal consistency was excellent (r = 0.96). US health-related quality of life was worse than European health-related quality of life, as indicated by higher FAQLQ-PF scores in US samples. Burden increased with age in all populations. The FAQLQ-PF is appropriate for use in an American population. Findings will form the basis for further work in the development of an online manual with food allergy-normed age scores to allow for precise measurement, interpretation of scores, and comparison across countries and cultures, in clinical and research settings. Copyright © 2016 American Academy of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.

The development and validation of a health-related quality of life questionnaire for pre-school children with a chronic heart disease.

PubMed

Niemitz, M; Seitz, D C M; Oebels, M; Schranz, D; Hövels-Gürich, H; Hofbeck, M; Kaulitz, R; Galm, C; Berger, F; Nagdymann, N; Stiller, B; Borth-Bruhns, T; Konzag, I; Balmer, C; Goldbeck, L

2013-12-01

Heart diseases are often associated with residual injuries, persisting functional restrictions, and long-term sequelae for psychosocial development. Currently, there are no disease-specific instruments to assess the health-related quality of life (HrQoL) of pre-school children. The aims of this study were to develop a parent proxy instrument to measure the HrQoL of children aged 3-7 years with a heart disease and to confirm its validity and reliability. Items from the Preschool Pediatric Cardiac Quality of Life Inventory (P-PCQLI) were generated through focus groups of caregivers. In a pilot study, comprehensibility and feasibility were tested. Five subdimensions were defined theoretically. Psychometric properties were analysed within a multicentre study with 167 parental caregivers. The final 52-item instrument contains a total score covering five moderately inter-correlated dimensions. The total score of the questionnaire showed a very high internal consistency (Cronbachs' α = 0.95). Test-retest correlation was at r tt = 0.96. External validity was indicated by higher correlations (r = 0.24-0.68) with a generic paediatric quality of life questionnaire (KINDL) compared to the Strengths and Difficulties Questionnaire (r = 0.17 to 0.59). Low P-PCQLI total scores were significantly associated with inpatient as opposed to outpatient treatment (t = 6.04, p < .001), with at least moderate disease severity ((t = 5.05, p < .001) NYHA classification) and with poorer prognosis (t = 5.53, p < .001) as estimated by the physician. The P-PCQLI is reliable and valid for pre-school children with a heart disease. It could be used as a screening instrument in routine care, and for evaluation of HrQoL outcomes in clinical trials and intervention research.

[Indicators of healthcare quality in day surgery (2010-2012)].

PubMed

Martínez Rodenas, F; Codina Grifell, J; Deulofeu Quintana, P; Garrido Corchón, J; Blasco Casares, F; Gibanel Garanto, X; Cuixart Vilamajó, L; de Haro Licer, J; Vazquez Dorrego, X

2014-01-01

Monitoring quality indicators in Ambulatory Surgery centers is fundamental in order to identify problems, correct them and prevent them. Given their large number, it is essential to select the most valid ones. The objectives of the study are the continuous improvement in the quality of healthcare of day-case surgery in our center, by monitoring selective quality parameters, having periodic information on the results and taking corrective measures, as well as achieving a percentage of unplanned transfer and cancellations within quality standards. Prospective, observational and descriptive study of the day-case surgery carried out from January 2010 to December 2012. Unplanned hospital admissions and cancellations on the same day of the operation were selected and monitored, along with their reasons. Hospital admissions were classified as: inappropriate selection, medical-surgical complications, and others. The results were evaluated each year and statistically analysed using χ(2) tests. A total of 8,300 patients underwent day surgery during the 3 years studied. The day-case surgery and outpatient index increased by 5.4 and 6.4%, respectively (P<.01). Unexpected hospital admissions gradually decreased due to the lower number of complications (P<.01). Hospital admissions, due to an extended period of time in locoregional anaesthesia recovery, also decreased (P<.01). There was improved prevention of nausea and vomiting, and of poorly controlled pain. The proportion of afternoon admissions was significantly reduced (P<.01). The cancellations increased in 2011 (P<.01). The monitoring of quality parameters in day-case surgery has been a useful tool in our clinical and quality management. Globally, the unplanned transfer and cancellations have been within the quality standards and many of the indicators analysed have improved. Copyright © 2013 SECA. Published by Elsevier Espana. All rights reserved.

Screening for important unwarranted variation in clinical practice: a triple-test of processes of care, costs and patient outcomes.

PubMed

Partington, Andrew; Chew, Derek P; Ben-Tovim, David; Horsfall, Matthew; Hakendorf, Paul; Karnon, Jonathan

2017-03-01

Objective Unwarranted variation in clinical practice is a target for quality improvement in health care, but there is no consensus on how to identify such variation or to assess the potential value of initiatives to improve quality in these areas. This study illustrates the use of a triple test, namely the comparative analysis of processes of care, costs and outcomes, to identify and assess the burden of unwarranted variation in clinical practice. Methods Routinely collected hospital and mortality data were linked for patients presenting with symptoms suggestive of acute coronary syndromes at the emergency departments of four public hospitals in South Australia. Multiple regression models analysed variation in re-admissions and mortality at 30 days and 12 months, patient costs and multiple process indicators. Results After casemix adjustment, an outlier hospital with statistically significantly poorer outcomes and higher costs was identified. Key process indicators included admission patterns, use of invasive diagnostic procedures and length of stay. Performance varied according to patients' presenting characteristics and time of presentation. Conclusions The joint analysis of processes, outcomes and costs as alternative measures of performance inform the importance of reducing variation in clinical practice, as well as identifying specific targets for quality improvement along clinical pathways. Such analyses could be undertaken across a wide range of clinical areas to inform the potential value and prioritisation of quality improvement initiatives. What is known about the topic? Variation in clinical practice is a long-standing issue that has been analysed from many different perspectives. It is neither possible nor desirable to address all forms of variation in clinical practice: the focus should be on identifying important unwarranted variation to inform actions to reduce variation and improve quality. What does this paper add? This paper proposes the comparative analysis of processes of care, costs and outcomes for patients with similar diagnoses presenting at alternative hospitals, using linked, routinely collected data. This triple test of performance indicators extracts maximum value from routine data to identify priority areas for quality improvement to reduce important and unwarranted variations in clinical practice. What are the implications for practitioners? The proposed analyses need to be applied to other clinical areas to demonstrate the general application of the methods. The outputs can then be validated through the application of quality improvement initiatives in clinical areas with identified important and unwarranted variation. Validated frameworks for the comparative analysis of clinical practice provide an efficient approach to valuing and prioritising actions to improve health service quality.

Measuring up: Implementing a dental quality measure in the electronic health record context.

PubMed

Bhardwaj, Aarti; Ramoni, Rachel; Kalenderian, Elsbeth; Neumann, Ana; Hebballi, Nutan B; White, Joel M; McClellan, Lyle; Walji, Muhammad F

2016-01-01

Quality improvement requires using quality measures that can be implemented in a valid manner. Using guidelines set forth by the Meaningful Use portion of the Health Information Technology for Economic and Clinical Health Act, the authors assessed the feasibility and performance of an automated electronic Meaningful Use dental clinical quality measure to determine the percentage of children who received fluoride varnish. The authors defined how to implement the automated measure queries in a dental electronic health record. Within records identified through automated query, the authors manually reviewed a subsample to assess the performance of the query. The automated query results revealed that 71.0% of patients had fluoride varnish compared with the manual chart review results that indicated 77.6% of patients had fluoride varnish. The automated quality measure performance results indicated 90.5% sensitivity, 90.8% specificity, 96.9% positive predictive value, and 75.2% negative predictive value. The authors' findings support the feasibility of using automated dental quality measure queries in the context of sufficient structured data. Information noted only in free text rather than in structured data would require using natural language processing approaches to effectively query electronic health records. To participate in self-directed quality improvement, dental clinicians must embrace the accountability era. Commitment to quality will require enhanced documentation to support near-term automated calculation of quality measures. Copyright © 2016 American Dental Association. Published by Elsevier Inc. All rights reserved.

Tools used for evaluation of Brazilian children's quality of life

PubMed Central

Souza, João Gabriel S.; Pamponet, Marcela Antunes; Souza, Tamirys Caroline S.; Pereira, Alessandra Ribeiro; Souza, Andrey George S.; Martins, Andréa Maria E. de B. L.

2014-01-01

OBJECTIVE: To review the available tools to evaluate children's quality of life validated for Brazilian language and culture. DATA SOURCES: Search of scientific articles in Medline, Lilacs and SciELO databases using the combination of descriptors "quality of life", "child" and "questionnaires" in Portuguese and English. DATA SYNTHESIS: Among the tools designed to assess children's quality of life validated for the Brazilian language and culture, the Auto questionnaire Qualité de Vie Enfant Imagé (AUQEI), the Child Health Questionnaire - Parent Form 50 (CHQ-PF50), the Pediatric Quality of Life Inventory (PedsQL(tm)) version 4.0 and the Kidscreen-52 are highlighted. Some tools do not include all range of ages and some lack domains that are currently considered relevant in the context of childhood, such as bullying. Moreover, due to the cultural diversity of Brazil, it may be necessary to adapt some instruments or to validate other tools. CONCLUSIONS: There are validated instruments to evaluate children's quality of life in Brazil. However, the validation or the adaptation of other international tools have to be considered in order to overcome current deficiencies. PMID:25119761

Further validation of the Health Promoting Activities Scale with mothers of typically developing children.

PubMed

Bourke-Taylor, Helen; Lalor, Aislinn; Farnworth, Louise; Pallant, Julie F

2014-10-01

The Health Promoting Activities Scale (HPAS) measures the frequency that mothers participate in self-selected leisure activities that promote health and wellbeing. The scale was originally validated on mothers of school-aged children with disabilities, and the current article extends this research using a comparative sample of mothers of typically developing school-aged children. Australian mothers (N = 263) completed a questionnaire containing the HPAS, a measure of depression, anxiety and stress (DASS-21) and questions concerning their weight, height, sleep quality and demographics. Statistical analysis assessed the underlying structure, internal consistency and construct validity of the HPAS. Inferential statistics were utilised to investigate the construct validity. Exploratory factor analysis supported the unidimensionality of the HPAS. It showed good internal consistency (Cronbach's alpha = 0.78). Significantly lower HPAS scores were recorded for women who were obese; had elevated levels of depression, anxiety and stress; had poor quality sleep or had heavy caring commitments. The mean HPAS score in this sample (M = 32.2) was significantly higher than was previously reported for women of children with a disability (M = 21.6: P < 0.001). Further psychometric evaluation of the HPAS continues to support the HPAS as a sound instrument that measures the frequency that women participate in meaningful occupation that is associated with differences in mental health and wellbeing and other health indicators. © 2014 Occupational Therapy Australia.

Uterine Fibroid Symptom - Quality of Life questionnaire translation and validation into Brazilian Portuguese.

PubMed

Silva, Rita Oliveira da; Gomes, Mariano Tamura Vieira; Castro, Rodrigo de Aquino; Bonduki, Cláudio Emílio; Girão, Manoel João Batista Castello

2016-10-01

Purpose  To translate into Portuguese, culturally adapt and validate the Uterine Fibroid Symptom - Quality of Life (UFS-QoL) questionnaire for Brazilian women with uterine leiomyoma. Methods  Initially, the UFS-QoL questionnaire was translated into Brazilian Portuguese in accordance with international standards, with subsequent cultural, structural, conceptual and semantic adaptations, so that patients were able to properly answer the questionnaire. Fifty patients with uterine leiomyoma and 19 patients without the disease, confirmed by abdominal pelvic examination and/or transvaginal ultrasound, were selected at the outpatient clinics of the Department of Gynecology of the Universidade Federal de São Paulo (Unifesp). The UFS-QoL questionnaire was administered to all women twice on the same day, with two different interviewers, with an interval of 15 minutes between interviews. After 15 days, the questionnaire was re-administered by the first interviewer. Reliability (internal consistency and test-retest), construct and discriminative validity were tested to ratify the questionnaire. Results  The reliability of the instrument was assessed by Cronbach's α coefficient with an overall result of 0.97, indicating high reliability. The survey results showed a high correlation ( p  = 0.94; p  ≤ 0.001). Conclusion  The UFS-QoL questionnaire was successfully adapted to the Brazilian Portuguese language and Brazilian culture, showing reliability and validity. Thieme Publicações Ltda Rio de Janeiro, Brazil.

Using fish communities to assess streams in Romania: Initial development of an index of biotic integrity

USGS Publications Warehouse

Angermeier, P.L.; Davideanu, G.

2004-01-01

Multimetric biotic indices increasingly are used to complement physicochemical data in assessments of stream quality. We initiated development of multimetric indices, based on fish communities, to assess biotic integrity of streams in two physiographic regions of central Romania. Unlike previous efforts to develop such indices for European streams, our metrics and scoring criteria were selected largely on the basis of empirical relations in the regions of interest. We categorised 54 fish species with respect to ten natural-history attributes, then used this information to compute 32 candidate metrics of five types (taxonomic, tolerance, abundance, reproductive, and feeding) for each of 35 sites. We assessed the utility of candidate metrics for detecting anthropogenic impact based on three criteria: (a) range of values taken, (b) relation to a site-quality index (SQI), which incorporated information on hydrologic alteration, channel alteration, land-use intensity, and water chemistry, and (c) metric redundancy. We chose seven metrics from each region to include in preliminary multimetric indices (PMIs). Both PMIs included taxonomic, tolerance, and feeding metrics, but only two metrics were common to both PMIs. Although we could not validate our PMIs, their strong association with the SQI in each region suggests that such indices would be valuable tools for assessing stream quality and could provide more comprehensive assessments than the traditional approaches based solely on water chemistry.