Reliability, validity and responsiveness of the German self-reported foot and ankle score (SEFAS) in patients with foot or ankle surgery.

PubMed

Arbab, Dariusch; Kuhlmann, Katharina; Schnurr, Christoph; Bouillon, Bertil; Lüring, Christian; König, Dietmar

2017-10-10

Patient-reported outcome measures are a critical tool in evaluating the efficacy of orthopedic procedures and are increasingly used in clinical trials to assess outcomes of health care. The intention of this study was to develop and culturally adapt a German version of the Self-reported Foot and Ankle Score (SEFAS) and to evaluate reliability, validity and responsiveness. According to Cross Cultural Adaptation of Self-Reported Measure guidelines forward and backward translation has been performed. The German SEFAS was investigated in 177 consecutive patients. 177 Patients completed the German SEFAS, Foot and Ankle Outcome Score (FAOS), Short-Form 36 and numeric scales for pain and disability (NRS) before and 118 patients 6 months after foot or ankle surgery. Test-Retest reliability, internal consistency, floor and ceiling effects, construct validity and minimal important change were analyzed. The German SEFAS demonstrated excellent test-retest reliability with ICC values of 0.97. Cronbach's alpha (α) value of 0.89 demonstrated strong internal consistency. No floor or ceiling effects were observed for the German version of the SEFAS. As hypothesized SEFAS correlated strongly with FAOS and SF-36 domains. It showed moderate (ES/SRM > 0.5) responsiveness between preoperative assessment and postoperative follow-up. The German version of the SEFAS demonstrated good psychometric properties. It proofed to be a valid and reliable instrument for use in foot and ankle patients. DRKS00007585.

Evaluation of Psychometric Properties of Voice Activity and Participation Profile (VAPP): A Spanish Version.

PubMed

Bermúdez-de-Alvear, Rosa M; Gálvez-Ruiz, Pablo; Martínez-Arquero, A Ginés; Rando-Márquez, Sara; Fernández-Contreras, Elena

2018-06-11

This study aimed to analyze the psychometric properties of the Spanish version of the Voice Activity and Participation Profile (SVAPP) questionnaire. A randomized, cross-sectional sampling strategy with controls was used. Two samples with a total of 169 participants were analyzed, specifically 61 men (mean age 37.02) and 108 women (mean age 37.78). Of these participants, 112 were patients and 57 were controls. The instrument was submitted to reliability (internal consistency and corrected item-total correlations) and reproducibility analyses. Validation assessment was based on the construct validity, convergent validity, discriminant validity, and concurrent validity. The global internal consistency was excellent (Cronbach's α = 0.976), corrected item-total correlations were satisfactory and ranged 0.63-0.89, and factor loadings were above 0.50. The different subscales showed good internal consistency (alpha coefficients ranged 0.830-0.956) and test-retest values were consistently associated. The exploratory factor analysis evidenced a strongly defined five factors internal structure, with factors loadings ranging 0.51-0.86. Convergent validity demonstrated that all subscales and scores were very strongly correlated (Pearson r above 0.735) and significantly associated. The discriminant validity analysis showed that SVAPP had good specificity to distinguish dysphonic from healthy voice subjects. Concurrent validity with Voice Handicap Index Spanish version (SVHI) showed very strong correlations between total scores, and between SVHI total score and SVAPP Daily and Social Communication subscales; correlations between both tests subscales were strong; only between SVAPP Work and SVHI Physical sections correlations were moderate. The findings of the present study demonstrated evidence for the SVAPP questionnaire reliability and validity, and provided insightful implications of voice disorders on Spanish patients' quality of life. However, further investigations are required. Copyright © 2018 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Reliability and Validation of the International Consultation on Incontinence Questionnaire in Over Active Bladder to Persian Language.

PubMed

Sari Motlagh, Reza; Hajebrahimi, Sakineh; Sadeghi-Bazargani, Homayoun; Joodi Tutunsaz, Javad

2015-05-01

Overactive bladder syndrome is a common syndrome in the world in both men and women. Correct diagnosis and accurate measurement of symptoms severity and also quality of life of patients is necessary to ensure proper treatment and to facilitate sound relationships among patients, researchers and doctors. The International Consultation on Incontinence Questionnaire in Over Active Bladder (ICIQ-OAB) questionnaire is a concise and strong tool to evaluate the symptoms of OAB and their effects on patients' quality of life and treatment results. The objective of this study was to translate and validate a simple and strong tool that could be used in clinics and research. First, the original British English questionnaire was translated into Persian by two bilingual and originally Persian-speaking translators. Then the Persian version was back translated to English and a native English speaker studied and compared the questionnaire with the original version. At the end, the translated and corrected Persian version was finalized by a research team. Content validity of the items and ensuring that the questions could convey the main concept to readers was assessed through Modified Content Validity Index (MCVI). Reliability was calculated by Cronbach's α coefficient. Internal Consistency of the questionnaire with the calculation of Kendall correlation coefficient were evaluated by performing test-retest in 50 participants. The modified content validity index was > 0.78 for all of the questions. Cronbach's α coefficient was calculated 0.76 for all of the participants. Kendall correlation coefficient was calculated for test-re-test assessment 0.66. Both of which indicates the reliability of this questionnaire. Persian version of ICIQ-OAB questionnaire is a simple and strong tool for research, treatment and screening purposes. © 2014 Wiley Publishing Asia Pty Ltd.

Calibrating EASY-Care independence scale to improve accuracy

PubMed Central

Jotheeswaran, A. T.; Dias, Amit; Philp, Ian; Patel, Vikram; Prince, Martin

2016-01-01

Background there is currently limited support for the reliability and validity of the EASY-Care independence scale, with little work carried out in low- or middle-income countries. Therefore, we assessed the internal construct validity and hierarchical and classical scaling properties among frail dependent older people in the community. Objective we assessed the internal construct validity and hierarchical and classical scaling properties among frail dependent older people in the community. Methods three primary care physicians administered EASY-Care comprehensive geriatric assessment for 150 frail and/or dependent older people in the primary care setting. A Mokken model was applied to investigate hierarchical scaling properties of EASY-Care independence scale, and internal consistency (Cronbach's alpha) of the scale was also examined. Results we found that EASY-Care independence scale is highly internally consistent and is a strong hierarchical scale, hence providing strong evidence for unidimensionality. However, two items in the scale (unable to use telephone and manage finances) had much lower item Loevinger H coefficients than others. Exclusion of these two items improved the overall internal consistency of the scale. Conclusions the strong performance of the EASY-Care independence scale among community-dwelling frail older people is encouraging. This study confirms that EASY-Care independence scale is highly internally consistent and a strong hierarchical scale. PMID:27496925

Integrated Logistics Support Analysis of the International Space Station Alpha: An Overview of the Maintenance Time Dependent Parameter Prediction Methods Enhancement

NASA Technical Reports Server (NTRS)

Sepehry-Fard, F.; Coulthard, Maurice H.

1995-01-01

The objective of this publication is to introduce the enhancement methods for the overall reliability and maintainability methods of assessment on the International Space Station. It is essential that the process to predict the values of the maintenance time dependent variable parameters such as mean time between failure (MTBF) over time do not in themselves generate uncontrolled deviation in the results of the ILS analysis such as life cycle costs, spares calculation, etc. Furthermore, the very acute problems of micrometeorite, Cosmic rays, flares, atomic oxygen, ionization effects, orbital plumes and all the other factors that differentiate maintainable space operations from non-maintainable space operations and/or ground operations must be accounted for. Therefore, these parameters need be subjected to a special and complex process. Since reliability and maintainability strongly depend on the operating conditions that are encountered during the entire life of the International Space Station, it is important that such conditions are accurately identified at the beginning of the logistics support requirements process. Environmental conditions which exert a strong influence on International Space Station will be discussed in this report. Concurrent (combined) space environments may be more detrimental to the reliability and maintainability of the International Space Station than the effects of a single environment. In characterizing the logistics support requirements process, the developed design/test criteria must consider both the single and/or combined environments in anticipation of providing hardware capability to withstand the hazards of the International Space Station profile. The effects of the combined environments (typical) in a matrix relationship on the International Space Station will be shown. The combinations of the environments where the total effect is more damaging than the cumulative effects of the environments acting singly, may include a combination such as temperature, humidity, altitude, shock, and vibration while an item is being transported. The item's acceptance to its end-of-life sequence must be examined for these effects.

A clinician-administered observation and corresponding caregiver interview capturing DSM-5 sensory reactivity symptoms in children with ASD.

PubMed

Siper, Paige M; Kolevzon, Alexander; Wang, A Ting; Buxbaum, Joseph D; Tavassoli, Teresa

2017-06-01

Sensory reactivity is a new criterion for autism spectrum disorder (ASD) in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5). However, there is no consensus on how to reliably measure sensory reactivity, particularly in minimally verbal individuals. The current study is an initial validation of the Sensory Assessment for Neurodevelopmental Disorders (SAND), a novel clinician-administered observation and corresponding caregiver interview that captures sensory symptoms based on DSM-5 criteria for ASD. Eighty children between the ages of 2 and 12 participated in this study; 44 children with ASD and 36 typically developing (TD) children. Sensory reactivity symptoms were measured using the SAND and the already validated Short Sensory Profile (SSP). Initial psychometric properties of the SAND were examined including reliability, validity, sensitivity and specificity. Children with ASD showed significantly more sensory reactivity symptoms compared to TD children across sensory domains (visual, tactile, and auditory) and within sensory subtypes (hyperreactivity, hyporeactivity and seeking). The SAND showed strong internal consistency, inter-rater reliability and test-retest reliability, high sensitivity (95.5%) and specificity (91.7%), and strong convergent validity with the SSP. The SAND provides a novel method to characterize sensory reactivity symptoms based on DSM-5 criteria for ASD. This is the first known sensory assessment that combines a clinician-administered observation and caregiver interview to optimally capture sensory phenotypes characteristic of individuals with neurodevelopmental disorders. The SAND offers a beneficial new tool for both research and clinical purposes and has the potential to meaningfully enhance gold-standard assessment of ASD. Autism Res 2017, 10: 1133-1140. © 2017 International Society for Autism Research, Wiley Periodicals, Inc. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Psychometric properties and cross-cultural adaptation of the Brazilian Quebec back pain disability scale questionnaire.

PubMed

Rodrigues, Marcelo F; Michel-Crosato, Edgard; Cardoso, Jefferson R; Traebert, Jefferson

2009-06-01

Cross-cultural translation and psychometric testing. To translate and cross-culturally adapt the Quebec Back Pain Disability Scale (QDS) to Brazilian Portuguese and to examine its validity and reliability. Current literature shows the need to adopt reliable and internationally standardized methods for the analysis of low back pain. To our knowledge, this specific questionnaire has not been translated and validated for Portuguese-speaking patients. The translation and cross-cultural adaptation of the QDS were developed in agreement with internationally recommended methodology, and the resulting product was evaluated in this study with 54 consecutive patients. Internal consistency was obtained through Cronbach's alpha; reliability was estimated through the intraclass correlation coefficient and the Bland and Altman agreement (d = mean difference). Validity was determined by correlating the scores of the Brazil-QDS with the Brazilian version of the Roland-Morris Questionnaire and Visual Analogue Pain Scale by means of the Spearman rank correlation coefficient. The internal consistency obtained was excellent (Cronbach's alpha = 0.97). Intraobserver and interobserver reliability were considered strong (ICC = 0.93-d = 0.68 and 0.96-d = 0.57, respectively). The correlation with Brazilian Roland-Morris Questionnaire and with the Visual Analogue Scale was high (r = 0.857; r = 0.758, respectively). The data showed that the process of translation and cross-cultural adaptation were successful and that the adapted instrument demonstrated excellent psychometric properties.

Psychometric Properties of Newly Translated Spanish Life Events Inventory and Daily Hassles Scale.

PubMed

Hannan, Jean; Youngblut, JoAnne M; Brooten, Dorothy; Bazzani, Dianne; Romero, Norma R; Chavez, Blanca; Picanes, Joann

2015-01-01

Measuring stress in Hispanic Americans, the fastest growing U.S. minority, is problematic. The Life Events Inventory (LEI) and the Daily Hassles Scale (DHS), widely used stress instruments, are not available in Spanish. To test the psychometric properties of the translated Spanish versions of the LEI and DHS. A convenience sample of 63 Hispanic women completed both instruments in Spanish and English 2 weeks apart. Internal consistency reliability and stability were strong for both instruments (.85-.97). Reliability and validity evidence for the translated Spanish versions were strong and similar to the English version. Psychometric findings suggest that the newly translated Spanish versions are good representations of the English versions and that these newly translated instruments are ready for use.

Reliability, validity and description of timed performance of the Jebsen-Taylor Test in patients with muscular dystrophies.

PubMed

Artilheiro, Mariana Cunha; Fávero, Francis Meire; Caromano, Fátima Aparecida; Oliveira, Acary de Souza Bulle; Carvas, Nelson; Voos, Mariana Callil; Sá, Cristina Dos Santos Cardoso de

2017-12-08

The Jebsen-Taylor Test evaluates upper limb function by measuring timed performance on everyday activities. The test is used to assess and monitor the progression of patients with Parkinson disease, cerebral palsy, stroke and brain injury. To analyze the reliability, internal consistency and validity of the Jebsen-Taylor Test in people with Muscular Dystrophy and to describe and classify upper limb timed performance of people with Muscular Dystrophy. Fifty patients with Muscular Dystrophy were assessed. Non-dominant and dominant upper limb performances on the Jebsen-Taylor Test were filmed. Two raters evaluated timed performance for inter-rater reliability analysis. Test-retest reliability was investigated by using intraclass correlation coefficients. Internal consistency was assessed using the Cronbach alpha. Construct validity was conducted by comparing the Jebsen-Taylor Test with the Performance of Upper Limb. The internal consistency of Jebsen-Taylor Test was good (Cronbach's α=0.98). A very high inter-rater reliability (0.903-0.999), except for writing with an Intraclass correlation coefficient of 0.772-1.000. Strong correlations between the Jebsen-Taylor Test and the Performance of Upper Limb Module were found (rho=-0.712). The Jebsen-Taylor Test is a reliable and valid measure of timed performance for people with Muscular Dystrophy. Copyright © 2017 Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia. Publicado por Elsevier Editora Ltda. All rights reserved.

Cross-cultural Adaption and Validation of the Danish Voice Handicap Index.

PubMed

Sorensen, Jesper Roed; Printz, Trine; Mehlum, Camilla Slot; Heidemann, Christian Hamilton; Groentved, Aagot Moeller; Godballe, Christian

2018-02-02

We aimed to assess psychometric properties, including internal consistency, reliability, and clinical validity of the Danish version of the Voice Handicap Index (VHI). A cross-sectional survey study was carried out. For validation, the existing nonvalidated Danish version of the VHI was used. Data from 208 patients with voice disorders of different etiology (neurogenic, functional, and structural) and a control group of 85 vocally healthy individuals were included. A test-retest reliability analysis of 42 patients and 45 control persons was performed. The internal consistency, test-retest reliability, and clinical validity of the questionnaire were assessed. Internal consistency was high with a Cronbach α >0.90 for both the patient and control group. Test-retest reliability measured as intraclass correlation coefficient was good with 0.93 (95% confidence interval [95% confidence interval]: 0.87-0.96) for patients and 0.78 (95% confidence interval: 0.63-0.87) for the control group which indicates sufficient reliability of the questionnaire. The Danish VHI has good clinical validity as it has a strong correlation between patient's perception of the severity of their voice disorder and the VHI score from the Spearman correlation of 0.69. The existing Danish version of the VHI has been thoroughly validated and found to be in line with the original VHI from Jacobsen et al. It showed good internal consistency, test-retest reliability, and clinical validity. It is suitable for use in daily practice and in research projects as it is able to assess patients' perception of their voice disorder severity. Copyright © 2018 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

The validity and reliability of the Thai version of the Kujala score for patients with patellofemoral pain syndrome.

PubMed

Apivatgaroon, Adinun; Angthong, Chayanin; Sanguanjit, Prakasit; Chernchujit, Bancha

2016-10-01

To develop a Thai version of the Kujala score and show the evaluation of the validity and reliability of the score. The Thai version of the Kujala score was developed using the forward-backward translation protocol. The 49 PFPS patients answered the Thai version of questionnaires including the Kujala score, Short Form-36 (SF-36) and International Knee Documentation Committee (IKDC) Subjective Knee Form. The validity between the scores has been tested. The reliability was assessed using test-retest reliability and internal consistency. The Thai version of the Kujala score showed a good correlation with Thai IKDC Subjective Knee Form (Pearson's correlation coefficient; r = 0.74: p < 0.01) and moderate correlation with the Thai SF-36 subscales of physical component summary, total score and role physical (r = 0.586, 0.571 and 0.524, respectively: p < 0.01). The test-retest reliability was excellent with an intra-class correlation coefficient of 0.908 (p < 0.001; 95% CI [0.842-0.947]). The internal consistency was strong with Cronbach's alpha of 0.952 (p < 0.001). No floor and ceiling effects were observed. The Thai version of the Kujala score has shown good validity and reliability. This score can be effectively used for evaluating Thai patients with patellofemoral pain syndrome. Implications for Rehabilitation The Kujala score is a self-administered questionnaire for patients with patellofemoral pain syndrome (PFPS). The validity and reliability of the Thai version of Kujala are compatible with other versions (Turkish, Chinese and Persian version). The Thai version of Kujala has been shown to have validity and reliability in Thai PFPS patients and can be used for clinical evaluation and also in the research work.

Assessing the validity and reliability of the Pool Activity Level (PAL) Checklist for use with older people with dementia.

PubMed

Wenborn, Jennifer; Challis, David; Pool, Jackie; Burgess, Jane; Elliott, Nicola; Orrell, Martin

2008-03-01

Activity is key to maintaining physical and mental health and well-being. However, as dementia affects the ability to engage in activity, care-givers can find it difficult to provide appropriate activities. The Pool Activity Level (PAL) Checklist guides the selection of appropriate, personally meaningful activities. The aim of this study was to assess the reliability and validity of the PAL Checklist when used with older people with dementia. A postal questionnaire sent to activity providers assessed content validity. Validity and reliability were measured in a sample of 60 older people with dementia. The questionnaire response rate was 83% (102/122). Most respondents felt no important items were missing. Seven of the nine activities were ranked as 'very important' or 'essential' by at least 77% of the sample, indicating very good content validity. Correlation with measures of cognition, severity of dementia and activity performance demonstrated strong concurrent validity. Inter-item correlation indicated strong construct validity. Cronbach's alpha coefficient measured internal consistency as excellent (0.95). All items achieved acceptable test-retest reliability, and the majority demonstrated acceptable inter-rater reliability. We conclude that the PAL Checklist demonstrates adequate validity and reliability when used with older people with dementia and appears a useful tool for a variety of care settings.

Further psychometric evaluation and revision of the Mayo-Portland Adaptability Inventory in a national sample.

PubMed

Malec, James F; Kragness, Miriam; Evans, Randall W; Finlay, Karen L; Kent, Ann; Lezak, Muriel D

2003-01-01

To evaluate the internal consistency of the Mayo-Portland Adaptability Inventory (MPAI), further refine the instrument, and provide reference data based on a large, geographically diverse sample of persons with acquired brain injury (ABI). 386 persons, most with moderate to severe ABI. Outpatient, community-based, and residential rehabilitation facilities for persons with ABI located in the United States: West, Midwest, and Southeast. Rasch, item cluster, principal components, and traditional psychometric analyses for internal consistency of MPAI data and subscales. With rescoring of rating scales for 4 items, a 29-item version of the MPAI showed satisfactory internal consistency by Rasch (Person Reliability=.88; Item Reliability=.99) and traditional psychometric indicators (Cronbach's alpha=.89). Three rationally derived subscales for Ability, Activity, and Participation demonstrated psychometric properties that were equivalent to subscales derived empirically through item cluster and factor analyses. For the 3 subscales, Person Reliability ranged from.78 to.79; Item Reliability, from.98 to.99; and Cronbach's alpha, from.76 to.83. Subscales correlated moderately (Pearson r =.49-.65) with each other and strongly with the overall scale (Pearson r=.82-.86). Outcome after ABI is represented by the unitary dimension described by the MPAI. MPAI subscales further define regions of this dimension that may be useful for evaluation of clinical cases and program evaluation.

Measuring disability: a systematic review of the validity and reliability of the Global Activity Limitations Indicator (GALI).

PubMed

Van Oyen, Herman; Bogaert, Petronille; Yokota, Renata T C; Berger, Nicolas

2018-01-01

GALI or Global Activity Limitation Indicator is a global survey instrument measuring participation restriction. GALI is the measure underlying the European indicator Healthy Life Years (HLY). Gali has a substantial policy use within the EU and its Member States. The objective of current paper is to bring together what is known from published manuscripts on the validity and the reliability of GALI. Following the PRISMA guidelines, two search strategies (PUBMED, Google Scholar) were combined to identify manuscripts published in English with publication date 2000 or beyond. Articles were classified as reliability studies, concurrent or predictive validity studies, in national or international populations. Four cross-sectional studies (of which 2 international) studied how GALI relates to other health measures (concurrent validity). A dose-response effect by GALI severity level on the association with the other health status measures was observed in the national studies. The 2 international studies (SHARE, EHIS) concluded that the odds of reporting participation restriction was higher in subjects with self-reported or observed functional limitations. In SHARE, the size of the Odds Ratio's (ORs) in the different countries was homogeneous, while in EHIS the size of the ORs varied more strongly. For the predictive validity, subjects were followed over time (4 studies of which one international). GALI proved, both in national and international data, to be a consistent predictor of future health outcomes both in terms of mortality and health care expenditure. As predictors of mortality, the two distinct health concepts, self-rated health and GALI, acted independently and complementary of each other. The one reliability study identified reported a sufficient reliability of GALI. GALI as inclusive one question instrument fits all conceptual characteristics specified for a global measure on participation restriction. In none of the studies, included in the review, there was evidence of a failing validity. The review shows that GALI has a good and sufficient concurrent and predictive validity, and reliability.

Starting Strong 2017: Key OECD Indicators on Early Childhood Education and Care

ERIC Educational Resources Information Center

OECD Publishing, 2017

2017-01-01

Early childhood education and care (ECEC) can help lay the foundations for future skills development, well-being and learning. Having timely, reliable and comparable international information is essential to help countries improve their ECEC services and systems. For over 15 years, the OECD has been conducting policy analysis and gathering new…

Material review of Li ion battery separators

NASA Astrophysics Data System (ADS)

Weber, Christoph J.; Geiger, Sigrid; Falusi, Sandra; Roth, Michael

2014-06-01

Separators for Li Ion batteries have a strong impact on cell production, cell performance, life, as well as reliability and safety. The separator market volume is about 500 million m2 mainly based on consumer applications. It is expected to grow strongly over the next decade for mobile and stationary applications using large cells. At present, the market is essentially served by polyolefine membranes. Such membranes have some technological limitations, such as wettability, porosity, penetration resistance, shrinkage and meltdown. The development of a cell failure due to internal short circuit is potentially closely related to separator material properties. Consequently, advanced separators became an intense area of worldwide research and development activity in academia and industry. New separator technologies are being developed especially to address safety and reliability related property improvements.

Measurement properties of patient-reported outcome measures (PROMs) used in adult patients with chronic kidney disease: A systematic review

PubMed Central

Kyte, Derek; Cockwell, Paul; Marshall, Tom; Gheorghe, Adrian; Keeley, Thomas; Slade, Anita; Calvert, Melanie

2017-01-01

Background Patient-reported outcome measures (PROMs) can provide valuable information which may assist with the care of patients with chronic kidney disease (CKD). However, given the large number of measures available, it is unclear which PROMs are suitable for use in research or clinical practice. To address this we comprehensively evaluated studies that assessed the measurement properties of PROMs in adults with CKD. Methods Four databases were searched; reference list and citation searching of included studies was also conducted. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to appraise the methodological quality of the included studies and to inform a best evidence synthesis for each PROM. Results The search strategy retrieved 3,702 titles/abstracts. After 288 duplicates were removed, 3,414 abstracts were screened and 71 full-text articles were retrieved for further review. Of these, 24 full-text articles were excluded as they did not meet the eligibility criteria. Following reference list and citation searching, 19 articles were retrieved bringing the total number of papers included in the final analysis to 66. There was strong evidence supporting internal consistency and moderate evidence supporting construct validity for the Kidney Disease Quality of Life-36 (KDQOL-36) in pre-dialysis patients. In the dialysis population, the KDQOL-Short Form (KDQOL-SF) had strong evidence for internal consistency and structural validity and moderate evidence for test-retest reliability and construct validity while the KDQOL-36 had moderate evidence of internal consistency, test-retest reliability and construct validity. The End Stage Renal Disease-Symptom Checklist Transplantation Module (ESRD-SCLTM) demonstrated strong evidence for internal consistency and moderate evidence for test-retest reliability, structural and construct validity in renal transplant recipients. Conclusions We suggest considering the KDQOL-36 for use in pre-dialysis patients; the KDQOL-SF or KDQOL-36 for dialysis patients and the ESRD-SCLTM for use in transplant recipients. However, further research is required to evaluate the measurement error, structural validity, responsiveness and patient acceptability of PROMs used in CKD. PMID:28636678

A systematic review of the factor structure and reliability of the Spence Children's Anxiety Scale.

PubMed

Orgilés, Mireia; Fernández-Martínez, Iván; Guillén-Riquelme, Alejandro; Espada, José P; Essau, Cecilia A

2016-01-15

The Spence Children's Anxiety Scale (SCAS) is a widely used instrument for assessing symptoms of anxiety disorders among children and adolescents. Previous studies have demonstrated its good reliability for children and adolescents from different backgrounds. However, remarkable variability in the reliability of the SCAS across studies and inconsistent results regarding its factor structure has been found. The present study aims to examine the SCAS factor structure by means of a systematic review with narrative synthesis, the mean reliability of the SCAS by means of a meta-analysis, and the influence of the moderators on the SCAS reliability. Databases employed to collect the studies included Scholar Google, PsycARTICLES, PsycINFO, Web of Science, and Scopus since 1997. Twenty-nine and 32 studies, which examined the factor structure and the internal consistency of the SCAS, respectively, were included. The SCAS was found to have strong internal consistency, influenced by different moderators. The systematic review demonstrated that the original six-factor model was supported by most studies. Factorial invariance studies (across age, gender, country) and test-retest reliability of the SCAS were not examined in this study. It is concluded that the SCAS is a reliable instrument for cross-cultural use, and it is suggested that the original six-factor model is appropriate for cross-cultural application. Copyright © 2015 Elsevier B.V. All rights reserved.

Assessing local instrument reliability and validity: a field-based example from northern Uganda.

PubMed

Betancourt, Theresa S; Bass, Judith; Borisova, Ivelina; Neugebauer, Richard; Speelman, Liesbeth; Onyango, Grace; Bolton, Paul

2009-08-01

This paper presents an approach for evaluating the reliability and validity of mental health measures in non-Western field settings. We describe this approach using the example of our development of the Acholi psychosocial assessment instrument (APAI), which is designed to assess depression-like (two tam, par and kumu), anxiety-like (ma lwor) and conduct problems (kwo maraco) among war-affected adolescents in northern Uganda. To examine the criterion validity of this measure in the absence of a traditional gold standard, we derived local syndrome terms from qualitative data and used self reports of these syndromes by indigenous people as a reference point for determining caseness. Reliability was examined using standard test-retest and inter-rater methods. Each of the subscale scores for the depression-like syndromes exhibited strong internal reliability ranging from alpha = 0.84-0.87. Internal reliability was good for anxiety (0.70), conduct problems (0.83), and the pro-social attitudes and behaviors (0.70) subscales. Combined inter-rater reliability and test-retest reliability were good for most subscales except for the conduct problem scale and prosocial scales. The pattern of significant mean differences in the corresponding APAI problem scale score between self-reported cases vs. noncases on local syndrome terms was confirmed in the data for all of the three depression-like syndromes, but not for the anxiety-like syndrome ma lwor or the conduct problem kwo maraco.

Validation of general job satisfaction in the Korean Labor and Income Panel Study.

PubMed

Park, Shin Goo; Hwang, Sang Hee

2017-01-01

The purpose of this study is to assess the validity and reliability of general job satisfaction (JS) in the Korean Labor and Income Panel Study (KLIPS). We used the data from the 17th wave (2014) of the nationwide KLIPS, which selected a representative panel sample of Korean households and individuals aged 15 or older residing in urban areas. We included in this study 7679 employed subjects (4529 males and 3150 females). The general JS instrument consisted of five items rated on a scale from 1 (strongly disagree) to 5 (strongly agree). The general JS reliability was assessed using the corrected item-total correlation and Cronbach's alpha coefficient. The validity of general JS was assessed using confirmatory factor analysis (CFA) and Pearson's correlation. The corrected item-total correlations ranged from 0.736 to 0.837. Therefore, no items were removed. Cronbach's alpha for general JS was 0.925, indicating excellent internal consistency. The CFA of the general JS model showed a good fit. Pearson's correlation coefficients for convergent validity showed moderate or strong correlations. The results obtained in our study confirm the validity and reliability of general JS.

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Development of CRIS: Measure of community reintegration of injured service members

PubMed Central

Resnik, Linda; Plow, Matthew; Jette, Alan

2012-01-01

Identification and prevention of community reintegration problems of veterans is an important public health mandate. However, no veteran-specific measure exists. Study purposes were to (1) develop the Community Reintegration for Service Members (CRIS) measure and (2) test the validity and reliability of the measure. Formative research identified challenges in community reintegration postdeployment. The World Health Organization’s International Classification of Functioning, Disability and Health participation domain guided item-bank development. Items were refined through cognitive interviews and clinician consultation. Pilot studies with 126 veterans examined unidimensionality, internal consistency, reliability, and construct validity. Three unidimensional CRIS scales were developed. Working subjects had better CRIS scores then unemployed subjects. Subjects with posttraumatic stress disorder, substance abuse, or mental health problems had worse scores than subjects without these conditions. The correlations between the CRIS and the 36-Item Short Form Health Survey scales of role physical, role emotional, and social functioning were 0.44–0.80. CRIS has strong reliability, conceptual integrity, and construct validity. PMID:19882482

Psychometric Properties of Physical Activity and Leisure Motivation Scale in Farsi: an International Collaborative Project on Motivation for Physical Activity and Leisure.

PubMed

Zarei, Sahar; Memari, Amir-Hossein; Moshayedi, Pouria; Mosayebi, Fatolla; Mansournia, Mohammad Ali; Khoo, Selina; Morris, Tony

2016-10-01

Given the importance of regular physical activity, it is crucial to evaluate the factors favoring participation in physical activity. We aimed to report the psychometric analysis of the Farsi version of the Physical Activity and Leisure Motivation Scale (PALMS). The Farsi version of PALMS was completed by 406 healthy adult individuals to test its factor structure and concurrent validity and reliability. Conducting the exploratory factor analysis revealed nine factors that accounted for 64.6% of the variances. The PALMS reliability was supported with a high internal consistency of 0.91 and a high test-retest reliability of 0.97 (95% CI: 0.97-0.98). The association between the PALMS and its previous version Recreational Exercise Motivation Measure scores was strongly significant (r= 0.86, P < 0.001). We have shown that the Farsi version of the PALMS appears to be a valuable instrument to measure motivation for physical activity and leisure.

The Environmental Reward Observation Scale (EROS): development, validity, and reliability.

PubMed

Armento, Maria E A; Hopko, Derek R

2007-06-01

Researchers acknowledge a strong association between the frequency and duration of environmental reward and affective mood states, particularly in relation to the etiology, assessment, and treatment of depression. Given behavioral theories that outline environmental reward as a strong mediator of affect and the unavailability of an efficient, reliable, and valid self-report measure of environmental reward, we developed the Environmental Reward Observation Scale (EROS) and examined its psychometric properties. In Experiment 1, exploratory factor analysis supported a unidimensional 10-item measure with strong internal consistency and test-retest reliability. When administered to a replication sample, confirmatory factor analysis suggested an excellent fit to the 1-factor model and convergent/discriminant validity data supported the construct validity of the EROS. In Experiment 2, further support for the convergent validity of the EROS was obtained via moderate correlations with the Pleasant Events Schedule (PES; MacPhillamy & Lewinsohn, 1976). In Experiment 3, hierarchical regression supported the ecological validity of the EROS toward predicting daily diary reports of time spent in highly rewarding behaviors and activities. Above and beyond variance accounted for by depressive symptoms (BDI), the EROS was associated with significant incremental variance in accounting for time spent in both low and high reward behaviors. The EROS may represent a brief, reliable and valid measure of environmental reward that may improve the psychological assessment of negative mood states such as clinical depression.

Validity and Reliability of Thai Version of the Foot and Ankle Ability Measure (FAAM) Subjective Form.

PubMed

Arunakul, Marut; Arunakul, Preeyaphan; Suesiritumrong, Chakhrist; Angthong, Chayanin; Chernchujit, Bancha

2015-06-01

Self-administered questionnaires have become an important aspect for clinical outcome assessment of foot and ankle-related problems. The Foot and Ankle Ability Measure (FAAM) subjective form is a region-specific questionnaire that is widely used and has sufficient validity and reliability from previous studies. Translate the original English version of FAAM into a Thai version and evaluate the validity and reliability of Thai FAAM in patients with foot and ankle-related problems. The FAAM subjective form was translated into Thai using forward-backward translation protocol. Afterward, reliability and validity were tested. Following responses from 60 consecutive patients on two questionnaires, the Thai FAAM subjective form and the short form (SF)-36, were used. The validity was tested by correlating the scores from both questionnaires. The reliability was adopted by measuring the test-retest reliability and internal consistency. Thai FAAM score including activity of daily life (ADL) and Sport subscale demonstrated the sufficient correlations with physical functioning (PF) and physical composite score (PCS) domains of the SF-36 (statistically significant with p < 0.001 level and ≥ 0.5 values). The result of reliability revealed highly intra-class correlation coefficient as 0.8 and 0.77, respectively from test-retest study. The internal consistency was strong (Cronbach alpha = 0.94 and 0.88, respectively). The Thai version of FAAM subjective form retained the characteristics of the original version and has proved a reliable evaluation instrument for patients with foot and ankle-related problems.

A Factor Analytic Validation Study of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC)

ERIC Educational Resources Information Center

Nishimura, Trisha Sugita; Busse, Randy T.

2015-01-01

General and special education teachers (N = 125) completed the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC). The internal consistency of the instrument was strong with an alpha of 0.89. The measure demonstrated excellent test-retest reliability (r = 0.99) and a dependent t-test was non-significant, indicating mean group…

The Measurement of Psychological Maltreatment: Early Data on the Child Abuse and Trauma Scale.

ERIC Educational Resources Information Center

Sanders, Barbara; Becker-Lausen, Evvie

1995-01-01

The Child Abuse and Trauma Scale, a self-report measure yielding a quantitative index of the frequency and extent of negative experiences in childhood and adolescence, was administered to 1,198 college students and 17 subjects with Multiple Personality Disorder. Results revealed the scale's strong internal consistency, test-retest reliability, and…

Development and Validation of a Questionnaire to Assess Multimorbidity in Primary Care: An Indian Experience.

PubMed

Pati, Sanghamitra; Hussain, Mohammad Akhtar; Swain, Subhashisa; Salisbury, Chris; Metsemakers, Job F M; Knottnerus, J André; van den Akker, Marjan

2016-01-01

Multimorbidity remains an underexplored domain in Indian primary care. We undertook a study to assess the prevalence, correlates, and outcomes of multimorbidity in primary care settings in India. This paper describes the process of development and validation of our data collection tool "Multimorbidity Assessment Questionnaire for Primary Care (MAQ-PC)." An iterative process comprising desk review, chart review, and expert consultations was undertaken to generate the questionnaire. The MAQ-PC contained items on chronic conditions, health care utilization, health related quality of life, disease severity, and sociodemographics. It was first tested with twelve adults for comprehensibility followed by test-retest reliability with 103 patients from four primary care practices. For interrater reliability, two interviewers separately administered the questionnaire to sixteen patients. MAQ-PC displayed strong internal consistency (Cronbach's alpha: 0.69), interrater reliability (Cohen's Kappa: 0.78-1), and test-retest reliability (ICC: 0.970-0.741). Substantial concordance between self-report and physician diagnosis (Scott Kappa: 0.59-1.0) was observed for listed chronic conditions indicating strong concurrent validity. Nearly 54% had one chronic condition and 23.3% had multimorbidity. Our findings demonstrate MAQ-PC to be a valid and reliable measure of multimorbidity in primary care practice and suggest its potential utility in multimorbidity research in India.

The Shoulder Objective Practical Assessment Tool: Evaluation of a New Tool Assessing Residents Learning in Diagnostic Shoulder Arthroscopy.

PubMed

Talbot, Christopher L; Holt, Edward M; Gooding, Benjamin W T; Tennent, Thomas D; Foden, Philip

2015-08-01

To design and validate an objective practical assessment tool for diagnostic shoulder arthroscopy that would provide residents with a method to evaluate their progression in this field of surgery and to identify specific learning needs. We designed and evaluated the shoulder Objective Practical Assessment Tool (OPAT). The shoulder OPAT was designed by us, and scoring domains were created using a Delphi process. The shoulder OPAT was trialed by members of the British Elbow & Shoulder Society Education Committee for internal consistency and ease of use before being offered to other trainers and residents. Inter-rater reliability and intrarater reliability were calculated. One hundred forty orthopaedic residents, of varying seniority, within 5 training regions in the United Kingdom, were questioned regarding the tool. A pilot study of 6 residents was undertaken. Internal consistency was 0.77 (standardized Cronbach α). Inter-rater reliability was 0.60, and intrarater reliability was 0.82. The Spearman correlation coefficient (r) between the global summary score for the shoulder OPAT and the current assessment tool used in postgraduate training for orthopaedic residents undertaking diagnostic shoulder arthroscopy equaled 0.74. Of the residents, 82% agreed or strongly agreed when asked if the shoulder OPAT would be a useful tool in monitoring progression and 72% agreed or strongly agreed with the introduction of the shoulder OPAT within the orthopaedic domain. This study shows that the shoulder OPAT fulfills several aspects of reliability and validity when tested. Despite the inter-rater reliability being 0.60, we believe that the shoulder OPAT has the potential to play a role alongside the current assessment tool in the training of orthopaedic residents. The shoulder OPAT can be used to assess residents during shoulder arthroscopy and has the potential for use in medical education, as well as arthroscopic skills training in the operating theater. Copyright © 2015 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Cross-cultural adaptation, reliability and validity of the Turkish version of the Lower Limb Functional Index.

PubMed

Duruturk, Neslihan; Tonga, Eda; Gabel, Charles Philip; Acar, Manolya; Tekindal, Agah

2015-07-26

This study aims to adapt culturally a Turkish version of the Lower Limb Functional Index (LLFI) and to determine its validity, reliability, internal consistency, measurement sensitivity and factor structure in lower limb problems. The LLFI was translated into Turkish and cross-culturally adapted with a double forward-backward protocol that determined face and content validity. Individuals (n = 120) with lower limb musculoskeletal disorders completed the LLFI and Short Form-36 questionnaires and the Timed Up and Go physical test. The psychometric properties were evaluated for the all participants from patient-reported outcome measures made at baseline and repeated at day 3 to determine criterion between scores (Pearson's r), internal consistency (Cronbachs α) and test-retest reliability (intraclass correlation coefficient - ICC 2.1 ). Error was determined using standard error of the measurement (SEM) and minimal detectable change at the 90% level (MDC 90 ), while factor structure was determined using exploratory factor analysis with maximum likelihood extraction and Varimax rotation. The psychometric characteristics showed strong criterion validity (r = 0.74-0.76), high internal consistency (α = 0.82) and high test-retest reability (ICC 2.1  = 0.97). The SEM of 3.2% gave an MDC 90  = 5.8%. The factor structure was uni-dimensional. Turkish version of LLFI was found to be valid and reliable for the measurement of lower limb function in a Turkish population. Implications for Rehabilitation Lower extremity musculoskeletal disorders are common and greatly impact activities among the affected individuals pertaining to daily living, work, leisure and quality of life. Patient-reported outcome (PRO) measures have advantages as they are practical, cost-effective and clinically convenient for use in patient-centered care. The Lower Limb Functional Index is a recently validated PRO measure shown to have strong clinimetric properties.

Validation of the MISSCARE-BRASIL survey - A tool to assess missed nursing care.

PubMed

Siqueira, Lillian Dias Castilho; Caliri, Maria Helena Larcher; Haas, Vanderlei José; Kalisch, Beatrice; Dantas, Rosana Aparecida Spadoti

2017-12-21

to analyze the metric validity and reliability properties of the MISSCARE-BRASIL survey. methodological research conducted by assessing construct validity and reliability via confirmatory factor analysis, known-groups validation, convergent construct validation, analysis of internal consistency and test-retest reliability. The sample consisted of 330 nursing professionals, of whom 86 participated in the retest phase. of the 330 participants, 39.7% were aides, 33% technicians, 20.9% nurses, and 6.4% nurses with administrative roles. Confirmatory factorial analysis demonstrated that the Brazilian Portuguese version of the instrument is adequately adjusted to the dimensional structure the scale authors originally proposed. The correlation between "satisfaction with position/role" and "satisfaction with teamwork" and the survey's missed care variables was moderate (Spearman's coefficient =0.35; p<0.001). The results of the Student's t-test indicated known-group validity. Professionals from closed units reported lower levels of missed care in comparison with the other units. The reliability showed a strong correlation, with the exception of "institutional management/leadership style" (intraclass correlation coefficient (ICC)=0.15; p=0.04). The internal consistency was adequate (Cronbach's alpha was greater than 0.70). the MISSCARE-BRASIL was valid and reliable in the group studied. The application of the MISSCARE-BRASIL can contribute to identifying solutions for missed nursing care.

Reliability and Validity of the Italian Version of the Protocol of Orofacial Myofunctional Evaluation with Scores (I-OMES).

PubMed

Scarponi, Letizia; de Felicio, Claudia Maria; Sforza, Chiarella; Pimenta Ferreira, Claudia Lucia; Ginocchio, Daniela; Pizzorni, Nicole; Barozzi, Stefania; Mozzanica, Francesco; Schindler, Antonio

2018-05-30

To evaluate the reliability, validity, and responsiveness of the Italian OMES (I-OMES). The study consisted of 3 phases: (1) internal consistency and reliability, (2) validity, and (3) responsiveness analysis. The recruited population included 27 patients with orofacial myofunctional disorders (OMD) and 174 healthy volunteers. Forty-seven subjects, 18 healthy and all recruited patients with OMD were assessed for inter-rater and test-retest reliability analysis. I-OMES and Nordic Orofacial Test - Screening (NOT-S) scores of the patients were correlated for concurrent validity analysis. I-OMES scores from 27 patients with OMD and 27 age- and gender-matched healthy subjects were compared to investigate construct validity. I-OMES scores before and after successful swallowing rehabilitation in patients were compared for responsiveness analysis. Adequate internal consistency (Cronbach α = 0.71) and strong inter-rater and test-retest reliability (intraclass coefficient correlation = 0.97 and 0.98, respectively) were found. I-OMES and NOT-S scores significantly and inversely correlated (r = -0.38). A statistical significance (p < 0.001) was found between the pathological group and the control group for the total I-OMES score. The mean I-OMES score improved from 90 (78-102) to 99 (89-103) after myofunctional rehabilitation (p < 0.001). The I-OMES is a reliable and valid tool to evaluate OMD. © 2018 S. Karger AG, Basel.

Semiautomatic segmentation and follow-up of multicomponent low-grade tumors in longitudinal brain MRI studies

PubMed Central

Weizman, Lior; Sira, Liat Ben; Joskowicz, Leo; Rubin, Daniel L.; Yeom, Kristen W.; Constantini, Shlomi; Shofty, Ben; Bashat, Dafna Ben

2014-01-01

Purpose: Tracking the progression of low grade tumors (LGTs) is a challenging task, due to their slow growth rate and associated complex internal tumor components, such as heterogeneous enhancement, hemorrhage, and cysts. In this paper, the authors show a semiautomatic method to reliably track the volume of LGTs and the evolution of their internal components in longitudinal MRI scans. Methods: The authors' method utilizes a spatiotemporal evolution modeling of the tumor and its internal components. Tumor components gray level parameters are estimated from the follow-up scan itself, obviating temporal normalization of gray levels. The tumor delineation procedure effectively incorporates internal classification of the baseline scan in the time-series as prior data to segment and classify a series of follow-up scans. The authors applied their method to 40 MRI scans of ten patients, acquired at two different institutions. Two types of LGTs were included: Optic pathway gliomas and thalamic astrocytomas. For each scan, a “gold standard” was obtained manually by experienced radiologists. The method is evaluated versus the gold standard with three measures: gross total volume error, total surface distance, and reliability of tracking tumor components evolution. Results: Compared to the gold standard the authors' method exhibits a mean Dice similarity volumetric measure of 86.58% and a mean surface distance error of 0.25 mm. In terms of its reliability in tracking the evolution of the internal components, the method exhibits strong positive correlation with the gold standard. Conclusions: The authors' method provides accurate and repeatable delineation of the tumor and its internal components, which is essential for therapy assessment of LGTs. Reliable tracking of internal tumor components over time is novel and potentially will be useful to streamline and improve follow-up of brain tumors, with indolent growth and behavior. PMID:24784396

Validity and reliability of the NAB Naming Test.

PubMed

Sachs, Bonnie C; Rush, Beth K; Pedraza, Otto

2016-05-01

Confrontation naming is commonly assessed in neuropsychological practice, but few standardized measures of naming exist and those that do are susceptible to the effects of education and culture. The Neuropsychological Assessment Battery (NAB) Naming Test is a 31-item measure used to assess confrontation naming. Despite adequate psychometric information provided by the test publisher, there has been limited independent validation of the test. In this study, we investigated the convergent and discriminant validity, internal consistency, and alternate forms reliability of the NAB Naming Test in a sample of adults (Form 1: n = 247, Form 2: n = 151) clinically referred for neuropsychological evaluation. Results indicate adequate-to-good internal consistency and alternate forms reliability. We also found strong convergent validity as demonstrated by relationships with other neurocognitive measures. We found preliminary evidence that the NAB Naming Test demonstrates a more pronounced ceiling effect than other commonly used measures of naming. To our knowledge, this represents the largest published independent validation study of the NAB Naming Test in a clinical sample. Our findings suggest that the NAB Naming Test demonstrates adequate validity and reliability and merits consideration in the test arsenal of clinical neuropsychologists.

Cross-Cultural Adaptation of the Profile Fitness Mapping Neck Questionnaire to Brazilian Portuguese: Internal Consistency, Reliability, and Construct and Structural Validity.

PubMed

Ferreira, Mariana Cândido; Björklund, Martin; Dach, Fabiola; Chaves, Thais Cristina

The purpose of this study was to adapt and evaluate the psychometric properties of the ProFitMap-neck to Brazilian Portuguese. The cross-cultural adaptation consisted of 5 stages, and 180 female patients with chronic neck pain participated in the study. A subsample (n = 30) answered the pretest, and another subsample (n = 100) answered the questionnaire a second time. Internal consistency, test-retest reliability, and construct validity (hypothesis testing and structural validity) were estimated. For construct validity, the scores of the questionnaire were correlated with the Neck Disability Index (NDI), and the Hospital Anxiety and Depression Scale (HADS), the Tampa Scale of Kinesiophobia (TSK), and the 36-item Short-Form Health Survey (SF-36). Internal consistency was determined by adequate Cronbach's α values (α > 0.70). Strong reliability was identified by high intraclass correlation coefficients (ICC > 0.75). Construct validity was identified by moderate and strong correlations of the Br-ProFitMap-neck with total NDI score (-0.56 50%, Kaiser-Meyer-Olkin index > 0.50, eigenvalue > 1, and factor loadings > 0.2. Br-ProFitMap-neck had adequate psychometric properties and can be used in clinical settings, as well as research, in patients with chronic neck pain. Copyright © 2017. Published by Elsevier Inc.

Psychometric assessment of the processes of change scale for sun protection.

PubMed

Sillice, Marie A; Babbin, Steven F; Redding, Colleen A; Rossi, Joseph S; Paiva, Andrea L; Velicer, Wayne F

2018-01-01

The fourteen-factor Processes of Change Scale for Sun Protection assesses behavioral and experiential strategies that underlie the process of sun protection acquisition and maintenance. Variations of this measure have been used effectively in several randomized sun protection trials, both for evaluation and as a basis for intervention. However, there are no published studies, to date, that evaluate the psychometric properties of the scale. The present study evaluated factorial invariance and scale reliability in a national sample (N = 1360) of adults involved in a Transtheoretical model tailored intervention for exercise and sun protection, at baseline. Invariance testing ranged from least to most restrictive: Configural Invariance (constraints only factor structure and zero loadings); Pattern Identity Invariance (equal factor loadings across target groups); and Strong Factorial Invariance (equal factor loadings and measurement errors). Multi-sample structural equation modeling tested the invariance of the measurement model across seven subgroups: age, education, ethnicity, gender, race, skin tone, and Stage of Change for Sun Protection. Strong factorial invariance was found across all subgroups. Internal consistency coefficient Alpha and factor rho reliability, respectively, were .83 and .80 for behavioral processes, .91 and .89 for experiential processes, and .93 and .91 for the global scale. These results provide strong empirical evidence that the scale is consistent, has internal validity and can be used in research interventions with population-based adult samples.

The validity and reliability of Systemic Lupus Erythematosus Quality of Life Questionnaire (L-QoL) in a Turkish population.

PubMed

Duruöz, M T; Unal, C; Toprak, C Sanal; Sezer, I; Yilmaz, F; Ulutatar, F; Atagündüz, P; Baklacioglu, H S

2017-12-01

Background Systemic lupus erythematosus (SLE) may have a profound impact on quality of life. There is increasing interest in measuring quality of life in lupus patients. The purpose of this study was to investigate the validity and reliability of SLE Quality of Life Questionnaire (L-QoL) in Turkish SLE patients. Methods SLE according to 2012 Systemic Lupus International Collaborating Clinics Classification Criteria were recruited into the study. Demographic data, clinical parameters and disease activity measured with the Systemic Lupus Erythematosus Disease Activity Index-2000 (SLEDAI-2K); were noted. Nottingham Health Profile and Health Assessment Questionnaire were filled out in addition to the Turkish L-QoL (LQoL-TR). Internal consistency, test-retest reliability, and convergent and discriminant validity were evaluated. Results The mean age of participants was 43.55 ± 14.33 years and the mean disease duration was 89.8 ± 92.1 months. The patients filled out LQoL-TR in 2.5 min. Strong correlation of LQoL-TR with all subgroups of the Nottingham Health Profile and the Health Assessment Questionnaire were established showing the convergent validity. The highest correlation was demonstrated with emotional reactions (rho = 0.72) and sleep component (rho = 0.65) of the Nottingham Health Profile scale ( p < 0.0001). Its poor and not significant correlation with nonfunctional parameters (age, disease duration, perceived general health, SLEDAI-2K) showed its discriminative properties. LQoL-TR demonstrated good internal reliability with a Cronbach's α of 0.93 and test-retest reliability with intraclass correlation coefficient of 0.87. Conclusion The LQoL-TR is a practical and useful tool which demonstrates good validity and reliability.

The Deaf Acculturation Scale (DAS): Development and Validation of a 58-Item Measure

ERIC Educational Resources Information Center

Maxwell-McCaw, Deborah; Zea, Maria Cecilia

2011-01-01

This study involved the development and validation of the Deaf Acculturation Scale (DAS), a new measure of cultural identity for Deaf and hard-of-hearing (hh) populations. Data for this study were collected online and involved a nation-wide sample of 3,070 deaf/hh individuals. Results indicated strong internal reliabilities for all the subscales,…

Cross-cultural adaptation, reliability, and validity of the Persian version of the Cumberland Ankle Instability Tool.

PubMed

Hadadi, Mohammad; Ebrahimi Takamjani, Ismail; Ebrahim Mosavi, Mohammad; Aminian, Gholamreza; Fardipour, Shima; Abbasi, Faeze

2017-08-01

The purpose of the present study was to translate and to cross-culturally adapt the Cumberland Ankle Instability Tool (CAIT) into Persian language and to evaluate its psychometric properties. The International Quality of Life Assessment process was pursued to translate CAIT into Persian. Two groups of Persian-speaking individuals, 105 participants with a history of ankle sprain and 30 participants with no history of ankle sprain, were asked to fill out Persian version of CAIT (CAIT-P), Foot and Ankle Ability Measure (FAAM), and Visual Analog Scale (VAS). Data obtained from the first administration of CAIT were used to evaluate floor and ceiling effects, internal consistency, dimensionality, and criterion validity. To determine the test-retest reliability, 45 individuals re-filled CAIT 5-7 days after the first session. Cronbach's alpha was over the cutoff point of 0.70 for both ankles and in both groups. The intra-class correlation coefficient was high for right (0.95) and left (0.91) ankles. There was a strong correlation between each item and the total score of the CAIT-P. Although the CAIT-P had strong correlation with VAS, its correlation with both subscales of FAAM was moderate. The CAIT-P has good validity and reliability and it can be used by clinicians and researchers for identification and investigation of functional ankle instability. Implications for Rehabilitation Chronic ankle instability is one of the most common consequences of acute ankle sprain. Cumberland Ankle Instability Tool is an acceptable measure to determine functional ankle instability and its severity. The Persian version of Cumberland Ankle Instability Tool is a valid and reliable tool for clinical and research purpose in Persian-speaking individuals.

Psychometric Properties of the Persian Version of the Simple Shoulder Test (SST) Questionnaire.

PubMed

Ebrahimzadeh, Mohammad H; Vahedi, Ehsan; Baradaran, Aslan; Birjandinejad, Ali; Seyyed-Hoseinian, Seyyed-Hadi; Bagheri, Farshid; Kachooei, Amir Reza

2016-10-01

To validate the Persian version of the simple shoulder test in patients with shoulder joint problems. Following Beaton`s guideline, translation and back translation was conducted. We reached to a consensus on the Persian version of SST. To test the face validity in a pilot study, the Persian SST was administered to 20 individuals with shoulder joint conditions. We enrolled 148 consecutive patients with shoulder problem to fill the Persian SST, shoulder specific measure including Oxford shoulder score (OSS) and two general measures including DASH and SF-36. To measure the test-retest reliability, 42 patients were randomly asked to fill the Persian-SST for the second time after one week. Cronbach's alpha coefficient was used to demonstrate internal consistency over the 12 items of Persian-SST. ICC for the total questionnaire was 0.61 showing good and acceptable test-retest reliability. ICC for individual items ranged from 0.32 to 0.79. The total Cronbach's alpha was 0.84 showing good internal consistency over the 12 items of the Persian-SST. Validity testing showed strong correlation between SST and OSS and DASH. The correlation with OSS was positive while with DASH scores was negative. The correlation was also good to strong with all physical and most mental subscales of the SF-36. Correlation coefficient was higher with DASH and OSS in compare to SF-36. Persian version of SST found to be valid and reliable instrument for shoulder joint pain and function assessment in Iranian population.

The Spanish version of the Alberta Infant Motor Scale: Validity and reliability analysis.

PubMed

Morales-Monforte, Erica; Bagur-Calafat, Caridad; Suc-Lerin, Neus; Fornaguera-Martí, Montserrat; Cazorla-Sánchez, Engracia; Girabent-Farrés, Montserrat

2017-02-01

Validity and reliability of the cross-cultural adaptive translation of the Alberta Infant Motor Scale (AIMS), to monitor gross motor development in infants from 0 to 18 months of age, were evaluated. A cross-cultural translation was used to generate a Spanish version of the AIMS. Fifty infants at risk or with diagnosis of motor delay, 0-18 months of age, participated in this study. Two independent physical therapists scored infants on the AIMS. Concurrent validity was tested using the AIMS and the Bayley Scales of Infant and Toddler Development - III (Bayley - III). Reliability and the internal consistency were high (ICCs ranged from 0.94 to 1.00 and KR-20 ranged from 0.90 to 0.98, respectively). AIMS and Bayley - III scores correlated strongly (r = 0.97). The Spanish version of the AIMS presented excellent validity and reliability. Further studies are suggested in order to assess the AIMS in preterm babies.

The Korean version of the Carpal Tunnel Questionnaire. Cross cultural adaptation, reliability, validity and responsiveness.

PubMed

Kim, J K; Lim, H M

2015-02-01

The purpose of this study was to translate and culturally adapt the Carpal Tunnel Questionnaire to produce an equivalent Korean version. A total of 53 patients completed the Korean version of the Carpal Tunnel Questionnaire pre-operatively and 3 months after open carpal tunnel release. All 53 also completed the Korean version of the Disabilities of Arm, Shoulder, and Hand questionnaire pre-operatively and 3 months post-operatively. Reliability was measured by determining the test-retest reliability and internal consistency. Test-retest reliability was assessed using intraclass correlation coefficients and paired t-tests, and internal consistency using Cronbach's alpha coefficients. Pearson correlation analysis was carried out on the Korean version of the Carpal Tunnel Questionnaire scores and the Korean version of the Disabilities of Arm, Shoulder, and Hand scores to assess construct validity. Responsiveness was evaluated using effect sizes and standardized response means. The reliability of the Korean version of the Carpal Tunnel Questionnaire was good. The scores in the Korean version of the Disabilities of Arm, Shoulder, and Hand strongly correlated with the scores in the Korean version of the Carpal Tunnel Questionnaire. Standardized response mean and effect size were both large for the Korean version of the Carpal Tunnel Questionnaire. The study shows that the Korean version of the Carpal Tunnel Questionnaire is a reliable, valid and responsive instrument for measuring outcomes in carpal tunnel syndrome. © The Author(s) 2014.

The Rothschild Scale for Antidepressant Tachyphylaxis: reliability and validity.

PubMed

Rothschild, Anthony J

2008-01-01

After successful treatment of an episode of major depression, many patients complain of symptoms of apathy or decreased motivation (described by patients as "the blahs"), fatigue, dullness in cognitive function, sleep disturbance, weight gain, and sexual dysfunction; however, the characterization of this phenomenon of antidepressant tachyphylaxis has been hampered by the lack of an accepted definition and a reliable and valid assessment tool. To address this problem, the development and assessment of the Rothschild Scale for Antidepressant Tachyphylaxis (RSAT) are described. The RSAT consists of 6 self-report items assessing energy level, motivation and interest, cognitive functioning, weight gain, sleep, and sexual functioning. A seventh item, affect, is assessed by the interviewer. Each item is measured within a 5-point ordinal scale with anchor points developed to illustrate each rating. This study assesses the internal consistency, test-retest reliability, convergent and discriminant validity, sensitivity, specificity, and positive and negative predictive values of the RSAT. The RSAT demonstrated excellent internal consistency and scale reliability (Cronbach alpha = .902). The RSAT also demonstrated strong test-retest reliability (for depressed patients: r = 0.822, P < .01; for control subjects: r = 0.887, P < .01). The total RSAT score did not correlate with severity of depression as measured by the total Hamilton Depression Rating Scale score or the Hamilton Depression Rating Scale item 1 (depressed mood), supporting the discriminant validity of the RSAT for use in antidepressant tachyphylaxis. The RSAT is a reliable measure of antidepressant tachyphylaxis.

Reliability and validity of the Turkish version of the situational self-efficacy scale for fruit and vegetable consumption in adolescents.

PubMed

Kadioglu, Hasibe; Erol, Saime; Ergun, Ayse

2015-01-01

The purpose of this research was to examine the psychometric properties of the Turkish version of the situational self-efficacy scale for vegetable and fruit consumption in adolescents. This was a methodological study. The study was conducted in four public secondary schools in Istanbul, Turkey. Subjects were 1586 adolescents. Content and construct validity were assessed to test the validity of the scale. The reliability was assessed in terms of internal consistency and test-retest reliability. For confirmatory factor analysis, χ(2) statistics plus other fit indices were used, including the goodness-of-fit index, the adjusted goodness-of-fit index, the nonnormed fit index, the comparative fit index, the standardized root mean residual, and the root mean square error of approximation. Pearson's correlation was used for test-retest reliability and item total correlation. The internal consistency was assessed by using Cronbach α. Confirmatory factor analysis strongly supported the three-component structure representing positive social situations (α = .81), negative effect situations (α = .93), and difficult situations (α = .78). Psychometric analyses of the Turkish version of the situational self-efficacy scale indicate high reliability and good content and construct validity. Researchers and health professionals will find it useful to employ the Turkish situational self-efficacy scale in evaluating situational self-efficacy for fruit and vegetable consumption in Turkish adolescents.

Detection of early psychotic symptoms: Validation of the Spanish version of the "Symptom Onset in Schizophrenia (SOS) inventory".

PubMed

Mezquida, Gisela; Cabrera, Bibiana; Martínez-Arán, Anabel; Vieta, Eduard; Bernardo, Miguel

2018-03-01

The period of subclinical signs that precedes the onset of psychosis is referred to as the prodrome or high-risk mental state. The "Symptom Onset in Schizophrenia (SOS) inventory" is an instrument to characterize and date the initial symptoms of a psychotic illness. The present study aims to provide reliability and validity data for clinical and research use of the Spanish version of the SOS. Thirty-six participants with a first-episode of psychosis meeting DSM-IV criteria for schizophrenia/schizoaffective/schizophreniform disorder were administered the translated SOS and other clinical assessments. The internal validity, intrarater and interrater reliability were studied. We found strong interrater reliability. To detect the presence/absence of prodromal symptoms, Kappa coefficients ranged between 0.8 and 0.7. Similarly, the raters obtained an excellent level of agreement regarding the onset of each symptom and the duration of symptoms until first treatment (intraclass correlation coefficients between 0.9 and 1.0). Cronbach's alpha was 0.9-1.0 for all the items. The interrater reliability and concurrent validity were also excellent in both cases. This study provides robust psychometric properties of the Spanish version of the SOS. The translated version is adequate in terms of good internal validity, intrarater and interrater reliability, and is as time-efficient as the original version. Copyright © 2017 Elsevier B.V. All rights reserved.

Psychometric evaluation of the Shared Decision-Making Instrument--Revised.

PubMed

Bartlett, Jacqueline A; Peterson, Jane A

2013-02-01

The purpose of this study was to evaluate the psychometric properties of the Shared Decision-Making Inventory-Revised (SDMI-R) to measure four constructs (knowledge, attitudes, self-efficacy, and intent) theoretically defined as vital in discussing the human papillomavirus (HPV) disease and vaccine with clients. The SDMI-R was distributed to a sample (N = 1,525) of school nurses. Correlational matrixes denoted moderate to strong correlations, indicating adequate internal reliability. Reliability for the total instrument was satisfactory (α = .874) along with Attitude, Self-Efficacy and Intent subscales .828, .917, .891, respectively. Exploratory factor analysis revealed five components that explained 75.96% of the variance.

VALIDITY AND RELIABILITY OF THE SPIRITUAL COPING STRATEGIES SCALE ARABIC VERSION IN SAUDI PATIENTS UNDERGOING HAEMODIALYSIS.

PubMed

Cruz, Jonas P; Baldacchino, Donia R; Alquwez, Nahed

2016-06-01

Patients often resort to religious and spiritual activities to cope with physical and mental challenges. The effect of spiritual coping on overall health, adaptation and health-related quality of life among patients undergoing haemodialysis (HD) is well documented. Thus, it is essential to establish a valid and reliable instrument that can assess both the religious and non-religious coping methods in patients undergoing HD. This study aimed to assess the validity and reliability of the Spiritual Coping Strategies Scale Arabic version (SCS-A) in Saudi patients undergoing HD. A convenience sample of 60 Saudi patients undergoing HD was recruited for this descriptive, cross-sectional study. Data were collected between May and June 2015. Forward-backward translation was used to formulate the SCS-A. The SCS-A, Muslim Religiosity Scale and the Quality of Life Index Dialysis Version III were used to procure the data. Internal consistency reliability, stability reliability, factor analysis and construct validity tests were performed. Analyses were set at the 0.05 level of significance. The SCS-A showed an acceptable internal consistency and strong stability reliability over time. The EFA produced two factors (non-religious and religious coping). Satisfactory construct validity was established by the convergent and divergent validity and known-groups method. The SCS-A is a reliable and valid tool that can be used to measure the religious and non-religious coping strategies of patients undergoing HD in Saudi Arabia and other Muslim and Arabic-speaking countries. © 2016 European Dialysis and Transplant Nurses Association/European Renal Care Association.

Adaptation and Validation of the Arabic Version of the Infant Breastfeeding Knowledge Questionnaire among Lebanese Women.

PubMed

Tamim, Hani; Ghandour, Lilian A; Shamsedine, Lama; Charafeddine, Lama; Nasser, Fatima; Khalil, Yvette; Nabulsi, Mona

2016-11-01

Valid instruments that can reliably assess maternal breastfeeding knowledge in Arabic-speaking populations are nonexistent. The availability of such an instrument is essential for investigators working in this field. This study aimed to describe the adaptation and validation of the Arabic Breastfeeding Knowledge Questionnaire (BFK-A) from the original 20-item English version. A translated version of the 20-item BFK was validated among 417 Lebanese women after pilot testing for clarity, comprehension, length, and cultural appropriateness. Exploratory factor analysis was run to examine dimensionality of the instrument and Kuder-Richardson-20 (KR-20) was used to assess its internal consistency. The BFK-A is a unidimensional scale with acceptable internal consistency reliability (KR-20 = 0.652) after the exclusion of 4 items. Higher breastfeeding knowledge levels were strongly and statistically significantly associated with higher mean scores for the validated Arabic Iowa Infant Feeding Attitude Scale ( P < .001), thus confirming its construct validity. The Arabic 16-item BFK-A has an acceptable reliability, similar to the original instrument. Further studies are encouraged to confirm the validity of the 16-item BFK-A among other Arab populations. There is also a need to develop more reliable instruments to use in lactation research in this context.

Reliability and validity of television food advertising questionnaire in Malaysia.

PubMed

Zalma, Abdul Razak; Safiah, Md Yusof; Ajau, Danis; Khairil Anuar, Md Isa

2015-09-01

Interventions to counter the influence of television food advertising amongst children are important. Thus, reliable and valid instrument to assess its effect is needed. The objective of this study was to determine the reliability and validity of such a questionnaire. The questionnaire was administered twice on 32 primary schoolchildren aged 10-11 years in Selangor, Malaysia. The interval between the first and second administration was 2 weeks. Test-retest method was used to examine the reliability of the questionnaire. Intra-rater reliability was determined by kappa coefficient and internal consistency by Cronbach's alpha coefficient. Construct validity was evaluated using factor analysis. The test-retest correlation showed moderate-to-high reliability for all scores (r = 0.40*, p = 0.02 to r = 0.95**, p = 0.00), with one exception, consumption of fast foods (r = 0.24, p = 0.20). Kappa coefficient showed acceptable-to-strong intra-rater reliability (K = 0.40-0.92), except for two items under knowledge on television food advertising (K = 0.26 and K = 0.21) and one item under preference for healthier foods (K = 0.33). Cronbach's alpha coefficient indicated acceptable internal consistency for all scores (0.45-0.60). After deleting two items under Consumption of Commonly Advertised Food, the items showed moderate-to-high loading (0.52, 0.84, 0.42 and 0.42) with the Scree plot showing that there was only one factor. The Kaiser-Meyer-Olkin was 0.60, showing that the sample was adequate for factor analysis. The questionnaire on television food advertising is reliable and valid to assess the effect of media literacy education on television food advertising on schoolchildren. © The Author (2013). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Validity and reliability of the Diagnostic Adaptive Behaviour Scale.

PubMed

Tassé, M J; Schalock, R L; Balboni, G; Spreat, S; Navas, P

2016-01-01

The Diagnostic Adaptive Behaviour Scale (DABS) is a new standardised adaptive behaviour measure that provides information for evaluating limitations in adaptive behaviour for the purpose of determining a diagnosis of intellectual disability. This article presents validity evidence and reliability data for the DABS. Validity evidence was based on comparing DABS scores with scores obtained on the Vineland Adaptive Behaviour Scale, second edition. The stability of the test scores was measured using a test and retest, and inter-rater reliability was assessed by computing the inter-respondent concordance. The DABS convergent validity coefficients ranged from 0.70 to 0.84, while the test-retest reliability coefficients ranged from 0.78 to 0.95, and the inter-rater concordance as measured by intraclass correlation coefficients ranged from 0.61 to 0.87. All obtained validity and reliability indicators were strong and comparable with the validity and reliability coefficients of the most commonly used adaptive behaviour instruments. These results and the advantages of the DABS for clinician and researcher use are discussed. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Evaluation of the Cardiac Depression Visual Analogue Scale in a medical and non-medical sample.

PubMed

Di Benedetto, Mirella; Sheehan, Matthew

2014-01-01

Comorbid depression and medical illness is associated with a number of adverse health outcomes such as lower medication adherence and higher rates of subsequent mortality. Reliable and valid psychological measures capable of detecting a range of depressive symptoms found in medical settings are needed. The Cardiac Depression Visual Analogue Scale (CDVAS) is a recently developed, brief six-item measure originally designed to assess the range and severity of depressive symptoms within a cardiac population. The current study aimed to further investigate the psychometric properties of the CDVAS in a general and medical sample. The sample consisted of 117 participants, whose mean age was 40.0 years (SD = 19.0, range 18-84). Participants completed the CDVAS, the Cardiac Depression Scale (CDS), the Depression Anxiety Stress Scales (DASS) and a demographic and health questionnaire. The CDVAS was found to have adequate internal reliability (α = .76), strong concurrent validity with the CDS (r = .89) and the depression sub-scale of the DASS (r = .70), strong discriminant validity and strong predictive validity. The principal components analysis revealed that the CDVAS measured only one component, providing further support for the construct validity of the scale. Results of the current study indicate that the CDVAS is a short, simple, valid and reliable measure of depressive symptoms suitable for use in a general and medical sample.

Children's Attributional Style from Middle Childhood to Early Adolescence: Further Validation of the Paper-and-Pencil Versions of the Children's Attributional Style Interview

ERIC Educational Resources Information Center

Rueger, Sandra Yu; Haines, Beth A.; Malecki, Christine Kerres

2010-01-01

The psychometric properties of two paper-and-pencil versions of the Children's Attributional Style Interview (i.e., CASI-I and CASI-II) were evaluated in a sample of 166 third and fourth graders and a sample of 245 sixth and seventh graders. The results demonstrated strong internal consistency reliability, convergent validity, and a factor…

Obfuscation Framework Based on Functionally Equivalent Combinatorial Logic Families

DTIC Science & Technology

2008-03-01

of Defense, or the United States Government . AFIT/GCS/ENG/08-12 Obfuscation Framework Based on Functionally Equivalent Combinatorial Logic Families...time, United States policy strongly encourages the sale and transfer of some military equipment to foreign governments and makes it easier for...Proceedings of the International Conference on Availability, Reliability and Security, 2007. 14. McDonald, J. Todd and Alec Yasinsac. “Of unicorns and random

Score Reliability and Validity of the Student Risk Screening Scale: A Psychometrically Sound, Feasible Tool for Use in Urban Middle Schools

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Bruhn, Allison L.; Eisner, Shanna L.; Kalberg, Jemma Robertson

2010-01-01

In this article, the authors examine the psychometric properties of the "Student Risk Screening Scale" (SRSS) for use in urban middle schools. Results of Studies 1 and 2 suggest strong internal consistency and test-retest stability. Study 1 supports the predictive validity of the SRSS, with students at low risk being able to be differentiated from…

Therapist adherence in the strong without anorexia nervosa (SWAN) study: A randomized controlled trial of three treatments for adults with anorexia nervosa.

PubMed

Andony, Louise J; Tay, Elaine; Allen, Karina L; Wade, Tracey D; Hay, Phillipa; Touyz, Stephen; McIntosh, Virginia V W; Treasure, Janet; Schmidt, Ulrike H; Fairburn, Christopher G; Erceg-Hurn, David M; Fursland, Anthea; Crosby, Ross D; Byrne, Susan M

2015-12-01

To develop a psychotherapy rating scale to measure therapist adherence in the Strong Without Anorexia Nervosa (SWAN) study, a multi-center randomized controlled trial comparing three different psychological treatments for adults with anorexia nervosa. The three treatments under investigation were Enhanced Cognitive Behavioural Therapy (CBT-E), the Maudsley Anorexia Nervosa Treatment for Adults (MANTRA), and Specialist Supportive Clinical Management (SSCM). The SWAN Psychotherapy Rating Scale (SWAN-PRS) was developed, after consultation with the developers of the treatments, and refined. Using the SWAN-PRS, two independent raters initially rated 48 audiotapes of treatment sessions to yield inter-rater reliability data. One rater proceeded to rate a total of 98 audiotapes from 64 trial participants. The SWAN-PRS demonstrated sound psychometric properties, and was considered a reliable measure of therapist adherence. The three treatments were highly distinguishable by independent raters, with therapists demonstrating significantly more behaviors consistent with the actual allocated treatment compared to the other two treatment modalities. There were no significant site differences in therapist adherence observed. The findings provide support for the internal validity of the SWAN study. The SWAN-PRS was deemed suitable for use in other trials involving CBT-E, MANTRA, or SSCM. The Authors. International Journal of Eating Disorders Published by Wiley Periodicals, Inc.

Quality and rigor of the concept mapping methodology: a pooled study analysis.

PubMed

Rosas, Scott R; Kane, Mary

2012-05-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed. Copyright © 2011 Elsevier Ltd. All rights reserved.

Privacy Preserved and Secured Reliable Routing Protocol for Wireless Mesh Networks.

PubMed

Meganathan, Navamani Thandava; Palanichamy, Yogesh

2015-01-01

Privacy preservation and security provision against internal attacks in wireless mesh networks (WMNs) are more demanding than in wired networks due to the open nature and mobility of certain nodes in the network. Several schemes have been proposed to preserve privacy and provide security in WMNs. To provide complete privacy protection in WMNs, the properties of unobservability, unlinkability, and anonymity are to be ensured during route discovery. These properties can be achieved by implementing group signature and ID-based encryption schemes during route discovery. Due to the characteristics of WMNs, it is more vulnerable to many network layer attacks. Hence, a strong protection is needed to avoid these attacks and this can be achieved by introducing a new Cross-Layer and Subject Logic based Dynamic Reputation (CLSL-DR) mechanism during route discovery. In this paper, we propose a new Privacy preserved and Secured Reliable Routing (PSRR) protocol for WMNs. This protocol incorporates group signature, ID-based encryption schemes, and CLSL-DR mechanism to ensure strong privacy, security, and reliability in WMNs. Simulation results prove this by showing better performance in terms of most of the chosen parameters than the existing protocols.

High inter-rater reliability, agreement, and convergent validity of Constant score in patients with clavicle fractures.

PubMed

Ban, Ilija; Troelsen, Anders; Kristensen, Morten Tange

2016-10-01

The Constant score (CS) has been the primary endpoint in most studies on clavicle fractures. However, the CS was not developed to assess patients with clavicle fractures. Our aim was to examine inter-rater reliability and agreement of the CS in patients with clavicle fractures. The secondary aim was to estimate the correlation between the CS and the Disabilities of the Arm, Shoulder and Hand score and the internal consistency of the 2 scores. On the basis of sample sizing, 36 patients (31 male and 5 female patients; mean age, 41.3 years) with clavicle fractures underwent standardized CS assessment at a mean of 6.8 weeks (SD, 1.0 weeks) after injury. Reliability and agreement of the CS were determined by 2 raters. The interclass correlation coefficient (ICC2,1), standard error of measurement, minimal detectable change, Cronbach α coefficient, and Pearson correlation coefficient were estimated. Inter-rater reliability of the total CS was excellent (interclass correlation coefficient, 0.94; 95% confidence interval, 0.88-0.97), with no systematic difference between the 2 raters (P = .75). The standard error of measurement (measurement error at the group level) was 4.9, whereas the minimal detectable change (smallest change needed to indicate a real change for an individual) was 13.6 CS points. The internal consistency of the 10 CS items was good, with a Cronbach α of .85, and we found a strong correlation (r = -0.92) between the CS and Disabilities of the Arm, Shoulder and Hand score. The CS was found to be reliable for assessing patients with clavicle fractures, especially at the group level. With high inter-rater reliability and agreement, in addition to good internal consistency, the standardized CS used in this study can be used for comparison of results from different settings. Copyright © 2016 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

The revised scale for caregiving self-efficacy: reliability and validity studies.

PubMed

Steffen, Ann M; McKibbin, Christine; Zeiss, Antonette M; Gallagher-Thompson, Dolores; Bandura, Albert

2002-01-01

Two samples of family caregivers (Study 1: N = 169; Study 2: N = 145) of cognitively impaired older adults were used to revise, extend, and evaluate a measure of perceived self-efficacy for caregiving tasks. The Revised Scale for Caregiving Self-Efficacy measures 3 domains of caregiving self-efficacy: Obtaining Respite, Responding to Disruptive Patient Behaviors, and Controlling Upsetting Thoughts. The 3 subscales show strong internal consistency and adequate test-retest reliability. Construct validity is supported by relationships between these 3 facets of perceived caregiving efficacy and depression, anxiety, anger, perceived social support, and criticism expressed in speech samples. The Revised Scale for Caregiving Self-Efficacy has potential uses for both research and clinical purposes.

Reliability, validity, and interpretation of the dependence scale in mild to moderately severe Alzheimer's disease.

PubMed

Lenderking, William R; Wyrwich, Kathleen W; Stolar, Marilyn; Howard, Kellee A; Leibman, Chris; Buchanan, Jacqui; Lacey, Loretto; Kopp, Zoe; Stern, Yaakov

2013-12-01

The Dependence Scale (DS) was designed to measure dependence on others among patients with Alzheimer's disease (AD). The objectives of this research were primarily to strengthen the psychometric evidence for the use of the DS in AD studies. Patients with mild to moderately severe AD were examined in 3 study databases. Within each data set, internal consistency, validity, and responsiveness were examined, and structural equation models were fit. The DS has strong psychometric properties. The DS scores differed significantly across known groups and demonstrated moderate to strong correlations with measures hypothesized to be related to dependence (|r| ≥ .31). Structural equation modeling supported the validity of the DS concept. An anchor-based DS responder definition to interpret a treatment benefit over time was identified. The DS is a reliable, valid, and interpretable measure of dependence associated with AD and is shown to be related to--but provides information distinct from--cognition, functioning, and behavior.

Developing and testing the CHORDS: Characteristics of Responsible Drinking Survey.

PubMed

Barry, Adam E; Goodson, Patricia

2011-01-01

Report on the development and psychometric testing of a theoretically and evidence-grounded instrument, the Characteristics of Responsible Drinking Survey (CHORDS). Instrument subjected to four phases of pretesting (cognitive validity, cognitive and motivational qualities, pilot test, and item evaluation) and a final posttest implementation. Large public university in Texas. Randomly selected convenience sample (n  =  729) of currently enrolled students. This 78-item questionnaire measures individuals' responsible drinking beliefs, motivations, intentions, and behaviors. Cronbach α, split-half reliability, principal components analysis and Spearman ρ were conducted to investigate reliability, stability, and validity. Measures in the CHORDS exhibited high internal consistency reliability and strong correlations of split-half reliability. Factor analyses indicated five distinct scales were present, as proposed in the theoretical model. Subscale composite scores also exhibited a correlation to alcohol consumption behaviors, indicating concurrent validity. The CHORDS represents the first instrument specifically designed to assess responsible drinking beliefs and behaviors. It was found to elicit valid and reliable data among a college student sample. This instrument holds much promise for practitioners who desire to empirically investigate dimensions of responsible drinking.

The SPAI-18, a brief version of the social phobia and anxiety inventory: reliability and validity in clinically referred and non-referred samples.

PubMed

de Vente, Wieke; Majdandžić, Mirjana; Voncken, Marisol J; Beidel, Deborah C; Bögels, Susan M

2014-03-01

We developed a new version of the Social Phobia and Anxiety Inventory (SPAI) in order to have a brief instrument for measuring social anxiety and social anxiety disorder (SAD) with a strong conceptual foundation. In the construction phase, a set of items representing 5 core aspects of social anxiety was selected by a panel of social anxiety experts. The selected item pool was validated using factor analysis, reliability analysis, and diagnostic analysis in a sample of healthy participants (N = 188) and a sample of clinically referred participants diagnosed with SAD (N = 98). This procedure resulted in an abbreviated version of the Social Phobia Subscale of the SPAI consisting of 18 items (i.e. the SPAI-18), which correlated strongly with the Social Phobia Subscale of the original SPAI (both groups r = .98). Internal consistency and diagnostic characteristics using a clinical cut-off score > 48 were good to excellent (Cronbach's alpha healthy group = .93; patient group = .91; sensitivity: .94; specificity: .88). The SPAI-18 was further validated in a community sample of parents-to-be without SAD (N = 237) and with SAD (N = 65). Internal consistency was again excellent (both groups Cronbach's alpha = .93) and a screening cut-off of > 36 proved to result in good sensitivity and specificity. The SPAI-18 also correlated strongly with other social anxiety instruments, supporting convergent validity. In sum, the SPAI-18 is a psychometrically sound instrument with good screening capacity for social anxiety disorder in clinical as well as community samples. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reliability and validity of the revised Gibson Test of Cognitive Skills, a computer-based test battery for assessing cognition across the lifespan.

PubMed

Moore, Amy Lawson; Miller, Terissa M

2018-01-01

The purpose of the current study is to evaluate the validity and reliability of the revised Gibson Test of Cognitive Skills, a computer-based battery of tests measuring short-term memory, long-term memory, processing speed, logic and reasoning, visual processing, as well as auditory processing and word attack skills. This study included 2,737 participants aged 5-85 years. A series of studies was conducted to examine the validity and reliability using the test performance of the entire norming group and several subgroups. The evaluation of the technical properties of the test battery included content validation by subject matter experts, item analysis and coefficient alpha, test-retest reliability, split-half reliability, and analysis of concurrent validity with the Woodcock Johnson III Tests of Cognitive Abilities and Tests of Achievement. Results indicated strong sources of evidence of validity and reliability for the test, including internal consistency reliability coefficients ranging from 0.87 to 0.98, test-retest reliability coefficients ranging from 0.69 to 0.91, split-half reliability coefficients ranging from 0.87 to 0.91, and concurrent validity coefficients ranging from 0.53 to 0.93. The Gibson Test of Cognitive Skills-2 is a reliable and valid tool for assessing cognition in the general population across the lifespan.

Reliability and Normative Reference Values for the Vestibular/Ocular Motor Screening (VOMS) Tool in Youth Athletes.

PubMed

Moran, Ryan N; Covassin, Tracey; Elbin, R J; Gould, Dan; Nogle, Sally

2018-05-01

The Vestibular/Ocular Motor Screening (VOMS) measure is a newly developed vestibular and ocular motor symptom provocation screening tool for sport-related concussions. Baseline data, psychometric properties, and reliability of the VOMS are needed to further understand the applications of this tool, especially in the youth population, where research is scarce. To establish normative data and document the internal consistency and false-positive rate of the VOMS in a sample of nonconcussed youth athletes. Cross-sectional study; Level of evidence, 3. A total of 423 youth athletes (male = 278, female = 145) between the ages of 8 and 14 years completed baseline VOMS screening before the start of their respective sport seasons. Internal consistency was measured with Cronbach α and inter-item correlations. Approximately 60% of youth athletes reported no symptom provocation on baseline VOMS assessment, with 9% to 13% scoring over the cutoff levels (score of ≥2 for any individual VOMS symptom, near point convergence distance of ≥5 cm). The VOMS displayed a high internal consistency (Cronbach α = .97) at baseline among youth athletes. The current findings provide preliminary support for the implementation of VOMS baseline assessment into clinical practice, due to a high internal consistency, strong relationships between VOMS items, and a low false-positive rate at baseline in youth athletes.

Self-Management and Transition Readiness Assessment: Development, Reliability, and Factor Structure of the STARx Questionnaire.

PubMed

Ferris, M; Cohen, S; Haberman, C; Javalkar, K; Massengill, S; Mahan, J D; Kim, S; Bickford, K; Cantu, G; Medeiros, M; Phillips, A; Ferris, M T; Hooper, S R

2015-01-01

The Self-Management and Transition to Adulthood with Rx=Treatment (STARx) Questionnaire was developed to collect information on self-management and health care transition (HCT) skills, via self-report, in a broad population of adolescents and young adults (AYAs) with chronic conditions. Over several iterations, the STARx questionnaire was created with AYA, family, and health provider input. The development and pilot testing of the STARx Questionnaire took place with the assistance of 1219 AYAs with different chronic health conditions, in multiple institutions and settings over three phases: item development, pilot testing, reliability and factor structuring. The three development phases resulted in a final version of the STARx Questionnaire. The exploratory factor analysis of the third version of the 18-item STARx identified six factors that accounted for about 65% of the variance: Medication management, Provider communication, Engagement during appointments, Disease knowledge, Adult health responsibilities, and Resource utilization. Reliability estimates revealed good internal consistency and temporal stability, with the alpha coefficient for the overall scale being .80. The STARx was developmentally sensitive, with older patients scoring significantly higher on nearly every factor than younger patients. The STARx Questionnaire is a reliable, self-report tool with adequate internal consistency, temporal stability, and a strong, multidimensional factor structure. It provides another assessment strategy to measure self-management and transition skills in AYAs with chronic conditions. Copyright © 2015 Elsevier Inc. All rights reserved.

Psychometric properties of the Dutch version of the London Measure of Unplanned Pregnancy in women with pregnancies ending in birth.

PubMed

Goossens, Joline; Verhaeghe, Sofie; Van Hecke, Ann; Barrett, Geraldine; Delbaere, Ilse; Beeckman, Dimitri

2018-01-01

To evaluate the psychometric properties of the Dutch version of the London Measure of Unplanned Pregnancy in women with pregnancies ending in birth. A two-phase psychometric evaluation design was set-up. Phase I comprised the translation from English into Dutch and pretesting with 6 women using cognitive interviews. In phase II, the reliability and validity of the Dutch version of the LMUP was assessed in 517 women giving birth recently. Reliability (internal consistency) was assessed using Cronbach's alpha, inter-item correlations, and corrected item-total correlations. Construct validity was assessed using principal components analysis and hypothesis testing. Exploratory Mokken scale analysis was carried out. 517 women aged 15-45 completed the Dutch version of the LMUP. Reliability testing showed acceptable internal consistency (alpha = 0.74, positive inter-item correlations between all items, all corrected item-total correlations >0.20). Validity testing confirmed the unidimensional structure of the scale and all hypotheses were confirmed. The overall Loevinger's H coefficient was 0.57, representing a 'strong' scale. The Dutch version of the LMUP is a reliable and valid measure that can be used in the Dutch-speaking population in Belgium to assess pregnancy planning. Future research is necessary to assess the stability of the Dutch version of the LMUP, and to evaluate its psychometric properties in women with abortions.

Confirmatory Factor Analysis of the Combined Social Phobia Scale and Social Interaction Anxiety Scale: Support for a Bifactor Model.

PubMed

Gomez, Rapson; Watson, Shaun D

2017-01-01

For the Social Phobia Scale (SPS) and the Social Interaction Anxiety Scale (SIAS) together, this study examined support for a bifactor model, and also the internal consistency reliability and external validity of the factors in this model. Participants ( N = 526) were adults from the general community who completed the SPS and SIAS. Confirmatory factor analysis (CFA) of their ratings indicated good support for the bifactor model. For this model, the loadings for all but six items were higher on the general factor than the specific factors. The three positively worded items had negligible loadings on the general factor. The general factor explained most of the common variance in the SPS and SIAS, and demonstrated good model-based internal consistency reliability (omega hierarchical) and a strong association with fear of negative evaluation and extraversion. The practical implications of the findings for the utilization of the SPS and SIAS, and the theoretical and clinical implications for social anxiety are discussed.

Confirmatory Factor Analysis of the Combined Social Phobia Scale and Social Interaction Anxiety Scale: Support for a Bifactor Model

PubMed Central

Gomez, Rapson; Watson, Shaun D.

2017-01-01

For the Social Phobia Scale (SPS) and the Social Interaction Anxiety Scale (SIAS) together, this study examined support for a bifactor model, and also the internal consistency reliability and external validity of the factors in this model. Participants (N = 526) were adults from the general community who completed the SPS and SIAS. Confirmatory factor analysis (CFA) of their ratings indicated good support for the bifactor model. For this model, the loadings for all but six items were higher on the general factor than the specific factors. The three positively worded items had negligible loadings on the general factor. The general factor explained most of the common variance in the SPS and SIAS, and demonstrated good model-based internal consistency reliability (omega hierarchical) and a strong association with fear of negative evaluation and extraversion. The practical implications of the findings for the utilization of the SPS and SIAS, and the theoretical and clinical implications for social anxiety are discussed. PMID:28210232

Psychometric evaluation of the impact of weight on quality of life-lite questionnaire (IWQOL-lite) in a community sample.

PubMed

Kolotkin, Ronette L; Crosby, Ross D

2002-03-01

The short form of impact of weight on quality of life (IWQOL)-Lite is a 31-item, self-report, obesity-specific measure of health-related quality of life (HRQOL) that consists of a total score and scores on each of five scales--physical function, self-esteem, sexual life, public distress, and work--and that exhibits strong psychometric properties. This study was undertaken in order to assess test-retest reliability and discriminant validity in a heterogeneous sample of individuals not in treatment. Individuals were recruited from the community to complete questionnaires that included the IWQOL-Lite, SF-36, Rosenberg self-esteem (RSE) scale, Marlowe-Crowne social desirability scale, global ratings of quality of life, and sexual functioning and public distress ratings. Persons currently enrolled in weight loss programs or with a body mass index (BMI) of less than 18.5 were dropped from the analyses, leaving 341 females and 153 males for analysis, with an average BMI of 27.4. For test-retest reliability, 112 participants completed the IWQOL-Lite again. ANOVA revealed significant main effects for BMI for all IWQOL-Lite scales and total score. Females showed greater impairment than males on all scales except public distress. Internal consistency ranged from 0.816 to 0.944 for IWQOL-Lite scales and was 0.958 for total score. Test-retest reliability ranged from 0.814 to 0.877 for scales and was 0.937 for total score. Internal consistency and test-retest results for overweight/obese subjects were similar to those obtained for the total sample. There was strong evidence for convergent and discriminant validity of the IWQOL-Lite in overweight/obese subjects. As in previous studies conducted on treatment-seeking obese persons, the IWQOL-Lite appears to be a reliable and valid measure of obesity-specific quality of life in overweight/obese persons not seeking treatment.

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda.

PubMed

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-12-02

The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda.

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda

PubMed Central

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-01-01

Background The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. Methods A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. Results The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. Conclusion This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda. PMID:19055716

The Clinician-Administered PTSD Scale for DSM-5 (CAPS-5): Development and initial psychometric evaluation in military veterans.

PubMed

Weathers, Frank W; Bovin, Michelle J; Lee, Daniel J; Sloan, Denise M; Schnurr, Paula P; Kaloupek, Danny G; Keane, Terence M; Marx, Brian P

2018-03-01

The Clinician-Administered PTSD Scale (CAPS) is an extensively validated and widely used structured diagnostic interview for posttraumatic stress disorder (PTSD). The CAPS was recently revised to correspond with PTSD criteria in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; American Psychiatric Association, 2013). This article describes the development of the CAPS for DSM-5 (CAPS-5) and presents the results of an initial psychometric evaluation of CAPS-5 scores in 2 samples of military veterans (Ns = 165 and 207). CAPS-5 diagnosis demonstrated strong interrater reliability (к = .78 to 1.00, depending on the scoring rule) and test-retest reliability (к = .83), as well as strong correspondence with a diagnosis based on the CAPS for DSM-IV (CAPS-IV; к = .84 when optimally calibrated). CAPS-5 total severity score demonstrated high internal consistency (α = .88) and interrater reliability (ICC = .91) and good test-retest reliability (ICC = .78). It also demonstrated good convergent validity with total severity score on the CAPS-IV (r = .83) and PTSD Checklist for DSM-5 (r = .66) and good discriminant validity with measures of anxiety, depression, somatization, functional impairment, psychopathy, and alcohol abuse (rs = .02 to .54). Overall, these results indicate that the CAPS-5 is a psychometrically sound measure of DSM-5 PTSD diagnosis and symptom severity. Importantly, the CAPS-5 strongly corresponds with the CAPS-IV, which suggests that backward compatibility with the CAPS-IV was maintained and that the CAPS-5 provides continuity in evidence-based assessment of PTSD in the transition from DSM-IV to DSM-5 criteria. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Measuring verbal and non-verbal communication in aphasia: reliability, validity, and sensitivity to change of the Scenario Test.

PubMed

van der Meulen, Ineke; van de Sandt-Koenderman, W Mieke E; Duivenvoorden, Hugo J; Ribbers, Gerard M

2010-01-01

This study explores the psychometric qualities of the Scenario Test, a new test to assess daily-life communication in severe aphasia. The test is innovative in that it: (1) examines the effectiveness of verbal and non-verbal communication; and (2) assesses patients' communication in an interactive setting, with a supportive communication partner. To determine the reliability, validity, and sensitivity to change of the Scenario Test and discuss its clinical value. The Scenario Test was administered to 122 persons with aphasia after stroke and to 25 non-aphasic controls. Analyses were performed for the entire group of persons with aphasia, as well as for a subgroup of persons unable to communicate verbally (n = 43). Reliability (internal consistency, test-retest reliability, inter-judge, and intra-judge reliability) and validity (internal validity, convergent validity, known-groups validity) and sensitivity to change were examined using standard psychometric methods. The Scenario Test showed high levels of reliability. Internal consistency (Cronbach's alpha = 0.96; item-rest correlations = 0.58-0.82) and test-retest reliability (ICC = 0.98) were high. Agreement between judges in total scores was good, as indicated by the high inter- and intra-judge reliability (ICC = 0.86-1.00). Agreement in scores on the individual items was also good (square-weighted kappa values 0.61-0.92). The test demonstrated good levels of validity. A principal component analysis for categorical data identified two dimensions, interpreted as general communication and communicative creativity. Correlations with three other instruments measuring communication in aphasia, that is, Spontaneous Speech interview from the Aachen Aphasia Test (AAT), Amsterdam-Nijmegen Everyday Language Test (ANELT), and Communicative Effectiveness Index (CETI), were moderate to strong (0.50-0.85) suggesting good convergent validity. Group differences were observed between persons with aphasia and non-aphasic controls, as well as between persons with aphasia unable to use speech to convey information and those able to communicate verbally; this indicates good known-groups validity. The test was sensitive to changes in performance, measured over a period of 6 months. The data support the reliability and validity of the Scenario Test as an instrument for examining daily-life communication in aphasia. The test focuses on multimodal communication; its psychometric qualities enable future studies on the effect of Alternative and Augmentative Communication (AAC) training in aphasia.

Validity and reliability of a low-cost digital dynamometer for measuring isometric strength of lower limb.

PubMed

Romero-Franco, Natalia; Jiménez-Reyes, Pedro; Montaño-Munuera, Juan A

2017-11-01

Lower limb isometric strength is a key parameter to monitor the training process or recognise muscle weakness and injury risk. However, valid and reliable methods to evaluate it often require high-cost tools. The aim of this study was to analyse the concurrent validity and reliability of a low-cost digital dynamometer for measuring isometric strength in lower limb. Eleven physically active and healthy participants performed maximal isometric strength for: flexion and extension of ankle, flexion and extension of knee, flexion, extension, adduction, abduction, internal and external rotation of hip. Data obtained by the digital dynamometer were compared with the isokinetic dynamometer to examine its concurrent validity. Data obtained by the digital dynamometer from 2 different evaluators and 2 different sessions were compared to examine its inter-rater and intra-rater reliability. Intra-class correlation (ICC) for validity was excellent in every movement (ICC > 0.9). Intra and inter-tester reliability was excellent for all the movements assessed (ICC > 0.75). The low-cost digital dynamometer demonstrated strong concurrent validity and excellent intra and inter-tester reliability for assessing isometric strength in the main lower limb movements.

Psychometric Properties of the Self-Perception Profile for Children in Children with Chronic Illness.

PubMed

Ferro, Mark A; Tang, Jennie

2017-07-01

The Self-Perception Profile for Children (SPPC) is a commonly used measure of self-concept in children, but little research has examined its psychometric properties in children newly-diagnosed with chronic illness. Confirmatory factor analysis and examination of reliability and convergent and discriminant validity of the SPPC was conducted in 31 children newly-diagnosed with asthma, diabetes, epilepsy, food allergy, or juvenile arthritis. The unidimensionality of each domain of the SPPC was confirmed, internal reliability was robust (α=.83-.95), and inter-domain polychoric correlations ranged from weak to strong (ρ=.05-.85) Convergent validity was demonstrated with measures of global self-concept and domains of quality of life. The Global Self-worth domain showed discriminant validity between children with and without comorbid mental disorder. Findings extend the psychometric properties of the SPPC as a valid and reliable scale in children newly-diagnosed with chronic illness.

Preliminary Psychometric Analysis of the Modified Perceived Value of Certification Tool for the Nurse Educator.

PubMed

Barbe, Tammy

2015-01-01

The purpose of this study was to examine psychometric properties of the Perceived Value of Certification Tool© with a focus on nurse educator certification (PVCT-NE) in a sample of nurse educators. Greater understanding of faculty perceptions of certification is necessary to facilitate a strong cadre of nursing faculty; however, research around nurse educator certification is limited by a lack of reliable and valid instruments to measure such perceptions. Twenty-four nursing faculty from one university participated in the psychometric study, which involved completion of the PVCT-NE in a web-based survey format. Internal consistency reliability was excellent. Cronbach's alpha for the total PVCT-NE was .94 (.93 for the intrinsic subscale and .86 for the extrinsic subscale). A content validity index of .95 was obtained. There is preliminary evidence that the PVCT-NE is a reliable and valid instrument to measure perceived value of certification in nurse educators.

Transcultural adaptation of the Korean version of the Hip Outcome Score.

PubMed

Lee, Young-Kyun; Ha, Yong-Chan; Martin, RobRoy L; Hwang, Deuk-Soo; Koo, Kyung-Hoi

2015-11-01

The Hip Outcome Score (HOS) is a questionnaire commonly used to assess the clinical outcome of patients after hip arthroscopy. However, a Korean version of the HOS is not available. The aim of this study was to translate and adapt the HOS questionnaire into the Korean language and then assess the psychometric properties of this instrument. Translation and transcultural adaptation of the HOS into Korean (HOS-K) was performed in accordance with the international recommendations. Sixty patients (mean age 38.4 years) planning hip arthroscopy participated in evaluating the psychometric properties of the HOS-K. Psychometric analyses consisted of assessing for the following: (1) floor/ceiling effects, (2) internal consistency using Cronbach's alpha, (3) test-retest reliability over 2-3 weeks with intraclass correlation coefficient (ICC), (4) convergent validity by correlation with the SF-36 and Hip disability and Osteoarthritis Outcome Score (HOOS), (5) construct validity by assessing for a difference in HOS-K scores based on a rating of hip function, and (6) responsiveness with a change in score over a 6-month period. The English version of the HOS was translated and adapted to Korean without notable discrepancies. The HOS-K scores were reliable with ICC of 0.946 for the activities of daily living (ADL) subscale and 0.929 for the sports subscale. Internal consistency was confirmed by Cronbach's alpha >0.90 for both subscales. Both subscales had a strong correlation to the five subscales of SF-36, except the general health subscale. The ADL subscale showed strong correlations with all the subscales of the HOOS, and sports subscale showed strong correlations with all subscales of the HOOS, except the symptom subscales of HOOS. The HOS-K also demonstrated evidence for responsiveness without floor and ceiling effects. The HOS-K can be recommended as an outcome instrument in hip arthroscopy for Korean-speaking individuals. Surgeons can use the HOS-K to evaluate the outcome of hip arthroscopy in Korea. Therapeutic case series with no comparison group, Level IV.

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

Adaptation and Validation of the Voice-Related Quality of Life Measure Into Polish.

PubMed

Sielska-Badurek, Ewelina; Rzepakowska, Anna; Sobol, Maria; Osuch-Wójcikiewicz, Ewa; Niemczyk, Kazimierz

2016-11-01

The purpose of the study was to translate and adapt the original V-RQOL (Voice-Related Quality of Life) instrument into Polish and to evaluate the psychometric properties of the Polish version of the V-RQOL Measure such as internal consistency, reliability, and construct validity in different groups of dysphonic patients. A total of 214 patients with voice disorders were assessed using the V-RQOL Measure, the Voice Handicap Index, and the World Health Organization Quality of Life, short version. The Polish version of the V-RQOL Measure showed strong internal consistency with the Cronbach alpha coefficient: 0.92 for the total score, 0.90 for the social-emotional domain, and 0.86 for the physical functioning domain, and a good test-retest reliability (r-Spearman correlation coefficient: r = 0.8852 for the total score of the V-RQOL Measure). Construct validity was demonstrated with a strong correlation to the Voice Handicap Index (r = -0.843, P = 0.000*) and a weak positive, statistically significant correlation between the V-RQOL-physical functioning domain, V-RQOL-social-emotional domain, and the Q1, Q2, and Domain 1-Domain 4 of the World Health Organization Quality of Life, short version (0.2 < r < 0.4). The Polish version of the V-RQOL Measure is a valid and reliable instrument to evaluate the patient's perception of his or her own voice disorders and the impact it can have on the patient's life. The V-RQOL Measure is easy to perform in clinical practice. Copyright © 2016 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Development of an Individualism-Collectivism Scale revisited: a Korean sample.

PubMed

Kim, Kitae; Cho, Bongsoon

2011-04-01

A 13-item Individualism-Collectivism scale comprising source of identity, goal priority, mode of social relation, and norm acceptance is presented. A validation of this scale was conducted using a survey of 773 Korean employees. An exploratory factor analysis and a second-order confirmatory factor analysis supported the measure as having theoretical face validity and acceptable internal consistency reliability. Among the four facets, goal priority most strongly predicted the general Individualism-Collectivism latent factor.

Plant photonics: application of optical coherence tomography to monitor defects and rots in onion

NASA Astrophysics Data System (ADS)

Meglinski, I. V.; Buranachai, C.; Terry, L. A.

2010-04-01

The incidence of physiological and/or pathological defects in many fresh produce types is still unacceptably high and accounts for a large proportion of waste. With increasing interest in food security their remains strong demand in developing reliable and cost effective technologies for non-destructive screening of internal defects and rots, these being deemed unacceptable by consumers. It is well recognized that the internal defects and structure of turbid scattering media can be effectively visualized by using optical coherence tomography (OCT). In the present study, the high spatial resolution and advantages of OCT have been demonstrated for imaging the skins and outer laminae (concentric tissue layers) of intact whole onion bulbs with a view to non-invasively visualizing potential incidence/severity of internal defects.

Validation of the Brazilian Portuguese Version of Geriatric Anxiety Inventory--GAI-BR.

PubMed

Massena, Patrícia Nitschke; de Araújo, Narahyana Bom; Pachana, Nancy; Laks, Jerson; de Pádua, Analuiza Camozzato

2015-07-01

The Geriatric Anxiety Inventory (GAI) is a recently developed scale aiming to evaluate symptoms of anxiety in later life. This 20-item scale uses dichotomous answers highlighting non-somatic anxiety complaints of elderly people. The present study aimed to evaluate the psychometric properties of the Brazilian Portuguese version GAI (GAI-BR) in a sample from community and outpatient psychogeriatric clinic. A mixed convenience sample of 72 subjects was recruited for answering the research protocol. The interview procedures were structured with questionnaires about sociodemographic data, clinical health status, anxiety, and depression previously validated instruments, Mini-Mental State Examination, Mini International Neuropsychiatric Interview, and GAI-BR. Twenty-two percent of the sample were interviewed twice for test-retest reliability. For internal consistency analyses, the Cronbach's α test was applied. The Spearman correlation test was applied to evaluate the test-retest GAI-BR reliability. A ROC (receiver operating characteristic) curve study was made to estimate the GAI-BR area under curve, cut-off points, sensitivity, and specificity for the Generalized Anxiety Disorder diagnosis. The GAI-BR version showed high internal consistency (Cronbach's α = 0.91) and strong and significant test-retest reliability (ρ = 0.85, p < 0.001). It also showed moderate and significant correlation with the Beck Anxiety Inventory (ρ = 0.68, p < 0.001) and the State-Trait Anxiety Inventory (ρ = 0.61, p < 0.001) showing evidence of concurrent validation. The cut-off point of 13 estimated by ROC curve analyses showed sensitivity of 83.3% and specificity of 84.6% to detect Generalized Anxiety Disorder (DSM-IV). GAI-BR has demonstrated very good psychometric properties and can be a reliable instrument to measure anxiety in Brazilian elderly people.

The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

PubMed

Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

2017-01-12

Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in Portugal. Further studies are needed to confirm its responsiveness.

Psychometric Evaluation of a New Instrument to Evaluate School Nurses' Perceptions on Concussion Care Management.

PubMed

Schneider, Kathleen H

2017-10-01

The rate of concussions in adolescents has risen over the last decade, resulting in cognitive and emotional problems. Neurologists recommend cognitive and physical rest during the recovery period, followed by a transitional return-to-classroom protocol. The purpose of the study was to develop and test an instrument that explores the beliefs and roles of school nurses in concussion care management. The instrument was a cross-sectional descriptive survey based on the theory of planned behavior, using Qualtrics®. The psychometric properties of the instrument were assessed through exploratory factor analysis with orthogonal rotation. The reliability of the instrument was assessed for internal consistency reliability using Cronbach's α. Kaiser-Meyer-Olkin for sample adequacy was .8; Cronbach's α strong (.851).

Factor analysis of social skills inventory responses of Italians and Americans.

PubMed

Galeazzi, Aldo; Franceschina, Emilio; Holmes, George R

2002-06-01

The Social Skills Inventory is a 90-item self-report procedure designed to measure social and communication skills. The inventory measures six dimensions, namely, Emotional Expressivity, Emotional Sensitivity, Emotional Control, Social Expressivity, Social Sensitivity, and Social Control. The Italian version was administered in several cities in Northern Italy to 500 Italian participants ranging in age from 15 to 59 years. Factor analysis appears to confirm the adequacy of the inventory for the Italian adult population. Results indicate strong similarities between the Italian and American populations with respect to the measure of social skills. Indexes of internal reliability and test-retest reliability are good for almost all subscales of the inventory, which should encourage the use of this inventory with Italian samples.

Reliability and validity of the Brief Pain Inventory in individuals with chronic obstructive pulmonary disease.

PubMed

Chen, Y-W; HajGhanbari, B; Road, J D; Coxson, H O; Camp, P G; Reid, W D

2018-06-08

Pain is prevalent in chronic obstructive pulmonary disease (COPD) and the Brief Pain Inventory (BPI) appears to be a feasible questionnaire to assess this symptom. However, the reliability and validity of the BPI have not been determined in individuals with COPD. This study aimed to determine the internal consistency, test-retest reliability and validity (construct, convergent, divergent and discriminant) of the BPI in individuals with COPD. In order to examine the test-retest reliability, individuals with COPD were recruited from pulmonary rehabilitation programmes to complete the BPI twice 1 week apart. In order to investigate validity, de-identified data was retrieved from two previous studies, including forced expiratory volume in 1-s, age, sex and data from four questionnaires: the BPI, short-form McGill Pain Questionnaire (SF-MPQ), 36-Item Short Form Survey (SF-36) and Community Health Activities Model Program for Seniors (CHAMPS) questionnaire. In total, 123 participants were included in the analyses (eligible data were retrieved from 86 participants and additional 37 participants were recruited). The BPI demonstrated excellent internal consistency and test-retest reliability. It also showed convergent validity with the SF-MPQ and divergent validity with the SF-36. The factor analysis yielded two factors of the BPI, which demonstrated that the two domains of the BPI measure the intended constructs. The BPI can also discriminate pain levels among COPD patients with varied levels of quality of life (SF-36) and physical activity (CHAMPS). The BPI is a reliable and valid pain questionnaire that can be used to evaluate pain in COPD. This study formally established the reliability and validity of the BPI in individuals with COPD, which have not been determined in this patient group. The results of this study provide strong evidence that assessment results from this pain questionnaire are reliable and valid. © 2018 European Pain Federation - EFIC®.

Validity and reliability of an Arabic version of the state-trait anxiety inventory in a Saudi dental setting

PubMed Central

Bahammam, Maha A.

2016-01-01

Objectives: To test the psychometric properties of an adapted Arabic version of the state trait anxiety-form Y (STAI-Y) in Saudi adult dental patients. Methods: In this cross-sectional study, the published Arabic version of the STAI-Y was evaluated by 2 experienced bilingual professionals for its compatibility with Saudi culture and revised prior to testing. Three hundred and eighty-seven patients attending dental clinics for treatment at the Faculty of Dentistry Hospital, King Abdullah University, Jeddah, Kingdom of Saudi Arabia, participated in the study. The Arabic version of the modified dental anxiety scale (MDAS) and visual analogue scale (VAS) ratings of anxiety were used to assess the concurrent criterion validity. Results: The Arabic version of the STAI-Y had high internal consistency reliability (Cronbach’s alpha: 0.989) for state and trait subscales. Factor analysis indicated unidimensionality of the scale. Correlations between STAI-Y scores and both MDAS and VAS scores indicated strong concurrent criterion validity. Discriminant validity was supported by the findings that higher anxiety levels were present among females as opposed to males, younger individuals as compared to older individuals, and patients who do not visit the dentist unless they have a need as opposed to more frequent visitors to the dental office. Conclusion: The Arabic version of the STAI-Y has an adequate internal consistency reliability, generally similar to that reported in the international literature, suggesting it is appropriate for assessing dental anxiety in Arabic speaking populations. PMID:27279514

Reliability and validity of the Lithuanian Tinnitus Handicap Inventory.

PubMed

Ulozienė, Ingrida; Balnytė, Renata; Alzbutienė, Giedrė; Arechvo, Irina; Vaitkus, Antanas; Šileikaitė, Milda; Šaferis, Viktoras; Ulozas, Virgilijus

2016-01-01

The aim of this study was to determine the reliability and validity of the Lithuanian version of the Tinnitus Handicap Inventory (THI), a self-report measure of perceived tinnitus handicap. A cross-sectional psychometric validation study was performed in the University Hospital. A total of 248 subjects reporting chronic tinnitus as their primary complaint or secondary to hearing loss were encluded in the study and filled in the Lithuanian version of THI. For assessment of construct validity a subgroup of 55 participants completed the Lithuanian version of the Hospital Anxiety and Depression Scale as a measure of self-perceived levels of anxiety and depression. Test-retest and internal consistency reliability as well as construct validity were calculated. The Lithuanian version of the THI and its subscales showed a robust internal consistency reliability (Cronbach's alpha=0.93) comparable to the original version. Statistically significant correlations were observed between the Lithuanian translation of the THI and the measures of self-perceived levels of anxiety and depression using HADS. Confirmatory factor analysis demonstrated that the three subscales of the THI Lithuanian version corresponded to three different factors, which strongly correlated between themselves. The results suggest that the Lithuanian version of THI maintains its original validity and may serve as reliable and valid measure of general tinnitus related distress that can be used in a clinical setting to quantify the impact of tinnitus on daily living. Copyright © 2016 The Lithuanian University of Health Sciences. Production and hosting by Elsevier Urban & Partner Sp. z o.o. All rights reserved.

Predicting the need for institutional care shortly after admission to rehabilitation: Rasch analysis and predictive validity of the BRASS Index.

PubMed

Panella, L; La Porta, F; Caselli, S; Marchisio, S; Tennant, A

2012-09-01

Effective discharge planning is increasingly recognised as a critical component of hospital-based Rehabilitation. The BRASS index is a risk screening tool for identification, shortly after hospital admission, of patients who are at risk of post-discharge problems. To evaluate the internal construct validity and reliability of the Blaylock Risk Assessment Screening Score (BRASS) within the rehabilitation setting. Observational prospective study. Rehabilitation ward of an Italian district hospital. One hundred and four consecutively admitted patients. Using classical psychometric methods and Rasch analysis (RA), the internal construct validity and reliability of the BRASS were examined. Also, external and predictive validity of the Rasch-modified BRASS (RMB) score were determined. Reliability of the original BRASS was low (Cronbach's alpha=0.595) and factor analyses showed that it was clearly multidimensional. A RA, based on a reduced 7-BRASS item set (RMB), satisfied model's expectations. Reliability was 0.777. The RMB scores strongly correlated with the original BRASS (rho=0.952; P<0.000) and with FIM™ admission scores (rho=-0.853; P<0.000). A RMB score of 12 was associated with an increased risk of nursing home admission (RR=2.1, 95%CI=1.7-2.5), whereas a score of 17 was associated to a higher risk of length of stay >28 days (RR=7.6, 95%CI=1.8-31.9). This study demonstrated that the original BRASS was multidimensional and unreliable. However, the RMB holds adequate internal construct validity and is sufficiently reliable as a predictor of discharge problems for group, but not individual use. The application of tools and methods (such as the BRASS Index) developed under the biomedical paradigm in a Physical and Rehabilitation Medicine setting may have limitations. Further research is needed to develop, within the rehabilitation setting, a valid measuring tool of risk of post-discharge problems at the individual level.

Development and Validation of the Numeracy Understanding in Medicine Instrument Short Form

PubMed Central

Schapira, Marilyn M.; Walker, Cindy M.; Miller, Tamara; Fletcher, Kathlyn A; Ganschow, Pamela G.; Jacobs, Elizabeth A; Imbert, Diana; O'Connell, Maria; Neuner, Joan M.

2014-01-01

Background Health numeracy can be defined as the ability to understand and use numeric information and quantitative concepts in the context of health. We previously reported the development of the Numeracy Understanding in Medicine Instrument (NUMi); a 20-item test developed using item response theory. We now report the development and validation of a short form of the NUMi. Methods Item statistics were used to identify a subset of 8-items representing a range of difficulty and content areas. Internal reliability was evaluated with Cronbach's alpha. Divergent and convergent validity was assessed by comparing scores of the S-NUMI with existing measures of education, print and numeric health literacy, mathematic achievement, cognitive reasoning, and the original NUMi. Results The 8-item scale had adequate reliability (Cronbach's alpha: 0.72) and was strongly correlated to the 20-item NUMi (0.92). The S-NUMi scores were strongly correlated with the Lipkus numeracy test (0.62), Wide Range of Achievement Test-Mathematics (WRAT-M) (0.72), and Wonderlic cognitive reasoning test (0.76). Moderate correlation was found with education level (0.58) and print literacy as measured by the TOFHLA (0.49). Conclusion The short Numeracy Understanding in Medicine Instrument is a reliable and valid measure of health numeracy feasible for use in clinical and research settings. PMID:25315596

Towards practical implementation of biophotonics-based solutions for cost-effective monitoring of food quality control (Conference Presentation)

NASA Astrophysics Data System (ADS)

Meglinski, Igor; Popov, Alexey; Bykov, Alexander

2017-03-01

Biophotonics-based diagnostic and imaging modalities have been widely used in various applications associated with the non-invasive imaging of the internal structure of a range biological media from a range of cells cultures to biological tissues. With the fast growing interest in food securities there remains strong demand to apply reliable and cost effective biophotonics-based technologies for rapid screening of freshness, internal defects and quality of major agricultural products. In current presentation the results of application of optical coherence tomography (OCT) and encapsulated optical bio-sensors for quantitative assessment of freshness of agricultural products, such as meat and sea foods, are presented, and their further perspectives are discussed.

Cross-Cultural Adaptation, Translation, and Validation of the Toronto Extremity Salvage Score for Extremity Bone and Soft Tissue Tumor Patients in Netherlands.

PubMed

Willeumier, Julie J; van der Wal, C W P G; van der Wal, Robert J P; Dijkstra, P D S; Vliet Vlieland, Thea P M; van de Sande, Michiel A J

2017-01-01

The aim of this study was to translate and culturally adapt the Toronto Extremity Salvage Score (TESS) to Dutch and to validate the translated version. The TESS lower and upper extremity versions (LE and UE) were translated to Dutch according to international guidelines. The translated version was validated in 98 patients with surgically treated bone or soft tissue tumors of the LE or UE. To assess test-retest reliability, participants were asked to fill in a second questionnaire after one week. Construct validity was determined by computing Spearman rank correlations with the Short Form- (SF-) 36. The internal consistency (0.957 and 0.938 for LE and UE, resp.) and test-retest reliability (intraclass correlation coefficients 0.963 and 0.969 for LE and UE, resp.) were good for both questionnaires. The Dutch LE and UE TESS versions correlated most strongly with the SF-36 physical function dimension ( r = 0.737 for LE, 0.726 for UE) and the physical component summary score ( r = 0.811 and 0.797 for LE and UE). The Dutch TESS questionnaire for lower and upper extremities is a consistent, reliable, and valid instrument to measure patient-reported physical function in surgically treated patients with a soft tissue or bone tumor.

Tinnitus and Hearing Survey: A Screening Tool to Differentiate Bothersome Tinnitus From Hearing Difficulties

PubMed Central

Griest, Susan; Zaugg, Tara L.; Thielman, Emily; Kaelin, Christine; Galvez, Gino; Carlson, Kathleen F.

2015-01-01

Purpose Individuals complaining of tinnitus often attribute hearing problems to the tinnitus. In such cases some (or all) of their reported “tinnitus distress” may in fact be caused by trouble communicating due to hearing problems. We developed the Tinnitus and Hearing Survey (THS) as a tool to rapidly differentiate hearing problems from tinnitus problems. Method For 2 of our research studies, we administered the THS twice (mean of 16.5 days between tests) to 67 participants who did not receive intervention. These data allow for measures of statistical validation of the THS. Results Reliability of the THS was good to excellent regarding internal consistency (α = .86–.94), test–retest reliability (r = .76–.83), and convergent validity between the Tinnitus Handicap Inventory (Newman, Jacobson, & Spitzer, 1996; Newman, Sandridge, & Jacobson, 1998) and the A (Tinnitus) subscale of the THS (r = .78). Factor analysis confirmed that the 2 subscales, A (Tinnitus) and B (Hearing), have strong internal structure, explaining 71.7% of the total variance, and low correlation with each other (r = .46), resulting in a small amount of shared variance (21%). Conclusion These results provide evidence that the THS is statistically validated and reliable for use in assisting patients and clinicians in quickly (and collaboratively) determining whether intervention for tinnitus is appropriate. PMID:25551458

Serial personal digital assistant data capture of health-related quality of life: A randomized controlled trial in a prostate cancer clinic

PubMed Central

Matthew, Andrew G; Currie, Kristen L; Irvine, Jane; Ritvo, Paul; Santa Mina, Daniel; Jamnicky, Leah; Nam, Robert; Trachtenberg, John

2007-01-01

Background In clinical and research practice linked to prostate cancer treatment, frequent monitoring of patient health-related quality of life (HRQOL) is essential. Practical and analytic limitations of paper questionnaire data capture may be overcome with the use of self-administered personal digital assistant (PDA) data collection. The objective of this study was to assess the reliability, validity, and feasibility of using PDA in place of paper versions of the International Prostate Symptom Score (IPSS), the Patient Oriented Prostate Cancer Utility Survey (PORPUS), and the International Index of Erectile Function-5 (IIEF-5) in a prostate cancer clinic setting. Methods 152 participants were randomly assigned to one of three conditions: 1) paper followed by PDA survey; 2) PDA followed by paper survey; or 3) PDA followed by PDA survey. Evaluation included an assessment of data quality (internal consistency, test-retest reliability, response correlation, completeness of data), and feasibility (participation rates, time to completion, preference and difficultly/ease of using PDA). Results Internal consistency was similar for both PDA and paper applications. Test-retest reliability was confirmed for PDA repeated administration. Data from paper and PDA questionnaires were strongly correlated. Lower missed item rates were found in PDA administration. 82.8% of participants preferred using the PDA or had no preference. Mean difficulty/ease ratings indicated that participants found the PDA easy to use. Age did not significantly correlate with preference or difficulty. Conclusion The results confirm the adaptability of the IPSS, IIEF-5, and the PORPUS to PDA administration. Similarly, the findings of this study support the feasibility of using PDA technology for HRQOL serial data capture in the prostate cancer patient population. PMID:17617906

Translation, cross-cultural adaptation, and validation of the Bulgarian version of the Liverpool Adverse Event Profile.

PubMed

Kuzmanova, Rumyana; Stefanova, Irina; Velcheva, Irena; Stambolieva, Katerina

2014-10-01

Adverse effects (AEs) of antiepileptic drugs (AEDs) affect the quality of life of patients with epilepsy and their outcomes. There are no questionnaires or studies on the reliability and validity of instruments measuring AEs of AEDs in patients with epilepsy in Bulgarian language. The aim of the present study was the translation, cross-cultural adaptation, and validation of the LAEP in the Bulgarian language in order to use it in the Bulgarian-speaking population in providing a reliable instrument for the clinical monitoring of patients with epilepsy. One hundred thirty-one patients (57 men and 74 women, mean age: 40.13±13.37 years) took part in the investigation. The internal consistency and test-retest reliability were tested by Cronbach's α and ICC estimations. The convergent construct validity was tested by estimating the correlation of the LAEP-BG with the QOLIE-89 and the discriminant validity by evaluating the difference between LAEP-BG scores and clinical parameters such as the type of epilepsy using Kruskal-Wallis ANOVA. The LAEP-BG showed high internal consistency and reliability. The Cronbach's α of the total scale was 0.86. No significant differences between the Cronbach's α coefficients of the total LAEP-BG and original English, Chinese, Spanish, Korean, and Portuguese-Brazilian versions of the questionnaire were observed. The ICCs, which evaluate the test-retest reliability, were higher than the recommended value of 0.75 and determined the strong positive correlations between the first and second examinations. The creation of two subscales "Neurological and psychiatric side effects" and "Non neurological side effects" of the LAEP-BG proposed by us showed good internal consistency (Cronbach's α of 0.85 and 0.71, respectively). The LAEP-BG scores significantly correlated with other questionnaires such as the Quality of Life in Epilepsy Inventory-89 (QOLIE-89) and showed a good discriminative validity between groups with different levels of self-assessed AEs of AEDs. The Bulgarian version of the Liverpool Adverse Event Profile (LAEP) is a reliable and valid tool in assessing the patient-reported AEs of AEDs and their impact on the patient's outcome. Copyright © 2014 Elsevier Inc. All rights reserved.

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

Development and Validation of the Faceted Inventory of the Five-Factor Model (FI-FFM).

PubMed

Watson, David; Nus, Ericka; Wu, Kevin D

2017-06-01

The Faceted Inventory of the Five-Factor Model (FI-FFM) is a comprehensive hierarchical measure of personality. The FI-FFM was created across five phases of scale development. It includes five facets apiece for neuroticism, extraversion, and conscientiousness; four facets within agreeableness; and three facets for openness. We present reliability and validity data obtained from three samples. The FI-FFM scales are internally consistent and highly stable over 2 weeks (retest rs ranged from .64 to .82, median r = .77). They show strong convergent and discriminant validity vis-à-vis the NEO, the Big Five Inventory, and the Personality Inventory for DSM-5. Moreover, self-ratings on the scales show moderate to strong agreement with corresponding ratings made by informants ( rs ranged from .26 to .66, median r = .42). Finally, in joint analyses with the NEO Personality Inventory-3, the FI-FFM neuroticism facet scales display significant incremental validity in predicting indicators of internalizing psychopathology.

Healthy eating opinion survey for individuals at risk for cardiovascular disease.

PubMed

Mark, Amy E; Riley, Dana L; McDonnell, Lisa A; Pipe, Andrew L; Reid, Robert D

2014-08-01

To develop and evaluate the validity and reliability of a questionnaire to measure intentions and beliefs about healthy eating in individuals at risk for coronary heart disease. The Healthy Eating Opinion Survey was developed using the theory of planned behavior. An open-ended elicitation questionnaire was administered to 21 participants, and a 46-item questionnaire was developed for further testing. Test-retest reliability of each question on the survey was assessed by calculating the correlation coefficients between the responses over a 2- week period in 17 participants. Internal consistency was assessed using Cronbach's alpha, and factor analysis was used to assess the construct validity of the questionnaire in a sample of 388 participants. The responses to the elicitation questions were used to develop behavioral beliefs, normative beliefs, and control beliefs questions for the final questionnaire. Test-retest reliability ranged from 0.22-0.90, with the majority (89%) of correlations being moderate to strong. Internal consistency was good, with Cronbach's alpha ranging from 0.74-0.92. All intentions questions loaded onto a single factor; attitude questions loaded onto two factors; subjective norm questions loaded onto two factors; perceived behavioral control questions loaded onto one factor; behavioral beliefs questions loaded onto one factor; normative beliefs questions loaded onto one factor; and control beliefs questions loaded onto one factor. The questionnaire was found to be a reliable, valid questionnaire to assess beliefs and intentions toward eating a healthy diet in individuals at risk for coronary heart disease.

Cross-cultural adaptation of the Nordic musculoskeletal questionnaire.

PubMed

de Barros, E N C; Alexandre, N M C

2003-06-01

Reports in the literature have identified a need for internationally standardized and reliable measurements to analyse musculoskeletal symptoms. Screening of musculoskeletal disorders may serve as a diagnostic tool to evaluate the work environment. The Nordic general questionnaire is a standardized instrument used to analyse musculoskeletal symptoms in an ergonomic or occupational health context. To translate and adapt a version of the Nordic general questionnaire into Brazilian Portuguese and evaluate its reliability. The cross-cultural adaptation was performed according to internationally recommended methodology, using the following guidelines: translation; back-translation; committee review; and pretesting. First, the questionnaire was independently translated into Portuguese by two teachers and one doctor, and a consensus version was generated. Second, two other translators performed a back-translation independently from one another. This version was then submitted to a committee, consisting of six specialists in the area of knowledge of the instrument, to evaluate its equivalence to the original instrument. The final version was pretested on 20 subjects randomly selected in an outpatient clinic. Reliability was assessed by a test-retest procedure at 1-day intervals using the Kappa coefficient in a group of 40 subjects. The Kappa agreement values were calculated for each one of the four questions of the questionnaire. The agreement among the same observers was substantial, varying from 0.88 to 1, according to the Kappa values. these demonstrated strong agreement of the instrument, suggesting that the Brazilian version of the "Standardized Nordic Questionnaire" offers substantial reliability.

How Residents Develop Trust in Interns: A Multi-Institutional Mixed-Methods Study.

PubMed

Sheu, Leslie; O'Sullivan, Patricia S; Aagaard, Eva M; Tad-Y, Darlene; Harrell, Heather E; Kogan, Jennifer R; Nixon, James; Hollander, Harry; Hauer, Karen E

2016-10-01

Although residents trust interns to provide patient care, little is known about how trust forms. Using a multi-institutional mixed-methods study design, the authors interviewed (March-September 2014) internal medicine (IM) residents in their second or third postgraduate year at a single institution to address how they develop trust in interns. Transcript analysis using grounded theory yielded a model for resident trust. Authors tested (January-March 2015) the model with residents from five IM programs using a two-section quantitative survey (38 items; 31 rated 0 = not at all to 100 = very much; 7 rated 0 = strongly disagree to 100 = strongly agree) to identify influences on how residents form trust. Qualitative analysis of 29 interviews yielded 14 themes within five previously identified factors of trust (resident, intern, relationship, task, and context). Of 478 residents, 376 (78.7%) completed the survey. Factor analysis yielded 11 factors that influence trust. Respondents rated interns' characteristics (reliability, competence, and propensity to make errors) highest when indicating importance to trust (respective means 86.3 [standard deviation = 9.7], 76.4 [12.9], and 75.8 [20.0]). They also rated contextual factors highly as influencing trust (access to an electronic medical record, duty hours, and patient characteristics; respective means 79.8 [15.3], 73.1 [14.4], and 71.9 [20.0]). Residents form trust based on primarily intern- and context-specific factors. Residents appear to consider trust in a way that prioritizes interns' execution of essential patient care tasks safely within the complexities and constraints of the hospital environment.

Identification of Classified Information in Unclassified DoD Systems During the Audit of Internal Controls and Data Reliability in the Deployable Disbursing System

DTIC Science & Technology

2009-02-17

Identification of Classified Information in Unclassified DoD Systems During the Audit of Internal Controls and Data Reliability in the Deployable...TITLE AND SUBTITLE Identification of Classified Information in Unclassified DoD Systems During the Audit of Internal Controls and Data Reliability...Systems During the Audit ofInternal Controls and Data Reliability in the Deployable Disbursing System (Report No. D-2009-054) Weare providing this

Vaccine production, distribution, access and uptake

PubMed Central

Smith, Jon; Lipsitch, Marc; Almond, Jeffrey W.

2011-01-01

Making human vaccines available on a global scale requires the use of complex production methods, meticulous quality control and reliable distribution channels that ensure the products are potent and effective at their point of use. The technologies involved in manufacturing different types of vaccines may strongly influence vaccine cost, ease of industrial scale-up, stability and ultimately world-wide availability. Manufacturing complexity is compounded by the need for different formulations for different countries and age groups. Reliable vaccine production in appropriate quantities and at affordable prices is the cornerstone of developing global vaccination policies. However, ensuring optimal access and uptake also requires strong partnerships between private manufacturers, regulatory authorities and national and international public health services. For vaccines whose supplies are limited, either due to rapidly emerging diseases or longer-term mismatch of supply and demand, prioritizing target groups can increase vaccine impact. Focusing on influenza vaccines as an example that well illustrates many of the relevant points, this article considers current production, distribution, access and other factors that ultimately impact on vaccine uptake and population-level effectiveness. PMID:21664680

Vaccine production, distribution, access, and uptake.

PubMed

Smith, Jon; Lipsitch, Marc; Almond, Jeffrey W

2011-07-30

For human vaccines to be available on a global scale, complex production methods, meticulous quality control, and reliable distribution channels are needed to ensure that the products are potent and effective at the point of use. The technologies used to manufacture different types of vaccines can strongly affect vaccine cost, ease of industrial scale-up, stability, and, ultimately, worldwide availability. The complexity of manufacturing is compounded by the need for different formulations in different countries and age-groups. Reliable vaccine production in appropriate quantities and at affordable prices is the cornerstone of developing global vaccination policies. However, to ensure optimum access and uptake, strong partnerships are needed between private manufacturers, regulatory authorities, and national and international public health services. For vaccines whose supply is insufficient to meet demand, prioritisation of target groups can increase the effect of these vaccines. In this report, we draw from our experience of vaccine development and focus on influenza vaccines as an example to consider production, distribution, access, and other factors that affect vaccine uptake and population-level effectiveness. Copyright © 2011 Elsevier Ltd. All rights reserved.

Reliability and construct validity of the Spanish version of the 6-item CTS symptoms scale for outcomes assessment in carpal tunnel syndrome.

PubMed

Rosales, Roberto S; Martin-Hidalgo, Yolanda; Reboso-Morales, Luis; Atroshi, Isam

2016-03-03

The purpose of this study was to assess the reliability and construct validity of the Spanish version of the 6-item carpal tunnel syndrome (CTS) symptoms scale (CTS-6). In this cross-sectional study 40 patients diagnosed with CTS based on clinical and neurophysiologic criteria, completed the standard Spanish versions of the CTS-6 and the disabilities of the arm, shoulder and hand (QuickDASH) scales on two occasions with a 1-week interval. Internal-consistency reliability was assessed with the Cronbach alpha coefficient and test-retest reliability with the intraclass correlation coefficient, two way random effect model and absolute agreement definition (ICC2,1). Cross-sectional precision was analyzed with the Standard Error of the Measurement (SEM). Longitudinal precision for test-retest reliability coefficient was assessed with the Standard Error of the Measurement difference (SEMdiff) and the Minimal Detectable Change at 95 % confidence level (MDC95). For assessing construct validity it was hypothesized that the CTS-6 would have a strong positive correlation with the QuickDASH, analyzed with the Pearson correlation coefficient (r). The standard Spanish version of the CTS-6 presented a Cronbach alpha of 0.81 with a SEM of 0.3. Test-retest reliability showed an ICC of 0.85 with a SRMdiff of 0.36 and a MDC95 of 0.7. The correlation between CTS-6 and the QuickDASH was concordant with the a priori formulated construct hypothesis (r 0.69) CONCLUSIONS: The standard Spanish version of the 6-item CTS symptoms scale showed good internal consistency, test-retest reliability and construct validity for outcomes assessment in CTS. The CTS-6 will be useful to clinicians and researchers in Spanish speaking parts of the world. The use of standardized outcome measures across countries also will facilitate comparison of research results in carpal tunnel syndrome.

Reliability and validity of the Fear of Intimacy Scale in China.

PubMed

Ingersoll, Travis S; Norvilitis, Jill M; Zhang, Jie; Jia, Shuhua; Tetewsky, Sheldon

2008-05-01

Participants in China (n = 343) and the United States (n = 283) completed measures to assess the reliability and validity of the Fear of Intimacy Scale (Descutner & Thelen, 1991) with a Chinese population. Internal consistency was strong in both cultures, and the factor structure was also similar between cultures, with confirmatory factor analysis (CFA) identifying three-factor models in both samples. As evidence of convergent validity, the scale was positively correlated with depression and negatively correlated with social support and self-esteem. There were gender differences between cultures, but low levels of femininity were predictive of fear of intimacy in both cultures. The influence of individualism and collectivism varied, with high levels of individualism more predictive of a fear of intimacy in China than in the United States.

Validation of the Japanese Version of the Body Vigilance Scale.

PubMed

Saigo, Tatsuo; Takebayashi, Yoshitake; Tayama, Jun; Bernick, Peter J; Schmidt, Norman B; Shirabe, Susumu; Sakano, Yuji

2016-06-01

The Body Vigilance Scale is a self-report measure of attention to bodily sensations. The measure was translated into Japanese and its reliability, validity, and factor structure were verified. Participants comprised 286 university students (age: 19 ± 1 years). All participants were administered the scale, along with several indices of anxiety (i.e., Anxiety Sensitivity Index, Short Health Anxiety Inventory Illness Likelihood Scale, Social Interaction Anxiety Scale, and Hospital Anxiety and Depression Scale). The Japanese version of the Body Vigilance Scale exhibited a unidimensional factor structure and strong internal consistency. Construct validity was demonstrated by significant correlations with the above measures. Results suggest that the Japanese version of the scale is a reliable, valid tool for measuring body vigilance in Japanese university students. © The Author(s) 2016.

A Psychometric Analysis of Quality of Life Tools in Lung Cancer Patients Who Smoke

PubMed Central

Browning, Kristine K.; Ferketich, Amy K.; Otterson, Gregory A.; Reynolds, Nancy R.; Wewers, Mary Ellen

2009-01-01

Lung cancer is the leading cause of cancer death for both men and women in the United States. Patient quality of life (QOL) prior to cancer treatment is known to be a strong predictor of survival and toleration of treatment toxicities. A lung cancer patient’s self-assessment of QOL is highly valued among clinicians as it guides treatment-related decisions and impacts clinical outcomes. Smokers are known to report a lower QOL. Limited research has been conducted on QOL outcomes in lung cancer patients who continue to smoke. To assess QOL, a reliable and valid QOL measure specific to lung cancer is required. The Functional Assessment of Cancer Therapy-Lung Cancer (FACT-L) and Lung Cancer Symptom Scale (LCSS) are instruments that specifically examine QOL among lung cancer patients. The LCSS is a focused QOL instrument that includes physical and functional domains of QOL and disease symptomatology. The FACT-L is a broader QOL instrument that includes physical, functional, social and emotional domains and disease symptomatology. Both are psychometrically valid and are widely used in the literature, but have not been exclusively evaluated in smokers. Furthermore, there is no ‘gold standard’ instrument since there has never been a correlation study to compare estimates of reliability and validity between these instruments. The purpose of this study is to report the internal consistency and convergence validity of the FACT-L and the LCSS among newly diagnosed lung cancer patients who smoke. This data were collected and analyzed from a larger study examining smoking behavior among newly diagnosed lung cancer patients (n=51). Descriptive statistics were calculated on the FACT-L and LCSS scores, internal consistency was assessed by estimating Cronbach’s alpha coefficients, and Pearson correlation coefficients were estimated between the two scales. Internal consistency coefficients demonstrated good reliability for both scales, and the two instruments demonstrated a strong correlation, suggesting good convergence validity. Either of these instruments are appropriate measures for QOL in lung cancer patients who smoke. Given the conceptual difference between the two instruments, it is important to carefully consider the research aims when selecting the appropriate QOL measurement instrument. PMID:19181418

Hypersonic force measurements using internal balance based on optical micromachined Fabry-Perot interferometry.

PubMed

Qiu, Huacheng; Min, Fu; Zhong, Shaolong; Song, Xin; Yang, Yanguang

2018-03-01

Force measurements using wind tunnel balance are necessary for determining a variety of aerodynamic performance parameters, while the harsh environment in hypersonic flows requires that the measurement instrument should be reliable and robust, in against strong electromagnetic interference, high vacuum, or metal (oxide) dusts. In this paper, we demonstrated a three-component internal balance for hypersonic aerodynamic force measurements, using novel optical micromachined Fabry-Perot interferometric (FPI) strain gauges as sensing elements. The FPI gauges were fabricated using Micro-Opto-Electro-Mechanical Systems (MOEMS) surface and bulk fabrication techniques. High-reflectivity coatings are used to form a high-finesse Fabry-Perot cavity, which benefits a high resolution. Antireflective and passivation coatings are used to reduce unwanted interferences. The FPI strain gauge based balance has been calibrated and evaluated in a Mach 5 hypersonic flow. The results are compared with the traditional technique using the foil resistive strain gauge balance, indicating that the proposed balance based on the MOEMS FPI strain gauge is reliable and robust and is potentially suitable for the hypersonic wind tunnel harsh environment.

Hypersonic force measurements using internal balance based on optical micromachined Fabry-Perot interferometry

NASA Astrophysics Data System (ADS)

Qiu, Huacheng; Min, Fu; Zhong, Shaolong; Song, Xin; Yang, Yanguang

2018-03-01

Force measurements using wind tunnel balance are necessary for determining a variety of aerodynamic performance parameters, while the harsh environment in hypersonic flows requires that the measurement instrument should be reliable and robust, in against strong electromagnetic interference, high vacuum, or metal (oxide) dusts. In this paper, we demonstrated a three-component internal balance for hypersonic aerodynamic force measurements, using novel optical micromachined Fabry-Perot interferometric (FPI) strain gauges as sensing elements. The FPI gauges were fabricated using Micro-Opto-Electro-Mechanical Systems (MOEMS) surface and bulk fabrication techniques. High-reflectivity coatings are used to form a high-finesse Fabry-Perot cavity, which benefits a high resolution. Antireflective and passivation coatings are used to reduce unwanted interferences. The FPI strain gauge based balance has been calibrated and evaluated in a Mach 5 hypersonic flow. The results are compared with the traditional technique using the foil resistive strain gauge balance, indicating that the proposed balance based on the MOEMS FPI strain gauge is reliable and robust and is potentially suitable for the hypersonic wind tunnel harsh environment.

Cross-Validation of the Implementation Leadership Scale (ILS) in Child Welfare Service Organizations.

PubMed

Finn, Natalie K; Torres, Elisa M; Ehrhart, Mark G; Roesch, Scott C; Aarons, Gregory A

2016-08-01

The Implementation Leadership Scale (ILS) is a brief, pragmatic, and efficient measure that can be used for research or organizational development to assess leader behaviors and actions that actively support effective implementation of evidence-based practices (EBPs). The ILS was originally validated with mental health clinicians. This study validates the ILS factor structure with providers in community-based organizations (CBOs) providing child welfare services. Participants were 214 service providers working in 12 CBOs that provide child welfare services. All participants completed the ILS, reporting on their immediate supervisor. Confirmatory factor analyses were conducted to examine the factor structure of the ILS. Internal consistency reliability and measurement invariance were also examined. Confirmatory factor analyses showed acceptable fit to the hypothesized first- and second-order factor structure. Internal consistency reliability was strong and there was partial measurement invariance for the first-order factor structure when comparing child welfare and mental health samples. The results support the use of the ILS to assess leadership for implementation of EBPs in child welfare organizations. © The Author(s) 2016.

Psychometric Evaluation of Kingston Caregiver Stress Scale.

PubMed

Sadak, Tatiana; Korpak, Anna; Wright, Jacob D; Lee, Mee Kyung; Noel, Margaret; Buckwalter, Kathleen; Borson, Soo

2017-01-01

Standardized measurement of caregiver stress is a component of Medicare's new health care benefit supporting care planning for people with dementia. In this article we identify existing measures of caregiver stress, strain and burden and propose specific criteria for choosing tools that may be suitable for wide use in primary care settings. We reviewed 22 measures and identified one, the Kingston Caregiver Stress Scale (KCSS), which met all the proposed criteria but had not been studied in a U.S. We conducted a psychometric evaluation of KCSS to determine its potential usefulness as a care planning tool with a U.S. We examined the internal consistency, test-retest reliability, component structure, and relationship to depression and anxiety in 227 dementia caregivers at two U.S. sites. The KCSS has high internal consistency and test-retest reliability, a strong factor structure, and moderate to high correlations with caregiver depression and anxiety. KCSS is a good candidate for use as part of comprehensive care planning for people with dementia and their caregivers. Routine assessment of caregiver stress in clinical care may facilitate timely intervention and potentially improve both patient and caregiver outcomes.

Reliability of a tool for measuring theory of planned behaviour constructs for use in evaluating research use in policymaking

PubMed Central

2011-01-01

Background Although measures of knowledge translation and exchange (KTE) effectiveness based on the theory of planned behavior (TPB) have been used among patients and providers, no measure has been developed for use among health system policymakers and stakeholders. A tool that measures the intention to use research evidence in policymaking could assist researchers in evaluating the effectiveness of KTE strategies that aim to support evidence-informed health system decision-making. Therefore, we developed a 15-item tool to measure four TPB constructs (intention, attitude, subjective norm and perceived control) and assessed its face validity through key informant interviews. Methods We carried out a reliability study to assess the tool's internal consistency and test-retest reliability. Our study sample consisted of 62 policymakers and stakeholders that participated in deliberative dialogues. We assessed internal consistency using Cronbach's alpha and generalizability (G) coefficients, and we assessed test-retest reliability by calculating Pearson correlation coefficients (r) and G coefficients for each construct and the tool overall. Results The internal consistency of items within each construct was good with alpha ranging from 0.68 to alpha = 0.89. G-coefficients were lower for a single administration (G = 0.34 to G = 0.73) than for the average of two administrations (G = 0.79 to G = 0.89). Test-retest reliability coefficients for the constructs ranged from r = 0.26 to r = 0.77 and from G = 0.31 to G = 0.62 for a single administration, and from G = 0.47 to G = 0.86 for the average of two administrations. Test-retest reliability of the tool using G theory was moderate (G = 0.5) when we generalized across a single observation, but became strong (G = 0.9) when we averaged across both administrations. Conclusion This study provides preliminary evidence for the reliability of a tool that can be used to measure TPB constructs in relation to research use in policymaking. Our findings suggest that the tool should be administered on more than one occasion when the intervention promotes an initial 'spike' in enthusiasm for using research evidence (as it seemed to do in this case with deliberative dialogues). The findings from this study will be used to modify the tool and inform further psychometric testing following different KTE interventions. PMID:21702956

Investigating the psychometric properties of the Geriatric Suicide Ideation Scale (GSIS) among community-residing older adults.

PubMed

Heisel, Marnin J; Flett, Gordon L

2016-01-01

To investigate the psychometric properties of the Geriatric Suicide Ideation Scale (GSIS) among community-residing older adults. We recruited 173 voluntary participants, 65 years and older, into a 2+ year longitudinal study of the onset or exacerbation of depressive symptoms and suicide ideation. We assessed the internal consistency of the GSIS and its four component subscales, and its shorter and longer duration test-retest reliability, convergent (depression, social hopelessness, and loneliness), divergent (psychological well-being, life satisfaction, perceived social support, and self-rated health), discriminant (basic and instrumental activities of daily living and social desirability), criterion (history of suicide behavior), and predictive validity (future suicide ideation). The GSIS demonstrated strong test-retest reliability and internal consistency. Baseline GSIS scores were significantly positively associated with suicide risk factors, negatively associated with potential resiliency factors, and not associated with functional impairment or social desirability. GSIS scores significantly differentiated between participants with as compared to those without a history of suicide behavior. Baseline GSIS scores significantly predicted suicide ideation at a 2+ year follow-up assessment. Findings suggest strong measurement characteristics for the GSIS with community-residing older adults, including impressive consistency over time. These results are consistent with research attesting to the empirical and pragmatic strengths of this measure. These findings have implications for the monitoring of suicide risk when aiming to enhance mental health and well-being and prevent suicide in later life.

Cross-cultural adaptation and validation of the Social Comfort Questionnaire for Brazilian adult survivors of burns.

PubMed

Freitas, N O; Forero, C G; Alonso, J; Caltran, M P; Dantas, R A S; Farina, J A; Rossi, L A

2017-01-01

Burn patients may encounter social barriers and stigmatization. The objectives of this study were to adapt the Social Comfort Questionnaire (SCQ) into Brazilian Portuguese and to assess the psychometric properties of the adapted version. Cross-cultural adaptation of the 8 items of the SCQ followed international guidelines. We interviewed 240 burn patients and verified the SCQ internal consistency, test-retest reliability and construct validity, correlating the scores with depression [Beck Depression Inventory (BDI)], affect/body image and interpersonal relationships [Burns Specific Health Scale-Revised (BSHS-R)] and self-esteem [Rosenberg's Self-Esteem Scale (RSES)]. We also performed a confirmatory factor analysis (CFA). The cross-cultural adaptation resulted in minor semantic modifications to the original SCQ version. After CFA, a reduced 6-item version showed satisfactory fit to the one-factor model (RMSEA = 0.05, CFI = 0.99, TLI = 0.99). Cronbach alpha's was 0.80, and test-retest intraclass correlation coefficient was 0.86. The final version presented a strong negative correlation with depression (BDI), and strong positive correlations with affect/body image (BSHS-R), interpersonal relationships (BSHS-R) and self-esteem (RSES) (all p < 0.001). The results showed that the SCQ Brazilian Portuguese adapted version complies with the validity and reliability criteria required for an instrument assessing social comfort in Brazilian burn patients. The Brazilian version yields a single score that is easy to interpret and well understood by patients.

Cross-Cultural and Psychometric Properties Assessment of the Exercise Self-Efficacy Scale in Individuals with Spinal Cord Injury.

PubMed

Pisconti, Fernando; Mahmoud Smaili Santos, Suhaila; Lopes, Josiane; Rosa Cardoso, Jefferson; Lopes Lavado, Edson

2017-11-29

The Exercise Self-Efficacy scale (ESES) is a reliable measure, in the English language, of exercise self-efficacy in individuals with spinal cord injury. The aim of this study was to culturally adjust and validate the Exercise Self-Efficacy scale in the Portuguese language. The Exercise Self-Efficacy scale was applied to 76 subjects, with three-month intervals (three applications in total). The reliability was appraised using the intra-class correlation coefficient and Bland-Altman methods, and the internal consistency was evaluated using Cronbach´s alpha. The Exercise Self-Efficacy scale was correlated with the domains of the Quality of life Questionnaire SF-36 and Functional Independence Measure and tested using the Spearman rho coefficient. The Exercise Self-Efficacy scale-Brazil presented good internal consistency (alpha 1 = 0.856; alpha 2 = 0.855; alpha 3 = 0.822) and high reliability in the test-retest (intra-class correlation coefficient = 0.97). There was a strong correlation between the Exercise Self-Efficacy scale-Brazil and the SF-36 only in the functional capacity domain (rho = 0.708). There were no changes in Exercise Self-Efficacy scale-Brazil scores between the three applications (p = 0.796). The validation of the Exercise Self-Efficacy scale questionnaire permits the assessor to use it reliably in Portuguese speaking countries, since it is the first instrument measuring self-efficacy specifically during exercises in individuals with spinal cord injury. Furthermore, the questionnaire can be used as an instrument to verify the effectiveness of interventions that use exercise as an outcome. The results of the Brazilian version of the Exercise Self-Efficacy scale support its use as a reliable and valid measurement of exercise self-efficacy for this population.

myTREEHOUSE Self-Concept Assessment: preliminary psychometric analysis of a new self-concept assessment for children with cerebral palsy.

PubMed

Cheong, Sau Kuan; Lang, Cathryne P; Hemphill, Sheryl A; Johnston, Leanne M

2017-06-01

To evaluate the preliminary validity and reliability of the myTREEHOUSE Self-Concept Assessment for children with cerebral palsy (CP) aged 8 to 12 years. The myTREEHOUSE Self-Concept Assessment includes 26 items divided into eight domains, assessed across three Performance Perspectives (Personal, Social, and Perceived) and an additional Importance Rating. Face and content validity was assessed by semi-structured interviews with seven expert professionals regarding the assessment construct, content, and clinical utility. Reliability was assessed with 50 children aged 8 to 12 years with CP (29 males, 21 females; mean age 10y 2mo; Gross Motor Function Classification System [GMFCS] level I=35, II=8, III=5, IV=1; mean Wechsler Intelligence Scale for Children - Fourth Edition [WISC-IV]=104), whose data was used to calculate internal consistency of the scale, and a subset of 35 children (20 males, 15 females; mean age 10y 5mo; GMFCS level I=26, II=4, III=4, IV=1; mean WISC-IV=103) who participated in test-retest reliability within 14 to 28 days. Face and content validity was supported by positive expert feedback, with only minor adjustments suggested to clarify the wording of some items. After these amendments, strong internal consistency (Cronbach's α 0.84-0.91) and moderate to good test-retest reliability (intraclass correlation coefficient 0.64-0.75) was found for each component. The myTREEHOUSE Self-Concept Assessment is a valid and reliable assessment of self-concept for children with CP aged 8 to 12 years. © 2017 Mac Keith Press.

Reliability and Validity of the Medical Outcomes Study Short Form-12 Version 2 (SF-12v2) in Adults with Non-Cancer Pain

PubMed Central

Hayes, Corey J.; Bhandari, Naleen Raj; Kathe, Niranjan; Payakachat, Nalin

2017-01-01

Limited evidence exists on how non-cancer pain (NCP) affects an individual’s health-related quality of life (HRQoL). This study aimed to validate the Medical Outcomes Study Short Form-12 Version 2 (SF-12v2), a generic measure of HRQoL, in a NCP cohort using the Medical Expenditure Panel Survey Longitudinal Files. The SF Mental Component Summary (MCS12) and SF Physical Component Summary (PCS12) were tested for reliability (internal consistency and test-retest reliability) and validity (construct: convergent and discriminant; criterion: concurrent and predictive). A total of 15,716 patients with NCP were included in the final analysis. The MCS12 and PCS12 demonstrated high internal consistency (Cronbach’s alpha and Mosier’s alpha > 0.8), and moderate and high test-retest reliability, respectively (MCS12 intraclass correlation coefficient (ICC): 0.64; PCS12 ICC: 0.73). Both scales were significantly associated with a number of chronic conditions (p < 0.05). The PCS12 was strongly correlated with perceived health (r = 0.52) but weakly correlated with perceived mental health (r = 0.25). The MCS12 was moderately correlated with perceived mental health (r = 0.42) and perceived health (r = 0.33). Increasing PCS12 and MCS12 scores were significantly associated with lower odds of reporting future physical and cognitive limitations (PCS12: OR = 0.90 95%CI: 0.89–0.90, MCS12: OR = 0.94 95%CI: 0.93–0.94). In summary, the SF-12v2 is a reliable and valid measure of HRQoL for patients with NCP. PMID:28445438

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

PubMed

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Weight concerns scale applied to college students: comparison between pencil-and-paper and online formats.

PubMed

Dias, Juliana Chioda Ribeiro; Maroco, João; Campos, Juliana Alvares Duarte Bonini

2015-03-01

Online data collection is becoming increasingly common and has some advantages compared to traditional paper-and-pencil formats, such as reducing loss of data, increasing participants' privacy, and decreasing the effect of social desirability. However, the validity and reliability of this administration format must be established before results can be considered acceptable. The aim of this study was to evaluate the validity, reliability, and equivalence of paper-and-pencil and online versions of the Weight Concerns Scale (WCS) when applied to Brazilian university students. A crossover design was used, and the Portuguese version of the WCS (in both paper-and-pencil and online formats) was completed by 100 college students. The results indicated adequate fit in both formats. The simultaneous fit of data for both groups was excellent, with strong invariance between models. Adequate convergent validity, internal consistency, and mean score equivalence of the WCS in both formats were observed. Thus, the WCS presented adequate reliability and validity in both administration formats, with equivalence/stability between answers.

Ratings of Everyday Executive Functioning (REEF): A parent-report measure of preschoolers' executive functioning skills.

PubMed

Nilsen, Elizabeth S; Huyder, Vanessa; McAuley, Tara; Liebermann, Dana

2017-01-01

Executive functioning (EF) facilitates the development of academic, cognitive, and social-emotional skills and deficits in EF are implicated in a broad range of child psychopathologies. Although EF has clear implications for early development, the few questionnaires that assess EF in preschoolers tend to ask parents for global judgments of executive dysfunction and thus do not cover the full range of EF within the preschool age group. Here we present a new measure of preschoolers' EF-the Ratings of Everyday Executive Functioning (REEF)-that capitalizes on parents' observations of their preschoolers' (i.e., 3- to 5-year-olds) behavior in specific, everyday contexts. Over 4 studies, items comprising the REEF were refined and the measure's reliability and validity were evaluated. Factor analysis of the REEF yielded 1 factor, with items showing strong internal reliability. More important, children's scores on the REEF related to both laboratory measures of EF and another parent-report EF questionnaire. Moreover, reflecting divergent validity, the REEF was more strongly related to measures of EF as opposed to measures of affective styles. The REEF also captured differences in children's executive skills across the preschool years, and norms at 6-month intervals are reported. In summary, the REEF is a new parent-report measure that provides researchers with an efficient, valid, and reliable means of assessing preschoolers' executive functioning. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Psychometric analysis of the leadership environment scale (LENS): Outcome from the Oregon research initiative on the organisation of nursing (ORION).

PubMed

Ross, Amy M; Ilic, Kelley; Kiyoshi-Teo, Hiroko; Lee, Christopher S

2017-12-26

The purpose of this study was to establish the psychometric properties of the new 16-item leadership environment scale. The leadership environment scale was based on complexity science concepts relevant to complex adaptive health care systems. A workforce survey of direct-care nurses was conducted (n = 1,443) in Oregon. Confirmatory factor analysis, exploratory factor analysis, concordant validity test and reliability tests were conducted to establish the structure and internal consistency of the leadership environment scale. Confirmatory factor analysis indices approached acceptable thresholds of fit with a single factor solution. Exploratory factor analysis showed improved fit with a two-factor model solution; the factors were labelled 'influencing relationships' and 'interdependent system supports'. Moderate to strong convergent validity was observed between the leadership environment scale/subscales and both the nursing workforce index and the safety organising scale. Reliability of the leadership environment scale and subscales was strong, with all alphas ≥.85. The leadership environment scale is structurally sound and reliable. Nursing management can employ adaptive complexity leadership attributes, measure their influence on the leadership environment, subsequently modify system supports and relationships and improve the quality of health care systems. The leadership environment scale is an innovative fit to complex adaptive systems and how nurses act as leaders within these systems. © 2017 John Wiley & Sons Ltd.

Assessment of psychometric properties of the Brazilian version of the oral anticoagulation knowledge test.

PubMed

Praxedes, Marcus Fernando da Silva; de Abreu, Mauro Henrique Nogueira Guimarães; Paiva, Saul Martins; Mambrini, Juliana Vaz de Melo; Marcolino, Milena Soriano; Martins, Maria Auxiliadora Parreiras

2016-06-24

The aim of this study was to evaluate the psychometric properties of the Brazilian version of the Oral Anticoagulation Knowledge (OAK) Test. This study, conducted in an anticoagulation clinic, included 201 Brazilian participants aged over 18 years, who had been using warfarin for more than two months. The reliability of the instrument was evaluated by assessing internal consistency (Kuder-Richardson coefficient) and reproducibility (test-retest reliability). The validity was evaluated by hypothesizing that there would be a positive correlation of moderate to strong intensity between the correctness levels of the OAK Test and time within therapeutic range (TTR) values, which is a measure used to evaluate the quality of oral anticoagulation. The instrument exhibited good psychometric properties. The total a Kuder-Richardson coefficient value was 0.818 and intraclass correlation coefficient was 0.967. The validity revealed a strong positive correlation between the values of the level of knowledge, as measured by the OAK Test and the TTR values (rs = 0.780). The instrument proved to be a reliable and valid tool for evaluating the knowledge of Brazilian patients on oral anticoagulation therapy with warfarin. This instrument may be incorporated into the practice of health care for substantiating the structuring of educational activities to ensure the improvement of knowledge about the use of warfarin, thereby increasing the effectiveness and safety of treatment.

Reliability, validity and minimal detectable change of the Mini-BESTest in Greek participants with chronic stroke.

PubMed

Lampropoulou, Sofia I; Billis, Evdokia; Gedikoglou, Ingrid A; Michailidou, Christina; Nowicky, Alexander V; Skrinou, Dimitra; Michailidi, Fotini; Chandrinou, Danae; Meligkoni, Margarita

2018-02-23

This study aimed to investigate the psychometric characteristics of reliability, validity and ability to detect change of a newly developed balance assessment tool, the Mini-BESTest, in Greek patients with stroke. A prospective, observational design study with test-retest measures was conducted. A convenience sample of 21 Greek patients with chronic stroke (14 male, 7 female; age of 63 ± 16 years) was recruited. Two independent examiners administered the scale, for the inter-rater reliability, twice within 10 days for the test-retest reliability. Bland Altman Analysis for repeated measures assessed the absolute reliability and the Standard Error of Measurement (SEM) and the Minimum Detectable Change at 95% confidence interval (MDC 95% ) were established. The Greek Mini-BESTest (Mini-BESTest GR ) was correlated with the Greek Berg Balance Scale (BBS GR ) for assessing the concurrent validity and with the Timed Up and Go (TUG), the Functional Reach Test (FRT) and the Greek Falls Efficacy Scale-International (FES-I GR ) for the convergent validity. The Mini-BESTestGR demonstrated excellent inter-rater reliability (ICC (95%CI) = 0.997 (0.995-0.999, SEM = 0.46) with the scores of two raters within the limits of agreement (mean dif  = -0.143 ± 0.727, p > 0.05) and test-retest reliability (ICC (95%CI) = 0.966 (0.926-0.988), SEM = 1.53). Additionally, the Mini-BESTest GR yielded very strong to moderate correlations with BBS GR (r = 0.924, p < 0.001), TUG (r = -0.823, p < 0.001), FES-I GR (r = -0.734, p < 0.001) and FRT (r = 0.689, p < 0.001). MDC 95 was 4.25 points. The exceptionally high reliability and the equally good validity of the Mini-BESTest GR , strongly support its utility in Greek people with chronic stroke. Its ability to identify clinically meaningful changes and falls risk need further investigation.

Reliability, Dimensionality, and Internal Consistency as Defined by Cronbach: Distinct Albeit Related Concepts

ERIC Educational Resources Information Center

Davenport, Ernest C.; Davison, Mark L.; Liou, Pey-Yan; Love, Quintin U.

2015-01-01

This article uses definitions provided by Cronbach in his seminal paper for coefficient a to show the concepts of reliability, dimensionality, and internal consistency are distinct but interrelated. The article begins with a critique of the definition of reliability and then explores mathematical properties of Cronbach's a. Internal consistency…

Establishing the reliability and validity of the Zagazig Depression Scale in a UK student population: an online pilot study.

PubMed

Ibrahim, Ahmed K; Kelly, Shona J; Challenor, Emily C; Glazebrook, Cris

2010-12-10

It is thought that depressive disorders will be the second leading cause of disability worldwide by 2020. Recently, there is a steady increase in the number of university students diagnosed and treated as depression patients. It can be assumed that depression is a serious mental health problem for university students because it affects all age groups of the students either younger or older equally. The current study aims to establish the reliability and validity of the Zagazig Depression scale in a UK sample. The study was a cross-sectional online survey. A sample of 133 out of 275 undergraduate students from a range of UK Universities in the academic year 2008-2009, aged 20.3 ± 6.3 years old were recruited. A modified back translated version of Zagazig Depression scale was used. In order to validate the Zagazig Depression scale, participants were asked to complete the Patient Health Questionnaire. Statistical analysis includes Kappa analysis, Cronbach's alpha, Spearman's correlation analysis, and Confirmatory Factor analysis. Using the recommended cut-off of Zagazig Depression scale for possible minor depression it was found that 30.3% of the students have depression and higher percentage was identified according to the Patient Health Questionnaire (37.4%). Females were more depressed. The mean ZDS score was 8.3 ± 4.2. Rates of depression increase as students get older. The reliability of The ZDS was satisfactory (Cronbach's alpha was .894). For validity, ZDS score was strongly associated with PHQ, with no significant difference (p-value > 0.05), with strong positive correlation (r = +.8, p-value < 0.01). The strong, significant correlation between the PHQ and ZDS, along with high internal consistency of the ZDS as a whole provides evidence that ZDS is a reliable measure of depressive symptoms and is promising for the use of the translated ZDS in a large-scale cross-culture study.

Using Item Response Theory to Develop a 60-Item Representation of the NEO PI-R Using the International Personality Item Pool: Development of the IPIP-NEO-60.

PubMed

Maples-Keller, Jessica L; Williamson, Rachel L; Sleep, Chelsea E; Carter, Nathan T; Campbell, W Keith; Miller, Joshua D

2017-10-31

Given advantages of freely available and modifiable measures, an increase in the use of measures developed from the International Personality Item Pool (IPIP), including the 300-item representation of the Revised NEO Personality Inventory (NEO PI-R; Costa & McCrae, 1992a ) has occurred. The focus of this study was to use item response theory to develop a 60-item, IPIP-based measure of the Five-Factor Model (FFM) that provides equal representation of the FFM facets and to test the reliability and convergent and criterion validity of this measure compared to the NEO Five Factor Inventory (NEO-FFI). In an undergraduate sample (n = 359), scores from the NEO-FFI and IPIP-NEO-60 demonstrated good reliability and convergent validity with the NEO PI-R and IPIP-NEO-300. Additionally, across criterion variables in the undergraduate sample as well as a community-based sample (n = 757), the NEO-FFI and IPIP-NEO-60 demonstrated similar nomological networks across a wide range of external variables (r ICC = .96). Finally, as expected, in an MTurk sample the IPIP-NEO-60 demonstrated advantages over the Big Five Inventory-2 (Soto & John, 2017 ; n = 342) with regard to the Agreeableness domain content. The results suggest strong reliability and validity of the IPIP-NEO-60 scores.

Chinese adaptation and validation of the patellofemoral pain severity scale.

PubMed

Cheung, Roy T H; Ngai, Shirley P C; Lam, Priscillia L; Chiu, Joseph K W; Fung, Eric Y H

2013-05-01

This study validated the Patellofemoral Pain Severity Scale translated into Chinese. The Chinese Patellofemoral Pain Severity Scale was translated from the original English version following standard forward and backward translation procedures recommended by the International Society for Pharmacoeconomics and Outcomes Research. The survey was then conducted in clinical settings by a questionnaire comprising the Chinese Patellofemoral Pain Severity Scale, Kujala Scale and Western Ontario and McMaster Universities (WOMAC) Osteoarthritis Index. Eighty-four Chinese reading patients with patellofemoral pain were recruited from physical therapy clinics. Internal consistency of the translated instrument was measured by Cronbach alpha. Convergent validity was examined by Spearman rank correlation coefficient (rho) tests by comparing its score with the validated Chinese version of the Kujala Scale and the WOMAC Osteoarthritis Index while the test-retest reliability was evaluated by administering the questionnaires twice. Cronbach alpha values of individual questions and their overall value were above 0.85. Strong association was found between the Chinese Patellofemoral Pain Severity Scale and the Kujala Scale (rho = -0.72, p < 0.001). Moderate correlation was also found between Chinese Patellofemoral Pain Severity Scale with the WOMAC Osteoarthritis Index (rho = 0.63, p < 0.001). Excellent test-retest reliability (Intraclass correlation coefficient = 0.98) was demonstrated. The Chinese translated version of the Patellofemoral Pain Severity Scale is a reliable and valid instrument for patients with patellofemoral pain.

Psychometric testing of a Mandarin Chinese Version of the Clinically Useful Depression Outcome Scale for patients diagnosed with type 2 diabetes mellitus.

PubMed

Hsu, Lan-Fang; Kao, Ching-Chiu; Wang, Mei-Yeh; Chang, Chun-Jen; Tsai, Pei-Shan

2014-12-01

The Clinically Useful Depression Outcome Scale (CUDOS) is a self-report instrument that assesses symptoms and the severity of depression, but its psychometric properties in patients with type 2 diabetes mellitus in Chinese-Speaking populations are unknown. To examine the psychometric properties of the Mandarin Chinese version of the CUDOS (CUDOS-Chinese). A methodological research design. Endocrinology and metabolism outpatient clinics at 2 university-affiliated hospitals in northern Taiwan. Two-hundred and fourteen type 2 diabetic patients with the mean age of 62.6 years were enrolled, and two-hundred and twelve of them completed the study. Internal consistency, test-retest reliability, concurrent, and contrasted-groups validity were assessed. A receiver operating characteristic curve analysis was performed to assess sensitivity and specificity. Construct validity by means of confirmatory factor analysis was conducted. Internal consistency (Cronbach α of total scale and four subscales=0.93, 0.80, 0.66, 0.80, and 0.83, respectively), test-retest reliability (intra-class correlation coefficients of total scale and four subscales=0.92, 0.89, 0.94, 0.89, and 0.91, respectively), and strong correlations with the Beck Depression Inventory-II (r=0.87) suggested good reliability and validity. The confirmatory factor analysis supported a four-factor model. A cut-off score of 19/20 yielded 77.8% sensitivity and 75.6% specificity. The CUDOS-Chinese demonstrated satisfactory validity and reliability for detecting depression in type 2 diabetic patients in Taiwan. Copyright © 2014 Elsevier Ltd. All rights reserved.

Reliability Impacts in Life Support Architecture and Technology Selection

NASA Technical Reports Server (NTRS)

Lange, Kevin E.; Anderson, Molly S.

2011-01-01

Equivalent System Mass (ESM) and reliability estimates were performed for different life support architectures based primarily on International Space Station (ISS) technologies. The analysis was applied to a hypothetical 1-year deep-space mission. High-level fault trees were initially developed relating loss of life support functionality to the Loss of Crew (LOC) top event. System reliability was then expressed as the complement (nonoccurrence) this event and was increased through the addition of redundancy and spares, which added to the ESM. The reliability analysis assumed constant failure rates and used current projected values of the Mean Time Between Failures (MTBF) from an ISS database where available. Results were obtained showing the dependence of ESM on system reliability for each architecture. Although the analysis employed numerous simplifications and many of the input parameters are considered to have high uncertainty, the results strongly suggest that achieving necessary reliabilities for deep-space missions will add substantially to the life support system mass. As a point of reference, the reliability for a single-string architecture using the most regenerative combination of ISS technologies without unscheduled replacement spares was estimated to be less than 1%. The results also demonstrate how adding technologies in a serial manner to increase system closure forces the reliability of other life support technologies to increase in order to meet the system reliability requirement. This increase in reliability results in increased mass for multiple technologies through the need for additional spares. Alternative parallel architecture approaches and approaches with the potential to do more with less are discussed. The tall poles in life support ESM are also reexamined in light of estimated reliability impacts.

Smoke composition and predicting relationships for international commercial cigarettes smoked with three machine-smoking conditions.

PubMed

Counts, M E; Morton, M J; Laffoon, S W; Cox, R H; Lipowicz, P J

2005-04-01

The study objectives were to determine the effects of smoking machine puffing parameters on mainstream smoke composition and to express those effects as predicting relationships. Forty-eight commercial Philip Morris USA and Philip Morris International cigarettes from international markets and the 1R4F reference cigarette were machine-smoked using smoking conditions defined by the International Organization of Standardization (ISO), the Massachusetts Department of Public Health (MDPH), and Health Canada (HC). Cigarette tobacco fillers were analyzed for nitrate, nicotine, tobacco-specific nitrosamines (TSNA), and ammonia. Mainstream yields for tar and 44 individual smoke constituents and "smoke pH" were determined. Cigarette constituent yields typically increased in the order ISO

Cross-cultural adaptation and validation of als Functional Rating Scale-Revised in Portuguese language.

PubMed

Guedes, Keyte; Pereira, Cecília; Pavan, Karina; Valério, Berenice Cataldo Oliveira

2010-02-01

The aim of this study is the cross-cultural, as well as to validate in Portuguese language the Amyotrophic Lateral Sclerosis Functional Rating Scale - Revised (ALSFRS-R). We performed a prospective study of individuals with amyotrophic lateral sclerosis (ALS) clinically defined. The scale, after obtaining the final version in Portuguese, was administered in 22 individuals and three weeks after re-applied. There were no significant differences between the application and reapplication of the scale (p=0.069). The linear regression and internal consistency measured by Pearson correlation and alpha Conbrach were significant with r=0.975 e alpha=0.934. The reliability test-retest demonstrated by intraclass correlation coefficient was strong with ICC=0.975. Therefore, this version proved to be applicable, reliable and easy to be conducted in clinical practice and research.

Evaluation of the Early Childhood Oral Health Impact Scale in an Australian preschool child population.

PubMed

Arrow, P; Klobas, E

2015-09-01

Early childhood caries has significant impacts on children and their families. The Early Childhood Oral Health Impact Scale (ECOHIS) is an instrument for capturing the complex dimensions of preschool children's oral health. This study aimed to evaluate the reliability and validity of the instrument among Australian preschool children. Parents/children dyads (n = 286) participating in a treatment trial on early childhood caries completed the scale at baseline, and 33 parents repeated the questionnaire 2-3 weeks later. The validity and reliability of the ECOHIS was determined using tests for convergent and discriminant validity, internal reliability of the instrument and test-retest reliability. Scale impacts were strongly correlated with global oral health ratings (Spearman's correlations; r = 0.51, total score; r = 0.43, child impact; and r = 0.49, family impact; p < 0.001). The scale was significantly associated with children's caries experience, p < 0.001. Cronbach's alpha values were 0.87, 0.89 and 0.74 for the total, the child and the family domains, respectively. Test-retest reliability was 0.92, 0.89 and 0.78 for the total, child and family domains, respectively. The scale demonstrated acceptable validity and reliability for assessing the impact of early childhood caries among Australian preschool children. © 2015 Australian Dental Association.

Adapting the Bayley Scales of infant and toddler development in Ethiopia: evaluation of reliability and validity

PubMed Central

Medhin, G.; Worku, B.; Tomlinson, M.; Alem, A.; Dewey, M.; Prince, M.

2016-01-01

Abstract Background There is a need for valid and reliable observational measures of early child development in low‐income and middle‐income country settings. Methods The aims of the study were to adapt the Bayley Scales of Infant Development (Bayley III) for a rural Ethiopian setting and evaluate reliability and validity. The study was carried out between January 2008 and January 2009 in the Butajira demographic surveillance site, south central Ethiopia. The Bayley III was adapted to be socioculturally appropriate for a rural Ethiopian context. Nurses and high school graduates were trained in administration of the measure for 10 days. Inter‐rater reliability was evaluated (n = 60). Content, construct and convergent validity was then examined on a population‐based cohort of children at the ages of 30 (n = 440) and 42 months (n = 456). Mokken scale analysis was used to determine the scalability of items in unidimensional, hierarchical sub‐scales. The mean score was compared by age of child and by stunting status (less than −2 z scores below the standard height‐for‐age). Results The intra‐class correlations between raters were above 0.90 for all sub‐scales of the child development measure. Some scale items were not contextually relevant and showed poor scalability. However, the majority of items scaled onto the existing sub‐scales of the international measure to form adequate‐to‐strong hierarchical scales with good internal consistency (Cronbach's α above 0.70 except for gross motor and expressive language sub‐scales). Item‐scale coefficients were good. The mean score of all sub‐scales was significantly higher in the older group of children (33.02 higher total score; P < 0.001) and in the children who were stunted (total Bayley score 2.58 (95% confidence interval 0.07 to 5.10) points lower at 30 months and 3.87 (1.94 to 5.81) points lower at 42 months. Conclusions An adapted version of an international, observational measure of child development was found to be reliable, valid and feasible in a rural Ethiopian setting. PMID:27381579

Adapting the Bayley Scales of infant and toddler development in Ethiopia: evaluation of reliability and validity.

PubMed

Hanlon, C; Medhin, G; Worku, B; Tomlinson, M; Alem, A; Dewey, M; Prince, M

2016-09-01

There is a need for valid and reliable observational measures of early child development in low-income and middle-income country settings. The aims of the study were to adapt the Bayley Scales of Infant Development (Bayley III) for a rural Ethiopian setting and evaluate reliability and validity. The study was carried out between January 2008 and January 2009 in the Butajira demographic surveillance site, south central Ethiopia. The Bayley III was adapted to be socioculturally appropriate for a rural Ethiopian context. Nurses and high school graduates were trained in administration of the measure for 10 days. Inter-rater reliability was evaluated (n = 60). Content, construct and convergent validity was then examined on a population-based cohort of children at the ages of 30 (n = 440) and 42 months (n = 456). Mokken scale analysis was used to determine the scalability of items in unidimensional, hierarchical sub-scales. The mean score was compared by age of child and by stunting status (less than -2 z scores below the standard height-for-age). The intra-class correlations between raters were above 0.90 for all sub-scales of the child development measure. Some scale items were not contextually relevant and showed poor scalability. However, the majority of items scaled onto the existing sub-scales of the international measure to form adequate-to-strong hierarchical scales with good internal consistency (Cronbach's α above 0.70 except for gross motor and expressive language sub-scales). Item-scale coefficients were good. The mean score of all sub-scales was significantly higher in the older group of children (33.02 higher total score; P < 0.001) and in the children who were stunted (total Bayley score 2.58 (95% confidence interval 0.07 to 5.10) points lower at 30 months and 3.87 (1.94 to 5.81) points lower at 42 months. An adapted version of an international, observational measure of child development was found to be reliable, valid and feasible in a rural Ethiopian setting. © 2016 The Authors Child: Care, Health and Development Published by John Wiley & Sons Ltd.

Focusing on the adult attachment style in schizophrenia in community mental health centres: validation of the Psychosis Attachment Measure (PAM) in a German-speaking sample.

PubMed

Kvrgic, Sara; Beck, Eva-Marina; Cavelti, Marialuisa; Kossowsky, Joe; Stieglitz, Rolf-Dieter; Vauth, Roland

2012-07-01

Assessing attachment style in people with schizophrenia may be important to identify a risk factor in building a strong therapeutic relationship and so indirectly to understand the development of mal-compliance as one of the major obstacles in the treatment of schizophrenia. The present study analysed the psychometric properties of the German version of the Psychosis Attachment Measure (PAM), which assesses avoidant and anxious attachment style. A sample of 127 patients suffering from chronic schizophrenia or schizoaffective disorder participated in this study. In testing discriminant validity, we assessed psychopathology, depression, therapeutic relationship and service engagement. Internal consistency, test-retest reliability and factor structure were analysed. The German version of PAM exhibited acceptable to good internal and test-retest reliabilities and the two-factor structure of the English version could be replicated. Avoidant attachment style was related to higher levels of positive symptoms and to a poorer therapeutic relationship. In the context of external validation, a regression analysis revealed that a poor therapeutic relationship correlated with avoidant attachment style, independent of anxious attachment style and depressive symptoms. Anxious attachment was associated with higher treatment adherence. Both insecure attachment styles (avoidant and anxious) were found to be correlated with higher levels of depression, but only attachment anxiety had an independent predictive value for self-reported depression in regression analysis. The German version of PAM displayed satisfactory psychometric properties and seems to be a reliable measure for assessing attachment style in individuals with schizophrenia. Validation of PAM led to the finding that only the avoidant attachment style might be a risk factor when building a strong therapeutic relationship in schizophrenia. In future studies, other factors influencing therapeutic relationship should be taken into account. Anxious attachment style may be a risk factor for depression, but it also has an enhancing effect on treatment adherence.

The reliability of four widely used patellar height ratios.

PubMed

van Duijvenbode, Dennis; Stavenuiter, Michel; Burger, Bart; van Dijke, Cees; Spermon, Jacco; Hoozemans, Marco

2016-03-01

The objective of this study was to evaluate the inter-observer reliability and the intra-observer reliability of four patellar height ratios: Insall-Salvati (IS), modified Insall-Salvati (MIS), Blackburne-Peel (BP) and Caton-Deschamps (CD). The patellar height ratios were assessed by four independent examiners using weight-bearing lateral knee radiographs in 30° flexion. Intra-class correlation coefficients and Fleiss' kappa's were determined. The inter-observer reliability was excellent for the IS and moderate for the other ratios. When the ratio values were categorized, the inter-observer reliability was strong for the IS, moderate for the MIS and BP, and poor for the CD. The intra-observer reliability was excellent for the IS, MIS and CD, and strong for the BP. When the ratio values were categorized, the intra-observer reliability was strong for the IS and MIS, and moderate for the other ratios. Although the IS showed best reliability, we advise to use the MIS as it showed the second best reliability but is, according to the literature, associated with better validity.

Brazilian Portuguese version of the Revised Fibromyalgia Impact Questionnaire (FIQR-Br): cross-cultural validation, reliability, and construct and structural validation.

PubMed

Lupi, Jaqueline Basilio; Carvalho de Abreu, Daniela Cristina; Ferreira, Mariana Candido; Oliveira, Renê Donizeti Ribeiro de; Chaves, Thais Cristina

2017-08-01

This study aimed to culturally adapt and validate the Revised Fibromyalgia Impact Questionnaire (FIQR) to Brazilian Portuguese, by the use of analysis of internal consistency, reliability, and construct and structural validity. A total of 100 female patients with fibromyalgia participated in the validation process of the Brazilian Portuguese version of the FIQR (FIQR-Br).The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Pearson's rank correlation for construct validity, and confirmatory factor analysis (CFA) for structural validity. It was verified excellent levels of reliability, with ICC greater than 0.75 for all questions and domains of the FIQR-Br. For internal consistency, alpha values greater than 0.70 for the items and domains of the questionnaire were observed. Moderate (0.40 < r < 0.70) and strong (r > 0.70) correlations were observed for the scores of domains and total score between the FIQR-Br and FIQ-Br. The structure of the three domains of the FIQR-Br was confirmed by CFA. The results of this study suggest that that the FIQR-Br is a reliable and valid instrument for assessing fibromyalgia-related impact, and supports its use in clinical settings and research. The structure of the three domains of the FIQR-Br was also confirmed. Implications for Rehabilitation Fibromyalgia is a chronic musculoskeletal disorder characterized by widespread and diffuse pain, fatigue, sleep disturbances, and depression. The disease significantly impairs patients' quality of life and can be highly disabling. To be used in multicenter research efforts, the Revised Fibromyalgia Impact Questionnaire (FIQR) must be cross-culturally validated and psychometrically tested. This paper will make available a new version of the FIQR-Br since another version already exists, but there are concerns about its measurement properties. The availability of an instrument adapted to and validated for Brazilian Portuguese may make it possible to reliably verify the effects of rehabilitation programs on disability from fibromyalgia. The FIQR-Br showed results comparable with other versions of the FIQR in other languages, thereby enabling comparison of effects of rehabilitation interventions on disability from fibromyalgia conducted in Brazil with results of studies carried out in other parts of the world.

Home care nurses' attitudes toward computers. A confirmatory factor analysis of the Stronge and Brodt instrument.

PubMed

Stricklin, Mary Lou; Bierer, S Beth; Struk, Cynthia

2003-01-01

Point-of-care technology for home care use will be the final step in enterprise-wide healthcare electronic communications. Successful implementation of home care point-of-care technology hinges upon nurses' attitudes toward point-of-care technology and its use in clinical practice. This study addresses the factors associated with home care nurses' attitudes using Stronge and Brodt's Nurse Attitudes Toward Computers instrument. In this study, the Nurses Attitudes Toward Computers instrument was administered to a convenience sample of 138 nurses employed by a large midwestern home care agency, with an 88% response rate. Confirmatory factor analysis corroborated the Nurses Attitudes Toward Computers' 3-dimensional factor structure for practicing nurses, which was labeled as nurses' work, security issues, and perceived barriers. Results from the confirmatory factor analysis also suggest that these 3 factors are internally correlated and represent multiple dimensions of a higher order construct labeled as nurses' attitudes toward computers. Additionally, two of these factors, nurses' work and perceived barriers, each appears to explain more variance in nurses' attitudes toward computers than security issues. Instrument reliability was high for the sample (.90), with subscale reliabilities ranging from 86 to 70.

The reliability and validity of the Maryland Assessment of Recovery in Serious Mental Illness Scale.

PubMed

Drapalski, Amy L; Medoff, Deborah; Dixon, Lisa; Bellack, Alan

2016-05-30

The current study aims to further evaluate the psychometric properties of the Maryland Assessment of Recovery in Serious Mental Illness (MARS), a relatively new instrument designed to assess personal recovery status in individuals with serious mental illness. Two hundred and fifty individuals with serious mental illness receiving outpatient mental health treatment completed a baseline assessment which included the MARS and measures to assess recovery-related constructs, clinical outcomes, and social and community functioning. The MARS demonstrated excellent internal consistency and test-retest reliability. Good construct validity was evidenced by strong positive relationships between the MARS and recovery-related constructs (e.g. hope, empowerment, self-efficacy, and personal agency) and a strong negative relationship with self-stigma. Divergent validity was demonstrated by weaker relationships with cognitive and social functioning. The confirmatory factor analysis did not confirm the unitary factor structure found in previous research. Given the equivocal result of the CFA, additional exploratory work is needed to determine if a more complex factor structure is present. This study provides addition support for the psychometric soundness of the MARS and subsequently, its potential use as a measure of personal recovery status in people with serious mental illness. Published by Elsevier Ireland Ltd.

Adaptation and Validation of the Sexual Assertiveness Scale (SAS) in a Sample of Male Drug Users.

PubMed

Vallejo-Medina, Pablo; Sierra, Juan Carlos

2015-04-21

The aim of the present study was to adapt and validate the Sexual Assertiveness Scale (SAS) in a sample of male drug users. A sample of 326 male drug users and 322 non-clinical males was selected by cluster sampling and convenience sampling, respectively. Results showed that the scale had good psychometric properties and adequate internal consistency reliability (Initiation = .66, Refusal = .74 and STD-P = .79). An evaluation of the invariance showed strong factor equivalence between both samples. A high and moderate effect of Differential Item Functioning was only found in items 1 and 14 (∆R 2 Nagelkerke = .076 and .037, respectively). We strongly recommend not using item 1 if the goal is to compare the scores of both groups, otherwise the comparison will be biased. Correlations obtained between the CSFQ-14 and the safe sex ratio and the SAS subscales were significant (CI = 95%) and indicated good concurrent validity. Scores of male drug users were similar to those of non-clinical males. Therefore, the adaptation of the SAS to drug users provides enough guarantees for reliable and valid use in both clinical practice and research, although care should be taken with item 1.

Development and psychometric properties of the Patient-Head Injury Participation Scale (P-HIPS) and the Patient-Head Injury Neurobehavioral Assessment Scale (P-HINAS): patient and family determined outcomes scales.

PubMed

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-06-01

To develop a measure to assess post-acute outcome following from traumatic brain injury (TBI) with particular emphasis on the emotional and the behavioral outcome. The second objective was to assess the test-retest reliability, internal consistency, and factor structure of the newly developed patient version of the Head Injury Participation Scale (P-HIPS) and Patient-Head Injury Neurobehavioral Scale (P-HINAS). Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analyzed and key themes and concepts were used to construct the 49-item P-HIPS. A postal survey was then conducted on a cohort of 113 TBI patients to 'field test' the P-HIPS and the P-HINAS. All individual 49 items of the P-HIPS and their total score showed good test-retest reliability (0.93) and internal consistency (0.95). The P-HIPS showed a very good correlations with the Mayo Portland Adaptability Inventory-3 (MPAI-3) (0.87) and a moderate negative correlation with the Glasgow Outcome Scale-Extended (GOSE) (-0.51). Factor analysis extracted the following domains: 'Emotion/Behavior,' 'Independence/Community Living,' 'Cognition' and 'Physical'. The 'Emotion/Behavior' factor constituted the P-HINAS, which showed good internal consistency (0.93), test-retest reliability (0.91) and concurrent validity with MPAI subscale (0.82). Both the P-HIPS and the P-HINAS show strong psychometric properties. The qualitative methodology employed in the construction stage of the questionnaires provided good evidence of face and content validity.

Development and psychometric properties of the Patient-Head Injury Participation Scale (P-HIPS) and the Patient-Head Injury Neurobehavioral Assessment Scale (P-HINAS): patient and family determined outcomes scales

PubMed Central

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-01-01

Objective To develop a measure to assess post-acute outcome following from traumatic brain injury (TBI) with particular emphasis on the emotional and the behavioral outcome. The second objective was to assess the test–retest reliability, internal consistency, and factor structure of the newly developed patient version of the Head Injury Participation Scale (P-HIPS) and Patient-Head Injury Neurobehavioral Scale (P-HINAS). Method Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analyzed and key themes and concepts were used to construct the 49-item P-HIPS. A postal survey was then conducted on a cohort of 113 TBI patients to ‘field test’ the P-HIPS and the P-HINAS. Results All individual 49 items of the P-HIPS and their total score showed good test–retest reliability (0.93) and internal consistency (0.95). The P-HIPS showed a very good correlations with the Mayo Portland Adaptability Inventory-3 (MPAI-3) (0.87) and a moderate negative correlation with the Glasgow Outcome Scale-Extended (GOSE) (−0.51). Factor analysis extracted the following domains: ‘Emotion/Behavior,’ ‘Independence/Community Living,’ ‘Cognition’ and ‘Physical’. The ‘Emotion/Behavior’ factor constituted the P-HINAS, which showed good internal consistency (0.93), test–retest reliability (0.91) and concurrent validity with MPAI subscale (0.82). Conclusions Both the P-HIPS and the P-HINAS show strong psychometric properties. The qualitative methodology employed in the construction stage of the questionnaires provided good evidence of face and content validity. PMID:19300568

Assessment of radiation-induced xerostomia: validation of the Italian version of the xerostomia questionnaire in head and neck cancer patients.

PubMed

Pellegrino, Federica; Groff, Elena; Bastiani, Luca; Fattori, Bruno; Sotti, Guido

2015-04-01

Xerostomia is the most common acute and late side effect of radiation treatment for head and neck cancer. Affecting taste perception, chewing, swallowing and speech, xerostomia is also the major cause of decreased quality of life. The aims of this study were to validate the Italian translation of the self-reported eight-item xerostomia questionnaire (XQ) and determine its psychometric properties in patients treated with radiotherapy for head and neck cancer. An observational cross-sectional study was conducted in the Radiotherapy Unit of the Veneto Institute of Oncology - IOV in Padua. The XQ was translated according to international guidelines and filled out by 102 patients. Construct validity was assessed using principal component analysis, internal consistency using Cronbach's α coefficient and test-retest reliability at 1-month interval using the intraclass correlation coefficient (ICC). Criterion-related validity was evaluated to compare the Italian version of XQ with the European Organization for Research and Treatment of Cancer (EORTC) Core Quality-of-Life Questionnaire (QLQ-C30) and its Head and Neck Cancer Module (QLQ-H&N35). Cronbach's α for the Italian version of XQ was strong at α = 0.93, test-retest reliability was also strong (0.79) and factor analysis confirmed that the questionnaire was one-dimensional. Criterion-related validity was excellent with high association with the EORTC QLQ-H&N35 xerostomia and sticky saliva scales. The Italian version of XQ has excellent psychometric properties and can be used to evaluate the impact of emerging radiation delivery techniques aiming at preventing xerostomia.

Psychometric properties of the Brunel Mood Scale in Chinese adolescents and adults.

PubMed

Zhang, Chun-Qing; Si, Gangyan; Chung, Pak-Kwong; Du, Mengmeng; Terry, Peter C

2014-01-01

Building on the work of Terry and colleagues (Terry, P. C., Lane, A. M., Lane, H. J., & Keohane, L. (1999). Development and validation of a mood measure for adolescents. Journal of Sports Sciences, 17, 861-872; Terry, P. C., Lane, A. M., & Fogarty, G. J. (2003). Construct validity of the Profile of Mood States-Adolescents for use with adults. Psychology of Sport & Exercise, 4, 125-139.), the present study examined the validity and internal consistency reliability of the Chinese version of the Brunel Mood Scale (BRUMS-C) among 2,548 participants, comprising adolescent athletes (n = 520), adult athletes (n = 434), adolescent students (n = 673), and adult students (n = 921). Both adolescent and adult athletes completed the BRUMS-C before, during, or after regular training and both adolescent and adult students completed the BRUMS-C in a classroom setting. Confirmatory factor analyses (CFAs) provided support for the factorial validity of a 23-item six-factor model, with one item removed from the hypothesised measurement model. Internal consistency reliabilities were satisfactory for all subscales across each of the four samples. Criterion validity was supported with strong relationships between the BRUMS-C, abbreviated POMS, and Chinese Affect Scale consistent with theoretical predictions. Multi-sample CFAs showed the BRUMS-C to be invariant at the configural, metric, strong, and structural levels for all samples. Furthermore, latent mean difference analyses showed that athletes reported significantly higher levels of fatigue than students while maintaining almost the same levels of vigour, and adolescent students reported significantly higher levels of depressed mood than the other three samples.

Translation and Validation of the Korean Version of the International Knee Documentation Committee Subjective Knee Form

PubMed Central

Kim, Jin Goo; Lee, Joong Yub; Seo, Seung Suk; Choi, Choong Hyeok; Lee, Myung Chul

2013-01-01

Purpose To perform a cross-cultural adaptation and to test the measurement properties of the Korean version of International Knee Documentation Committee (K-IKDC) Subjective Knee Form. Materials and Methods According to the guidelines for cross-cultural adaptation, translation and backward translation of the English version of the IKDC Subjective Knee Form were performed. After translation into the Korean version, 150 patients who had knee-related problems were asked to complete the K-IKDC, Lysholm score, and Short Form-36 (SF-36). Of these patients, 126 were retested 2 weeks later to evaluate test-retest reliability, and 104 were recruited 3 months later to evaluate responsiveness. Construct validity was analyzed by investigating the correlation with Lysholm score and SF-36; content validity was also evaluated. Standardized mean response was calculated for evaluating responsiveness. Results The test-retest reliability proved excellent with a high value for the intraclass correlation coefficient (r=0.94). The internal consistency was strong (Cronbach's α=0.91). Good content validity with absence of floor not ceiling effects and good convergent and divergent validity were observed. Moderate responsiveness was shown (standardized mean response=0.689). Conclusions The K-IKDC demonstrated good measurement properties. We suggest that this instrument is an excellent evaluation instrument that can be used for Korean patients with knee-related injuries. PMID:24032098

Validation of a Quality of Life Questionnaire for Bronchiectasis: psychometric analyses of the Spanish QOL-B-V3.0.

PubMed

Olveira, Casilda; Olveira, Gabriel; Espildora, Francisco; Giron, Rosa-Maria; Muñoz, Gerard; Quittner, Alexandra L; Martinez-Garcia, Miguel-Angel

2014-05-01

Bronchiectasis is a chronic disease, leading to worsening of health-related quality of life. This study evaluated the psychometric properties of a new patient-reported outcome for non-cystic fibrosis bronchiectasis, the Quality of Life Questionnaire Bronchiectasis, translated into Spanish (QOL-B-Sp-V3.0). This prospective study recruited clinically stable patients with non-cystic fibrosis bronchiectasis at 4 Spanish centers. Health status was assessed with multiple indicators (dyspnea, exacerbations, bronchorrhea, etc.), microbiological, radiological, spirometric, and anthropometric parameters plus St-George Respiratory Questionnaire (SGRQ). Psychometric analyses included internal consistency, test-retest reliability, convergent validity, predictive validity, and responsivity to change. The 207 stable patients (mean age 57.2 years) had a Bhalla score of 11.53 ± 7.39 and FEV1% of 68.3 ± 22.2 %. One hundred and sixty-one stable patients repeated the test 2 weeks later, and 80 patients who had an exacerbation within 6 months of the assessment also repeated it. Internal consistency was high across all scales (Cronbach's alpha >0.70). Thirty-six of 37 items correlated more strongly with their assigned scale than a competing scale. Test-retest coefficients were strong (intraclass correlations r = 0.68-0.88). All scales, except Treatment Burden, discriminated significantly between patients with mild, moderate, and severe disease according to FEV1% and other respiratory parameters. Strong convergence was found between the QOL-B-Sp-V3.0 and SGRQ. Significant correlations were found between QOL-B-Sp-V3.0 and various clinical, spirometric, radiological, and anthropometric variables. Significant differences were found on all QOL-B-Sp-V3.0 scales, except emotional functioning, between the baseline responses and onset of an exacerbation; robust sensitivity to change was observed on the Respiratory Symptoms scale. The QOL-B-Sp-V3.0 questionnaire demonstrated strong reliability and validity. Scores were reproducible after 2 weeks, and it discriminated between patients who varied in severity and was responsive to changes related to exacerbation.

Behavioral and cognitive outcomes for clinical trials in children with neurofibromatosis type 1.

PubMed

van der Vaart, Thijs; Rietman, André B; Plasschaert, Ellen; Legius, Eric; Elgersma, Ype; Moll, Henriëtte A

2016-01-12

To evaluate the appropriateness of cognitive and behavioral outcome measures in clinical trials in neurofibromatosis type 1 (NF1) by analyzing the degree of deficits compared to reference groups, test-retest reliability, and how scores correlate between outcome measures. Data were analyzed from the Simvastatin for cognitive deficits and behavioral problems in patients with neurofibromatosis type 1 (NF1-SIMCODA) trial, a randomized placebo-controlled trial of simvastatin for cognitive deficits and behavioral problems in children with NF1. Outcome measures were compared with age-specific reference groups to identify domains of dysfunction. Pearson r was computed for before and after measurements within the placebo group to assess test-retest reliability. Principal component analysis was used to identify the internal structure in the outcome data. Strongest mean score deviations from the reference groups were observed for full-scale intelligence (-1.1 SD), Rey Complex Figure Test delayed recall (-2.0 SD), attention problems (-1.2 SD), and social problems (-1.1 SD). Long-term test-retest reliability were excellent for Wechsler scales (r > 0.88), but poor to moderate for other neuropsychological tests (r range 0.52-0.81) and Child Behavioral Checklist subscales (r range 0.40-0.79). The correlation structure revealed 2 strong components in the outcome measures behavior and cognition, with no correlation between these components. Scores on psychosocial quality of life correlate strongly with behavioral problems and less with cognitive deficits. Children with NF1 show distinct deficits in multiple domains. Many outcome measures showed weak test-retest correlations over the 1-year trial period. Cognitive and behavioral outcomes are complementary. This analysis demonstrates the need to include reliable outcome measures on a variety of cognitive and behavioral domains in clinical trials for NF1. © 2015 American Academy of Neurology.

The Distress Disclosure Index: a research review and multitrait-multimethod examination.

PubMed

Kahn, Jeffrey H; Hucke, Brandy E; Bradley, Allyson M; Glinski, Austin J; Malak, Brittany L

2012-01-01

The Distress Disclosure Index (DDI; J. H. Kahn & R. M. Hessling, 2001) is a brief self-report measure of one's tendency to disclose personally distressing information. The purpose of this article was to summarize what is known about the DDI, present new validity evidence, and make recommendations for use of the DDI. This article reviews research on the DDI from the past decade that indicates that distress disclosure is associated with well-being, professional help-seeking attitudes and intentions, and success in brief psychotherapy. On the basis of the reviewed literature, the authors report a reliability generalization study of DDI scores that strongly supports the internal consistency and test-retest reliability of DDI scores, and they review criterion-related and construct validity evidence. Next, the authors present a new multitrait-multimethod validity study of the DDI. Participants (N = 153) and peer informants (N = 153)--one per participant--completed paper-and-pencil questionnaire packets. Convergent validity of self-reported DDI scores was supported by a strong association with self-reports of emotional self-disclosure in response to a specific, unpleasant event, and self- and peer reports on the DDI were moderately correlated. DDI scores were not strongly associated with cognitive reappraisal and ambivalence over emotional expression, thus supporting discriminant validity. DDI scores were strongly associated with expressive suppression, and correlations between DDI scores and affect, depression symptoms, coping, and emotional expressivity were similar to those found with expressive suppression. The authors offer possible hypotheses explaining the overlap between distress disclosure and expressive suppression and present recommendations for future use of the DDI. (c) 2012 APA, all rights reserved.

Satisfaction With Appearance Scale-SWAP: Adaptation and validation for Brazilian burn victims.

PubMed

Caltran, Marina P; Freitas, Noélle O; Dantas, Rosana A S; Farina, Jayme Adriano; Rossi, Lidia A

2016-09-01

Methodological study that aimed to adapt the Satisfaction with Appearance Scale (SWAP) into Brazilian Portuguese language and to assess the validity, the reliability and the dimensionality of the adapted version in a sample of Brazilian burn victims. We carried out the adaptation process according to the international literature. Construct validity was assessed by correlating the adapted version of SWAP scores with depression (Beck Depression Index), self-esteem (Rosenberg Self-Esteem Scale), health-related quality of Life (Short Form Health Survey-36) and health status of burn victims (Burn Specific Health Scale-Revised), and with gender, total body surface area burned, and visibility of the scars. We tested dimensionality using Exploratory Factor Analysis (EFA) and the reliability by means of Cronbach's alpha. Participants were 106 adult burned patients. The correlations between the Brazilian version of the SWAP scores and the correlated construct measures varied from moderate to strong (r=.30-.77). The participants who perceived their burn sequelae was visible reported being more dissatisfied with their body image than the participants who answered that their scars would not be visible (p<.001). Cronbach's alpha for the adapted version was 0.88 and the item-total correlation varied from moderate to strong (r=.35-.73). The EFA resulted in three factors with a total explained variance percentage of 63.2%. The Brazilian version of the SWAP was valid and reliable for use with Brazilian burn victims. Copyright © 2016 Elsevier Ltd and ISBI. All rights reserved.

UP TO 100,000 RELIABLE STRONG GRAVITATIONAL LENSES IN FUTURE DARK ENERGY EXPERIMENTS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Serjeant, S.

2014-09-20

The Euclid space telescope will observe ∼10{sup 5} strong galaxy-galaxy gravitational lens events in its wide field imaging survey over around half the sky, but identifying the gravitational lenses from their observed morphologies requires solving the difficult problem of reliably separating the lensed sources from contaminant populations, such as tidal tails, as well as presenting challenges for spectroscopic follow-up redshift campaigns. Here I present alternative selection techniques for strong gravitational lenses in both Euclid and the Square Kilometre Array, exploiting the strong magnification bias present in the steep end of the Hα luminosity function and the H I mass function.more » Around 10{sup 3} strong lensing events are detectable with this method in the Euclid wide survey. While only ∼1% of the total haul of Euclid lenses, this sample has ∼100% reliability, known source redshifts, high signal-to-noise, and a magnification-based selection independent of assumptions of lens morphology. With the proposed Square Kilometre Array dark energy survey, the numbers of reliable strong gravitational lenses with source redshifts can reach 10{sup 5}.« less

Assessment of technical and nontechnical skills in surgical residents.

PubMed

Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

2016-11-01

Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P < .001 to .86, P < .001. The associations between nontechnical and technical skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P < .001). Multiple samplings of integrated technical and nontechnical skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

Observation of Spontaneous Expressive Language (OSEL): A New Measure for Spontaneous and Expressive Language of Children with Autism Spectrum Disorders and Other Communication Disorders

PubMed Central

Kim, So Hyun; Junker, Dörte; Lord, Catherine

2014-01-01

A new language measure, the Observation of Spontaneous Expressive Language (OSEL), is intended to document spontaneous use of syntax, pragmatics, and semantics in 2-12-year-old children with ASD and other communication disorders with expressive language levels comparable to typical 2-5 year olds. Because the purpose of the OSEL is to provide developmental norms for use of language, the first step involves assessment of the scale’s feasibility, validity, and reliability using a sample of 180 2-5 year-old typically developing children. Pilot data from the OSEL shows strong internal consistency, high reliabilities and validity. Once replicated with a large population-based sample and in special populations, the scale should be helpful in designing appropriate interventions for children with ASD and other communication disorders. PMID:25022249

Measuring hope among families impacted by cognitive impairment

PubMed Central

Hunsaker, Amanda E.; Terhorst, Lauren; Gentry, Amanda; Lingler, Jennifer H.

2014-01-01

The current exploratory investigation aims to establish the reliability and validity of a hope measure, the Herth Hope Index (HHI), among families impacted by early cognitive impairment (N=96). Exploratory factor analysis was used to examine the dimensionality of the measure. Bivariate analyses were used to examine construct validity. The sample had moderately high hope scores. A two-factor structure emerged from the factor analysis, explaining 51.44% of the variance. Both factors exhibited strong internal consistency (Cronbach’s alphas ranged from .83 to .86). Satisfaction with social support was positively associated with hope, supporting convergent validity. Neurocognitive status, illness insight and depression were not associated with hope, indicating discriminant validity. Families impacted by cognitive impairment may maintain hope in the face of a potentially progressive illness, regardless of cognitive status. The HHI can be utilized as a reliable and valid measure of hope by practitioners providing support to families impacted by cognitive impairment. PMID:24784938

Measuring self-concept among African-Americans: validating the factor structure of the self-perception profile for adolescents.

PubMed

Powell-Young, Yolanda M; Spruill, Ida J

2011-12-01

The purpose of this investigation was to examine the reliability and factor structure of the Harter Self-Perception Profile for Adolescents (SPPA) with African-Americans. While the SPPA has demonstrated strong psychometric properties with European-Americans, limited information exists with African-Americans. Three hundred and ten (N = 310) female adolescents, from 14 through 18 years of age, completed the SPPA. Estimations of internal consistency reliability with Cronbach's alpha (alpha), item suitability with Pearson (gamma) correlations, and evaluation of factor structure fit utilizing principle axis extraction with oblimin (oblique) rotation were conducted. When compared with Harter's normative data, psychometric properties of the SPPA varied significantly with the current sample. Findings suggested cautious interpretation of data generated with demographically similar cohorts. Further study is warranted to ascertain the factor structure that is most relevant for use with African-American adolescents.

Observation of Spontaneous Expressive Language (OSEL): a new measure for spontaneous and expressive language of children with autism spectrum disorders and other communication disorders.

PubMed

Kim, So Hyun; Junker, Dörte; Lord, Catherine

2014-12-01

A new language measure, the Observation of Spontaneous Expressive Language (OSEL), is intended to document spontaneous use of syntax, pragmatics, and semantics in 2-12-year-old children with Autism Spectrum Disorder (ASD) and other communication disorders with expressive language levels comparable to typical 2-5 year olds. Because the purpose of the OSEL is to provide developmental norms for use of language, the first step involves assessment of the scale's feasibility, validity, and reliability using a sample of 180 2-5 year-old typically developing children. Pilot data from the OSEL shows strong internal consistency, high reliabilities and validity. Once replicated with a large population-based sample and in special populations, the scale should be helpful in designing appropriate interventions for children with ASD and other communication disorders.

Cross-validating a bidimensional mathematics anxiety scale.

PubMed

Haiyan Bai

2011-03-01

The psychometric properties of a 14-item bidimensional Mathematics Anxiety Scale-Revised (MAS-R) were empirically cross-validated with two independent samples consisting of 647 secondary school students. An exploratory factor analysis on the scale yielded strong construct validity with a clear two-factor structure. The results from a confirmatory factor analysis indicated an excellent model-fit (χ(2) = 98.32, df = 62; normed fit index = .92, comparative fit index = .97; root mean square error of approximation = .04). The internal consistency (.85), test-retest reliability (.71), interfactor correlation (.26, p < .001), and positive discrimination power indicated that MAS-R is a psychometrically reliable and valid instrument for measuring mathematics anxiety. Math anxiety, as measured by MAS-R, correlated negatively with student achievement scores (r = -.38), suggesting that MAS-R may be a useful tool for classroom teachers and other educational personnel tasked with identifying students at risk of reduced math achievement because of anxiety.

Reliability and validity of the adapted Resistance Training Skills Battery for Children.

PubMed

Furzer, Bonnie J; Bebich-Philip, Marc D; Wright, Kemi E; Reid, Siobhan L; Thornton, Ashleigh L

2017-12-29

Resistance training (RT) is emerging as a training modality to improve motor function and facilitate physical activity participation in children across the motor proficiency spectrum. Although RT competency assessments have been established and validated among adolescent cohorts, the extent to which these methods are suitable for assessing children's RT skills is unknown. This project aimed to assess the psychometric properties of the adapted Resistance Training Skills Battery for Children (RTSBc), in children with varying motor proficiency. Repeated measures design with 40 participants (M age=8.2±1.7years) displaying varying levels of motor proficiency. Participants performed the adapted RTSBc on two occasions, receiving a score for their execution of each component, in addition to an overall RT skill quotient child (RTSQc). Cronbach's alpha, intra-class correlation (ICC), Bland-Altman analysis, and typical error were used to assess test-retest reliability. To examine construct validity, exploratory factor analysis was performed alongside computing correlations between participants' muscle strength, motor proficiency, age, lean muscle mass, and RTSQc. The RTSBc displayed an acceptable level of internal consistency (alpha=0.86) and test-retest reliability (ICC range=0.86-0.99). Exploratory factor analysis supported internal test structure, with all six RT skills loading strongly on a single factor (range 0.56-0.89). Analyses of structural validity revealed positive correlations for RTSQc in relation to motor proficiency (r=0.52, p<0.001) and strength scores (r=0.61, p<0.001). Analyses revealed support for the construct validity and test-retest reliability of the RTSBc, providing preliminary evidence that the RTSBc is appropriate for use in the assessment of children's RT competency. Copyright © 2018 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Cross-Cultural Adaptation, Validation, and Reliability Testing of the Modified Oswestry Disability Questionnaire in Persian Population with Low Back Pain.

PubMed

Baradaran, Aslan; Ebrahimzadeh, Mohammad H; Birjandinejad, Ali; Kachooei, Amir Reza

2016-04-01

Prospective study. We aimed to validate the Persian version of the modified Oswestry disability questionnaire (MODQ) in patients with low back pain. Modified Oswestry low back pain disability questionnaire is a well-known condition-specific outcome measure that helps quantify disability in patients with lumbar syndromes. To test the validity in a pilot study, the Persian MODQ was administered to 25 individuals with low back pain. We then enrolled 200 consecutive patients with low back pain to fill the Persian MODQ as well as the short form 36 (SF-36) questionnaire. Convergent validity of the MODQ was tested using the Spearman's correlation coefficient between the MODQ and SF-36 subscales. Intraclass correlation coefficient (ICC) and Cronbach's α coefficient were measured to test the reliability between test and retest and internal consistency of all items, respectively. ICC for individual items ranged from 0.43 to 0.80 showing good reliability and reproducibility of each individual item. Cronbach's α coefficient was 0.69 showing good internal consistency across all 10 items of the Persian MODQ. Total MODQ score showed moderate to strong correlation with the eight subscales and the two domains of the SF-36. The highest correlation was between the MODQ and the physical functioning subscale of the SF-36 (r=-0.54, p<0.001) and the physical component domain of the SF-36 (r=-0.55, p<0.001) showing that MODQ is measuring what it is supposed to measure in terms of disability and physical function. Persian version of the MODQ is a valid and reliable tool for the assessment of the disability following low back pain.

Patient-reported outcome instruments that evaluate adherence behaviours in adults with asthma: A systematic review of measurement properties.

PubMed

Gagné, Myriam; Boulet, Louis-Philippe; Pérez, Norma; Moisan, Jocelyne

2018-04-30

To systematically identify the measurement properties of patient-reported outcome instruments (PROs) that evaluate adherence to inhaled maintenance medication in adults with asthma. We conducted a systematic review of six databases. Two reviewers independently included studies on the measurement properties of PROs that evaluated adherence in asthmatic participants aged ≥18 years. Based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), the reviewers (1) extracted data on internal consistency, reliability, measurement error, content validity, structural validity, hypotheses testing, cross-cultural validity, criterion validity, and responsiveness; (2) assessed the methodological quality of the included studies; (3) assessed the quality of the measurement properties (positive or negative); and (4) summarised the level of evidence (limited, moderate, or strong). We screened 6,068 records and included 15 studies (14 PROs). No studies evaluated measurement error or responsiveness. Based on methodological and measurement property quality assessments, we found limited positive evidence of: (a) internal consistency of the Adherence Questionnaire, Refined Medication Adherence Reason Scale (MAR-Scale), Medication Adherence Report Scale for Asthma (MARS-A), and Test of the Adherence to Inhalers (TAI); (b) reliability of the TAI; and (c) structural validity of the Adherence Questionnaire, MAR-Scale, MARS-A, and TAI. We also found limited negative evidence of: (d) hypotheses testing of Adherence Questionnaire; (e) reliability of the MARS-A; and (f) criterion validity of the MARS-A and TAI. Our results highlighted the need to conduct further high-quality studies that will positively evaluate the reliability, validity, and responsiveness of the available PROs. This article is protected by copyright. All rights reserved.

Validation of the Turkish Version of the Sexual Health Outcomes in Women Questionnaire (SHOW-Q) in Turkish-Speaking Women.

PubMed

Selcuk, Selcuk; Kucukbas, Mehmet; Cam, Cetin; Eser, Ahmet; Devranoglu, Belgin; Turkyilmaz, Sebnem; Karateke, Ates

2016-06-01

The Sexual Health Outcomes in Women Questionnaire (SHOW-Q) is designed to evaluate the sexual life of women for satisfaction, orgasm, desire, and pelvic problem interference. The SHOW-Q is important for evaluating worsening of sexual life for patients with pelvic problems and the management of these women to improve their sexual life. To validate the Turkish versions of the SHOW-Q for Turkish-speaking women. The Turkish version of the SHOW-Q was generated by two independent professional English-to-Turkish translators. The translated version of the SHOW-Q was reverse translated by two bilingual translators whose native language was English. Women with at least one symptom related to pelvic problems (n = 71) and those with no symptoms (n = 38) were included in the present study. Test-retest reliability analysis, content-face validity, internal consistency reliability, item-total correlations, convergent validity, construct validity, and factorial validity were performed to assess the psychometric properties of the Turkish versions of the SHOW-Q. Test-retest reliability demonstrated good correlation for all subscales. Cronbach α values ranged from 0.735 to 0.892 and indicated high internal consistency. There was a strong correlation for the corresponding subscales between the SHOW-Q and the Female Sexual Function Index. The mean score of each SHOW-Q subscale showed significant differences between symptomatic and asymptomatic patients. The Turkish version of the SHOW-Q is a valid and reliable instrument that can be used to evaluate the sexual life of Turkish-speaking women with different pelvic problems. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

A comparative trial of paper-and-pencil versus computer administration of the Quality of Life in Reflux and Dyspepsia (QOLRAD) questionnaire.

PubMed

Kleinman, L; Leidy, N K; Crawley, J; Bonomi, A; Schoenfeld, P

2001-02-01

Although most health-related quality of life questionnaires are self-administered by means of paper and pencil, new technologies for automated computer administration are becoming more readily available. Novel methods of instrument administration must be assessed for score equivalence in addition to consistency in reliability and validity. The present study compared the psychometric characteristics (score equivalence and structure, internal consistency, and reproducibility reliability and construct validity) of the Quality of Life in Reflux And Dyspepsia (QOLRAD) questionnaire when self-administered by means of paper and pencil versus touch-screen computer. The influence of age, education, and prior experience with computers on score equivalence was also examined. This crossover trial randomized 134 patients with gastroesophageal reflux disease to 1 of 2 groups: paper-and-pencil questionnaire administration followed by computer administration or computer administration followed by use of paper and pencil. To minimize learning effects and respondent fatigue, administrations were scheduled 3 days apart. A random sample of 32 patients participated in a 1-week reproducibility evaluation of the computer-administered QOLRAD. QOLRAD scores were equivalent across the 2 methods of administration regardless of subject age, education, and prior computer use. Internal consistency levels were very high (alpha = 0.93-0.99). Interscale correlations were strong and generally consistent across methods (r = 0.7-0.87). Correlations between the QOLRAD and Short Form 36 (SF-36) were high, with no significant differences by method. Test-retest reliability of the computer-administered QOLRAD was also very high (ICC = 0.93-0.96). Results of the present study suggest that the QOLRAD is reliable and valid when self-administered by means of computer touch-screen or paper and pencil.

Assessing the reliability of the short form 12 (SF-12) health survey in adults with mental health conditions: a report from the wellness incentive and navigation (WIN) study.

PubMed

Huo, Tianyao; Guo, Yi; Shenkman, Elizabeth; Muller, Keith

2018-02-13

Although Short Form (SF)-12 × 2® has been extensively studied and used as a valid measure of health-related quality of life in a variety of population groups, no systematic studies have described the reliability of the measure in patients with behavioral conditions or serious mental illness (SMI). We assessed the internal consistency, split-half reliability and annual test-retest correlations in a sample of 1587 participants with either a combination of physical and behavioral conditions or SMI. The Mosier's alpha was 0.70 for the Physical Composite Scale (PCS) and 0.69 for the Mental Health Composite Scale (MCS), indicating good internal consistency. We observed strong correlations between physical functioning, physical role and body pain scales (r = 0.55-0.56), and between social functioning, emotional role, and mental health (r = 0.53-0.58). We calculated split-half reliabilities to be 0.74 for physical functioning, 0.75 for physical role, 0.73 for emotional role and 0.65 for mental health respectively. We assessed the annual test-retest correlation using intraclass correlation (ICC) and found an ICC of 0.61 for PCS and 0.57 for MCS composite scores, adjusting for age, sex, race/ethnicity, and CRG. We found no decline in the correlations between baseline and the following study years until year 3. Our results encourage using SF-12v2® to assess health-related quality of life in the Medicaid population with combined physical and behavioral conditions or similar cohorts. The WIN study was registered with clinicaltrials.gov on April 22, 2015. NCT02440906 . Retrospectively registered.

Psychometric properties of the Finnish version of the Young Person's Clinical Outcomes in Routine Evaluation (YP-CORE) questionnaire.

PubMed

Gergov, Vera; Lahti, Jari; Marttunen, Mauri; Lipsanen, Jari; Evans, Chris; Ranta, Klaus; Laitila, Aarno; Lindberg, Nina

2017-05-01

An increasing need exists for suitable measures to evaluate treatment outcome in adolescents. YP-CORE is a pan-theoretical brief questionnaire developed for this purpose, but it lacks studies in different cultures or languages. To explore the acceptability, factor structure, reliability, validity, and sensitivity to change of the Finnish translation of YP-CORE. The study was conducted at the Department of Adolescent Psychiatry, Helsinki University Central Hospital. A Finnish translation was prepared by a team of professionals and adolescents. A clinical sample of 104 patients was asked to complete the form together with BDI-21 and BAI, and 92 of them filled the forms again after a 3-month treatment. Analysis included acceptability, confirmatory factor analysis, internal and test-re-test reliability, concurrent validity, influence of gender and age, and criteria for reliable change. YP-CORE was well accepted, and the rate of missing values was low. Internal consistency (α = 0.83-.92) and test-re-test reliability were good (r = 0.69), and the results of CFA supported a one-factor model. YP-CORE showed good concurrent validity against two widely used symptom-specific measures (r = 0.62-0.87). Gender had a moderately strong effect on the scores (d = 0.67), but the effect of age was not as evident. The measure was sensitive to change, showing a larger effect size (d = 0.55) than in the BDI-21 and BAI (d = 0.31-0.50). The results show that the translation of YP-CORE into Finnish has been successful, the YP-CORE has good psychometric properties, and the measure could be taken into wider use in clinical settings for outcome measurement in adolescents.

Cross-cultural adaptation of a pre-school screening instrument: comparison of Korean and US populations.

PubMed

Heo, K H; Squires, J; Yovanoff, P

2008-03-01

Accurate and efficient developmental screening measures are critical for early identification of developmental problems; however, few reliable and valid tests are available in Korea as well as other countries outside the USA. The Ages and Stages Questionnaires (ASQ) was chosen for study with young children in Korea. The ASQ was translated into Korean and necessary cross-cultural adaptations were made. The translated version was then distributed and completed by 3220 parents of young children between the ages of 4 months and 5 years. Reliability was studied including domain correlations, internal consistency, and performance of identification cut-off scores for the Korean population. Rasch analyses including tests of Differential Item Functioning, contrasting Korean and US samples were also performed. In general, internal consistency of the Korean ASQ was high, with overall correlations 0.75 for communication, 0.85 for gross motor, 0.74 for fine motor, 0.72 for problem solving, and 0.65 for personal-social. Validity, including concurrent validity, also had strong evidence. Mean scores of children on the Korean translation of the ASQ and the US normative sample were generally similar. Rasch analyses indicated the majority of items functioned similarly across the Korean sample. In general, the ASQ was translated with cultural appropriateness in mind and functioned as a valid and reliable parent-completed screening test to assist in early identification of young children with developmental delays. Further research is needed to confirm these results with a larger and more diverse Korean sample.

Development, reliability, and validity of the Alberta Perinatal Stroke Project Parental Outcome Measure.

PubMed

Bemister, Taryn B; Brooks, Brian L; Kirton, Adam

2014-07-01

Perinatal stroke is a leading cause of cerebral palsy and lifelong disability, although parent and family outcomes have not yet been studied in this specific population. The Alberta Perinatal Stroke Project Parental Outcome Measure was developed as a 26-item questionnaire on the impact of perinatal stroke on parents and families. The items were derived from expert opinion and scientific literature on issues salient to parents of children with perinatal stroke, including guilt and blame, which are not well captured in existing measures of family impact. Data were collected from 82 mothers and 28 fathers who completed the Parental Outcome Measure and related questionnaires (mean age, 39.5 years; mean child age, 7.4 years). Analyses examined the Parental Outcome Measure's internal consistency, test-retest reliability, validity, and factor structure. The Parental Outcome Measure demonstrated three unique theoretical constructs: Psychosocial Impact, Guilt, and Blame. The Parental Outcome Measure has excellent internal consistency (Cronbach α = 0.91) and very good test-retest reliability more than 2-5 weeks (r = 0.87). Regarding validity, the Parental Outcome Measure is sensitive to condition severity, accounts for additional variance in parent outcomes, and strongly correlates with measures of anxiety, depression, stress, quality of life, family functioning, and parent adjustment. The Parental Outcome Measure contributes to the literature as the first brief measure of family impact designed for parents of children with perinatal stroke. Copyright © 2014 Elsevier Inc. All rights reserved.

How reliable and valid is the teacher version of the Strengths and Difficulties Questionnaire in primary school children?

PubMed

van den Heuvel, Meta; Jansen, Danielle E M C; Stewart, Roy E; Smits-Engelsman, Bouwien C M; Reijneveld, Sijmen A; Flapper, Boudien C T

2017-01-01

The Strengths and Difficulties Questionnaire (SDQ) is validated for parents, but not yet for teachers in a broad age range of children. We conducted a cross-sectional study with 4-10 years old school children to investigate if the SDQ-T can be used instead of the validated but lengthy Teacher's Report Form (TRF) to acquire information about emotional and behavioral problems in the school community. Teachers of 453 children from primary schools were approached. Teachers of 394 children (response rate 86.9%) with a mean age of 7.1 years filled in the SDQ-T (n = 387), the TRF (n = 349) or both (n = 342). We assessed reliability by calculating internal consistency and concurrent validity (using correlation coefficients, sensitivity, specificity) of the SDQ-T compared with the TRF. Internal consistency of the SDQ-T Total Difficulties Score (SDQ-T TDS; Cronbach α = 0.80), hyperactivity/ inattention- (α = 0.86) and prosocial behavior (α = 0.81) was very good. Concurrent validity demonstrated a strong correlation of all subscales of the SDQ-T with the corresponding scale on the TRF (range 0.54-0.73), except for peer problems (0.46). Using a SDQ-T TDS cut-off score > 14, the SDQ-T had a good sensitivity (90%) and specificity (94%). The good reliability, validity and brevity of the SDQ-T make it an easily applicable questionnaire for obtaining information about emotional and behavioral problems from teachers in primary school children.

Validity and reliability of the multidimensional assessment of fatigue scale in Iranian patients with relapsing-remitting subtype of multiple sclerosis.

PubMed

Behrangrad, Shabnam; Kordi Yoosefinejad, Amin

2018-03-01

The purpose of this study is to investigate the validity and reliability of the Persian version of the Multidimensional Assessment of Fatigue Scale (MAFS) in an Iranian population with multiple sclerosis. A self-reported survey on fatigue including the MAFS, Fatigue Impact Scale and demographic measures was completed by 130 patients with multiple sclerosis and 60 healthy persons sampled with a convenience method. Test-retest reliability and validity were evaluated 3 days apart. Construct validity of the MAFS was assessed with the Fatigue Impact Scale. The MAFS had high internal consistency (Cronbach's alpha >0.9) and 3-d test-retest reliability (intraclass correlation coefficient = 0.99). Correlation between the Fatigue Impact Scale and MAFS was high (r = 0.99). Correlation between MAFS scores and the Expanded Disability Status Scale was also strong (r = 0.85). Questionnaire items showed acceptable item-scale correlation (0.968-0.993). The Persian version of the MAFS appears to be a valid and reliable questionnaire. It is an appropriate short multidimensional instrument to assess fatigue in patients with multiple sclerosis in clinical practice and research. Implications for Rehabilitation The Persian version of Multidimensional Assessment of Fatigue is a valid and reliable instrument for the assessment and monitoring the fatigue in Persian-language patients with multiple sclerosis. It is very easy to administer and a time efficient scale in comparison to other instruments evaluating fatigue in patients with multiple sclerosis.

Reliability and validity of the parent efficacy for child healthy weight behaviour (PECHWB) scale.

PubMed

Palmer, F; Davis, M C

2014-05-01

Interventions for childhood overweight and obesity that target parents as the agents of change by increasing parent self-efficacy for facilitating their child's healthy weight behaviours require a reliable and valid tool to measure parent self-efficacy before and after interventions. Nelson and Davis developed the Parent Efficacy for Child Healthy Weight Behaviour (PECHWB) scale with good preliminary evidence of reliability and validity. The aim of this research was to provide further psychometric evidence from an independent Australian sample. Data were provided by a convenience sample of 261 primary caregivers of children aged 4-17 years via an online survey. PECHWB scores were correlated with scores on other self-report measures of parenting efficacy and 2- to 4-week test-retest reliability of the PECHWB was assessed. The results of the study confirmed the four-factor structure of the PECHWB (Fat and Sugar, Sedentary Behaviours, Physical Activity, and Fruit and Vegetables) and provided strong evidence of internal consistency and test-retest reliability, as well as good evidence of convergent validity. Future research should investigate the properties of the PECHWB in a sample of parents of overweight or obese children, including measures of child weight and actual child healthy weight behaviours to provide evidence of the concurrent and predictive validity of PECHWB scores. © 2013 John Wiley & Sons Ltd.

Reliability of Instruments Measuring At-Risk and Problem Gambling Among Young Individuals: A Systematic Review Covering Years 2009-2015.

PubMed

Edgren, Robert; Castrén, Sari; Mäkelä, Marjukka; Pörtfors, Pia; Alho, Hannu; Salonen, Anne H

2016-06-01

This review aims to clarify which instruments measuring at-risk and problem gambling (ARPG) among youth are reliable and valid in light of reported estimates of internal consistency, classification accuracy, and psychometric properties. A systematic search was conducted in PubMed, Medline, and PsycInfo covering the years 2009-2015. In total, 50 original research articles fulfilled the inclusion criteria: target age under 29 years, using an instrument designed for youth, and reporting a reliability estimate. Articles were evaluated with the revised Quality Assessment of Diagnostic Accuracy Studies tool. Reliability estimates were reported for five ARPG instruments. Most studies (66%) evaluated the South Oaks Gambling Screen Revised for Adolescents. The Gambling Addictive Behavior Scale for Adolescents was the only novel instrument. In general, the evaluation of instrument reliability was superficial. Despite its rare use, the Canadian Adolescent Gambling Inventory (CAGI) had a strong theoretical and methodological base. The Gambling Addictive Behavior Scale for Adolescents and the CAGI were the only instruments originally developed for youth. All studies, except the CAGI study, were population based. ARPG instruments for youth have not been rigorously evaluated yet. Further research is needed especially concerning instruments designed for clinical use. Copyright © 2016 The Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Investigating the reliability and validity of the Dutch versions of the illness management and recovery scales among clients with mental disorders.

PubMed

Goossens, Peter J J; Beentjes, Titus A A; Knol, Suzanne; Salyers, Michelle P; de Vries, Sjoerd J

2017-12-01

The Illness Management and Recovery scales (IMRS) can measure the progress of clients' illness self-management and recovery. Previous studies have examined the psychometric properties of the IMRS. This study examined the reliability and validity of the Dutch version of the IMRS. Clients (n = 111) and clinicians (n = 40) completed the client and clinician versions of the IMRS, respectively. The scales were administered again 2 weeks later to assess stability over time. Validity was assessed with the Utrecht Coping List (UCL), Dutch Empowerment Scale (DES), and Brief Symptom Inventory (BSI). The client and clinician versions of the IMRS had moderate internal reliability, with α = 0.69 and 0.71, respectively. The scales showed strong test-retest reliability, r = 0.79, for the client version and r = 0.86 for the clinician version. Correlations between client and clinician versions ranged from r = 0.37 to 0.69 for the total and subscales. We also found relationships in expected directions between the client IMRS and UCL, DES and BSI, which supports validity of the Dutch version of the IMRS. The Dutch version of the IMRS demonstrated good reliability and validity. The IMRS could be useful for Dutch-speaking programs interested in evaluating client progress on illness self-management and recovery.

Ultrasound definition of tendon damage in patients with rheumatoid arthritis. Results of a OMERACT consensus-based ultrasound score focussing on the diagnostic reliability.

PubMed

Bruyn, George A W; Hanova, Petra; Iagnocco, Annamaria; d'Agostino, Maria-Antonietta; Möller, Ingrid; Terslev, Lene; Backhaus, Marina; Balint, Peter V; Filippucci, Emilio; Baudoin, Paul; van Vugt, Richard; Pineda, Carlos; Wakefield, Richard; Garrido, Jesus; Pecha, Ondrej; Naredo, Esperanza

2014-11-01

To develop the first ultrasound scoring system of tendon damage in rheumatoid arthritis (RA) and assess its intraobserver and interobserver reliability. We conducted a Delphi study on ultrasound-defined tendon damage and ultrasound scoring system of tendon damage in RA among 35 international rheumatologists with experience in musculoskeletal ultrasound. Twelve patients with RA were included and assessed twice by 12 rheumatologists-sonographers. Ultrasound examination for tendon damage in B mode of five wrist extensor compartments (extensor carpi radialis brevis and longus; extensor pollicis longus; extensor digitorum communis; extensor digiti minimi; extensor carpi ulnaris) and one ankle tendon (tibialis posterior) was performed blindly, independently and bilaterally in each patient. Intraobserver and interobserver reliability were calculated by κ coefficients. A three-grade semiquantitative scoring system was agreed for scoring tendon damage in B mode. The mean intraobserver reliability for tendon damage scoring was excellent (κ value 0.91). The mean interobserver reliability assessment showed good κ values (κ value 0.75). The most reliable were the extensor digiti minimi, the extensor carpi ulnaris, and the tibialis posterior tendons. An ultrasound reference image atlas of tenosynovitis and tendon damage was also developed. Ultrasound is a reproducible tool for evaluating tendon damage in RA. This study strongly supports a new reliable ultrasound scoring system for tendon damage. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Psychometric Evaluation of the Spiritual Coping Strategies Scale Arabic Version for Saudi Nursing Students.

PubMed

Cruz, Jonas Preposi; Alquwez, Nahed; Alqubeilat, Hikmet; Colet, Paolo C

2016-05-22

To evaluate the psychometric properties of the Spiritual Coping Strategies scale Arabic version (SCS-A) in a sample of nursing students in Saudi Arabia. This study had a cross-sectional design with a convenience sample of 100 nursing students in Saudi Arabia. Using the SCS-A and the Muslim Religiosity Scale for data collection, data were analyzed to establish the reliability and validity of the SCS-A. Good internal consistency reliability (Cronbach's α > .70) and stability reliability (intraclass correlation coefficient > .80) were observed. Two dominant factors were extracted from the scale items, the nonreligious coping strategies and religious coping strategies, which accounted for 35.5% and 32.7% of the variance, respectively. The religious coping subscale exhibited a strong positive correlation with the religious practices subscale of the Muslim Religious Involvement Scale (r = .45, p < .001) and total religiosity score (r = .48, p < .001) as well as a weak positive correlation with the intrinsic religious beliefs subscale (r = .25, p < .05). No significant relationship was found between nonreligious coping subscale and the Muslim Religious Involvement Scale. The SCS-A exhibited an acceptable validity and reliability, supporting its sound psychometric properties with respect to the responses from Saudi nursing students. © The Author(s) 2016.

Validity and reliability of the Cognitive Complaints in Bipolar Disorder Rating Assessment (COBRA) in Japanese patients with bipolar disorder.

PubMed

Toyoshima, Kuniyoshi; Fujii, Yutaka; Mitsui, Nobuyuki; Kako, Yuki; Asakura, Satoshi; Martinez-Aran, Anabel; Vieta, Eduard; Kusumi, Ichiro

2017-08-01

In Japan, there are currently no reliable rating scales for the evaluation of subjective cognitive impairment in patients with bipolar disorder. We studied the relationship between the Japanese version of the Cognitive Complaints in Bipolar Disorder Rating Assessment (COBRA) and objective cognitive assessments in patients with bipolar disorder. We further assessed the reliability and validity of the COBRA. Forty-one patients, aged 16-64, in a remission period of bipolar disorder were recruited from Hokkaido University Hospital in Sapporo, Japan. The COBRA (Japanese version) and Frankfurt Complaint Questionnaire (FCQ), the gold standard in subjective cognitive assessment, were administered. A battery of neuropsychological tests was employed to measure objective cognitive impairment. Correlations among the COBRA, FCQ, and neuropsychological tests were determined using Spearman's correlation coefficient. The Japanese version of the COBRA had high internal consistency, good retest reliability, and concurrent validity-as indicated by a strong correlation with the FCQ. A significant correlation was also observed between the COBRA and objective cognitive measurements of processing speed. These findings are the first to demonstrate that the Japanese version of the COBRA may be clinically useful as a subjective cognitive impairment rating scale in Japanese patients with bipolar disorder. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

TURKISH VERSION QUALITY OF LIFE IN ESSENTIAL TREMOR QUESTIONNAIRE (QUEST): VALIDITY AND RELIABILITY STUDY.

PubMed

Güler, Sibel; Turan, F Nesrin

2015-09-30

Our aim was to translate the Quality of Life in Essential Tremor Questionnaire (QUEST) advanced by Troster (2005) and to analyse the validity and reliability of this questionnaire. Two hundred twelve consecutive patients with essential tremor (ET) and forty-three control subjects were included in the study. Permission for the translation and validation of the QUEST scale was obtained. The translation was performed according to the guidelines provided by the publisher. After the translation, the final version of the scale was administered to both groups to determine its reliability and validity. The QUEST Physical, Psychosocial, communication, Hobbies/leisure and Work/finance scores were 0.967, 0.968, 0.933, 0.964 and 0.925, respectively. There were good correlations between each of the QUEST scores that were indicative of good internal consistency. Additionally, we observed that all of the QUEST scores were most strongly related to the right and left arms (p=0.0001). However, we observed that all of the QUEST scores were weakly related to the voice, head and right leg (p=0.0001). These findings support the notion that the Turkish version of the Quality of Life in Essential Tremor (QUEST) questionnaire is a valid and reliable tool for the assessment of the quality of life of patients with ET.

Do in-training evaluation reports deserve their bad reputations? A study of the reliability and predictive ability of ITER scores and narrative comments.

PubMed

Ginsburg, Shiphra; Eva, Kevin; Regehr, Glenn

2013-10-01

Although scores on in-training evaluation reports (ITERs) are often criticized for poor reliability and validity, ITER comments may yield valuable information. The authors assessed across-rotation reliability of ITER scores in one internal medicine program, ability of ITER scores and comments to predict postgraduate year three (PGY3) performance, and reliability and incremental predictive validity of attendings' analysis of written comments. Numeric and narrative data from the first two years of ITERs for one cohort of residents at the University of Toronto Faculty of Medicine (2009-2011) were assessed for reliability and predictive validity of third-year performance. Twenty-four faculty attendings rank-ordered comments (without scores) such that each resident was ranked by three faculty. Mean ITER scores and comment rankings were submitted to regression analyses; dependent variables were PGY3 ITER scores and program directors' rankings. Reliabilities of ITER scores across nine rotations for 63 residents were 0.53 for both postgraduate year one (PGY1) and postgraduate year two (PGY2). Interrater reliabilities across three attendings' rankings were 0.83 for PGY1 and 0.79 for PGY2. There were strong correlations between ITER scores and comments within each year (0.72 and 0.70). Regressions revealed that PGY1 and PGY2 ITER scores collectively explained 25% of variance in PGY3 scores and 46% of variance in PGY3 rankings. Comment rankings did not improve predictions. ITER scores across multiple rotations showed decent reliability and predictive validity. Comment ranks did not add to the predictive ability, but correlation analyses suggest that trainee performance can be measured through these comments.

Reliability Analysis for the Internationally Administered 2002 Series GED Tests. GED Testing Service[R] Research Studies, 2009-3

ERIC Educational Resources Information Center

Setzer, J. Carl; He, Yi

2009-01-01

Reliability Analysis for the Internationally Administered 2002 Series GED (General Educational Development) Tests Reliability refers to the consistency, or stability, of test scores when the authors administer the measurement procedure repeatedly to groups of examinees (American Educational Research Association [AERA], American Psychological…

Training and Maintaining System-Wide Reliability in Outcome Management.

PubMed

Barwick, Melanie A; Urajnik, Diana J; Moore, Julia E

2014-01-01

The Child and Adolescent Functional Assessment Scale (CAFAS) is widely used for outcome management, for providing real time client and program level data, and the monitoring of evidence-based practices. Methods of reliability training and the assessment of rater drift are critical for service decision-making within organizations and systems of care. We assessed two approaches for CAFAS training: external technical assistance and internal technical assistance. To this end, we sampled 315 practitioners trained by external technical assistance approach from 2,344 Ontario practitioners who had achieved reliability on the CAFAS. To assess the internal technical assistance approach as a reliable alternative training method, 140 practitioners trained internally were selected from the same pool of certified raters. Reliabilities were high for both practitioners trained by external technical assistance and internal technical assistance approaches (.909-.995, .915-.997, respectively). 1 and 3-year estimates showed some drift on several scales. High and consistent reliabilities over time and training method has implications for CAFAS training of behavioral health care practitioners, and the maintenance of CAFAS as a global outcome management tool in systems of care.

Validity and Reliability of the Verbal Numerical Rating Scale for Children Aged 4 to 17 Years With Acute Pain.

PubMed

Tsze, Daniel S; von Baeyer, Carl L; Pahalyants, Vartan; Dayan, Peter S

2018-06-01

The Verbal Numerical Rating Scale is the most commonly used self-report measure of pain intensity. It is unclear how the validity and reliability of the scale scores vary across children's ages. We aimed to determine the validity and reliability of the scale for children presenting to the emergency department across a comprehensive spectrum of age. This was a cross-sectional study of children aged 4 to 17 years. Children self-reported their pain intensity, using the Verbal Numerical Rating Scale and Faces Pain Scale-Revised at 2 serial assessments. We evaluated convergent validity (strong validity defined as correlation coefficient ≥0.60), agreement (difference between concurrent Verbal Numerical Rating Scale and Faces Pain Scale-Revised scores), known-groups validity (difference in score between children with painful versus nonpainful conditions), responsivity (decrease in score after analgesic administration), and reliability (test-retest at 2 serial assessments) in the total sample and subgroups based on age. We enrolled 760 children; 27 did not understand the Verbal Numerical Rating Scale and were removed. Of the remainder, Pearson correlations were strong to very strong (0.62 to 0.96) in all years of age except 4 and 5 years, and agreement was strong for children aged 8 and older. Known-groups validity and responsivity were strong in all years of age. Reliability was strong in all age subgroups, including each year of age from 4 to 7 years. Convergent validity, known-groups validity, responsivity, and reliability of the Verbal Numerical Rating Scale were strong for children aged 6 to 17 years. Convergent validity was not strong for children aged 4 and 5 years. Our findings support the use of the Verbal Numerical Rating Scale for most children aged 6 years and older, but not for those aged 4 and 5 years. Copyright © 2017 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.

Internal Consistency, Retest Reliability, and their Implications For Personality Scale Validity

PubMed Central

McCrae, Robert R.; Kurtz, John E.; Yamagata, Shinji; Terracciano, Antonio

2010-01-01

We examined data (N = 34,108) on the differential reliability and validity of facet scales from the NEO Inventories. We evaluated the extent to which (a) psychometric properties of facet scales are generalizable across ages, cultures, and methods of measurement; and (b) validity criteria are associated with different forms of reliability. Composite estimates of facet scale stability, heritability, and cross-observer validity were broadly generalizable. Two estimates of retest reliability were independent predictors of the three validity criteria; none of three estimates of internal consistency was. Available evidence suggests the same pattern of results for other personality inventories. Internal consistency of scales can be useful as a check on data quality, but appears to be of limited utility for evaluating the potential validity of developed scales, and it should not be used as a substitute for retest reliability. Further research on the nature and determinants of retest reliability is needed. PMID:20435807

An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures.

PubMed

Ponterotto, Joseph G; Ruckdeschel, Daniel E

2007-12-01

The present article addresses issues in reliability assessment that are often neglected in psychological research such as acceptable levels of internal consistency for research purposes, factors affecting the magnitude of coefficient alpha (alpha), and considerations for interpreting alpha within the research context. A new reliability matrix anchored in classical test theory is introduced to help researchers judge adequacy of internal consistency coefficients with research measures. Guidelines and cautions in applying the matrix are provided.

Reliability of the Client-Centeredness of Goal Setting (C-COGS) Scale in Acquired Brain Injury Rehabilitation.

PubMed

Doig, Emmah; Prescott, Sarah; Fleming, Jennifer; Cornwell, Petrea; Kuipers, Pim

2016-01-01

To examine the internal reliability and test-retest reliability of the Client-Centeredness of Goal Setting (C-COGS) scale. The C-COGS scale was administered to 42 participants with acquired brain injury after completion of multidisciplinary goal planning. Internal reliability of scale items was examined using item-partial total correlations and Cronbach's α coefficient. The scale was readministered within a 1-mo period to a subsample of 12 participants to examine test-retest reliability by calculating exact and close percentage agreement for each item. After examination of item-partial total correlations, test items were revised. The revised items demonstrated stronger internal consistency than the original items. Preliminary evaluation of test-retest reliability was fair, with an average exact percent agreement across all test items of 67%. Findings support the preliminary reliability of the C-COGS scale as a tool to evaluate and promote client-centered goal planning in brain injury rehabilitation. Copyright © 2016 by the American Occupational Therapy Association, Inc.

Use of Internal Consistency Coefficients for Estimating Reliability of Experimental Tasks Scores

PubMed Central

Green, Samuel B.; Yang, Yanyun; Alt, Mary; Brinkley, Shara; Gray, Shelley; Hogan, Tiffany; Cowan, Nelson

2017-01-01

Reliabilities of scores for experimental tasks are likely to differ from one study to another to the extent that the task stimuli change, the number of trials varies, the type of individuals taking the task changes, the administration conditions are altered, or the focal task variable differs. Given reliabilities vary as a function of the design of these tasks and the characteristics of the individuals taking them, making inferences about the reliability of scores in an ongoing study based on reliability estimates from prior studies is precarious. Thus, it would be advantageous to estimate reliability based on data from the ongoing study. We argue that internal consistency estimates of reliability are underutilized for experimental task data and in many applications could provide this information using a single administration of a task. We discuss different methods for computing internal consistency estimates with a generalized coefficient alpha and the conditions under which these estimates are accurate. We illustrate use of these coefficients using data for three different tasks. PMID:26546100

Delimiting Coefficient a from Internal Consistency and Unidimensionality

ERIC Educational Resources Information Center

Sijtsma, Klaas

2015-01-01

I discuss the contribution by Davenport, Davison, Liou, & Love (2015) in which they relate reliability represented by coefficient a to formal definitions of internal consistency and unidimensionality, both proposed by Cronbach (1951). I argue that coefficient a is a lower bound to reliability and that concepts of internal consistency and…

Reliability of Measurement of Glenohumeral Internal Rotation, External Rotation, and Total Arc of Motion in 3 Test Positions

PubMed Central

Kevern, Mark A.; Beecher, Michael; Rao, Smita

2014-01-01

Context: Athletes who participate in throwing and racket sports consistently demonstrate adaptive changes in glenohumeral-joint internal and external rotation in the dominant arm. Measurements of these motions have demonstrated excellent intrarater and poor interrater reliability. Objective: To determine intrarater reliability, interrater reliability, and standard error of measurement for shoulder internal rotation, external rotation, and total arc of motion using an inclinometer in 3 testing procedures in National Collegiate Athletic Association Division I baseball and softball athletes. Design: Cross-sectional study. Setting: Athletic department. Patients or Other Participants Thirty-eight players participated in the study. Shoulder internal rotation, external rotation, and total arc of motion were measured by 2 investigators in 3 test positions. The standard supine position was compared with a side-lying test position, as well as a supine test position without examiner overpressure. Results: Excellent intrarater reliability was noted for all 3 test positions and ranges of motion, with intraclass correlation coefficient values ranging from 0.93 to 0.99. Results for interrater reliability were less favorable. Reliability for internal rotation was highest in the side-lying position (0.68) and reliability for external rotation and total arc was highest in the supine-without-overpressure position (0.774 and 0.713, respectively). The supine-with-overpressure position yielded the lowest interrater reliability results in all positions. The side-lying position had the most consistent results, with very little variation among intraclass correlation coefficient values for the various test positions. Conclusions: The results of our study clearly indicate that the side-lying test procedure is of equal or greater value than the traditional supine-with-overpressure method. PMID:25188316

[The reliability of a questionnaire regarding Colombian children's physical activity].

PubMed

Herazo-Beltrán, Aliz Y; Domínguez-Anaya, Regina

2012-10-01

Reporting the Physical Activity Questionnaire for school children's (PAQ-C) test-retest reliability and internal consistency. This was a descriptive study of 100 school-aged children aged 9 to 11 years old attending a school in Cartagena, Colombia. The sample was randomly selected. The PAQ-C was given twice, one week apart, after the informed consent forms had been signing by the children's parents and school officials. Cronbach's alpha coefficient of reliability was used for assessing internal consistency and an intra-class correlation coefficient for test-retest reliability SPSS (version 17.0) was used for statistical analysis. The questionnaire scored 0.73 internal consistencies during the first measurement and 0.78 on the second; intra-class correlation coefficient was 0.60. There were differences between boys and girls regarding both measurements. The PAQ-C had acceptable internal consistency and test-retest reliability, thereby making it useful for measuring children's self-reported physical activity and a valuable tool for population studies in Colombia.

Validation of the Italian Version of the Caregiver Abuse Screen among Family Caregivers of Older People with Alzheimer's Disease.

PubMed

Melchiorre, Maria Gabriella; Di Rosa, Mirko; Barbabella, Francesco; Barbini, Norma; Lattanzio, Fabrizia; Chiatti, Carlos

2017-01-01

Introduction . Elder abuse is often a hidden phenomenon and, in many cases, screening practices are difficult to implement among older people with dementia. The Caregiver Abuse Screen (CASE) is a useful tool which is administered to family caregivers for detecting their potential abusive behavior. Objectives . To validate the Italian version of the CASE tool in the context of family caregiving of older people with Alzheimer's disease (AD) and to identify risk factors for elder abuse in Italy. Methods . The CASE test was administered to 438 caregivers, recruited in the Up-Tech study. Validity and reliability were evaluated using Spearman's correlation coefficients, principal-component analysis, and Cronbach's alphas. The association between the CASE and other variables potentially associated with elder abuse was also analyzed. Results . The factor analysis suggested the presence of a single factor, with a strong internal consistency (Cronbach's alpha = 0.86). CASE score was strongly correlated with well-known risk factors of abuse. At multivariate level, main factors associated with CASE total score were caregiver burden and AD-related behavioral disturbances. Conclusions . The Italian version of the CASE is a reliable and consistent screening tool for tackling the risk of being or becoming perpetrators of abuse by family caregivers of people with AD.

The Stigma Resistance Scale: A multi-sample validation of a new instrument to assess mental illness stigma resistance.

PubMed

Firmin, Ruth L; Lysaker, Paul H; McGrew, John H; Minor, Kyle S; Luther, Lauren; Salyers, Michelle P

2017-12-01

Although associated with key recovery outcomes, stigma resistance remains under-studied largely due to limitations of existing measures. This study developed and validated a new measure of stigma resistance. Preliminary items, derived from qualitative interviews of people with lived experience, were pilot tested online with people self-reporting a mental illness diagnosis (n = 489). Best performing items were selected, and the refined measure was administered to an independent sample of people with mental illness at two state mental health consumer recovery conferences (n = 202). Confirmatory factor analyses (CFA) guided by theory were used to test item fit, correlations between the refined stigma resistance measure and theoretically relevant measures were examined for validity, and test-retest correlations of a subsample were examined for stability. CFA demonstrated strong fit for a 5-factor model. The final 20-item measure demonstrated good internal consistency for each of the 5 subscales, adequate test-retest reliability at 3 weeks, and strong construct validity (i.e., positive associations with quality of life, recovery, and self-efficacy, and negative associations with overall symptoms, defeatist beliefs, and self-stigma). The new measure offers a more reliable and nuanced assessment of stigma resistance. It may afford greater personalization of interventions targeting stigma resistance. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation of the Italian Version of the Caregiver Abuse Screen among Family Caregivers of Older People with Alzheimer's Disease

PubMed Central

Di Rosa, Mirko; Barbabella, Francesco; Barbini, Norma; Chiatti, Carlos

2017-01-01

Introduction. Elder abuse is often a hidden phenomenon and, in many cases, screening practices are difficult to implement among older people with dementia. The Caregiver Abuse Screen (CASE) is a useful tool which is administered to family caregivers for detecting their potential abusive behavior. Objectives. To validate the Italian version of the CASE tool in the context of family caregiving of older people with Alzheimer's disease (AD) and to identify risk factors for elder abuse in Italy. Methods. The CASE test was administered to 438 caregivers, recruited in the Up-Tech study. Validity and reliability were evaluated using Spearman's correlation coefficients, principal-component analysis, and Cronbach's alphas. The association between the CASE and other variables potentially associated with elder abuse was also analyzed. Results. The factor analysis suggested the presence of a single factor, with a strong internal consistency (Cronbach's alpha = 0.86). CASE score was strongly correlated with well-known risk factors of abuse. At multivariate level, main factors associated with CASE total score were caregiver burden and AD-related behavioral disturbances. Conclusions. The Italian version of the CASE is a reliable and consistent screening tool for tackling the risk of being or becoming perpetrators of abuse by family caregivers of people with AD. PMID:28265571

The Psychometric Properties of the Center for Epidemiologic Studies Depression Scale in Chinese Primary Care Patients: Factor Structure, Construct Validity, Reliability, Sensitivity and Responsiveness.

PubMed

Chin, Weng Yee; Choi, Edmond P H; Chan, Kit T Y; Wong, Carlos K H

2015-01-01

The Center for Epidemiologic Studies Depression Scale (CES-D) is a commonly used instrument to measure depressive symptomatology. Despite this, the evidence for its psychometric properties remains poorly established in Chinese populations. The aim of this study was to validate the use of the CES-D in Chinese primary care patients by examining factor structure, construct validity, reliability, sensitivity and responsiveness. The psychometric properties were assessed amongst a sample of 3686 Chinese adult primary care patients in Hong Kong. Three competing factor structure models were examined using confirmatory factor analysis. The original CES-D four-structure model had adequate fit, however the data was better fit into a bi-factor model. For the internal construct validity, corrected item-total correlations were 0.4 for most items. The convergent validity was assessed by examining the correlations between the CES-D, the Patient Health Questionnaire 9 (PHQ-9) and the Short Form-12 Health Survey (version 2) Mental Component Summary (SF-12 v2 MCS). The CES-D had a strong correlation with the PHQ-9 (coefficient: 0.78) and SF-12 v2 MCS (coefficient: -0.75). Internal consistency was assessed by McDonald's omega hierarchical (ωH). The ωH value for the general depression factor was 0.855. The ωH values for "somatic", "depressed affect", "positive affect" and "interpersonal problems" were 0.434, 0.038, 0.738 and 0.730, respectively. For the two-week test-retest reliability, the intraclass correlation coefficient was 0.91. The CES-D was sensitive in detecting differences between known groups, with the AUC >0.7. Internal responsiveness of the CES-D to detect positive and negative changes was satisfactory (with p value <0.01 and all effect size statistics >0.2). The CES-D was externally responsive, with the AUC>0.7. The CES-D appears to be a valid, reliable, sensitive and responsive instrument for screening and monitoring depressive symptoms in adult Chinese primary care patients. In its original four-factor and bi-factor structure, the CES-D is supported for cross-cultural comparisons of depression in multi-center studies.

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

Head and neck cancer-specific quality of life: instrument validation.

PubMed

Terrell, J E; Nanavati, K A; Esclamado, R M; Bishop, J K; Bradford, C R; Wolf, G T

1997-10-01

The disfigurement and dysfunction associated with head and neck cancer affect emotional well-being and some of the most basic functions of life. Most cancer-specific quality-of-life assessments give a single composite score for head and neck cancer-related quality of life. To develop and evaluate an improved multidimensional instrument to assess head and neck cancer-related functional status and well-being. The item selection process included literature review, interviews with health care workers, and patient surveys. A survey with 37 disease-specific questions and the SF-12 survey were administered to 253 patients in 3 large medical centers. Factor analysis was performed to identify disease-specific domains. Domain scores were calculated as the standardized score of the component items. These domains were assessed for construct validity based on clinical hypotheses and test-retest reliability. Four relevant domains were identified: Eating (6 items), Communication (4 items), Pain (4 items), and Emotion (6 items). Each had an internal consistency (Cronbach alpha value) of greater than 0.80. Construct validity was demonstrated by moderate correlations with the SF-12 Physical and Mental component scores (r=0.43-0.60). Test-retest reliability for each domain demonstrated strong reliability between the 2 time points. Correlations were strong for each individual question, ranging from 0.53 to 0.93. Construct validity testing demonstrated that the direction of differences for each domain were as hypothesized. The Head and Neck Quality of Life questionnaire is a promising multidimensional tool with which to assess head and neck cancer-specific quality of life.

Relapse Risk Assessment for Schizophrenia Patients (RASP): A New Self-Report Screening Tool.

PubMed

Velligan, Dawn; Carpenter, William; Waters, Heidi C; Gerlanc, Nicole M; Legacy, Susan N; Ruetsch, Charles

2018-01-01

The Relapse Assessment for Schizophrenia Patients (RASP) was developed as a six-question self-report screener that measures indicators of Increased Anxiety and Social Isolation to assess patient stability and predict imminent relapse. This paper describes the development and psychometric characteristics of the RASP. The RASP and Positive and Negative Syndrome Scale (PANSS) were administered to patients with schizophrenia (n=166) three separate times. Chart data were collected on a subsample of patients (n=81). Psychometric analyses of RASP included tests of reliability, construct validity, and concurrent validity of items. Factors from RASP were correlated with subscales from PANSS (sensitivity to change and criterion validity [agreement between RASP and evidence of relapse]). Test-retest reliability returned modest to strong agreement at the item level and strong agreement at the questionnaire level. RASP showed good item response curves and internal consistency for the total instrument and within each of the two subscales (Increased Anxiety and Social Isolation). RASP Total Score and subscales showed good concurrent validity when correlated with PANSS Total Score, Positive, Excitement, and Anxiety subscales. RASP correctly predicted relapse in 67% of cases, with good specificity and negative predictive power and acceptable positive predictive power and sensitivity. The reliability and validity data presented support the use of RASP in settings where addition of a brief self-report assessment of relapse risk among patients with schizophrenia may be of benefit. Ease of use and scoring, and the ability to administer without clinical supervision allows for routine administration and assessment of relapse risk.

A reliability generalization meta-analysis of coefficient alpha and test-retest coefficient for the aging males' symptoms (AMS) scale.

PubMed

Lee, Chin-Pang; Chiu, Yu-Wen; Chu, Chun-Lin; Chen, Yu; Jiang, Kun-Hao; Chen, Jiun-Liang; Chen, Ching-Yen

2016-12-01

The aging males' symptoms (AMS) scale is an instrument used to determine the health-related quality of life in adult and elderly men. The purpose of this study was to synthesize internal consistency (Cronbach's alpha) and test-retest reliability for the AMS scale and its three subscales. Of the 123 studies reviewed, 12 provided alpha coefficients which were then used in the meta-analyses of internal consistency. Seven of the 12 included studies provided test-retest coefficients, and these were used in the meta-analyses of test-retest reliability. The AMS scale had excellent internal consistency [α = 0.89 (95% CI 0.88-0.90)]; the mean alpha estimates across the AMS subscales ranged from 0.79 to 0.82. The AMS scale also had good test-retest reliability [r = 0.85 (95% CI 0.82-0.88]; the test-retest reliability coefficients of the AMS subscales ranged from 0.76 to 0.83. There was significant heterogeneity among the included studies. The AMS scale and the three subscales had fairly good internal consistency and test-retest reliability. Future psychometric studies of the AMS scale should report important characteristics of the participants, details of item scores, and test-retest reliability.

Evaluation of Dimensionality in the Assessment of Internal Consistency Reliability: Coefficient Alpha and Omega Coefficients

ERIC Educational Resources Information Center

Green, Samuel B.; Yang, Yanyun

2015-01-01

In the lead article, Davenport, Davison, Liou, & Love demonstrate the relationship among homogeneity, internal consistency, and coefficient alpha, and also distinguish among them. These distinctions are important because too often coefficient alpha--a reliability coefficient--is interpreted as an index of homogeneity or internal consistency.…

Measuring Critical Care Providers' Attitudes About Controlled Donation After Circulatory Death.

PubMed

Rodrigue, James R; Luskin, Richard; Nelson, Helen; Glazier, Alexandra; Henderson, Galen V; Delmonico, Francis L

2018-06-01

Unfavorable attitudes and insufficient knowledge about donation after cardiac death among critical care providers can have important consequences for the appropriate identification of potential donors, consistent implementation of donation after cardiac death policies, and relative strength of support for this type of donation. The lack of reliable and valid assessment measures has hampered research to capture providers' attitudes. Design and Research Aims: Using stakeholder engagement and an iterative process, we developed a questionnaire to measure attitudes of donation after cardiac death in critical care providers (n = 112) and examined its psychometric properties. Exploratory factor analysis, internal consistency, and validity analyses were conducted to examine the measure. A 34-item questionnaire consisting of 4 factors (Personal Comfort, Process Satisfaction, Family Comfort, and System Trust) provided the most parsimonious fit. Internal consistency was acceptable for each of the subscales and the total questionnaire (Cronbach α > .70). A strong association between more favorable attitudes overall and knowledge ( r = .43, P < .001) provides evidence of convergent validity. Multivariable regression analyses showed that white race ( P = .002) and more experience with donation after cardiac death ( P < .001) were significant predictors of more favorable attitudes. Study findings support the utility, reliability, and validity of a questionnaire for measuring attitudes in critical care providers and for isolating targets for additional education on donation after cardiac death.

Residual stresses in a stainless steel - titanium alloy joint made with the explosive technique

NASA Astrophysics Data System (ADS)

Taran, Yu V.; Balagurov, A. M.; Sabirov, B. M.; Evans, A.; Davydov, V.; Venter, A. M.

2012-02-01

Joining of pipes from stainless steel (SS) and titanium (Ti) alloy still experience serious technical problems. Recently, reliable and hermetic joining of SS and Ti pipes has been achieved with the explosive bonding technique in the Russian Federal Nuclear Center. Such adapters are earmarked for use at the future International Linear Collider. The manufactured SS-Ti adapters have excellent mechanical behavior at room and liquid nitrogen temperatures, during high-pressure tests and thermal cycling. We here report the first neutron diffraction investigation of the residual stresses in a SS-Ti adapter on the POLDI instrument at the SINQ spallation source. The strain scanning across the adapter walls into the SS-SS and SS-Ti pipes sections encompassed measurement of the axial, radial and hoop strain components, which were transformed into residual stresses. The full stress information was successfully determined for the three steel pipes involved in the joint. The residual stresses do not exceed 300 MPa in magnitude. All stress components have tensile values close to the adapter internal surface, whilst they are compressive close to the outer surface. The strong incoherent and weak coherent neutron scattering cross-sections of Ti did not allow for the reliable determination of stresses inside the titanic pipe.

Mental Illness Stigma Expressed by Police to Police.

PubMed

Stuart, Heather

2017-01-01

This paper describes mental health related stigma expressed by police to police using a newly developed 11-item Police Officer Stigma Scale and reports on the preliminary psychometric properties (factor structure and internal reliability) of this scale. The scale used an indirect measurement approach adapted from the Perceived Devaluation and Discrimination Scale. Five themes appropriate to police culture were adapted and six additional items were added. Responses were rated on a 5-point agreement scale with an additional don't know option. Data were collected from officers attending a mandatory workshop (90.5% response). Exploratory factor analysis showed the scale to be unidimensional and internally reliable (Cronbach's alpha was 0.82). The most endorsed items pertained to avoiding disclosure to a supervisor/manager or to a colleague (85% agreement), that most officers would expect discrimination at work (62%), and that most officers would not want a supervisor or manager who had a mental illness (62%). Findings highlight that (a) Police-to-police mental illness stigma may be a particularly strong feature of police cultures; (b) police should be a focus for targeted anti-stigma interventions; and (c) though further psychometric testing is needed, the Police Office Stigma Scale may provide important insights into the nature and functioning of police-to-police stigma in police cultures in future research.

The Pittsburgh sleep quality index as a screening tool for sleep dysfunction in clinical and non-clinical samples: A systematic review and meta-analysis.

PubMed

Mollayeva, Tatyana; Thurairajah, Pravheen; Burton, Kirsteen; Mollayeva, Shirin; Shapiro, Colin M; Colantonio, Angela

2016-02-01

This review appraises the process of development and the measurement properties of the Pittsburgh sleep quality index (PSQI), gauging its potential as a screening tool for sleep dysfunction in non-clinical and clinical samples; it also compares non-clinical and clinical populations in terms of PSQI scores. MEDLINE, Embase, PsycINFO, and HAPI databases were searched. Critical appraisal of studies of measurement properties was performed using COSMIN. Of 37 reviewed studies, 22 examined construct validity, 19 - known-group validity, 15 - internal consistency, and three - test-retest reliability. Study quality ranged from poor to excellent, with the majority designated fair. Internal consistency, based on Cronbach's alpha, was good. Discrepancies were observed in factor analytic studies. In non-clinical and clinical samples with known differences in sleep quality, the PSQI global scores and all subscale scores, with the exception of sleep disturbance, differed significantly. The best evidence synthesis for the PSQI showed strong reliability and validity, and moderate structural validity in a variety of samples, suggesting the tool fulfills its intended utility. A taxonometric analysis can contribute to better understanding of sleep dysfunction as either a dichotomous or continuous construct. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Psychometric Evaluation of the Santa Clara Strength of Religious Faith Questionnaire among Students from Poland and Chile.

PubMed

Wnuk, Marcin

2017-01-01

This study verifies the psychometric properties of the Santa Clara Strength of Religious Faith Questionnaire (SCSORFQ). This measure consists of 10 items regarding strength of religious faith, regardless of religious denomination or affiliation. Participants were 177 students from Chile and 393 students from Poland. The SCSORFQ method is a reliable measure with good internal consistency evaluated by the α-Cronbach coefficient. Factor analysis statistically confirmed the unidimensional structure of the SCSORFQ. The strength of religious faith in both student groups was moderate to strong correlated with public or private aspects of religiousness and strong correlated with spiritual experiences. It was weakly correlated with the cognitive indicator of well-being as satisfaction with life as well as with existential variables like hope and meaning of life. The results confirm that the SCSORFQ is psychometrically sound and is therefore recommended for use by researchers studying the construct of religiousness.

Internalized HIV Stigma and Disclosure Concerns: Development and Validation of Two Scales in Spanish-Speaking Populations.

PubMed

Hernansaiz-Garrido, Helena; Alonso-Tapia, Jesús

2017-01-01

Internalized stigma and disclosure concerns are key elements for the study of mental health in people living with HIV. Since no measures of these constructs were available for Spanish population, this study sought to develop such instruments, to analyze their reliability and validity and to provide a short version. A heterogeneous sample of 458 adults from different Spanish-speaking countries completed the HIV-Internalized Stigma Scale and the HIV-Disclosure Concerns Scale, along with the Hospital Anxiety and Depression Scale, Rosenberg's Self-esteem Scale and other socio-demographic variables. Reliability and correlation analyses, exploratory factor analyses, path analyses with latent variables, and ANOVAs were conducted to test the scales' psychometric properties. The scales showed good reliability in terms of internal consistency and temporal stability, as well as good sensitivity and factorial and criterion validity. The HIV-Internalized Stigma Scale and the HIV-Disclosure Concerns Scale are reliable and valid means to assess these variables in several contexts.

Emergency department triage scales and their components: a systematic review of the scientific evidence.

PubMed

Farrohknia, Nasim; Castrén, Maaret; Ehrenberg, Anna; Lind, Lars; Oredsson, Sven; Jonsson, Håkan; Asplund, Kjell; Göransson, Katarina E

2011-06-30

Emergency department (ED) triage is used to identify patients' level of urgency and treat them based on their triage level. The global advancement of triage scales in the past two decades has generated considerable research on the validity and reliability of these scales. This systematic review aims to investigate the scientific evidence for published ED triage scales. The following questions are addressed: 1. Does assessment of individual vital signs or chief complaints affect mortality during the hospital stay or within 30 days after arrival at the ED?2. What is the level of agreement between clinicians' triage decisions compared to each other or to a gold standard for each scale (reliability)? 3. How valid is each triage scale in predicting hospitalization and hospital mortality? A systematic search of the international literature published from 1966 through March 31, 2009 explored the British Nursing Index, Business Source Premier, CINAHL, Cochrane Library, EMBASE, and PubMed. Inclusion was limited to controlled studies of adult patients (≥ 15 years) visiting EDs for somatic reasons. Outcome variables were death in ED or hospital and need for hospitalization (validity). Methodological quality and clinical relevance of each study were rated as high, medium, or low. The results from the studies that met the inclusion criteria and quality standards were synthesized applying the internationally developed GRADE system. Each conclusion was then assessed as having strong, moderately strong, limited, or insufficient scientific evidence. If studies were not available, this was also noted.We found ED triage scales to be supported, at best, by limited and often insufficient evidence.The ability of the individual vital signs included in the different scales to predict outcome is seldom, if at all, studied in the ED setting. The scientific evidence to assess interrater agreement (reliability) was limited for one triage scale and insufficient or lacking for all other scales. Two of the scales yielded limited scientific evidence, and one scale yielded insufficient evidence, on which to assess the risk of early death or hospitalization in patients assigned to the two lowest triage levels on a 5-level scale (validity).

Emergency Department Triage Scales and Their Components: A Systematic Review of the Scientific Evidence

PubMed Central

2011-01-01

Emergency department (ED) triage is used to identify patients' level of urgency and treat them based on their triage level. The global advancement of triage scales in the past two decades has generated considerable research on the validity and reliability of these scales. This systematic review aims to investigate the scientific evidence for published ED triage scales. The following questions are addressed: 1. Does assessment of individual vital signs or chief complaints affect mortality during the hospital stay or within 30 days after arrival at the ED? 2. What is the level of agreement between clinicians' triage decisions compared to each other or to a gold standard for each scale (reliability)? 3. How valid is each triage scale in predicting hospitalization and hospital mortality? A systematic search of the international literature published from 1966 through March 31, 2009 explored the British Nursing Index, Business Source Premier, CINAHL, Cochrane Library, EMBASE, and PubMed. Inclusion was limited to controlled studies of adult patients (≥15 years) visiting EDs for somatic reasons. Outcome variables were death in ED or hospital and need for hospitalization (validity). Methodological quality and clinical relevance of each study were rated as high, medium, or low. The results from the studies that met the inclusion criteria and quality standards were synthesized applying the internationally developed GRADE system. Each conclusion was then assessed as having strong, moderately strong, limited, or insufficient scientific evidence. If studies were not available, this was also noted. We found ED triage scales to be supported, at best, by limited and often insufficient evidence. The ability of the individual vital signs included in the different scales to predict outcome is seldom, if at all, studied in the ED setting. The scientific evidence to assess interrater agreement (reliability) was limited for one triage scale and insufficient or lacking for all other scales. Two of the scales yielded limited scientific evidence, and one scale yielded insufficient evidence, on which to assess the risk of early death or hospitalization in patients assigned to the two lowest triage levels on a 5-level scale (validity). PMID:21718476

Predictive validity of a selection centre testing non-technical skills for recruitment to training in anaesthesia.

PubMed

Gale, T C E; Roberts, M J; Sice, P J; Langton, J A; Patterson, F C; Carr, A S; Anderson, I R; Lam, W H; Davies, P R F

2010-11-01

Assessment centres are an accepted method of recruitment in industry and are gaining popularity within medicine. We describe the development and validation of a selection centre for recruitment to speciality training in anaesthesia based on an assessment centre model incorporating the rating of candidate's non-technical skills. Expert consensus identified non-technical skills suitable for assessment at the point of selection. Four stations-structured interview, portfolio review, presentation, and simulation-were developed, the latter two being realistic scenarios of work-related tasks. Evaluation of the selection centre focused on applicant and assessor feedback ratings, inter-rater agreement, and internal consistency reliability coefficients. Predictive validity was sought via correlations of selection centre scores with subsequent workplace-based ratings of appointed trainees. Two hundred and twenty-four candidates were assessed over two consecutive annual recruitment rounds; 68 were appointed and followed up during training. Candidates and assessors demonstrated strong approval of the selection centre with more than 70% of ratings 'good' or 'excellent'. Mean inter-rater agreement coefficients ranged from 0.62 to 0.77 and internal consistency reliability of the selection centre score was high (Cronbach's α=0.88-0.91). The overall selection centre score was a good predictor of workplace performance during the first year of appointment. An assessment centre model based on the rating of non-technical skills can produce a reliable and valid selection tool for recruitment to speciality training in anaesthesia. Early results on predictive validity are encouraging and justify further development and evaluation.

An anatomical subunit-based outcome assessment scale for bilateral cleft lip and palate.

PubMed

Bonanthaya, K; Shetty, P N; Fudalej, P S; Rao, D D; Bitra, S; Pabari, M; Rachwalski, M

2017-08-01

As there is currently no internationally accepted outcome measurement tool available for complete bilateral cleft lip and palate (CBCLP), the goal of this prospective study was to develop a numerical evaluation scale that allows reliable scoring of this cleft deformity. Our cohort comprised 121 Indian subjects with CBCLP who underwent surgical repair (mean age at time of surgery 6.53 months) using a modified Millard technique. A panel of three professionals evaluated each subject's outcome of bilateral cleft lip repair 6 months postoperatively on two-dimensional (2D) full-face photographs in the frontal view and worm's eye view. A simple two-point rating system was applied to separately analyse a total of 12 components of lip, nose, and scar. The results and mean scores for the analysed anatomical areas were 2.2±1.01 (max=3) for nose, 5.4±1.54 (max=8) for lip, and 1.9±1.3 (max=3) for scar, with a total score 7.7±2.21 (max=12) indicating a good surgical outcome. The inter-examiner ICC for nose, lip, scar, and total score was calculated at 0.836, 0.889, 0.723, and 0.927 respectively and indicated a strong level of repeatability and reliability that was highly significant (P<0.001). In conclusion, we were able to develop and test a scoring system for measuring outcomes in CBCLP that warrants simplicity of use, reliability and reproducibility. Copyright © 2017 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Validation of the comprehensive feeding practices questionnaire in parents of preschool children in Brazil.

PubMed

Warkentin, Sarah; Mais, Laís Amaral; Latorre, Maria do Rosário Dias de Oliveira; Carnell, Susan; Taddei, José Augusto de Aguiar Carrazedo

2016-07-19

Recent national surveys in Brazil have demonstrated a decrease in the consumption of traditional food and a parallel increase in the consumption of ultra-processed food, which has contributed to a rise in obesity prevalence in all age groups. Environmental factors, especially familial factors, have a strong influence on the food intake of preschool children, and this has led to the development of psychometric scales to measure parents' feeding practices. The aim of this study was to test the validity of a translated and adapted Comprehensive Feeding Practices Questionnaire in a sample of Brazilian preschool-aged children enrolled in private schools. A transcultural adaptation process was performed in order to develop a modified questionnaire (43 items). After piloting, the questionnaire was sent to parents, along with additional questions about family characteristics. Test-retest reliability was assessed in one of the schools. Factor analysis with oblique rotation was performed. Internal reliability was tested using Cronbach's alpha and correlations between factors, discriminant validity using marker variables of child's food intake, and convergent validity via correlations with parental perceptions of perceived responsibility for feeding and concern about the child's weight were also performed. The final sample consisted of 402 preschool children. Factor analysis resulted in a final questionnaire of 43 items distributed over 6 factors. Cronbach alpha values were adequate (0.74 to 0.88), between-factor correlations were low, and discriminant validity and convergent validity were acceptable. The modified CFPQ demonstrated significant internal reliability in this urban Brazilian sample. Scale validation within different cultures is essential for a more comprehensive understanding of parental feeding practices for preschoolers.

How reliable and valid is the teacher version of the Strengths and Difficulties Questionnaire in primary school children?

PubMed Central

van den Heuvel, Meta; Jansen, Danielle E. M. C.; Stewart, Roy E.; Smits-Engelsman, Bouwien C. M.; Reijneveld, Sijmen A.; Flapper, Boudien C. T.

2017-01-01

Introduction The Strengths and Difficulties Questionnaire (SDQ) is validated for parents, but not yet for teachers in a broad age range of children. We conducted a cross-sectional study with 4–10 years old school children to investigate if the SDQ-T can be used instead of the validated but lengthy Teacher’s Report Form (TRF) to acquire information about emotional and behavioral problems in the school community. Methods Teachers of 453 children from primary schools were approached. Teachers of 394 children (response rate 86.9%) with a mean age of 7.1 years filled in the SDQ-T (n = 387), the TRF (n = 349) or both (n = 342). We assessed reliability by calculating internal consistency and concurrent validity (using correlation coefficients, sensitivity, specificity) of the SDQ-T compared with the TRF. Results Internal consistency of the SDQ-T Total Difficulties Score (SDQ-T TDS; Cronbach α = 0.80), hyperactivity/ inattention- (α = 0.86) and prosocial behavior (α = 0.81) was very good. Concurrent validity demonstrated a strong correlation of all subscales of the SDQ-T with the corresponding scale on the TRF (range 0.54–0.73), except for peer problems (0.46). Using a SDQ-T TDS cut-off score > 14, the SDQ-T had a good sensitivity (90%) and specificity (94%). Discussion The good reliability, validity and brevity of the SDQ-T make it an easily applicable questionnaire for obtaining information about emotional and behavioral problems from teachers in primary school children. PMID:28453573

Measuring patient activation in The Netherlands: translation and validation of the American short form Patient Activation Measure (PAM13).

PubMed

Rademakers, Jany; Nijman, Jessica; van der Hoek, Lucas; Heijmans, Monique; Rijken, Mieke

2012-07-31

The American short form Patient Activation Measure (PAM) is a 13-item instrument which assesses patient (or consumer) self-reported knowledge, skills and confidence for self-management of one's health or chronic condition. In this study the PAM was translated into a Dutch version; psychometric properties of the Dutch version were established and the instrument was validated in a panel of chronically ill patients. The translation was done according to WHO guidelines. The PAM 13-Dutch was sent to 4178 members of the Dutch National Panel of people with Chronic illness or Disability (NPCD) in April 2010 (study A) and again to a sub sample of this group (N = 973) in June 2010 (study B). Internal consistency, test-retest reliability and cross-validation with the SBSQ-D (a measure for Health literacy) were computed. The Dutch results were compared to similar Danish and American data. The psychometric properties of the PAM 13-Dutch were generally good. The level of internal consistency is good (α = 0.88) and item-rest correlations are moderate to strong. The Dutch mean PAM score (61.3) is comparable to the American (61.9) and lower than the Danish (64.2). The test-retest reliability was moderate. The association with Health literacy was weak to moderate. The PAM-13 Dutch is a reliable instrument to measure patient activation. More research is needed into the validity of the Patient Activation Measure, especially with respect to a more comprehensive measure of Health literacy.

The Deaf Acculturation Scale (DAS): Development and Validation of a 58-Item Measure

PubMed Central

Maxwell-McCaw, Deborah; Zea, Maria Cecilia

2011-01-01

This study involved the development and validation of the Deaf Acculturation Scale (DAS), a new measure of cultural identity for Deaf and hard-of-hearing (hh) populations. Data for this study were collected online and involved a nation-wide sample of 3,070 deaf/hh individuals. Results indicated strong internal reliabilities for all the subscales, and construct validity was established by demonstrating that the DAS could discriminate groups based on parental hearing status, school background, and use of self-labels. Construct validity was further demonstrated through factorial analyses, and findings resulted in a final 58-item measure. Directions for future research are discussed. PMID:21263041

A Persian-version of the stuttering severity instrument-version four (SSI-4): How the new additions to SSI-4 complement its stuttering severity score?

PubMed

Tahmasebi, Neda; Shafie, Bijan; Karimi, Hamid; Mazaheri, Masood

The fourth version of the Stuttering Severity Instrument (SSI-4) has been available since 2009. It has some modifications and new features which make it more appropriate at least for clinical practice, although further documentation is needed. The objective of the current research was to translate SSI-4 into Persian language and to discuss its relative and absolute reliability as well as its criterion validity for Persian adults who stutter (PWS). We also aimed to study how the new subjective self-reports of the SSI-4 complement the stuttering severity score obtained from the SSI-3 or the SSI-4. The cross-cultural guideline recommended by the International Quality of Life Assessment project was used to translate the SSI-4 into Persian language. Thirty five PWS from ages 17 to 42 were recruited and 10 speech and language pathologists assessed their stuttering severity using either the SSI-4 or stuttering severity ratings (SR) to test validity and reliability of the Persian translated version. A very high inter-judge relative reliability along with a poor absolute inter-judge reliability was found for the SSI-4 scores. The results were more promising for the intra-judge absolute reliability. Test-retest reliability of the complementary questions to the SSI-4 was also found acceptable. However, no strong relationship was found between the SSI-4 scores and its complementary questions. The Persian version of the SSI-4 can be used reliably by trained SLPs for research and clinical purposes, but not to document small changes in stuttering severity. We argue that the response of participants to the complementary self-report questions should also be considered in calculating their stuttering severity score. Copyright © 2018 Elsevier Inc. All rights reserved.

Mental Illness Related Internalized Stigma: Psychometric Properties of the Brief ISMI Scale in Greece.

PubMed

Paraskevoulakou, Alexia; Vrettou, Kassiani; Pikouli, Katerina; Triantafillou, Evgenia; Lykou, Anastasia; Economou, Marina

2017-09-01

Since evaluation regarding the impact of mental illness related internalized stigma is scarce, there is a great need for psychometric instruments which could contribute to understanding its adverse effects among Greek patients with severe mental illness. The Brief Internalized Stigma of Mental Illness (ISMI) scale is one of the most widely used measures designed to assess the subjective experience of stigma related to mental illness. The present study aimed to investigate the psychometric properties of the Greek version of the Brief ISMI scale. In addition to presenting psychometric findings, we explored the relationship of the Greek version of the Brief ISMI subscales with indicators of self-esteem and quality of life. 272 outpatients (108 males, 164 females) meeting the DSM-IV TR criteria for severe mental disorder (schizophrenia, bipolar disorder, major depression) completed the Brief ISMI, the RSES and the WHOQOL-BREF scales. Patients reported age and educational level. A retest was conducted with 124 patients. The Chronbach's alpha coefficient was 0 0.83. The test-retest reliability coefficients varied from 0.81 to 0.91, indicating substantial agreement. The ICC was for the total score 0.83 and for the two factors, 0.69 and 0.77 respectively. Factor analysis provided strong evidence for a two factor model. Factors 1 and 2 were named respectively "how others view me" and "how I view myself". They were negatively correlated with both RSES and WHOQOL-BREF scales, as well as with educational level. Factor 2 was significantly associated with the type of diagnosis. The Greek version of the Brief ISMI scale can be used as a reliable and valid tool for assessing mental illness related internalized stigma among Greek patients with severe mental illness.

The MOVES (Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey): cross-cultural evaluation of the French version and additional psychometric assessment.

PubMed

Jalenques, Isabelle; Guiguet-Auclair, Candy; Derost, Philippe; Joubert, Pauline; Foures, Louis; Hartmann, Andreas; Muellner, Julia; Rondepierre, Fabien

2018-03-01

The Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey (MOVES) is a self-report scale suggested as a severity scale for tics and related sensory phenomena observed in Gilles de la Tourette syndrome (GTS) and recommended as a screening instrument by the Committee on Rating Scale Development of the International Parkinson's Disease and Movement Disorder Society. To cross-culturally adapt a French version of the MOVES and to evaluate its psychometric properties. After the cross-cultural adaptation of the MOVES, we assessed its psychometric properties in 53 patients aged 12-16 years and in 54 patients aged 16 years and above: reliability and construct validity (relationships between items and scales), internal consistency and concurrent validity with the Yale Global Tic Severity Scale (YGTSS) and the Children's Yale-Brown Obsessive-Compulsive Scale (CY-BOCS) or the auto-Yale-Brown scale. The results showed very good acceptability with response rates greater than 92%, good internal consistency (Cronbach's alpha ranging from 0.62 and 0.89) and good test-retest reliability (ICCs ranging from 0.59 to 0.91). Concurrent validity with the YGTSS, CY-BOCS and auto-Yale-Brown scales showed strong expected correlations. The cut-off points tested for diagnostic performance gave satisfactory values of sensitivity, specificity, and positive and negative predictive values. Our study provides evidence of the good psychometric properties of the French version of the MOVES. The cross-cultural adaptation of this specific instrument will allow investigators to include French-speaking persons with GTS aged 12 years and over in national and international collaboration research projects.

Reliability and Validity the Brief Problem Monitor, an Abbreviated Form of the Child Behavior Checklist

PubMed Central

Piper, Brian J.; Gray, Hilary M.; Raber, Jacob; Birkett, Melissa A.

2014-01-01

Aim The parent form of the 113 item Child Behavior Checklist (CBCL) is widely utilized by child psychiatrists and psychologists. This report examines the reliability and validity of a recently developed abbreviated version of the CBCL, the Brief Problem Monitor (BPM). Methods Caregivers (N=567) completed the CBCL online and the 19 BPM items were examined separately. Results Internal consistency of the BPM was high (Cronbach’s alpha=0.91) and satisfactory for the Internalizing (0.78), Externalizing (0.86), and Attention (0.87) scales. High correlations between the CBCL and BPM were identified for the total score (r=0.95) as well as the Internalizing (0.86), Externalizing (0.93), and Attention (0.97) scales. The BPM and scales were sensitive and identified significantly higher behavioral and emotional problems among children whose caregiver reported a psychiatric diagnosis of Attention Deficit Hyperactivity Disorder, bipolar, depression, anxiety, developmental disabilities, or Autism Spectrum Disorders relative to a comparison group that had not been diagnosed with these disorders. BPM ratings also differed by the socioeconomic status and education of the caregiver. Mothers with higher annual incomes rated their children as having 38.8% fewer total problems (Cohen’s d=0.62) as well as 42.8% lower Internalizing (d=0.53), 44.1% less Externalizing (d=0.62), and 30.9% decreased Attention (d=0.39). A similar pattern was evident for maternal education (d=0.30 to 0.65). Conclusion Overall, these findings provide strong psychometric support for the BPM although the differences based on the characteristics of the parent indicates that additional information from other sources (e.g., teachers) should be obtained to complement parental reports. PMID:24735087

Impact of Alzheimer's Disease on Caregiver Questionnaire: internal consistency, convergent validity, and test-retest reliability of a new measure for assessing caregiver burden.

PubMed

Cole, Jason C; Ito, Diane; Chen, Yaozhu J; Cheng, Rebecca; Bolognese, Jennifer; Li-McLeod, Josephine

2014-09-04

There is a lack of validated instruments to measure the level of burden of Alzheimer's disease (AD) on caregivers. The Impact of Alzheimer's Disease on Caregiver Questionnaire (IADCQ) is a 12-item instrument with a seven-day recall period that measures AD caregiver's burden across emotional, physical, social, financial, sleep, and time aspects. Primary objectives of this study were to evaluate psychometric properties of IADCQ administered on the Web and to determine most appropriate scoring algorithm. A national sample of 200 unpaid AD caregivers participated in this study by completing the Web-based version of IADCQ and Short Form-12 Health Survey Version 2 (SF-12v2™). The SF-12v2 was used to measure convergent validity of IADCQ scores and to provide an understanding of the overall health-related quality of life of sampled AD caregivers. The IADCQ survey was also completed four weeks later by a randomly selected subgroup of 50 participants to assess test-retest reliability. Confirmatory factor analysis (CFA) was implemented to test the dimensionality of the IADCQ items. Classical item-level and scale-level psychometric analyses were conducted to estimate psychometric characteristics of the instrument. Test-retest reliability was performed to evaluate the instrument's stability and consistency over time. Virtually none (2%) of the respondents had either floor or ceiling effects, indicating the IADCQ covers an ideal range of burden. A single-factor model obtained appropriate goodness of fit and provided evidence that a simple sum score of the 12 items of IADCQ can be used to measure AD caregiver's burden. Scales-level reliability was supported with a coefficient alpha of 0.93 and an intra-class correlation coefficient (for test-retest reliability) of 0.68 (95% CI: 0.50-0.80). Low-moderate negative correlations were observed between the IADCQ and scales of the SF-12v2. The study findings suggest the IADCQ has appropriate psychometric characteristics as a unidimensional, Web-based measure of AD caregiver burden and is supported by strong model fit statistics from CFA, high degree of item-level reliability, good internal consistency, moderate test-retest reliability, and moderate convergent validity. Additional validation of the IADCQ is warranted to ensure invariance between the paper-based and Web-based administration and to determine an appropriate responder definition.

Reliability and Validity of Athletes Disability Index Questionnaire.

PubMed

Noormohammadpour, Pardis; Hosseini Khezri, Alireza; Farahbakhsh, Farzin; Mansournia, Mohammad Ali; Smuck, Matthew; Kordi, Ramin

2018-03-01

The purpose of this study was to evaluate validity and reliability of a new proposed questionnaire for assessment of functional disability in athletes with low back pain (LBP). Validity and reliability study. Elite athletes participating in different fields of sports. Participants were 165 male and female athletes (between 12 and 50 years old) with LBP. Athlete Disability Index (ADI) Questionnaire which is developed by the authors for assessing LBP-related disability in athletes, Oswestry Disability Index (ODI), and the Roland-Morris Disability Questionnaire (RDQ). Self-reported responses were collected regarding LBP-related disability through ADI, ODI, and RDQ. The test-retest reliability was strong, and intraclass correlation value ranged between 0.74 and 0.94. The Cronbach alpha coefficient value of 0.91 (P < 0.001) demonstrated excellent internal consistency of the questionnaire. The correlation coefficient between ADI and ODI was r = 0.918 (P < 0.0001), between ADI and RDQ was r = 0.669 (P < 0.0001), and between ADI and visual analog scale was r = 0.626 (P < 0.001). According to ODI and RDQ, disability levels were mild in the large majority of subjects (91.5% and 86.0%, respectively). Alternatively, disability assessments by the ADI did not cluster at the mild level and ranged more broadly from mild to very high. The ADI is a reliable and valid instrument for assessing disability in athletes with LBP. Compared with the available LBP disability questionnaires used in the general population, ADI can more precisely stratify the disability levels of athletes due to LBP.

Development of the 3-SET 4P questionnaire for evaluating former ICU patients' physical and psychosocial problems over time: a pilot study.

PubMed

Akerman, Eva; Fridlund, Bengt; Ersson, Anders; Granberg-Axéll, Anetth

2009-04-01

Current studies reveal a lack of consensus for the evaluation of physical and psychosocial problems after ICU stay and their changes over time. The aim was to develop and evaluate the validity and reliability of a questionnaire for assessing physical and psychosocial problems over time for patients following ICU recovery. Thirty-nine patients completed the questionnaire, 17 were retested. The questionnaire was constructed in three sets: physical problems, psychosocial problems and follow-up care. Face and content validity were tested by nurses, researchers and patients. The questionnaire showed good construct validity in all three sets and had strong factor loadings (explained variance >70%, factor loadings >0.5) for all three sets. There was good concurrent validity compared with the SF 12 (r(s)>0.5). Internal consistency was shown to be reliable (Cronbach's alpha 0.70-0.85). Stability reliability on retesting was good for the physical and psychosocial sets (r(s)>0.5). The 3-set 4P questionnaire was a first step in developing an instrument for assessment of former ICU patients' problems over time. The sample size was small and thus, further studies are needed to confirm these findings.

Psychometric survey of nursing competences illustrated with nursing students and apprentices

PubMed

Reichardt, Christoph; Wernecke, Frances; Giesler, Marianne; Petersen-Ewert, Corinna

2016-09-01

Background: The term competences is discussed differently in various disciplines of science. Furthermore there is no international or discipline comprehensive accepted definition of this term. Problem: So far, there are few practical, reliable and valid measuring instruments for a survey of general nursing skills. This article describes the adaptation process of a measuring instrument for medical skills into one for nursing competences. Method: The measurement quality of the questionnaire was audited using a sample of two different courses of studies and regular nursing apprentices. Another research question focused whether the adapted questionnaire is able to detect a change of nursing skills. For the validation of reliability and validity data from the first point of measurement was used (n = 240). The data from the second point of measurement, which was conducted two years later (n = 163), were used to validate, whether the questionnaire is able to detect a change of nursing competences. Results/Conclusions: The results indicate that the adapted version of the questionnaire is reliable and valid. Also the questionnaire was able to detect significant, partly even strong, effects of change in nursing skills (d = 0,17 – 1,04). It was possible to adapt the questionnaire for the measurement of nursing competences.

Reliability of the Serbian version of the International Physical Activity Questionnaire for older adults.

PubMed

Milanović, Zoran; Pantelić, Saša; Trajković, Nebojša; Jorgić, Bojan; Sporiš, Goran; Bratić, Milovan

2014-01-01

The purpose of this study was to determine the test-retest reliability of the International Physical Activity Questionnaire (IPAQ) for older adults in Serbia. Six hundred and sixty older adults (352 men, 53%; 308 women, 47%; mean age 67.65±5.76 years) participated in the study. To examine test-retest reliability, the participants were asked to complete the IPAQ on two occasions 2 weeks apart. Moderate reliability was observed between the repeated IPAQ, with intraclass correlation coefficients ranging from 0.53 to 0.91. The least reliability was established in leisure time activity (0.53) and the most reliability in the transport domain (0.91). Men and women had similar intraclass correlation coefficients for total physical activity (0.71 versus 0.74, respectively), while the biggest difference was obtained for housework in men (0.68) and in women (0.90). Our study shows that the long version of the IPAQ is a reliable instrument for assessing physical activity levels in older adults and that it may be useful for generating internationally comparable data.

The Safety Culture Enactment Questionnaire (SCEQ): Theoretical model and empirical validation.

PubMed

de Castro, Borja López; Gracia, Francisco J; Tomás, Inés; Peiró, José M

2017-06-01

This paper presents the Safety Culture Enactment Questionnaire (SCEQ), designed to assess the degree to which safety is an enacted value in the day-to-day running of nuclear power plants (NPPs). The SCEQ is based on a theoretical safety culture model that is manifested in three fundamental components of the functioning and operation of any organization: strategic decisions, human resources practices, and daily activities and behaviors. The extent to which the importance of safety is enacted in each of these three components provides information about the pervasiveness of the safety culture in the NPP. To validate the SCEQ and the model on which it is based, two separate studies were carried out with data collection in 2008 and 2014, respectively. In Study 1, the SCEQ was administered to the employees of two Spanish NPPs (N=533) belonging to the same company. Participants in Study 2 included 598 employees from the same NPPs, who completed the SCEQ and other questionnaires measuring different safety outcomes (safety climate, safety satisfaction, job satisfaction and risky behaviors). Study 1 comprised item formulation and examination of the factorial structure and reliability of the SCEQ. Study 2 tested internal consistency and provided evidence of factorial validity, validity based on relationships with other variables, and discriminant validity between the SCEQ and safety climate. Exploratory Factor Analysis (EFA) carried out in Study 1 revealed a three-factor solution corresponding to the three components of the theoretical model. Reliability analyses showed strong internal consistency for the three scales of the SCEQ, and each of the 21 items on the questionnaire contributed to the homogeneity of its theoretically developed scale. Confirmatory Factor Analysis (CFA) carried out in Study 2 supported the internal structure of the SCEQ; internal consistency of the scales was also supported. Furthermore, the three scales of the SCEQ showed the expected correlation patterns with the measured safety outcomes. Finally, results provided evidence of discriminant validity between the SCEQ and safety climate. We conclude that the SCEQ is a valid, reliable instrument supported by a theoretical framework, and it is useful to measure the enactment of safety culture in NPPs. Copyright © 2017 Elsevier Ltd. All rights reserved.

The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals.

PubMed

Skinner, Ian W; Hübscher, Markus; Moseley, G Lorimer; Lee, Hopin; Wand, Benedict M; Traeger, Adrian C; Gustin, Sylvia M; McAuley, James H

2017-08-15

Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test-retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test-retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test-retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from -.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test-retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.

Transcultural adaptation of the Breast Cancer Awareness Measure.

PubMed

Al-Khasawneh, E M; Leocadio, M; Seshan, V; Siddiqui, S T; Khan, A N; Al-Manaseer, M M

2016-09-01

To overcome the lack of a validated and robust Arabic instrument to measure breast cancer awareness. Currently, there is no validated Arabic instrument for measuring breast cancer awareness levels. We adapted, translated and validated the Breast Cancer Awareness Measure developed by Cancer Research UK. The instrument was translated into Arabic and back-translated for validation. Validation and reliability tests were conducted using purposively sampled 972 Arab women older than 20 years, living in Oman. The adapted content was validated by a panel of medical, linguistic and cultural experts, followed by cognitive interviews (n = 10), behavioural coding (n = 30) and criterion validation (n = 646). The instrument was tested for acceptability and its subscales for internal consistency. Inter-rater reliability was estimated between two similar groups (n = 144 and n = 142) to test homogeneity. The adapted and translated instrument had a high acceptability (98.7% completed). The validation process shaped the adaptation, and resulted in strong criterion validity (R = 0.58, P < 0.01). The instrument subscales for risk factors and warning signs had high internal consistency (Cronbach's alpha 0.856 and 0.890, respectively), with all floor and ceiling effects less than 15%. The correlation measure for inter-rater reliability was 0.97 (P < 0.01). Through the incorporation of contextual characteristics and prevalent beliefs among Arab populations, the adapted Best Cancer Awareness Measure is a robust Arabic instrument for the measurement of breast cancer awareness and early detection practices among Arab women. The purposively selected sample may not be representative of the population. Improvement of awareness and early detection of breast cancer can contribute towards reducing mortality from the disease. The adapted instrument has policy implications, since measurement of awareness levels is essential towards breast health promotion policies in Arab countries. © 2016 International Council of Nurses.

International classification of reliability for implanted cochlear implant receiver stimulators.

PubMed

Battmer, Rolf-Dieter; Backous, Douglas D; Balkany, Thomas J; Briggs, Robert J S; Gantz, Bruce J; van Hasselt, Andrew; Kim, Chong Sun; Kubo, Takeshi; Lenarz, Thomas; Pillsbury, Harold C; O'Donoghue, Gerard M

2010-10-01

To design an international standard to be used when reporting reliability of the implanted components of cochlear implant systems to appropriate governmental authorities, cochlear implant (CI) centers, and for journal editors in evaluating manuscripts involving cochlear implant reliability. The International Consensus Group for Cochlear Implant Reliability Reporting was assembled to unify ongoing efforts in the United States, Europe, Asia, and Australia to create a consistent and comprehensive classification system for the implanted components of CI systems across manufacturers. All members of the consensus group are from tertiary referral cochlear implant centers. None. A clinically relevant classification scheme adapted from principles of ISO standard 5841-2:2000 originally designed for reporting reliability of cardiac pacemakers, pulse generators, or leads. Standard definitions for device failure, survival time, clinical benefit, reduced clinical benefit, and specification were generated. Time intervals for reporting back to implant centers for devices tested to be "out of specification," categorization of explanted devices, the method of cumulative survival reporting, and content of reliability reports to be issued by manufacturers was agreed upon by all members. The methodology for calculating Cumulative survival was adapted from ISO standard 5841-2:2000. The International Consensus Group on Cochlear Implant Device Reliability Reporting recommends compliance to this new standard in reporting reliability of implanted CI components by all manufacturers of CIs and the adoption of this standard as a minimal reporting guideline for editors of journals publishing cochlear implant research results.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Assuring long-term reliability of concentrator PV systems

NASA Astrophysics Data System (ADS)

McConnell, R.; Garboushian, V.; Brown, J.; Crawford, C.; Darban, K.; Dutra, D.; Geer, S.; Ghassemian, V.; Gordon, R.; Kinsey, G.; Stone, K.; Turner, G.

2009-08-01

Concentrator PV (CPV) systems have attracted significant interest because these systems incorporate the world's highest efficiency solar cells and they are targeting the lowest cost production of solar electricity for the world's utility markets. Because these systems are just entering solar markets, manufacturers and customers need to assure their reliability for many years of operation. There are three general approaches for assuring CPV reliability: 1) field testing and development over many years leading to improved product designs, 2) testing to internationally accepted qualification standards (especially for new products) and 3) extended reliability tests to identify critical weaknesses in a new component or design. Amonix has been a pioneer in all three of these approaches. Amonix has an internal library of field failure data spanning over 15 years that serves as the basis for its seven generations of CPV systems. An Amonix product served as the test CPV module for the development of the world's first qualification standard completed in March 2001. Amonix staff has served on international standards development committees, such as the International Electrotechnical Commission (IEC), in support of developing CPV standards needed in today's rapidly expanding solar markets. Recently Amonix employed extended reliability test procedures to assure reliability of multijunction solar cell operation in its seventh generation high concentration PV system. This paper will discuss how these three approaches have all contributed to assuring reliability of the Amonix systems.

Adapting the helpful responses questionnaire to assess communication skills involved in delivering contingency management: preliminary psychometrics.

PubMed

Hartzler, Bryan

2015-08-01

A paper/pencil instrument, adapted from Miller and colleagues' (1991) Helpful Responses Questionnaire (HRQ), was developed to assess clinician skill with core communicative aspects involved in delivering contingency management (CM). The instrument presents a single vignette consisting of six points of client dialogue to which respondents write 'what they would say next.' In the context of an implementation/effectiveness hybrid trial, 19 staff clinicians at an opiate treatment program completed serial training outcome assessments before, following, and three months after CM training. Assessments included this adaptation of the HRQ, a multiple-choice CM knowledge test, and a recorded standardized patient encounter scored for CM skillfulness. Study results reveal promising psychometric properties for the instrument, including strong scoring reliability, internal consistency, concurrent and predictive validity, test-retest reliability and sensitivity to training effects. These preliminary findings suggest the instrument is a viable, practical method to assess clinician skill in communicative aspects of CM delivery. Copyright © 2015 Elsevier Inc. All rights reserved.

The Liebowitz Social Anxiety Scale for Children and Adolescents.

PubMed

Olivares, José; Sánchez-García, Raquel; López-Pina, José Antonio

2009-08-01

The purpose of this study was to analyze the component structure and reliability of the Liebowitz Social Anxiety Scale for Children and Adolescents, self-report version (LSAS-CA-SR), in a Spanish community population. The sample was made up of 422 students from elementary and high schools, aged between 10 and 17 years. Exploratory factor analysis isolated one component for the Anxiety subscale and one component for the Avoidance subscale. Medium-strong associations were found between the total score and subscale scores. LSAS-CA-SR scores had stronger associations with instruments of social anxiety. Internal consistency for the Fear subscale was .91, and for the Avoidance subscale, it was .89. Gender and age effects were assessed for LSAS-CA-SR scores. Effect sizes for age and gender and interaction of age and gender were very low on both the Fear and the Avoidance subscales. There were significant differences between female and male means on the Fear subscale. The findings suggest that the LSAS-CA-SR is reliable and valid.

Convergent and discriminant validity and reliability of the pediatric anxiety rating scale in youth with autism spectrum disorders.

PubMed

Storch, Eric A; Wood, Jeffrey J; Ehrenreich-May, Jill; Jones, Anna M; Park, Jennifer M; Lewin, Adam B; Murphy, Tanya K

2012-11-01

The psychometric properties of the Pediatric Anxiety Rating Scale (PARS), a clinician-administered measure for assessing severity of anxiety symptoms, were examined in 72 children and adolescents diagnosed with an autism spectrum disorder (ASD). The internal consistency of the PARS was 0.59, suggesting that the items were related but not repetitive. The PARS showed high 26-day test-retest (ICC = 0.83) and inter-rater reliability (ICC = 0.86). The PARS was strongly correlated with clinician-ratings of overall anxiety severity and parent-report anxiety measures, supporting convergent validity. Results for divergent validity were mixed. Although the PARS was not associated with the sum of the Social and Communication items on the Autism Diagnostic Observation System, it was moderately correlated with parent-reported inattention, aggression and externalizing behavior. Overall, these results suggest that the psychometric properties of the PARS are adequate for assessing anxiety symptoms in youth with ASD, although additional clarification of divergent validity is needed.

Measuring hope among families impacted by cognitive impairment.

PubMed

Hunsaker, Amanda E; Terhorst, Lauren; Gentry, Amanda; Lingler, Jennifer H

2016-07-01

The current exploratory investigation aims to establish the reliability and validity of a hope measure, the Herth Hope Index, among families impacted by early cognitive impairment (N = 96). Exploratory factor analysis was used to examine the dimensionality of the measure. Bivariate analyses were used to examine construct validity. The sample had moderately high hope scores. A two-factor structure emerged from the factor analysis, explaining 51.44% of the variance. Both factors exhibited strong internal consistency (Cronbach's alphas ranged from .83 to .86). Satisfaction with social support was positively associated with hope, supporting convergent validity. Neurocognitive status, illness insight, and depression were not associated with hope, indicating discriminant validity. Families impacted by cognitive impairment may maintain hope in the face of a potentially progressive illness, regardless of cognitive status. The Herth Hope Index can be utilized as a reliable and valid measure of hope by practitioners providing support to families impacted by cognitive impairment. © The Author(s) 2014.

A Validation Study of the Japanese Version of the Addenbrooke's Cognitive Examination-Revised

PubMed Central

dos Santos Kawata, Kelssy Hitomi; Hashimoto, Ryusaku; Nishio, Yoshiyuki; Hayashi, Atsuko; Ogawa, Nanayo; Kanno, Shigenori; Hiraoka, Kotaro; Yokoi, Kayoko; Iizuka, Osamu; Mori, Etsuro

2012-01-01

The aim of this study was to validate the Japanese version of the Addenbrooke's Cognitive Examination-Revised (ACE-R) [Mori: Japanese Edition of Hodges JR's Cognitive Assessment for Clinicians, 2010] designed to detect dementia, and to compare its diagnostic accuracy with that of the Mini-Mental State Examination. The ACE-R was administered to 85 healthy individuals and 126 patients with dementia. The reliability assessment revealed a strong correlation in both groups. The internal consistency was excellent (α-coefficient = 0.88). Correlation with the Clinical Dementia Rating sum of boxes score was significant (rs = −0.61, p < 0.001). The area under the curve was 0.98 for the ACE-R and 0.96 for the Mini-Mental State Examination. The cut-off score of 80 showed a sensitivity of 94% and a specificity of 94%. Like the original ACE-R and the versions designed for other languages, the Japanese version of the ACE-R is a reliable and valid test for the detection of dementia. PMID:22619659

Fixing the Problem With Empathy: Development and Validation of the Affective and Cognitive Measure of Empathy.

PubMed

Vachon, David D; Lynam, Donald R

2016-04-01

Low empathy is a criterion for most externalizing disorders, and empathy training is a regular component of treatment for aggressive people, from school bullies to sex offenders. However, recent meta-analytic evidence suggests that current measures of empathy explain only 1% of the variance in aggressive behavior. A new assessment of empathy was developed to more fully represent the empathy construct and better predict important outcomes--particularly aggressive behavior and externalizing psychopathology. Across three independent samples (N = 210-708), the 36-item Affective and Cognitive measure of Empathy (ACME) was internally consistent, structurally reliable, and invariant across sex. The ACME bore significant associations to important outcomes, which were incremental relative to other measures of empathy and generalizable across sex. Importantly, the affective scales of the ACME-particularly a new "Affective Dissonance" scale--yielded moderate to strong associations with aggressive behavior and externalizing disorders. The ACME is a short, reliable, and useful measure of empathy. © The Author(s) 2015.

Cancer and treatment distress psychometric evaluation over time: A BMT CTN 0902 secondary analysis.

PubMed

Syrjala, Karen L; Sutton, Steven K; Jim, Heather S L; Knight, Jennifer M; Wood, William A; Lee, Stephanie J; Jacobsen, Paul B; Abidi, Muneer H; Yi, Jean C

2017-04-15

Routine monitoring of cancer-related distress is recognized as essential to quality care and mandated by a major accrediting organization. However, to the authors' knowledge, few cancer-specific measures have been developed to date to assess the multiple cancer-related factors contributing to this distress. In the current study, the authors examined the psychometric properties of the Cancer and Treatment Distress (CTXD) measure over time in hematopoietic cell transplantation (HCT) recipients. As a secondary analysis of a multicenter randomized controlled clinical trial, adult patients undergoing autologous or allogeneic HCT completed patient-reported outcomes including the CTXD and the Medical Outcomes Study Short Form-36 (SF-36) before transplantation and 100 days and 180 days after HCT. Across 21 transplantation centers, a total of 701 patients consented, underwent transplantation, and were included in the current analyses, 645 of whom were alive at 100 days and 618 of whom were alive at 180 days. Internal consistency reliability was found to be strong for the overall CTXD at the 3 time points: Cronbach alphas (α) were .94, .95, and .95, respectively. Subscale reliability met hypothesized levels of an α>.70 across time, with the lowest reliability noted for the Identity subscale at 180 days (α = .77). Correlations with the SF-36 Mental Health subscale were higher than with the Physical Functioning subscale at each time point, thereby supporting convergent and discriminant validity. Strong correlations of the pretransplantation CTXD with the posttransplantation CTXD and SF-36 Mental Health subscale supported predictive validity. The CTXD is reliable and valid as a measure of cancer distress both before and after HCT. It may be a useful tool for measuring dimensions of distress and for defining those patients requiring treatment for distress during and after transplantation. Cancer 2017;123:1416-1423. © 2016 American Cancer Society. © 2016 American Cancer Society.

Factorial validity and internal consistency of the motivational climate in physical education scale.

PubMed

Soini, Markus; Liukkonen, Jarmo; Watt, Anthony; Yli-Piipari, Sami; Jaakkola, Timo

2014-01-01

The aim of the study was to examine the construct validity and internal consistency of the Motivational Climate in Physical Education Scale (MCPES). A key element of the development process of the scale was establishing a theoretical framework that integrated the dimensions of task- and ego involving climates in conjunction with autonomy, and social relatedness supporting climates. These constructs were adopted from the self-determination and achievement goal theories. A sample of Finnish Grade 9 students, comprising 2,594 girls and 1,803 boys, completed the 18-item MCPES during one physical education class. The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate and ego-involving climate. Additionally, autonomy, social relatedness, and task- involving climates were significantly and strongly correlated with each other, whereas the ego- involving climate had low or negligible correlations with the other climate dimensions.The construct validity of the MCPES was analyzed using confirmatory factor analysis. The statistical fit of the four-factor model consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. The results of the reliability analysis showed acceptable internal consistencies for all four dimensions. The Motivational Climate in Physical Education Scale can be considered as psychometrically valid tool to measure motivational climate in Finnish Grade 9 students. Key PointsThis study developed Motivational Climate in School Physical Education Scale (MCPES). During the development process of the scale, the theoretical framework using dimensions of task- and ego involving as well as autonomy, and social relatedness supporting climates was constructed. These constructs were adopted from the self-determination and achievement goal theories.The statistical fit of the four-factor model of the MCPES consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. Additionally, the results of the reliability analysis showed acceptable internal consistencies for all four dimensions.The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate.Autonomy, social relatedness, and task climate were significantly and strongly correlated with each other, whereas the ego climate factor had low or negligible correlations with the other three factors.

Factorial Validity and Internal Consistency of the Motivational Climate in Physical Education Scale

PubMed Central

Soini, Markus; Liukkonen, Jarmo; Watt, Anthony; Yli-Piipari, Sami; Jaakkola, Timo

2014-01-01

The aim of the study was to examine the construct validity and internal consistency of the Motivational Climate in Physical Education Scale (MCPES). A key element of the development process of the scale was establishing a theoretical framework that integrated the dimensions of task- and ego involving climates in conjunction with autonomy, and social relatedness supporting climates. These constructs were adopted from the self-determination and achievement goal theories. A sample of Finnish Grade 9 students, comprising 2,594 girls and 1,803 boys, completed the 18-item MCPES during one physical education class. The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate and ego-involving climate. Additionally, autonomy, social relatedness, and task- involving climates were significantly and strongly correlated with each other, whereas the ego- involving climate had low or negligible correlations with the other climate dimensions.The construct validity of the MCPES was analyzed using confirmatory factor analysis. The statistical fit of the four-factor model consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. The results of the reliability analysis showed acceptable internal consistencies for all four dimensions. The Motivational Climate in Physical Education Scale can be considered as psychometrically valid tool to measure motivational climate in Finnish Grade 9 students. Key Points This study developed Motivational Climate in School Physical Education Scale (MCPES). During the development process of the scale, the theoretical framework using dimensions of task- and ego involving as well as autonomy, and social relatedness supporting climates was constructed. These constructs were adopted from the self-determination and achievement goal theories. The statistical fit of the four-factor model of the MCPES consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. Additionally, the results of the reliability analysis showed acceptable internal consistencies for all four dimensions. The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate. Autonomy, social relatedness, and task climate were significantly and strongly correlated with each other, whereas the ego climate factor had low or negligible correlations with the other three factors. PMID:24570617

Validation of Persian rapid estimate of adult literacy in dentistry.

PubMed

Pakpour, Amir H; Lawson, Douglas M; Tadakamadla, Santosh K; Fridlund, Bengt

2016-05-01

The aim of the present study was to establish the psychometric properties of the Rapid Estimate of adult Literacy in Dentistry-99 (REALD-99) in the Persian language for use in an Iranian population (IREALD-99). A total of 421 participants with a mean age of 28 years (59% male) were included in the study. Participants included those who were 18 years or older and those residing in Quazvin (a city close to Tehran), Iran. A forward-backward translation process was used for the IREALD-99. The Test of Functional Health Literacy in Dentistry (TOFHLiD) was also administrated. The validity of the IREALD-99 was investigated by comparing the IREALD-99 across the categories of education and income levels. To further investigate, the correlation of IREALD-99 with TOFHLiD was computed. A principal component analysis (PCA) was performed on the data to assess unidimensionality and strong first factor. The Rasch mathematical model was used to evaluate the contribution of each item to the overall measure, and whether the data were invariant to differences in sex. Reliability was estimated with Cronbach's α and test-retest correlation. Cronbach's alpha for the IREALD-99 was 0.98, indicating strong internal consistency. The test-retest correlation was 0.97. IREALD-99 scores differed by education levels. IREALD-99 scores were positively related to TOFHLiD scores (rh = 0.72, P < 0.01). In addition, IREALD-99 showed positive correlation with self-rated oral health status (rh = 0.31, P < 0.01) as evidence of convergent validity. The PCA indicated a strong first component, five times the strength of the second component and nine times the third. The empirical data were a close fit with the Rasch mathematical model. There was not a significant difference in scores with respect to income level (P = 0.09), and only the very lowest income level was significantly different (P < 0.01). The IREALD-99 exhibited excellent reliability on repeated administrations, as well as internal consistency. The IREALD-99 can be used for the basic screening of oral health literacy among the Iranian population. © 2014 Wiley Publishing Asia Pty Ltd.

Partnering to Establish and Study Simulation in International Nursing Education.

PubMed

Garner, Shelby L; Killingsworth, Erin; Raj, Leena

The purpose of this article was to describe an international partnership to establish and study simulation in India. A pilot study was performed to determine interrater reliability among faculty new to simulation when evaluating nursing student competency performance. Interrater reliability was below the ideal agreement level. Findings in this study underscore the need to obtain baseline interrater reliability data before integrating competency evaluation into a simulation program.

Advanced Relay Design and Technology for Energy-Efficient Electronics

DTIC Science & Technology

2011-07-07

Estimates and Unique Failure Mechanisms of the Digital Micromirror Device (DMD),” in Proceedings of the IEEE Annual International Reliability Physics...Symposium (IRPS 󈨦), pp. 9-16, March 1998. [18] A. B. Sontheimer, “Digital Micromirror Device (DMD) Hinge Memory Lifetime Reliability Modeling,” in...Mechanisms of the Digital Micromirror Device (DMD),” in Proceedings of the IEEE Annual International Reliability Physics Symposium (IRPS 󈨦), pp. 9-16

Psychometric Evaluation of the D-Catch, an Instrument to Measure the Accuracy of Nursing Documentation.

PubMed

D'Agostino, Fabio; Barbaranelli, Claudio; Paans, Wolter; Belsito, Romina; Juarez Vela, Raul; Alvaro, Rosaria; Vellone, Ercole

2017-07-01

To evaluate the psychometric properties of the D-Catch instrument. A cross-sectional methodological study. Validity and reliability were estimated with confirmatory factor analysis (CFA) and internal consistency and inter-rater reliability, respectively. A sample of 250 nursing documentations was selected. CFA showed the adequacy of a 1-factor model (chronologically descriptive accuracy) with an outlier item (nursing diagnosis accuracy). Internal consistency and inter-rater reliability were adequate. The D-Catch is a valid and reliable instrument for measuring the accuracy of nursing documentation. Caution is needed when measuring diagnostic accuracy since only one item measures this dimension. The D-Catch can be used as an indicator of the accuracy of nursing documentation and the quality of nursing care. © 2015 NANDA International, Inc.

Translation and validation of the German version of the Bournemouth Questionnaire for Neck Pain.

PubMed

Soklic, Marina; Peterson, Cynthia; Humphreys, B Kim

2012-01-25

Clinical outcome measures are important tools to monitor patient improvement during treatment as well as to document changes for research purposes. The short-form Bournemouth questionnaire for neck pain patients (BQN) was developed from the biopsychosocial model and measures pain, disability, cognitive and affective domains. It has been shown to be a valid and reliable outcome measure in English, French and Dutch and more sensitive to change compared to other questionnaires. The purpose of this study was to translate and validate a German version of the Bournemouth questionnaire for neck pain patients. German translation and back translation into English of the BQN was done independently by four persons and overseen by an expert committee. Face validity of the German BQN was tested on 30 neck pain patients in a single chiropractic practice. Test-retest reliability was evaluated on 31 medical students and chiropractors before and after a lecture. The German BQN was then assessed on 102 first time neck pain patients at two chiropractic practices for internal consistency, external construct validity, external longitudinal construct validity and sensitivity to change compared to the German versions of the Neck Disability Index (NDI) and the Neck Pain and Disability Scale (NPAD). Face validity testing lead to minor changes to the German BQN. The Intraclass Correlation Coefficient for the test-retest reliability was 0.99. The internal consistency was strong for all 7 items of the BQN with Cronbach α's of .79 and .80 for the pre and post-treatment total scores. External construct validity and external longitudinal construct validity using Pearson's correlation coefficient showed statistically significant correlations for all 7 scales of the BQN with the other questionnaires. The German BQN showed greater responsiveness compared to the other questionnaires for all scales. The German BQN is a valid and reliable outcome measure that has been successfully translated and culturally adapted. It is shorter, easier to use, and more responsive to change than the NDI and NPAD.

Evaluation of Three Pain Assessment Scales Used for Ventilated Neonates.

PubMed

Huang, Xiao-Zhi; Li, Li; Zhou, Jun; He, Fang; Zhong, Chun-Xia; Wang, Bin

2018-06-26

To compare and evaluate the reliability, validity, feasibility, clinical utility, and nurses' preference of the Premature Infant Pain Profile-Revised (PIPP-R), the Neonatal Pain, Agitation, and Sedation Scale (N-PASS), and the Neonatal Infant Acute Pain Assessment Scale (NIAPAS) used for procedural pain in ventilated neonates. Procedural pain is a common phenomenon but is undermanaged and underassessed in hospitalized neonates. Information for clinician selecting pain measurements to improve neonatal care and outcomes are still limited. A prospective observational study and adheres to the relevant EQUATOR guidelines. A total of 1080 pain assessments were made at 90 neonates by two nurses independently, using three scales viewing three phases of videotaped painful (arterial blood sampling) and non-painful procedures (diaper change). Internal consistency, inter-rater reliability, discriminant validity, concurrent validity and convergent validity of scales were analyzed. Feasibility, clinical utility, and nurses' preference of scales were also investigated. All three scales showed excellent inter-raters coefficients (from 0.991 to 0.992) and good internal consistency (0.733 for the PIPP-R, 0.837 for the N-PASS and 0.836 for the NIAPAS, respectively). Scores of painful and nonpainful procedures on the three scales changed significantly across the phases. There was a strong correlation between the three scales with adequate limits of agreement. The mean scores of the N-PASS for feasibility and utility were significantly higher than those of the NIAPAS, but not significantly higher than those of the PIPP-R. The N-PASS was mostly preferred by 55.9% of the nurses, followed by the NIAPAS (23.5%) and the PIPP-R (20.6%). The three scales are all reliable and valid, but the N-PASS and the NIAPAS performs better in reliability. The N-PASS appears to be a better choice for frontier nurses to assess procedural pain in ventilated neonates based on its good feasibility, utility, and nurses' preference. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Cultural adaptation and psychometric properties of the family questionnaire in a Brazilian sample of relatives of schizophrenia outpatients.

PubMed

Zanetti, Ana C G; Wiedemann, Georg; Dantas, Rosana A S; Hayashida, Miyeko; de Azevedo-Marques, João M; Galera, Sueli A F

2013-06-01

To evaluate the internal reliability and validity of the Brazilian Portuguese version of the Family Questionnaire among families of schizophrenia outpatients. The main studies about the family environment of schizophrenia patients are related to the concept of Expressed Emotion. There is currently no instrument to evaluate this concept in Brazil that is easily applicable and comparable with studies from other countries. Methodological and cross-sectional research design. A convenience sample of 130 relatives of schizophrenia outpatients was selected. The translation and cultural adaptation of the instrument involved experts in mental health and experts in the German language and included back translation, semantic evaluation of items and pretesting of the instrument with 30 relatives of schizophrenia outpatients. The psychometric properties of the instrument were studied with another 100 relatives, which fulfilled the requirements for the Brazilian Portuguese version of the instrument. The psychometric properties of the instrument were assessed by construct validity (using an analysis of its key components, comparisons between distinct groups-convergent validity with the Antonovsky's Sense of Coherence Scale) and reliability (checking the internal consistency of its items and its test-retest reproducibility). The analysis of main components confirmed dimensionality patterns that were comparable between the original and adapted versions. In two domains of the instrument, critical comments and emotional over-involvement had moderate and significant correlations, respectively, with Antonovsky's Sense of Coherence Scale, appropriate values of Cronbach's alpha and strong and significant correlations, respectively, in test-retest reproducibility. We observed significant differences between distinct groups of parents in the category of emotional over-involvement. We conclude that the Portuguese-adapted version of the Family Questionnaire is valid and reliable for the study sample. This study provided evidence that the Family Questionnaire is a reliable and valid instrument for assessing expressed emotion. It is easy and practical to use and is acceptable for use in a Brazilian cultural population. © 2012 Blackwell Publishing Ltd.

Psychometric properties of the medical outcomes study sleep scale in Spanish postmenopausal women.

PubMed

Zagalaz-Anula, Noelia; Hita-Contreras, Fidel; Martínez-Amat, Antonio; Cruz-Díaz, David; Lomas-Vega, Rafael

2017-07-01

This study aimed to analyze the reliability and validity of the Spanish version of the Medical Outcomes Study Sleep Scale (MOS-SS), and its ability to discriminate between poor and good sleepers among a Spanish population with vestibular disorders. In all, 121 women (50-76 years old) completed the Spanish version of the MOS-SS. Internal consistency, test-retest reliability, and construct validity (exploratory factor analysis) were analyzed. Concurrent validity was evaluated using the Pittsburgh Sleep Quality Index and the 36-item Short Form Health Survey. To analyze the ability of the MOS-SS scores to discriminate between poor and good sleepers, a receiver-operating characteristic curve analysis was performed. The Spanish version of the MOS-SS showed excellent and substantial reliability in Sleep Problems Index I (two sleep disturbance items, one somnolence item, two sleep adequacy items, and awaken short of breath or with headache) and Sleep Problems Index II (four sleep disturbance items, two somnolence items, two sleep adequacy items, and awaken short of breath or with headache), respectively, and good internal consistency with optimal Cronbach's alpha values in all domains and indexes (0.70-0.90). Factor analysis suggested a coherent four-factor structure (explained variance 70%). In concurrent validity analysis, MOS-SS indexes showed significant and strong correlation with the Pittsburgh Sleep Quality Index total score, and moderate with the 36-item Short Form Health Survey component summaries. Several domains and the two indexes were significantly able to discriminate between poor and good sleepers (P < 0.05). Optimal cut-off points were above 20 for "sleep disturbance" domain, with above 22.22 and above 33.33 for Sleep Problems Index I and II. The Spanish version of the MOS-SS is a valid and reliable instrument, suitable to assess sleep quality in Spanish postmenopausal women, with satisfactory general psychometric properties. It discriminates well between good and poor sleepers.

A Measure of Barriers Toward Medical Disclosure Among Health Professionals in the United Arab Emirates.

PubMed

Zaghloul, Ashraf Ahmad; Elsergany, Moetaz; Mosallam, Rasha

2018-03-01

There has been a growing awareness that patients are subject to injuries that can be prevented as a direct consequence of health care. Error disclosure is an effective technique to restore the lost trust with the health care system. The current study aimed to develop a valid and reliable scale to determine the factors facilitating the disclosure of health professionals in health organizations. This study had a cross-sectional design that consisted of 722 responses (response rate of 68.3%) from 1 private and 1 public hospital in Sharjah, United Arab Emirates. The data collection tool included 23 items rated on a Likert scale ranging from 5, strongly agree, to 1, strongly disagree.The internal consistency was established through calculating the split-half reliability for part 1 (12 items), which had a Cronbach coefficient of 0.65, and part 2 (11 items), which had a Cronbach coefficient of 0.62. Scale validity was assessed with the Kaiser-Meyer-Olkin measure of sampling adequacy, which had a value of 0.62, and the Bartlett test of sphericity (approximated χ = 13012.2, P = 0.0001) supported the factorability of the correlation matrix. The varimax rotation revealed 5 components that explained 77.8% of the total variance. The varimax rotation revealed 21 items loaded on the following 5 factors: fear of disclosure and provider image consequences (factor 1), apology (factor 2), organizational culture toward patient safety (factor 3), professional ethics and transparency (factor 4), as well as patient and provider education (factor 5). The disclosure of medical mistakes requires preliminary considerations to effectively and compassionately disclose these events to patients. The validity and reliability of the results support the use of this scale at hospitals as part of the health care providers' disclosure processes.

Measuring of quality of life in autoimmune blistering disorders in Poland. Validation of disease - specific Autoimmune Bullous Disease Quality of Life (ABQOL) and the Treatment Autoimmune Bullous Disease Quality of Life (TABQOL) questionnaires.

PubMed

Kalinska-Bienias, Agnieszka; Jakubowska, Beata; Kowalewski, Cezary; Murrell, Dedee F; Wozniak, Katarzyna

2017-03-01

Autoimmune bullous dermatoses (AIBD) are rare, severe diseases resulting from some antibodies activity against the different adhesion structures within the skin and/or mucosa. Few studies investigated quality of life (QOL) in AIBD by generic and dermatology-specific instruments, all reporting strong impact on QOL. Recently, disease-specific measurement tools have been developed: Autoimmune Bullous Disease Quality of Life (ABQOL) and Treatment of Autoimmune Bullous Disease Quality of Life (TABQOL) questionnaires. The aim of this study was to test the reliability and validity of ABQOL and TABQOL by developing the first foreign language versions and to evaluate ABQOL and TABQOL in Polish patients. The study enrolled 80 patients from the tertiary referral center for AIBD at the outpatient clinic or on admission to the hospital. Sixty six patients completed the 17-item questionnaires of each ABQOL and TABQOL at day 0 and after 5-7 days. Both questionnaires were translated into Polish according to protocol. The internal consistency and test-retest reliability were high (Cronbach α=0.95 for ABQOL, α=0.87 for TABQOL), (R=0.98 for ABQOL, R=0.86 for TABQOL). In convergent validity, the correlation of ABQOL and TABQOL was strong (R=0.81), but low with objective disease activity scales. The strongest impact of AIBD on QOL has been observed in flares and in patients with the onset below 70 years of age. The patients with bullous pemphigoid had the highest QOL compared to other AIBD patients. The ABQOL and TABQOL are reliable and valid instruments for the assessment of QOL in AIBD. Copyright © 2016 Medical University of Bialystok. Published by Elsevier B.V. All rights reserved.

Predicting functional outcomes among college drinkers: reliability and predictive validity of the Young Adult Alcohol Consequences Questionnaire.

PubMed

Read, Jennifer P; Merrill, Jennifer E; Kahler, Christopher W; Strong, David R

2007-11-01

Heavy drinking and associated consequences are widespread among U.S. college students. Recently, Read et al. (Read, J. P., Kahler, C. W., Strong, D., & Colder, C. R. (2006). Development and preliminary validation of the Young Adult Alcohol Consequences Questionnaire. Journal of Studies on Alcohol, 67, 169-178) developed the Young Adult Alcohol Consequences Questionnaire (YAACQ) to assess the broad range of consequences that may result from heavy drinking in the college milieu. In the present study, we sought to add to the psychometric validation of this measure by employing a prospective design to examine the test-retest reliability, concurrent validity, and predictive validity of the YAACQ. We also sought to examine the utility of the YAACQ administered early in the semester in the prediction of functional outcomes later in the semester, including the persistence of heavy drinking, and academic functioning. Ninety-two college students (48 females) completed a self-report assessment battery during the first weeks of the Fall semester, and approximately one week later. Additionally, 64 subjects (37 females) participated at an optional third time point at the end of the semester. Overall, the YAACQ demonstrated strong internal consistency, test-retest reliability, and concurrent and predictive validity. YAACQ scores also were predictive of both drinking frequency, and "binge" drinking frequency. YAACQ total scores at baseline were an early indicator of academic performance later in the semester, with greater number of total consequences experienced being negatively associated with end-of-semester grade point average. Specific YAACQ subscale scores (Impaired Control, Dependence Symptoms, Blackout Drinking) showed unique prediction of persistent drinking and academic outcomes.

Reliability of a new biokinetic model of zirconium in internal dosimetry: part I, parameter uncertainty analysis.

PubMed

Li, Wei Bo; Greiter, Matthias; Oeh, Uwe; Hoeschen, Christoph

2011-12-01

The reliability of biokinetic models is essential in internal dose assessments and radiation risk analysis for the public, occupational workers, and patients exposed to radionuclides. In this paper, a method for assessing the reliability of biokinetic models by means of uncertainty and sensitivity analysis was developed. The paper is divided into two parts. In the first part of the study published here, the uncertainty sources of the model parameters for zirconium (Zr), developed by the International Commission on Radiological Protection (ICRP), were identified and analyzed. Furthermore, the uncertainty of the biokinetic experimental measurement performed at the Helmholtz Zentrum München-German Research Center for Environmental Health (HMGU) for developing a new biokinetic model of Zr was analyzed according to the Guide to the Expression of Uncertainty in Measurement, published by the International Organization for Standardization. The confidence interval and distribution of model parameters of the ICRP and HMGU Zr biokinetic models were evaluated. As a result of computer biokinetic modelings, the mean, standard uncertainty, and confidence interval of model prediction calculated based on the model parameter uncertainty were presented and compared to the plasma clearance and urinary excretion measured after intravenous administration. It was shown that for the most important compartment, the plasma, the uncertainty evaluated for the HMGU model was much smaller than that for the ICRP model; that phenomenon was observed for other organs and tissues as well. The uncertainty of the integral of the radioactivity of Zr up to 50 y calculated by the HMGU model after ingestion by adult members of the public was shown to be smaller by a factor of two than that of the ICRP model. It was also shown that the distribution type of the model parameter strongly influences the model prediction, and the correlation of the model input parameters affects the model prediction to a certain extent depending on the strength of the correlation. In the case of model prediction, the qualitative comparison of the model predictions with the measured plasma and urinary data showed the HMGU model to be more reliable than the ICRP model; quantitatively, the uncertainty model prediction by the HMGU systemic biokinetic model is smaller than that of the ICRP model. The uncertainty information on the model parameters analyzed in this study was used in the second part of the paper regarding a sensitivity analysis of the Zr biokinetic models.

Reliability and concurrent and construct validity of the Strategies for Weight Management measure for adults.

PubMed

Kolodziejczyk, Julia K; Norman, Gregory J; Rock, Cheryl L; Arredondo, Elva M; Roesch, Scott C; Madanat, Hala; Patrick, Kevin

2016-01-01

This study evaluates the reliability and validity of the strategies for weight management (SWM) measure, a questionnaire that assesses weight management strategies for adults. The SWM includes 20 items that are categorized within the following subscales: (1) energy intake, (2) energy expenditure, (3) self-monitoring, and (4) self-regulation. Baseline and 6-month data were collected from 404 overweight/obese adults (mean age=22±3.8 years, 68% ethnic minority) enrolled in a randomized controlled trial aiming to reduce weight by improving diet and physical activity behaviours. Reliability and validity were assessed for each subscale separately. Cronbach alpha was conducted to assess reliability. Concurrent, construct I (sensitivity to the study treatment condition), and construct II (relationship to the outcomes) validity were assessed using linear regressions with the following outcome measures: weight, self-reported diet, and weekly energy expenditure. All subscales showed strong internal consistency. The strength of the validity evidence depended on subscale and validity type. The strongest validity evidence was concurrent validity of the energy intake and energy expenditure subscales; construct I validity of the energy intake and self-monitoring subscales; and construct II validity of the energy intake, energy expenditure, and self-regulation subscales. Results indicate that the SWM can be used to assess weight management strategies among an ethnically diverse sample of adults as each subscale showed evidence of reliability and select types of validity. As validity is an accumulation of evidence over multiple studies, this study provides initial reliability and validity evidence in one population segment. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

Development, test-retest reliability and validity of the Pharmacy Value-Added Services Questionnaire (PVASQ).

PubMed

Tan, Christine L; Hassali, Mohamed A; Saleem, Fahad; Shafie, Asrul A; Aljadhey, Hisham; Gan, Vincent B

2015-01-01

(i) To develop the Pharmacy Value-Added Services Questionnaire (PVASQ) using emerging themes generated from interviews. (ii) To establish reliability and validity of questionnaire instrument. Using an extended Theory of Planned Behavior as the theoretical model, face-to-face interviews generated salient beliefs of pharmacy value-added services. The PVASQ was constructed initially in English incorporating important themes and later translated into the Malay language with forward and backward translation. Intention (INT) to adopt pharmacy value-added services is predicted by attitudes (ATT), subjective norms (SN), perceived behavioral control (PBC), knowledge and expectations. Using a 7-point Likert-type scale and a dichotomous scale, test-retest reliability (N=25) was assessed by administrating the questionnaire instrument twice at an interval of one week apart. Internal consistency was measured by Cronbach's alpha and construct validity between two administrations was assessed using the kappa statistic and the intraclass correlation coefficient (ICC). Confirmatory Factor Analysis, CFA (N=410) was conducted to assess construct validity of the PVASQ. The kappa coefficients indicate a moderate to almost perfect strength of agreement between test and retest. The ICC for all scales tested for intra-rater (test-retest) reliability was good. The overall Cronbach' s alpha (N=25) is 0.912 and 0.908 for the two time points. The result of CFA (N=410) showed most items loaded strongly and correctly into corresponding factors. Only one item was eliminated. This study is the first to develop and establish the reliability and validity of the Pharmacy Value-Added Services Questionnaire instrument using the Theory of Planned Behavior as the theoretical model. The translated Malay language version of PVASQ is reliable and valid to predict Malaysian patients' intention to adopt pharmacy value-added services to collect partial medicine supply.

The reliability and validity of Chinese version of SF36 v2 in aging patients with chronic heart failure.

PubMed

Dong, Aishu; Chen, Sisi; Zhu, Lianlian; Shi, Lingmin; Cai, Yueli; Zeng, Jingni; Guo, Wenjian

2017-08-01

Chronic heart failure (CHF), a major public health problem worldwide, seriously limits health-related quality of life (HRQOL). How to evaluate HRQOL in older patients with CHF remains a problem. To evaluate the reliability and validity of the Chinese version of the Medical Outcomes Study Short Form version 2 (SF-36v2) in CHF patients. From September 2012 to June 2014, we assessed QOL using the SF-36v2 in 171 aging participants with CHF in four cardiology departments. Convergent and discriminant validity, factorial validity, sensitivity among different NYHA classes and between different age groups, and reliability were determined using standard measurement methods. A total of 150 participants completed a structured questionnaire including general information and the Chinese SF-36v2; 132 questionnaires were considered valid, while 21 patients refused to take part. 25 of the 50 participants invited to complete the 2-week test-retest questionnaires returned completed questionnaires. The internal consistency reliability (Cronbach's α) of the total SF-36v2 was 0.92 (range 0.74-0.93). All hypothesized item-subscale correlations showed satisfactory convergent and discriminant validity. Sensitivity was measured in different NYHA classes and age groups. Comparison of different NYHA classes showed statistical significance, but there was no significant difference between age groups. We confirmed the SF-36v2 as a valid instrument for evaluating HRQOL Chinese CHF patients. Both reliability and validity were strongly satisfactory, but there was divergence in understanding subscales such as "social functioning" because of differing cultural background. The reliability, validity, and sensitivity of SF-36v2 in aging patients with CHF were acceptable.

[Reliability and validity of the Turkish version of the internalized stigma of mental illness scale].

PubMed

Ersoy, Mehmet Akif; Varan, Azmi

2007-01-01

The aim of this study was to evaluate the reliability and validity of the Turkish version of the Internalized Stigma of Mental Illness Scale (ISMI) in patients with psychiatric disorders. The study included 203 patients diagnosed with various psychiatric disorders in a psychiatry outpatient clinic of a university hospital. The reliability of the scale was assessed by investigation of its internal consistency and split-half reliability. The convergent validity of the scale was demonstrated by the relationship between the Turkish form of the ISMI and various criteria scales. Cronbach's alpha value was 0.93 for the entire scale and ranged between 0.63 and 0.87 for the 5 subscales of the ISMI. In terms of convergent validity, the total score of the Turkish ISMI significantly correlated with the Beck Depression Inventory, Rosenberg Self-Esteem Scale, Sociotropy-Autonomy Scale, Brief Symptom Inventory, Multidimensional Scale of Perceived Social Support, Clinical Global Impression Scale, and Global Assessment of Functioning Scale scores. All values were in the expected direction. In the light of the findings, it was concluded that the Turkish version of ISMI could be used as a reliable and valid tool in assessing internalized stigma of the Turkish psychiatric patients.

Development and Validation of a Web-Based Survey on the Use of Personal Communication Devices by Hospital Registered Nurses: Pilot Study

PubMed Central

LeVasseur, Sandra A; Li, Dongmei

2013-01-01

Background The use of personal communication devices (such as basic cell phones, enhanced cell phones or smartphones, and tablet computers) in hospital units has risen dramatically in recent years. The use of these devices for personal and professional activities can be beneficial, but also has the potential to negatively affect patient care, as clinicians may become distracted by these devices. Objective No validated questionnaire examining the impact of the use of these devices on patient care exists; thus, we aim to develop and validate an online questionnaire for surveying the views of registered nurses with experience of working in hospitals regarding the impact of the use of personal communication devices on hospital units. Methods A 50-item, four-domain questionnaire on the views of registered nursing staff regarding the impact of personal communication devices on hospital units was developed based on a literature review and interviews with such nurses. A repeated measures pilot study was conducted to examine the psychometrics of a survey questionnaire and the feasibility of conducting a larger study. Psychometric testing of the questionnaire included examining internal consistency reliability and test-retest reliability in a sample of 50 registered nurses. Results The response rate for the repeated measures was 30%. Cronbach coefficient alpha was used to examine the internal consistency and reliability, and in three of the four question groups (utilization, impact, and opinions), the correlation was observed to be very high. This suggests that the questions were measuring a single underlying theme. The Cronbach alpha value for the questions in the performance group, describing the use of personal communication devices while working, was lower than those for the other question groups. These values may be an indication that the assumptions underlying the Cronbach alpha calculation may have been violated for this group of questions. A Spearman rho correlation was used to determine the test-retest reliability. There was a strong test-retest reliability between the two tests for the majority of the questions. The average test-retest percent of agreement for the Likert scale responses was 74% (range 43-100%). Accounting for responses within the 1 SD range on the Likert scale increased the agreement to 96% (range 87-100%). Missing data were in the range of 0 to 7%. Conclusions The psychometrics of the questionnaire showed good to fair levels of internal consistency and test-retest reliability. The pilot study demonstrated that our questionnaire may be useful in exploring registered nurses’ perceptions of the impact of personal electronic devices on hospital units in a larger study. PMID:24280660

[Assessment of the validity and reliability of the processes of change scale based on the transtheoretical model of vegetable consumption behavior in Japanese male workers].

PubMed

Kushida, Osamu; Murayama, Nobuko

2012-12-01

A core construct of the Transtheoretical model is that the processes and stages of change are strongly related to observable behavioral changes. We created the Processes of Change Scale of vegetable consumption behavior and examined the validity and reliability of this scale. In September 2009, a self-administered questionnaire was administered to male Japanese employees, aged 20-59 years, working at 20 worksites in Niigata City in Japan. The stages of change (precontempration, contemplation, preparation, action, and maintenance stage) were measured using 2 items that assessed participants' current implementation of the target behavior (eating 5 or more servings of vegetables per day) and their readiness to change their habits. The Processes of Change Scale of vegetable consumption behavior comprised 10 items assessing 5 cognitive processes (consciousness raising, emotional arousal, environmental reevaluation, self-reevaluation, and social liberation) and 5 behavioral processes (commitment, rewards, helping relationships, countering, and environment control). Each item was selected from an existing scale. Decisional balance (pros [2 items] and cons [2 items]), and self-efficacy (3 items) were also assessed, because these constructs were considered to be relevant to the processes of change. The internal consistency reliability of the scale was examined using Cronbach's alpha. Its construct validity was examined using a factor analysis of the processes of change, decisional balance, and self-efficacy variables, while its criterion-related validity was determined by assessing the association between the scale scores and the stages of change. The data of 527 (out of 600) participants (mean age, 41.1 years) were analyzed. Results indicated that the Processes of Change Scale had sufficient internal consistency reliability (Cronbach's alpha: cognitive processes=0.722, behavioral processes=0.803). The processes of change were divided into 2 factors: "consciousness raising, emotional arousal, environmental reevaluation, self-reevaluation, commitment, rewards, helping relationships, and social liberation" and "countering and environment control" in the factor analysis. Moreover, each construct--the processes of change, decisional balance, and self-efficacy--could be classified into different factors. The scores for cognitive processes were higher in the contemplation and preparation stages than in the precontemplation stage (P<0.05). Scores for behavioral processes increased from the precontemplation stage to the preparation stages (P<0.05), and were higher in the action + maintenance stage than in the precontemplation stage (P< 0.05). For male workers, the Processes of Change Scale has sufficient validity and reliability, as demonstrated by the internal fitness and the construct and criterion-related validity of the scale found in this study.

Validity and reliability of a Nigerian-Yoruba version of the stroke-specific quality of life scale 2.0.

PubMed

Odetunde, Marufat Oluyemisi; Akinpelu, Aderonke Omobonike; Odole, Adesola Christiana

2017-10-19

Psychometric evidence is necessary to establish scientific integrity and clinical usefulness of translations and cultural adaptations of the Stroke-Specific Quality of Life (SS-QoL) scale. However, the limited evidence on psychometrics of Yoruba version of SS-QoL 2.0 (SS-QoL(Y)) is a significant shortcoming. This study assessed the test-retest reliability, internal consistency, convergent, divergent, discriminant and known-group validity of the SS-QoL(Y). Yoruba version of the WHOQoL-BREF was used to test the convergent and divergent validity of the SS-QoL(Y) among 100 consenting stroke survivors. The WHOQoL-BREF and SS-QoL(Y) was administered randomly in order to eliminate bias. The test-retest reliability of the SS-QoL(Y) was carried out among 68 of the respondents within an interval of 7 days. All respondents were purposively recruited from selected secondary and tertiary health facilities in South-west Nigeria. Data were analysed using descriptive statistics of mean and standard deviation, and inferential statistics of Spearman correlation, Cronbach's alpha, Intra-class Correlation Coefficient (ICC), Independent t-test and One-way ANOVA. Alpha level was set at p < 0.05. The physical health, psychological health, social relationship and environment domains on WHOQoL-BREF with correlation coefficient that ranged from 0.214 to 0.360 showed significant correlation with similar domains on SS-QoL(Y). Dissimilar domains between the two scales had r values from 0.035 to 0.366. Discriminant validity of SS-QoL(Y) showed that items' r value ranged from 0.711 to 0.920 with their hypothesized domains. The scale demonstrated moderate to strong test-retest reliability with Intra-class correlation coefficient (ICC) for the domains and overall scores (r = 0.47 to 0.81) and moderate to high internal consistency (Cronbach's alpha =0.61 to 0.82) for domains scores. These correlations were also significant for the domains and overall scores (p < 0.05). There were no significant differences across different age groups or gender for the domains or overall scores of SS-QoL(Y). Discriminant and known-group validity, test-retest reliability and internal consistency of the Yoruba version of the Stroke Specific Quality of Life 2.0 are adequate while the convergent and divergent validity are low but acceptable. The SS-QoL(Y) is recommended for assessing health-related quality of life among Yoruba stroke survivors.

Measuring cancer-specific child adjustment difficulties: Development and validation of the Children's Oncology Child Adjustment Scale (ChOCs).

PubMed

Burke, Kylie; McCarthy, Maria; Lowe, Cherie; Sanders, Matthew R; Lloyd, Erin; Bowden, Madeleine; Williams, Lauren

2017-03-01

Childhood cancer is associated with child adjustment difficulties including, eating and sleep disturbance, and emotional and other behavioral difficulties. However, there is a lack of validated instruments to measure the specific child adjustment issues associated with pediatric cancer treatments. The aim of this study was to develop and evaluate the reliability and validity of a parent-reported, child adjustment scale. One hundred thirty-two parents from two pediatric oncology centers who had children (aged 2-10 years) diagnosed with cancer completed the newly developed measure and additional measures of child behavior, sleep, diet, and quality of life. Children were more than 4 weeks postdiagnosis and less than 12 months postactive treatment. Factor structure, internal consistency, and construct (convergent) validity analyses were conducted. Principal component analysis revealed five distinct and theoretically coherent factors: Sleep Difficulties, Impact of Child's Illness, Eating Difficulties, Hospital-Related Behavior Difficulties, and General Behavior Difficulties. The final 25-item measure, the Children's Oncology Child Adjustment Scale (ChOCs), demonstrated good internal consistency (α = 0.79-0.91). Validity of the ChOCs was demonstrated by significant correlations between the subscales and measures of corresponding constructs. The ChOCs provides a new measure of child adjustment difficulties designed specifically for pediatric oncology. Preliminary analyses indicate strong theoretical and psychometric properties. Future studies are required to further examine reliability and validity of the scale, including test-retest reliability, discriminant validity, as well as change sensitivity and generalizability across different oncology samples and ages of children. The ChOCs shows promise as a measure of child adjustment relevant for oncology clinical settings and research purposes. © 2016 Wiley Periodicals, Inc.

Psychometric properties of the Activities-specific Balance Confidence Scale among individuals with a lower-limb amputation.

PubMed

Miller, William C; Deathe, A Barry; Speechley, Mark

2003-05-01

To evaluate the internal consistency, test-retest reliability, and construct validity of the Activities-specific Balance Confidence (ABC) Scale among people who have a lower-limb amputation. Retest design. A university-affiliated outpatient amputee clinic in Ontario. Two samples of individuals who have unilateral transtibial and transfemoral amputation. Sample 1 (n=54) was a consecutive and sample 2 (n=329) a convenience sample of all members of the clinic population. Not applicable. Repeated application of the ABC Scale, a 16-item questionnaire that assesses confidence in performing various mobility-related tasks. Correlation to test hypothesized relationships between the ABC Scale and the 2-minute walk (2MWT) and the timed up-and-go (TUG) tests; and assessment of the ability of the ABC Scale to discriminate among groups based on amputation cause, amputation level, mobility device use, automatic stepping ability, wearing time, stair climbing ability, and walking distance. Test-retest reliability (intraclass correlation coefficient) of the ABC Scale was .91 (95% confidence interval [CI], .84-.95) with individual item test-retest coefficients ranging from .53 to .87. Internal consistency, measured by Cronbach alpha, was .95. Hypothesized associations with the 2MWT and TUG test were observed with correlations of .72 (95% CI, .56-.84) and -.70 (95% CI, -.82 to -.53), respectively. The ABC Scale discriminated between all groups except those based on amputation level. Balance confidence, as measured by the ABC Scale, is a construct that provides unique information potentially useful to clinicians who provide amputee rehabilitation. The ABC Scale is reliable, with strong support for validity. Study of the scale's responsiveness is recommended.

Comprehensive knowledge of HIV among women in rural Mozambique: development and validation of the HIV knowledge 27 scale.

PubMed

Ciampa, Philip J; Skinner, Shannon L; Patricio, Sérgio R; Rothman, Russell L; Vermund, Sten H; Audet, Carolyn M

2012-01-01

The relationship between HIV knowledge and HIV-related behaviors in settings like Mozambique has been limited by a lack of rigorously validated measures. A convenience sample of women seeking prenatal care at two clinics were administered an adapted, orally-administered, 27 item HIV-knowledge scale, the HK-27. Validation analyses were stratified by survey language (Portuguese and Echuabo). Kuder-Richardson (KR-20) coefficients estimated internal reliability. Construct validity was assessed with bivariate associations between HK-27 scores (% correct) and selected participant characteristics. The association between knowledge, self-reported HIV testing, and HIV infection were evaluated with multivariable logistic regression. Participants (N = 348) had a median age of 24; 188 spoke Portuguese, and 160 spoke Echuabo. Mean HK-27 scores were higher for Portuguese-speaking participants than Echuabo-speaking participants (68% correct vs. 42%, p<0.001). Internal reliability was strong (KR-20>0.8) for scales in both languages. Higher HK-27 scores were significantly (p≤0.05) correlated with more education, more media items in the home, a history of HIV testing, and participant work outside of the home for women of both languages. HK-27 scores were independently associated with completion of HIV testing in multivariable analysis (per 1% correct: aOR:1.02, 95%CI:0.01-0.03, p = 0.01), but not with HIV infection. HK-27 is a reliable and valid measure of HIV knowledge among Portuguese and Echuabo-speaking Mozambican women. The HK-27 demonstrated significant knowledge deficits among women in the study, and higher scores were associated with higher HIV testing probability. Future studies should evaluate the role of the HK-27 in longitudinal studies and in other populations.

Translation and Cross-cultural Adaptation of the Hip Disability and Osteoarthritis Score into Persian Language: Reassessment of Validity and Reliability

PubMed Central

Mousavian, Alireza; Kachooie, Amir Reza; Birjandinejad, Ali; Khoshsaligheh, Masood; Ebrahimzadeh, Mohammad Hosein

2018-01-01

Background: This study aimed Persian translation and validation of the hip disability and osteoarthritis outcome score (HOOS) questionnaire. Methods: The study was carried out in two phases. First, we translated the HOOS according to acceptable guidelines. We assessed HOOS content convergent validity on 203 hip osteoarthritis patients using SF-36. Internal consistency was tested using Cronbach's alpha coefficient if each item removed and intraclass correlation coefficient (ICC) for the assessment of test-retest reproducibility. Results: Patients had mean (standard deviation) age of 39 (17). Test-retest ICC in whole was 0.95 (P = 0.014) showing excellent reliability. ICC was 0.92 for the “pain” subscale (P = 0.02), 0.81 for the “symptom” subscale (P = 0.002), 0.81 for the “function of daily living (FDL)” (P = 0.022), 0.88 for the “function of sports and recreational activities” (P = 0.006), but it was 0.62 (P = 0.1) for the “quality of life (QOL).” Cronbach's alpha was 0.92, 0.73, 0.97, 0.86, 0.80, and 0.80 for the pain, symptom, FDL, function of sports, QOL, and stiffness, respectively, showing good to excellent internal consistancy. Having SF-36 for the assessment of convergent validity, there was a strong correlation between total HOOS score and the physical component summary domain of SF-36 (r = 0.64, P = 0.0001), whereas the t correlation with the mental component summary domain was weak (r = 0.16, P = 0.04). Conclusions: The Persian version of the HOOS questionnaire is a valid (regarding physical not mental aspects) and reliable assessment tool in patients with hip osteoarthritis. PMID:29619147

A test of the International Personality Item Pool representation of the Revised NEO Personality Inventory and development of a 120-item IPIP-based measure of the five-factor model.

PubMed

Maples, Jessica L; Guan, Li; Carter, Nathan T; Miller, Joshua D

2014-12-01

There has been a substantial increase in the use of personality assessment measures constructed using items from the International Personality Item Pool (IPIP) such as the 300-item IPIP-NEO (Goldberg, 1999), a representation of the Revised NEO Personality Inventory (NEO PI-R; Costa & McCrae, 1992). The IPIP-NEO is free to use and can be modified to accommodate its users' needs. Despite the substantial interest in this measure, there is still a dearth of data demonstrating its convergence with the NEO PI-R. The present study represents an investigation of the reliability and validity of scores on the IPIP-NEO. Additionally, we used item response theory (IRT) methodology to create a 120-item version of the IPIP-NEO. Using an undergraduate sample (n = 359), we examined the reliability, as well as the convergent and criterion validity, of scores from the 300-item IPIP-NEO, a previously constructed 120-item version of the IPIP-NEO (Johnson, 2011), and the newly created IRT-based IPIP-120 in comparison to the NEO PI-R across a range of outcomes. Scores from all 3 IPIP measures demonstrated strong reliability and convergence with the NEO PI-R and a high degree of similarity with regard to their correlational profiles across the criterion variables (rICC = .983, .972, and .976, respectively). The replicability of these findings was then tested in a community sample (n = 757), and the results closely mirrored the findings from Sample 1. These results provide support for the use of the IPIP-NEO and both 120-item IPIP-NEO measures as assessment tools for measurement of the five-factor model. (c) 2014 APA, all rights reserved.

Substance use disorders: Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV) and International Classification of Diseases, tenth edition (ICD-10).

PubMed

Hasin, Deborah; Hatzenbuehler, Mark L; Keyes, Katherine; Ogburn, Elizabeth

2006-09-01

Two major nomenclatures, Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV) and International Classification of Diseases, tenth edition (ICD-10), currently define substance use disorders for broad audiences of users with different training, experience and interests. A comparison of these definitions and their implications for DSM-V and ICD-11 has not been available. The background for the dependence concept and abuse, harmful use, withdrawal, substance-induced disorders and remission and other substance-related conditions is reviewed. Reliability evidence is presented, as is validity evidence from approaches including psychometric, genetic and animal studies. The relevance of the DSM-IV and ICD-10 compared to alternative systems (e.g. the Addiction Severity Index) is considered. Reliability and psychometric validity evidence for substance dependence is consistently strong, but more mixed for abuse and harmful use. Findings on the genetics of alcohol disorders support the validity of the dependence concept, while animal studies underscore the centrality of continued use despite negative consequences to the concept of dependence. While few studies on substance-induced disorders have been conducted, those published show good reliability and validity when elements of DSM-IV and ICD-10 are combined. Dependence in DSM-V and ICD-11 should be retained, standardizing both criteria sets and adding a severity measure. The consequences of heavy use should be measured independently of dependence; add cannabis withdrawal if further research supports existing evidence; conduct further studies of the substance-induced psychiatric categories; standardize their criteria across DSM-V and ICD-11; develop a theoretical basis for better remission criteria; consider changing substance 'abuse' to substance 'dysfunction disorder'; and conduct clinician education on the value of the diagnostic criteria.

Improving treatment with methotrexate in rheumatoid arthritis-development of a multimedia patient education program and the MiRAK, a new instrument to evaluate methotrexate-related knowledge.

PubMed

Ciciriello, Sabina; Buchbinder, Rachelle; Osborne, Richard H; Wicks, Ian P

2014-02-01

To develop and test an evidence-based, multimedia patient education program (MPEP) about methotrexate (MTX) treatment for rheumatoid arthritis (RA) and a new measure of patient knowledge [Methotrexate in Rheumatoid Arthritis Knowledge test (MiRAK)]. The content of the MPEP and MiRAK was guided by concept-mapping workshops with patients (N = 24), literature review, health professional, and expert linguistic input. The MPEP and MiRAK underwent multiple stages of testing and revision with patients and health professionals. The MiRAK was administered to RA patients (N = 169) and its properties examined using the Rasch analyses. A subset of respondents (N = 131) repeated the MiRAK to determine test-retest reliability. A before-after pilot study with patients who had recently started MTX (N = 31) tested responsiveness of the MiRAK and feasibility and acceptability of the MPEP. A DVD of 24-minutes duration was produced that presents detailed, evidence-based information about MTX. The Rasch analyses of the 60 MiRAK items revealed that these could be summated into a single score. The MiRAK had good model fit, supporting internal construct validity, good internal consistency (person separation index; 0.84), test-retest reliability (ICC; 0.89), and ability to detect change (ES; 2.38). The before-after study suggested that patients could self-administer the MPEP, with the majority finding it informative and easy to use. We developed a MPEP about MTX treatment for RA, which was found to be user-friendly and easily implementable. The MiRAK is a new scale, testing a broad spectrum of MTX knowledge. Analyses revealed strong evidence for its validity and reliability. Copyright © 2014 Elsevier Inc. All rights reserved.

Danish translation and validation of Kessler's 10-item psychological distress scale - K10.

PubMed

Thelin, Camilla; Mikkelsen, Benjamin; Laier, Gunnar; Turgut, Louise; Henriksen, Bente; Olsen, Lis Raabaek; Larsen, Jens Knud; Arnfred, Sidse

2017-08-01

Psychological distress is a trans-diagnostic feature of mental suffering closely associated with mental disorders. Kessler's 10-item Psychological Distress Scale (K10), a scale with sound psychometric properties, is widely used in epidemiological studies. To translate and investigate whether K10 is a reliable and valid rating scale for the measurement of psychological distress in a Danish population. The translation was carried out according to official WHO translation guidelines. A sample of 100 subjects was included, 54 patients from the regional Mental Health Service (MHS) and 46 subjects with no psychiatric history. All participants were assessed with a psychiatric diagnostic interview (MINI) and handed out K10. Concurrent validity was assessed by WHO Well-being Index (WHO-5). Correlation matrix analysis was conducted for the full sample and receiver operating characteristic (ROC) curves for discriminating mental health service affiliation. Mean K10 scores differed, with decreasing levels, between inpatients and outpatient in MHS and the subjects with no psychiatric history. Factor analysis confirmed a unidimensional structure, and Cronbach's alpha and Omega showed excellent internal reliability. AUC for the K10 ROC curves showed excellent sensitivity (0.947 [0.900-0.995]), accurately differentiating mental health from non-mental health patients. The Danish K10 has the same strong internal reliability as the original English version, and scores differ between psychiatric patients in outpatient and emergency ward settings. The Danish K10 translation is authorized and freely available for download at https://www.hcp.med.harvard.edu/ncs/k6_scales.php . The utility as an instrument for clinical screening in a mental healthcare setting is supported.

Validation of a new classification system for skin tears.

PubMed

LeBlanc, Kimberly; Baranoski, Sharon; Holloway, Samantha; Langemo, Diane

2013-06-01

The aim of this study was to validate and establish reliability of the International Skin Tear classification system. A consensus panel of 12 internationally recognized key opinion leaders convened in 2011 to establish consensus statements on the prevention, prediction, assessment, and treatment of skin tears. Subsequently, a new skin tear classification system was proposed. The system was then tested for interrater and intrarater reliability between the experts before being tested more widely on a sample of 327 individuals from the United States, Canada, and Europe. The results of the study indicated a substantial level of agreement for the expert panel (Fleiss κ = 0.619; 2-month follow-up = 0.653). Intrarater reliability was high (Cohen κ = 0.877). Interrater reliability was moderate (Fleiss κ = 0.555) for healthcare professionals (n = 303) and fair for non-health professionals (Fleiss κ = 0.338; n = 24). This international study established the reliability and validity of a new classification system for skin tears.

Long Term Surface Salinity Measurements

NASA Technical Reports Server (NTRS)

Schmitt, Raymond W.; Brown, Neil L.

2005-01-01

Our long-term goal is to establish a reliable system for monitoring surface salinity around the global ocean. Salinity is a strong indicator of the freshwater cycle and has a great influence on upper ocean stratification. Global salinity measurements have potential to improve climate forecasts if an observation system can be developed. This project is developing a new internal field conductivity cell that can be protected from biological fouling for two years. Combined with a temperature sensor, this foul-proof cell can be deployed widely on surface drifters. A reliable in-situ network of surface salinity sensors will be an important adjunct to the salinity sensing satellite AQUARIUS to be deployed by NASA in 2009. A new internal-field conductivity cell has been developed by N Brown, along with new electronics. This sensor system has been combined with a temperature sensor to make a conductivity - temperature (UT) sensor suitable for deployment on drifters. The basic sensor concepts have been proven on a high resolution CTD. A simpler (lower cost) circuit has been built for this application. A protection mechanism for the conductivity cell that includes antifouling protection has also been designed and built. Mr. A.Walsh of our commercial partner E-Paint has designed and delivered time-release formulations of antifoulants for our application. Mr. G. Williams of partner Clearwater Instrumentation advised on power and communication issues and supplied surface drifters for testing.

Development and psychometric evaluation of child acute stress measures in Spanish and English.

PubMed

Kassam-Adams, Nancy; Gold, Jeffrey I; Montaño, Zorash; Kohser, Kristen L; Cuadra, Anai; Muñoz, Cynthia; Armstrong, F Daniel

2013-02-01

Clinicians and researchers need tools for accurate early assessment of children's acute stress reactions and acute stress disorder (ASD). There is a particular need for independently validated Spanish-language measures. The current study reports on 2 measures of child acute stress (a self-report checklist and a semistructured interview), describing the development of the Spanish version of each measure and psychometric evaluation of both the Spanish and English versions. Children between the ages of 8 to 17 years who had experienced a recent traumatic event completed study measures in Spanish (n = 225) or in English (n = 254). Results provide support for reliability (internal consistency of the measures in both languages ranged from .83 to .89; cross-language reliability of the checklist was .93) and for convergent validity (with later PTSD symptoms, and with concurrent anxiety symptoms). Comparing checklist and interview results revealed a strong association between severity scores within the Spanish and English samples. Differences between the checklist and interview in evaluating the presence of ASD appear to be linked to different content coverage for dissociation symptoms. Future studies should further assess the impact of differing assessment modes, content coverage, and the use of these measures in children with diverse types of acute trauma exposure in English- and Spanish-speaking children. Copyright © 2013 International Society for Traumatic Stress Studies.

A new music therapy engagement scale for persons with dementia.

PubMed

Tan, Jane; Wee, Shiou-Liang; Yeo, Pei Shi; Choo, Juliet; Ritholz, Michele; Yap, Philip

2018-05-25

ABSTRACTObjectives:To develop and validate a new scale to assess music therapy engagement in persons with dementia (PWDs). A draft scale was derived from literature review and >2 years of qualitative recording of PWDs during music therapy. Content validity was attained through iterative consultations, trial sessions, and revisions. The final five-item Music Therapy Engagement scale for Dementia (MTED) assessed music and non-music related elements. Internal consistency and inter-rater reliability were assessed over 120 music therapy sessions. MTED was validated with the Greater Cincinnati Chapter Well-being Observation Tool, Holden Communication Scale, and Participant Engagement Observation Checklist - Music Sessions. A total of 62 PWDs (83.2 ± 7.7 years, modified version of the mini-mental state examination = 13.2/30 ± 4.1) in an acute hospital dementia unit were involved. The mean MTED score was 13.02/30 ± 4.27; internal consistency (Cronbach's α = 0.87) and inter-rater reliability (intra-class correlation = 0.96) were good. Principal component analysis revealed a one-factor structure with Eigen value > 1 (3.27), which explained 65.4% of the variance. MTED demonstrated good construct validity. The MTED total score correlated strongly with the combined items comprising Pleasure, Interest, Sadness, and Sustained attention of the Greater Cincinnati Chapter Well-being Observation Tool (rs = 0.88, p < 0.001). MTED is a clinically appropriate and psychometrically valid scale to evaluate music therapy engagement in PWDs.

Validation of the FACT-B+4-UL questionnaire and exploration of its predictive value in women submitted to surgery for breast cancer.

PubMed

Andrade Ortega, Juan Alfonso; Millán Gómez, Ana Pilar; Ribeiro González, Marisa; Martínez Piró, Pilar; Jiménez Anula, Juan; Sánchez Andújar, María Belén

2017-06-21

The early detection of upper limb complications is important in women operated on for breast cancer. The "FACT-B+4-UL" questionnaire, a specific variant of the Functional Assessment of Cancer Therapy-Breast (FACT-B) is available among others to measure the upper limb function. The Spanish version of the upper limb subscale of the FACT-B+4 was validated in a prospective cohort of 201 women operated on for breast cancer (factor analysis, internal consistency, test-retest reliability, construct validity and sensitivity to change were determined). Its predictive capacity of subsequent lymphoedema and other complications in the upper limb was explored using logistic regression. This subscale is unifactorial and has a great internal consistency (Cronbach's alpha: 0.87), its test-retest reliability and construct validity are strong (intraclass correlation coefficient: 0.986; Pearson's R with "Quick DASH": 0.81) as is its sensitivity to change. It didn't predict the onset of lymphedema. Its predictive capacity for other upper limb complications is low. FACT-B+4-UL is useful in measuring upper limb disability in women surgically treated for breast cancer; but it does not predict the onset of lymphoedema and its predictive capacity for others complications in the upper limb is low. Copyright © 2017 Elsevier España, S.L.U. All rights reserved.

Profiling medical school learning environments in Malaysia: a validation study of the Johns Hopkins Learning Environment Scale.

PubMed

Tackett, Sean; Bakar, Hamidah Abu; Shilkofski, Nicole A; Coady, Niamh; Rampal, Krishna; Wright, Scott

2015-01-01

While a strong learning environment is critical to medical student education, the assessment of medical school learning environments has confounded researchers. Our goal was to assess the validity and utility of the Johns Hopkins Learning Environment Scale (JHLES) for preclinical students at three Malaysian medical schools with distinct educational and institutional models. Two schools were new international partnerships, and the third was school leaver program established without international partnership. First- and second-year students responded anonymously to surveys at the end of the academic year. The surveys included the JHLES, a 28-item survey using five-point Likert scale response options, the Dundee Ready Educational Environment Measure (DREEM), the most widely used method to assess learning environments internationally, a personal growth scale, and single-item global learning environment assessment variables. The overall response rate was 369/429 (86%). After adjusting for the medical school year, gender, and ethnicity of the respondents, the JHLES detected differences across institutions in four out of seven domains (57%), with each school having a unique domain profile. The DREEM detected differences in one out of five categories (20%). The JHLES was more strongly correlated than the DREEM to two thirds of the single-item variables and the personal growth scale. The JHLES showed high internal reliability for the total score (α=0.92) and the seven domains (α, 0.56-0.85). The JHLES detected variation between learning environment domains across three educational settings, thereby creating unique learning environment profiles. Interpretation of these profiles may allow schools to understand how they are currently supporting trainees and identify areas needing attention.

Profiling medical school learning environments in Malaysia: a validation study of the Johns Hopkins Learning Environment Scale

PubMed Central

Tackett, Sean; Bakar, Hamidah Abu; Shilkofski, Nicole A.; Coady, Niamh; Rampal, Krishna; Wright, Scott

2015-01-01

Purpose: While a strong learning environment is critical to medical student education, the assessment of medical school learning environments has confounded researchers. Our goal was to assess the validity and utility of the Johns Hopkins Learning Environment Scale (JHLES) for preclinical students at three Malaysian medical schools with distinct educational and institutional models. Two schools were new international partnerships, and the third was school leaver program established without international partnership. Methods: First- and second-year students responded anonymously to surveys at the end of the academic year. The surveys included the JHLES, a 28-item survey using five-point Likert scale response options, the Dundee Ready Educational Environment Measure (DREEM), the most widely used method to assess learning environments internationally, a personal growth scale, and single-item global learning environment assessment variables. Results: The overall response rate was 369/429 (86%). After adjusting for the medical school year, gender, and ethnicity of the respondents, the JHLES detected differences across institutions in four out of seven domains (57%), with each school having a unique domain profile. The DREEM detected differences in one out of five categories (20%). The JHLES was more strongly correlated than the DREEM to two thirds of the single-item variables and the personal growth scale. The JHLES showed high internal reliability for the total score (α=0.92) and the seven domains (α, 0.56-0.85). Conclusion: The JHLES detected variation between learning environment domains across three educational settings, thereby creating unique learning environment profiles. Interpretation of these profiles may allow schools to understand how they are currently supporting trainees and identify areas needing attention. PMID:26165949

Reliability and validity of the de Morton Mobility Index in individuals with sub-acute stroke.

PubMed

Braun, Tobias; Marks, Detlef; Thiel, Christian; Grüneberg, Christian

2018-02-04

To establish the validity and reliability of the de Morton Mobility Index (DEMMI) in patients with sub-acute stroke. This cross-sectional study was performed in a neurological rehabilitation hospital. We assessed unidimensionality, construct validity, internal consistency reliability, inter-rater reliability, minimal detectable change and possible floor and ceiling effects of the DEMMI in adult patients with sub-acute stroke. The study included a total sample of 121 patients with sub-acute stroke. We analysed validity (n = 109) and reliability (n = 51) in two sub-samples. Rasch analysis indicated unidimensionality with an overall fit to the model (chi-square = 12.37, p = 0.577). All hypotheses on construct validity were confirmed. Internal consistency reliability (Cronbach's alpha = 0.94) and inter-rater reliability (intraclass correlation coefficient = 0.95; 95% confidence interval: 0.92-0.97) were excellent. The minimal detectable change with 90% confidence was 13 points. No floor or ceiling effects were evident. These results indicate unidimensionality, sufficient internal consistency reliability, inter-rater reliability, and construct validity of the DEMMI in patients with a sub-acute stroke. Advantages of the DEMMI in clinical application are the short administration time, no need for special equipment and interval level data. The de Morton Mobility Index, therefore, may be a useful performance-based bedside test to measure mobility in individuals with a sub-acute stroke across the whole mobility spectrum. Implications for Rehabilitation The de Morton Mobility Index (DEMMI) is an unidimensional measurement instrument of mobility in individuals with sub-acute stroke. The DEMMI has excellent internal consistency and inter-rater reliability, and sufficient construct validity. The minimal detectable change of the DEMMI with 90% confidence in stroke rehabilitation is 13 points. The lack of any floor or ceiling effects on hospital admission indicates applicability across the whole mobility spectrum of patients with sub-acute stroke.

77 FR 47670 - Amended Certification Regarding Eligibility To Apply for Worker Adjustment Assistance

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-09

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-75,151; TA-W-75,151A] Amended... Reliability Center, A Subsidiary of Navistar International Corporation, Truck Division, Including All On-Site... Reliability Center, a Subsidiary of Navistar International Corporation, Truck Division, 3033 Wayne Trace, Fort...

Nurses as Evaluators of the Humanistic Behavior of Internal Medicine Residents.

ERIC Educational Resources Information Center

Butterfield, Paula S.; And Others

1987-01-01

The reliability of a 13-item questionnaire designed to assess the humanistic behaviors of internal medicine residents and the reliability of nurses as raters of those behaviors were examined. Residents were evaluated by nurses on two general medicine services and on cardiology and hematology-oncology services. (Author/MLW)

Internal Consistency Reliability of the Self-Report Antisocial Process Screening Device

ERIC Educational Resources Information Center

Poythress, Norman G.; Douglas, Kevin S.; Falkenbach, Diana; Cruise, Keith; Lee, Zina; Murrie, Daniel C.; Vitacco, Michael

2006-01-01

The self-report version of the Antisocial Process Screening Device (APSD) has become a popular measure for assessing psychopathic features in justice-involved adolescents. However, the internal consistency reliability of its component scales (Narcissism, Callous-Unemotional, and Impulsivity) has been questioned in several studies. This study…

The Effects of Participation Rate on the Internal Reliability of Peer Nomination Measures

ERIC Educational Resources Information Center

Marks, Peter E. L.; Babcock, Ben; Cillessen, Antonius H. N.; Crick, Nicki R.

2013-01-01

Although low participation rates have historically been considered problematic in peer nomination research, some researchers have recently argued that small proportions of participants can, in fact, provide adequate sociometric data. The current study used a classical measurement perspective to investigate the internal reliability (Cronbach's…

Item Analysis to Improve Reliability for an Internal Medicine Undergraduate OSCE

ERIC Educational Resources Information Center

Auewarakul, Chirayu; Downing, Steven M.; Praditsuwan, Rungnirand; Jaturatamrong, Uapong

2005-01-01

Utilization of objective structured clinical examinations (OSCEs) for final assessment of medical students in Internal Medicine requires a representative sample of OSCE stations. The reliability and generalizability of OSCE scores provides validity evidence for OSCE scores and supports its contribution to the final clinical grade of medical…

Internal consistency reliability and validity of the Arabic translation of the Mathematics Teaching Efficacy Beliefs Instrument.

PubMed

Alkhateeb, Haitham M

2004-06-01

The Arabic translation of the Mathematics Teaching Efficacy Beliefs was completed by 144 undergraduate students (M age=20.6) in Jordan. The findings support the internal reliability of the Arabic translation of the Mathematics Teaching Efficacy Beliefs as well as its construct validity.

The Psychometric Properties of the Center for Epidemiologic Studies Depression Scale in Chinese Primary Care Patients: Factor Structure, Construct Validity, Reliability, Sensitivity and Responsiveness

PubMed Central

2015-01-01

Background The Center for Epidemiologic Studies Depression Scale (CES-D) is a commonly used instrument to measure depressive symptomatology. Despite this, the evidence for its psychometric properties remains poorly established in Chinese populations. The aim of this study was to validate the use of the CES-D in Chinese primary care patients by examining factor structure, construct validity, reliability, sensitivity and responsiveness. Methods and Results The psychometric properties were assessed amongst a sample of 3686 Chinese adult primary care patients in Hong Kong. Three competing factor structure models were examined using confirmatory factor analysis. The original CES-D four-structure model had adequate fit, however the data was better fit into a bi-factor model. For the internal construct validity, corrected item-total correlations were 0.4 for most items. The convergent validity was assessed by examining the correlations between the CES-D, the Patient Health Questionnaire 9 (PHQ-9) and the Short Form-12 Health Survey (version 2) Mental Component Summary (SF-12 v2 MCS). The CES-D had a strong correlation with the PHQ-9 (coefficient: 0.78) and SF-12 v2 MCS (coefficient: -0.75). Internal consistency was assessed by McDonald’s omega hierarchical (ωH). The ωH value for the general depression factor was 0.855. The ωH values for “somatic”, “depressed affect”, “positive affect” and “interpersonal problems” were 0.434, 0.038, 0.738 and 0.730, respectively. For the two-week test-retest reliability, the intraclass correlation coefficient was 0.91. The CES-D was sensitive in detecting differences between known groups, with the AUC >0.7. Internal responsiveness of the CES-D to detect positive and negative changes was satisfactory (with p value <0.01 and all effect size statistics >0.2). The CES-D was externally responsive, with the AUC>0.7. Conclusions The CES-D appears to be a valid, reliable, sensitive and responsive instrument for screening and monitoring depressive symptoms in adult Chinese primary care patients. In its original four-factor and bi-factor structure, the CES-D is supported for cross-cultural comparisons of depression in multi-center studies. PMID:26252739

Development of an Electromechanical Grade to Assess Human Knee Articular Cartilage Quality.

PubMed

Sim, Sotcheadt; Hadjab, Insaf; Garon, Martin; Quenneville, Eric; Lavigne, Patrick; Buschmann, Michael D

2017-10-01

Quantitative assessments of articular cartilage function are needed to aid clinical decision making. Our objectives were to develop a new electromechanical grade to assess quantitatively cartilage quality and test its reliability. Electromechanical properties were measured using a hand-held electromechanical probe on 200 human articular surfaces from cadaveric donors and osteoarthritic patients. These data were used to create a reference electromechanical property database and to compare with visual arthroscopic International Cartilage Repair Society (ICRS) grading of cartilage degradation. The effect of patient-specific and location-specific characteristics on electromechanical properties was investigated to construct a continuous and quantitative electromechanical grade analogous to ICRS grade. The reliability of this novel grade was assessed by comparing it with ICRS grades on 37 human articular surfaces. Electromechanical properties were not affected by patient-specific characteristics for each ICRS grade, but were significantly different across the articular surface. Electromechanical properties varied linearly with ICRS grade, leading to a simple linear transformation from one scale to the other. The electromechanical grade correlated strongly with ICRS grade (r = 0.92, p < 0.0001). Additionally, the electromechanical grade detected lesions that were not found visually. This novel grade can assist the surgeon in assessing human knee cartilage by providing a quantitative and reliable grading system.

Cross-cultural adaptation, validity, and reliability of the Parenting Styles and Dimensions Questionnaire - Short Version (PSDQ) for use in Brazil.

PubMed

Oliveira, Thaís D; Costa, Danielle de S; Albuquerque, Maicon R; Malloy-Diniz, Leandro F; Miranda, Débora M; de Paula, Jonas J

2018-06-11

The Parenting Styles and Dimensions Questionnaire (PSDQ) is used worldwide to assess three styles (authoritative, authoritarian, and permissive) and seven dimensions of parenting. In this study, we adapted the short version of the PSDQ for use in Brazil and investigated its validity and reliability. Participants were 451 mothers of children aged 3 to 18 years, though sample size varied with analyses. The translation and adaptation of the PSDQ followed a rigorous methodological approach. Then, we investigated the content, criterion, and construct validity of the adapted instrument. The scale content validity index (S-CVI) was considered adequate (0.97). There was evidence of internal validity, with the PSDQ dimensions showing strong correlations with their higher-order parenting styles. Confirmatory factor analysis endorsed the three-factor, second-order solution (i.e., three styles consisting of seven dimensions). The PSDQ showed convergent validity with the validated Brazilian version of the Parenting Styles Inventory (Inventário de Estilos Parentais - IEP), as well as external validity, as it was associated with several instruments measuring sociodemographic and behavioral/emotional-problem variables. The PSDQ is an effective and reliable psychometric instrument to assess childrearing strategies according to Baumrind's model of parenting styles.

Population-based study of intra-household gender differences in water insecurity: reliability and validity of a survey instrument for use in rural Uganda.

PubMed

Tsai, Alexander C; Kakuhikire, Bernard; Mushavi, Rumbidzai; Vořechovská, Dagmar; Perkins, Jessica M; McDonough, Amy Q; Bangsberg, David R

2016-04-01

Hundreds of millions of people worldwide lack adequate access to water. Water insecurity, which is defined as having limited or uncertain availability of safe water or the ability to acquire safe water in socially acceptable ways, is typically overlooked by development organizations focusing on water availability. To address the urgent need in the literature for validated measures of water insecurity, we conducted a population-based study in rural Uganda with 327 reproductive-age women and 204 linked men from the same households. We used a novel method of photo identification so that we could accurately elicit study participants' primary household water sources, thereby enabling us to identify water sources for objective water quality testing and distance/elevation measurement. Our psychometric analyses provided strong evidence of the internal structure, reliability, and validity of a new eight-item Household Water Insecurity Access Scale (HWIAS). Important intra-household gender differences in perceptions of water insecurity were observed, with men generally perceiving household water insecurity as being less severe compared to women. In summary, the HWIAS represents a reliable and valid measure of water insecurity, particularly among women, and may be useful for informing and evaluating interventions to improve water access in resource-limited settings.

Population-Based Study of Intra-Household Gender Differences in Water Insecurity: Reliability and Validity of a Survey Instrument for Use in Rural Uganda

PubMed Central

Tsai, Alexander C.; Kakuhikire, Bernard; Mushavi, Rumbidzai; Vořechovská, Dagmar; Perkins, Jessica M.; McDonough, Amy Q.; Bangsberg, David R.

2015-01-01

Hundreds of millions of persons worldwide lack adequate access to water. Water insecurity, which is defined as having limited or uncertain availability of safe water or the ability to acquire safe water in socially acceptable ways, is typically overlooked by development organizations focusing on water availability. To address the urgent need in the literature for validated measures of water insecurity, we conducted a population-based study in rural Uganda with 327 reproductive-age women and 204 linked men from the same households. We used a novel method of photo identification so that we could accurately elicit study participants’ primary household water sources, thereby enabling us to identify water sources for objective water quality testing and distance/elevation measurement. Our psychometric analyses provided strong evidence of the internal structure, reliability, and validity of a new 8-item Household Water Insecurity Access Scale. Important intra-household gender differences in perceptions of water insecurity were observed, with men generally perceiving household water insecurity as being less severe compared to women. In summary, the Household Water Insecurity Access Scale represents a reliable and valid measure of water insecurity, particularly among women, and may be useful for informing and evaluating interventions to improve water access in resource limited settings. PMID:27105413

A Comparison of the Fagerström Test for Cigarette Dependence and Cigarette Dependence Scale in a Treatment-Seeking Sample of Pregnant Smokers

PubMed Central

Singleton, Edward G.; Heishman, Stephen J.

2016-01-01

Introduction: Valid and reliable brief measures of cigarette dependence are essential for research purposes and effective clinical care. Two widely-used brief measures of cigarette dependence are the six-item Fagerström Test for Cigarette Dependence (FTCD) and five-item Cigarette Dependence Scale (CDS-5). Their respective metric characteristics among pregnant smokers have not yet been studied. Methods: This was a secondary analysis of data of pregnant smokers (N = 476) enrolled in a smoking cessation study. We assessed internal consistency, reliability, and examined correlations between the instruments and smoking-related behaviors for construct validity. We evaluated predictive validity by testing how well the measures predict abstinence 2 weeks after quit date. Results: Cronbach’s alpha coefficient for the CDS-5 was 0.62 and for the FTCD 0.55. Measures were strongly correlated with each other, although FTCD, but not CDS-5, was associated with saliva cotinine concentration. The FTCD, CDS-5, craving to smoke, and withdrawal symptoms failed to predict smoking status 2 weeks following the quit date. Conclusions: Suboptimal reliability estimates and failure to predict short-term smoking call into question the value of including either of the brief measures in studies that aim to explain the obstacles to smoking cessation during pregnancy. PMID:25995159

Development and evaluation of social cognitive measures related to adolescent physical activity.

PubMed

Dewar, Deborah L; Lubans, David Revalds; Morgan, Philip James; Plotnikoff, Ronald C

2013-05-01

This study aimed to develop and evaluate the construct validity and reliability of modernized social cognitive measures relating to physical activity behaviors in adolescents. An instrument was developed based on constructs from Bandura's Social Cognitive Theory and included the following scales: self-efficacy, situation (perceived physical environment), social support, behavioral strategies, and outcome expectations and expectancies. The questionnaire was administered in a sample of 171 adolescents (age = 13.6 ± 1.2 years, females = 61%). Confirmatory factor analysis was employed to examine model-fit for each scale using multiple indices, including chi-square index, comparative-fit index (CFI), goodness-of-fit index (GFI), and the root mean square error of approximation (RMSEA). Reliability properties were also examined (ICC and Cronbach's alpha). Each scale represented a statistically sound measure: fit indices indicated each model to be an adequate-to-exact fit to the data; internal consistency was acceptable to good (α = 0.63-0.79); rank order repeatability was strong (ICC = 0.82-0.91). Results support the validity and reliability of social cognitive scales relating to physical activity among adolescents. As such, the developed scales have utility for the identification of potential social cognitive correlates of youth physical activity, mediators of physical activity behavior changes and the testing of theoretical models based on Social Cognitive Theory.

Relating Measurement Invariance, Cross-Level Invariance, and Multilevel Reliability.

PubMed

Jak, Suzanne; Jorgensen, Terrence D

2017-01-01

Data often have a nested, multilevel structure, for example when data are collected from children in classrooms. This kind of data complicate the evaluation of reliability and measurement invariance, because several properties can be evaluated at both the individual level and the cluster level, as well as across levels. For example, cross-level invariance implies equal factor loadings across levels, which is needed to give latent variables at the two levels a similar interpretation. Reliability at a specific level refers to the ratio of true score variance over total variance at that level. This paper aims to shine light on the relation between reliability, cross-level invariance, and strong factorial invariance across clusters in multilevel data. Specifically, we will illustrate how strong factorial invariance across clusters implies cross-level invariance and perfect reliability at the between level in multilevel factor models.

Parental discipline behaviours and beliefs about their child: associations with child internalizing and mediation relationships.

PubMed

Laskey, B J; Cartwright-Hatton, S

2009-09-01

Internalizing disorders of childhood are a common and disabling problem, with sufferers at increased risk of subsequent psychiatric morbidity. Several studies have found associations between parenting styles and children's internalizing, although few have considered the role of parental discipline. Parental discipline style may exert an effect on children's internalizing symptoms. Anxiety and depression are reliably found to run in families and parental anxiety has been shown to effect parenting behaviour. This study set out to examine the links between parental anxiety, parental discipline style and child internalizing symptoms. Eighty-eight parents of children aged 4-10 years were recruited through primary schools. All parents completed questionnaires including measures relating to: adult anxiety (State-Trait Anxiety Inventory - Trait version, Penn State Worry Questionnaire), parental depression (Beck Depression Inventory - Fastscreen), parental discipline (The Parenting Scale), parenting-related attributions (Parenting Attitudes, Beliefs and Cognitions Scale) and child psychological morbidity (Child Behaviour Checklist 4-18 version). Significant correlations were found between both parental anxiety and child internalizing symptoms with ineffective discipline and negative beliefs about parenting. Particularly strong correlations were found between parental anxiety and child internalizing symptoms with harsh discipline. Parents of anxious/withdrawn children were more likely to hold negative beliefs about their child. The link between parental anxiety and child internalizing symptoms was mediated by harsh discipline. The link between parental anxiety and harsh discipline was mediated by parental beliefs about the child. Discipline style may be an important factor in the relationship between parent anxiety and child internalizing symptoms.

Validity and reliability of the session-RPE method for quantifying training in Australian football: a comparison of the CR10 and CR100 scales.

PubMed

Scott, Tannath J; Black, Cameron R; Quinn, John; Coutts, Aaron J

2013-01-01

The purpose of this study was to examine and compare the criterion validity and test-retest reliability of the CR10 and CR100 rating of perceived exertion (RPE) scales for team sport athletes that undertake high-intensity, intermittent exercise. Twenty-one male Australian football (AF) players (age: 19.0 ± 1.8 years, body mass: 83.92 ± 7.88 kg) participated the first part (part A) of this study, which examined the construct validity of the session-RPE (sRPE) method for quantifying training load in AF. Ten male athletes (age: 16.1 ± 0.5 years) participated in the second part of the study (part B), which compared the test-retest reliability of the CR10 and CR100 RPE scales. In part A, the validity of the sRPE method was assessed by examining the relationships between sRPE, and objective measures of internal (i.e., heart rate) and external training load (i.e., distance traveled), collected from AF training sessions. Part B of the study assessed the reliability of sRPE through examining the test-retest reliability of sRPE during 3 different intensities of controlled intermittent running (10, 11.5, and 13 km·h(-1)). Results from part A demonstrated strong correlations for CR10- and CR100-derived sRPE with measures of internal training load (Banisters TRIMP and Edwards TRIMP) (CR10: r = 0.83 and 0.83, and CR100: r = 0.80 and 0.81, p < 0.05). Correlations between sRPE and external training load (distance, higher speed running and player load) for both the CR10 (r = 0.81, 0.71, and 0.83) and CR100 (r = 0.78, 0.69, and 0.80) were significant (p < 0.05). Results from part B demonstrated poor reliability for both the CR10 (31.9% CV) and CR100 (38.6% CV) RPE scales after short bouts of intermittent running. Collectively, these results suggest both CR10- and CR100-derived sRPE methods have good construct validity for assessing training load in AF. The poor levels of reliability revealed under field testing indicate that the sRPE method may not be sensible to detecting small changes in exercise intensity during brief intermittent running bouts. Despite this limitation, the sRPE remains a valid method to quantify training loads in high-intensity, intermittent team sport.

Development and Validation of the Sleep Inertia Questionnaire (SIQ) and Assessment of Sleep Inertia in Analogue and Clinical Depression

PubMed Central

Kanady, Jennifer C.; Harvey, Allison G.

2015-01-01

Sleep inertia is the transitional state from sleep to wake. Research on sleep inertia is important in depression because many people with depression report having difficulty getting out of bed, which contributes to impairment and can impede the implementation of interventions. The first aim was to develop and validate the first self-report measure of sleep inertia, the Sleep Inertia Questionnaire (SIQ). The second aim was to compare reports of sleep inertia across three groups: (1) No-to-Mild-Depression, (2) Analogue-Depression, and (3) Syndromal-Depression. The SIQ demonstrates strong psychometric properties; it has good to excellent internal consistency, strong construct validity, and SIQ severity is associated with less prior sleep duration. Sleep inertia is more severe in the Analogue-Depression and Syndromal-Depression groups compared to the No-to-Mild-Depression group. In conclusion, the SIQ is a reliable measure of sleep inertia and has potential for improving the assessment of sleep inertia in clinical and research settings. PMID:26451063

Development and Validation of the Sleep Inertia Questionnaire (SIQ) and Assessment of Sleep Inertia in Analogue and Clinical Depression.

PubMed

Kanady, Jennifer C; Harvey, Allison G

2015-10-01

Sleep inertia is the transitional state from sleep to wake. Research on sleep inertia is important in depression because many people with depression report having difficulty getting out of bed, which contributes to impairment and can impede the implementation of interventions. The first aim was to develop and validate the first self-report measure of sleep inertia, the Sleep Inertia Questionnaire (SIQ). The second aim was to compare reports of sleep inertia across three groups: (1) No-to-Mild-Depression, (2) Analogue-Depression, and (3) Syndromal-Depression. The SIQ demonstrates strong psychometric properties; it has good to excellent internal consistency, strong construct validity, and SIQ severity is associated with less prior sleep duration. Sleep inertia is more severe in the Analogue-Depression and Syndromal-Depression groups compared to the No-to-Mild-Depression group. In conclusion, the SIQ is a reliable measure of sleep inertia and has potential for improving the assessment of sleep inertia in clinical and research settings.

Investigating the internal structure of galaxies and clusters through strong gravitational lensing

NASA Astrophysics Data System (ADS)

Jigish Gandhi, Pratik; Grillo, Claudio; Bonamigo, Mario

2018-01-01

Gravitational lensing studies have radically improved our understanding of the internal structure of galaxies and cluster-scale systems. In particular, the combination of strong lensing and stellar dynamics or stellar population synthesis models have made it possible to characterize numerous fundamental properties of the galaxies as well as dark matter halos and subhalos with unprecedented robustness and accuracy. Here we demonstrate the usefulness and accuracy of strong lensing as a probe for characterising the properties of cluster members as well as dark matter halos, to show that such characterisation carried out via lensing analyses alone is as viable as those carried out through a combination of spectroscopy and lensing analyses.Our study uses focuses on the early-type galaxy cluster MACS J1149.5+2223 at redshift 0.54 in the Hubble Frontier Fields (HFF) program, where the first magnified and spatially resolved multiple images of supernova (SN) “Refsdal” and its late-type host galaxy at redshift 1.489 were detected. The Refsdal system is unique in being the first ever multiply-imaged supernova, with it’s first four images appearing in an Einstein Cross configuration around one of the cluster members in 2015. In our lensing analyses we use HST data of the multiply-imaged SN Refsdal to constrain the dynamical masses, velocity dispersions, and virial radii of individual galaxies and dark matter halos in the MACS J1149.5+2223 cluster. For our lensing models we select a sample of 300 cluster members within approximately 500 kpc from the BCG, and a set of reliable multiple images associated with 18 distinct knots in the SN host spiral galaxy, as well as multiple images of the supernova itself. Our results provide accurate measurements of the masses, velocity dispersions, and radii of the cluster’s dark matter halo as well as three chosen members galaxies, in strong agreement with those obtained by Grillo et al 2015, demonstrating the usefulness of strong lensing in characterising the properties of cluster-scale systems.

Study samples are too small to produce sufficiently precise reliability coefficients.

PubMed

Charter, Richard A

2003-04-01

In a survey of journal articles, test manuals, and test critique books, the author found that a mean sample size (N) of 260 participants had been used for reliability studies on 742 tests. The distribution was skewed because the median sample size for the total sample was only 90. The median sample sizes for the internal consistency, retest, and interjudge reliabilities were 182, 64, and 36, respectively. The author presented sample size statistics for the various internal consistency methods and types of tests. In general, the author found that the sample sizes that were used in the internal consistency studies were too small to produce sufficiently precise reliability coefficients, which in turn could cause imprecise estimates of examinee true-score confidence intervals. The results also suggest that larger sample sizes have been used in the last decade compared with those that were used in earlier decades.

The reliability paradox of the Parent-Child Conflict Tactics Corporal Punishment Subscale.

PubMed

Lorber, Michael F; Slep, Amy M Smith

2018-02-01

In the present investigation we consider and explain an apparent paradox in the measurement of corporal punishment with the Parent-Child Conflict Tactics Scale (CTS-PC): How can it have poor internal consistency and still be reliable? The CTS-PC was administered to a community sample of 453 opposite sex couples who were parents of 3- to 7-year-old children. Internal consistency was marginal, yet item response theory analyses revealed that reliability rose sharply with increasing corporal punishment, exceeding .80 in the upper ranges of the construct. The results suggest that the CTS-PC Corporal Punishment subscale reliably discriminates among parents who report average to high corporal punishment (64% of mothers and 56% of fathers in the present sample), despite low overall internal consistency. These results have straightforward implications for the use and reporting of the scale. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Confirmatory Factor Analysis and Test-Retest Reliability of the Alcohol and Drug Confrontation Scale (ADCS)

PubMed Central

Polcin, Douglas L.; Galloway, Gantt P.; Bond, Jason; Korcha, Rachael; Greenfield, Thomas K.

2008-01-01

The addiction field lacks an accepted definition and reliable measure of confrontation. The Alcohol and Drug Confrontation Scale (ADCS) defines confrontation as warnings about the potential consequences of substance use. To assess psychometric properties, 323 individual entering recovery houses in U.S. urban and suburban areas were interviewed between 2003 and 2005 (20% women, 68% white). Analyses included test-retest reliability, confirmatory factor analysis, and measures of internal consistency. Findings support the ADCS as a reliable way of assessing two factors: Internal Support and External intensity. Confrontation was experienced as supportive, accurate and helpful. Additional studies should assess confrontation in different contexts. PMID:20686635

Validation of a global assessment of arthroscopic skills in a cadaveric knee model.

PubMed

Slade Shantz, Jesse A; Leiter, Jeff R; Collins, John B; MacDonald, Peter B

2013-01-01

The purpose of this study was to determine whether a global assessment of arthroscopic skills was valid for blinded assessment of cadaveric diagnostic knee arthroscopy. A global skills assessment for arthroscopy was created using a published theory of the development of expertise. Faculty surgeons, fellows, and residents were consented and enrolled in this institutional review board-approved validation study. All participants were oriented to the equipment and procedures for diagnostic arthroscopy of the knee. After reviewing the anatomic structures to be visualized, participants were allowed 10 minutes to complete a diagnostic arthroscopy of the knee. The hands and arthroscopic view were recorded during this attempt. Resident participants completed a second filmed diagnostic arthroscopy 1 week after the initial attempt. Five blinded reviewers watched the synchronized videos and assessed arthroscopic skills with a procedure-specific checklist and the newly developed global skills assessment. The agreement between reviewers was determined by intraclass correlation coefficient. Internal consistency was determined with Cronbach's α. Test-retest reliability was measured by correlating repeated arthroscopies by residents. The ability of the global assessment to discriminate skill levels was determined with between-group Mann-Whitney U tests. The agreement between global assessment scores was strong (I.C.C. = 0.80, 95% C.I. 0.68-0.92). The internal consistency of evaluations was excellent (Cronbach's α = 0.97), and the test-retest reliability was strong (r = 0.52). The global assessment score was shown to be able to discriminate between skill levels by an analysis of variance indicating the difference in means among the various levels of training (P < .0001). The Objective Assessment of Arthroscopic Skills is a useful adjunct to arthroscopic educators and learners and could be used for in-training evaluations. The Objective Assessment of Arthroscopic Skills is an instrument that can be employed to measure the impact of skills curricula, including but not limited to simulation. Copyright © 2013 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Polish translation and validation of the Pelvic Organ Prolapse/Urinary Incontinence Sexual Questionnaire, IUGA-Revised (PISQ-IR).

PubMed

Grzybowska, Magdalena Emilia; Piaskowska-Cala, Justyna; Wydra, Dariusz Grzegorz

2017-12-29

The aim of the study was to translate into Polish the Pelvic Organ Prolapse/Incontinence Sexual Questionnaire, IUGA-Revised (PISQ-IR), which evaluates sexual function in sexually active (SA) and not SA (NSA) women with pelvic floor disorders (PFD), and to validate the Polish version. After translation, back-translation and cognitive interviews, the final version of PISQ-IR was established. The study group included 252 women with PFD (124 NSA and 128 SA). All women underwent clinical evaluation and completed the PISQ-IR. For test-retest reliability, the questionnaire was administered to 99 patients twice at an interval of 2 weeks. The analysis of criterion validity required the subjects to complete self-reported measures. Internal consistency and criterion validity were assessed separately for NSA and SA women for the PISQ-IR subscales. The mean age of the women was 60.9 ± 10.6 years and their mean BMI was 27.9 ± 4.9 kg/m 2 . Postmenopausal women constituted 82.5% of the study group. Urinary incontinence (UI) was diagnosed in 60 women (23.8%), pelvic organ prolapse (POP) in 90 (35.7%), and UI and POP in 102 (40.5%). Fecal incontinence was reported by 45 women (17.9%). The PISQ-IR Polish version proved to have good internal consistency in NSA women (α 0.651 to 0.857) and SA women (α 0.605 to 0.887), and strong reliability in all subscales (Pearson's coefficient 0.759-0.899; p < 0.001). Criterion validity confirmed moderate to strong correlations between PISQ-IR scores and self-reported measures in SA subscales, as well the SA summary score, and weak to moderate correlations in NSA women. The PISQ-IR Polish version is a valid tool for evaluating sexual function in women with PFD.

Toehold-mediated internal control to probe the near-field interaction between the metallic nanoparticle and the fluorophore

NASA Astrophysics Data System (ADS)

Ang, Y. S.; Yung, L. Y. L.

2014-10-01

Metallic nanoparticles (MNPs) are known to alter the emission of vicinal fluorophores through the near-field interaction, leading to either fluorescence quenching or enhancement. Much ambiguity remains in the experimental outcome of such a near-field interaction, particularly for bulk colloidal solution. It is hypothesized that the strong far-field interference from the inner filter effect of the MNPs could mask the true near-field MNP-fluorophore interaction significantly. Thus, in this work, a reliable internal control capable of decoupling the near-field interaction from far-field interference is established by the use of the DNA toehold concept to mediate the in situ assembly and disassembly of the MNP-fluorophore conjugate. A model gold nanoparticle (AuNP)-Cy3 system is used to investigate our proposed toehold-mediated internal control system. The maximum fluorescence enhancement is obtained for large-sized AuNP (58 nm) separated from Cy3 at an intermediate distance of 6.8 nm, while fluorescence quenching is observed for smaller-sized AuNP (11 nm and 23 nm), which is in agreement with the theoretical values reported in the literature. This work shows that the toehold-mediated internal control design can serve as a central system for evaluating the near-field interaction of other MNP-fluorophore combinations and facilitate the rational design of specific MNP-fluorophore systems for various applications.Metallic nanoparticles (MNPs) are known to alter the emission of vicinal fluorophores through the near-field interaction, leading to either fluorescence quenching or enhancement. Much ambiguity remains in the experimental outcome of such a near-field interaction, particularly for bulk colloidal solution. It is hypothesized that the strong far-field interference from the inner filter effect of the MNPs could mask the true near-field MNP-fluorophore interaction significantly. Thus, in this work, a reliable internal control capable of decoupling the near-field interaction from far-field interference is established by the use of the DNA toehold concept to mediate the in situ assembly and disassembly of the MNP-fluorophore conjugate. A model gold nanoparticle (AuNP)-Cy3 system is used to investigate our proposed toehold-mediated internal control system. The maximum fluorescence enhancement is obtained for large-sized AuNP (58 nm) separated from Cy3 at an intermediate distance of 6.8 nm, while fluorescence quenching is observed for smaller-sized AuNP (11 nm and 23 nm), which is in agreement with the theoretical values reported in the literature. This work shows that the toehold-mediated internal control design can serve as a central system for evaluating the near-field interaction of other MNP-fluorophore combinations and facilitate the rational design of specific MNP-fluorophore systems for various applications. Electronic supplementary information (ESI) available: DNA sequences, size distribution analysis, photobleaching background and optical characterization. See DOI: 10.1039/c4nr03643c

Home Healthcare Nurses' Job Satisfaction Scale: refinement and psychometric testing.

PubMed

Ellenbecker, Carol H; Byleckie, James J

2005-10-01

This paper describes a study to further develop and test the psychometric properties of the Home Healthcare Nurses' Job Satisfaction Scale, including reliability and construct and criterion validity. Numerous scales have been developed to measure nurses' job satisfaction. Only one, the Home Healthcare Nurses' Job Satisfaction Scale, has been designed specifically to measure job satisfaction of home healthcare nurses. The Home Healthcare Nurses' Job Satisfaction Scale is based on a theoretical model that integrates the findings of empirical research related to job satisfaction. A convenience sample of 340 home healthcare nurses completed the Home Healthcare Nurses' Job Satisfaction Scale and the Mueller and McCloskey Satisfaction Scale, which was used to test criterion validity. Factor analysis was used for testing and refinement of the theory-based assignment of items to constructs. Reliability was assessed by Cronbach's alpha internal consistency reliability coefficients. The data were collected in 2003. Nine factors contributing to home healthcare nurses' job satisfaction emerged from the factor analysis and were strongly supported by the underlying theory. Factor loadings were all above 0.4. Cronbach's alpha coefficients for each of the nine subscales ranged from 0.64 to 0.83; the alpha for the global scale was 0.89. The correlations between the Home Healthcare Nurses' Job Satisfaction Scale and Mueller and McCloskey Satisfaction Scale was 0.79, indicating good criterion-related validity. The Home Healthcare Nurses' Job Satisfaction Scale has potential as a reliable and valid scale for measurement of job satisfaction of home healthcare nurses.

Validity and reliability of the Questionnaire for Compliance with Standard Precaution

PubMed Central

Valim, Marília Duarte; Marziale, Maria Helena Palucci; Hayashida, Miyeko; Rocha, Fernanda Ludmilla Rossi; Santos, Jair Lício Ferreira

2015-01-01

ABSTRACT OBJECTIVE : To evaluate the validity and reliability of the Questionnaire for Compliance with Standard Precaution for nurses. METHODS : This methodological study was conducted with 121 nurses from health care facilities in Sao Paulo’s countryside, who were represented by two high-complexity and by three average-complexity health care facilities. Internal consistency was calculated using Cronbach’s alpha and stability was calculated by the intraclass correlation coefficient, through test-retest. Convergent, discriminant, and known-groups construct validity techniques were conducted. RESULTS : The questionnaire was found to be reliable (Cronbach’s alpha: 0.80; intraclass correlation coefficient: (0.97) In regards to the convergent and discriminant construct validity, strong correlation was found between compliance to standard precautions, the perception of a safe environment, and the smaller perception of obstacles to follow such precautions (r = 0.614 and r = 0.537, respectively). The nurses who were trained on the standard precautions and worked on the health care facilities of higher complexity were shown to comply more (p = 0.028 and p = 0.006, respectively). CONCLUSIONS : The Brazilian version of the Questionnaire for Compliance with Standard Precaution was shown to be valid and reliable. Further investigation must be conducted with nurse samples that are more representative of the Brazilian reality. The use of the questionnaire may support the creation of educational measures considering the possible gaps that can be identified, focusing on the workers’ health and on the patients’ safety. PMID:26759967

Cross-cultural adaptation of Kerlan-Jobe Orthopaedic Clinic shoulder and elbow score: Reliability and validity in Turkish-speaking overhead athletes.

PubMed

Turgut, Elif; Tunay, Volga Bayrakci

2018-03-09

Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow Score (KJOC-SES) is a subjective assessment tool to measure functional status of the upper extremities in overhead athletes. The aim was to translate and culturally adapt the KJOC-SES and to evaluate the psychometric properties of the Turkish version (KJOC-SES-Tr) in overhead athletes. The forward and back-translation method was followed. One hundred and twenty-three overhead athletes completed the KJOC-SES-Tr, the Disabilities of the Arm, Shoulder, and Hand (DASH), and the American Shoulder and Elbow Surgeons Evaluation Form (ASES). Participants were assigned to one of the following subgroups: asymptomatic (playing without pain) or symptomatic (playing with pain, or not playing due to pain). Internal consistency, reliability, construct validity, discriminant validity, and content validity of the KJOC-SES-Tr were tested. The test-retest reliability of the KJOC-SES-Tr was excellent with an interclass coefficient of 0.93. There was a strong correlation between the KJOC-SES-Tr and the DASH and the ASES, indicating that the construct validity was good for all participants. Results of the KJOC-SES-Tr significantly differed between different subgroups and categories of athletes. The floor and ceiling effects were acceptable for symptomatic athletes. The KJOC-SES-Tr was shown to be valid, reliable tool to monitor the return to sports following injuries in athletes. Copyright © 2018 Turkish Association of Orthopaedics and Traumatology. Production and hosting by Elsevier B.V. All rights reserved.

Validity and Reliability of a New Instrument to Measure Cancer-Related Fatigue in Adolescents

PubMed Central

Hinds, Pamela S.; Hockenberry, Marilyn; Tong, Xin; Rai, Shesh N.; Gattuso, Jamie S.; McCarthy, Kathleen; Pui, Ching-Hon; Srivastava, Deo Kumar

2008-01-01

Adolescents undergoing treatment for cancer rate fatigue as their most prevalent and intense cancer- and treatment-related effect. Parents and staff rate it similarly. Despite its reported prevalence, intensity, and distressing effects, cancer-related fatigue in adolescents is not routinely assessed during or after cancer treatment. We contend that the insufficient clinical attention is primarily due to the lack of a reliable and valid self-report instrument with which adolescent cancer-related fatigue can be measured. Our aim was to determine the reliability and construct validity of a new instrument and its ability to measure change in fatigue over time. Initial testing involved 64 adolescents undergoing curative treatment of cancer who completed the Fatigue Scale-Adolescent (FS-A) at two to four key points in treatment in one of four studies. Internal consistency estimates ranged from 0.67 to 0.95. Validity estimates involving the FS-A with the parent version ranged from 0.13 to 0.76; estimates involving the staff version and the Reynolds Depression Scale were 0.27 and 0.87 respectively. Additional validity findings included significant fatigue differences between anemic and non-anemic patients (P = 0.042) and the emergence of four factors in an exploratory factor analysis. Findings further indicate that the FS-A can be used to measure change over time (t = 2.55, P <0.01). In summary, the FS-A has moderate to strong reliability and impressive validity coefficients for a new research instrument. PMID:17629669

Cross-cultural adaptation and validation of the Peripheral Artery Questionnaire: Korean version for patients with peripheral vascular diseases.

PubMed

Lee, Ji Hyun; Cho, Kyoung Im; Spertus, John; Kim, Seong Man

2012-08-01

The Peripheral Artery Questionnaire (PAQ), as developed in US English, is a validated scale to evaluate the health status of patients with peripheral artery disease (PAD). The aim of this study was to translate the PAQ into Korean and to evaluate its reliability and validity. A multi-step process of forward-translation, reconciliation, consultation with the developer, back-translation and proofreading was conducted. The test-retest reliability was evaluated at a 2-week interval using the intra-class correlation coefficient (ICC). The validity was assessed by identifying associations between Korean PAQ (KPAQ) scores and Korean Health Assessment Questionnaire (KHAQ) scores. A total of 100 PAD patients were enrolled: 63 without and 37 with severe claudication. The reliability of the KPAQ was adequate, with an ICC of 0.71. There were strong correlations between KPAQ's subscales. Cronbach's alpha for the summary score was 0.94, indicating good internal consistency and congruence with the original US version. The validity was supported by a significant correlation between the total KHAQ score and KPAQ physical function, stability, symptom, social limitation and quality of life scores (r = -0.24 to -0.90; p < 0.001) as well as between the KHAQ walking subscale and the KPAQ physical function score (r = -0.55, p < 0.001). Our results indicate that the KPAQ is a reliable, valid instrument to evaluate the health status of Korean patients with PAD.

The Trunk Impairment Scale - modified to ordinal scales in the Norwegian version.

PubMed

Gjelsvik, Bente; Breivik, Kyrre; Verheyden, Geert; Smedal, Tori; Hofstad, Håkon; Strand, Liv Inger

2012-01-01

To translate the Trunk Impairment Scale (TIS), a measure of trunk control in patients after stroke, into Norwegian (TIS-NV), and to explore its construct validity, internal consistency, intertester and test-retest reliability. TIS was translated according to international guidelines. The validity study was performed on data from 201 patients with acute stroke. Fifty patients with stroke and acquired brain injury were recruited to examine intertester and test-retest reliability. Construct validity was analyzed with exploratory and confirmatory factor analysis and item response theory, internal consistency with Cronbach's alpha test, and intertester and test-retest reliability with kappa and intraclass correlation coefficient tests. The back-translated version of TIS-NV was validated by the original developer. The subscale Static sitting balance was removed. By combining items from the subscales Dynamic sitting balance and Coordination, six ordinal superitems (testlets) were constructed. The TIS-NV was renamed the modified TIS-NV (TIS-modNV). After modifications the TIS-modNV fitted well to a locally dependent unidimensional item response theory model. It demonstrated good construct validity, excellent internal consistency, and high intertester and test-retest reliability for the total score. This study supports that the TIS-modNV is a valid and reliable scale for use in clinical practice and research.

Reliability of the ecSatter Inventory as a tool to measure eating competence.

PubMed

Stotts, Jodi L; Lohse, Barbara

2007-01-01

To examine the reliability of the ecSatter Inventory (ecSI), a measure of eating competence. Self-report questionnaires were administered in person or by mail. Retesting occurred 2 to 6 weeks after completion of the first questionnaire. Both administrations of the questionnaire were completed by 259 participants who were mostly food secure, white females with some college education; mean age was 26.9 +/- 10.4 years. Test-retest reliability and internal consistency. Spearman's rank correlation coefficients to estimate test-retest reliability and Cronbach alpha coefficients to estimate internal consistency. Spearman's rank correlation coefficient for ecSI total score was 0.68; subscale coefficients were 0.70 for eating attitudes, 0.70 for contextual skills, 0.65 for food acceptance, and 0.52 for internal regulation. Cronbach alpha coefficient for ecSI total score was 0.77. Subscale alphas coefficients were 0.80 for eating attitudes, 0.69 for contextual skills, 0.68 for food acceptance, and 0.66 for internal regulation. This study provides psychometric evidence about the reliability of ecSI as a measure of eating competence in this sample. Although some ecSI items may require revision, results suggest that the instrument may be used to evaluate nutrition education designed to improve eating competence.

Reliability and Validity of the Short Falls Efficacy Scale International in English, Mandarin, and Bahasa Malaysia in Malaysia.

PubMed

Tan, Maw Pin; Nalathamby, Nemala; Mat, Sumaiyah; Tan, Pey June; Kamaruzzaman, Shahrul Bahyah; Morgan, Karen

2018-01-01

While the prevalence of falls among Malaysian older adults is comparable to other older populations around the world, little is currently known about fear of falling in Malaysia. The Falls Efficacy Scale International (FES-I) and short FES-I scales to measure fear of falling have not yet been validated for use within the Malaysian population, and are currently not available in Bahasa Malaysia (BM). A total of 402 participants aged ≥63 years were recruited. The questionnaire was readministered to 149 participants, 4 to 8 weeks after the first administration to determine test-retest reliability. The original version of the 7-item short FES-I is available in English, while the Mandarin was adapted from the 16-item Mandarin FES-I. The BM version was translated according to protocol by four experts. The internal structure of the FES-I was examined by factor analysis. The 7-item short FES-I showed good internal reliability and test-retest reliability for English, Mandarin, and BM versions for Malaysia.

Familiarization, validity and smallest detectable difference of the isometric squat test in evaluating maximal strength.

PubMed

Drake, David; Kennedy, Rodney; Wallace, Eric

2018-02-06

Isometric multi-joint tests are considered reliable and have strong relationships with 1RM performance. However, limited evidence is available for the isometric squat in terms of effects of familiarization and reliability. This study aimed to assess, the effect of familiarization, stability reliability, determine the smallest detectible difference, and the correlation of the isometric squat test with 1RM squat performance. Thirty-six strength-trained participants volunteered to take part in this study. Following three familiarization sessions, test-retest reliability was evaluated with a 48-hour window between each time point. Isometric squat peak, net and relative force were assessed. Results showed three familiarizations were required, isometric squat had a high level of stability reliability and smallest detectible difference of 11% for peak and relative force. Isometric strength at a knee angle of ninety degrees had a strong significant relationship with 1RM squat performance. In conclusion, the isometric squat is a valid test to assess multi-joint strength and can discriminate between strong and weak 1RM squat performance. Changes greater than 11% in peak and relative isometric squat performance should be considered as meaningful in participants who are familiar with the test.

Development of a Digital-Based Instrument to Assess Perceived Motor Competence in Children: Face Validity, Test-Retest Reliability, and Internal Consistency

PubMed Central

Palmer, Kara K.

2017-01-01

Assessing children’s perceptions of their movement abilities (i.e., perceived competence) is traditionally done using picture scales—Pictorial Scale of Perceived Competence and Acceptance for Young Children or Pictorial Scale of Perceived Movement Skill Competence. Pictures fail to capture the temporal components of movement. To address this limitation, we created a digital-based instrument to assess perceived motor competence: the Digital Scale of Perceived Motor Competence. The purpose of this study was to determine the validity, reliability, and internal consistency of the Digital-based Scale of Perceived Motor Skill Competence. The Digital-based Scale of Perceived Motor Skill Competence is based on the twelve fundamental motor skills from the Test of Gross Motor Development-2nd Edition with a similar layout and item structure as the Pictorial Scale of Perceived Movement Skill Competence. Face Validity of the instrument was examined in Phase I (n = 56; Mage = 8.6 ± 0.7 years, 26 girls). Test-retest reliability and internal consistency were assessed in Phase II (n = 54, Mage = 8.7 years ± 0.5 years, 26 girls). Intra-class correlations (ICC) and Cronbach’s alpha were conducted to determine test-retest reliability and internal consistency for all twelve skills along with locomotor and object control subscales. The Digital Scale of Perceived Motor Competence demonstrates excellent test-retest reliability (ICC = 0.83, total; ICC = 0.77, locomotor; ICC = 0.79, object control) and acceptable/good internal consistency (α = 0.62, total; α = 0.57, locomotor; α = 0.49, object control). Findings provide evidence of the reliability of the three level digital-based instrument of perceived motor competence for older children. PMID:29910408

Evidence-based rules from family practice to inform family practice; the learning healthcare system case study on urinary tract infections.

PubMed

Soler, Jean K; Corrigan, Derek; Kazienko, Przemyslaw; Kajdanowicz, Tomasz; Danger, Roxana; Kulisiewicz, Marcin; Delaney, Brendan

2015-05-16

Analysis of encounter data relevant to the diagnostic process sourced from routine electronic medical record (EMR) databases represents a classic example of the concept of a learning healthcare system (LHS). By collecting International Classification of Primary Care (ICPC) coded EMR data as part of the Transition Project from Dutch and Maltese databases (using the EMR TransHIS), data mining algorithms can empirically quantify the relationships of all presenting reasons for encounter (RfEs) and recorded diagnostic outcomes. We have specifically looked at new episodes of care (EoC) for two urinary system infections: simple urinary tract infection (UTI, ICPC code: U71) and pyelonephritis (ICPC code: U70). Participating family doctors (FDs) recorded details of all their patient contacts in an EoC structure using the ICPC, including RfEs presented by the patient, and the FDs' diagnostic labels. The relationships between RfEs and episode titles were studied using probabilistic and data mining methods as part of the TRANSFoRm project. The Dutch data indicated that the presence of RfE's "Cystitis/Urinary Tract Infection", "Dysuria", "Fear of UTI", "Urinary frequency/urgency", "Haematuria", "Urine symptom/complaint, other" are all strong, reliable, predictors for the diagnosis "Cystitis/Urinary Tract Infection" . The Maltese data indicated that the presence of RfE's "Dysuria", "Urinary frequency/urgency", "Haematuria" are all strong, reliable, predictors for the diagnosis "Cystitis/Urinary Tract Infection". The Dutch data indicated that the presence of RfE's "Flank/axilla symptom/complaint", "Dysuria", "Fever", "Cystitis/Urinary Tract Infection", "Abdominal pain/cramps general" are all strong, reliable, predictors for the diagnosis "Pyelonephritis" . The Maltese data set did not present any clinically and statistically significant predictors for pyelonephritis. We describe clinically and statistically significant diagnostic associations observed between UTIs and pyelonephritis presenting as a new problem in family practice, and all associated RfEs, and demonstrate that the significant diagnostic cues obtained are consistent with the literature. We conclude that it is possible to generate clinically meaningful diagnostic evidence from electronic sources of patient data.

Establishing Reliability and Validity of the Criterion Referenced Exam of GeoloGy Standards EGGS

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, S. J.; Slater, T. F.; Schleigh, S.; Burrows, A. C.

2016-12-01

Discipline-based geoscience education researchers have considerable need for a criterion-referenced, easy-to-administer and -score conceptual diagnostic survey for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing education research across the geosciences, we are continuing to rigorously and systematically work to firmly establish the reliability and validity of the recently released Exam of GeoloGy Standards, EGGS. In educational testing, reliability refers to the consistency or stability of test scores whereas validity refers to the accuracy of the inferences or interpretations one makes from test scores. There are several types of reliability measures being applied to the iterative refinement of the EGGS survey, including test-retest, alternate form, split-half, internal consistency, and interrater reliability measures. EGGS rates strongly on most measures of reliability. For one, Cronbach's alpha provides a quantitative index indicating the extent to which if students are answering items consistently throughout the test and measures inter-item correlations. Traditional item analysis methods further establish the degree to which a particular item is reliably assessing students is actually quantifiable, including item difficulty and item discrimination. Validity, on the other hand, is perhaps best described by the word accuracy. For example, content validity is the to extent to which a measurement reflects the specific intended domain of the content, stemming from judgments of people who are either experts in the testing of that particular content area or are content experts. Perhaps more importantly, face validity is a judgement of how representative an instrument is reflective of the science "at face value" and refers to the extent to which a test appears to measure a the targeted scientific domain as viewed by laypersons, examinees, test users, the public, and other invested stakeholders.

Reliability and Validity of the Turkish Version of the Voice-Related Quality of Life Measure.

PubMed

Tezcaner, Zahide Çiler; Aksoy, Songül

2017-03-01

This study aims to test the validity and reliability of the Turkish version of the Voice-Related Quality of Life (V-RQOL) questionnaire. This is a nonrandomized, prospective study with control group. The questionnaire was administered to 249 individuals-130 with vocal complaint and 119 without-with a mean age of 37.8 ± 12.3 years. The Turkish version of the Voice Handicap Index (VHI) and perceptual voice evaluation measures were also administered at 2-14 days for retest reliability. The instrument was submitted to validity and reliability evaluation. The V-RQOL measure showed a strong internal consistency and test-retest reliability; the Cronbach's alpha coefficient for the overall V-RQOL was 0.969, the physical functioning domain was 0.949, and the social-emotional domain was 0.940. In the test-retest reliability test, the overall V-RQOL was found to be 0.989. The construct validity of the V-RQOL was determined based on the strength and direction of its relation to the VHI and the perceptual voice evaluation measure. The higher the VHI level, the lower the physical functioning, social-emotional, and overall score levels of the V-RQOL (r = -0.927, r = -0.912, r = -0.944, respectively; P < 0.001). Following the perceptual voice self-assessment, a statistically significant difference was found between the V-RQOL scores of individuals who defined their voices as good, very good, and perfect, and those who defined their voices as bad and very bad (P < 0.001). The results suggest that the Turkish version of the V-RQOL measure has reliability and validity and may play a crucial role in evaluating Turkish-speaking patients with voice disorders. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Reliability Generalization of Scores on the Spielberger State-Trait Anxiety Inventory.

ERIC Educational Resources Information Center

Barnes, Laura L. B.; Harp, Diane; Jung, Woo Sik

2002-01-01

Conducted a reliability generalization study for the State-Trait Anxiety Inventory (C. Spielberger, 1983) by reviewing and classifying 816 research articles. Average reliability coefficients were acceptable for both internal consistency and test-retest reliability, but variation was present among the estimates. Other differences are discussed.…

German version, inter- and intrarater reliability and internal consistency of the "Agitated Behavior Scale" (ABS-G) in patients with moderate to severe traumatic brain injury.

PubMed

Hellweg, Stephanie; Schuster-Amft, Corina

2016-07-19

Agitation is frequently observed during early recovery after traumatic brain injury (TBI). Agitated behaviour often interferes with a goal-orientated rehabilitation and can be a substantial hindrance to therapy. Despite the relatively high occurance of agitation in TBI population there is no objective assessement in German (G) available. An existing scale with excellent psychometric properties is the "Agitated Behavior Scale (ABS)" developed by Corrigan in 1989. The aim of the study was to translate the Agitated Behavior Scale (ABS) into German (ABS-G) and investigate the inter- and intrarater reliability and internal consistency in patients with moderate to severe TBI. A formal nine-step translation and cross-cultural adaptation procedure (TCCA) was applied. Subsequently a prospective observational patient study was conducted. To examine the interrater reliability and internal consistency, two therapists rated 20 patients independently after a therapy session. This procedure was repeated twice on a weekly basis. The intrarater reliability was assessed through video recordings from three patients. Nine raters scored the demonstrated behaviour on the videotape with the ABS-G independently twice within one month. The inter- and intrarater reliability were evaluated with the Spearman rank correlation coefficient and the quadratic weighted kappa. The internal consistency was tested with Cronbach's alpha. Behaviour of 20 patients (18 males; mean age 41 ± 20.7; mean Functional Independence Measure (FIM) cognitive score on admission 7.1 ± 4.04; mean ABS-G score at first observation 17.3 ± 2.83) was assessed threefold. Interrater reliability yielded a correlation coefficient for ABS-G total score of all 60 paired observations of r s 0.845 and a weighted Kappa of 0.738. Intrarater reliability for ABS-G total score ranged between r s 0.719 and 0.953 and showed a weighted Kappa between 0.871 and 0.953. Cronbach's alpha indicated moderate internal consistency with 0.661. This study demonstrates that the ABS-G is a reliable instrument for evaluating agitation in patients with moderate to severe TBI. Hereby it would be possible to monitor agitation objectively and optimise the management of agitated patients according to international recommendations.

Translation, Cultural Adaptation and Validation of the Simple Shoulder Test to Spanish

PubMed Central

Arcuri, Francisco; Barclay, Fernando; Nacul, Ivan

2015-01-01

Background: The validation of widely used scales facilitates the comparison across international patient samples. Objective: The objective was to translate, culturally adapt and validate the Simple Shoulder Test into Argentinian Spanish. Methods: The Simple Shoulder Test was translated from English into Argentinian Spanish by two independent translators, translated back into English and evaluated for accuracy by an expert committee to correct the possible discrepancies. It was then administered to 50 patients with different shoulder conditions.Psycometric properties were analyzed including internal consistency, measured with Cronbach´s Alpha, test-retest reliability at 15 days with the interclass correlation coefficient. Results: The internal consistency, validation, was an Alpha of 0,808, evaluated as good. The test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.835, evaluated as excellent. Conclusion: The Simple Shoulder Test translation and it´s cultural adaptation to Argentinian-Spanish demonstrated adequate internal reliability and validity, ultimately allowing for its use in the comparison with international patient samples.

Rates of childhood trauma in a sample of university students in Greece: The Greek version of the Early Trauma Inventory-Self Report.

PubMed

Antonopoulou, Z; Konstantakopoulos, G; Τzinieri-Coccosis, M; Sinodinou, C

2017-01-01

The self-report Early Trauma Inventory (ETI-SR-SF) was developed by Bremner et al in 2007 and has been proven a valid tool for the assessment of childhood trauma. The inventory covers four types of traumatic experiences: general trauma, physical abuse, emotional abuse and sexual abuse. The primary aim of the present study was to assess the internal consistency, test-retest reliability, convergent validity and factor structure of the Greek version of the ETI-SR-SF. The study sample consisted of 605 individuals (402 women), undergraduate and postgraduate students of Athens universities with a mean age of 24.3 years. All participants completed a questionnaire on demographic characteristics, the Greek version of the ETI-SR-SF and the Greek version of the Trauma Symptoms Checklist (TSC-40). Both ETI-SR-SF and TSC-40 were re-administered to 56 participants after three to four weeks. ETI-SR-SF was found to display high levels of internal consistency (Cronbach's α=0.91) and test-retest reliability (ICC=0.93). In addition, the internal structure of every subscale was examined by the means of factor analysis, which revealed that the items in every subscale contribute to a single factor explaining a great proportion of the variance. The correlation between total scores of ETI-SR-SF and TSC-40 was significantly strong (r=0.42, p<0.001), indicating satisfactory convergent validity. The most frequently reported type of childhood trauma was corporal punishment, at a rate of 89.9%, followed by emotional abuse (67.2%) and sexual abuse (27%). These rates are higher than those found in the international literature indicating that the various types of early traumatic experience are very common phenomena in the Greek student population. This finding should alert the experts and requires replication and further investigation by studies with larger samples. The findings of the present study suggest that the Greek version of the self-report Early Trauma Inventory (ETI-SR-SF) is a valid and reliable tool useful for future studies on childhood traumatic experiences in Greek populations. Moreover, according to our preliminary findings further investigation of the childhood trauma in Greece appears to be very much warranted.

The validity and internal structure of the Bipolar Depression Rating Scale: data from a clinical trial of N-acetylcysteine as adjunctive therapy in bipolar disorder.

PubMed

Berk, Michael; Dodd, Seetal; Dean, Olivia M; Kohlmann, Kristy; Berk, Lesley; Malhi, Gin S

2010-10-01

Berk M, Dodd S, Dean OM, Kohlmann K, Berk L, Malhi GS. The validity and internal structure of the Bipolar Depression Rating Scale: data from a clinical trial of N-acetylcysteine as adjunctive therapy in bipolar disorder. The phenomenology of unipolar and bipolar disorders differ in a number of ways, such as the presence of mixed states and atypical features. Conventional depression rating instruments are designed to capture the characteristics of unipolar depression and have limitations in capturing the breadth of bipolar disorder. The Bipolar Depression Rating Scale (BDRS) was administered together with the Montgomery Asberg Rating Scale (MADRS) and Young Mania Rating Scale (YMRS) in a double-blind randomised placebo-controlled clinical trial of N-acetyl cysteine for bipolar disorder (N = 75). A factor analysis showed a two-factor solution: depression and mixed symptom clusters. The BDRS has strong internal consistency (Cronbach's alpha = 0.917), the depression cluster showed robust correlation with the MADRS (r = 0.865) and the mixed subscale correlated with the YMRS (r = 0.750). The BDRS has good internal validity and inter-rater reliability and is sensitive to change in the context of a clinical trial.

International development and psychometric properties of the Child and Adolescent Trauma Screen (CATS).

PubMed

Sachser, Cedric; Berliner, Lucy; Holt, Tonje; Jensen, Tine K; Jungbluth, Nathaniel; Risch, Elizabeth; Rosner, Rita; Goldbeck, Lutz

2017-03-01

Systematic screening is a powerful means by which children and adolescents with posttraumatic stress symptoms (PTSS) can be detected. Reliable and valid measures based on current diagnostic criteria are needed. To investigate the internal consistency and construct validity of the Child and Adolescent Trauma Screen (CATS) in three samples of trauma-exposed children in the US (self-reports: n=249; caregiver reports: n=267; pre-school n=190), in Germany (self-reports: n=117; caregiver reports: n=95) and in Norway (self-reports: n=109; caregiver reports: n=62). Internal consistency was calculated using Cronbach's α. Convergent-discriminant validity was investigated using bivariate correlation coefficients with measures of depression, anxiety and externalizing symptoms. CFA was used to investigate the DSM-5 factor structure. In all three language samples the 20 item symptom score of the self-report and the caregiver report proved good to excellent reliability with α ranging between .88 and .94. The convergent-discriminant validity pattern showed medium to strong correlations with measures of depression (r =.62-.82) and anxiety (r =.40-.77) and low to medium correlations with externalizing symptoms (r =-.15-.43) within informants in all language versions. Using CFA the underlying DSM-5 factor structure with four symptom clusters (re-experiencing, avoidance, negative alterations in mood and cognitions, hyperarousal) was supported (n =475 for self-report; n =424 for caregiver reports). The external validation of the CATS with a DSM-5 based semi-structured clinical interview and corresponding determination of cut-points is pending. The CATS has satisfactory psychometric properties. Clinicians may consider the CATS as a screening tool and for symptom monitoring. Copyright © 2016 Elsevier B.V. All rights reserved.

Measuring the impact and distress of osteoarthritis from the patients' perspective

PubMed Central

Pallant, Julie F; Keenan, Anne-Maree; Misajon, Roseanne; Conaghan, Philip G; Tennant, Alan

2009-01-01

Background To assess the internal construct validity of the Perceived Impact of Problem Profile (PIPP), a patient based outcome measure based on the International Classification of Functioning, Disability and Health (ICF), which assesses impact and distress, in an osteoarthritis (OA) cohort. Methods A questionnaire comprising the 23-item PIPP, which assesses five domains (mobility, participation, self care, psychological well being and relationships), the Western Ontario McMasters University Osteoarthritis Index (WOMAC), the General Well-Being Index (GWBI), and the Hospital Anxiety and Depression Scale (HADS) was posted to people with clinician diagnosed OA. Assessment of the internal construct validity of the PIPP was undertaken using Rasch analysis performed with RUMM2020 software and concurrent validity through comparator measures. Results Two hundred and fifty-nine participants with OA responded. Analysis of the five individual domains of the PIPP indicated that there was good fit to the Rasch model, with high person separation reliability. One item required removal from the Mobility subscale and the Participation subscale. There were strong correlations between the PIPP Mobility scores and the WOMAC disability and pain subscales (rho = .73 and rho = .68), and between the PIPP Psychological well-being and HADS Depression (rho = .71) and GWBI (rho = -.69). High inter-correlations between the impact and distress subscales for each domain (range rho = .85 to .96), suggested redundancy of the latter. Conclusion This study demonstrates that the PIPP has good psychometric properties in an OA population. The PIPP, using just the impact subscales, provides a brief, reliable and valid means of assessing the impact of OA from the individual's perspective and operationalizing the bio-psychosocial model by the application of a single multi-domain questionnaire. PMID:19400966

Cross-cultural adaptation and measurement properties of the italian version of the Patient-Rated Tennis Elbow Evaluation (PRTEE) questionnaire.

PubMed

Cacchio, Angelo; Necozione, Stefano; MacDermid, Joy C; Rompe, Jan Dirk; Maffulli, Nicola; di Orio, Ferdinando; Santilli, Valter; Paoloni, Marco

2012-08-01

The Patient-Rated Tennis Elbow Evaluation (PRTEE) questionnaire is a tool designed for self-assessment of forearm pain and disability in patients with lateral elbow tendinopathy (LET). However, an Italian version of this questionnaire has not been available. The aims of this study were: (1) to translate and cross-culturally adapt the PRTEE questionnaire into Italian and (2) to evaluate its measurement properties. This was a longitudinal, observational measurement study. The PRTEE questionnaire was cross-culturally adapted to Italian according to established guidelines. Ninety-five individuals (41 women, 54 men) with unilateral, imaging-confirmed, chronic LET were selected consecutively to assess the measurement properties of the PRTEE questionnaire. Internal consistency, test-retest reliability, construct validity, and responsiveness were estimated. The Italian version of the PRTEE displayed a high degree of internal consistency, with a Cronbach alpha of .95. The test-retest reliability was high for both short-term and medium-term, with intraclass correlation coefficients (2,1) of .95 and .93, respectively. The PRTEE exhibited a strong correlation (r=.77-.91, P<.0001) with the Disabilities of the Arm, Shoulder and Hand (DASH) at the baseline and a moderate correlation (r=.58-.74, P<.0001) at discharge. The responsiveness was higher for the PRTEE than for the DASH. Limitations A methodological limitation of the study is that due to the small sample size, a factor analysis was not performed to assess convergent validity. The Italian version of the PRTEE questionnaire is internally consistent, demonstrates expected correlations with other measures, and is more responsive than the DASH in Italian patients with chronic LET.

Monitoring stress among internal medicine residents: an experience-driven, practical and short measure.

PubMed

Myszkowski, Nils; Villoing, Barbara; Zenasni, Franck; Jaury, Philippe; Boujut, Emilie

2017-07-01

Residents experience severely high levels of stress, depression and burnout, leading to perceived medical errors, as well as to symptoms of impairment, such as chronic anger, cognitive impairment, suicidal behavior and substance abuse. Because research has not yet provided a psychometrically robust population-specific tool to measure the level of stress of medicine residents, we aimed at building and validating such a measure. Using an inductive scale development approach, a short, pragmatic measure was built, based on the interviews of 17 medicine residents. The Internal Medicine Residency Stress Scale (IMRSS) was then administered in a sample of 259 internal medicine residents (199 females, 60 males, M Age  = 25.6) along with the Hospital Anxiety and Depression Scale, Maslach Burnout Inventory, Satisfaction With Life Scale and Ways of Coping Checklist. The IMRSS showed satisfactory internal reliability (Cronbach's α = .86), adequate structural validity - studied through Confirmatory Factor Analysis (χ 2 /df = 2.51, CFI = .94; SRMR = .037, RMSEA = .076) - and good criterion validity - the IMRSS was notably strongly correlated with emotional exhaustion (r = .64; p < .001) and anxiety (r = .57; p < .001). Because of its short length and robust psychometric qualities, the use of the IMRSS is recommended to quickly and frequently assess and monitor stress among internal medicine residents.

Test-retest and inter- and intrareliability of the quality of the upper-extremity skills test in preschool-age children with cerebral palsy.

PubMed

Haga, Nienke; van der Heijden-Maessen, Hélène C; van Hoorn, Jessika F; Boonstra, Anne M; Hadders-Algra, Mijna

2007-12-01

To investigate the test-retest, inter-, and intraobserver reliability of the Quality of Upper Extremity Skills Test (QUEST) in young children with cerebral palsy (CP). For test-retest reliability, a test-retest design was used; for the intra- and interobserver reliability, the videotaped test was scored on 2 occasions by 1 observer and by various observers. Groups of preschool-age children in 2 general rehabilitation centers. Twenty-one children with CP (12 boys, 9 girls) aged 2 to 4.5 years (mean, 39 mo). Not applicable. Spearman correlation coefficient. The data indicated that test-retest reliability was strong (rho range, .85-.94). Intraobserver agreement (rho range, .63-.95) and agreement between various observers (rho range, .72-.90) were moderate to strong. Test-retest and inter- and intraobserver reliability of the QUEST in preschool-age children with CP is good.

Assessment of psychometric properties of a modified PHEEM questionnaire.

PubMed

Gooneratne, I K; Munasinghe, S R; Siriwardena, C; Olupeliyawa, A M; Karunathilake, I

2008-12-01

An effective tool in analysing the learning environment, customised to the Sri Lankan setting, is vital for the assessment and delivery of quality healthcare training of preregistration house officers. Such a tool should be reliable and valid. We assessed psychometric properties such as internal reliability and construct validity of a modified version of the Postgraduate Hospital Educational Environment Measure (PHEEM). A modified PHEEM questionnaire customised to the Sri Lankan context was developed in accordance to the Sri Lanka Medical Council guidelines. The questionnaire was distributed to all interns at the National Hospital of Sri Lanka, Colombo North Teaching Hospital and Wathupitiwala Base Hospital during a calendar year (n = 100, response rate = 86%). Internal reliability and construct validity of the inventory were assessed by using Cronbach's alpha and exploratory factor analysis respectively as statistical methods. PHEEM consists of 3 subscales: perceptions of autonomy, social support and teaching, which are factors perceived to be influencing the educational environment. This administration demonstrated high internal reliability as reflected by a Cronbach's alpha value of 0.84. Exploratory factor analysis identified 12 factors with eigenvalue >1. However, the first factor had an eigenvalue of 6.7 (accounting for 19.7% of variance), while the rest had eigenvalues < 2.5. These results suggest a single predictive factor and thus a one-dimensional scale as opposed to the three-dimensional scale which is used in the current questionnaire. The psychometric properties of this tool reflect a high degree of internal reliability in assessing the educational environment of intern doctors in Sri Lanka. It is possible that the clinical educational environment is collectively represented as a single dimension. This may be due to the complex interplay between individual items in the questionnaire. Therefore the psychometric properties do not justify the interpretation of the educational environment through specified subscales.

Test-retest reliability of cardinal plane isokinetic hip torque and EMG.

PubMed

Claiborne, Tina L; Timmons, Mark K; Pincivero, Danny M

2009-10-01

The objective of the present study was to establish test-retest reliability of isokinetic hip torque and prime mover electromyogram (EMG) through the three cardinal planes of motion. Thirteen healthy young adults participated in two experimental sessions, separated by approximately one week. During each session, isokinetic hip torque was evaluated on the Biodex Isokinetic Dynamometer at a velocity of 60 deg/s. Subjects performed three maximal-effort concentric and eccentric contractions, separately, for right and left hip abduction/adduction, flexion/extension, and internal/external rotation. Surface EMGs were sampled from the gluteus maximus, gluteus medius, adductor, medial and lateral hamstring, and rectus femoris muscles during all contractions. Intraclass correlation coefficients (ICC - 2,1) and standard errors of measurement (SEM) were calculated for peak torque for each movement direction and contraction mode, while ICCs were only computed for the EMG data. Motions that demonstrated high torque reliability included concentric hip abduction (right and left), flexion (right and left), extension (right) and internal rotation (right and left), and eccentric hip abduction (left), adduction (left), flexion (right), and extension (right and left) (ICC range=0.81-0.91). Motions with moderate torque reliability included concentric hip adduction (right), extension (left), internal rotation (left), and external rotation (right), and eccentric hip abduction and adduction (right), flexion (left), internal rotation (right and left), and external rotation (right and left) (ICC range=0.49-0.79). The majority of the EMG sampled muscles (n=12 and n=11 for concentric and eccentric contractions, respectively) demonstrated high reliability (ICC=0.81-0.95). Instances of low, or unacceptable, EMG reliability values occurred for the medial hamstring muscle of the left leg (both contraction modes) and the adductor muscle of the right leg during eccentric internal rotation. The major finding revealed high and moderate levels of between-day reliability of isokinetic hip peak torque and prime mover EMG. It is recommended that the day-to-day variability estimates concomitant with acceptable levels of reliability be considered when attempting to objectify intervention effects on hip muscle performance.

Confirmatory factor analysis of different versions of the Body Shape Questionnaire applied to Brazilian university students.

PubMed

da Silva, Wanderson Roberto; Dias, Juliana Chioda Ribeiro; Maroco, João; Campos, Juliana Alvares Duarte Bonini

2014-09-01

This study aimed at evaluating the validity, reliability, and factorial invariance of the complete (34-item) and shortened (8-item and 16-item) versions of the Body Shape Questionnaire (BSQ) when applied to Brazilian university students. A total of 739 female students with a mean age of 20.44 (standard deviation=2.45) years participated. Confirmatory factor analysis was conducted to verify the degree to which the one-factor structure satisfies the proposal for the BSQ's expected structure. Two items of the 34-item version were excluded because they had factor weights (λ)<40. All models had adequate convergent validity (average variance extracted=.43-.58; composite reliability=.85-.97) and internal consistency (α=.85-.97). The 8-item B version was considered the best shortened BSQ version (Akaike information criterion=84.07, Bayes information criterion=157.75, Browne-Cudeck criterion=84.46), with strong invariance for independent samples (Δχ(2)λ(7)=5.06, Δχ(2)Cov(8)=5.11, Δχ(2)Res(16)=19.30). Copyright © 2014 Elsevier Ltd. All rights reserved.

A 1 GeV CW FFAG High Intensity Proton Driver

DOE Office of Scientific and Technical Information (OSTI.GOV)

Johnstone, C.; Sheehy, S. L.

2012-05-01

The drive for high beam power, high duty cycle, and reliable beams at reasonable cost has focused world attention on fixed-field accelerators, notably Fixed-Field Alternating Gradient accelerators (FFAGs). High-intensity GeV proton drivers are of particular interest, as these encounter duty cycle and space-charge limits in the synchrotron and machine size concerns in the weaker-focusing cyclotron. Recently, the concept of isochronous orbits has been explored and developed for non-scaling FFAGs using powerful new methodologies in FFAG accelerator design. These new breeds of FFAGs have been identified by international collaborations for serious study thanks to their potential applications including Accelerator Driven Subcriticalmore » Reactors (ADS) a nd Accelerator Transmutation of Waste. The extreme reliability requirements for ADS mandate CW operation capability and the FFAG s strong focusing, particularly in the vertical, will serve to mitigate the effect of space charge (as compared with the weak- focusing cyclotron). This paper reports on these new advances in FFAG accelerator technology and presents a stable, 0.25-1GeV isochronous FFAG for an accelerator driven subcritical reactor.« less

Development of a modified instrument to measure anticipatory grieving in Jordanian parents of children diagnosed with cancer: the Marwit and Meuser Caregiver Inventory Childhood Cancer.

PubMed

Al-Gamal, Ekhlas; Long, Tony; Livesley, Joan

2009-01-01

The purpose of this article is to report on the development and field testing for validity and reliability of a modified version of the Marwit and Meuser Caregiver Inventory (MM-CGI) for the assessment of anticipatory grief among Jordanian parents of children with cancer (the MM-CGI Childhood Cancer). In 2006, a 50-item MM-CGI Childhood Cancer was administered to 140 Jordanian parents living with a child with cancer. The Cronbach alpha coefficient for the total instrument was .95, and Cronbach alpha coefficients for each of the 3 subscales was .91 for personal sacrifice burden, .90 for heartfelt sadness and longing, and .86 for worry and felt isolation. The construct validity of this instrument was supported by demonstrating a significant and positive correlation with the Anticipatory Grief Scale. The MM-CGI Childhood Cancer demonstrated strong convergent validity and excellent internal consistency reliability. However, further testing with a larger sample to facilitate factor analysis is needed to complete the validation process.

Is the Epworth Sleepiness Scale a useful tool for screening excessive daytime sleepiness in commercial drivers?

PubMed

Baiardi, Simone; La Morgia, Chiara; Sciamanna, Lucia; Gerosa, Alberto; Cirignotta, Fabio; Mondini, Susanna

2018-01-01

The significant social and economic impact of excessive daytime sleepiness makes sleep evaluation a primary medical need in commercial drivers. However, the best screening tool is still matter of debate. In our cohort of 221 commercial drivers, only ten (4.5%) had Epworth Sleepiness Scale scores indicative of excessive daytime sleepiness. These findings and the lack of concordance in estimating excessive daytime sleepiness among commercial drivers in previous studies using the same psychometric measure indicate that the Epworth Sleepiness Scale is not a reliable tool. This may be due to the low internal consistency of the scale in non-clinical samples and the possible intentional underscoring of sleepiness due to a perceived threat of driver's license suspension. Moreover, the reliability of the Epworth Sleepiness Scale results may be strongly influenced by the administration setting. The clinical application of inexpensive less time-consuming new tools like performance tests should be considered for the objective evaluation of excessive daytime sleepiness in commercial drivers. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reliability and Validity of the Chinese (Mandarin) Tinnitus Handicap Inventory

PubMed Central

Meng, Zhaoli; Zheng, Yun; Wang, Kai; Kong, Xiudan; Tao, Yong; Xu, Ke; Liu, Guanjian

2012-01-01

Objectives The Tinnitus Handicap Inventory (THI) is a commonly used self-reporting tinnitus questionnaire. We undertook this study to determine the reliability and validity of the Chinese-Mandarin version of the Tinnitus Handicap Inventory (THI-CM) for measuring tinnitus-related handicaps. Methods We tested the test-retest reliability, internal reliability, and construct validity of the THI-CM. Two-hundred patients seeking treatment for primary or secondary tinnitus in Southwest China were asked to complete THI-CM prior to clinical evaluation. Patients were evaluated by a clinician using standard methods, and 40 patients were asked to complete THI-CM a second time 14±3 days after the initial interview. Results The test-retest reliability of THI-CM was high (Pearson correlation, 0.98), as was the internal reliability (Cronbach's α, 0.93). Factor analysis indicated that THI-CM has a unifactorial structure. Conclusion The THI-CM version is reliable. The total score in THI-CM can be used to measure tinnitus-related handicaps in Mandarin-speaking populations. PMID:22468196

Validity and reliability of sleep time questionnaires in children and adolescents: A systematic review and meta-analysis.

PubMed

Nascimento-Ferreira, Marcus V; Collese, Tatiana S; de Moraes, Augusto César F; Rendo-Urteaga, Tara; Moreno, Luis A; Carvalho, Heráclito B

2016-12-01

Sleep duration has been associated with several health outcomes in children and adolescents. As an extensive number of questionnaires are currently used to investigate sleep schedule or sleep time, we performed a systematic review of criterion validation of sleep time questionnaires for children and adolescents, considering accelerometers as the reference method. We found a strong correlation between questionnaires and accelerometers for weeknights and a moderate correlation for weekend nights. When considering only studies performing a reliability assessment of the used questionnaires, a significant increase in the correlations for both weeknights and weekend nights was observed. In conclusion, moderate to strong criterion validity of sleep time questionnaires was observed; however, the reliability assessment of the questionnaires showed strong validation performance. Copyright © 2015 Elsevier Ltd. All rights reserved.

Psychometric Properties of the Beck Depression Inventory-II in a Clinically-Identified Sample of Mexican American Adolescents

ERIC Educational Resources Information Center

VanVoorhis, Carmen R. Wilson; Blumentritt, Tracie L.

2007-01-01

We examined the internal consistency reliability, convergent and divergent validity, and factor structure of the Beck Depression Inventory-II (BDI-II) in a sample of 131 Mexican American youth. The BDI-II demonstrated excellent internal consistency reliability (alpha = 0.90) and solid convergent and divergent validity with various clinical scales…

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Development and Validation of a Coping with Discrimination Scale: Factor Structure, Reliability, and Validity

ERIC Educational Resources Information Center

Wei, Meifen; Alvarez, Alvin N.; Ku, Tsun-Yao; Russell, Daniel W.; Bonett, Douglas G.

2010-01-01

Four studies were conducted to develop and validate the Coping With Discrimination Scale (CDS). In Study 1, an exploratory factor analysis (N = 328) identified 5 factors: Education/Advocacy, Internalization, Drug and Alcohol Use, Resistance, and Detachment, with internal consistency reliability estimates ranging from 0.72 to 0.90. In Study 2, a…

Validity and Reliability of Internalized Stigma of Mental Illness (Cantonese)

ERIC Educational Resources Information Center

Young, Daniel Kim-Wan; Ng, Petrus Y. N.; Pan, Jia-Yan; Cheng, Daphne

2017-01-01

Purpose: This study aims to translate and test the reliability and validity of the Internalized Stigma of Mental Illness-Cantonese (ISMI-C). Methods: The original English version of ISMI is translated into the ISMI-C by going through forward and backward translation procedure. A cross-sectional research design is adopted that involved 295…

Psychometric Characteristics of the Korean Version of the Satisfaction with Life Scale Adapted for Children

ERIC Educational Resources Information Center

Lim, Young-Jin

2015-01-01

The aim of this study was to examine the internal consistency reliability, test-retest reliability, factorial structure validity, and convergent validity of a Korean version of the Satisfaction With Life Scale adapted for children (K-SWLS-C). Participants consisted of 653 elementary school students (48% were male). The internal consistency of the…

Exploratory and Confirmatory Factor Analysis of the Decision Regret Scale in Recipients of Internal Cardioverter Defibrillators

PubMed Central

Hickman, Ronald L.; Pinto, Melissa D.; Lee, Eunsuk; Daly, Barbara J.

2015-01-01

The Decision Regret Scale (DRS) is a five-item instrument that captures an individual’s regret associated with a healthcare decision. Cross-sectional data were collected from 109 cardiac patients who decided to receive an internal cardioverter defibrillator (ICD). Exploratory and confirmatory factor analyses, assessments of the internal reliability consistency (α = .86), and discriminant validity established the DRS as a reliable and valid measure of decision regret in ICD recipients. The DRS, a psychometrically sound instrument, has relevance for clinicians and researchers vested in optimizing the decisional outcomes of ICD recipients. Future research is needed to examine the reliability and validity of the DRS in a larger and more diverse sample of ICD recipients. PMID:22679707

Reliability and cultural applicability of the Greek version of the International Personality Disorders Examination.

PubMed

Fountoulakis, K N; Iacovides, A; Ioannidou, Ch; Bascialla, F; Nimatoudis, I; Kaprinis, G; Janca, A; Dahl, A

2002-05-17

The International Personality Disorders Examination (IPDE) constitutes the proposal of the WHO for the reliable diagnosis of personality disorders (PD). The IPDE assesses pathological personality and is compatible both with DSM-IV and ICD-10 diagnosis. However it is important to test the reliability and cultural applicability of different IPDE translations. Thirty-one patients (12 male and 19 female) aged 35.25 +/- 11.08 years, took part in the study. Three examiners applied the interview (23 interviews of two and 8 interviews of 3 examiners, that is 47 pairs of interviews and 70 single interviews). The phi coefficient was used to test categorical diagnosis agreement and the Pearson Product Moment correlation coefficient to test agreement concerning the number of criteria met. Translation and back-translation did not reveal specific problems. Results suggested that reliability of the Greek translation is good. However, socio-cultural factors (family coherence, work environment etc) could affect the application of some of the IPDE items in Greece. The diagnosis of any PD was highly reliable with phi >0.92. However, diagnosis of non-specific PD was not reliable at all (phi close to 0) suggesting that this is a true residual category. Diagnosis of specific PDs were highly reliable with the exception of schizoid PD. Diagnosis of antisocial and Borderline PDs were perfectly reliable with phi equal to 1.00. The Greek translation of the IPDE is a reliable instrument for the assessment of personality disorder but cultural variation may limit its applicability in international comparisons.

Living with chronic illness scale: international validation of a new self-report measure in Parkinson’s disease

PubMed Central

Ambrosio, Leire; Portillo, Mari Carmen; Rodríguez-Blázquez, Carmen; Rodriguez-Violante, Mayela; Castrillo, Juan Carlos Martínez; Arillo, Víctor Campos; Garretto, Nélida Susana; Arakaki, Tomoko; Dueñas, Marcos Serrano; Álvarez, Mario; Ibáñez, Ivonne Pedroso; Carvajal, Ana; Martínez-Martín, Pablo

2016-01-01

Understanding how a person lives with a chronic illness, such as Parkinson’s disease (PD), is necessary to provide individualized care and professionals role in person-centered care at clinical and community levels is paramount. The present study was aimed to analyze the psychometric properties of the Living with Chronic Illness-PD Scale (EC-PC) in a wide Spanish-speaking population with PD. International cross-sectional study with retest was carried out with 324 patients from four Latin American countries and Spain. Feasibility, acceptability, scaling assumptions, reliability, precision, and construct validity were tested. The study included 324 patients, with age (mean±s.d.) 66.67±10.68 years. None of the EC-PC items had missing values and all acceptability parameters fulfilled the standard criteria. Around two-third of the items (61.54%) met scaling assumptions standards. Concerning internal consistency, Cronbach’s alpha values were 0.68–0.88; item-total correlation was >0.30, except for two items; item homogeneity index was >0.30, and inter-item correlation values 0.14–0.76. Intraclass correlation coefficient for EC-PC stability was 0.76 and standard error of measurement (s.e.m.) for precision was 8.60 (for a EC-PC s.d.=18.57). EC-PC presented strong correlation with social support (rS=0.61) and moderate correlation with life satisfaction (rS=0.46). Weak and negligible correlations were found with the other scales. Internal validity correlations ranged from 0.46 to 0.78. EC-PC total scores were significantly different for each severity level based on Hoehn and Yahr and Clinical Impression of Severity Index, but not for Patient Global Impression of Severity. The EC-PC has satisfactory acceptability, reliability, precision, and validity to evaluate living with PD. PMID:28725703

Internal Flow Simulation of Enhanced Performance Solid Rocket Booster for the Space Transportation System

NASA Technical Reports Server (NTRS)

Ahmad, Rashid A.; McCool, Alex (Technical Monitor)

2001-01-01

An enhanced performance solid rocket booster concept for the space shuttle system has been proposed. The concept booster will have strong commonality with the existing, proven, reliable four-segment Space Shuttle Reusable Solid Rocket Motors (RSRM) with individual component design (nozzle, insulator, etc.) optimized for a five-segment configuration. Increased performance is desirable to further enhance safety/reliability and/or increase payload capability. Performance increase will be achieved by adding a fifth propellant segment to the current four-segment booster and opening the throat to accommodate the increased mass flow while maintaining current pressure levels. One development concept under consideration is the static test of a "standard" RSRM with a fifth propellant segment inserted and appropriate minimum motor modifications. Feasibility studies are being conducted to assess the potential for any significant departure in component performance/loading from the well-characterized RSRM. An area of concern is the aft motor (submerged nozzle inlet, aft dome, etc.) where the altered internal flow resulting from the performance enhancing features (25% increase in mass flow rate, higher Mach numbers, modified subsonic nozzle contour) may result in increased component erosion and char. To assess this issue and to define the minimum design changes required to successfully static test a fifth segment RSRM engineering test motor, internal flow studies have been initiated. Internal aero-thermal environments were quantified in terms of conventional convective heating and discrete phase alumina particle impact/concentration and accretion calculations via Computational Fluid Dynamics (CFD) simulation. Two sets of comparative CFD simulations of the RSRM and the five-segment (IBM) concept motor were conducted with CFD commercial code FLUENT. The first simulation involved a two-dimensional axi-symmetric model of the full motor, initial grain RSRM. The second set of analyses included three-dimensional models of the RSRM and FSM aft motors with four-degree vectored nozzles.

Apples to Apples: Equivalent-Reliability Power Systems Across Diverse Resource Mix Scenarios

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stephen, Gordon W; Frew, Bethany A; Sigler, Devon

Electricity market research is highly price sensitive, and prices are strongly influenced by balance of supply and demand. This work looks at how to combine capacity expansion models and reliability assessment tools to assess equivalent-reliability power systems across diverse resource mix scenarios.

Challenges and opportunities in international molecular cancer prevention research: An ASPO Molecular Epidemiology and the Environment and International Cancer Prevention Interest Groups Report.

PubMed

Epplein, Meira; Bostick, Roberd M; Mu, Lina; Ogino, Shuji; Braithwaite, Dejana; Kanetsky, Peter A

2014-11-01

The International Agency for Research on Cancer estimates that over half of the new cancer cases and almost two-thirds of the cancer deaths in 2012 occurred in low and middle income countries. To discuss the challenges and opportunities to reducing the burden of cancer worldwide, the Molecular Epidemiology and the Environment and the International Issues in Cancer Special Interest Groups joined forces to hold a session during the 38th Annual Meeting of the American Society of Preventive Oncology (March 2014, Arlington, Virginia). The session highlighted three topics of particular interest to molecular cancer prevention researchers working internationally, specifically: 1) biomarkers in cancer research; 2) environmental exposures and cancer; and 3) molecular pathological epidemiology. A major factor for successful collaboration illuminated during the discussion was the need for strong, committed, and reliable international partners. A key element of establishing such relationships is to thoroughly involve individual international collaborators in the development of the research question; engaged international collaborators are particularly motivated to champion and shepherd the project through all necessary steps, including issues relating to institutional review boards, political sensitivity, laboratory-based assays, and tumor subtyping. Also essential is allotting time for the building, maintaining, and investing in such relationships so that successful international collaborations may take root and bloom. While there are many challenges inherent to international molecular cancer research, the opportunities for furthering the science and prevention of cancer worldwide are great, particularly at this time of increasing cancer incidence and prevalence in low and middle income countries. ©2014 American Association for Cancer Research.

Interrater reliability of the injury reporting of the injury surveillance system used in international athletics championships.

PubMed

Edouard, Pascal; Junge, Astrid; Kiss-Polauf, Marianna; Ramirez, Christophe; Sousa, Monica; Timpka, Toomas; Branco, Pedro

2018-03-01

The quality of epidemiological injury data depends on the reliability of reporting to an injury surveillance system. Ascertaining whether all physicians/physiotherapists report the same information for the same injury case is of major interest to determine data validity. The aim of this study was therefore to analyse the data collection reliability through the analysis of the interrater reliability. Cross-sectional survey. During the 2016 European Athletics Advanced Athletics Medicine Course in Amsterdam, all national medical teams were asked to complete seven virtual case reports on a standardised injury report form using the same definitions and classifications of injuries as the international athletics championships injury surveillance protocol. The completeness of data and the Fleiss' kappa coefficients for the inter-rater reliability were calculated for: sex, age, event, circumstance, location, type, assumed cause and estimated time-loss. Forty-one team physicians and physiotherapists of national medical teams participated in the study (response rate 89.1%). Data completeness was 96.9%. The Fleiss' kappa coefficients were: almost perfect for sex (k=1), injury location (k=0.991), event (k=0.953), circumstance (k=0.942), and age (k=0.870), moderate for type (k=0.507), fair for assumed cause (k=0.394), and poor for estimated time-loss (k=0.155). The injury surveillance system used during international athletics championships provided reliable data for "sex", "location", "event", "circumstance", and "age". More caution should be taken for "assumed cause" and "type", and even more for "estimated time-loss". This injury surveillance system displays satisfactory data quality (reliable data and high data completeness), and thus, can be recommended as tool to collect epidemiology information on injuries during international athletics championships. Copyright © 2018 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Reliability of perceived neighbourhood conditions and the effects of measurement error on self-rated health across urban and rural neighbourhoods.

PubMed

Pruitt, Sandi L; Jeffe, Donna B; Yan, Yan; Schootman, Mario

2012-04-01

Limited psychometric research has examined the reliability of self-reported measures of neighbourhood conditions, the effect of measurement error on associations between neighbourhood conditions and health, and potential differences in the reliabilities between neighbourhood strata (urban vs rural and low vs high poverty). We assessed overall and stratified reliability of self-reported perceived neighbourhood conditions using five scales (social and physical disorder, social control, social cohesion, fear) and four single items (multidimensional neighbouring). We also assessed measurement error-corrected associations of these conditions with self-rated health. Using random-digit dialling, 367 women without breast cancer (matched controls from a larger study) were interviewed twice, 2-3 weeks apart. Test-retest (intraclass correlation coefficients (ICC)/weighted κ) and internal consistency reliability (Cronbach's α) were assessed. Differences in reliability across neighbourhood strata were tested using bootstrap methods. Regression calibration corrected estimates for measurement error. All measures demonstrated satisfactory internal consistency (α ≥ 0.70) and either moderate (ICC/κ=0.41-0.60) or substantial (ICC/κ=0.61-0.80) test-retest reliability in the full sample. Internal consistency did not differ by neighbourhood strata. Test-retest reliability was significantly lower among rural (vs urban) residents for two scales (social control, physical disorder) and two multidimensional neighbouring items; test-retest reliability was higher for physical disorder and lower for one multidimensional neighbouring item among the high (vs low) poverty strata. After measurement error correction, the magnitude of associations between neighbourhood conditions and self-rated health were larger, particularly in the rural population. Research is needed to develop and test reliable measures of perceived neighbourhood conditions relevant to the health of rural populations.

Inter-rater Reliability of Sustained Aberrant Movement Patterns as a Clinical Assessment of Muscular Fatigue

PubMed Central

Aerts, Frank; Carrier, Kathy; Alwood, Becky

2016-01-01

Background: The assessment of clinical manifestation of muscle fatigue is an effective procedure in establishing therapeutic exercise dose. Few studies have evaluated physical therapist reliability in establishing muscle fatigue through detection of changes in quality of movement patterns in a live setting. Objective: The purpose of this study is to evaluate the inter-rater reliability of physical therapists’ ability to detect altered movement patterns due to muscle fatigue. Design: A reliability study in a live setting with multiple raters. Participants: Forty-four healthy individuals (ages 19-35) were evaluated by six physical therapists in a live setting. Methods: Participants were evaluated by physical therapists for altered movement patterns during resisted shoulder rotation. Each participant completed a total of four tests: right shoulder internal rotation, right shoulder external rotation, left shoulder internal rotation and left shoulder external rotation. Results: For all tests combined, the inter-rater reliability for a single rater scoring ICC (2,1) was .65 (95%, .60, .71) This corresponds to moderate inter-rater reliability between physical therapists. Limitations: The results of this study apply only to healthy participants and therefore cannot be generalized to a symptomatic population. Conclusion: Moderate inter-rater reliability was found between physical therapists in establishing muscle fatigue through the observation of sustained altered movement patterns during dynamic resistive shoulder internal and external rotation. PMID:27347241

The Validity and Reliability of the Turkish Version of Miller Forensic Assessment of Symptoms Test (M-FAST)

PubMed Central

KEYVAN, Ali; GER, Mehmet Can; ERTÜRK, Sevgi Gül; TÜRKCAN, Ahmet

2015-01-01

Introduction The aim of this study was to show the validity and reliability of the M-FAST Turkish Version. Methods Translation and back-translation of the M-FAST was done, then the M-FAST Turkish Version was created with linguistic equivalence. The study was performed with 97 detainees and convicts sent from penal institutions who were internalized at our hospital forensic psychiatry service. M-FAST Turkish Version was applied to evaluees and as a result of clinical interview according to DSM-IV-TR diagnostic criteria and various data explorations the evaluee was examined for malingering. To investigate the internal consistency of the scale, Cronbach’s alpha and test-retest methods were used. In order to check the validity of the scale, in addition to the clinician’s diagnosis, participants were requested to fill the Minnesota Multiphasic Personality Inventory (MMPI) F and K validity scales. Results The mean age of participants was 31.8±9.3 (SD) years. 47 evaluees (48.5%) were diagnosed as malingering. In the internal consistency analysis, Cronbach’s alpha Coefficient was found to be .93. Test-retest relationship that was applied to 22 evaluees was found to be highly significant and strong (r=.89, p<.001). M-FAST scores were significantly high at the malingering group (n=47) (z=−8.02, p<.001). ROC curve analysis suggested a score of ≥7 points as the optimal cut-off for a malingering level for the M-FAST. Kappa coefficients of malingering ± groups were found to be, M-FAST≥7 Kappa: .83; F>16 Kappa: .29; F-K>16 Kappa: .30. For diagnosis of malingering, M-FAST Scale and the MMPI inventory scales were evaluated with the Binary Logistic Regression analysis and only M-FAST scores were found to be significant in prediction of malingering. Conclusion The findings of this study support that, M-FAST Turkish Form represents the structure of the original scale and can be used as a reliable and valid instrument. PMID:28360727

Validation of the Dutch language version of the Safety Attitudes Questionnaire (SAQ-NL).

PubMed

Haerkens, Marck Htm; van Leeuwen, Wouter; Sexton, J Bryan; Pickkers, Peter; van der Hoeven, Johannes G

2016-08-15

As the first objective of caring for patients is to do no harm, patient safety is a priority in delivering clinical care. An essential component of safe care in a clinical department is its safety climate. Safety climate correlates with safety-specific behaviour, injury rates, and accidents. Safety climate in healthcare can be assessed by the Safety Attitudes Questionnaire (SAQ), which provides insight by scoring six dimensions: Teamwork Climate, Job Satisfaction, Safety Climate, Stress Recognition, Working Conditions and Perceptions of Management. The objective of this study was to assess the psychometric properties of the Dutch language version of the SAQ in a variety of clinical departments in Dutch hospitals. The Dutch version (SAQ-NL) of the SAQ was back translated, and analyzed for semantic characteristics and content. From October 2010 to November 2015 SAQ-NL surveys were carried out in 17 departments in two university and seven large non-university teaching hospitals in the Netherlands, prior to a Crew Resource Management human factors intervention. Statistical analyses were used to examine response patterns, mean scores, correlations, internal consistency reliability and model fit. Cronbach's α's and inter-item correlations were calculated to examine internal consistency reliability. One thousand three hundred fourteen completed questionnaires were returned from 2113 administered to health care workers, resulting in a response rate of 62 %. Confirmatory Factor Analysis revealed the 6-factor structure fit the data adequately. Response patterns were similar for professional positions, departments, physicians and nurses, and university and non-university teaching hospitals. The SAQ-NL showed strong internal consistency (α = .87). Exploratory analysis revealed differences in scores on the SAQ dimensions when comparing different professional positions, when comparing physicians to nurses and when comparing university to non-university hospitals. The SAQ-NL demonstrated good psychometric properties and is therefore a useful instrument to measure patient safety climate in Dutch clinical work settings. As removal of one item resulted in an increased reliability of the Working Conditions dimension, revision or deletion of this item should be considered. The results from this study provide researchers and practitioners with insight into safety climate in a variety of departments and functional positions in Dutch hospitals.

International physical activity questionnaire: reliability and validity of the Turkish version.

PubMed

Saglam, Melda; Arikan, Hulya; Savci, Sema; Inal-Ince, Deniz; Bosnak-Guclu, Meral; Karabulut, Erdem; Tokgozoglu, Lale

2010-08-01

Physical inactivity is a global problem which is related to many chronic health disorders. Physical activity scales which allow cross-cultural comparisons have been developed. The goal was to assess the reliability and validity of a Turkish version of the International Physical Activity Questionnaire (IPAQ). 1,097 university students (721 women, 376 men; ages 18-32) volunteered. Short and long forms of the IPAQ gave good agreement and comparable 1-wk. test-retest reliabilities. Caltrac accelerometer data were compared with IPAQ scores in 80 participants with good agreement for short and long forms. Turkish versions of the IPAQ short and long forms are reliable and valid in assessment of physical activity.

Development and psychometric properties of the Student Worry Questionnaire-30.

PubMed

Osman, A; Gutierrez, P M; Downs, W R; Kopper, B A; Barrios, F X; Haraburda, C M

2001-02-01

Described are the development and initial psychometric properties (Ns = 50 and 188) of a self-report measure, the Student Worry Questionnaire-30, for use with college undergraduates. Exploratory principal components analyses (Ns = 388, 350, and 396) with oblimin rotation indicated six domains of worrisome thinking, financial-related concerns, significant others' well-being, social adequacy concerns, academic concerns, and general anxiety symptoms. The total score and scale scores showed internal consistency of .80 to .94. Also, test-retest reliability analyses (.75 to .80) support consistency of responses over 4 wk. Strong evidence for convergent validity) was indicated. Confirmatory factor analysis confirmed the fit of the 6-factor oblique model. Limitations of the present studies, and directions for research are discussed.

Reliability and validity of the Tilburg Frailty Indicator (TFI) among Chinese community-dwelling older people.

PubMed

Dong, Lijuan; Liu, Na; Tian, Xiaoyu; Qiao, Xiaoxia; Gobbens, Robbert J J; Kane, Robert L; Wang, Cuili

2017-11-01

To translate the Tilburg Frailty Indicator (TFI) into Chinese and assess its reliability and validity. A sample of 917 community-dwelling older people, aged ≥60 years, in a Chinese city was included between August 2015 and March 2016. Construct validity was assessed using alternative measures corresponding to the TFI items, including self-rated health status (SRH), unintentional weight loss, walking speed, timed-up-and-go tests (TUGT), making telephone calls, grip strength, exhaustion, Short Portable Mental Status Questionnaire (SPMSQ), Geriatric Depression scale (GDS-15), emotional role, Adaptability Partnership Growth Affection and Resolve scale (APGAR) and Social Support Rating Scale (SSRS). Fried's phenotype and frailty index were measured to evaluate criterion validity. Adverse health outcomes (ADL and IADL disability, healthcare utilization, GDS-15, SSRS) were used to assess predictive (concurrent) validity. The internal consistency reliability was good (Cronbach's α=0.71). The test-retest reliability was strong (r=0.88). Kappa coefficients showed agreements between the TFI items and corresponding alternative measures. Alternative measures correlated as expected with the three domains of TFI, with an exclusion that alternative psychological measures had similar correlations with psychological and physical domains of the TFI. The Chinese TFI had excellent criterion validity with the AUCs regarding physical phenotype and frailty index of 0.87 and 0.86, respectively. The predictive (concurrent) validities of the adverse health outcomes and healthcare utilization were acceptable (AUCs: 0.65-0.83). The Chinese TFI has good validity and reliability as an integral instrument to measure frailty of older people living in the community in China. Copyright © 2017 Elsevier B.V. All rights reserved.

Questionnaire for measuring organisational attributes in dental-care practices: psychometric properties and test-retest reliability.

PubMed

Goetz, Katja; Hasse, Philipp; Szecsenyi, Joachim; Campbell, Stephen M

2016-04-01

The consideration of organisational aspects, such as shared goals and clear communication, within the health care team is important to ensure good quality care. In primary health care, the instrument Survey of Organizational Attributes for Primary Care (SOAPC) is available to measure organisational attributes of care. However, there is no instrument available for dental care. The aim of the present study was to investigate psychometric properties and test-retest reliability of the version of SOAPC adapted for dental care, namely the Survey of Organizational Attributes in Dental Care (SOADC). The SOADC consists of 21 items in the following four subscales: communication; decision making; stress/chaos; and history of change. Convergent construct validity was measured using the job satisfaction scale. A total of 287 dental-care practices were asked to participate in the validation study. Psychometric properties and test-retest reliability were observed. A total of 43 dental-care practices responded to the survey. At baseline, 178 dental-care staff completed the questionnaire, and 4 weeks later 138 did so. Internal consistency, measured by Cronbach's alpha, was 0.718 or higher in the subscales. The test-retest reliability for each subscale and the overall SOADC score demonstrated good correlations over the 4-week test-retest interval, except for 'history of change'. A strong correlation with the aggregated job-satisfaction scale showed high convergent construct validity of SOADC. The consideration of organisational aspects from the perspective of dental-care teams is important for providing good quality of care. The SOADC is a reliable instrument with good psychometric properties and is suitable for the evaluation of organisational attributes in dental-care practices. © 2015 FDI World Dental Federation.

Influences on and Limitations of Classical Test Theory Reliability Estimates.

ERIC Educational Resources Information Center

Arnold, Margery E.

It is incorrect to say "the test is reliable" because reliability is a function not only of the test itself, but of many factors. The present paper explains how different factors affect classical reliability estimates such as test-retest, interrater, internal consistency, and equivalent forms coefficients. Furthermore, the limits of classical test…

Reliability Generalization of the Psychopathy Checklist Applied in Youthful Samples

ERIC Educational Resources Information Center

Campbell, Justin S.; Pulos, Steven; Hogan, Mike; Murry, Francie

2005-01-01

This study examines the average reliability of Hare Psychopathy Checklists (PCLs) adapted for use in samples of youthful offenders (aged 12 to 21 years). Two forms of reliability are examined: 18 alpha estimates of internal consistency and 18 intraclass correlation (two or more raters) estimates of interrater reliability. The results, an average…

Assessment of the Maximal Split-Half Coefficient to Estimate Reliability

ERIC Educational Resources Information Center

Thompson, Barry L.; Green, Samuel B.; Yang, Yanyun

2010-01-01

The maximal split-half coefficient is computed by calculating all possible split-half reliability estimates for a scale and then choosing the maximal value as the reliability estimate. Osburn compared the maximal split-half coefficient with 10 other internal consistency estimates of reliability and concluded that it yielded the most consistently…

Reliability and validity of a tool to measure the severity of tongue thrust in children: the Tongue Thrust Rating Scale.

PubMed

Serel Arslan, S; Demir, N; Karaduman, A A

2017-02-01

This study aimed to develop a scale called Tongue Thrust Rating Scale (TTRS), which categorised tongue thrust in children in terms of its severity during swallowing, and to investigate its validity and reliability. The study describes the developmental phase of the TTRS and presented its content and criterion-based validity and interobserver and intra-observer reliability. For content validation, seven experts assessed the steps in the scale over two Delphi rounds. Two physical therapists evaluated videos of 50 children with cerebral palsy (mean age, 57·9 ± 16·8 months), using the TTRS to test criterion-based validity, interobserver and intra-observer reliability. The Karaduman Chewing Performance Scale (KCPS) and Drooling Severity and Frequency Scale (DSFS) were used for criterion-based validity. All the TTRS steps were deemed necessary. The content validity index was 0·857. A very strong positive correlation was found between two examinations by one physical therapist, which indicated intra-observer reliability (r = 0·938, P < 0·001). A very strong positive correlation was also found between the TTRS scores of two physical therapists, indicating interobserver reliability (r = 0·892, P < 0·001). There was also a strong positive correlation between the TTRS and KCPS (r = 0·724, P < 0·001) and a very strong positive correlation between the TTRS scores and DSFS (r = 0·822 and r = 0·755; P < 0·001). These results demonstrated the criterion-based validity of the TTRS. The TTRS is a valid, reliable and clinically easy-to-use functional instrument to document the severity of tongue thrust in children. © 2016 John Wiley & Sons Ltd.

Development and initial validation of the internalization of Asian American stereotypes scale.

PubMed

Shen, Frances C; Wang, Yu-Wei; Swanson, Jane L

2011-07-01

This research consists of four studies on the initial reliability and validity of the Internalization of Asian American Stereotypes Scale (IAASS), a self-report instrument that measures the degree Asian Americans have internalized racial stereotypes about their own group. The results from the exploratory and confirmatory factor analyses support a stable four-factor structure of the IAASS: Difficulties with English Language Communication, Pursuit of Prestigious Careers, Emotional Reservation, and Expected Academic Success. Evidence for concurrent and discriminant validity is presented. High internal-consistency and test-retest reliability estimates are reported. A discussion of how this scale can contribute to research and practice regarding internalized stereotyping among Asian Americans is provided.

Basic Concepts in Classical Test Theory: Tests Aren't Reliable, the Nature of Alpha, and Reliability Generalization as a Meta-analytic Method.

ERIC Educational Resources Information Center

Helms, LuAnn Sherbeck

This paper discusses the fact that reliability is about scores and not tests and how reliability limits effect sizes. The paper also explores the classical reliability coefficients of stability, equivalence, and internal consistency. Stability is concerned with how stable test scores will be over time, while equivalence addresses the relationship…

Swedish Acceptance and Action Questionnaire (SAAQ): a psychometric evaluation.

PubMed

Lundgren, Tobias; Parling, Thomas

2017-06-01

Psychological inflexibility and experiential avoidance are equivalent (with somewhat different connotations) concepts and refer to an unwillingness to remain in contact with particular private events. This concept is most often measured by the Acceptance and Action Questionnaire (AAQ-II) and is strongly related to psychopathology and behavioral effectiveness. In this study, the preliminary psychometric properties of the Swedish version of the AAQ-II (Swedish Acceptance and Action Questionnaire-SAAQ) are presented. The study is done in two steps. In the first step, the 10-item version of the AAQ-II is investigated through principal component analysis (n = 147). Secondly, due to problems with the component structure, the instrument is reduced to a six-item version and its validity and internal consistency are investigated (n = 154). The six-item version shows good concurrent and convergent validity as well as satisfying internal consistency (α = .85). Furthermore, the Swedish six-item version of the AAQ-II showed one strong component. Test-retest reliability was satisfactory (r = .80; n = 228). In future research, predictive and external validity would be important to investigate in order to further ensure that the SAAQ is a useful measure for clinical research. In conclusion, the SAAQ has satisfactory psychometric properties, but more data need to be gathered to further explore the possibilities for the instruments in Swedish contexts.

Principal component analysis acceleration of rovibrational coarse-grain models for internal energy excitation and dissociation

NASA Astrophysics Data System (ADS)

Bellemans, Aurélie; Parente, Alessandro; Magin, Thierry

2018-04-01

The present work introduces a novel approach for obtaining reduced chemistry representations of large kinetic mechanisms in strong non-equilibrium conditions. The need for accurate reduced-order models arises from compression of large ab initio quantum chemistry databases for their use in fluid codes. The method presented in this paper builds on existing physics-based strategies and proposes a new approach based on the combination of a simple coarse grain model with Principal Component Analysis (PCA). The internal energy levels of the chemical species are regrouped in distinct energy groups with a uniform lumping technique. Following the philosophy of machine learning, PCA is applied on the training data provided by the coarse grain model to find an optimally reduced representation of the full kinetic mechanism. Compared to recently published complex lumping strategies, no expert judgment is required before the application of PCA. In this work, we will demonstrate the benefits of the combined approach, stressing its simplicity, reliability, and accuracy. The technique is demonstrated by reducing the complex quantum N2(g+1Σ) -N(S4u ) database for studying molecular dissociation and excitation in strong non-equilibrium. Starting from detailed kinetics, an accurate reduced model is developed and used to study non-equilibrium properties of the N2(g+1Σ) -N(S4u ) system in shock relaxation simulations.

The Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM): An assessment of validity, reliability, and responsiveness.

PubMed

Bryant, Elizabeth; Murtagh, Shemane; Finucane, Laura; McCrum, Carol; Mercer, Christopher; Smith, Toby; Canby, Guy; Rowe, David A; Moore, Ann P

2018-05-11

In response for the need of a freely available, stand-alone, validated outcome measure for use within musculoskeletal (MSK) physiotherapy practice, sensitive enough to measure clinical effectiveness, we developed an MSK patient reported outcome measure. This study examined the validity and reliability of the newly developed Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM) within physiotherapy outpatient settings. Two hundred twenty-four patients attending physiotherapy outpatient departments in South East England with an MSK condition participated in this study. The BmPROM was assessed for user friendliness (rated feedback, N = 224), reliability (internal consistency and test-retest reliability, n = 42), validity (internal and external construct validity, N = 224), and responsiveness (internal, n = 25). Exploratory factor analysis indicated that a two-factor model provides a good fit to the data. Factors were representative of "Functionality" and "Wellbeing". Correlations observed between the BmPROM and SF-36 domains provided evidence of convergent validity. Reliability results indicated that both subscales were internally consistent with alphas above the acceptable limits for both "Functionality" (α = .85, 95% CI [.81, .88]) and 'Wellbeing' (α = .80, 95% CI [.75, .84]). Test-retest analyses (n = 42) demonstrated a high degree of reliability between "Functionality" (ICC = .84; 95% CI [.72, .91]) and "Wellbeing" scores (ICC = .84; 95% CI [.72, .91]). Further examination of test-retest reliability through the Bland-Altman analysis demonstrated that the difference between "Functionality" and "Wellbeing" test scores did not vary as a function of absolute test score. Large treatment effect sizes were found for both subscales (Functionality d = 1.10; Wellbeing 1.03). The BmPROM is a reliable and valid outcome measure for use in evaluating physiotherapy treatment of MSK conditions. Copyright © 2018 John Wiley & Sons, Ltd.

Reliability of the Cooking Task in adults with acquired brain injury.

PubMed

Poncet, Frédérique; Swaine, Bonnie; Taillefer, Chantal; Lamoureux, Julie; Pradat-Diehl, Pascale; Chevignard, Mathilde

2015-01-01

Acquired brain injury (ABI) often leads to deficits in executive functioning (EF) responsible for severe and long-standing disabilities in daily life activities. The Cooking Task is an ecological and valid test of EF involving multi-tasking in a real environment. Given its complex scoring system, it is important to establish the tool's reliability. The objective of the study was to examine the reliability of the Cooking Task (internal consistency, inter-rater and test-retest reliability). A total of 160 patients with ABI (113 men, mean age 37 years, SD = 14.3) were tested using the Cooking Task. For test-retest reliability, patients were assessed by the same rater on two occasions (mean interval 11 days) while two raters independently and simultaneously observed and scored patients' performances to estimate inter-rater reliability. Internal consistency was high for the global scale (Cronbach α = .74). Inter-rater reliability (n = 66) for total errors was also high (ICC = .93), however the test-retest reliability (n = 11) was poor (ICC = .36). In general the Cooking Task appears to be a reliable tool. The low test-retest results were expected given the importance of EF in the performance of novel tasks.

HPLC-MRM relative quantification analysis of fatty acids based on a novel derivatization strategy.

PubMed

Cai, Tie; Ting, Hu; Xin-Xiang, Zhang; Jiang, Zhou; Jin-Lan, Zhang

2014-12-07

Fatty acids (FAs) are associated with a series of diseases including tumors, diabetes, and heart diseases. As potential biomarkers, FAs have attracted increasing attention from both biological researchers and the pharmaceutical industry. However, poor ionization efficiency, extreme diversity, strict dependence on internal standards and complicated multiple reaction monitoring (MRM) optimization protocols have challenged efforts to quantify FAs. In this work, a novel derivatization strategy based on 2,4-bis(diethylamino)-6-hydrazino-1,3,5-triazine was developed to enable quantification of FAs. The sensitivity of FA detection was significantly enhanced as a result of the derivatization procedure. FA quantities as low as 10 fg could be detected by high-performance liquid chromatography coupled with triple-quadrupole mass spectrometry. General MRM conditions were developed for any FA, which facilitated the quantification and extended the application of the method. The FA quantification strategy based on HPLC-MRM was carried out using deuterated derivatization reagents. "Heavy" derivatization reagents were used as internal standards (ISs) to minimize matrix effects. Prior to statistical analysis, amounts of each FA species were normalized by their corresponding IS, which guaranteed the accuracy and reliability of the method. FA changes in plasma induced by ageing were studied using this strategy. Several FA species were identified as potential ageing biomarkers. The sensitivity, accuracy, reliability, and full coverage of the method ensure that this strategy has strong potential for both biomarker discovery and lipidomic research.

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

PubMed

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Psychometric properties of belief measures about osteoporosis and its control.

PubMed

Alexander, Lacey; Wajanatinapart, Piyaorn; Lauver, Diane

2017-12-01

Osteoporosis (OP) is a chronic health condition with potentially serious consequences. Although preventive behaviors are important to control OP, many people do not engage in such behaviors. Although beliefs about preventive behaviors for OP influence such behaviors, we could not find psychometrically strong measures of such beliefs for use in planned research. Our initial study was done to assess the content validity, clarity, and internal consistency of belief measures regarding behaviors to control OP: perceived competence, perceived susceptibility, and perceived severity, based on relevant theories. Using a descriptive design, we recruited five clinicians to rate proposed measures for content validity. We also recruited fifty-one older adults from five different counties in a Midwestern state to respond to proposed measures so we could assess clarity and internal consistency reliability. The content validity indices of items varied from 0.60-1.00. The content validity indices of scales varied from 0.73-1.00. For reliability, the final Cronbach's alphas were 0.79-0.96. Addressing a gap in research, we have documented good psychometric properties of belief measures regarding OP and its control. In describing our search for psychometrically sound measures, we have raised issues for future researchers to consider prior to adopting use of existing measures. Nurses can use these measures to assess and address the accuracy of patients' beliefs either individually or in groups. Researchers can use these measures to examine whether or not psycho-educational interventions influence beliefs about OP and its control. Published by Elsevier Inc.

Psychometric properties of the Internalized Stigma of Mental Illness scale adapted for people who use psychoactive substances.

PubMed

Gallo, Verónica Del Valle; Burrone, María Soledad; Fernandez, Alicia Ruth; Boyd, Jennifer E; Abeldaño, Roberto Ariel

2017-01-01

People who consume psychoactive substances may experience situations of social stigma on the part of the society in general, and also situations of internalized-stigma derived from their own consumption of substances. The Internalized Stigma of Mental Illness (ISMI) scale has been shown to be valid and reliable to evaluate the internalized-stigma in people with severe mental disorders, but in Argentina there is no a Spanish version of this scale for use with people who use psychoactive substances. The objective of this work was to evaluate the psychometric properties of the Spanish version of the Internalized Stigma of Mental Illness instrument adapted for people who use psychoactive substances. The work was carried out on a sample of 200 patients older than 18 years under treatment of rehabilitation by consumption of psychoactive substances in a public institution of the city of Córdoba (Argentina) between the years 2014 and 2016. The instrument used was the Internalized Stigma of Mental Illness (ISMI) previously adapted for use in these groups of patients. It was determined the reliability of the scale through Cronbach's coefficients α and factorial structure was analyzed through an exploratory factor analysis. The obtained coefficients showed a high reliability, while in the factorial structure emerged the 4 theoretical dimensions described by Ritsher, namely: social isolation, perceived discrimination, alienation and stereotyping. It is concluded that the scale adapted for people who use psychoactive substances is reliable and with an adequate factorial structure.

Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale with Elementary Age English Learners

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Richards-Tutor, Catherine; Oakes, Wendy Peia; Connor, Kristin

2014-01-01

We report findings of a validation study exploring the Student Risk Screening Scale (SRSS; Drummond, 1994) for use with English learners (ELs) attending a large suburban elementary school. First, we explored the reliability of the SRSS by examining internal consistency, with results indicating adequate internal consistency (0.83). Second, we…

Psychometric Properties of the School Attitude Assessment Survey-Revised with International Baccalaureate High School Students

ERIC Educational Resources Information Center

Dedrick, Robert F.; Shaunessy-Dedrick, Elizabeth; Suldo, Shannon M.; Ferron, John M.

2015-01-01

In two studies (ns = 312 and 1,149) with 9- to 12-grade students in pre-International Baccalaureate (IB) and IB Diploma programs, we evaluated the reliability, factor structure, measurement invariance, and criterion-related validity of the scores from the School Attitude Assessment Survey-Revised (SAAS-R). Reliabilities of the five SAAS-R subscale…

Reliability and Validity of the Psychoeducational Profile-Third Edition Caregiver Report in Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Fu, Chung-Pei; Chen, Kuan-Lin; Tseng, Mei-Hui; Chiang, Fu-Mei; Hsieh, Ching-Lin

2012-01-01

The aim of this study was to examine the internal consistency, inter-respondent reliability, and convergent and divergent validity of the Psychoeducational Profile-third edition Caregiver Report (PEP3-CR) in children with Autism Spectrum Disorders (ASD). We examined the internal consistency on 66 mothers of children with ASD who completed the…

Construct validity, test-retest reliability and internal consistency of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) in patients with carpal tunnel syndrome.

PubMed

Buntragulpoontawee, Montana; Phutrit, Suphatha; Tongprasert, Siam; Wongpakaran, Tinakon; Khunachiva, Jeeranan

2018-03-27

This study evaluated additional psychometric properties of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) which included, test-retest reliability, construct validity, internal consistency of in patients with carpal tunnel syndrome. As for determining construct validity, the Thai EuroQOL questionnaire (EQ-5D-5L) was also administered in order to examine convergent and divergent validity. Fifty patients completed both questionnaires. The DASH-TH showed excellent test-retest reliability (intraclass correlation coefficient = 0.811) and internal consistency (Cronbach's alpha = 0.911). The exploratory factor analysis yielded a six-factor solution while the confirmatory factor analysis denoted that the hypothesized model adequately fit the data with a comparative fit index of 0.967 and a Tucker-Lewis index of 0.964. The related subscales between the DASH-TH and the Thai EQ-5D-5L were significantly correlated, indicating the DASH-TH's convergent and discriminant validity. The DASH-TH demonstrated good reliability, internal consistency construct validity, and multidimensionality, in assessing the upper extremity function in carpal tunnel syndrome patients.

The Internal Reliability of Family Crisis Oriented Personal Evaluation Scale (F-COPES) in Malay version among caregivers of individual with learning disabilities.

PubMed

Alwi, N; Harun, D; Omar, B; Ahmad, M; Zagan, M; Leonard, J H

2015-01-01

Caregivers face challenges to adapt while handling individual with learning disabilities (LD). The Family Crisis Oriented Personal Evaluation Scale (F-COPES) is a widely used instrument to measure coping strategies among caregivers. The current study performed cross cultural translation of F-COPES in Malay language. This study aims to examine the reliability by testing internal consistency of Malay version of F-COPES which is developed through back to back translation method from original English version. The Malay version of F-COPES was administered among 30 caregivers. The reliability of F-COPES in Malay version is good with Cronbach's alpha coefficient value of 0.79. The internal consistency on sub domains of F-COPES such as reframing, acquiring social support and seeking spiritual support also acceptable with Cronbach's alpha values 0.67, 0.74, and 0.80, respectively. The Malay version of F-COPES is a reliable tool to evaluate the coping strategies adopted by the caregivers of individual with LD.

[Validity and reliability of a scale to assess self-efficacy for physical activity in elderly].

PubMed

Borges, Rossana Arruda; Rech, Cassiano Ricardo; Meurer, Simone Teresinha; Benedetti, Tânia Rosane Bertoldo

2015-04-01

This study aimed to analyze the confirmatory factor validity and reliability of a self-efficacy scale for physical activity in a sample of 118 elderly (78% women) from 60 to 90 years of age. Mplus 6.1 was used to evaluate the confirmatory factor analysis. Reliability was tested by internal consistency and temporal stability. The original scale consisted of five items with dichotomous answers (yes/no), independently for walking and moderate and vigorous physical activity. The analysis excluded the item related to confidence in performing physical activities when on vacation. Two constructs were identified, called "self-efficacy for walking" and "self-efficacy for moderate and vigorous physical activity", with a factor load ≥ 0.50. Internal consistency was adequate both for walking (> 0.70) and moderate and vigorous physical activity (> 0.80), and temporal stability was adequate for all the items. In conclusion, the self-efficacy scale for physical activity showed adequate validity, reliability, and internal consistency for evaluating this construct in elderly Brazilians.

A disease-specific measure of health-related quality of life for use in adults with immune thrombocytopenic purpura: its development and validation.

PubMed

Mathias, Susan D; Bussel, James B; George, James N; McMillan, Robert; Okano, Gary J; Nichol, Janet L

2007-02-22

No validated disease-specific measures are available to assess health-related quality of life (HRQoL) in adult subjects with immune thrombocytopenic purpura (ITP). Therefore, we sought to develop and validate the ITP-Patient Assessment Questionnaire (ITP-PAQ) for adult subjects with ITP. Information from literature reviews, focus groups with subjects, and clinicians were used to develop 50 ITP-PAQ items. Factor analyses were conducted to develop the scale structure and reduce the number of items. The final 44-item ITP-PAQ, which includes ten scales [Symptoms (S), Bother-Physical Health (B), Fatigue/Sleep (FT), Activity (A), Fear (FR), Psychological Health (PH), Work (W), Social Activity (SA), Women's Reproductive Health (RH), and Overall (QoL)], was self-administered to adult ITP subjects at baseline and 7-10 days later. Test-retest reliability, internal consistency reliability, construct and known groups validity of the final ITP-PAQ were evaluated. Seventy-three subjects with ITP completed the questionnaire twice. Test-retest reliability, as measured by the intra-class correlation, ranged from 0.52-0.90. Internal consistency reliability was demonstrated with Cronbach's alpha for all scales above the acceptable level of 0.70 (range: 0.71-0.92), except for RH (0.66). Construct validity, assessed by correlating ITP-PAQ scales with established measures (Short Form-36 v.1, SF-36 and Center for Epidemiologic Studies Depression Scale, CES-D), was demonstrated through moderate correlations between the ITP-PAQ SA and SF-36 Social Function scales (r = 0.67), and between ITP-PAQ PH and SF-36 Mental Health Scales (r = 0.63). Moderate to strong inter-scale correlations were reported between ITP-PAQ scales and the CES-D, except for the RH scale. Known groups validity was evaluated by comparing mean scores for groups that differed clinically. Statistically significant differences (p < 0.01) were observed when subjects were categorized by treatment status [S, FT, B, A, PH, and QoL, perceived effectiveness of ITP treatment [S], and time elapsed since ITP diagnosis [PH]. Results provide preliminary evidence of the reliability and validity of the ITP-PAQ in adult subjects with ITP. Further work should be conducted to assess the responsiveness and to estimate the minimal clinical important difference of the ITP-PAQ to more fully understand the impact of ITP and its treatments on HRQoL.

Psychometric Inferences from a Meta-Analysis of Reliability and Internal Consistency Coefficients

ERIC Educational Resources Information Center

Botella, Juan; Suero, Manuel; Gambara, Hilda

2010-01-01

A meta-analysis of the reliability of the scores from a specific test, also called reliability generalization, allows the quantitative synthesis of its properties from a set of studies. It is usually assumed that part of the variation in the reliability coefficients is due to some unknown and implicit mechanism that restricts and biases the…

Preliminary development and psychometric evaluation of an unmet needs measure for adolescents and young adults with cancer: the Cancer Needs Questionnaire - Young People (CNQ-YP).

PubMed

Clinton-McHarg, Tara; Carey, Mariko; Sanson-Fisher, Rob; D'Este, Catherine; Shakeshaft, Anthony

2012-01-30

Adolescents and young adult (AYA) cancer survivors may have unique physical, psychological and social needs due to their cancer occurring at a critical phase of development. The aim of this study was to develop a psychometrically rigorous measure of unmet need to capture the specific needs of this group. Items were developed following a comprehensive literature review, focus groups with AYAs, and feedback from health care providers, researchers and other professionals. The measure was pilot tested with 32 AYA cancer survivors recruited through a state-based cancer registry to establish face and content validity. A main sample of 139 AYA cancer patients and survivors were recruited through seven treatment centres and invited to complete the questionnaire. To establish test-retest reliability, a sub-sample of 34 participants completed the measure a second time. Exploratory factor analysis was performed and the measure was assessed for internal consistency, discriminative validity, potential responsiveness and acceptability. The Cancer Needs Questionnaire - Young People (CNQ-YP) has established face and content validity, and acceptability. The final measure has 70 items and six factors: Treatment Environment and Care (33 items); Feelings and Relationships (14 items); Daily Life (12 items); Information and Activities (5 items); Education (3 items); and Work (3 items). All domains achieved Cronbach's alpha values greater than 0.80. Item-to-item test-retest reliability was also high, with all but four items reaching weighted kappa values above 0.60. The CNQ-YP is the first multi-dimensional measure of unmet need which has been developed specifically for AYA cancer patients and survivors. The measure displays a strong factor structure, and excellent internal consistency and test-retest reliability. However, the small sample size has implications for the reliability of the statistical analyses undertaken, particularly the exploratory factor analysis. Future studies with a larger sample are recommended to confirm the factor structure of the measure. Longitudinal studies to establish responsiveness and predictive validity should also be undertaken.

Preliminary development and psychometric evaluation of an unmet needs measure for adolescents and young adults with cancer: the Cancer Needs Questionnaire - Young People (CNQ-YP)

PubMed Central

2012-01-01

Background Adolescents and young adult (AYA) cancer survivors may have unique physical, psychological and social needs due to their cancer occurring at a critical phase of development. The aim of this study was to develop a psychometrically rigorous measure of unmet need to capture the specific needs of this group. Methods Items were developed following a comprehensive literature review, focus groups with AYAs, and feedback from health care providers, researchers and other professionals. The measure was pilot tested with 32 AYA cancer survivors recruited through a state-based cancer registry to establish face and content validity. A main sample of 139 AYA cancer patients and survivors were recruited through seven treatment centres and invited to complete the questionnaire. To establish test-retest reliability, a sub-sample of 34 participants completed the measure a second time. Exploratory factor analysis was performed and the measure was assessed for internal consistency, discriminative validity, potential responsiveness and acceptability. Results The Cancer Needs Questionnaire - Young People (CNQ-YP) has established face and content validity, and acceptability. The final measure has 70 items and six factors: Treatment Environment and Care (33 items); Feelings and Relationships (14 items); Daily Life (12 items); Information and Activities (5 items); Education (3 items); and Work (3 items). All domains achieved Cronbach's alpha values greater than 0.80. Item-to-item test-retest reliability was also high, with all but four items reaching weighted kappa values above 0.60. Conclusions The CNQ-YP is the first multi-dimensional measure of unmet need which has been developed specifically for AYA cancer patients and survivors. The measure displays a strong factor structure, and excellent internal consistency and test-retest reliability. However, the small sample size has implications for the reliability of the statistical analyses undertaken, particularly the exploratory factor analysis. Future studies with a larger sample are recommended to confirm the factor structure of the measure. Longitudinal studies to establish responsiveness and predictive validity should also be undertaken. PMID:22284545

Patient reported outcomes in GNE myopathy: incorporating a valid assessment of physical function in a rare disease.

PubMed

Slota, Christina; Bevans, Margaret; Yang, Li; Shrader, Joseph; Joe, Galen; Carrillo, Nuria

2018-05-01

The aim of this analysis was to evaluate the psychometric properties of three patient reported outcome (PRO) measures characterizing physical function in GNE myopathy: the Human Activity Profile, the Inclusion Body Myositis Functional Rating Scale, and the Activities-specific Balance Confidence scale. This analysis used data from 35 GNE myopathy subjects participating in a natural history study. For construct validity, correlational and known-group analyses were between the PROs and physical assessments. Reliability of the PROs between baseline and 6 months was evaluated using the intra-class correlation coefficient model; internal consistency was tested with Cronbach's alpha. The hypothesized moderate positive correlations for construct validity were supported; the strongest correlation was between the human activity profile adjusted activity score and the adult myopathy assessment endurance subscale score (r = 0.81; p < 0.0001). The PROs were able to discriminate between known high and low functioning groups for the adult myopathy assessment tool. Internal consistency of the PROs was high (α > 0.8) and there was strong reliability (ICC >0.62). The PROs are valid and reliable measures of physical function in GNE myopathy and should be incorporated in investigations to better understand the impact of progressive muscle weakness on physical function in this rare disease population. Implications for Rehabilitation GNE myopathy is a rare muscle disease that results in slow progressive muscle atrophy and weakness, ultimately leading to wheelchair use and dependence on a caregiver. There is limited knowledge on the impact of this disease on the health-related quality of life, specifically physical function, of this rare disease population. Three patient reported outcomes have been shown to be valid and reliable in GNE myopathy subjects and should be incorporated in future investigations to better understand how progressive muscle weakness impacts physical functions in this rare disease population. The patient reported outcome scores of GNE myopathy patients indicate a high risk for falls and impaired physical functioning, so it is important clinicians assess and provide interventions for these subjects to maintain their functional capacity.

External validation of Global Evaluative Assessment of Robotic Skills (GEARS).

PubMed

Aghazadeh, Monty A; Jayaratna, Isuru S; Hung, Andrew J; Pan, Michael M; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2015-11-01

We demonstrate the construct validity, reliability, and utility of Global Evaluative Assessment of Robotic Skills (GEARS), a clinical assessment tool designed to measure robotic technical skills, in an independent cohort using an in vivo animal training model. Using a cross-sectional observational study design, 47 voluntary participants were categorized as experts (>30 robotic cases completed as primary surgeon) or trainees. The trainee group was further divided into intermediates (≥5 but ≤30 cases) or novices (<5 cases). All participants completed a standardized in vivo robotic task in a porcine model. Task performance was evaluated by two expert robotic surgeons and self-assessed by the participants using the GEARS assessment tool. Kruskal-Wallis test was used to compare the GEARS performance scores to determine construct validity; Spearman's rank correlation measured interobserver reliability; and Cronbach's alpha was used to assess internal consistency. Performance evaluations were completed on nine experts and 38 trainees (14 intermediate, 24 novice). Experts demonstrated superior performance compared to intermediates and novices overall and in all individual domains (p < 0.0001). In comparing intermediates and novices, the overall performance difference trended toward significance (p = 0.0505), while the individual domains of efficiency and autonomy were significantly different between groups (p = 0.0280 and 0.0425, respectively). Interobserver reliability between expert ratings was confirmed with a strong correlation observed (r = 0.857, 95 % CI [0.691, 0.941]). Experts and participant scoring showed less agreement (r = 0.435, 95 % CI [0.121, 0.689] and r = 0.422, 95 % CI [0.081, 0.0672]). Internal consistency was excellent for experts and participants (α = 0.96, 0.98, 0.93). In an independent cohort, GEARS was able to differentiate between different robotic skill levels, demonstrating excellent construct validity. As a standardized assessment tool, GEARS maintained consistency and reliability for an in vivo robotic surgical task and may be applied for skills evaluation in a broad range of robotic procedures.

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

PubMed Central

Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel

2016-01-01

Background The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users’ satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=−.35, P<.001) and perceived stress (r=−.48, P<.001) demonstrated the construct validity of the scale. Conclusions The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user’s general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user’s perspective in the overall evaluation of Web-based health interventions. PMID:27582341

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions.

PubMed

Boß, Leif; Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel

2016-08-31

The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

A Preliminary Study on the Reliability of the Malay Version of PedsQL™ Family Impact Module among Caregivers of Children with Disabilities in Kelantan, Malaysia

PubMed Central

Rahman, Azriani Ab; Mohamad, Norsarwany; Imran, Musa Kamarul; Ibrahim, Wan Pauzi Wan; Othman, Azizah; Aziz, Aniza Abd; Harith, Sakinah; Ibrahim, Mohd Ismail; Ariffin, Nor Hashimah; Van Rostenberghe, Hans

2011-01-01

Background: No previous study has assessed the impact of childhood disability on parents and family in the context of Malaysia, and no instrument to measure this impact has previously been available. The objective of this cross-sectional study was to determine the reliability of a Malay version of the PedsQL™ Family Impact Module that measures the impact of children with disabilities (CWD) on their parents and family in a Malaysian context. Methods: The study was conducted in 2009. The questionnaire was translated forward and backward before it was administered to 44 caregivers of CWD to determine the internal consistency reliability. The test for Cronbach’s alpha was performed. Results: The internal consistency reliability was good. The Cronbach’s alpha for all domains was above 0.7, ranging from 0.73 to 0.895. Conclusion: The Malay version of the PedsQL™ Family Impact Module showed evidence of good internal consistency reliability. However, future studies with a larger sample size are necessary before the module can be recommended as a tool to measure the impact of disability on Malay-speaking Malaysian families. PMID:22589674

Is international junior success a reliable predictor for international senior success in elite combat sports?

PubMed

Li, Pingwei; De Bosscher, Veerle; Pion, Johan; Weissensteiner, Juanita R; Vertonghen, Jikkemien

2018-05-01

Currently in the literature, there is a dearth of empirical research that confirms whether international junior success is a reliable predictor for future international senior success. Despite the uncertainty of the junior-senior relationship, federations and coaches still tend to use junior success as a predictor for long-term senior success. A range of former investigations utilising a retrospective lens has merely focused on success that athletes attained at junior level competitions. Success that was achieved at senior-level competitions but at a junior age was relatively ignored. This study explored to what extent international senior success can be predicted based on success that athletes achieved in either international junior level competitions (i.e. junior medalists) or senior competitions at a junior age (i.e. early achievers). The sample contains 4011 international male and female athletes from three combat sports (taekwondo, wrestling and boxing), who were born between 1974 and 1990 and participated in both international junior and senior-level competitions between 1990 and 2016. Gender and sport differences were compared. The results revealed that 61.4% of the junior medalists and 90.4% of the early achievers went on to win international medals at a senior age. Among the early achievers, 92.2% of the taekwondo athletes, 68.4% of the wrestling athletes and 37.9% of the boxing athletes could be reliably "predicted" to win international senior medals. The findings demonstrate that specific to the three combat sports examined, international junior success appears to be an important predictor to long-term international senior success.

Patterns and reliability of EEG during error monitoring for internal versus external feedback in schizophrenia.

PubMed

Llerena, Katiah; Wynn, Jonathan K; Hajcak, Greg; Green, Michael F; Horan, William P

2016-07-01

Accurately monitoring one's performance on daily life tasks, and integrating internal and external performance feedback are necessary for guiding productive behavior. Although internal feedback processing, as indexed by the error-related negativity (ERN), is consistently impaired in schizophrenia, initial findings suggest that external performance feedback processing, as indexed by the feedback negativity (FN), may actually be intact. The current study evaluated internal and external feedback processing task performance and test-retest reliability in schizophrenia. 92 schizophrenia outpatients and 63 healthy controls completed a flanker task (ERN) and a time estimation task (FN). Analyses examined the ΔERN and ΔFN defined as difference waves between correct/positive versus error/negative feedback conditions. A temporal principal component analysis was conducted to distinguish the ΔERN and ΔFN from overlapping neural responses. We also assessed test-retest reliability of ΔERN and ΔFN in patients over a 4-week interval. Patients showed reduced ΔERN accompanied by intact ΔFN. In patients, test-retest reliability for both ΔERN and ΔFN over a four-week period was fair to good. Individuals with schizophrenia show a pattern of impaired internal, but intact external, feedback processing. This pattern has implications for understanding the nature and neural correlates of impaired feedback processing in schizophrenia. Published by Elsevier B.V.

Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

PubMed

Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

2015-01-01

Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief disease management encounters. MISHCE also evaluates quality of the patient-provider therapeutic alliance, i.e., the "flow" of the interaction. Copyright © 2015 Elsevier Inc. All rights reserved.

The Recovery Knowledge Inventory for Measurement of Nursing Student Views on Recovery-oriented Mental Health Services.

PubMed

Happell, Brenda; Byrne, Louise; Platania-Phung, Chris

2015-01-01

Recovery-oriented services are a goal for policy and practice in the Australian mental health service system. Evidence-based reform requires an instrument to measure knowledge of recovery concepts. The Recovery Knowledge Inventory (RKI) was designed for this purpose, however, its suitability and validity for student health professionals has not been evaluated. The purpose of the current article is to report the psychometric features of the RKI for measuring nursing students' views on recovery. The RKI, a self-report measure, consists of four scales: (I) Roles and Responsibilities, (II) Non-Linearity of the Recovery Process, (III) Roles of Self-Definition and Peers, and (IV) Expectations Regarding Recovery. Confirmatory and exploratory factor analyses of the baseline data (n = 167) were applied to assess validity and reliability. Exploratory factor analyses generally replicated the item structure suggested by the three main scales, however more stringent analyses (confirmatory factor analysis) did not provide strong support for convergent validity. A refined RKI with 16 items had internal reliabilities of α = .75 for Roles and Responsibilities, α = .49 for Roles of Self-Definition and Peers, and α = .72, for Recovery as Non-Linear Process. If the RKI is to be applied to nursing student populations, the conceptual underpinning of the instrument needs to be reworked, and new items should be generated to evaluate and improve scale validity and reliability.

Development of the Assessment of Belief Conflict in Relationship-14 (ABCR-14).

PubMed

Kyougoku, Makoto; Teraoka, Mutsumi; Masuda, Noriko; Ooura, Mariko; Abe, Yasushi

2015-01-01

Nurses and other healthcare workers frequently experience belief conflict, one of the most important, new stress-related problems in both academic and clinical fields. In this study, using a sample of 1,683 nursing practitioners, we developed The Assessment of Belief Conflict in Relationship-14 (ABCR-14), a new scale that assesses belief conflict in the healthcare field. Standard psychometric procedures were used to develop and test the scale, including a qualitative framework concept and item-pool development, item reduction, and scale development. We analyzed the psychometric properties of ABCR-14 according to entropy, polyserial correlation coefficient, exploratory factor analysis, confirmatory factor analysis, average variance extracted, Cronbach's alpha, Pearson product-moment correlation coefficient, and multidimensional item response theory (MIRT). The results of the analysis supported a three-factor model consisting of 14 items. The validity and reliability of ABCR-14 was suggested by evidence from high construct validity, structural validity, hypothesis testing, internal consistency reliability, and concurrent validity. The result of the MIRT offered strong support for good item response of item slope parameters and difficulty parameters. However, the ABCR-14 Likert scale might need to be explored from the MIRT point of view. Yet, as mentioned above, there is sufficient evidence to support that ABCR-14 has high validity and reliability. The ABCR-14 demonstrates good psychometric properties for nursing belief conflict. Further studies are recommended to confirm its application in clinical practice.

Is the Neonatal Tongue Screening Test a valid and reliable tool for detecting ankyloglossia in newborns?

PubMed

Brandão, Clarissa de Almeida; de Marsillac, Mirian de Waele Souchois; Barja-Fidalgo, Fernanda; Oliveira, Branca Heloisa

2018-05-16

Although there is a lack of strong evidence for the association between ankyloglossia in newborns and impaired breastfeeding, screening for ankyloglossia using the Neonatal Tongue Screening Test (NTST) is mandated by law in Brazilian maternities. To assess the reliability and validity of the NTST. cohort study; baseline sample comprised 268 mother-newborn dyads. At follow-up, 169 mothers were contacted by telephone. Interviews with the mothers for data collection were performed up to 48 h and at 1-3 months after childbirth. Trained and calibrated personnel performed the oral examinations of the newborns. Thirty newborns were examined for inter-reproducibility assessment. Of the 268 newborns included, 212 had a lingual frenulum that could be visually inspected and their NTST scores ranged from zero to nine (mean = 2.0, ±2.0). Interexaminer reproducibility was acceptable (Intraclass correlation coefficient = 0.77). Internal consistency of the NTST was poor (Cronbach's alpha = 0.28). Construct validity was investigated through the association between NTST scores and difficulties in breastfeeding at baseline and follow-up, and infants' weight gain at follow-up (mean age 32 ± 6.7 days). No statistically significant associations were found. NTST is neither reliable nor valid for detecting ankyloglossia that may interfere with breastfeeding in newborns. © 2018 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

The Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH): an observational instrument for assessing the physical environment of institutional settings for persons with dementia.

PubMed

Sloane, Philip D; Mitchell, C Madeline; Weisman, Gerald; Zimmerman, Sheryl; Foley, Kristie M Long; Lynn, Mary; Calkins, Margaret; Lawton, M Powell; Teresi, Jeanne; Grant, Leslie; Lindeman, David; Montgomery, Rhonda

2002-03-01

To develop an observational instrument that describes the ability of physical environments of institutional settings to address therapeutic goals for persons with dementia. A National Institute on Aging workgroup identified and subsequently revised items that evaluated exit control, maintenance, cleanliness, safety, orientation/cueing, privacy, unit autonomy, outdoor access, lighting, noise, visual/tactile stimulation, space/seating, and familiarity/homelikeness. The final instrument contains 84 discrete items and one global rating. A summary scale, the Special Care Unit Environmental Quality Scale (SCUEQS), consists of 18 items. Lighting items were validated using portable light meters. Concurrent criterion validation compared SCUEQS scores with the Professional Environmental Assessment Protocol (PEAP). Interrater kappa statistics for 74% of items were above.60. For another 10% of items, kappas could not be calculated due to empty cells, but interrater agreement was above 80%. The SCUEQS demonstrated an interrater reliability of.93, a test--retest reliability of.88, and an internal consistency of.81--.83. Light meter ratings correlated significantly with the Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH) lighting items (r =.29--.38, p =.01--.04), and the SCUEQS correlated significantly with global PEAP ratings (r =.52, p <.01). The TESS-NH efficiently assesses discrete elements of the physical environment and has strong reliability and validity. The SCUEQS provides a quantitative measure of environmental quality in institutional settings.

Proportional spike-timing precision and firing reliability underlie efficient temporal processing of periodicity and envelope shape cues

PubMed Central

Zheng, Y.

2013-01-01

Temporal sound cues are essential for sound recognition, pitch, rhythm, and timbre perception, yet how auditory neurons encode such cues is subject of ongoing debate. Rate coding theories propose that temporal sound features are represented by rate tuned modulation filters. However, overwhelming evidence also suggests that precise spike timing is an essential attribute of the neural code. Here we demonstrate that single neurons in the auditory midbrain employ a proportional code in which spike-timing precision and firing reliability covary with the sound envelope cues to provide an efficient representation of the stimulus. Spike-timing precision varied systematically with the timescale and shape of the sound envelope and yet was largely independent of the sound modulation frequency, a prominent cue for pitch. In contrast, spike-count reliability was strongly affected by the modulation frequency. Spike-timing precision extends from sub-millisecond for brief transient sounds up to tens of milliseconds for sounds with slow-varying envelope. Information theoretic analysis further confirms that spike-timing precision depends strongly on the sound envelope shape, while firing reliability was strongly affected by the sound modulation frequency. Both the information efficiency and total information were limited by the firing reliability and spike-timing precision in a manner that reflected the sound structure. This result supports a temporal coding strategy in the auditory midbrain where proportional changes in spike-timing precision and firing reliability can efficiently signal shape and periodicity temporal cues. PMID:23636724

The revised Generalized Expectancy for Success Scale: a validity and reliability study.

PubMed

Hale, W D; Fiedler, L R; Cochran, C D

1992-07-01

The Generalized Expectancy for Success Scale (GESS; Fibel & Hale, 1978) was revised and assessed for reliability and validity. The revised version was administered to 199 college students along with other conceptually related measures, including the Rosenberg Self-Esteem Scale, the Life Orientation Test, and Rotter's Internal-External Locus of Control Scale. One subsample of students also completed the Eysenck Personality Inventory, while another subsample performed a criterion-related task that involved risk taking. Item analysis yielded 25 items with correlations of .45 or higher with the total score. Results indicated high internal consistency and test-retest reliability.

Validation of a Theory of Planned Behavior-Based Questionnaire to Examine Factors Associated With Milk Expression.

PubMed

Bai, Yeon K; Dinour, Lauren M

2017-11-01

A proper assessment of multidimensional needs for breastfeeding mothers in various settings is crucial to facilitate and support breastfeeding and its exclusivity. The theory of planned behavior (TPB) has been used frequently to measure factors associated with breastfeeding. Full utility of the TPB requires accurate measurement of theory constructs. Research aim: This study aimed to develop and confirm the psychometric properties of an instrument, Milk Expression on Campus, based on the TPB and to establish the reliability and validity of the instrument. In spring 2015, 218 breastfeeding (current or in the recent past) employees and students at one university campus in northern New Jersey completed the online questionnaire containing demography and theory-based items. Internal consistency (α) and split-half reliability ( r) tests and factor analyses established and confirmed the reliability and construct validity of this instrument. Milk Expression on Campus showed strong and significant reliabilities as a full scale (α = .78, r = .74, p < .001) and theory construct subscales. Validity was confirmed as psychometric properties corresponded to the factors extracted from the scale. Four factors extracted from the direct construct subscales accounted for 79.49% of the total variability. Four distinct factors from the indirect construct subscales accounted for 73.68% of the total variability. Milk Expression on Campus can serve as a model TPB-based instrument to examine factors associated with women's milk expression behavior. The utility of this instrument extends to designing effective promotion programs to foster breastfeeding and milk expression behaviors in diverse settings.

Use of a safety climate questionnaire in UK health care: factor structure, reliability and usability.

PubMed

Hutchinson, A; Cooper, K L; Dean, J E; McIntosh, A; Patterson, M; Stride, C B; Laurence, B E; Smith, C M

2006-10-01

To explore the factor structure, reliability, and potential usefulness of a patient safety climate questionnaire in UK health care. Four acute hospital trusts and nine primary care trusts in England. The questionnaire used was the 27 item Teamwork and Safety Climate Survey. Thirty three healthcare staff commented on the wording and relevance. The questionnaire was then sent to 3650 staff within the 13 NHS trusts, seeking to achieve at least 600 responses as the basis for the factor analysis. 1307 questionnaires were returned (36% response). Factor analyses and reliability analyses were carried out on 897 responses from staff involved in direct patient care, to explore how consistently the questions measured the underlying constructs of safety climate and teamwork. Some questionnaire items related to multiple factors or did not relate strongly to any factor. Five items were discarded. Two teamwork factors were derived from the remaining 11 teamwork items and three safety climate factors were derived from the remaining 11 safety items. Internal consistency reliabilities were satisfactory to good (Cronbach's alpha > or =0.69 for all five factors). This is one of the few studies to undertake a detailed evaluation of a patient safety climate questionnaire in UK health care and possibly the first to do so in primary as well as secondary care. The results indicate that a 22 item version of this safety climate questionnaire is useable as a research instrument in both settings, but also demonstrates a more general need for thorough validation of safety climate questionnaires before widespread usage.

Reliability and validity of Arabic translation of Medication Adherence Report Scale (MARS) and Beliefs about Medication Questionnaire (BMQ)–specific for use in children and their parents

PubMed Central

Alsous, Mervat; Alhalaiqa, Fadwa; Abu Farha, Rana; Abdel Jalil, Mariam; McElnay, James; Horne, Robert

2017-01-01

Objectives to evaluate the reliability and discriminant validity of Arabic translation of the Medication Adherence Report Scale (MARS) and the Beliefs about Medication Questionnaire-specific (BMQ-specific). Methods Having developed Arabic translations of the study instruments, a cross-sectional study was carried out between March and October 2015 in two multidisciplinary governmental hospitals in Jordan. An expert panel monitored the forward and backward translation of the MARS and BMQ. Standard Arabic was used (with no specific dialect inclusion) to allow greater generalisability across Arabic speaking countries. Once the Arabic translations of the questionnaires were developed they were tested for consistency, validity and reliability on a group of children with chronic diseases and their parents. Results A total of 258 parents and 208 children were included in the study. The median age of participated children and parents was 15 years and 42 years respectively. Principle component analysis of all questionnaires indicated that all had good construct validity as they clearly measured one construct. The questionnaires were deemed reliable based on the results of Cronbach alpha coefficient. Furthermore, reliability of the questionnaires was demonstrated by test-retest intraclass correlation coefficients (ICC) which ranged from good to excellent for all scales (ICC>0.706). The Pearson correlation coefficient ranged from 0.546–0.805 for the entire sample which indicated a significant moderate to strong positive correlation between MARS and BMQ items at time 1 and 2. Reported adherence was greater than 59% using MARS-children and MARS-parents scales, and was correlated with beliefs in necessity and independent of the concerns regarding medications. Conclusion The Arabic translations of both BMQ and MARS for use in children and their parents have good internal consistency and proved to be valid and reliable tools that can be used by researchers in clinical practice to measure adherence and beliefs about medications in Arabic speaking patient populations. PMID:28192467

Reliability and validity of Arabic translation of Medication Adherence Report Scale (MARS) and Beliefs about Medication Questionnaire (BMQ)-specific for use in children and their parents.

PubMed

Alsous, Mervat; Alhalaiqa, Fadwa; Abu Farha, Rana; Abdel Jalil, Mariam; McElnay, James; Horne, Robert

2017-01-01

to evaluate the reliability and discriminant validity of Arabic translation of the Medication Adherence Report Scale (MARS) and the Beliefs about Medication Questionnaire-specific (BMQ-specific). Having developed Arabic translations of the study instruments, a cross-sectional study was carried out between March and October 2015 in two multidisciplinary governmental hospitals in Jordan. An expert panel monitored the forward and backward translation of the MARS and BMQ. Standard Arabic was used (with no specific dialect inclusion) to allow greater generalisability across Arabic speaking countries. Once the Arabic translations of the questionnaires were developed they were tested for consistency, validity and reliability on a group of children with chronic diseases and their parents. A total of 258 parents and 208 children were included in the study. The median age of participated children and parents was 15 years and 42 years respectively. Principle component analysis of all questionnaires indicated that all had good construct validity as they clearly measured one construct. The questionnaires were deemed reliable based on the results of Cronbach alpha coefficient. Furthermore, reliability of the questionnaires was demonstrated by test-retest intraclass correlation coefficients (ICC) which ranged from good to excellent for all scales (ICC>0.706). The Pearson correlation coefficient ranged from 0.546-0.805 for the entire sample which indicated a significant moderate to strong positive correlation between MARS and BMQ items at time 1 and 2. Reported adherence was greater than 59% using MARS-children and MARS-parents scales, and was correlated with beliefs in necessity and independent of the concerns regarding medications. The Arabic translations of both BMQ and MARS for use in children and their parents have good internal consistency and proved to be valid and reliable tools that can be used by researchers in clinical practice to measure adherence and beliefs about medications in Arabic speaking patient populations.

Development, test-retest reliability and validity of the Pharmacy Value-Added Services Questionnaire (PVASQ)

PubMed Central

Tan, Christine L.; Hassali, Mohamed A.; Saleem, Fahad; Shafie, Asrul A.; Aljadhey, Hisham; Gan, Vincent B.

2015-01-01

Objective: (i) To develop the Pharmacy Value-Added Services Questionnaire (PVASQ) using emerging themes generated from interviews. (ii) To establish reliability and validity of questionnaire instrument. Methods: Using an extended Theory of Planned Behavior as the theoretical model, face-to-face interviews generated salient beliefs of pharmacy value-added services. The PVASQ was constructed initially in English incorporating important themes and later translated into the Malay language with forward and backward translation. Intention (INT) to adopt pharmacy value-added services is predicted by attitudes (ATT), subjective norms (SN), perceived behavioral control (PBC), knowledge and expectations. Using a 7-point Likert-type scale and a dichotomous scale, test-retest reliability (N=25) was assessed by administrating the questionnaire instrument twice at an interval of one week apart. Internal consistency was measured by Cronbach’s alpha and construct validity between two administrations was assessed using the kappa statistic and the intraclass correlation coefficient (ICC). Confirmatory Factor Analysis, CFA (N=410) was conducted to assess construct validity of the PVASQ. Results: The kappa coefficients indicate a moderate to almost perfect strength of agreement between test and retest. The ICC for all scales tested for intra-rater (test-retest) reliability was good. The overall Cronbach’ s alpha (N=25) is 0.912 and 0.908 for the two time points. The result of CFA (N=410) showed most items loaded strongly and correctly into corresponding factors. Only one item was eliminated. Conclusions: This study is the first to develop and establish the reliability and validity of the Pharmacy Value-Added Services Questionnaire instrument using the Theory of Planned Behavior as the theoretical model. The translated Malay language version of PVASQ is reliable and valid to predict Malaysian patients’ intention to adopt pharmacy value-added services to collect partial medicine supply. PMID:26445622

Psychometric evaluation of an inpatient consumer survey measuring satisfaction with psychiatric care.

PubMed

Ortiz, Glorimar; Schacht, Lucille

2012-01-01

Measurement of consumers' satisfaction in psychiatric settings is important because it has been correlated with improved clinical outcomes and administrative measures of high-quality care. These consumer satisfaction measurements are actively used as performance measures required by the accreditation process and for quality improvement activities. Our objectives were (i) to re-evaluate, through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), the structure of an instrument intended to measure consumers' satisfaction with care in psychiatric settings and (ii) to examine and publish the psychometric characteristics, validity and reliability, of the Inpatient Consumer Survey (ICS). To psychometrically test the structure of the ICS, 34 878 survey results, submitted by 90 psychiatric hospitals in 2008, were extracted from the Behavioral Healthcare Performance Measurement System (BHPMS). Basic descriptive item-response and correlation analyses were performed for total surveys. Two datasets were randomly created for analysis. A random sample of 8229 survey results was used for EFA. Another random sample of 8261 consumer survey results was used for CFA. This same sample was used to perform validity and reliability analyses. The item-response analysis showed that the mean range for a disagree/agree five-point scale was 3.10-3.94. Correlation analysis showed a strong relationship between items. Six domains (dignity, rights, environment, empowerment, participation, and outcome) with internal reliabilities between good to moderate (0.87-0.73) were shown to be related to overall care satisfaction. Overall reliability for the instrument was excellent (0.94). Results from CFA provided support for the domains structure of the ICS proposed through EFA. The overall findings from this study provide evidence that the ICS is a reliable measure of consumer satisfaction in psychiatric inpatient settings. The analysis has shown the ICS to provide valid and reliable results and to focus on the specific concerns of consumers of psychiatric inpatient care. Scores by item indicate that opportunity for improvement exists across healthcare organizations.

Reliability and validation of the Dutch Achilles tendon Total Rupture Score.

PubMed

Opdam, K T M; Zwiers, R; Wiegerinck, J I; Kleipool, A E B; Haverlag, R; Goslings, J C; van Dijk, C N

2018-03-01

Patient-reported outcome measures (PROMs) have become a cornerstone for the evaluation of the effectiveness of treatment. The Achilles tendon Total Rupture Score (ATRS) is a PROM for outcome and assessment of an Achilles tendon rupture. The aim of this study was to translate the ATRS to Dutch and evaluate its reliability and validity in the Dutch population. A forward-backward translation procedure was performed according to the guidelines of cross-cultural adaptation process. The Dutch ATRS was evaluated for reliability and validity in patients treated for a total Achilles tendon rupture from 1 January 2012 to 31 December 2014 in one teaching hospital and one academic hospital. Reliability was assessed by the intraclass correlation coefficients (ICC), Cronbach's alpha and minimal detectable change (MDC). We assessed construct validity by calculation of Spearman's rho correlation coefficient with domains of the Foot and Ankle Outcome Score (FAOS), Victorian Institute of Sports Assessment-Achilles questionnaire (VISA-A) and Numeric Rating Scale (NRS) for pain in rest and during running. The Dutch ATRS had a good test-retest reliability (ICC = 0.852) and a high internal consistency (Cronbach's alpha = 0.96). MDC was 30.2 at individual level and 3.5 at group level. Construct validity was supported by 75 % of the hypothesized correlations. The Dutch ATRS had a strong correlation with NRS for pain during running (r = -0.746) and all the five subscales of the Dutch FAOS (r = 0.724-0.867). There was a moderate correlation with the VISA-A-NL (r = 0.691) and NRS for pain in rest (r = -0.580). The Dutch ATRS shows an adequate reliability and validity and can be used in the Dutch population for measuring the outcome of treatment of a total Achilles tendon rupture and for research purposes. Diagnostic study, Level I.

Validity and Reliability of International Physical Activity Questionnaire-Short Form in Chinese Youth

ERIC Educational Resources Information Center

Wang, Chao; Chen, Peijie; Zhuang, Jie

2013-01-01

Purpose: The psychometric profiles of the widely used International Physical Activity Questionnaire-Short Form (IPAQ-SF) in Chinese youth have not been reported. The purpose of this study was to examine the validity and reliability of the IPAQ-SF using a sample of Chinese youth. Method: One thousand and twenty-one youth (M[subscript age] = 14.26 ±…

Why the Major Field Test in Business Does Not Report Subscores: Reliability and Construct Validity Evidence. Research Report. ETS RR-12-11

ERIC Educational Resources Information Center

Ling, Guangming

2012-01-01

To assess the value of individual students' subscores on the Major Field Test in Business (MFT Business), I examined the test's internal structure with factor analysis and structural equation model methods, and analyzed the subscore reliabilities using the augmented scores method. Analyses of the internal structure suggested that the MFT Business…

The Growth of the International Baccalaureate[R] Diploma Program: Concerns about the Consistency and Reliability of the Assessments

ERIC Educational Resources Information Center

Bunnell, Tristan

2011-01-01

The International Baccalaureate[R] (IB) world, known as "the IB World," is doubling in size every five years. The IB has become a complex educational product, but offers high levels of consistency and reliability in terms of delivery and assessment. However, since late 2008, a number of concerns have been raised about the quality and manageability…

The Validity of Reliability Assessments.

ERIC Educational Resources Information Center

Basch, Charles E.; Gold, Robert S.

1985-01-01

Reliability guides research design and is used as a standard for judging the credibility of findings and inferences. Using data gathered in a school health education curriculum evaluation as an example, possible errors in hypothesis testing are examined. Appropriateness of internal consistency as a measure of reliability is discussed and…

Score Reliability of Adolescent Alcohol Screening Measures: A Meta-Analytic Inquiry

ERIC Educational Resources Information Center

Shields, Alan L.; Campfield, Delia C.; Miller, Christopher S.; Howell, Ryan T.; Wallace, Kimberly; Weiss, Roger D.

2008-01-01

This study describes the reliability reporting practices in empirical studies using eight adolescent alcohol screening tools and characterizes and explores variability in internal consistency estimates across samples. Of 119 observed administrations of these instruments, 40 (34%) reported usable reliability information. The Personal Experience…

Coefficient Alpha and Reliability of Scale Scores

ERIC Educational Resources Information Center

Almehrizi, Rashid S.

2013-01-01

The majority of large-scale assessments develop various score scales that are either linear or nonlinear transformations of raw scores for better interpretations and uses of assessment results. The current formula for coefficient alpha (a; the commonly used reliability coefficient) only provides internal consistency reliability estimates of raw…

Validity and Reliability of the School Physical Activity Environment Questionnaire

ERIC Educational Resources Information Center

Martin, Jeffrey J.; McCaughtry, Nate; Flory, Sara; Murphy, Anne; Wisdom, Kimberlydawn

2011-01-01

The goal of the current study was to establish the factor validity of the Questionnaire Assessing School Physical Activity Environment (Robertson-Wilson, Levesque, & Holden, 2007) using confirmatory factor analysis procedures. Another goal was to establish internal reliability and test-retest reliability. The confirmatory factor analysis…

Reliable Design Versus Trust

NASA Technical Reports Server (NTRS)

Berg, Melanie; LaBel, Kenneth A.

2016-01-01

This presentation focuses on reliability and trust for the users portion of the FPGA design flow. It is assumed that the manufacturer prior to hand-off to the user tests FPGA internal components. The objective is to present the challenges of creating reliable and trusted designs. The following will be addressed: What makes a design vulnerable to functional flaws (reliability) or attackers (trust)? What are the challenges for verifying a reliable design versus a trusted design?

Testing the validity, reliability and utility of the Self-Administration of Medication (SAM) tool in patients undergoing rehabilitation.

PubMed

Anderson, Jessica; Manias, Elizabeth; Kusljic, Snezana; Finch, Sue

2014-01-01

Determination of patients' ability to self-administer medications in the hospital has largely been determined using the subjective judgment of health professionals. To examine the validity, reliability and utility of the Self-Administration of Medication (SAM) tool as an objective means to determine patients' ability to self-administer in a rehabilitation unit of a public teaching hospital in Melbourne, Australia. To assess validity of the SAM tool, associations were examined between the total SAM tool score and of the patients' competence to self-administer from the perceptions of the tool administrator, patients and nurses. Validity also was determined from a principal component analysis. Pearson correlations were calculated for how SAM scores related to scores obtained from the Functional Independence Measure (FIM) and Barthel Score Index (BSI). To assess the SAM tool's reliability, a Cronbach's alpha coefficient was calculated. Utility of the SAM tool was evidenced by documenting its administration time. One hundred patients participated in this study. The SAM tool had a Cronbach's alpha coefficient of 0.75 and took a mean time of 5.36 min to complete. The capability to self-medicate section of the SAM tool had strong correlations with the FIM (r = 0.485) and BSI (r = 0.472) data, respectively, and the total SAM tool had moderate and strong correlations with the nurses' (r = 0.315) and tool administrator's (r = 0.632) perceptions of patients' ability to self-administer, respectively. Bland-Altman and ROC curve analyses showed poor agreement between the total SAM tool score and the nurses' perceptions. The SAM tool demonstrated acceptable overall internal consistency. It only requires a short time to be completed and is more objective than seeking out health professionals' perceptions. Additional research is needed to further validate this approach to determining patients' ability to self-medicate. Crown Copyright © 2014. Published by Elsevier Inc. All rights reserved.

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation.

PubMed

Sim, Joong Hiong; Tong, Wen Ting; Hong, Wei-Han; Vadivelu, Jamuna; Hassan, Hamimah

2015-01-01

Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. The AEQ is a valid and reliable instrument. Initial validation supports its use to measure students' perceptions of the assessment environment in an undergraduate medical program.

Development and validation of the sociocultural attitudes towards appearance questionnaire-4-revised (SATAQ-4R).

PubMed

Schaefer, Lauren M; Harriger, Jennifer A; Heinberg, Leslie J; Soderberg, Taylor; Kevin Thompson, J

2017-02-01

The Sociocultural Attitudes Toward Appearance Questionnaire-4 (SATAQ-4) is a measure of internalization of appearance ideals (i.e., personal acceptance of societal ideals) and appearance pressures (i.e., pressures to achieve the societal ideal). The current study sought to address limitations of the scale in order to increase precision in the measurement of muscular ideal internalization, include an assessment of one's desire for attractiveness, and broaden the measurement of appearance-related pressures. The factor structure, reliability and construct validity of the SATAQ-4-Revised were examined among college women (N = 1,114) in Study 1, adolescent girls (N = 275) in Study 2, and college men (N = 290) in Study 3. Factor analysis among college women indicated a 7-factor 31-item scale, labeled the SATAQ-4R-Female: (1) Internalization: Thin/Low Body Fat, (2) Internalization: Muscular, (3) Internalization: General Attractiveness, (4) Pressures: Family, (5) Pressures: Media, (6) Pressures: Peers, and (7) Pressures: Significant Others. SATAQ-4R-Female subscales demonstrated good reliability and construct validity among college women. Examination of the SATAQ-4R-Female among adolescent girls suggested a six-factor scale in which peer and significant others items comprised a single subscale. The scale demonstrated good reliability and construct validity in adolescent girls. Examination of the SATAQ-4R among men produced a 28-item scale with seven factors paralleling the factors identified among college women. This scale, labeled the SATAQ-4R-Male, demonstrated good reliability and construct validity. Results support the reliability and validity of SATAQ-4R-Female in college women and adolescent girls, and the SATAQ-4R-Male in college men. © 2016 Wiley Periodicals, Inc.(Int J Eat Disord 2017; 50:104-117). © 2016 Wiley Periodicals, Inc.

Analysis of Test-Retest Reliability, Construct Validity, and Internal Consistency of the Brazilian Version of the Pelvic Girdle Questionnaire.

PubMed

Simões, Luan; Teixeira-Salmela, Luci Fuscaldi; Magalhães, Lívia; Stuge, Britt; Laurentino, Glória; Wanderley, Elaine; Barros, Raphaela; Lemos, Andrea

2018-04-24

The purpose of this study was to evaluate test-retest reliability, construct validity, and internal consistency of the Brazilian version of the Pelvic Girdle Questionnaire (PGQ-Brazil). Analysis of the measurement properties was carried out in 4 steps. Step 1 was the pilot study, on which basis 4 hypotheses were formulated. These hypotheses were tested during the next step (construct validity, step 2) by completion of the questionnaire by the 2 groups (in pain [n = 105] and not in pain [n = 52]). For implementation of the PGQ-Brazil in the group with pain, we calculated the internal consistency (step 3) and, 7 days later, test-retest reliability (step 4) by re-application of the instrument in this group. First, the PGQ-Brazil was able to discriminate between these groups (construct validity). Second, test-retest reliability (intraclass correlation coefficients for Activities subscale [0.97 with 95% confidence interval of 0.95-0.98] and Symptoms subscale [0.98 with 95% confidence interval of 0.97-0.98] and κ coefficient between 0.50 and 0.89 for the items) was found to be good; the Bland-Altman test indicated satisfactory agreement. The Rasch analysis indicated good internal consistency, and the instrument's ability to divide the participants into at least 3 levels of skills was confirmed. In contrast, a ceiling effect was observed, as 24% of pregnant women exhibited skills superior to what the PGQ-Brazil could evaluate. The PGQ-Brazil had good internal consistency, test-retest reliability, and construct validity in assessment of limitations in activities and symptoms of pregnant women with pelvic girdle pain. Copyright © 2018. Published by Elsevier Inc.

Reliability of the Arabic Smartphone Addiction Scale and Smartphone Addiction Scale-Short Version in Two Different Moroccan Samples.

PubMed

Sfendla, Anis; Laita, Meriame; Nejjar, Basma; Souirti, Zouhayr; Touhami, Ahami Ahmed Omar; Senhaji, Meftaha

2018-05-01

The extensive accessibility to smartphones in the last decade raises the concerns of addictive behavior patterns toward these technologies worldwide and in developing countries, and Arabic ones in particular. In an area of stigmatized behavior such as Internet and smartphone addiction, the hypothesis extends to whether there is a reliable instrument that can assess smartphone addiction. To our knowledge, no scale in Arabic language is available to assess maladaptive behavior associated with smartphone use. This study aims to assess the factorial validity and internal reliability of the Arabic Smartphone Addiction Scale (SAS) and Smartphone Addiction Scale-Short Version (SAS-SV) in a Moroccan surveyed population. Participants (N = 440 and N = 310) completed an online survey, including SAS, SAS-SV, and questions about sociodemographic status. Factor analysis results showed six factors with factor loading ranging from 0.25 to 0.99 for SAS. Reliability, based on Cronbach's alpha, was excellent (α = 0.94) for this instrument. The SAS-SV showed one factor (unidimensional construct), and internal reliability was in the good range with an alpha coefficient of (α = 0.87). The prevalence of excessive users was 55.8 percent with highest symptom prevalence reported for tolerance and preoccupation. This study proved factor validity of the Arabic SAS and SAS-SV instruments and confirmed their internal reliability.

Examination of Anomalous World Experience: A Report on Reliability.

PubMed

Conerty, Joseph; Skodlar, Borut; Pienkos, Elizabeth; Zadravek, Tina; Byrom, Greg; Sass, Louis

2017-01-01

The EAWE (Examination of Anomalous World Experience) is a newly developed, semi-structured interview that aims to capture anomalies of subjectivity, common in schizophrenia spectrum disorders, that pertain to experiences of the lived world, including space, time, people, language, atmosphere, and certain existential attitudes. By contrast, previous empirical studies of subjective experience in schizophrenia have focused largely on disturbances in self-experience. To assess the reliability of the EAWE, including internal consistency and interrater reliability. In the course of developing the EAWE, two distinct studies were conducted, one in the United States and the other in Slovenia. Thirteen patients diagnosed with schizophrenia spectrum or mood disorders were recruited for the US study. Fifteen such patients were recruited for the Slovenian study. Two live interviewers conducted the EAWE in the US. The Slovenian interviews were completed by one live interviewer with a second rater reviewing audiorecordings of the interview. Internal consistency and interrater reliability were calculated independently for each study, utilizing Cronbach's α, Spearman's ρ, and Cohen's κ. Each study yielded high internal consistency (Cronbach's α >0.82) and high interrater reliability for total EAWE scores (ρ > 0.83; average κ values were at least 0.78 for each study, with EAWE domain-specific κ not lower than 0.73). The EAWE, containing world-oriented inquiries into anomalies in subjective experience, has adequate reliability for use in a clinical or research setting. © 2017 S. Karger AG, Basel.

Accuracy and reliability testing of two methods to measure internal rotation of the glenohumeral joint.

PubMed

Hall, Justin M; Azar, Frederick M; Miller, Robert H; Smith, Richard; Throckmorton, Thomas W

2014-09-01

We compared accuracy and reliability of a traditional method of measurement (most cephalad vertebral spinous process that can be reached by a patient with the extended thumb) to estimates made with the shoulder in abduction to determine if there were differences between the two methods. Six physicians with fellowship training in sports medicine or shoulder surgery estimated measurements in 48 healthy volunteers. Three were randomly chosen to make estimates of both internal rotation measurements for each volunteer. An independent observer made objective measurements on lateral scoliosis films (spinous process method) or with a goniometer (abduction method). Examiners were blinded to objective measurements as well as to previous estimates. Intraclass coefficients for interobserver reliability for the traditional method averaged 0.75, indicating good agreement among observers. The difference in vertebral level estimated by the examiner and the actual radiographic level averaged 1.8 levels. The intraclass coefficient for interobserver reliability for the abduction method averaged 0.81 for all examiners, indicating near-perfect agreement. Confidence intervals indicated that estimates were an average of 8° different from the objective goniometer measurements. Pearson correlation coefficients of intraobserver reliability for the abduction method averaged 0.94, indicating near-perfect agreement within observers. Confidence intervals demonstrated repeated estimates between 5° and 10° of the original. Internal rotation estimates made with the shoulder abducted demonstrated interobserver reliability superior to that of spinous process estimates, and reproducibility was high. On the basis of this finding, we now take glenohumeral internal rotation measurements with the shoulder in abduction and use a goniometer to maximize accuracy and objectivity. Copyright © 2014 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Mosby, Inc. All rights reserved.

Reliability of the Melbourne assessment of unilateral upper limb function.

PubMed

Randall, M; Carlin, J B; Chondros, P; Reddihough, D

2001-11-01

This study examines the reliability of the Melbourne Assessment of Unilateral Upper Limb Function: a quantitative test of quality of movement in children with neurological impairment. The assessment was administered to 20 children aged from 5 to 16 years (mean age 9 years 10 months, SD 2 years 10 months) who had various types and degrees of cerebral palsy (CP). The performances of the 20 children during assessment were videotaped for subsequent scoring by 15 occupational therapists. Scores were analyzed for internal consistency of test items, inter- and intrarater reliability of scorings of the same videotapes, and test-retest reliability using repeat videotaping. Results revealed very high internal consistency of test items (alpha=0.96), moderate to high agreement both within and between raters for all test items (intraclass correlations of at least 0.7) apart from item 16 (hand to mouth and down), and high interrater reliability (0.95) and intrarater reliability (0.97) for total test scores. Test-retest results revealed moderate to high intrarater reliability for item totals (mean of 0.83 and 0.79) for each rater and high reliability for test totals (0.98 and 0.97). These findings indicate that the Melbourne Assessment of Unilateral Upper Limb Function is a reliable tool for measuring the quality of unilateral upper-limb movement in children with CP.

Coping with matrix effects in headspace solid phase microextraction gas chromatography using multivariate calibration strategies.

PubMed

Ferreira, Vicente; Herrero, Paula; Zapata, Julián; Escudero, Ana

2015-08-14

SPME is extremely sensitive to experimental parameters affecting liquid-gas and gas-solid distribution coefficients. Our aims were to measure the weights of these factors and to design a multivariate strategy based on the addition of a pool of internal standards, to minimize matrix effects. Synthetic but real-like wines containing selected analytes and variable amounts of ethanol, non-volatile constituents and major volatile compounds were prepared following a factorial design. The ANOVA study revealed that even using a strong matrix dilution, matrix effects are important and additive with non-significant interaction effects and that it is the presence of major volatile constituents the most dominant factor. A single internal standard provided a robust calibration for 15 out of 47 analytes. Then, two different multivariate calibration strategies based on Partial Least Square Regression were run in order to build calibration functions based on 13 different internal standards able to cope with matrix effects. The first one is based in the calculation of Multivariate Internal Standards (MIS), linear combinations of the normalized signals of the 13 internal standards, which provide the expected area of a given unit of analyte present in each sample. The second strategy is a direct calibration relating concentration to the 13 relative areas measured in each sample for each analyte. Overall, 47 different compounds can be reliably quantified in a single fully automated method with overall uncertainties better than 15%. Copyright © 2015 Elsevier B.V. All rights reserved.

A Meta-Analysis of Reliability Coefficients in Second Language Research

ERIC Educational Resources Information Center

Plonsky, Luke; Derrick, Deirdre J.

2016-01-01

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

Reliability and Validity of a Scale for Rating Memory Impairment in Hospitalized Amnesiacs.

ERIC Educational Resources Information Center

Knight, Robert G.; Godfrey, Hamish P. D.

1984-01-01

Investigated the reliability and concurrent validity of the Inpatient Memory Impairment Scale (IMIS), using a group of memory-impaired chronic alcoholic and Korsakoff patients (N=20). Analysis revealed that the IMIS had a high degree of internal consistency and that interrater reliability is also high. (LLL)

Reliability and Validity of the Evidence-Based Practice Confidence (EPIC) Scale

ERIC Educational Resources Information Center

Salbach, Nancy M.; Jaglal, Susan B.; Williams, Jack I.

2013-01-01

Introduction: The reliability, minimal detectable change (MDC), and construct validity of the evidence-based practice confidence (EPIC) scale were evaluated among physical therapists (PTs) in clinical practice. Methods: A longitudinal mail survey was conducted. Internal consistency and test-retest reliability were estimated using Cronbach's alpha…

Preliminary assessment of combustion modes for internal combustion wave rotors

NASA Technical Reports Server (NTRS)

Nalim, M. Razi

1995-01-01

Combustion within the channels of a wave rotor is examined as a means of obtaining pressure gain during heat addition in a gas turbine engine. Several modes of combustion are considered and the factors that determine the applicability of three modes are evaluated in detail; premixed autoignition/detonation, premixed deflagration, and non-premixed compression ignition. The last two will require strong turbulence for completion of combustion in a reasonable time in the wave rotor. The compression/autoignition modes will require inlet temperatures in excess of 1500 R for reliable ignition with most hydrocarbon fuels; otherwise, a supplementary ignition method must be provided. Examples of combustion mode selection are presented for two core engine applications that had been previously designed with equivalent 4-port wave rotor topping cycles using external combustion.

The neutron texture diffractometer at the China Advanced Research Reactor

NASA Astrophysics Data System (ADS)

Li, Mei-Juan; Liu, Xiao-Long; Liu, Yun-Tao; Tian, Geng-Fang; Gao, Jian-Bo; Yu, Zhou-Xiang; Li, Yu-Qing; Wu, Li-Qi; Yang, Lin-Feng; Sun, Kai; Wang, Hong-Li; Santisteban, J. r.; Chen, Dong-Feng

2016-03-01

The first neutron texture diffractometer in China has been built at the China Advanced Research Reactor, due to strong demand for texture measurement with neutrons from the domestic user community. This neutron texture diffractometer has high neutron intensity, moderate resolution and is mainly applied to study texture in commonly used industrial materials and engineering components. In this paper, the design and characteristics of this instrument are described. The results for calibration with neutrons and quantitative texture analysis of zirconium alloy plate are presented. The comparison of texture measurements with the results obtained in HIPPO at LANSCE and Kowari at ANSTO illustrates the reliability of the texture diffractometer. Supported by National Nature Science Foundation of China (11105231, 11205248, 51327902) and International Atomic Energy Agency-TC program (CPR0012)

Family impact of assistive technology scale: development of a measurement scale for parents of children with complex communication needs.

PubMed

Delarosa, Elizabeth; Horner, Stephanie; Eisenberg, Casey; Ball, Laura; Renzoni, Anne Marie; Ryan, Stephen E

2012-09-01

Young people use augmentative and alternative communication (AAC) systems to meet their everyday communication needs. However, the successful integration of an AAC system into a child's life requires strong commitment and continuous support from parents and other family members. This article describes the development and evaluation of the Family Impact of Assistive Technology Scale for AAC Systems - a parent-report questionnaire intended to detect the impact of AAC systems on the lives of children with complex communication needs and their families. The study involved 179 parents and clinical experts to test the content and face validities of the questionnaire, demonstrate its internal reliability and stability over time, and estimate its convergent construct validity when compared to a standardized measure of family impact.

Reliability of the International Physical Activity Questionnaire in Research Settings: Last 7-Day Self-Administered Long Form

ERIC Educational Resources Information Center

Levy, Susan S.; Readdy, R. Tucker

2009-01-01

The purpose of this study was to examine the test-retest reliability of the last 7-day long form International Physical Activity Questionnaire (Craig et al., 2003) and to examine the construct validity for the measure in a research setting. Participants were 151 male (n = 52) and female (n = 99) university students (M age = 24.15 years, SD = 5.01)…

The Language Use Inventory for Young Children: A Parent-Report Measure of Pragmatic Language Development for 18- to 47-Month-Old Children

ERIC Educational Resources Information Center

O'Neill, Daniela K.

2007-01-01

Purpose: To demonstrate the internal reliability and discriminative validity of the Language Use Inventory for Young Children (LUI; D. K. O'Neill, 2002), a newly developed parent-report measure designed to assess pragmatic language development in 18-47-month-olds. Method: To examine internal reliability, the LUI was completed by mail by 177…

Cross-Cultural Validation of the Patient Perception of Integrated Care Survey.

PubMed

Tietschert, Maike V; Angeli, Federica; van Raak, Arno J A; Ruwaard, Dirk; Singer, Sara J

2017-07-20

To test the cross-cultural validity of the U.S. Patient Perception of Integrated Care (PPIC) Survey in a Dutch sample using a standardized procedure. Primary data collected from patients of five primary care centers in the south of the Netherlands, through survey research from 2014 to 2015. Cross-sectional data collected from patients who saw multiple health care providers during 6 months preceding data collection. The PPIC survey includes 59 questions that measure patient perceived care integration across providers, settings, and time. Data analysis followed a standardized procedure guiding data preparation, psychometric analysis, and included invariance testing with the U.S. dataset. Latent scale structures of the Dutch and U.S. survey were highly comparable. Factor "Integration with specialist" had lower reliability scores and noninvariance. For the remaining factors, internal consistency and invariance estimates were strong. The standardized cross-cultural validation procedure produced strong support for comparable psychometric characteristics of the Dutch and U.S. surveys. Future research should examine the usability of the proposed procedure for contexts with greater cultural differences. © Health Research and Educational Trust.

The factor structure of the Buss and Plomin EAS Temperament Survey (parental ratings) in a Dutch sample of elementary school children.

PubMed

Boer, F; Westenberg, P M

1994-06-01

The psychometric properties of the Buss and Plomin (1984) EAS Temperament Survey for Children (Parental Ratings) were examined in a sample of Dutch children between 4 and 13 years of age. Ratings were obtained from 230 mothers and 172 fathers. The findings presented here provide the lacking cross-validation of the original analyses by Rowe and Plomin (1977): Emotionality, activity, and shyness were independent temperaments, regardless of age and gender. The factorial position of the yet experimental Sociability scale is more ambiguous: Sociability was significantly related to both shyness and activity but was more strongly associated with shyness in the youngest age cohort and most strongly with activity in the oldest cohort. This age trend, combined with a positive association with activity, supports the premise that sociability cannot be equated to nonshyness and justifies the inclusion of a separate Sociability scale in the EAS. All four EAS scales are reliable in terms of internal consistency and interrater agreement, but one modification of the Sociability scale is needed.

Survival and weak chaos.

PubMed

Nee, Sean

2018-05-01

Survival analysis in biology and reliability theory in engineering concern the dynamical functioning of bio/electro/mechanical units. Here we incorporate effects of chaotic dynamics into the classical theory. Dynamical systems theory now distinguishes strong and weak chaos. Strong chaos generates Type II survivorship curves entirely as a result of the internal operation of the system, without any age-independent, external, random forces of mortality. Weak chaos exhibits (a) intermittency and (b) Type III survivorship, defined as a decreasing per capita mortality rate: engineering explicitly defines this pattern of decreasing hazard as 'infant mortality'. Weak chaos generates two phenomena from the normal functioning of the same system. First, infant mortality- sensu engineering-without any external explanatory factors, such as manufacturing defects, which is followed by increased average longevity of survivors. Second, sudden failure of units during their normal period of operation, before the onset of age-dependent mortality arising from senescence. The relevance of these phenomena encompasses, for example: no-fault-found failure of electronic devices; high rates of human early spontaneous miscarriage/abortion; runaway pacemakers; sudden cardiac death in young adults; bipolar disorder; and epilepsy.

Survival and weak chaos

PubMed Central

2018-01-01

Survival analysis in biology and reliability theory in engineering concern the dynamical functioning of bio/electro/mechanical units. Here we incorporate effects of chaotic dynamics into the classical theory. Dynamical systems theory now distinguishes strong and weak chaos. Strong chaos generates Type II survivorship curves entirely as a result of the internal operation of the system, without any age-independent, external, random forces of mortality. Weak chaos exhibits (a) intermittency and (b) Type III survivorship, defined as a decreasing per capita mortality rate: engineering explicitly defines this pattern of decreasing hazard as ‘infant mortality’. Weak chaos generates two phenomena from the normal functioning of the same system. First, infant mortality—sensu engineering—without any external explanatory factors, such as manufacturing defects, which is followed by increased average longevity of survivors. Second, sudden failure of units during their normal period of operation, before the onset of age-dependent mortality arising from senescence. The relevance of these phenomena encompasses, for example: no-fault-found failure of electronic devices; high rates of human early spontaneous miscarriage/abortion; runaway pacemakers; sudden cardiac death in young adults; bipolar disorder; and epilepsy. PMID:29892407

Measuring Filial Piety in the 21st Century: Development, Factor Structure, and Reliability of the 10-Item Contemporary Filial Piety Scale.

PubMed

Lum, Terry Y S; Yan, Elsie C W; Ho, Andy H Y; Shum, Michelle H Y; Wong, Gloria H Y; Lau, Mandy M Y; Wang, Junfang

2016-11-01

The experience and practice of filial piety have evolved in modern Chinese societies, and existing measures fail to capture these important changes. Based on a conceptual analysis on current literature, 42 items were initially compiled to form a Contemporary Filial Piety Scale (CFPS), and 1,080 individuals from a representative sample in Hong Kong were surveyed. Principal component analysis generated a 16-item three-factor model: Pragmatic Obligations (Factor 1; 10 items), Compassionate Reverence (Factor 2; 4 items), and Family Continuity (Factor 3; 2 items). Confirmatory factor analysis revealed strong factor loadings for Factors 1 and 2, while removing Factor 3 and conceptually duplicated items increased total variance explained from 58.02% to 60.09% and internal consistency from .84 to .88. A final 10-item two-factor structure model was adopted with a goodness of fit of 0.95. The CFPS-10 is a data-driven, simple, and efficient instrument with strong psychometric properties for assessing contemporary filial piety. © The Author(s) 2015.

An International, Multi-Specialty Validation Study of the IgG4-Related Disease Responder Index.

PubMed

Wallace, Zachary S; Khosroshahi, Arezou; Carruthers, Mollie D; Perugino, Cory A; Choi, Hyon; Campochiaro, Corrado; Culver, Emma L; Cortazar, Frank; Della-Torre, Emanuel; Ebbo, Mikael; Fernandes, Ana; Frulloni, Luca; Hart, Philip; Karadag, Omer; Kawa, Shigeyuki; Kawano, Mitsuhiro; Kim, Myung-Hwan; Lanzillotta, Marco; Matsui, Shoko; Okazaki, Kazuichi; Ryu, Jay H; Saeki, Takako; Schleinitz, Nicolas; Tanasa, Paula; Umehara, Hisanori; Webster, George; Zhang, Wen; Stone, John H

2018-02-18

IgG4-related disease (IgG4-RD) can cause fibro-inflammatory lesions in nearly any organ, leading to organ dysfunction and failure. The IgG4-RD Responder Index (RI) was developed to help investigators assess the efficacy of treatment in a structured manner. We sought to validate the RI in a multi-national investigation. The RI guides investigators through assessments of disease activity and damage in 25 domains, incorporating higher weights for disease manifestations that require treatment urgently or that worsen despite treatment. After a training exercise, investigators reviewed 12 written IgG4-RD vignettes (mean length: 279 words, range: 76-511 words) based upon real patients. Investigators calculated both an RI score as well as a physician global assessment (PGA) for each vignette. Three investigators used the RI on fifteen patients followed over serial visits after treatment. We assessed inter- and intra-rater reliability, precision, validity, and responsiveness. Twenty-six physician-investigators included representatives from 6 specialties and 9 countries. The inter-rater and intra-rater reliabilities of the RI were strong (0.88 and 0.69, respectively) and superior to those of the PGA. Correlations (construct validity) between the RI and PGA were high (Spearman's r=0.9, P<0.0001). The RI was sensitive to change (discriminant validity). Following treatment, there was significant improvement in the RI (mean change 10.5 (95% CI 5.4-12), P<0.001) which correlated with the change in the PGA. Urgent disease and damage were captured effectively. In this international, multi-specialty study, we found that the RI is a valid, and reliable disease activity assessment tool that can be used to measure response to therapy. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Development and validation of the Pediatric Stroke Quality of Life Measure.

PubMed

Fiume, Andrea; Deveber, Gabrielle; Jang, Shu-Hyun; Fuller, Colleen; Viner, Shani; Friefeld, Sharon

2018-06-01

To develop and validate a disease-specific parent proxy and child quality of life (QoL) measure for patients aged 2 to 18 years surviving cerebral sinovenous thrombosis (CSVT) and arterial ischaemic stroke (AIS). Utilizing qualitative and quantitative methods, we developed a 75-item Pediatric Stroke Quality of Life Measure (PSQLM) questionnaire. We mailed the PSQLM and a standardized generic QoL measure, Pediatric Quality of Life Inventory (PedsQL), to 353 families. Stroke type, age at stroke, and neurological outcome on the Pediatric Stroke Outcome Measure were documented. We calculated the internal consistency, validity, and reliability of the PSQLM. The response rate was 29%, yielding a sample of 101 patients (mean age 9y 9mo [SD 4.30]; 69 AIS [68.3%], 32 CSVT [31.7%]). The internal consistency of the PSQLM was high (Cronbach's α=0.94-0.97). Construct validity for the PSQLM was moderately strong (r=0.3-0.4; p<0.003) and, as expected, correlation with the PedsQL was moderate, suggesting the PSQLM operationalizes QoL distinct from the PedsQL. Test-retest reliability at 2 weeks was very good (intraclass correlation coefficient [ICC] 0.85-0.95; 95% confidence interval 0.83-0.97) and good agreement was established between parent and child report (ICC 0.63-0.76). The PSQLM demonstrates sound psychometric properties. Further research will seek to increase its clinical utility by reducing length and establishing responsiveness for descriptive and longitudinal evaluative assessment. A pediatric stroke-specific quality of life (QoL) measurement tool for assessments based on perceptions of importance and satisfaction. Moderate-to-high reliability and validity established for a new clinical scale evaluating QoL among children with stroke. Perceived QoL measured using the Pediatric Stroke Quality of Life Measure appears lower in children with neurological impairment. © 2018 Mac Keith Press.

Psychometrics and utility of Psycho-Educational Profile-Revised as a developmental quotient measure among children with the dual disability of intellectual disability and autism.

PubMed

Alwinesh, Merlin Thanka Jemi; Joseph, Rachel Beulah Jansirani; Daniel, Anna; Abel, Julie Sandra; Shankar, Satya Raj; Mammen, Priya; Russell, Sushila; Russell, Paul Swamidhas Sudhakar

2012-09-01

There is no agreement about the measure to quantify the intellectual/developmental level in children with the dual disability of intellectual disability and autism. Therefore, we studied the psychometric properties and utility of Psycho-Educational Profile-Revised (PEP-R) as a developmental test in this population. We identified 116 children with dual disability from the day care and inpatient database of a specialised Autism Clinic. Scale and domain level scores of PEP-R were collected and analyzed. We examined the internal consistency, domain-total correlation of PEP-R and concurrent validity of PEP-R against Gesell's Developmental Schedule, inter-rater and test-retest reliability and utility of PEP-R among children with dual disability in different ages, functional level and severity of autism. Besides the adequate face and content validity, PEP-R demonstrates a good internal consistency (Cronbach's α ranging from 0.91 to 0.93) and domain-total correlation (ranging from 0.75 to 0.90). The inter-rater reliability (intraclass correlation coefficient, ICC = 0.96) and test-retest reliability (ICC = 0.87) for PEP-R is good. There is moderate-to-high concurrent validity with GDS (r ranging from 0.61 to 0.82; all Ps = 0.001). The utility of PEP-R as a developmental measure was good with infants, toddlers, pre-school and primary school children. The ability of PEP-R to measure the developmental age was good, irrespective of the severity of autism but was better with high-functioning children. The PEP-R as an intellectual/developmental test has strong psychometric properties in children with dual disability. It could be used in children with different age groups and severity of autism. PEP-R should be used with caution as a developmental test in children with dual disability who are low functioning.

The nutrition for sport knowledge questionnaire (NSKQ): development and validation using classical test theory and Rasch analysis.

PubMed

Trakman, Gina Louise; Forsyth, Adrienne; Hoye, Russell; Belski, Regina

2017-01-01

Appropriate dietary intake can have a significant influence on athletic performance. There is a growing consensus on sports nutrition and professionals working with athletes often provide dietary education. However, due to the limitations of existing sports nutrition knowledge questionnaires, previous reports of athletes' nutrition knowledge may be inaccurate. An updated questionnaire has been developed based on a recent review of sports nutrition guidelines. The tool has been validated using a robust methodology that incorporates relevant techniques from classical test theory (CTT) and Item response theory (IRT), namely, Rasch analysis. The final questionnaire has 89 questions and six sub-sections (weight management, macronutrients, micronutrients, sports nutrition, supplements, and alcohol). The content and face validity of the tool have been confirmed based on feedback from expert sports dietitians and university sports students, respectively. The internal reliability of the questionnaire as a whole is high (KR = 0.88), and most sub-sections achieved an acceptable internal reliability. Construct validity has been confirmed, with an independent T-test revealing a significant ( p  < 0.001) difference in knowledge scores of nutrition (64 ± 16%) and non-nutrition students (51 ± 19%). Test-retest reliability has been assured, with a strong correlation ( r  = 0.92, p  < 0.001) between individuals' scores on two attempts of the test, 10 days to 2 weeks apart. Three of the sub-sections fit the Rasch Unidimensional Model. The final version of the questionnaire represents a significant improvement over previous tools. Each nutrition sub-section is unidimensional, and therefore researchers and practitioners can use these individually, as required. Use of the questionnaire will allow researchers to draw conclusions about the effectiveness of nutrition education programs, and differences in knowledge across athletes of varying ages, genders, and athletic calibres.

Development and psychometric testing of the Canine Owner-Reported Quality of Life questionnaire, an instrument designed to measure quality of life in dogs with cancer.

PubMed

Giuffrida, Michelle A; Brown, Dorothy Cimino; Ellenberg, Susan S; Farrar, John T

2018-05-01

OBJECTIVE To describe development and initial psychometric testing of an owner-reported questionnaire designed to standardize measurement of general quality of life (QOL) in dogs with cancer. DESIGN Key-informant interviews, questionnaire development, and field trial. SAMPLE Owners of 25 dogs with cancer for item development and pretesting and owners of 90 dogs with cancer for reliability and validity testing. PROCEDURES Standard methods for development and testing of questionnaire instruments intended to measure subjective states were used. Items were generated, selected, scaled, and pretested for content, meaning, and readability. Response items were evaluated with exploratory factor analysis and by assessing internal consistency (Cronbach α) and convergence with global QOL as determined with a visual analog scale. Preliminary tests of stability and responsiveness were performed. RESULTS The final questionnaire-which was named the Canine Owner-Reported Quality of Life (CORQ) questionnaire-contained 17 items related to observable behaviors commonly used by owners to evaluate QOL in their dogs. Several items pertaining to physical symptoms performed poorly and were omitted. The 17 items were assigned to 4 factors-vitality, companionship, pain, and mobility-on the basis of the items they contained. The CORQ questionnaire and its factors had high internal consistency (Cronbach α = 0.68 to 0.90) and moderate to strong correlations (r = 0.49 to 0.71) with global QOL as measured on a visual analog scale. Preliminary testing indicated good test-retest reliability and responsiveness to improvements in overall QOL. CONCLUSIONS AND CLINICAL RELEVANCE The CORQ questionnaire was a valid, reliable owner-reported questionnaire that measured general QOL in dogs with cancer and showed promise as a clinical trial outcome measure for quantifying changes in individual dog QOL occurring in response to cancer treatment and progression.

Psychometric properties of the Dresden Body Image Questionnaire: A multiple-group confirmatory factor analysis across sex and age in a Dutch non-clinical sample

PubMed Central

Scheffers, Mia; van Duijn, Marijtje A. J.; Bosscher, Ruud J.; Wiersma, Durk; Schoevers, Robert A.; van Busschbach, Jooske T.

2017-01-01

Background Body image has implications for psychosocial functioning and quality of life and its disturbance is reported in a broad range of psychiatric disorders. In view of the lack of instruments in Dutch measuring body image as a broad concept, we set out to make an instrument available that reflects the multidimensional character of this construct by including more dimensions than physical appearance. The Dresden Körperbildfragebogen (DBIQ, Dresden Body Image Questionnaire) particularly served this purpose. The DBIQ consists of 35 items and five subscales: body acceptance, sexual fulfillment, physical contact, vitality, and self-aggrandizement. The main objective of the present study was to evaluate the psychometric properties of the Dutch translation of the Dresden Body Image Questionnaire (DBIQ-NL) in a non-clinical sample. Methods The psychometric properties of the DBIQ-NL were examined in a non-clinical sample of 988 respondents aged between 18 and 65. We investigated the subscales' internal consistency and test-retest reliability. In order to establish construct validity we evaluated the association with a related construct, body cathexis, and with indices of self-esteem and psychological wellbeing. The factor structure of the DBIQ-NL was examined via confirmatory factor analysis (CFA). The equivalence of the measurement model across sex and age was evaluated by multiplegroup confirmatory factor analyses. Results Confirmatory factor analyses showed a structure in accordance with the original scale, where model fit was improved significantly by moving one item to another subscale. Multiple group confirmatory factor analysis across sex and age demonstrated partial strong invariance. Internal consistency was good with little overlap between the subscales. Temporal reliability and construct validity were satisfactory. Conclusion Results indicate that the DBIQ-NL is a reliable and valid instrument for non-clinical subjects. This provides a sound basis for further investigation of the DBIQ-NL in a clinical sample. PMID:28746387

WHO Study on the reliability and validity of the alcohol and drug use disorder instruments: overview of methods and results.

PubMed

Ustün, B; Compton, W; Mager, D; Babor, T; Baiyewu, O; Chatterji, S; Cottler, L; Göğüş, A; Mavreas, V; Peters, L; Pull, C; Saunders, J; Smeets, R; Stipec, M R; Vrasti, R; Hasin, D; Room, R; Van den Brink, W; Regier, D; Blaine, J; Grant, B F; Sartorius, N

1997-09-25

The WHO Study on the reliability and validity of the alcohol and drug use disorder instruments in an international study which has taken place in centres in ten countries, aiming to test the reliability and validity of three diagnostic instruments for alcohol and drug use disorders: the Composite International Diagnostic Interview (CIDI), the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) and a special version of the Alcohol Use Disorder and Associated Disabilities Interview schedule-alcohol/drug-revised (AUDADIS-ADR). The purpose of the reliability and validity (R&V) study is to further develop the alcohol and drug sections of these instruments so that a range of substance-related diagnoses can be made in a systematic, consistent, and reliable way. The study focuses on new criteria proposed in the tenth revision of the International Classification of Diseases (ICD-10) and the fourth revision of the diagnostic and statistical manual of mental disorders (DSM-IV) for dependence, harmful use and abuse categories for alcohol and psychoactive substance use disorders. A systematic study including a scientifically rigorous measure of reliability (i.e. 1 week test-retest reliability) and validity (i.e. comparison between clinical and non-clinical measures) has been undertaken. Results have yielded useful information on reliability and validity of these instruments at diagnosis, criteria and question level. Overall the diagnostic concordance coefficients (kappa, kappa) were very good for dependence disorders (0.7-0.9), but were somewhat lower for the abuse and harmful use categories. The comparisons among instruments and independent clinical evaluations and debriefing interviews gave important information about possible sources of unreliability, and provided useful clues on the applicability and consistency of nosological concepts across cultures.

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Measurement of fatigue: Comparison of the reliability and validity of single-item and short measures to a comprehensive measure.

PubMed

Kim, Hee-Ju; Abraham, Ivo

2017-01-01

Evidence is needed on the clinicometric properties of single-item or short measures as alternatives to comprehensive measures. We examined whether two single-item fatigue measures (i.e., Likert scale, numeric rating scale) or a short fatigue measure were comparable to a comprehensive measure in reliability (i.e., internal consistency and test-retest reliability) and validity (i.e., convergent, concurrent, and predictive validity) in Korean young adults. For this quantitative study, we selected the Functional Assessment of Chronic Illness Therapy-Fatigue for the comprehensive measure and the Profile of Mood States-Brief, Fatigue subscale for the short measure; and constructed two single-item measures. A total of 368 students from four nursing colleges in South Korea participated. We used Cronbach's alpha and item-total correlation for internal consistency reliability and intraclass correlation coefficient for test-retest reliability. We assessed Pearson's correlation with a comprehensive measure for convergent validity, with perceived stress level and sleep quality for concurrent validity and the receiver operating characteristic curve for predictive validity. The short measure was comparable to the comprehensive measure in internal consistency reliability (Cronbach's alpha=0.81 vs. 0.88); test-retest reliability (intraclass correlation coefficient=0.66 vs. 0.61); convergent validity (r with comprehensive measure=0.79); concurrent validity (r with perceived stress=0.55, r with sleep quality=0.39) and predictive validity (area under curve=0.88). Single-item measures were not comparable to the comprehensive measure. A short fatigue measure exhibited similar levels of reliability and validity to the comprehensive measure in Korean young adults. Copyright © 2016 Elsevier Ltd. All rights reserved.

Paediatric Automatic Phonological Analysis Tools (APAT).

PubMed

Saraiva, Daniela; Lousada, Marisa; Hall, Andreia; Jesus, Luis M T

2017-12-01

To develop the pediatric Automatic Phonological Analysis Tools (APAT) and to estimate inter and intrajudge reliability, content validity, and concurrent validity. The APAT were constructed using Excel spreadsheets with formulas. The tools were presented to an expert panel for content validation. The corpus used in the Portuguese standardized test Teste Fonético-Fonológico - ALPE produced by 24 children with phonological delay or phonological disorder was recorded, transcribed, and then inserted into the APAT. Reliability and validity of APAT were analyzed. The APAT present strong inter- and intrajudge reliability (>97%). The content validity was also analyzed (ICC = 0.71), and concurrent validity revealed strong correlations between computerized and manual (traditional) methods. The development of these tools contributes to fill existing gaps in clinical practice and research, since previously there were no valid and reliable tools/instruments for automatic phonological analysis, which allowed the analysis of different corpora.

Dynamic one-dimensional modeling of secondary settling tanks and system robustness evaluation.

PubMed

Li, Ben; Stenstrom, M K

2014-01-01

One-dimensional secondary settling tank models are widely used in current engineering practice for design and optimization, and usually can be expressed as a nonlinear hyperbolic or nonlinear strongly degenerate parabolic partial differential equation (PDE). Reliable numerical methods are needed to produce approximate solutions that converge to the exact analytical solutions. In this study, we introduced a reliable numerical technique, the Yee-Roe-Davis (YRD) method as the governing PDE solver, and compared its reliability with the prevalent Stenstrom-Vitasovic-Takács (SVT) method by assessing their simulation results at various operating conditions. The YRD method also produced a similar solution to the previously developed Method G and Enquist-Osher method. The YRD and SVT methods were also used for a time-to-failure evaluation, and the results show that the choice of numerical method can greatly impact the solution. Reliable numerical methods, such as the YRD method, are strongly recommended.

Domestic and International Climate Migration from Rural Mexico

PubMed Central

Nawrotzki, Raphael J.; Runfola, Daniel M.; Hunter, Lori M.; Riosmena, Fernando

2016-01-01

Evidence is increasing that climate change and variability may influence human migration patterns. However, there is less agreement regarding the type of migration streams most strongly impacted. This study tests whether climate change more strongly impacted international compared to domestic migration from rural Mexico during 1986-99. We employ eight temperature and precipitation-based climate change indices linked to detailed migration histories obtained from the Mexican Migration Project. Results from multilevel discrete-time event-history models challenge the assumption that climate-related migration will be predominantly short distance and domestic, but instead show that climate change more strongly impacted international moves from rural Mexico. The stronger climate impact on international migration may be explained by the self-insurance function of international migration, the presence of strong migrant networks, and climate-related changes in wage difference. While a warming in temperature increased international outmigration, higher levels of precipitation declined the odds of an international move. PMID:28439146

Domestic and International Climate Migration from Rural Mexico.

PubMed

Nawrotzki, Raphael J; Runfola, Daniel M; Hunter, Lori M; Riosmena, Fernando

2016-12-01

Evidence is increasing that climate change and variability may influence human migration patterns. However, there is less agreement regarding the type of migration streams most strongly impacted. This study tests whether climate change more strongly impacted international compared to domestic migration from rural Mexico during 1986-99. We employ eight temperature and precipitation-based climate change indices linked to detailed migration histories obtained from the Mexican Migration Project. Results from multilevel discrete-time event-history models challenge the assumption that climate-related migration will be predominantly short distance and domestic, but instead show that climate change more strongly impacted international moves from rural Mexico. The stronger climate impact on international migration may be explained by the self-insurance function of international migration, the presence of strong migrant networks, and climate-related changes in wage difference. While a warming in temperature increased international outmigration, higher levels of precipitation declined the odds of an international move.

Timed activity performance in persons with upper limb amputation: A preliminary study.

PubMed

Resnik, Linda; Borgia, Mathew; Acluche, Frantzy

55 subjects with upper limb amputation were administered the T-MAP twice within one week. To develop a timed measure of activity performance for persons with upper limb amputation (T-MAP); examine the measure's internal consistency, test-retest reliability and validity; and compare scores by prosthesis use. Measures of activity performance for persons with upper limb amputation are needed The time required to perform daily activities is a meaningful metric that implication for participation in life roles. Internal consistency and test-retest reliability were evaluated. Construct validity was examined by comparing scores by amputation level. Exploratory analyses compared sub-group scores, and examined correlations with other measures. Scale alpha was 0.77, ICC was 0.93. Timed scores differed by amputation level. Subjects using a prosthesis took longer to perform all tasks. T-MAP was not correlated with other measures of dexterity or activity, but was correlated with pain for non-prosthesis users. The timed scale had adequate internal consistency and excellent test-retest reliability. Analyses support reliability and construct validity of the T-MAP. 2c "outcomes" research. Published by Elsevier Inc.

Rating scales for dystonia in cerebral palsy: reliability and validity.

PubMed

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

Assuring reliability program effectiveness.

NASA Technical Reports Server (NTRS)

Ball, L. W.

1973-01-01

An attempt is made to provide simple identification and description of techniques that have proved to be most useful either in developing a new product or in improving reliability of an established product. The first reliability task is obtaining and organizing parts failure rate data. Other tasks are parts screening, tabulation of general failure rates, preventive maintenance, prediction of new product reliability, and statistical demonstration of achieved reliability. Five principal tasks for improving reliability involve the physics of failure research, derating of internal stresses, control of external stresses, functional redundancy, and failure effects control. A final task is the training and motivation of reliability specialist engineers.

Measuring eating disorder attitudes and behaviors: a reliability generalization study

PubMed Central

2014-01-01

Background Although score reliability is a sample-dependent characteristic, researchers often only report reliability estimates from previous studies as justification for employing particular questionnaires in their research. The present study followed reliability generalization procedures to determine the mean score reliability of the Eating Disorder Inventory and its most commonly employed subscales (Drive for Thinness, Bulimia, and Body Dissatisfaction) and the Eating Attitudes Test as a way to better identify those characteristics that might impact score reliability. Methods Published studies that used these measures were coded based on their reporting of reliability information and additional study characteristics that might influence score reliability. Results Score reliability estimates were included in 26.15% of studies using the EDI and 36.28% of studies using the EAT. Mean Cronbach’s alphas for the EDI (total score = .91; subscales = .75 to .89), EAT-40 (total score = .81) and EAT-26 (total score = .86; subscales = .56 to .80) suggested variability in estimated internal consistency. Whereas some EDI subscales exhibited higher score reliability in clinical eating disorder samples than in nonclinical samples, other subscales did not exhibit these differences. Score reliability information for the EAT was primarily reported for nonclinical samples, making it difficult to characterize the effect of type of sample on these measures. However, there was a tendency for mean score reliability to be higher in the adult (vs. adolescent) samples and in female (vs. male) samples. Conclusions Overall, this study highlights the importance of assessing and reporting internal consistency during every test administration because reliability is affected by characteristics of the participants being examined. PMID:24764530

A framework convention on global health: health for all, justice for all.

PubMed

Gostin, Lawrence O

2012-05-16

Health inequalities represent perhaps the most consequential global health challenge and yet they persist despite increased funding and innovative programs. The United Nations is revising the Millennium Development Goals (MDGs) that will shape the world for many years to come. What would a transformative post-MDG framework for global health justice look like? A global coalition of civil society and academics--the Joint Action and Learning Initiative on National and Global Responsibilities for Health (JALI)--has formed an international campaign to advocate for a Framework Convention on Global Health (FCGH). Recently endorsed by the UN Secretary-General, the FCGH would reimagine global governance for health, offering a new post-MDG vision. This Special Communication describes the key modalities of an FCGH to illustrate how it would improve health and reduce inequalities. The modalities would include defining national responsibilities for the population's health; defining international responsibilities for reliable, sustainable funding; setting global health priorities; coordinating fragmented activities; reshaping global governance for health; and providing strong global health leadership through the World Health Organization.

Production of hydrogen driven from biomass waste to power Remote areas away from the electric grid utilizing fuel cells and internal combustion engines vehicles

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tawfik, Hazem

Recent concerns over the security and reliability of the world’s energy supply has caused a flux towards the research and development of renewable sources. A leading renewable source has been found in the biomass gasification of biological materials derived from organic matters such as wood chips, forest debris, and farm waste that are found in abundance in the USA. Accordingly, there is a very strong interest worldwide in the development of new technologies that provide an in-depth understanding of this economically viable energy source. This work aims to allow the coupling of biomass gasification and fuel cell systems as wellmore » as Internal Combustion Engines (ICE) to produce high-energy efficiency, clean environmental performance and near-zero greenhouse gas emissions. Biomass gasification is a process, which produces synthesis gas (syngas) that contains 19% hydrogen and 20% carbon monoxide from inexpensive organic matter waste. This project main goal is to provide cost effective energy to the public utilizing remote farms’ waste and landfill recycling area.« less

Operator adaptation to changes in system reliability under adaptable automation.

PubMed

Chavaillaz, Alain; Sauer, Juergen

2017-09-01

This experiment examined how operators coped with a change in system reliability between training and testing. Forty participants were trained for 3 h on a complex process control simulation modelling six levels of automation (LOA). In training, participants either experienced a high- (100%) or low-reliability system (50%). The impact of training experience on operator behaviour was examined during a 2.5 h testing session, in which participants either experienced a high- (100%) or low-reliability system (60%). The results showed that most operators did not often switch between LOA. Most chose an LOA that relieved them of most tasks but maintained their decision authority. Training experience did not have a strong impact on the outcome measures (e.g. performance, complacency). Low system reliability led to decreased performance and self-confidence. Furthermore, complacency was observed under high system reliability. Overall, the findings suggest benefits of adaptable automation because it accommodates different operator preferences for LOA. Practitioner Summary: The present research shows that operators can adapt to changes in system reliability between training and testing sessions. Furthermore, it provides evidence that each operator has his/her preferred automation level. Since this preference varies strongly between operators, adaptable automation seems to be suitable to accommodate these large differences.

Orthopoxvirus detection in environmental specimens during suspected bioterror attacks: inhibitory influences of common household products.

PubMed

Kurth, Andreas; Achenbach, John; Miller, Liljia; Mackay, Ian M; Pauli, Georg; Nitsche, Andreas

2008-01-01

After terrorists attacked the United States in 2001, the appearance of letters and other objects containing powdery substances with unknown potentials for biological threat focused attention on the speed, sensitivity, and reliability of diagnostic methods. This study summarizes the abilities and limitations of real-time PCR, electron microscopy (EM), and virus isolation when used to detect potential bioweapons. In particular, we investigated the inhibitory influences of different common household products present in environmental specimens on PCR yield, EM detection, and virus isolation. We used vaccinia virus as a model for orthopoxviruses by spiking it into specimens. In the second part of the study, we describe modifications of diagnostic methods to overcome inhibitory effects. A variety of PCR amplification enhancers, DNA extraction protocols, and applications of internal controls were evaluated to improve diagnostic simplicity, speed, and reliability. As a result, we strongly recommend using at least two different frontline techniques in parallel, e.g., EM and PCR. A positive result obtained by any one of these techniques should be followed by a biological method to confirm the putative diagnosis. Confirmatory methods include virus isolation followed by an agent-specific immunofluorescence assay to confirm the presence of replication-competent particles.

IMatter: validation of the NHS Scotland Employee Engagement Index.

PubMed

Snowden, Austyn; MacArthur, Ewan

2014-11-08

Employee engagement is a fundamental component of quality healthcare. In order to provide empirical data of engagement in NHS Scotland an Employee Engagement Index was co-constructed with staff. 'iMatter' consists of 25 Likert questions developed iteratively from the literature and a series of validation events with NHS Scotland staff. The aim of this study was to test the face, content and construct validity of iMatter. Cross sectional survey of NHS Scotland staff. In January 2013 iMatter was sent to 2300 staff across all disciplines in NHS Scotland. 1280 staff completed it. Demographic data were collected. Internal consistency of the scale was calculated. Construct validity consisted of concurrent application of factor analysis and Rasch analysis. Face and content validity were checked using 3 focus groups. The sample was representative of the NHSScotland population. iMatter showed very strong reliability (α = 0.958). Factor analysis revealed a four-factor structure consistent with the following interpretation: iMatter showed evidence of high reliability and validity. It is a popular measure of staff engagement in NHS Scotland. Implications for practice focus on the importance of coproduction in psychometric development.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

PubMed

Nguyen, Van N B; Forbes, Helen; Mohebbi, Mohammadreza; Duke, Maxine

2017-12-01

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process. © 2017 The Authors. Nursing & Health Sciences published by John Wiley & Sons Australia, Ltd.

Grapheme-color synesthesia subtypes: Stable individual differences reflected in posterior alpha-band oscillations.

PubMed

Cohen, Michael X; Weidacker, Kathrin; Tankink, Judith; Scholte, H Steven; Rouw, Romke

2015-01-01

Grapheme-color synesthesia is a condition in which seeing letters and numbers produces sensations of colors (e.g., the letter R may elicit a sky-blue percept). Recent evidence implicates posterior parietal areas, in addition to lower-level sensory processing regions, in the neurobiological mechanisms involved in synesthesia. Furthermore, these mechanisms seem to differ for "projectors" (synesthetes who report seeing the color "out there in the real world") versus "associators" (synesthetes who report the color to be only an internal experience). Relatively little is known about possible electrophysiological characteristics of grapheme-color synesthesia. Here we used EEG to investigate functional oscillatory differences among associators, projectors, and non-synesthetes. Projectors had stronger stimulus-related alpha-band (~10 Hz) power over posterior parietal electrodes, compared to both associators and non-synesthetes. Posterior alpha activity was not statistically significantly different between associators from non-synesthetes. We also performed a test-retest assessment of the projector-associator score and found strong retest reliability, as evidenced by a correlation coefficient of .85. These findings demonstrate that the projector-associator distinction is highly reliable over time and is related to neural oscillations in the alpha band.

Herpes zoster surveillance using electronic databases in the Valencian Community (Spain)

PubMed Central

2013-01-01

Background Epidemiologic data of Herpes Zoster (HZ) disease in Spain are scarce. The objective of this study was to assess the epidemiology of HZ in the Valencian Community (Spain), using outpatient and hospital electronic health databases. Methods Data from 2007 to 2010 was collected from computerized health databases of a population of around 5 million inhabitants. Diagnoses were recorded by physicians using the International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM). A sample of medical records under different criteria was reviewed by a general practitioner, to assess the reliability of codification. Results The average annual incidence of HZ was 4.60 per 1000 persons-year (PY) for all ages (95% CI: 4.57-4.63), is more frequent in women [5.32/1000PY (95% CI: 5.28-5.37)] and is strongly age-related, with a peak incidence at 70-79 years. A total of 7.16/1000 cases of HZ required hospitalization. Conclusions Electronic health database used in the Valencian Community is a reliable electronic surveillance tool for HZ disease and will be useful to define trends in disease burden before and after HZ vaccine introduction. PMID:24094135

The post-event processing questionnaire in a clinical sample with social phobia.

PubMed

McEvoy, Peter M; Kingsep, Patrick

2006-11-01

Post-event processing (PEP) involving rumination about perceived inadequacy in a past social situation has been proposed as an important maintaining factor in social phobia. The three aims of this study were to examine (a) the factor structure and internal reliability of a modified version of the Post-Event Processing Questionnaire [Rachman, S., Grüter-Andrew, J., & Shafran, R. (2000). Post-event processing in social anxiety. Behaviour Research and Therapy, 38, 611-617] in a clinical sample with social phobia (N=117), (b) the associations between PEP and symptoms of anxiety and depression, and (c) the relationship between perspective-taking ('field' and 'observer') and anxiety. Principal axis factor analysis yielded a highly reliable one-factor solution in our clinical sample, which generally replicated Rachman et al.'s findings with a sample of undergraduate students. PEP was most strongly and independently associated with state anxiety when depression, general anxiety and stress were controlled for. Contrary to expectations, PEP was not related to measures of social anxiety. The relationship between perspective-taking and anxiety was more complex than expected. Theoretical implications of these findings are discussed with reference to contemporary cognitive-behavioural models of social phobia.

Orthopoxvirus Detection in Environmental Specimens during Suspected Bioterror Attacks: Inhibitory Influences of Common Household Products▿

PubMed Central

Kurth, Andreas; Achenbach, John; Miller, Liljia; Mackay, Ian M.; Pauli, Georg; Nitsche, Andreas

2008-01-01

After terrorists attacked the United States in 2001, the appearance of letters and other objects containing powdery substances with unknown potentials for biological threat focused attention on the speed, sensitivity, and reliability of diagnostic methods. This study summarizes the abilities and limitations of real-time PCR, electron microscopy (EM), and virus isolation when used to detect potential bioweapons. In particular, we investigated the inhibitory influences of different common household products present in environmental specimens on PCR yield, EM detection, and virus isolation. We used vaccinia virus as a model for orthopoxviruses by spiking it into specimens. In the second part of the study, we describe modifications of diagnostic methods to overcome inhibitory effects. A variety of PCR amplification enhancers, DNA extraction protocols, and applications of internal controls were evaluated to improve diagnostic simplicity, speed, and reliability. As a result, we strongly recommend using at least two different frontline techniques in parallel, e.g., EM and PCR. A positive result obtained by any one of these techniques should be followed by a biological method to confirm the putative diagnosis. Confirmatory methods include virus isolation followed by an agent-specific immunofluorescence assay to confirm the presence of replication-competent particles. PMID:17965204

Towards higher stability of resonant absorption measurements in pulsed plasmas.

PubMed

Britun, Nikolay; Michiels, Matthieu; Snyders, Rony

2015-12-01

Possible ways to increase the reliability of time-resolved particle density measurements in pulsed gaseous discharges using resonant absorption spectroscopy are proposed. A special synchronization, called "dynamic source triggering," between a gated detector and two pulsed discharges, one representing the discharge of interest and another being used as a reference source, is developed. An internal digital delay generator in the intensified charge coupled device camera, used at the same time as a detector, is utilized for this purpose. According to the proposed scheme, the light pulses from the reference source follow the gates of detector, passing through the discharge of interest only when necessary. This allows for the utilization of short-pulse plasmas as reference sources, which is critical for time-resolved absorption analysis of strongly emitting pulsed discharges. In addition to dynamic source triggering, the reliability of absorption measurements can be further increased using simultaneous detection of spectra relevant for absorption method, which is also demonstrated in this work. The proposed methods are illustrated by the time-resolved measurements of the metal atom density in a high-power impulse magnetron sputtering (HiPIMS) discharge, using either a hollow cathode lamp or another HiPIMS discharge as a pulsed reference source.

Study on the Validity and Reliability of Melbourne Decision Making Scale in Turkey

ERIC Educational Resources Information Center

Çolakkadioglu, Oguzhan; Deniz, M. Engin

2015-01-01

This study is to analyze the validity and reliability of Melbourne Decision Making Questionnaire (MDMQ). The sample consisted of 650 university students. The structural validity of the MDMQ, as well as correlations among its sub-scales, measure-bound validity, internal consistency, item total correlations and test-retest reliability coefficients…

Discrepancy Score Reliabilities in the WAIS-IV Standardization Sample

ERIC Educational Resources Information Center

Glass, Laura A.; Ryan, Joseph J.; Charter, Richard A.

2010-01-01

In the present investigation, the authors provide internal consistency reliabilities for Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) subtest and Index discrepancy scores using the standardization sample as the data source. Reliabilities ranged from 0.55 to 0.88 for subtest discrepancy scores and 0.80 to 0.91 for Index discrepancy…

Processes and Procedures for Estimating Score Reliability and Precision

ERIC Educational Resources Information Center

Bardhoshi, Gerta; Erford, Bradley T.

2017-01-01

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

Reliability and Validity Tests of Singelis's Self-Construal Scale (1994).

ERIC Educational Resources Information Center

Wang, Qi

Two studies focused on the reliability and validity of T.M. Singelis's 24-item Self-Construal Scale (SCS) (1994). In the first study, Cronbach alphas were calculated to assess the internal consistency of the reliability of the two subscales that were supposed to measure individuals' independent and interdependent self construals. The sample was…

The Bahasa Melayu version of the Nursing Stress Scale among nurses: a reliability study in Malaysia.

PubMed

Rosnawati, Muhamad Robat; Moe, Htay; Masilamani, Retneswari; Darus, A

2010-10-01

The Nursing Stress Scale (NSS) has been shown to be a valid and reliable instrument to assess occupational stressors among nurses. The NSS, which was previously used in the English version, was translated and back-translated into Bahasa Melayu. This study was conducted to assess the reliability of the Bahasa Melayu version of the NSS among nurses for future studies in this country. The reliability of the NSS was assessed after its readministration to 30 nurses with a 2-week interval. The Spearman coefficient was calculated to assess its stability. The internal consistency was measured through 4 measures: Cronbach's α, Spearman-Brown, Guttman split-half, and standardized item α coefficients. The total response rate was 70%. Test-retest reliability showed remarkable stability (Spearman's ρ exceeded .70). All 4 measures of internal consistency among items indicated a satisfactory level (coefficients in the range of .68 to .87). In conclusion, the Bahasa Melayu version of the NSS is a reliable and useful instrument for measuring the possible stressors at the workplace among nurses.

Ahmad Mayyas | NREL

Science.gov Websites

University-International Center for Automotive Research (CU-ICAR) (2009-2012) Intern/Reliability Engineer selection for body-in-white." International Journal of Sustainable Manufacturing 2, no. 4 (August 2012 Structure Case Study." Accepted for publication in International Journal of Sustainable Engineering

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

PubMed

Mokkink, Lidwine B; Terwee, Caroline B; Patrick, Donald L; Alonso, Jordi; Stratford, Paul W; Knol, Dirk L; Bouter, Lex M; de Vet, Henrica C W

2010-05-01

Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'. Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.

Use of a brief version of the self-compassion inventory with an international sample of people with HIV/AIDS

PubMed Central

Brion, John M.; Leary, Mark; Wantland, Dean; Sullivan, K.; Nokes, Kathleen; Bain, Catherine A; Chaiphibalsarisdi, Puangtip; Chen, Wei-ti; Holzemer, William L.; Eller, Lucille Sanzero; Iipinge, Scholastika; Johnson, Mallory O.; Portillo, Carmen; Voss, Joachim; Tyer-Viola, Lynda; Corless, Inge B; Nicholas, Patrice K; Rose, Carol Dawson; Phillips, J. Craig; Sefcik, Elizabeth; Mendez, Marta Rivero; Kirksey, Kenn M.

2013-01-01

The objective of this study was to extend the psychometric evaluation of a brief version of the Self Compassion Scale (SCS). A secondary analysis of data from an international sample of 1,967 English-speaking persons living with HIV disease was used to examine the factor structure, and reliability of the 12-item Brief Version Self Compassion Inventory (BVSCI). A Maximum Likelihood factor analysis and Oblimin with Kaiser Normalization confirmed a two-factor solution, accounting for 42.58% of the variance. The BVSCI supported acceptable internal consistencies, with .714 for the total scale and .822 for Factor I and .774 for Factor II. Factor I (lower self compassion) demonstrated strongly positive correlations with measures of anxiety and depression while Factor II (high self compassion) was inversely correlated with the measures. No significant differences were found in the BVSCI scores for gender, age, or having children. Levels of self-compassion were significantly higher in persons with HIV disease and other physical and psychological health conditions. The scale shows promise for the assessment of self-compassion in persons with HIV without taxing participants, and may prove essential in investigating future research aimed at examining correlates of self-compassion, as well as providing data for tailoring self-compassion interventions for persons with HIV. PMID:23527887

Validation of the LupusPRO version 1.8: an update to a disease-specific patient-reported outcome tool for systemic lupus erythematosus.

PubMed

Azizoddin, D R; Weinberg, S; Gandhi, N; Arora, S; Block, J A; Sequeira, W; Jolly, M

2018-04-01

Objectives LupusPRO has shown good measurement properties as a disease-specific patient-reported outcome tool in systemic lupus erythematosus (SLE). For the purpose of clinical trials, the version 1.7 (v1.7) domain of Pain-Vitality was separated into distinct Pain, Vitality and Sleep domains in v1.8, and the psychometric properties examined. Methods A total of 131 consecutive SLE patients were self-administered surveys assessing fatigue (FACIT, SF-36), pain (Pain Inventory, SF-36), insomnia (Insomnia Severity Index), emotional health (PHQ-9, SF-36) and quality of life (SF-36, LupusPRO) at routine care visits. Internal consistency reliability (ICR) for each domain was obtained using Cronbach's alpha. The convergent construct validity of LupusPRO domains with corresponding SF-36 domains or tools were tested using Spearman correlation. Varimax rotations were conducted to assess factor structures of the LupusPRO v1.8. Results Mean (SD) age was 40.04 (14.10) years. Scores from the LupusPRO-Sleep domain strongly correlated with insomnia scores, while LupusPRO-Vitality correlated strongly with fatigue (FACIT) and SF-36 vitality. The LupusPRO-Pain domain correlated strongly with pain (SF36 Bodily-Pain, Pain Inventory) scores. Similarly, the LupusPRO domains of Physical and Emotional Health had significant correlations with corresponding SF-36 domains. The ICR for HRQoL and non-HRQoL were 0.96 and 0.81. LupusPRO (domains HRQoL and QoL) scores correlated with disease activity. Principal component analysis included seven factor loadings presenting for the HRQOL subscales (combined Sleep, Vitality, and Pain), and three factors for the NHRQoL (Combined Coping and Social Support). Conclusions LupusPRO v1.8 (including its Sleep, Vitality, and Pain domains) has acceptable reliability and validity. Use of LupusPRO as an outcome measure in clinical trials would facilitate responsiveness assessment.

The 7 up 7 down inventory: a 14-item measure of manic and depressive tendencies carved from the General Behavior Inventory.

PubMed

Youngstrom, Eric A; Murray, Greg; Johnson, Sheri L; Findling, Robert L

2013-12-01

The aim of this study was to develop and validate manic and depressive scales carved from the full-length General Behavior Inventory (GBI). The brief version was designed to be applicable for youths and adults and to improve separation between mania and depression dimensions. Data came from 9 studies (2 youth clinical samples, aggregate N = 738, and 7 nonclinical adult samples, aggregate N = 1,756). Items with high factor loadings on the 2 extracted dimensions of mania and depression were identified from both data sets, and final item selection was based on internal reliability criteria. Confirmatory factor analyses described the 2-factor model's fit. Criterion validity was compared between mania and depression scales, and with the full-length GBI scales. For both mania and depression factors, 7 items produced a psychometrically adequate measure applicable across both aggregate samples. Internal reliability of the Mania scale was .81 (youth) and .83 (adult) and for Depression was .93 (youth) and .95 (adult). By design, the brief scales were less strongly correlated with each other than were the original GBI scales. Construct validity of the new instrument was supported in observed discriminant and convergent relationships with external correlates and discrimination of diagnostic groups. The new brief GBI, the 7 Up 7 Down Inventory, demonstrates sound psychometric properties across a wide age range, showing expected relationships with external correlates. The new instrument provides a clearer separation of manic and depressive tendencies than the original. (PsycINFO Database Record (c) 2013 APA, all rights reserved).

Development of a Theory-based, Sociocultural Instrument to Assess Black Maternal Intentions to Vaccinate Their Daughters Aged 9 to 12 Against HPV.

PubMed

Cunningham-Erves, Jennifer; Talbott, Laura L; O'Neal, Marcia R; Ivankova, Nataliya V; Wallston, Kenneth A

2016-09-01

The human papillomavirus (HPV) vaccine could assist in reducing the cervical cancer disparity existing between Black and White women. Understanding factors influencing Black maternal intentions to vaccinate their daughter is essential in improving vaccination uptake. However, existing instruments do not comprehensively assess factors (e.g., culture) influencing maternal intentions. This paper describes the development of the Human Papillomavirus Vaccination Survey for Black Mothers with Girls Aged 9 to 12 (HPVS-BM), the first instrument to measure knowledge, attitudes, subjective norms, and cultural beliefs relating to Black maternal intentions to vaccinate their daughters aged 9 to 12 years against HPV. The items and scales were refined using content review by experts, as well as cognitive interviews and pilot testing with target audience participants. The final version of the HPVS-BM was administered to 242 Black mothers with adolescent daughters. Internal reliability was determined using Cronbach's alpha. An a priori hypothetical model was developed to determine convergent and discriminant validity. All scales of the HPVS-BM had an acceptable internal reliability of 0.70 or higher. The intention scale of HPVS-BM was significantly correlated (p < .05) with perceived benefits, perceived barriers, and subjective norms, supporting strong convergent validity. Moderate discriminant construct validity was also demonstrated. Exhibiting good psychometrics, this instrument could be used by healthcare researchers and professionals to develop programs to increase HPV vaccination among Black adolescent females aimed at reducing the racial disparities in cervical cancer. Further psychometric testing of this survey tool for understanding factors influencing maternal intentions is warranted.

Psychometric Properties of the Multidimensional Pain Inventory Applied to Brazilian Patients with Orofacial Pain.

PubMed

Zucoloto, Miriane Lucindo; Maroco, João; Duarte Bonini Campos, Juliana Alvares

2015-01-01

To evaluate the psychometric properties of the Multidimensional Pain Inventory (MPI) in a Brazilian sample of patients with orofacial pain. A total of 1,925 adult patients, who sought dental care in the School of Dentistry of São Paulo State University's Araraquara campus, were invited to participate; 62.5% (n=1,203) agreed to participate. Of these, 436 presented with orofacial pain and were included. The mean age was 39.9 (SD=13.6) years and 74.5% were female. Confirmatory factor analysis was conducted using χ²/df, comparative fit index, goodness of fit index, and root mean square error of approximation as indices of goodness of fit. Convergent validity was estimated by the average variance extracted and composite reliability, and internal consistency by Cronbach's alpha standardized coefficient (α). The stability of the models was tested in independent samples (test and validation; dental pain and orofacial pain). The factorial invariance was estimated by multigroup analysis (Δχ²). Factorial, convergent validity, and internal consistency were adequate in all three parts of the MPI. To achieve this adequate fit for Part 1, item 15 needed to be deleted (λ=0.13). Discriminant validity was compromised between the factors "activities outside the home" and "social activities" of Part 3 of the MPI in the total sample, validation sample, and in patients with dental pain and with orofacial pain. A strong invariance between different subsamples from the three parts of the MPI was detected. The MPI produced valid, reliable, and stable data for pain assessment among Brazilian patients with orofacial pain.

Psychometric properties of the Turkish version of the Internet Addiction Test (IAT).

PubMed

Boysan, Murat; Kuss, Daria J; Barut, Yaşar; Ayköse, Nafi; Güleç, Mustafa; Özdemir, Osman

2017-01-01

Of many instruments developed to assess Internet addiction, the Internet Addiction Test (IAT), an expanded version of the Internet Addiction Diagnostic Questionnaire (IADQ), has been the most widely used scale in English and non-English speaking populations. In this study, our aim was to investigate the psychometric properties of short and expanded versions of the IAT in a Turkish undergraduate sample. Overall, 455 undergraduate students from Turkey aged between 18 and 30 participated in the study (63.53% were females). Explanatory and confirmatory factor analytic procedures investigated factor structures of the IADQ and IAT. The Internet Addiction Scale (IAS), Coping Inventory for Stressful Situations (CISS), Obsessive Compulsive Inventory-Revised (OCI-R) and Dissociative Experiences Scale (DES) were administered to assess convergent and divergent validities of the IADQ and IAT. Internal consistency and 15-day test-retest reliability were computed. In the factorial analytic investigation, we found a unidimensional factor structure for each measure fit the current data best. Significant but weak to moderate correlations of the IADQ and the IAT with the CISS, OCI-R and DES provided empirical evidence for divergent validity, whereas strong associations with the subscales of the IAS pointed to the convergent validity of Young's Internet addiction construct. Internal consistency of the IADQ was weak (α=0.67) and of the IAT was high (α=0.93). Temporal reliability of both instruments was very high (α=0.81 and α=0.87; respectively). The IAT revealed promising and sound psychometric properties in a Turkish sample. Copyright © 2015 Elsevier Ltd. All rights reserved.

Cross-cultural adaptation to Portuguese of tools for assessing the nutritional status of patients on dialysis.

PubMed

Fetter, Renata Lemos; Bigogno, Fernanda Guedes; de Oliveira, Fernanda Galvão Pasculli; Avesani, Carla Maria

2014-01-01

The 7 point subjective global assessment (7p-SGA) and the malnutrition inflammation score (MIS) are tools commonly applied for the assessment of nutritional status in dialyzed patients. Both were developed in English and require translation to Portuguese to be applied in Brazil. The cross-cultural equivalence process ensures semantic and measurement equivalence of a translated tool. To perform the cross-cultural adaptation to Portuguese of the 7p-SGA and MIS. Semantic equivalence was performed by the back-translation method and by assessing the degree of similarity between the original instrument and that back-translated from Portuguese to English (Back-translation). The assessment of the equivalence measurement was made by evaluating the intern reliability (Cronbach's α) and interobserver reliability (two observers). One-hundred and one elderly patients on hemodialysis (HD) were included. Both instruments showed a high degree of semantic similarity with results close to the maximum value (7p-SGA 96.8 ± 7.8 and MIS 99.6 ± 1.4). The intern consistency showed a Cronbach's α value for 7p-SGA of 0.72 and of 0.53 for MIS. The interobserver reproducibility of 7p-SGA was moderate (intraclass coefficient [ICC] = 0.74 [95% CI: 0.58; 0.84]), while for MIS was strong (ICC = 0.88 [95% CI: 0.81; 0.93]). The 7p-SGA and MIS translated into Portuguese can be applied for assessing the nutritional status of elderly patients on HD. Studies testing the applicability of these instruments in adult patients on HD and in peritoneal dialysis should yet be performed.

The SPADE Symptom Cluster in Primary Care Patients With Chronic Pain.

PubMed

Davis, Lorie L; Kroenke, Kurt; Monahan, Patrick; Kean, Jacob; Stump, Timothy E

2016-05-01

Sleep disturbance, pain, anxiety, depression, and low energy/fatigue, the SPADE pentad, are the most prevalent and co-occurring symptoms in the general population and clinical practice. Co-occurrence of SPADE symptoms may produce additive impairment and negatively affect treatment response, potentially undermining patients' health and functioning. The purpose of this paper is to determine: (1) prevalence and comorbidity (ie, clustering) of SPADE symptoms; (2) internal reliability and construct validity of a composite SPADE symptom score derived from the Patient-Reported Outcomes Measurement Information System (PROMIS) measures; and (3) whether improvement in somatic symptom burden represented by a composite score predicted subsequent measures of functional status at 3 and 12 months follow-up. Secondary analysis of data from the Stepped Care to Optimize Pain care Effectiveness study, a randomized trial of a collaborative care intervention for Veterans with chronic pain. Most patients had multiple SPADE symptoms; only 9.6% of patients were monosymptomatic. The composite PROMIS symptom score had good internal reliability (Cronbach's alpha=0.86) and construct validity and strongly correlated with multiple measures of functional status; improvement in the composite score significantly correlated with higher scores for 5 of 6 functional status outcomes. The standardized error of measurement (SEM) for the composite T-score was 2.84, suggesting a 3-point difference in an individual's composite score may be clinically meaningful. Brief PROMIS measures may be useful in evaluating SPADE symptoms and overall symptom burden. Because symptom burden may predict functional status outcomes, better identification and management of comorbid symptoms may be warranted.

Cross-cultural reliability and validity of ADHD assessed by the ADHD Rating Scale in a pan-European study.

PubMed

Döpfner, Manfred; Steinhausen, Hans-Christoph; Coghill, David; Dalsgaard, Søren; Poole, Lynne; Ralston, Stephen J; Rothenberger, Aribert

2006-12-01

To provide psychometric information on the Attention-Deficit/Hyperactivity Disorder (ADHD) Rating Scale-IV (ADHD-RS-IV) in a large population of children with ADHD. Patients aged 6-18 years (n=1,478 in baseline analysis) were rated by 244 physicians on the ADHD-RS-IV based on a semi-structured interview with the patient's parent. Physicians additionally rated functional impairment (CGAS) and health status (CGI-S), and parents rated their child's behavioural and emotional problems (SDQ) and quality of life (CHIP-CE). Inattention and hyperactivity-impulsivity as dimensions of ADHD were replicated. 3-factor solutions reflecting the ICD-10 definition, with hyperactivity, impulsivity and inattention as separate dimensions were extracted in some national sub-samples and in separate analyses for boys and younger children.Good internal consistencies, strong country effects and small effects of age were found. Based on ADHD-RS-IV, 88.5% of patients met the criteria for any ADHD diagnosis. Correlations between ADHD-RS-IV and measures of functional impairment were low but statistically significant. The correlations with SDQ and CHIP-CE scales confirm the convergent and divergent validity of ADHD-RS-IV. Impressive evidence for the cross-cultural factorial validity, internal consistency as well as convergent and divergent validity of ADHD-RS-IV was found. ADHD can be assessed reliably and validly in routine care across Europe. The ICD-10 3-factor model seems to be less robust than the DSM-IV 2-factor model, but may be a good description for special populations (boys, younger children).

Translation, cross-cultural adaptation and validation of the Italian version of the Nottingham Clavicle Score (NCS).

PubMed

Vascellari, Alberto; Schiavetti, Stefano; Rebuzzi, Enrico; Coletti, Nicolò

2015-11-01

The Nottingham Clavicle Score (NCS) is a specific Patient Reported Outcome Measure of injuries to the clavicle, acromio-clavicular joint (ACJ) and sterno-clavicular joint. The purpose of this study was to translate the NCS into Italian and establish its cultural adaptiveness and validity. The original version of the NCS was translated into Italian in accordance with the cross-cultural adaptation guidelines described by Guillemin. Sixty-six patients [average age 45.7 years (SD 11.3)] who had received surgical treatment for injuries of the ACJ and the clavicle were included in the study. The study population completed the NCS twice within 5 days, the Oxford Shoulder Score (OSS), the Disability of the Arm, Shoulder and Hand (DASH) questionnaire and the short-form 36 (SF-36). Statistical tests assessed the construct validity, discriminant validity, internal consistency, reliability and feasibility of the NCS. The translation and adaptation of the NCS for an Italian context required no major cultural adaptation. Internal consistency was high (Cronbach's α, 0.86). Test-retest reproducibility was excellent (ρ = 0.981, p < 0.00001). Administration time was 45 s (range 1 min 32 s-8 min), and all items were answered. The Italian NCS showed strong correlation with the DASH (-0.87), the OSS (-0.84) and those subscales of the SF-36 (physical functioning, role physical and bodily pain) which aim to measure similar constructs. The Italian NCS scale is a reliable, valid, consistent shoulder assessment form that can be used to assess the functional limitations of patients with injuries of clavicle or ACJ. III.

Development of the Persian version of the Vertigo Symptom Scale: Validity and reliability

PubMed Central

Kamalvand, Atefeh; Ghahraman, Mansoureh Adel; Jalaie, Shohreh

2017-01-01

Background: Vertigo Symptom Scale (VSS) is a proper instrument for assessing the patient status, clarifying the symptoms, and examining the relative impact of the vertigo and anxiety on reported handicap. Our aim is the translation and cross-cultural adaptation of the VSS into Persian language (VSS-P) and investigating its validity and reliability in patients with peripheral vestibular disorders. Materials and Methods: VSS was translated into Persian. Cross-cultural adaptation was carried out on 101 patients with peripheral vestibular disorders and 34 participants with no history of vertigo. They completed the Persian versions of VSS, dizziness handicap inventory (DHI), and Beck anxiety inventory (BAI). Internal, discriminant, and convergent validities, internal consistency, and test-retest reliability were determined. Results: The VSS-P showed good face validity. Internal validity was confirmed and demonstrated the presence of two vertigo (VSS-VER) and autonomic-anxiety (VSS-AA) subscales. Significant difference between the median scores for patient and healthy groups was reported in discriminate validity (P <0.001). Convergent validity revealed high correlation between both BAI and DHI with VSS-P. There was a high test-retest reliability; with intraclass correlation coefficient of 0.89, 0.86, and 0.91 for VSS-AA, VER, and VSS-P, respectively. The internal consistency was good with Cronbach's alpha 0.90 for VER subscale, 0.86 for VSS-AA subscale, and 0.92 for the overall VSS-P. Conclusion: The Persian version of the VSS could be used clinically as a valid and reliable tool. Thus, it is a key instrument to focus on the symptoms associated with dizziness. PMID:28616045

Development of the Persian version of the Vertigo Symptom Scale: Validity and reliability.

PubMed

Kamalvand, Atefeh; Ghahraman, Mansoureh Adel; Jalaie, Shohreh

2017-01-01

Vertigo Symptom Scale (VSS) is a proper instrument for assessing the patient status, clarifying the symptoms, and examining the relative impact of the vertigo and anxiety on reported handicap. Our aim is the translation and cross-cultural adaptation of the VSS into Persian language (VSS-P) and investigating its validity and reliability in patients with peripheral vestibular disorders. VSS was translated into Persian. Cross-cultural adaptation was carried out on 101 patients with peripheral vestibular disorders and 34 participants with no history of vertigo. They completed the Persian versions of VSS, dizziness handicap inventory (DHI), and Beck anxiety inventory (BAI). Internal, discriminant, and convergent validities, internal consistency, and test-retest reliability were determined. The VSS-P showed good face validity. Internal validity was confirmed and demonstrated the presence of two vertigo (VSS-VER) and autonomic-anxiety (VSS-AA) subscales. Significant difference between the median scores for patient and healthy groups was reported in discriminate validity ( P <0.001). Convergent validity revealed high correlation between both BAI and DHI with VSS-P. There was a high test-retest reliability; with intraclass correlation coefficient of 0.89, 0.86, and 0.91 for VSS-AA, VER, and VSS-P, respectively. The internal consistency was good with Cronbach's alpha 0.90 for VER subscale, 0.86 for VSS-AA subscale, and 0.92 for the overall VSS-P. The Persian version of the VSS could be used clinically as a valid and reliable tool. Thus, it is a key instrument to focus on the symptoms associated with dizziness.

Development and validation of the brief esophageal dysphagia questionnaire.

PubMed

Taft, T H; Riehl, M; Sodikoff, J B; Kahrilas, P J; Keefer, L; Doerfler, B; Pandolfino, J E

2016-12-01

Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. 1638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. The BEDQ represents a rapid, reliable, and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. © 2016 John Wiley & Sons Ltd.

Development and Validation of the Brief Esophageal Dysphagia Questionnaire

PubMed Central

Taft, Tiffany H.; Riehl, Megan; Sodikoff, Jamie B.; Kahrilas, Peter J.; Keefer, Laurie; Doerfler, Bethany; Pandolfino, John E.

2017-01-01

Background Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. Methods 1,638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. Key Results The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. Conclusions & Inferences The BEDQ represents a rapid, reliable and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. PMID:27380834

Cross-cultural challenges for assessing medical professionalism among clerkship physicians in a Middle Eastern country (Bahrain): feasibility and psychometric properties of multisource feedback.

PubMed

Al Ansari, Ahmed; Al Khalifa, Khalid; Al Azzawi, Mohamed; Al Amer, Rashed; Al Sharqi, Dana; Al-Mansoor, Anwar; Munshi, Fadi M

2015-01-01

We aimed to design, implement, and evaluate the feasibility and reliability of a multisource feedback (MSF) system to assess interns in their clerkship year in the Middle Eastern culture, the Kingdom of Bahrain. The study was undertaken in the Bahrain Defense Force Hospital, a military teaching hospital in the Kingdom of Bahrain. A total of 21 interns (who represent the total population of the interns for the given year) were assessed in this study. All of the interns were rotating through our hospital during their year-long clerkship rotation. The study sample consisted of nine males and 12 females. Each participating intern was evaluated by three groups of raters, eight medical intern colleagues, eight senior medical colleagues, and eight coworkers from different departments. A total of 21 interns (nine males and 12 females) were assessed in this study. The total mean response rates were 62.3%. A factor analysis was conducted that found that the data on the questionnaire grouped into three factors that counted for 76.4% of the total variance. These three factors were labeled as professionalism, collaboration, and communication. Reliability analysis indicated that the full instrument scale had high internal consistency (Cronbach's α 0.98). The generalizability coefficients for the surveys were estimated to be 0.78. Based on our results and analysis, we conclude that the MSF tool we used on the interns rotating in their clerkship year within our Middle Eastern culture provides an effective method of evaluation because it offers a reliable, valid, and feasible process.

Validating the shortened Quality of Life in Childhood Epilepsy Questionnaire (QOLCE-55) in a sample of children with drug-resistant epilepsy.

PubMed

Conway, Lauryn; Widjaja, Elysa; Smith, Mary Lou; Speechley, Kathy N; Ferro, Mark A

2017-04-01

The aim of this study was to validate the newly developed shortened Quality of Life in Childhood Epilepsy Questionnaire (QOLCE-55) in a sample of children with drug-resistant epilepsy. Data came from 136 children enrolled in the Impact of Pediatric Epilepsy Surgery on Health-Related Quality of Life Study (PEPSQOL), a multicenter prospective cohort study. Confirmatory factor analysis was used to assess the higher-order factor structure of the QOLCE-55. Convergent and divergent validity was assessed by correlating subscales of the KIDSCREEN-27 with the QOLCE-55. Measurement equivalence of the QOLCE-55 was evaluated using multiple-group confirmatory factor analysis of children with drug-resistant epilepsy from PEPSQOL versus children with new-onset epilepsy from HERQULES (Health-Related Quality of Life in Children with Epilepsy Study). The higher-order factor structure of the QOLCE-55 demonstrated adequate fit: Comparative Fit Index (CFI) = 0.948; Tucker-Lewis Index (TLI) = 0.946; Root Mean Square of Approximation (RMSEA) = 0.060 (90% confidence interval [CI] 0.054-0.065); Weighted Root Mean Square Residuals (WRMR) = 1.247. Higher-order factor loadings were strong, ranging from λ = 0.74 to 0.81. Internal consistency reliability was excellent (α = 0.97, subscales α > 0.82). QOLCE-55 subscales demonstrated moderate to strong correlations with similar subscales of the KIDSCREEN-27 (ρ = 0.43-0.75) and weak to moderate correlations with dissimilar subscales (ρ = 0.25-0.42). The QOLCE-55 demonstrated partial measurement equivalence at the level of strict invariance - χ 2 (2,823) = 3,727.9, CFI = 0.961, TLI = 0.962, RMSEA = 0.049 (0.044, 0.053), WRMR = 1.834. The findings provide support for the factor structure of the QOLCE-55 and contribute to its robust psychometric profile as a reliable and valid measure. Researchers and health practitioners should consider the QOLCE-55 as a viable option for reducing respondent burden when assessing health-related quality of life in children with epilepsy. Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.

Measuring health-related quality of life: psychometric evaluation of the Tunisian version of the SF-12 health survey.

PubMed

Younsi, Moheddine; Chakroun, Mohamed

2014-09-01

The 12-item short-form health survey (SF-12) was developed as a shorter alternative to the SF-36 for use in large-scale studies as an applicable instrument for measuring health-related quality of life. The main purpose of this study was to evaluate the psychometric properties of the Tunisian version of the SF-12. A stratified representative sample (N = 3,582) of the general Tunisian population aged 18 years and over was interviewed. SF-12 summary scores were derived using the standard US algorithm. Factor analysis was used to confirm the hypothesized component structure of the SF-12 items. Reliability was estimated using internal consistency, and construct validity was investigated with "known groups" validity testing and via convergent and divergent validity. SF-12 summary scores distinguished well, and in the expected manner, between groups of respondents on the basis of gender, age, education and socioeconomic status, thus providing evidence of construct validity. Mean scores in the total sample were 50.11 (SD 8.53) for the physical component summary (PCS) score and 47.96 (SD 9.82) for the mental component summary (MCS) score. The results showed satisfactory internal consistency and acceptable convergent validity for both summary scores. Cronbach's α coefficient for PCS-12 and MCS-12 was 0.73 and 0.72, respectively. Known groups comparison showed that the SF-12 discriminated well between groups of respondents on the basis of gender, age, education and socioeconomic status. In addition, no floor or ceiling effects at baseline were observed. The PCA confirmed the two-factor structure of the SF-12 items. Items belonging to the physical component correlated more strongly with the PCS-12 than those with the MCS-12. Similarly, items belonging to the mental component correlated more strongly with the MCS-12 than those with the PCS-12. The findings suggest that the SF-12 appears to be a valid and reliable measure that can be used for measuring of population health status. However, for optimal measurement, modifications to traditional scoring methods for the SF-12 should be considered.

Reliability of the detailed assessment of speed of handwriting on Flemish children.

PubMed

Simons, Johan; Probst, Michel

2014-01-01

This study evaluates the reliability of the Detailed Assessment of Speed of Handwriting (DASH) in a Dutch-speaking sample of children. The sample included 650 boys and 513 girls (age range = 9-16 years). Handwriting speed measurements were obtained using the DASH. Interrater agreement, test-retest reliability, and internal consistency were calculated; gender and age effects were analyzed. Interrater agreement shows excellent reliability with intraclass correlation coefficients of at least 0.94. Test-retest correlations ranged from r = 0.65 to r = 0.81. The internal consistency measures, calculated with Cronbach's alpha, were between 0.88 and 0.94. Both gender and age have a significant effect on handwriting speed, with F (7.1144) = 17.43 (P < .001) for gender and F (7.1144) = 21.8 (P < .001) for age. The DASH is a reliable assessment tool to evaluate handwriting speed of Dutch-speaking children. There is a tendency of girls to write faster than boys.

Structured assessment of current mental state in clinical practice: an international study of the reliability and validity of the Current Psychiatric State interview, CPS-50.

PubMed

Falloon, I R H; Mizuno, M; Murakami, M; Roncone, R; Unoka, Z; Harangozo, J; Pullman, J; Gedye, R; Held, T; Hager, B; Erickson, D; Burnett, K

2005-01-01

To develop a reliable standardized assessment of psychiatric symptoms for use in clinical practice. A 50-item interview, the Current Psychiatric State 50 (CPS-50), was used to assess 237 patients with a range of psychiatric diagnoses. Ratings were made by interviewers after a 2-day training. Comparisons of inter-rater reliability on each item and on eight clinical subscales were made across four international centres and between psychiatrists and non-psychiatrists. A principal components analysis was used to validate these clinical scales. Acceptable inter-rater reliability (intra-class coefficient > 0.80) was found for 46 of the 50 items, and for all eight subscales. There was no difference between centres or between psychiatrists and non-psychiatrists. The principal components analysis factors were similar to the clinical scales. The CPS-50 is a reliable standardized assessment of current mental status that can be used in clinical practice by all mental health professionals after brief training. Blackwell Munksgaard 2004

Deformation of Cases in High Capacitance Value Wet Tantalum Capacitors under Environmental Stresses

NASA Technical Reports Server (NTRS)

Teverovsky, Alexander

2016-01-01

Internal gas pressure in hermetic wet tantalum capacitors is created by air, electrolyte vapor, and gas generated by electrochemical reactions at the electrodes. This pressure increases substantially with temperature and time of operation due to excessive leakage currents. Deformation of the case occurs when the internal pressure exceeds pressure of the environments and can raise significantly when a part operates in space. Contrary to the cylinder case wet tantalum capacitors that have external sealing by welding and internal sealing provided by the Teflon bushing and crimping of the case, no reliable internal sealing exists in the button case capacitors. Single seal design capacitors are used for high capacitance value wet tantalum capacitors manufactured per DLA L&M drawings #04003, 04005, and 10011, and require additional analysis to assure their reliable application in space systems. In this work, leakage currents and case deformation of button case capacitors were measured during different environmental test conditions. Recommendations for derating, screening and qualification testing are given. This work is a continuation of a series of NEPP reports related to quality and reliability of wet tantalum capacitors.

Agreement and accuracy using the FIGO, ACOG and NICE cardiotocography interpretation guidelines.

PubMed

Santo, Susana; Ayres-de-Campos, Diogo; Costa-Santos, Cristina; Schnettler, William; Ugwumadu, Austin; Da Graça, Luís M

2017-02-01

One of the limitations reported with cardiotocography is the modest interobserver agreement observed in tracing interpretation. This study compared agreement, reliability and accuracy of cardiotocography interpretation using the International Federation of Gynecology and Obstetrics, American College of Obstetrics and Gynecology and National Institute for Health and Care Excellence guidelines. A total of 151 tracings were evaluated by 27 clinicians from three centers where International Federation of Gynecology and Obstetrics, American College of Obstetrics and Gynecology and National Institute for Health and Care Excellence guidelines were routinely used. Interobserver agreement was evaluated using the proportions of agreement and reliability with the κ statistic. The accuracy of tracings classified as "pathological/category III" was assessed for prediction of newborn acidemia. For all measures, 95% confidence interval were calculated. Cardiotocography classifications were more distributed with International Federation of Gynecology and Obstetrics (9, 52, 39%) and National Institute for Health and Care Excellence (30, 33, 37%) than with American College of Obstetrics and Gynecology (13, 81, 6%). The category with the highest agreement was American College of Obstetrics and Gynecology category II (proportions of agreement = 0.73, 95% confidence interval 0.70-76), and the ones with the lowest agreement were American College of Obstetrics and Gynecology categories I and III. Reliability was significantly higher with International Federation of Gynecology and Obstetrics (κ = 0.37, 95% confidence interval 0.31-0.43), and National Institute for Health and Care Excellence (κ = 0.33, 95% confidence interval 0.28-0.39) than with American College of Obstetrics and Gynecology (κ = 0.15, 95% confidence interval 0.10-0.21); however, all represent only slight/fair reliability. International Federation of Gynecology and Obstetrics and National Institute for Health and Care Excellence showed a trend towards higher sensitivities in prediction of newborn acidemia (89 and 97%, respectively) than American College of Obstetrics and Gynecology (32%), but the latter achieved a significantly higher specificity (95%). With American College of Obstetrics and Gynecology guidelines there is high agreement in category II, low reliability, low sensitivity and high specificity in prediction of acidemia. With International Federation of Gynecology and Obstetrics and National Institute for Health and Care Excellence guidelines there is higher reliability, a trend towards higher sensitivity, and lower specificity in prediction of acidemia. © 2016 Nordic Federation of Societies of Obstetrics and Gynecology.

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the MCQ and OSCE scores provides evidence of the validity of these measures for use in the evaluation of knowledge and clinical skills in internal medicine. The OSCE exam is more reliable than the short- and long-case clinical exams and requires less effort on the part of examiners and patients.

Translation of oswestry disability index into Tamil with cross cultural adaptation and evaluation of reliability and validity(§).

PubMed

Vincent, Joshua Israel; Macdermid, Joy Christine; Grewal, Ruby; Sekar, Vincent Prabhakaran; Balachandran, Dinesh

2014-01-01

Prospective longitudinal validation study. To translate and cross-culturally adapt the Oswestry Disability Index (ODI) to the Tamil language (ODI-T), and to evaluate its reliability and construct validity. ODI is widely used as a disease specific questionnaire in back pain patients to evaluate pain and disability. A thorough literature search revealed that the Tamil version of the ODI has not been previously published. The ODI was translated and cross-culturally adapted to the Tamil language according to established guidelines. 30 subjects (16 women and 14 men) with a mean age of 42.7 years (S.D. 13.6; Range 22 - 69) with low back pain were recruited to assess the psychometric properties of the ODI-T Questionnaire. Patients completed the ODI-T, Roland-Morris disability questionnaire (RMDQ), VAS-pain and VAS-disability at baseline and 24-72 hours from the baseline visit. The ODI-T displayed a high degree of internal consistency, with a Cronbach's alpha of 0.92. The test-retest reliability was high (n=30) with an ICC of 0.92 (95% CI, 0.84 to 0.96) and a mean re-test difference of 2.6 points lower on re-test. The ODI-T scores exhibited a strong correlation with the RMDQ scores (r = 0.82) p<0.01, VAS-P (r = 0.78) p<0.01 and VAS-D (r = 0.81) p<0.01. Moderate to low correlations were observed between the ODI-T and lumbar ROM (r = -0.27 to -0.53). All the hypotheses that were constructed apriori were supported. The Tamil version of the ODI Questionnaire is a valid and reliable tool that can be used to measure subjective outcomes of pain and disability in Tamil speaking patients with low back pain.

A competency based selection procedure for Dutch postgraduate GP training: a pilot study on validity and reliability.

PubMed

Vermeulen, Margit I; Tromp, Fred; Zuithoff, Nicolaas P A; Pieters, Ron H M; Damoiseaux, Roger A M J; Kuyvenhoven, Marijke M

2014-12-01

Abstract Background: Historically, semi-structured interviews (SSI) have been the core of the Dutch selection for postgraduate general practice (GP) training. This paper describes a pilot study on a newly designed competency-based selection procedure that assesses whether candidates have the competencies that are required to complete GP training. The objective was to explore reliability and validity aspects of the instruments developed. The new selection procedure comprising the National GP Knowledge Test (LHK), a situational judgement tests (SJT), a patterned behaviour descriptive interview (PBDI) and a simulated encounter (SIM) was piloted alongside the current procedure. Forty-seven candidates volunteered in both procedures. Admission decision was based on the results of the current procedure. Study participants did hardly differ from the other candidates. The mean scores of the candidates on the LHK and SJT were 21.9 % (SD 8.7) and 83.8% (SD 3.1), respectively. The mean self-reported competency scores (PBDI) were higher than the observed competencies (SIM): 3.7(SD 0.5) and 2.9(SD 0.6), respectively. Content-related competencies showed low correlations with one another when measured with different instruments, whereas more diverse competencies measured by a single instrument showed strong to moderate correlations. Moreover, a moderate correlation between LHK and SJT was found. The internal consistencies (intraclass correlation, ICC) of LHK and SJT were poor while the ICC of PBDI and SIM showed acceptable levels of reliability. Findings on content validity and reliability of these new instruments are promising to realize a competency based procedure. Further development of the instruments and research on predictive validity should be pursued.

Measuring teamwork and conflict among emergency medical technician personnel.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Weaver, Sallie J; Rosen, Michael A; Todorova, Gergana; Weingart, Laurie R; Krackhardt, David; Lave, Judith R; Arnold, Robert M; Yealy, Donald M; Salas, Eduardo

2012-01-01

We sought to develop a reliable and valid tool for measuring teamwork among emergency medical technician (EMT) partnerships. We adapted existing scales and developed new items to measure components of teamwork. After recruiting a convenience sample of 39 agencies, we tested a 122-item draft survey tool (EMT-TEAMWORK). We performed a series of exploratory factor analyses (EFAs) and confirmatory factor analysis (CFA) to test reliability and construct validity, describing variation in domain and global scores using descriptive statistics. We received 687 completed surveys. The EFAs identified a nine-factor solution. We labeled these factors 1) Team Orientation, 2) Team Structure & Leadership, 3) Partner Communication, Team Support, & Monitoring, 4) Partner Trust and Shared Mental Models, 5) Partner Adaptability & Back-Up Behavior, 6) Process Conflict, 7) Strong Task Conflict, 8) Mild Task Conflict, and 9) Interpersonal Conflict. We tested a short-form (30-item SF) and long-form (45-item LF) version. The CFAs determined that both the SF and the LF possess positive psychometric properties of reliability and construct validity. The EMT-TEAMWORK-SF has positive internal consistency properties, with a mean Cronbach's alpha coefficient ≥0.70 across all nine factors (mean = 0.84; minimum = 0.78, maximum = 0.94). The mean Cronbach's alpha coefficient for the EMT-TEAMWORK-LF was 0.87 (minimum = 0.79, maximum = 0.94). There was wide variation in weighted scores across all nine factors and the global score for the SF and LF. Mean scores were lowest for the Team Orientation factor (48.1, standard deviation [SD] 21.5, SF; 49.3, SD 19.8, LF) and highest (more positive) for the Interpersonal Conflict factor (87.7, SD 18.1, for both SF and LF). We developed a reliable and valid survey to evaluate teamwork between EMT partners.

The Self-Stigma of Depression Scale: Translation and Validation of the Arabic Version

PubMed Central

Darraj, Hussain Ahmed; Mahfouz, Mohamed Salih; Al Sanosi, Rashad Mohamed; Badedi, Mohammed; Sabai, Abdullah

2017-01-01

Background: Self-stigma may feature strongly and be detrimental for people with depression, but the understanding of its nature and prevalence is limited by the lack of psychometrically validated measures. This study is aimed to validate the Arabic version self-stigma of depression scale (SSDS) among adolescents. Materials and Methods: A cross-sectional study involved 100 adolescents randomly selected. The analyses include face validation, factor analysis, and reliability testing. A test–retest was conducted within a 2-week interval. Results: The mean score for self-stigma of depression among study participants was 68.9 (Standard deviation = 8.76) median equal to 71 and range was 47. Descriptive analysis showed that the percentage of those who scored below the mean score (41.7%) is shown less than those who scored above the mean score (58.3%). Preliminary construct validation analysis confirmed that factor analysis was appropriate for the Arabic-translated version of the SSDS. Furthermore, the factor analysis showed similar factor loadings to the original English version. The total internal consistency of the translated version, which was measured by Cronbach's alphas ranged from 0.70 to 0.77 for the four subscales and 0.84 for the total scale. Test–retest reliability was assessed in 65 respondents after 2 weeks. Cronbach's alphas ranged from 0.70 to 0.77 for the four subscales and 0.84 for the total scale. Conclusions: Face validity, construct validity, and reliability analysis were found satisfactory for the Arabic-translated version of the SSDS. The Arabic-translated version of the SSDS was found valid and reliable to be used in future studies, with comparable properties to the original version and to previous studies. PMID:28149090

Reliability and acceptability of the Multiple Sclerosis Quality of Life-29 questionnaire in an English-speaking cohort.

PubMed

Baker, Georgina; Nair, Krishnan Padmakumari Sivaraman; Baster, Kathleen; Rosato, Rosalba; Solari, Alessandra

2018-05-01

Multiple Sclerosis Quality-of-Life Questionnaire-54 (MSQoL-54) is a disease-specific instrument for assessing health-related quality of life (HRQoL). Due to the number of items, the time taken to complete it is long. A shorter 29-item version, Multiple Sclerosis Quality-of-Life Questionnaire-29 (MSQoL-29) is yet to be evaluated in English. To assess reliability and acceptability of English version of MSQoL-29. Among 100 participants with MS who first completed both MSQoL-54 and MSQoL-29, 91 completed MSQoL-29 after 4-8 weeks. We looked for internal consistency (Cronbach's alpha), acceptability, reliability (intraclass correlation coefficients (ICCs)) and agreement (Bland-Altman plots). ICCs were strongly positive between MSQoL-54 and MSQoL-29 (Physical Health Composite (PHC) -ICC = 0.914, confidence interval (CI) = 0.872-0.942; Mental Health Composite (MHC) - ICC = 0.875, CI = 0.814-0.916) and between the two MSQoL-29 (PHC - ICC = 0.970, CI = 0.955-0.980; MHC - ICC = 0.937, CI = 0.904-0.958). On Bland-Altman plots, the MSQoL-29 scores of 95% of participants during two visits were within the limits of agreement (LOAs). Time taken to complete MSQoL-29 was 7.2 ± 2.9 minutes and MSQoL-54 was 19.79 ± 5.4 minutes ( p = 0.0001). MSQoL-29 has good test-retest reliability in English-speaking population and was quicker to complete.