The Author’s Guide To Writing 412th Test Wing Technical Reports

DTIC Science & Technology

2014-12-01

control CAD computer aided design cc cubic centimeters C.O. carry-over c/o checkout USAF United States Air Force C1 rolling moment coefficient...cooling air. Mission Impact: Results in maintenance inability to reliably duplicate and isolate valid aircraft failures, and degrades reliability...air. Mission Impact: Results in maintenance inability to reliably duplicate and isolate valid aircraft failures, and degrades reliability of system

Response of thermocouples interfaced to electrothermometers when immersed in 5 water bath temperatures.

PubMed

Long, Blaine C; Jutte, Lisa S; Knight, Kenneth L

2010-01-01

Thermocouples and electrothermometers are used in therapeutic modality research. Until recently, researchers assumed that these instruments were valid and reliable. To examine 3 different thermocouple types in 5 degrees C, 15 degrees C, 18.4 degrees C, 25 degrees C, and 35 degrees C water baths. Randomized controlled trial. Therapeutic modality laboratory. Eighteen thermocouple leads were inserted through the wall of a foamed polystyrene cooler. The cooler was filled with water. Six thermocouples (2 of each model) were plugged into the 6 channels of the Datalogger and 6 randomly selected channels in the 2 Iso-Thermexes. A mercury thermometer was immersed into the water and was read every 10 seconds for 4 minutes during each of 6 trials. The entire process was repeated for each of 5 water bath temperatures (5 degrees C, 15 degrees C, 18.4 degrees C, 25 degrees C, 35 degrees C). Temperature and absolute temperature differences among 3 thermocouple types (IT-21, IT-18, PT-6) and 3 electrothermometers (Datalogger, Iso-Thermex calibrated from -50 degrees C to 50 degrees C, Iso-Thermex calibrated from -20 degrees C to 80 degrees C). Validity and reliability were dependent on thermocouple type, electrothermometer, and water bath temperature (P < .001; modified Levene P < .05). Statistically, the IT-18 and PT-6 thermocouples were not reliable in each electrothermometer; however, these differences were not practically different from each other. The PT-6 thermocouples were more valid than the IT-18s, and both thermocouple types were more valid than the IT-21s, regardless of water bath temperature (P < .001). The validity and reliability of thermocouples interfaced to an electrothermometer under experimental conditions should be tested before data collection. We also recommend that investigators report the validity, the reliability, and the calculated uncertainty (validity + reliability) of their temperature measurements for therapeutic modalities research. With this information, investigators and clinicians will be better able to interpret and compare results and conclusions.

Examining the Reliability and Validity of the "Supports Intensity Scale-Children's Version" in Children with Autism and Intellectual Disability

ERIC Educational Resources Information Center

Shogren, Karrie A.; Wehmeyer, Michael L.; Seo, Hyojeong; Thompson, James R.; Schalock, Robert L.; Hughes, Carolyn; Little, Todd D.; Palmer, Susan B.

2017-01-01

This study compared the reliability, validity, and measurement properties of the "Supports Intensity Scale-Children's Version" (SIS-C) in children with autism and intellectual disability (n = 2,124) and children with intellectual disability only (n = 1,861). The results suggest that SIS-C is a valid and reliable tool in both populations.…

Validity and reliability of temperature measurement by heat flow thermistors, flexible thermocouple probes and thermistors in a stirred water bath.

PubMed

Versey, Nathan G; Gore, Christopher J; Halson, Shona L; Plowman, Jamie S; Dawson, Brian T

2011-09-01

We determined the validity and reliability of heat flow thermistors, flexible thermocouple probes and general purpose thermistors compared with a calibrated reference thermometer in a stirred water bath. Validity (bias) was defined as the difference between the observed and criterion values, and reliability as the repeatability (standard deviation or typical error) of measurement. Data were logged every 5 s for 10 min at water temperatures of 14, 26 and 38 °C for ten heat flow thermistors and 24 general purpose thermistors, and at 35, 38 and 41 °C for eight flexible thermocouple probes. Statistical analyses were conducted using spreadsheets for validity and reliability, where an acceptable bias was set at ±0.1 °C. None of the heat flow thermistors, 17% of the flexible thermocouple probes and 71% of the general purpose thermistors met the validity criterion for temperature. The inter-probe reliabilities were 0.03 °C for heat flow thermistors, 0.04 °C for flexible thermocouple probes and 0.09 °C for general purpose thermistors. The within trial intra-probe reliability of all three temperature probes was 0.01 °C. The results suggest that these temperature sensors should be calibrated individually before use at relevant temperatures and the raw data corrected using individual linear regression equations.

Validity and reliability of the semi-quantitative self-report Home Food Availability Inventory Checklist (HFAI-C) in White and South Asian populations.

PubMed

Bryant, Maria; LeCroy, Madison; Sahota, Pinki; Cai, Jianwen; Stevens, June

2016-05-04

Despite interest in the importance of the home food environment and its potential influence on children's diets and social norms, there remain few self-report checklist methods that have been validated against the gold standard of researcher-conducted inventories. This study aimed to assess the criterion validity and reliability of the 'Home Food Availability Inventory Checklist' (HFAI-C), a 39-item checklist including categories of fruit, vegetables, snacks and drinks. The HFAI-C was completed by 97 participants of White and Pakistani origin in the UK. Validity was determined by comparing participant-reported HFAI-C responses to data from researcher observations of home food availability using PABAK and weighted kappa statistics. The validity of measuring the amount of items (in addition to presence/absence) available was also determined. Test-retest reliability compared repeated administrations of the HFAI-C using intra-class correlation coefficients. Validity and reliability was fair to moderate overall. For validity, the average category-level PABAK ranged from 0.31 (95% CI: 0.25, 0.37) for vegetables to 0.44 (95% CI: 0.40, 0.49) for fruits. Assessment of the presence/absence of items demonstrated higher validity compared to quantity measurements. Reliability was increased when the HFAI-C was repeated close to the time of the first administration. For example, ICCs for reliability of the measurement of fruits were 0.52 (95%CI: 0.47, 0.56) if re-administered within 5 months, 0.58 (95% CI: 0.51, 0.64) within 30 days and 0.97 (95%CI: 0.94, 1.00) if re-administered on the same day. Overall, the HFAI-C demonstrated fair to moderate validity and reliability in a population of White and South Asian participants. This evaluation is consistent with previous work on other checklists in less diverse, more affluent populations. Our research supports the use of the HFAI-C as a useful, albeit imperfect, representation of researcher-conducted inventories. The feasibility of collecting information using the HFAI-C in large, multi-ethnic samples can facilitate examination of home food availability in relation to exposures such as ethnicity and outcomes including behavioural, social and health outcomes. Future work using the HFAI-C could provide important insights into a modifiable influence with potential to impact health.

Validation of the Physical Activity Questionnaire for Older Children (PAQ-C) among Chinese Children.

PubMed

Wang, Jing Jing; Baranowski, Tom; Lau, Wc Patrick; Chen, Tzu An; Pitkethly, Amanda Jane

2016-03-01

This study initially validates the Chinese version of the Physical Activity Questionnaire for Older Children (PAQ-C), which has been identified as a potentially valid instrument to assess moderate-to-vigorous physical activity (MVPA) in children among diverse racial groups. The psychometric properties of the PAQ-C with 742 Hong Kong Chinese children were assessed with the scale's internal consistency, reliability, test-retest reliability, confirmatory factory analysis (CFA) in the overall sample, and multistep invariance tests across gender groups as well as convergent validity with body mass index (BMI), and an accelerometry-based MVPA. The Cronbach alpha coefficient (α=0.79), composite reliability value (ρ=0.81), and the intraclass correlation coefficient (α=0.82) indicate the satisfactory reliability of the PAQ-C score. The CFA indicated data fit a single factor model, suggesting that the PAQ-C measures only one construct, on MVPA over the previous 7 days. The multiple-group CFAs suggested that the factor loadings and variances and covariances of the PAQ-C measurement model were invariant across gender groups. The PAQ-C score was related to accelerometry-based MVPA (r=0.33) and inversely related to BMI (r=-0.18). This study demonstrates the reliability and validity of the PAQ-C in Chinese children. Copyright © 2016 The Editorial Board of Biomedical and Environmental Sciences. Published by China CDC. All rights reserved.

An appraisal of the psychometric properties of the Clinician version of the Apathy Evaluation Scale (AES-C).

PubMed

Clarke, Diana E; Van Reekum, Robert; Patel, Jigisha; Simard, Martine; Gomez, Everlyne; Streiner, David L

2007-01-01

This article examines the psychometric properties of the clinician version of the Apathy Evaluation Scale (AES-C) to determine its ability to characterize, quantify and differentiate apathy. Critical appraisals of the item-reduction processes, effectiveness of the administration, coding and scoring procedures, and the reliability and validity of the scale were carried out. For training, administration and rating of the AES-C, clearer guidelines, including a more standardized list of verbal and non-verbal apathetic cues, are needed. There is evidence of high internal consistency for the scale across studies. In addition, the original study reported good test-retest and inter-rater reliability coefficients. However, there is a lack of replication on these more stable and informative measures of reliability and as such they warrant further investigation. The research evidence confirms that the AES-C shows good discriminant, convergent and criterion validity. However, evidence of its predictive validity is limited. As this aspect of validity refers to the scale's ability to predict future outcomes, which is important for treatment and rehabilitation planning, further assessment of the predictive validity of the AES-C is needed. In conclusion, the AES-C is a reliable and valid measure for the characterization and quantification of apathy. Copyright (c) 2007 John Wiley & Sons, Ltd.

Validation of the Pain Resilience Scale in Chinese-speaking patients with temporomandibular disorders pain.

PubMed

He, S L; Wang, J H; Ji, P

2018-03-01

To validate the Pain Resilience Scale (PRS) for use in Chinese patients with temporomandibular disorders (TMD) pain. According to international guidelines, the original PRS was first translated and cross-culturally adapted to formulate the Chinese version of PRS (PRS-C). A total of 152 patients with TMD pain were recruited to complete series of questionnaires. Reliability of the PRS-C was investigated using internal consistency and test-retest reliability. Validity of the PRS-C was calculated using cross-cultural validity and convergent validity. Cross-cultural validity was evaluated by examining the confirmatory factor analysis (CFA). And convergent validity was examined through correlating the PRS-C scores with scores of 2 commonly used pain-related measures (the Connor-Davidson Resilience Scale [CD-RISC] and the Tampa Scale for Kinesiophobia for Temporomandibular Disorders [TSK-TMD]). The PRS-C had a high internal consistency (Cronbach's alpha = 0.92) and good test-retest reliability (intra-class correlation coefficient [ICC] = 0.81). The CFA supported a 2-factor model for the PRS-C with acceptable fit to the data. The fit indices were chi-square/DF = 2.21, GFI = 0.91, TLI = 0.97, CFI = 0.98 and RMSEA = 0.08. As regards convergent validity, the PRS-C evidenced moderate-to-good relationships with the CD-RISC and the TSK-TMD. The PRS-C shows good psychometric properties and could be considered as a reliable and valid measure to evaluate pain-related resilience in patients with TMD pain. © 2017 John Wiley & Sons Ltd.

Effect of individual shades on reliability and validity of observers in colour matching.

PubMed

Lagouvardos, P E; Diamanti, H; Polyzois, G

2004-06-01

The effect of individual shades in shade guides, on the reliability and validity of measurements in a colour matching process is very important. Observer's agreement on shades and sensitivity/specificity of shades, can give us an estimate of shade's effect on observer's reliability and validity. In the present study, a group of 16 students, matched 15 shades of a Kulzer's guide and 10 human incisors to Kulzer's and/or Vita's shade tabs, in 4 different tests. The results showed shades I, B10, C40, A35 and A10 were those with the highest reliability and validity values. In conclusion, a) the matching process with shades of different materials was not accurate enough, b) some shades produce a more reliable and valid match than others and c) teeth are matched with relative difficulty.

A Chinese version of the City of Hope Quality of Life-Ostomy Questionnaire: validity and reliability assessment.

PubMed

Gao, Wenjun; Yuan, Changrong; Wang, Jichuan; Du, Jiarui; Wu, Huiqiao; Qian, Xiaojie; Hinds, Pamela S

2013-01-01

The City of Hope Quality of Life-Ostomy Questionnaire is a widely accepted scale to assess quality of life in ostomy patients. However, the validity and reliability of the Chinese version (C-COH) have not been studied. The objective of the study was to assess the validity and reliability of the C-COH among ostomy patients sampled from Shanghai from August 2010 to June 2011. Content validity was examined based on the reviews of a panel of 10 experts; test-retest was conducted to assess the item reliabilities of the scale; a pilot sample (n = 274) was selected to explore the factorial structure of the C-COH using exploratory factor analysis; a validation sample (n = 370) was selected to confirm the findings from the exploratory study using confirmatory factor analysis (CFA). Statistical package SPSS version 16.0 was used for the exploratory factor analysis, and Amos 17.0 was used for the CFA. The C-COH was developed by modifying 1 item and excluding 11 items from the original scale. Four factors/subscales (physical well-being, psychological well-being, social well-being, and spiritual well-being) were identified and confirmed in the C-COH The scale reliabilities estimated from the CFA results for the 4 subscales were 0.860, 0.885, 0.864, and 0.686, respectively. Findings support the reliability and validity of the C-COH. The C-COH could be a useful measure of the level of quality of life among Chinese patients with a stoma and may provide important intervention implications for healthcare providers to help improve the life quality of patients with a stoma.

Reliability and Validity of the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A).

PubMed

Bervoets, Liene; Van Noten, Caroline; Van Roosbroeck, Sofie; Hansen, Dominique; Van Hoorenbeeck, Kim; Verheyen, Els; Van Hal, Guido; Vankerckhoven, Vanessa

2014-01-01

This study was designed to validate the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A). After adjustment of the original Canadian PAQ-C and PAQ-A (i.e. translation/back-translation and evaluation by expert committee), content validity of both PAQs was assessed and calculated using item-level (I-CVI) and scale-level (S-CVI) content validity indexes. Inter-item and inter-rater reliability of 196 PAQ-C and 95 PAQ-A filled in by both children or adolescents and their parent, were evaluated. Inter-item reliability was calculated by Cronbach's alpha (α) and inter-rater reliability was examined by percent observed agreement and weighted kappa (κ). Concurrent validity of PAQ-A was examined in a subsample of 28 obese and 16 normal-weight children by comparing it with concurrently measured physical activity using a maximal cardiopulmonary exercise test for the assessment of peak oxygen uptake (VO2 peak). For both PAQs, I-CVI ranged 0.67-1.00. S-CVI was 0.89 for PAQ-C and 0.90 for PAQ-A. A total of 192 PAQ-C and 94 PAQ-A were fully completed by both child and parent. Cronbach's α was 0.777 for PAQ-C and 0.758 for PAQ-A. Percent agreement ranged 59.9-74.0% for PAQ-C and 51.1-77.7% for PAQ-A, and weighted κ ranged 0.48-0.69 for PAQ-C and 0.51-0.68 for PAQ-A. The correlation between total PAQ-A score and VO2 peak - corrected for age, gender, height and weight - was 0.516 (p = 0.001). Both PAQs have an excellent content validity, an acceptable inter-item reliability and a moderate to good strength of inter-rater agreement. In addition, total PAQ-A score showed a moderate positive correlation with VO2 peak. Both PAQs have an acceptable to good reliability and validity, however, further validity testing is recommended to provide a more complete assessment of both PAQs.

Reliability and Validity of the PAQ-C Questionnaire to Assess Physical Activity in Children

ERIC Educational Resources Information Center

Benítez-Porres, Javier; López-Fernández, Iván; Raya, Juan Francisco; Álvarez Carnero, Sabrina; Alvero-Cruz, José Ramón; Álvarez Carnero, Elvis

2016-01-01

Background: Physical activity (PA) assessment by questionnaire is a cornerstone in the field of sport epidemiology studies. The Physical Activity Questionnaire for Children (PAQ-C) has been used widely to assess PA in healthy school populations. The aim of this study was to evaluate the reliability and validity of the PAQ-C questionnaire in…

Validation study of a Chinese version of Partners in Health in Hong Kong (C-PIH HK).

PubMed

Chiu, Teresa Mei Lee; Tam, Katharine Tai Wo; Siu, Choi Fong; Chau, Phyllis Wai Ping; Battersby, Malcolm

2017-01-01

The Partners in Health (PIH) scale is a measure designed to assess the generic knowledge, attitudes, behaviors, and impacts of self-management. A cross-cultural adaptation of the PIH for use in Hong Kong was evaluated in this study. This paper reports the validity and reliability of the Chinese version of PIH (C-PIH[HK]). A 12-item PIH was translated using forward-backward translation technique and reviewed by individuals with chronic diseases and health professionals. A total of 209 individuals with chronic diseases completed the scale. The construct validity, internal consistency, and test-retest reliability were evaluated in two waves. The findings in Wave 1 (n = 73) provided acceptable psychometric properties of the C-PIH(HK) but supported the adaptation of question 5 to improve the cultural relevance, validity, and reliability of the scale. An adapted version of C-PIH(HK) was evaluated in Wave 2. The findings in Wave 2 (n = 136) demonstrated good construct validity and internal consistency of C-PIH(HK). A principal component analysis with Oblimin rotation yielded a 3-factor solution, and the Cronbach's alphas of the subscales ranged from 0.773 to 0.845. Participants were asked whether they perceived the self-management workshops they attended and education provided by health professionals as useful or not. The results showed that the C-PIH(HK) was able to discriminate those who agreed and those who disagreed related to the usefulness of individual health education (p < 0.0001 in all subscales) and workshops (p < 0.001 in the knowledge subscale) as hypothesized. The test-retest reliability was high (ICC = 0.818). A culturally adapted version of PIH for use in Hong Kong was evaluated. The study supported good construct validity, discriminate validity, internal consistency, and test-retest reliability of the C-PIH(HK).

Reliability, factor structure, and validity of the German version of the Trauma Symptom Checklist for Children in a sample of adolescents

PubMed Central

Matulis, Simone; Loos, Laura; Langguth, Nadine; Schreiber, Franziska; Gutermann, Jana; Gawrilow, Caterina; Steil, Regina

2015-01-01

Background The Trauma Symptom Checklist for Children (TSC-C) is the most widely used self-report scale to assess trauma-related symptoms in children and adolescents on six clinical scales. The purpose of the present study was to develop a German version of the TSC-C and to investigate its psychometric properties, such as factor structure, reliability, and validity, in a sample of German adolescents. Method A normative sample of N=583 and a clinical sample of N=41 adolescents with a history of physical or sexual abuse aged between 13 and 21 years participated in the study. Results The Confirmatory Factor Analysis on the six-factor model (anger, anxiety, depression, dissociation, posttraumatic stress, and sexual concerns with the subdimensions preoccupation and distress) revealed acceptable to good fit statistics in the normative sample. One item had to be excluded from the German version of the TSC-C because the factor loading was too low. All clinical scales presented acceptable to good reliability, with Cronbach's α's ranging from .80 to .86 in the normative sample and from .72 to .87 in the clinical sample. Concurrent validity was also demonstrated by the high correlations between the TSC-C scales and instruments measuring similar psychopathology. TSC-C scores reliably differentiated between adolescents with trauma history and those without trauma history, indicating discriminative validity. Conclusions In conclusion, the German version of the TSC-C is a reliable and valid instrument for assessing trauma-related symptoms on six different scales in adolescents aged between 13 and 21 years. PMID:26498182

Reliability, factor structure, and validity of the German version of the Trauma Symptom Checklist for Children in a sample of adolescents.

PubMed

Matulis, Simone; Loos, Laura; Langguth, Nadine; Schreiber, Franziska; Gutermann, Jana; Gawrilow, Caterina; Steil, Regina

2015-01-01

The Trauma Symptom Checklist for Children (TSC-C) is the most widely used self-report scale to assess trauma-related symptoms in children and adolescents on six clinical scales. The purpose of the present study was to develop a German version of the TSC-C and to investigate its psychometric properties, such as factor structure, reliability, and validity, in a sample of German adolescents. A normative sample of N=583 and a clinical sample of N=41 adolescents with a history of physical or sexual abuse aged between 13 and 21 years participated in the study. The Confirmatory Factor Analysis on the six-factor model (anger, anxiety, depression, dissociation, posttraumatic stress, and sexual concerns with the subdimensions preoccupation and distress) revealed acceptable to good fit statistics in the normative sample. One item had to be excluded from the German version of the TSC-C because the factor loading was too low. All clinical scales presented acceptable to good reliability, with Cronbach's α's ranging from .80 to .86 in the normative sample and from .72 to .87 in the clinical sample. Concurrent validity was also demonstrated by the high correlations between the TSC-C scales and instruments measuring similar psychopathology. TSC-C scores reliably differentiated between adolescents with trauma history and those without trauma history, indicating discriminative validity. In conclusion, the German version of the TSC-C is a reliable and valid instrument for assessing trauma-related symptoms on six different scales in adolescents aged between 13 and 21 years.

Assessing the reliability and validity of the Chinese Sexual Assault Symptom Scale (C-SASS): scale development and validation.

PubMed

Wang, Chang-Hwai; Lee, Jin-Chuan; Yuan, Yu-Hsi

2014-01-01

The purpose of this research is to establish and verify the psychometric and structural properties of the self-report Chinese Sexual Assault Symptom Scale (C-SASS) to assess the trauma experienced by Chinese victims of sexual assault. An earlier version of the C-SASS was constructed using a modified list of the same trauma symptoms administered to an American sample and used to develop and validate the Sexual Assault Symptom Scale II (SASS II). The rationale of this study is to revise the earlier version of the C-SASS, using a larger and more representative sample and more robust statistical analysis than in earlier research, to permit a more thorough examination of the instrument and further confirm the dimensions of sexual assault trauma in Chinese victims of rape. In this study, a sample of 418 victims from northern Taiwan was collected to confirm the reliability and validity of the C-SASS. Exploratory factor analysis yielded five common factors: Safety Fears, Self-Blame, Health Fears, Anger and Emotional Lability, and Fears About the Criminal Justice System. Further tests of the validity and composite reliability of the C-SASS were provided by the structural equation modeling (SEM). The results indicated that the C-SASS was a brief, valid, and reliable instrument for assessing sexual assault trauma among Chinese victims in Taiwan. The scale can be used to evaluate victims in sexual assault treatment centers around Taiwan, as well as to capture the characteristics of sexual assault trauma among Chinese victims.

Decisional balance and processes of change in community-recruited with moderate-high versus mild severity of cannabis dependence

PubMed Central

2017-01-01

Decisional Balance and Processes of Change are generally addressed in motivational interventions for the treatment of cannabis use disorders. However, specific aspects of these multifaceted constructs, with greater relevance for severe cannabis users, need to be ascertained to enable better interventions. This study aimed to compare the different facets of decisional balance and processes of change between mild and severe cannabis users in a community-based sample of young undergraduates. Thirty-one severe cannabis users and 31 mild cannabis users, indicated with the Severity of Dependence Scale, were assessed using the Decisional Balance Questionnaire (DBQ) and the Processes of Change Questionnaire (PCQ). We found that severe cannabis users had higher scores in the DBQ dimensions of Utilitarian Gains for the Self, Utilitarian Gains for Significant Others, and Self-approval, as well as in the total subscale of Gains but not Losses. The group of severe cannabis users also had higher scores in the PCQ dimensions of Self-revaluations and Counter-conditioning. Our results pinpoint specific dimensions of Decisional Balance and Processes of Change that are endorsed by severe cannabis users. This knowledge could be applied to inform motivational interventions targeting severe cannabis users. PMID:29206230

Validity and Reliability of Internalized Stigma of Mental Illness (Cantonese)

ERIC Educational Resources Information Center

Young, Daniel Kim-Wan; Ng, Petrus Y. N.; Pan, Jia-Yan; Cheng, Daphne

2017-01-01

Purpose: This study aims to translate and test the reliability and validity of the Internalized Stigma of Mental Illness-Cantonese (ISMI-C). Methods: The original English version of ISMI is translated into the ISMI-C by going through forward and backward translation procedure. A cross-sectional research design is adopted that involved 295…

Reliability and relative validity of three physical activity questionnaires in Taizhou population of China: the Taizhou Longitudinal Study.

PubMed

Hu, B; Lin, L F; Zhuang, M Q; Yuan, Z Y; Li, S Y; Yang, Y J; Lu, M; Yu, S Z; Jin, L; Ye, W M; Wang, X F

2015-09-01

To examine the test-retest reliabilities and relative validities of the Chinese version of short International Physical Activity Questionnaire (IPAQ-S-C), the Global Physical Activity Questionnaire (GPAQ-C), and the Total Energy Expenditure Questionnaire (TEEQ-C) in a population-based prospective study, the Taizhou Longitudinal Study (TZLS). A longitudinal comparative study. A total of 205 participants (male: 38.54%) aged 30-70 years completed three questionnaires twice (day one and day nine) and physical activity log (PA-log) over seven consecutive days. The test-retest reliabilities were evaluated using intra-class correlation coefficients (ICCs) and the relative validities were estimated by comparing the data from physical activity questionnaires (PAQs) and PA-log. Good reliabilities were observed between the repeated PAQs. The ICCs ranged from 0.51 to 0.80 for IPAQ-C, 0.67 to 0.85 for GPAQ-C, and 0.74 to 0.94 for TEEQ-C, respectively. Energy expenditure of most PA domains estimated by the three PAQs correlated moderately with the results recorded by PA-log except the walking domain of IPAQ-S-C. The partial correlation coefficients between the PAQs and PA-log ranged from 0.44 to 0.58 for IPAQ-S-C, 0.26 to 0.52 for GPAQ-C, and 0.41 to 0.72 for TEEQ-C, respectively. Bland-Altman plots showed acceptable agreement between the three PAQs and PA-log. The three PAQs, especially TEEQ-C, were relatively reliable and valid for assessment of physical activity and could be used in TZLS. Copyright © 2015 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Translation, Cross Cultural Adaptation and Validation of the Lee Chronic Graft-versus-Host Disease (GVHD) Symptom Scale in a Brazilian Population

PubMed Central

de Souza, Clarissa Vasconcellos; Vigorito, Afonso Celso; Miranda, Eliana C M; Garcia, Celso; Colturato, Vergílio Antonio Rensi; Mauad, Marcos Augusto; Moreira, Maria Cláudia Rodrigues; da Silva Bouzas, Luis Fernando; Lermontov, Simone; Hamerschlak, Nelson; Rodrigues, Morgani; de Almeida Barros, Jose Carlos; Chiattone, Ricardo; Lee, Stephanie J; Flowers, Mary ED

2017-01-01

The Lee chronic graft-versus-disease (cGVHD) Symptom Scale is a patient-reported instrument developed and validated in English to measure symptoms and functional impact of cGVHD. This tool has not been validated in a Latin America population. The Brazil-Seattle Chronic GVHD Consortium conducted a multicenter study at five Brazilian institutions to validate the Lee cGVHD Symptom Scale in adults with chronic GVHD. Study objectives included the translation and validation of the instrument in Brazilian Portuguese and evaluation of the correlation with other quality of life (QoL) tools (i.e., Medical Outcomes Study Short Form 36 [SF-36] and the Functional Assessment of Chronic Illness Therapy with Bone Marrow Transplant subscale [FACT-BMT]). Translation and validation were according to the American Association of Orthopedic Surgeons Outcome Committee guideline. Spearman’s correlation coefficient was used to measure construct validity. Reliability was assessed using Cronbach’s alpha and intraclass correlation coefficients. Between April 2011 and August 2012, 47 patients with cGVHD by the 2005 NIH criteria were enrolled in this study. Cohort median age was 48 (23–69) years and 29 (62%) were male. Lee cGVHD Symptom Scale reliability was adequate (Cronbach’s alpha 0.62–0.83). The correlations between similar domains of the Lee cGVHD Symptom Scale, SF-36 and FACT-BMT were moderate to high. The Brazilian Portuguese version of the Lee cGVHD Symptom Scale is valid and reliable and can be used in clinical trials of cGVHD in Brazil. PMID:27058616

Psychometric Testing of the Chinese-Version Glover-Nilsson Smoking Behavioral Questionnaire (GN-SBQ-C) for the Identification of Nicotine Dependence in Adult Smokers in Taiwan.

PubMed

Chen, Shu-Ching; Chen, Hsiu-Fang; Peng, Hsi-Ling; Lee, Li-Yun; Chiang, Ting-Yu; Chiu, Hui-Chuan

2017-04-01

The purposes of this study were to evaluate the psychometric properties, reliability, and validity of the Chinese-version Glover-Nilsson Smoking Behavioral Questionnaire (GN-SBQ-C) and assess the behavioral nicotine dependence among community-dwelling adult smokers in Taiwan. The methods used were survey design, administration, and validation. A total of 202 adult smokers completed a survey to assess behavioral dependence, nicotine dependence, depression, social support, and demographic and smoking characteristics. Data analysis included descriptive statistics, internal consistency reliability, t test, exploratory factor analysis, independent t test, and Pearson product moment correlation. The results showed that (1) the GN-SBQ-C has good internal consistency reliability and stability (2-week test-retest reliability); (2) the extracted one factor explained 41.80 % of the variance, indicating construct validity; (3) the scale has acceptable concurrent validity, with significant positive correlation between the GN-SBQ-C and nicotine dependence, depression, and time smoking and negative correlation between the GN-SBQ-C and age and exercise habit; and (4) the instrument has discriminant validity, supported by significant differences between those with high and low-to-moderate nicotine dependence, smokers greater than 43 years old and those 43 years old and younger, and those who smoked 10 years or less and those smoking more than 10 years. The 11-item GN-SBQ-C has satisfactory psychometric properties when applied in a sample of Taiwanese adult smokers. The scale is feasible and valid to use to assess smoking behavioral dependence.

Reliability and Validity of Finger Strength and Endurance Measurements in Rock Climbing

ERIC Educational Resources Information Center

Michailov, Michail Lubomirov; Baláš, Jirí; Tanev, Stoyan Kolev; Andonov, Hristo Stoyanov; Kodejška, Jan; Brown, Lee

2018-01-01

Purpose: An advanced system for the assessment of climbing-specific performance was developed and used to: (a) investigate the effect of arm fixation (AF) on construct validity evidence and reliability of climbing-specific finger-strength measurement; (b) assess reliability of finger-strength and endurance measurements; and (c) evaluate the…

Eating Disorder Diagnostic Scale: Additional Evidence of Reliability and Validity

ERIC Educational Resources Information Center

Stice, Eric; Fisher, Melissa; Martinez, Erin

2004-01-01

The authors conducted 4 studies investigating the reliability and validity of the Eating Disorder Diagnostic Scale (HDDS; E. Stice, C. F. Telch, & S. L. Rizvi, 2000), a brief self-report measure for diagnosing anorexia nervosa, bulimia nervosa, and binge eating disorder. Study 1 found that the HDDS showed criterion validity with interview-based…

Validity of the posttraumatic stress disorders (PTSD) checklist in pregnant women.

PubMed

Gelaye, Bizu; Zheng, Yinnan; Medina-Mora, Maria Elena; Rondon, Marta B; Sánchez, Sixto E; Williams, Michelle A

2017-05-12

The PTSD Checklist-civilian (PCL-C) is one of the most commonly used self-report measures of PTSD symptoms, however, little is known about its validity when used in pregnancy. This study aims to evaluate the reliability and validity of the PCL-C as a screen for detecting PTSD symptoms among pregnant women. A total of 3372 pregnant women who attended their first prenatal care visit in Lima, Peru participated in the study. We assessed the reliability of the PCL-C items using Cronbach's alpha. Criterion validity and performance characteristics of PCL-C were assessed against an independent, blinded Clinician-Administered PTSD Scale (CAPS) interview using measures of sensitivity, specificity and receiver operating characteristics (ROC) curves. We tested construct validity using exploratory and confirmatory factor analytic approaches. The reliability of the PCL-C was excellent (Cronbach's alpha =0.90). ROC analysis showed that a cut-off score of 26 offered optimal discriminatory power, with a sensitivity of 0.86 (95% CI: 0.78-0.92) and a specificity of 0.63 (95% CI: 0.62-0.65). The area under the ROC curve was 0.75 (95% CI: 0.71-0.78). A three-factor solution was extracted using exploratory factor analysis and was further complemented with three other models using confirmatory factor analysis (CFA). In a CFA, a three-factor model based on DSM-IV symptom structure had reasonable fit statistics with comparative fit index of 0.86 and root mean square error of approximation of 0.09. The Spanish-language version of the PCL-C may be used as a screening tool for pregnant women. The PCL-C has good reliability, criterion validity and factorial validity. The optimal cut-off score obtained by maximizing the sensitivity and specificity should be considered cautiously; women who screened positive may require further investigation to confirm PTSD diagnosis.

Reliability and Validity of the Korean Version of the Cancer Stigma Scale.

PubMed

So, Hyang Sook; Chae, Myeong Jeong; Kim, Hye Young

2017-02-01

In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (χ²/df)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients. © 2017 Korean Society of Nursing Science

Reliability and Validity of the PAQ-C Questionnaire to Assess Physical Activity in Children.

PubMed

Benítez-Porres, Javier; López-Fernández, Iván; Raya, Juan Francisco; Álvarez Carnero, Sabrina; Alvero-Cruz, José Ramón; Álvarez Carnero, Elvis

2016-09-01

Physical activity (PA) assessment by questionnaire is a cornerstone in the field of sport epidemiology studies. The Physical Activity Questionnaire for Children (PAQ-C) has been used widely to assess PA in healthy school populations. The aim of this study was to evaluate the reliability and validity of the PAQ-C questionnaire in Spanish children using triaxial accelerometry as criterion. Eighty-three (N = 46 boys, N = 37 girls) healthy children (age 10.98 ± 1.17 years, body mass index 19.48 ± 3.51 kg/m(2) ) were volunteers and completed the PAQ-C twice and wore an accelerometer for 8 consecutive days. Reliability was analyzed by the intraclass correlation coefficient (ICC) and the internal consistency by the Cronbach's α coefficient. The PAQ-C was compared against total PA and moderate to vigorous PA (MVPA) obtained by accelerometry. Test-retest reliability showed an ICC = 0.96 for the final score of PAQ-C. Small differences between first and second questionnaire administration were detected. Few and low correlations (rho = 0.228-0.278, all ps < .05) were observed between PAQ-C and accelerometry. The highest correlation was observed for item 9 (rho = 0.311, p < .01). PAQ-C had a high reliability but a questionable validity for assessing total PA and MVPA in Spanish children. Therefore, PA measurement in children should not be limited only to self-report measurements. © 2016, American School Health Association.

Psychometric properties of a Chinese asthma quality of life questionnaire.

PubMed

Wang, Ningqun; Huang, Xiaobo; Chen, Wenqiang; Zhang, Xiaomei; Zhang, Yongsheng; Chen, Yujing

2017-12-01

To assess the acceptability, reliability, validity, and responsiveness of the Chinese Asthma Quality of Life Questionnaire (C-AQLQ) in a sample of Chinese asthma patients. The C-AQLQ and Short Form 36 Health Survey (SF-36) scales were administered to patients at baseline and 3 months later. Asthma severity condition and lung function were evaluated. Necessary data were gathered to assess the psychometric properties such as the feasibility, internal consistency, test-retest reliability, structural validity, discriminant validity, convergent validity, and responsiveness of the C-AQLQ. One hundred and thirty-seven patients completed the investigation. The Cronbach's alpha coefficient for the total scale was 0.96. Factor analysis yielded five factors that generally corresponded to the five proposed subscales. Patients with mild asthma reported higher scores than patients with moderate/severe asthma on all subscales other than environmental stimuli. Lung function measurement and the asthma severity score correlated significantly with domains of the C-AQOL but with fewer domains of the SF-36. The questionnaire detected within-subject changes in patients' asthma status during follow-up. Results indicated preliminary support that the C-AQLQ is a reliable, valid, discriminating, and responsive measure of quality of life in Chinese asthma patients. It is more sensitive than the generic SF-36 in detecting differences in asthma severity.

The Intra-Rater Reliability of Nine Content-Validated Technical Skill Assessment Instruments (TSAI) for Athletic Taping Skills

ERIC Educational Resources Information Center

Lagumen, Niko G.; Butterwick, Dale J.; Paskevich, David M.; Fung, Tak S.; Donnon, Tyrone L.

2008-01-01

Objective: To establish the intra-rater reliability of nine content-validated Technical Skill Assessment Instruments (TSAI) for the skills of athletic taping. Setting: University of Calgary. Subjects: Canadian Certified Athletic Therapists, CAT(C), with a mean ± SD of 9.6 ± 10.8 years as a CAT(C), 7.8 ± 10.9 years as a Supervisory Athletic…

Factor validity and reliability of the aberrant behavior checklist-community (ABC-C) in an Indian population with intellectual disability.

PubMed

Lehotkay, R; Saraswathi Devi, T; Raju, M V R; Bada, P K; Nuti, S; Kempf, N; Carminati, G Galli

2015-03-01

In this study realised in collaboration with the department of psychology and parapsychology of Andhra University, validation of the Aberrant Behavior Checklist-Community (ABC-C) in Telugu, the official language of Andhra Pradesh, one of India's 28 states, was carried out. To assess the factor validity and reliability of this Telugu version, 120 participants with moderate to profound intellectual disability (94 men and 26 women, mean age 25.2, SD 7.1) were rated by the staff of the Lebenshilfe Institution for Mentally Handicapped in Visakhapatnam, Andhra Pradesh, India. Rating data were analysed with a confirmatory factor analysis. The internal consistency was estimated by Cronbach's alpha. To confirm the test-retest reliability, 50 participants were rated twice with an interval of 4 weeks, and 50 were rated by pairs of raters to assess inter-rater reliability. Confirmatory factor analysis revealed that the root mean square error of approximation (RMSEA) was equal to 0.06, the comparative fit index (CFI) was equal to 0.77, and the Tucker Lewis index (TLI) was equal to 0.77, which indicated that the model with five correlated factors had a good fit. Coefficient alpha ranged from 0.85 to 0.92 across the five subscales. Spearman's rank correlation coefficients for inter-rater reliability tests ranged from 0.65 to 0.75, and the correlations for test-retest reliability ranged from 0.58 to 0.76. All reliability coefficients were statistically significant (P < 0.01). The factor validity and reliability of Telugu version of the ABC-C evidenced factor validity and reliability comparable to the original English version and appears to be useful for assessing behaviour disorders in Indian people with intellectual disabilities. © 2014 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Reliability and Validity of Nonradiologic Measures of Forward Flexed Posture in Parkinson Disease.

PubMed

Nair, Prajakta; Bohannon, Richard W; Devaney, Laurie; Maloney, Catherine; Romano, Alexis

2017-03-01

To examine the intertester reliability and validity of 5 nonradiologic measures of forward flexed posture in individuals with Parkinson disease (PD). Cross-sectional observational study. University outpatient facility and community centers. Individuals (N=28) with PD with Hoehn and Yahr scores of 1 through 4. Not applicable. Occiput to wall status, tragus to wall distance, C7 to wall distance, photographically derived trunk flexion angle, and inclinometric kyphosis measure. Participants were older adults (mean, 69.7±10.6y) with a 14-month to 15-year (mean, 5.9±3.5y) history of PD. Intertester reliability was excellent for all measures (κ=.89 [cued condition] and 1.0 [relaxed condition] for occiput to wall status; intraclass correlation coefficients, .779-.897 for tragus to wall distance, C7 to wall distance, flexion angle, and inclinometric kyphosis measure). Convergent validity was supported for all measures by significant correlations between the same measures obtained during relaxed and cued conditions (eg, occiput to wall relaxed and cued) and for most measures by significant correlations between measures obtained under the same condition (eg, occiput to wall cued and tragus to wall cued). Significant correlations between tragus to wall distance, C7 to wall distance, flexion angle, and inclinometric kyphosis measure and the Unified Parkinson Disease Rating Scale item 28 (posture) also supported convergent validity. Significant differences between tragus to wall distance, C7 to wall distance, and inclinometric kyphosis measure values under relaxed and cued conditions supported known condition validity. Known group validity was demonstrated by significant differences in tragus to wall distance, C7 to wall distance, and inclinometric kyphosis measure obtained from individuals able and individuals unable to touch their occiput to wall when cued to stand tall. Tragus to wall distance, C7 to wall distance, and inclinometric kyphosis measure are reliable and valid nonradiologic measures of forward flexed posture in PD. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Reliability and validity of a Chinese version of the Multidimensional Fatigue Symptom Inventory-Short Form (MFSI-SF-C).

PubMed

Pien, Li-Chung; Chu, Hsin; Chen, Wen-Chun; Chang, Yu-Shiun; Liao, Yuan-Mei; Chen, Chiung-Hua; Chou, Kuei-Ru

2011-08-01

To examine the psychometric properties of the Chinese version of the Multidimensional Fatigue Symptom Inventory-Short Form (MFSI-SF-C) for use in Chinese-speaking countries. The assessment of fatigue is a challenging task for most researchers because culture may influence perceptions of meaning of fatigue. The lack of examination of the psychometric properties of the fatigue measures across studies limits the scientific rigour for generating additional research on the concept of 'fatigue.' A cross-sectional study. The study recruited 107 cancer inpatients from two medical centres in Taiwan. The MFSI-SF-C was examined using a two step process: (1) Translation and back-translation of the instrument; and (2) Examination of internal consistency reliability, test-retest reliability, content validity and construct validity. The results showed that the Cronbach's α of MFSI-SF-C total scale and subscales ranged between 0·83-0·92. The content validity index was 0·93. The difference between the fatigue of cancer patients and the comparison group of healthy people in the community was significant. The results demonstrated good convergent validity when comparing fatigue with depression and quality of life. Factor analysis confirmed the four dimensions of fatigue: physical, emotional, mental and vigour. It showed moderate intercorrelation between subscales and high factor loadings also helped to clarify the psychometric meaning. The reliability and validity information presented in this article support the use of the Chinese version of the MFSI-SF as a research instrument for measuring fatigue in Chinese populations. This study also provides evidence that the MFSI-SF possesses robust psychometric properties. The MFSI-SF-C is an effective and comprehensive tool for measuring fatigue in Chinese patients with cancer. © 2011 Blackwell Publishing Ltd.

34 CFR 200.4 - State law exception.

Code of Federal Regulations, 2010 CFR

2010-07-01

...) Academic assessments meet the requirements in § 200.2, particularly regarding validity and reliability... equivalent to one another in their content coverage, difficulty, and quality; (B) Have comparable validity and reliability with respect to groups of students described in section 1111(b)(2)(C)(v) of the Act...

Transcultural and psychometric validation of the Dispositional Resilience Scale (DRS-15) in Chinese adult women.

PubMed

Wong, Janet Yuen-Ha; Fong, Daniel Yee-Tak; Choi, Anna Wai-Man; Chan, Claudia Kor-Yee; Tiwari, Agnes; Chan, Ko Ling; Lai, Vincent; Logan, Tk; Bartone, Paul

2014-11-01

The aim of this study was to report translation and transcultural adaptation of the 15-item Dispositional Resilience Scale in traditional Chinese (C-DRS-15) and evaluate its psychometric properties. The DRS is a self-report instrument that measures psychological hardiness. We followed an international standard of cross-cultural translation and validation of patient-reported outcome measures to create the Chinese version. Then, the translated C-DRS-15 was validated on 542 Chinese women from a population-based sample in Hong Kong. The internal consistency and criterion-related validity were investigated. Exploratory and confirmatory factor analysis revealed that the C-DRS-15 was supported by a modified three-factor structure in our Chinese sample (RMSEA = .06, CFI = .94, TLI = .92, and SRMR = .06). The reliability (Cronbach's α coefficient = .78) and validity were satisfactory. Total resilience score was negatively correlated with depression (p < .001), with non-depressed women scoring higher on the C-DRS-15. The C-DRS-15 was demonstrated to be a reliable and valid measurement to assess hardiness in Chinese women.

Cross-cultural adaptation and psychometric assessment of the Chinese version of the comprehensive needs assessment tool for cancer caregivers (CNAT-C).

PubMed

Zhang, Yin-Ping; Zhao, Xin-Shuang; Zhang, Bei; Zhang, Lu-Lu; Ni, Chun-Ping; Hao, Nan; Shi, Chang-Bei; Porr, Caroline

2015-07-01

The comprehensive needs assessment tool for cancer caregivers (CNAT-C) is a systematic and comprehensive needs assessment tool for the family caregivers. The purpose of this project was twofold: (1) to adapt the CNAT-C to Mainland China's cultural context and (2) to evaluate the psychometric properties of the newly adapted Chinese CNAT-C. Cross-cultural adaptation of the original CNAT-C was performed according to published guidelines. A pilot study was conducted in Mainland China with 30 Chinese family cancer caregivers. A subsequent validation study was conducted with 205 Chinese cancer caregivers from Mainland China. Construct validity was determined through exploratory and confirmatory factor analyses. Reliability was determined using internal consistency and test-retest reliability. The split-half coefficient for the overall Chinese CNAT-C scale was 0.77. Principal component analysis resulted in an eight-factor structure explaining 68.11 % of the total variance. The comparative fit index (CFI) was 0.91 from the modified model confirmatory factor analysis. The Chi-square divided by degrees of freedom was 1.98, and the root mean squared error of approximation (RMSEA) was 0.079. In relation to the known-group validation, significant differences were found in the Chinese CNAT-C scale according to various caregiver characteristics. Internal consistency was high for the Chinese CNAT-C reaching a Cronbach α value of 0.94. Test-retest reliability was 0.85. The newly adapted Chinese CNAT-C scale possesses adequate validity, test-retest reliability, and internal consistency and therefore may be used to ascertain holistic health and support needs of cancer patients' family caregivers in Mainland China.

Effects of a Tundra Fire on Soils and Plant Communities along a Hillslope in the Seward Peninsula, Alaska.

DTIC Science & Technology

1980-11-01

together with topography, slope, drainage, soil types (HPCq = Histic Pergelic Cryaquept; PCq = Pergelic Cryaquept; PCf = Pergelic Cryofibrist), frost...short distance to the north. the soil moisture environments (Fig. 3): Histic Shallow, weakly expressed, more or less paral- Pergelic Cryaquepts on the...poorly drained foot- lel drainageways occur at intervals of about 100 slope, Pergelic Cryaquepts on the moderately to 150 m along the entire southwest

Cross-cultural translation of the Lysholm knee score in Chinese and its validation in patients with anterior cruciate ligament injury.

PubMed

Wang, W; Liu, L; Chang, X; Jia, Z Y; Zhao, J Z; Xu, W D

2016-10-19

The Lysholm Knee Score (LKS) is widely used and is one of the most effective questionnaires employed to assess knee injuries. Although LKS has been translated into multiple languages, there is no Chinese version even though China has the largest population of patients with knee-joint injuries. The objective of our study was to develop the Chinese version of LKS (C-LKS) and assess its reliability, validity and responsiveness in Chinese patients with anterior cruciate ligament (ACL) injuries. Study participants were mainly recruited among patients with ACL injuries scheduled for arthroscopic ACL reconstruction at our hospital. First, we developed the C-LKS in a five-step translation and cross-cultural adaptation procedure. Next, we calculated the Cronbach's alpha, intraclass correlation coefficient (ICC), Pearson's correlation coefficient (r), effect size (ES), and standardized response mean (SRM) to evaluate the reliability, validity, and responsiveness of C-LKS respectively. Overall, 126 patients with ACL injuries successfully completed the questionnaires. Acceptable internal consistency (Cronbach's alpha = 0.726) as well as excellent test-retest reliability (ICC = 0.935) was found for C-LKS. Good or moderate correlation (r = 0.514-0.837) was determined among C-LKS and International Knee Documentation Committee Subjective Knee Form (IKDC), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), physical subscales of SF-36; C-LKS also had fair or moderate correlation (r = 0.207-0.462) with the other subscales of SF-36, which adequately illustrated that good validity was included in C-LKS. In addition, good responsiveness was also observed in C-LKS (ES = 1.36,SRM = 1.26). We have shown that our developed C-LKS questionnaire is reliable, valid and responsible for the evaluation of Chinese-speaking patients with ACL injuries and it would be an effective instrument.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population.

PubMed

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population

PubMed Central

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe. PMID:27228050

Insights into the use of thermography to assess burn wound healing potential: a reliable and valid technique when compared to laser Doppler imaging

NASA Astrophysics Data System (ADS)

Jaspers, Mariëlle E. H.; Maltha, Ilse; Klaessens, John H. G. M.; de Vet, Henrica C. W.; Verdaasdonk, Rudolf M.; van Zuijlen, Paul P. M.

2016-09-01

Adequate assessment of burn wounds is crucial in the management of burn patients. Thermography, as a noninvasive measurement tool, can be utilized to detect the remaining perfusion over large burn wound areas by measuring temperature, thereby reflecting the healing potential (HP) (i.e., number of days that burns require to heal). The objective of this study was to evaluate the clinimetric properties (i.e., reliability and validity) of thermography for measuring burn wound HP. To evaluate reliability, two independent observers performed a thermography measurement of 50 burns. The intraclass correlation coefficient (ICC), the standard error of measurement (SEM), and the limits of agreement (LoA) were calculated. To assess validity, temperature differences between burned and nonburned skin (ΔT) were compared to the HP found by laser Doppler imaging (serving as the reference standard). By applying a visual method, one ΔT cutoff point was identified to differentiate between burns requiring conservative versus surgical treatment. The ICC was 0.99, expressing an excellent correlation between two measurements. The SEM was calculated at 0.22°C, the LoA at -0.58°C and 0.64°C. The ΔT cutoff point was -0.07°C (sensitivity 80% specificity 80%). These results show that thermography is a reliable and valid technique in the assessment of burn wound HP.

Measuring the contribution of art therapy in multidisciplinary treatment of personality disorders: The construction of the Self‐expression and Emotion Regulation in Art Therapy Scale (SERATS)

PubMed Central

van Hooren, Susan; van der Veld, William M.; Hutschemaekers, Giel

2017-01-01

Abstract Despite the use of art therapy in clinical practice, its appreciation and reported beneficial results, no instruments are available to measure specific effects of art therapy among patients with personality disorders cluster B/C in multidisciplinary treatment. In the present study, we described the development and psychometric evaluation of the Self‐expression and Emotion Regulation in Art Therapy Scale (SERATS). Structural validity (exploratory and confirmatory factor analysis), reliability, construct validity and sensitivity to change were examined using two independent databases (n = 335; n = 34) of patients diagnosed with personality disorders cluster B/C. This resulted in a nine‐item effect scale with a single factor with a high internal reliability and high test–retest reliability; it demonstrated discriminant validity and sensitivity to change. In conclusion, the SERATS is brief and content‐valid and offers objective and reliable information on self‐expression and emotion regulation in art therapy among patients with personality disorders cluster B/C. Although more research on construct validity is needed, the SERATS is a promising tool to be applied as an effect scale and as a monitoring tool during art therapy treatment. © 2017 The Authors Personality and Mental Health Published by John Wiley & Sons Ltd PMID:28730717

Translation, Validation and Cross-Cultural Adaptation of a Simplified-Chinese Version of the Tegner Activity Score in Chinese Patients with Anterior Cruciate Ligament Injury.

PubMed

Huang, Hongshi; Zhang, Dongxia; Jiang, Yanfang; Yang, Jie; Feng, Tao; Gong, Xi; Wang, Jianquan; Ao, Yingfang

2016-01-01

To translate the English version of Tegner Activity Score into a Simplified-Chinese version (Tegner-C) and evaluate its psychometric properties. Tegner-C was cross-culturally adapted according to established guidelines. The validity and reliability of Tegner-C were assessed in 78 participants, with 19-20 participants in each of the four groups: before anterior cruciate ligament reconstruction (pre-ACLR) group, 2-3 months after ACLR group, 3-12 months after ACLR group, and healthy control group. Each participant was asked to complete the Tegner-C and Chinese version of International Knee Documentation Committee Subjective Knee Form (IKDC-SKF-C) twice, with an interval of 5±2 days. Intra-class correlation coefficient (ICC2, 1) was used to assess the reliability and Spearman's rank correlation was used for construct validity. The ICC2,1 was higher than 0.90 for all groups except in the pre-ACLR group, for which the ICC2,1 was 0.71 (0.41, 0.87) (All with p<0.001). The absolute reliability as evaluated by the smallest detectable change was 0.43, 2.12, 0.89, and 0.44 for the healthy control group, pre-ACLR group, 2-3 months after ACLR group, and 3-12 months after ACLR group, respectively. Neither a ceiling effect nor a floor effect was observed for any group. Significant difference was observed for both Tegner-C and IKDC-SKF-C scores between the control and the other three groups (all with p<0.001), and between pre-ACLR and the 2-3 months after ACLR group (p<0.001). Tegner-C demonstrated comparable psychometric properties to the original English version and thus is reliable and valid for Chinese-speaking patients with ACL injury.

76 FR 65504 - Proposed Agency Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2011-10-21

..., including the validity of the methodology and assumptions used; (c) ways to enhance the quality, utility... Reliability Standard, FAC- 008-3--Facility Ratings, developed by the North American Electric Reliability... Reliability Standard FAC- 008-3 is pending before the Commission. The proposed Reliability Standard modifies...

The Chinese version of the Outcome Expectations for Exercise scale: validation study.

PubMed

Lee, Ling-Ling; Chiu, Yu-Yun; Ho, Chin-Chih; Wu, Shu-Chen; Watson, Roger

2011-06-01

Estimates of the reliability and validity of the English nine-item Outcome Expectations for Exercise (OEE) scale have been tested and found to be valid for use in various settings, particularly among older people, with good internal consistency and validity. Data on the use of the OEE scale among older Chinese people living in the community and how cultural differences might affect the administration of the OEE scale are limited. To test the validity and reliability of the Chinese version of the Outcome Expectations for Exercise scale among older people. A cross-sectional validation study was designed to test the Chinese version of the OEE scale (OEE-C). Reliability was examined by testing both the internal consistency for the overall scale and the squared multiple correlation coefficient for the single item measure. The validity of the scale was tested on the basis of both a traditional psychometric test and a confirmatory factor analysis using structural equation modelling. The Mokken Scaling Procedure (MSP) was used to investigate if there were any hierarchical, cumulative sets of items in the measure. The OEE-C scale was tested in a group of older people in Taiwan (n=108, mean age=77.1). There was acceptable internal consistency (alpha=.85) and model fit in the scale. Evidence of the validity of the measure was demonstrated by the tests for criterion-related validity and construct validity. There was a statistically significant correlation between exercise outcome expectations and exercise self-efficacy (r=.34, p<.01). An analysis of the Mokken Scaling Procedure found that nine items of the scale were all retained in the analysis and the resulting scale was reliable and statistically significant (p=.0008). The results obtained in the present study provided acceptable levels of reliability and validity evidence for the Chinese Outcome Expectations for Exercise scale when used with older people in Taiwan. Future testing of the OEE-C scale needs to be carried out to see whether these results are generalisable to older Chinese people living in urban areas. Copyright © 2010 Elsevier Ltd. All rights reserved.

Development of a simulation evaluation tool for assessing nursing students' clinical judgment in caring for children with dehydration.

PubMed

Kim, Shin-Jeong; Kim, Sunghee; Kang, Kyung-Ah; Oh, Jina; Lee, Myung-Nam

2016-02-01

The lack of reliable and valid tools to evaluate learning outcomes during simulations has limited the adoption and progress of simulation-based nursing education. This study had two aims: (a) to develop a simulation evaluation tool (SET(c-dehydration)) to assess students' clinical judgment in caring for children with dehydration based on the Lasater Clinical Judgment Rubric (LCJR) and (b) to examine its reliability and validity. Undergraduate nursing students from two nursing schools in South Korea participated in this study from March 3 through June 10, 2014. The SET(c-dehydration) was developed, and 120 nursing students' clinical judgment was evaluated. Descriptive statistics, Cronbach's alpha, Cohen's kappa coefficient, and confirmatory factor analysis (CFA) were used to analyze the data. A 41-item version of the SET(c-dehydration) with three subscales was developed. Cohen's kappa (measuring inter-observer reliability) of the sessions ranged from .73 to .95, and Cronbach's alpha was .87. The mean total rating of the SET(c-dehydration) by the instructors was 1.92 (±.25), and the mean scores for the four LCJR dimensions of clinical judgment were as follows: noticing (1.74±.27), interpreting (1.85±.43), responding (2.17±.32), and reflecting (1.79±.35). CFA, which was performed to test construct validity, showed that the four dimensions of the SET(c-dehydration) was an appropriate framework. The SET(c-dehydration) provides a means to evaluate clinical judgment in simulation education. Its reliability and validity should be examined further. Copyright © 2015 Elsevier Ltd. All rights reserved.

Establishing the Test-Retest Reliability & Concurrent Validity for the Repeat Ice Skating Test (RIST) in Adolescent Male Ice Hockey Players

ERIC Educational Resources Information Center

Power, Allan; Faught, Brent E.; Przysucha, Eryk; McPherson, Moira; Montelpare, William

2012-01-01

In this study the authors examine the test-retest reliability and concurrent validity of the Repeat Ice Skating Test (RIST). This was an on-ice field anaerobic test that measured average peak power and was validated with 3 anaerobic lab tests: (a) vertical jump, (b) the Margaria-Kalamen stair test, and (c) the Wingate Anaerobic Test. The…

The dignified approach to care: a pilot study using the patient dignity question as an intervention to enhance dignity and person-centred care for people with palliative care needs in the acute hospital setting.

PubMed

Johnston, Bridget; Pringle, Jan; Gaffney, Marion; Narayanasamy, Melanie; McGuire, Margaret; Buchanan, Deans

2015-01-01

Providing person-centred, dignity-conserving care for hospitalised patients is central to many healthcare policies and essential to the provision of effective palliative care. The Patient Dignity Question (PDQ) "What do I need to know about you as a person to take the best care of you that I can?" was designed from empirical research on patients' perceptions of their dignity at end of life to help healthcare professionals (HCPs) understand the patient as a person. This mixed method pilot study was designed to inform a larger multisite study in the future. It tests the hypothesis that the PDQ intervention could be used to enhance a more person-centred climate for people with palliative care needs in the acute hospital setting, and provide evidence regarding its acceptability. Outcome measures pre and post intervention Person-centred Climate Questionnaire--patient version (PCQ-P), and the Consultation and Relational Empathy (CARE) measure; PDQ feedback questionnaires were used for all participants post intervention, in addition to qualitative interviews. 30 patients, 17 HCPs, and 4 family members participated. Results showed a positive correlation between higher PCQ-P scores and higher CARE scores, indicating that the PDQ can make improvements to a person-centred environment and levels of empathy perceived by patients. Individual results from the PCQ-P and the CARE indicated overall improvements in the majority of fields. The PDQ supported disclosure of information previously unknown to HCPs, has implications for improving person-centred care. Positive results from PDQ feedback questionnaires were received from all participants. Qualitative findings indicated patients' appreciation of staff (Attributes and attitudes), that patients wanted staff to have awareness of them (Know me as a person), take the time to talk, and work flexibly, to allow for patient individuality (Time and place). The PDQ has potential to improve patients' perceptions of care, and HCP attitudes. Furthermore, it was well received by participants. The PDQ could be incorporated into clinical practice for the care of palliative care patients in the acute setting to the benefit of personalized and dignified care. Further research using the PDQ across wider geographical areas, and more diverse settings, would be beneficial.

Translation and validation of European organization for research and treatment of cancer quality of life Questionnaire -C30 into Moroccan version for cancer patients in Morocco

PubMed Central

2014-01-01

Background Understanding the effects of cancer on the quality of life of affected patients is critical to clinical research as well as to optimal management and care. The aim of this study was to adapt the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30 (EORTC QLQ-C30) questionnaire into Moroccan Arabic and to determine its psychometric properties. After translation, back translation and pretesting of the pre-final version, the translated version was submitted to a committee of professionals composed by oncologists and epidemiologists. The psychometric properties were tested in patients with cancer. Internal consistency was tested using Cronbach’s alpha and the test-retest reliability using interclass correlation coefficients. Construct validity was assessed by examining item-convergent and divergent validity. It was also tested using Spearman’s correlation between QLQ-C30 scales and EQ-5D. Results The study was conducted in 125 patients. The Moroccan version was internally reliable, Cronbach’s α was 0.87 for the total scale and ranged from 0.34 to 0.97 for the subscales. The intraclass correlation coefficient of the test-retest reliability ranged from 0.64 for “social functioning” to 0.89 for “physical activities” subscales. The instrument demonstrated a good construct and concomitant validity. Conclusions We have developed a semantically equivalent translation with cultural adaptation of EORTC QLQ-C30 questionnaire. The assessment of its measurement properties showed that it is quite reliable and a valid measure of the effect of cancer on the quality of life in Moroccan patients. PMID:24721384

The Chinese version of the Child and Adolescent Scale of Environment (CASE-C): validity and reliability for children with disabilities in Taiwan.

PubMed

Kang, Lin-Ju; Yen, Chia-Feng; Bedell, Gary; Simeonsson, Rune J; Liou, Tsan-Hon; Chi, Wen-Chou; Liu, Shu-Wen; Liao, Hua-Fang; Hwang, Ai-Wen

2015-03-01

Measurement of children's participation and environmental factors is a key component of the assessment in the new Disability Evaluation System (DES) in Taiwan. The Child and Adolescent Scale of Environment (CASE) was translated into Traditional Chinese (CASE-C) and used for assessing environmental factors affecting the participation of children and youth with disabilities in the DES. The aim of this study was to validate the CASE-C. Participants were 614 children and youth aged 6.0-17.9 years with disabilities, with the largest condition group comprised of children with intellectual disability (61%). Internal structure, internal consistency, test-retest reliability, convergent validity, and discriminant (known group) validity were examined using exploratory factor analyses, Cronbach's α coefficient, intra-class correlation coefficients (ICC), correlation analyses, and univariate ANOVAs. A three-factor structure (Family/Community Resources, Assistance/Attitude Supports, and Physical Design Access) of the CASE-C was produced with 38% variance explained. The CASE-C had adequate internal consistency (Cronbach's α=.74-.86) and test-retest reliability (ICCs=.73-.90). Children and youth with disabilities who had higher levels of severity of impairment encountered more environmental barriers and those experiencing more environmental problems also had greater restrictions in participation. The CASE-C scores were found to distinguish children on the basis of disability condition and impairment severity, but not on the basis of age or sex. The CASE-C is valid for assessing environmental problems experienced by children and youth with disabilities in Taiwan. Copyright © 2014 Elsevier Ltd. All rights reserved.

Validity, Reliability, and Inertia of Four Different Temperature Capsule Systems.

PubMed

Bongers, Coen C W G; Daanen, Hein A M; Bogerd, Cornelis P; Hopman, Maria T E; Eijsvogels, Thijs M H

2018-01-01

Telemetric temperature capsule systems are wireless, relatively noninvasive, and easily applicable in field conditions and have therefore great advantages for monitoring core body temperature. However, the accuracy and responsiveness of available capsule systems have not been compared previously. Therefore, the aim of this study was to examine the validity, reliability, and inertia characteristics of four ingestible temperature capsule systems (i.e., CorTemp, e-Celsius, myTemp, and VitalSense). Ten temperature capsules were examined for each system in a temperature-controlled water bath during three trials. The water bath temperature gradually increased from 33°C to 44°C in trials 1 and 2 to assess the validity and reliability, and from 36°C to 42°C in trial 3 to assess the inertia characteristics of the temperature capsules. A systematic difference between capsule and water bath temperature was found for CorTemp (0.077°C ± 0.040°C), e-Celsius (-0.081°C ± 0.055°C), myTemp (-0.003°C ± 0.006°C), and VitalSense (-0.017°C ± 0.023°C; P < 0.010), with the lowest bias for the myTemp system (P < 0.001). A systematic difference was found between trial 1 and trial 2 for CorTemp (0.017°C ± 0.083°C; P = 0.030) and e-Celsius (-0.007°C ± 0.033°C; P = 0.019), whereas temperature values of myTemp (0.001°C ± 0.008°C) and VitalSense (0.002°C ± 0.014°C) did not differ (P > 0.05). Comparable inertia characteristics were found for CorTemp (25 ± 4 s), e-Celsius (21 ± 13 s), and myTemp (19 ± 2 s), whereas the VitalSense system responded more slowly (39 ± 6 s) to changes in water bath temperature (P < 0.001). Although differences in temperature and inertia were observed between capsule systems, an excellent validity, test-retest reliability, and inertia was found for each system between 36°C and 44°C after removal of outliers.

Translation and Initial Validation of the Chinese (Cantonese) Version of Community Integration Measure for Use in Patients with Chronic Stroke

PubMed Central

Ng, Shamay S. M.; Ng, Gabriel Y. F.

2014-01-01

Objectives. To (1) translate and culturally adapt the English version Community Integration Measure into Chinese (Cantonese), (2) report the results of initial validation of the Chinese (Cantonese) version of CIM (CIM-C) including the content validity, internal consistency, test-retest reliability, and factor structure of CIM-C for use in stroke survivors in a Chinese community setting, and (3) investigate the level of community integration of stroke survivors living in Hong Kong. Design. Cross-sectional study. Setting. University-based rehabilitation centre. Participants. 62 (n = 62) subjects with chronic stroke. Methods. The CIM-C was produced after forward-backward translation, expert panel review, and pretesting. 25 (n = 25) of the same subjects were reassessed after a 1-week interval. Results. The items of the CIM-C demonstrated high internal consistency with a Cronbach's α of 0.84. The CIM-C showed good test-retest reliability with an intraclass correlation coefficient (ICC) of 0.84 (95% confidence interval, 0.64–0.93). A 3-factor structure of the CIM-C including “relationship and engagement,” “sense of knowing,” and “independent living,” was consistent with the original theoretical model. Hong Kong stroke survivors revealed a high level of community integration as measured by the CIM-C (mean (SD): 43.48 (5.79)). Conclusions. The CIM-C is a valid and reliable measure for clinical use. PMID:24995317

[Reliability and validity studies of Turkish translation of Eysenck Personality Questionnaire Revised-Abbreviated].

PubMed

Karanci, A Nuray; Dirik, Gülay; Yorulmaz, Orçun

2007-01-01

The aim of the present study was to examine the reliability and the validity of the Turkish translation of the Eysneck Personality Questionnaire Revised-abbreviated Form (EPQR-A) (Francis et al., 1992), which consists of 24 items that assess neuroticism, extraversion, psychoticism, and lying. The questionnaire was first translated into Turkish and then back translated. Subsequently, it was administered to 756 students from 4 different universities. The Fear Survey Inventory-III (FSI-III), Rosenberg Self-Esteem Scales (RSES), and Egna Minnen Betraffande Uppfostran (EMBU-C) were also administered in order to assess the questionnaire's validity. The internal consistency, test-retest reliability, and validity were subsequently evaluated. Factor analysis, similar to the original scale, yielded 4 factors; the neuroticism, extraversion, psychoticism, and lie scales. Kuder-Richardson alpha coefficients for the extraversion, neuroticism, psychoticism, and lie scales were 0.78, 0.65, 0.42, and 0.64, respectively, and the test-retest reliability of the scales was 0.84, 0.82, 0.69, and 0.69, respectively. The relationships between EPQR-A-48, FSI-III, EMBU-C, and RSES were examined in order to evaluate the construct validity of the scale. Our findings support the construct validity of the questionnaire. To investigate gender differences in scores on the subscales, MANOVA was conducted. The results indicated that there was a gender difference only in the lie scale scores. Our findings largely supported the reliability and validity of the questionnaire in a Turkish student sample. The psychometric characteristics of the Turkish version of the EPQR-A were discussed in light of the relevant literature.

Validation of a theoretically motivated approach to measuring childhood socioeconomic circumstances in the Health and Retirement Study.

PubMed

Vable, Anusha M; Gilsanz, Paola; Nguyen, Thu T; Kawachi, Ichiro; Glymour, M Maria

2017-01-01

Childhood socioeconomic status (cSES) is a powerful predictor of adult health, but its operationalization and measurement varies across studies. Using Health and Retirement Study data (HRS, which is nationally representative of community-residing United States adults aged 50+ years), we specified theoretically-motivated cSES measures, evaluated their reliability and validity, and compared their performance to other cSES indices. HRS respondent data (N = 31,169, interviewed 1992-2010) were used to construct a cSES index reflecting childhood social capital (cSC), childhood financial capital (cFC), and childhood human capital (cHC), using retrospective reports from when the respondent was <16 years (at least 34 years prior). We assessed internal consistency reliability (Cronbach's alpha) for the scales (cSC and cFC), and construct validity, and predictive validity for all measures. Validity was assessed with hypothesized correlates of cSES (educational attainment, measured adult height, self-reported childhood health, childhood learning problems, childhood drug and alcohol problems). We then compared the performance of our validated measures with other indices used in HRS in predicting self-rated health and number of depressive symptoms, measured in 2010. Internal consistency reliability was acceptable (cSC = 0.63, cFC = 0.61). Most measures were associated with hypothesized correlates (for example, the association between educational attainment and cSC was 0.01, p < 0.0001), with the exception that measured height was not associated with cFC (p = 0.19) and childhood drug and alcohol problems (p = 0.41), and childhood learning problems (p = 0.12) were not associated with cHC. Our measures explained slightly more variability in self-rated health (adjusted R2 = 0.07 vs. <0.06) and number of depressive symptoms (adjusted R2 > 0.05 vs. < 0.04) than alternative indices. Our cSES measures use latent variable models to handle item-missingness, thereby increasing the sample size available for analysis compared to complete case approaches (N = 15,345 vs. 8,248). Adopting this type of theoretically motivated operationalization of cSES may strengthen the quality of research on the effects of cSES on health outcomes.

Reliability and validity of the Chinese versions of self-efficacy and outcome expectations for osteoporosis medication adherence scales in Chinese immigrants.

PubMed

Qi, Bing-Bing; Resnick, Barbara

2014-01-01

To assess the psychometric properties of Chinese versions self-efficacy and outcome expectations on osteoporosis medication adherence (SEOMA-C and OEOMA-C) scales. Back-translated tools were assessed by internal consistency and R2 by structured equation modeling, confirmatory factor analyses, hypothesis testing, and criterion-related validity among 110 (81 females, 29 males) Mandarin-speaking immigrants (mean age = 63.44, SD = 9.63). The Cronbach's alpha for SEOMA-C and OEOMA-C is .904 and .937, respectively. There was fair and good fit of the measurement model to the data. Previous bone mineral density (BMD) testing, calcaneus BMD, self-efficacy for exercise, and osteoporosis medication adherence were positively related to SEOMA-C scores. These scales constitute some preliminary validity and reliability. Further refined and cultural sensitive items could be explored and added.

Psychometric Characteristics of the Korean Version of the Satisfaction with Life Scale Adapted for Children

ERIC Educational Resources Information Center

Lim, Young-Jin

2015-01-01

The aim of this study was to examine the internal consistency reliability, test-retest reliability, factorial structure validity, and convergent validity of a Korean version of the Satisfaction With Life Scale adapted for children (K-SWLS-C). Participants consisted of 653 elementary school students (48% were male). The internal consistency of the…

Ankle Accelerometry for Assessing Physical Activity among Adolescent Girls: Threshold Determination, Validity, Reliability, and Feasibility

ERIC Educational Resources Information Center

Hager, Erin R.; Treuth, Margarita S.; Gormely, Candice; Epps, LaShawna; Snitker, Soren; Black, Maureen M.

2015-01-01

Purpose: Ankle accelerometry allows for 24-hr data collection and improves data volume/integrity versus hip accelerometry. Using Actical ankle accelerometry, the purpose of this study was to (a) develop sensitive/specific thresholds, (b) examine validity/reliability, (c) compare new thresholds with those of the manufacturer, and (d) examine…

Further evaluation of the EORTC QLQ-C30 psychometric properties in a large Brazilian cancer patient cohort as a function of their educational status.

PubMed

Paiva, Carlos Eduardo; Carneseca, Estela Cristina; Barroso, Eliane Marçon; de Camargos, Mayara Goulart; Alfano, Ana Camila Callado; Rugno, Fernanda Capella; Paiva, Bianca Sakamoto Ribeiro

2014-08-01

The European Organization for Research and Treatment of Cancer Core Quality of Life Questionnaire (EORTC QLQ-C30) is considered a valid instrument for use in Brazil. However, the previous Brazilian validation study included only 30 lung cancer patients and only measured test-retest reliability. The aim of this study was to evaluate the psychometric properties of the EORTC QLQ-C30 in a sample of cancer patients at different educational levels who completed the instrument administered by an interviewer. Data from six prospective studies conducted by the same group of researchers were combined in this study (N = 986). Reliability was assessed using Cronbach's alpha coefficient, all values of which were >0.7, with the exception of cognitive functioning, social functioning, and nausea and vomiting (α = 0.57, α = 0.69, and α = 0.68, respectively). In multi-trait scaling analysis, convergent and divergent validity were considered adequate (validity indices were 91.6 and 97.4%). In general, moderate to strong correlations were found between the subscales of the EORTC QLQ-C30 and its respective dimensions from the WHOQOL-bref, the hospital anxiety and depression scale, and the Edmonton Symptom Assessment System (ESAS) instruments. In addition, the EORTC QLQ-C30 was able to differentiate groups of patients with distinct performance statuses and types of treatment (known-group validation). Statistical analyses were also performed on educational status, yielding similar results. Detailed psychometric property data using the EORTC QLQ-C30 in Brazil are added by this study. In addition, we demonstrated that this instrument is in general reliable and valid regardless of the patient educational level.

Validation and reliability of the Physical Activity Scale for the Elderly in Chinese population.

PubMed

Ngai, Shirley P C; Cheung, Roy T H; Lam, Priscillia L; Chiu, Joseph K W; Fung, Eric Y H

2012-05-01

Physical Activity Scale for the Elderly (PASE) is a widely used questionnaire in epidemiological studies for assessing the physical activity level of elderly. This study aims to translate and validate PASE in Chinese population. Cross-sectional study. Chinese elderly aged 65 or above. The original English version of PASE was translated into Chinese (PASE-C) following standardized translation procedures. Ninety Chinese elderly aged 65 or above were recruited in the community. Test-retest reliability was determined by comparing the scores obtained from two separate administrations by the intraclass correlation coefficient. Validity was evaluated by Spearman's rank correlation coefficients between PASE and Medical Outcome Survey 36-Item Short Form Health Survey (SF-36), grip strength, single-leg-stance, 5 times sit-to-stand and 10-m walk. PASE-C demonstrated good test-retest reliability (intraclass correlation coefficient  = 0.81). Fair to moderate association were found between PASE-C and most of the subscales of SF-36 (rs = 0.285 to 0.578, p < 0.01), grip strength (rs = 0.405 to 0.426, p < 0.001), single-leg-stance (rs = 0.470 to 0.548, p < 0.001), 5 times sit-to-stand (rs = -0.33, p = 0.001) and 10-m walk (rs = -0.281, p = 0.007). PASE-C is a reliable and valid instrument for assessing the physical activity level of elderly in Chinese population.

Validation and Cross-Cultural Adaptation of a Chinese Version of the Emotional and Social Dysfunction Questionnaire in Stroke Patients.

PubMed

Huang, Hui-Chuan; Shyu, Meei-Ling; Lin, Mei-Feng; Hu, Chaur-Jong; Chang, Chien-Hung; Lee, Hsin-Chien; Chi, Nai-Fang; Chang, Hsiu-Ju

2017-12-01

The objectives of this study were to develop a cross-cultural Chinese version of the Emotional and Social Dysfunction Questionnaire (ESDQ-C) and test its validity and reliability among Chinese-speaking stroke patients. Various methods were used to develop the ESDQ-C. A cross-sectional study was used to examine the validity and reliability of the developed questionnaire, which consists of 28 items belonging to six factors, anger, helplessness, emotional dyscontrol, indifference, inertia and fatigue, and euphoria. Satisfactory convergence and known-group validities were confirmed by significant correlations of the ESDQ-C with the Profile of Mood States-Short Form ( p < .05) and with the Hospital Anxiety and Depression Scale ( p < .05). The internal consistency was represented by Cronbach's alpha, which was .96 and .79 to .92 for the entire scale and subscales, respectively. Appropriate application of the ESDQ-C will be helpful to identify critical adjustment-related types of distress and patients who experience difficulty coping with such distress.

Development of a Language Impairment Screener for Spanish Speaking Children--SSLIC: Phase 1--Task Development

ERIC Educational Resources Information Center

Restrepo, M. Adelaida; Gorin, Joanna S.; Gray, Shelley; Morgan, Gareth P.; Barona, Nicole

2010-01-01

The main purpose of this study is to develop a Spanish language screening measure that (a) is valid and reliable for the purpose of identifying Spanish-speaking (SS) children at risk for Language Impairment (LI), (b) is valid and reliable across different Spanish dialects, different socioeconomic groups, and different ethnicities, (c) uses a…

A Validation Study of the "School Leader Dispositions Inventory"[C

ERIC Educational Resources Information Center

Melton, Teri Denlea; Tysinger, Dawn; Mallory, Barbara; Green, James

2011-01-01

Although university-based school administrator preparation programs are required by accreditation agencies to assess the dispositions of candidates, valid and reliable methods for doing so remain scarce. "The School Leaders Disposition Inventory"[C] (SDLI) is proposed as an instrument that has promise for identifying leadership…

Spanish translation, cross-cultural adaptation, and validation of the Questionnaire for Diabetes-Related Foot Disease (Q-DFD)

PubMed Central

Castillo-Tandazo, Wilson; Flores-Fortty, Adolfo; Feraud, Lourdes; Tettamanti, Daniel

2013-01-01

Purpose To translate, cross-culturally adapt, and validate the Questionnaire for Diabetes-Related Foot Disease (Q-DFD), originally created and validated in Australia, for its use in Spanish-speaking patients with diabetes mellitus. Patients and methods The translation and cross-cultural adaptation were based on international guidelines. The Spanish version of the survey was applied to a community-based (sample A) and a hospital clinic-based sample (samples B and C). Samples A and B were used to determine criterion and construct validity comparing the survey findings with clinical evaluation and medical records, respectively; while sample C was used to determine intra- and inter-rater reliability. Results After completing the rigorous translation process, only four items were considered problematic and required a new translation. In total, 127 patients were included in the validation study: 76 to determine criterion and construct validity and 41 to establish intra- and inter-rater reliability. For an overall diagnosis of diabetes-related foot disease, a substantial level of agreement was obtained when we compared the Q-DFD with the clinical assessment (kappa 0.77, sensitivity 80.4%, specificity 91.5%, positive likelihood ratio [LR+] 9.46, negative likelihood ratio [LR−] 0.21); while an almost perfect level of agreement was obtained when it was compared with medical records (kappa 0.88, sensitivity 87%, specificity 97%, LR+ 29.0, LR− 0.13). Survey reliability showed substantial levels of agreement, with kappa scores of 0.63 and 0.73 for intra- and inter-rater reliability, respectively. Conclusion The translated and cross-culturally adapted Q-DFD showed good psychometric properties (validity, reproducibility, and reliability) that allow its use in Spanish-speaking diabetic populations. PMID:24039434

Defining physicians' readiness to screen and manage intimate partner violence in Greek primary care settings.

PubMed

Papadakaki, Maria; Prokopiadou, Dimitra; Petridou, Eleni; Kogevinas, Manolis; Lionis, Christos

2012-06-01

The current article aims to translate the PREMIS (Physician Readiness to Manage Intimate Partner Violence) survey into the Greek language and test its validity and reliability in a sample of primary care physicians. The validation study was conducted in 2010 and involved all the general practitioners serving two adjacent prefectures of Greece (n = 80). Maximum-likelihood factor analysis (MLF) was used to extract key survey factors. The instrument was further assessed for the following psychometric properties: (a) scale reliability, (b) item-specific reliability, (c) test-retest reliability, (d) scale construct validity, and (e) internal predictive validity. The MLF analysis of 23 opinion items revealed a seven-factor solution (preparation, constraint, workplace issues, screening, self-efficacy, alcohol/drugs, victim understanding), which was statistically sound (p = .293). Most of the newly derived scales displayed satisfactory internal consistency (α ≥ .60), high item-specific reliability, strong construct, and internal predictive validity (F = 2.82; p = .004), and high repeatability when retested with 20 individuals (intraclass correlation coefficient [ICC] > .70). The tool was found appropriate to facilitate the identification of competence deficits and the evaluation of training initiatives.

The Short International Physical Activity Questionnaire: cross-cultural adaptation, validation and reliability of the Hausa language version in Nigeria.

PubMed

Oyeyemi, Adewale L; Oyeyemi, Adetoyeje Y; Adegoke, Babatunde O; Oyetoke, Fatima O; Aliyu, Habeeb N; Aliyu, Salamatu U; Rufai, Adamu A

2011-11-22

Accurate assessment of physical activity is important in determining the risk for chronic diseases such as cardiovascular disease, stroke, type 2 diabetes, cancer and obesity. The absence of culturally relevant measures in indigenous languages could pose challenges to epidemiological studies on physical activity in developing countries. The purpose of this study was to translate and cross-culturally adapt the Short International Physical Activity Questionnaire (IPAQ-SF) to the Hausa language, and to evaluate the validity and reliability of the Hausa version of IPAQ-SF in Nigeria. The English IPAQ-SF was translated into the Hausa language, synthesized, back translated, and subsequently subjected to expert committee review and pre-testing. The final product (Hausa IPAQ-SF) was tested in a cross-sectional study for concurrent (correlation with the English version) and construct validity, and test-retest reliability in a sample of 102 apparently healthy adults. The Hausa IPAQ-SF has good concurrent validity with Spearman correlation coefficients (ρ) ranging from 0.78 for vigorous activity (Min Week-1) to 0.92 for total physical activity (Metabolic Equivalent of Task [MET]-Min Week-1), but poor construct validity, with cardiorespiratory fitness (ρ = 0.21, p = 0.01) and body mass index (ρ = 0.22, p = 0.04) significantly correlated with only moderate activity and sitting time (Min Week-1), respectively. Reliability was good for vigorous (ICC = 0.73, 95% C.I = 0.55-0.84) and total physical activity (ICC = 0.61, 95% C.I = 0.47-0.72), but fair for moderate activity (ICC = 0.33, 95% C.I = 0.12-0.51), and few meaningful differences were found in the gender and socioeconomic status specific analyses. The Hausa IPAQ-SF has acceptable concurrent validity and test-retest reliability for vigorous-intensity activity, walking, sitting and total physical activity, but demonstrated only fair construct validity for moderate and sitting activities. The Hausa IPAQ-SF can be used for physical activity measurements in Nigeria, but further construct validity testing with objective measures such as an accelerometer is needed.

Psychometric properties of the Chinese version of the Perceived Therapeutic Efficacy Scale for type 2 diabetes.

PubMed

Wu, Shu-Fang Vivienne; Courtney, Mary; Edwards, Helen; McDowell, Jan; Shortridge-Baggett, Lillie M; Chang, Pei-Jen

2008-03-01

The purpose of this study was to test the psychometric properties of the Perceived Therapeutic Efficacy Scale (PTES) for type 2 diabetes with a Taiwanese sample. The mortality rate and health care cost of diabetes have dramatically increased in Taiwan, with many people with diabetes lacking the ability to control their disease appropriately. Addressing this problem requires enhancing self-efficacy towards self-management. Thus, there is a particular need for research into developing a diabetes-specific self-efficacy measurement instrument in Taiwan. This study was undertaken in two stages. Stage 1 consisted of forward and back translation of the PTES into Chinese and examination of content validity. Stage 2 established the validity and reliability of the Chinese version of PTES (C-PTES). A total of 230 people with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic and taking oral medicine were recruited for psychometric testing. Significant criterion-related validity was demonstrated between the C-PTES and the Summary of Diabetes Self-Care Activities scores (r=0.32; p<0.01). Convergent validity was confirmed as the C-PTES converged well with the General Self-Efficacy Scale in measuring self-efficacy (r=0.42; p<0.01); construct validity using factor analysis composed a single subscale. Internal consistency showed Cronbach's alpha was 0.95 and the test-retest reliability (Pearson's correction) was 0.79 (p<0.01) and a Bland-Altman plot showed that 97% of the subjects were within two standard deviations of the mean. The results of reliability and validity strengthen confidence in using the C-PTES. The C-PTES requires future studies to confirm the psychometric properties.

Probabilistic volcanic hazard assessments of Pyroclastic Density Currents: ongoing practices and future perspectives

NASA Astrophysics Data System (ADS)

Tierz, Pablo; Sandri, Laura; Ramona Stefanescu, Elena; Patra, Abani; Marzocchi, Warner; Costa, Antonio; Sulpizio, Roberto

2014-05-01

Explosive volcanoes and, especially, Pyroclastic Density Currents (PDCs) pose an enormous threat to populations living in the surroundings of volcanic areas. Difficulties in the modeling of PDCs are related to (i) very complex and stochastic physical processes, intrinsic to their occurrence, and (ii) to a lack of knowledge about how these processes actually form and evolve. This means that there are deep uncertainties (namely, of aleatory nature due to point (i) above, and of epistemic nature due to point (ii) above) associated to the study and forecast of PDCs. Consequently, the assessment of their hazard is better described in terms of probabilistic approaches rather than by deterministic ones. What is actually done to assess probabilistic hazard from PDCs is to couple deterministic simulators with statistical techniques that can, eventually, supply probabilities and inform about the uncertainties involved. In this work, some examples of both PDC numerical simulators (Energy Cone and TITAN2D) and uncertainty quantification techniques (Monte Carlo sampling -MC-, Polynomial Chaos Quadrature -PCQ- and Bayesian Linear Emulation -BLE-) are presented, and their advantages, limitations and future potential are underlined. The key point in choosing a specific method leans on the balance between its related computational cost, the physical reliability of the simulator and the pursued target of the hazard analysis (type of PDCs considered, time-scale selected for the analysis, particular guidelines received from decision-making agencies, etc.). Although current numerical and statistical techniques have brought important advances in probabilistic volcanic hazard assessment from PDCs, some of them may be further applicable to more sophisticated simulators. In addition, forthcoming improvements could be focused on three main multidisciplinary directions: 1) Validate the simulators frequently used (through comparison with PDC deposits and other simulators), 2) Decrease simulator runtimes (whether by increasing the knowledge about the physical processes or by doing more efficient programming, parallelization, ...) and 3) Improve uncertainty quantification techniques.

Reliability and known-group validity of the Arabic version of the 8-item Morisky Medication Adherence Scale among type 2 diabetes mellitus patients.

PubMed

Ashur, S T; Shamsuddin, K; Shah, S A; Bosseri, S; Morisky, D E

2015-12-13

No validation study has previously been made for the Arabic version of the 8-item Morisky Medication Adherence Scale (MMAS-8(©)) as a measure for medication adherence in diabetes. This study in 2013 tested the reliability and validity of the Arabic MMAS-8 for type 2 diabetes mellitus patients attending a referral centre in Tripoli, Libya. A convenience sample of 103 patients self-completed the questionnaire. Reliability was tested using Cronbach alpha, average inter-item correlation and Spearman-Brown coefficient. Known-group validity was tested by comparing MMAS-8 scores of patients grouped by glycaemic control. The Arabic version showed adequate internal consistency (α = 0.70) and moderate split-half reliability (r = 0.65). Known-group validity was supported as a significant association was found between medication adherence and glycaemic control, with a moderate effect size (ϕc = 0.34). The Arabic version displayed good psychometric properties and could support diabetes research and practice in Arab countries.

Evaluation of using the Chinese version of the Spirituality Index of Well-Being (SIWB) scale in Taiwanese elders.

PubMed

Lee, Yi-Hui; Salman, Ali

2016-11-01

Spirituality and spiritual well-being have emerged as important indicators for one's quality of life and health outcomes. Nursing as a profession is concerned with a holistic approach to improve health and overall well-being. To evaluate the outcomes of holistic nursing interventions, using valid and reliable instruments to assess spiritual well-being becomes necessary. There is a lack of instruments for measuring spiritual well-being in Chinese populations. Little has been known about the feasibility of using the Spirituality Index of Well-Being (SIWB) in Taiwanese elders. The purpose of this cross-sectional study was to evaluate the uses of the translated Chinese version of the Spirituality Index of Well-Being (SIWB-C) with Taiwanese elders. A total of 150 individual who were 65 years old or older and living in southern Taiwan were recruited from a public community center. A four-step procedure was used to translate the English version of the SIWB to the traditional Chinese language. Internal consistency, factor analysis, and correlation coefficient were conducted to evaluate the reliability and validity of the SIWB-C. The SIWB-C demonstrated a high internal consistency with Cronbach's alpha .95. The construct validity of SIWB-C was supported by factor analysis and by significant correlations with its subscales and the CES-D scale. The psychometric analysis indicates that the SIWB-C is a valid and reliable instrument for measuring spiritual well-being. This instrument provides a feasible and valid approach for assessing Taiwanese elders' spiritual well-being in the future. Copyright © 2016 Elsevier Inc. All rights reserved.

Psychometric properties of the Anxiety Inventory for Respiratory Disease in patients with COPD in China.

PubMed

Dong, Xiao-Yan; Wang, Lan; Tao, Yan-Xia; Suo, Xiu-Li; Li, Yue-Chuan; Liu, Fang; Zhao, Yue; Zhang, Qing

2017-01-01

Anxiety is a common comorbidity in patients with COPD in China, and it can significantly decrease patients' quality of life. Almost all anxiety measurements contain somatic items that can overlap with symptoms of COPD and side effects of medicines, which can lead to bias in measuring anxiety in patients with COPD. Therefore, a brief and disease-specific non-somatic anxiety measurement scale, the Anxiety Inventory for Respiratory Disease (AIR), which has been developed and validated in its English version, is needed for patients with COPD in China. A two-center study was conducted in two tertiary hospitals in Tianjin, China. A total of 181 outpatients with COPD (mean age 67.21±8.10 years, 32.6% women), who met the inclusion and exclusion criteria, were enrolled in the study. Test-retest reliability was examined using intraclass correlation coefficients. The internal consistency was calculated by Cronbach's α . Content validity was examined using the Content Validity Index (CVI), scale-level CVI/universal agreement, and scale-level CVI/average agreement (S-CVI/Ave). Besides, convergent validity and construct validity were also examined. The AIR-C (AIR-Chinese version) scale had high test-retest reliability (intraclass correlation coefficient =0.904) and internal consistency (Cronbach's α =0.914); the content validity of the AIR-C scale was calculated by CVI, scale-level CVI/universal agreement, and S-CVI/Ave at values of 0.89-1, 0.90, and 0.98, respectively. Meanwhile, the AIR-C scale had good convergent validity, correlating with the Hospital Anxiety and Depression Scale-Anxiety ( r =0.81, P <0.01), and there were significant correlations between the AIR-C and Clinical COPD Questionnaire (CCQ; r =0.44, P <0.01) and Activities of Daily Living Scale (ADLS; r =0.36, P <0.01). A two-factor model of general anxiety and panic symptoms in the AIR-C scale had the best fit according to Confirmatory Factor Analysis (CFA). The AIR-C scale had a good reliability and validity for patients with COPD and can be used as a user-friendly and valid tool for measuring anxiety symptoms among patients with COPD in China.

Quantitative measurement of hypertrophic scar: interrater reliability and concurrent validity.

PubMed

Nedelec, Bernadette; Correa, José A; Rachelska, Grazyna; Armour, Alexis; LaSalle, Léo

2008-01-01

Research into the pathophysiology and treatment of hypertrophic scar (HSc) remains limited by the heterogeneity of scar and the imprecision with which its severity is measured. The objective of this study was to test the interrater reliability and concurrent validity of the Cutometer measurement of elasticity, the Mexameter measurement of erythema and pigmentation, and total thickness measure of the DermaScan C relative to the modified Vancouver Scar Scale (mVSS) in patient-matched normal skin, normal scar, and HSc. Three independent investigators evaluated 128 sites (severe HSc, moderate or mild HSc, donor site, and normal skin) on 32 burn survivors using all of the above measurement tools. The intraclass correlation coefficient, which was used to measure interrater reliability, reflects the inherent amount of error in the measure and is considered acceptable when it is >0.75. Interrater reliability of the totals of the height, pliability, and vascularity subscales of the mVSS fell below the acceptable limit ( congruent with0.50). The individual subscales of the mVSS fell well below the acceptable level (< or =0.3). The Cutometer reading of elasticity provided acceptable reliability (>0.89) for each study site with the exception of severe scar. Mexameter and DermaScan C reliability measurements were acceptable for all sites (>0.82). Concurrent validity correlations with the mVSS were significant except for the comparison of the mVSS pliability subscale and the Cutometer maximum deformation measure comparison in severe scar. In conclusion, the Mexameter and DermaScan C measurements of scar color and thickness of all sites, as well as the Cutometer measurement of elasticity in all but the most severe scars shows high interrater reliability. Their significant concurrent validity with the mVSS confirms that these tools are measuring the same traits as the mVSS, and in a more objective way.

Creation of the TXP parenting questionnaire and study of its psychometric properties.

PubMed

Benito, Ana; Calvo, Gema; Real-López, Matías; Gallego, María José; Francés, Sonia; Turbi, Ángel; Haro, Gonzalo

2018-01-15

Parenting is linked to conduct disorders (CD) and substance related disorders (SRD) in adolescents, but with differences according to cultural context. A questionnaire with two versions (parenting questionnaire TXP-A for adolescents and TXP-C  for primary caregivers) was designed using the Delphi method to evaluate parenting practices related to CD and SRD in a Spanish population. It was validated in a community sample of 631 adolescents aged between 14 and 16 and their caregivers. Results suggest a 29-item TXP-A questionnaire with bifactorial structure: affection-communication and control-structure, with high internal (Cronbach’s alpha=0.89) and test-retest (intraclass correlation coefficient=0.94) reliabilities. Both factors are related to SRD (r=0.273, p<0.001) and with most of the psychopathological dimensions studied. The total score and affection-communication are related to dissocial disorder (t=3.259, p=0.001) and its severity (r=-0,119; p=0.003). Inter-observer reliability between adolescents and caregivers is low, in part because the 16-item TXP-C has a different bifactorial structure: affection-communication and prosocial values. TXP-C’s internal (Cronbach’s alpha=0.87) and test-retest (intraclass correlation coefficient=0.94) reliabilities are high. The total score and affection-communication were related to dissocial disorder (t=2.586; p=0.010) but TXP-C did not discriminate according to SRD. In conclusion, the TXP-A questionnaire for adolescents seems to be a reliable, valid and unbiased instrument that evaluates the perception of parenting practices, relating higher affection-communication and control-structure to less psychopathology and alcohol and drug use. TXP-C also seems to be reliable and unbiased, but shows less evidence of validity regarding substance use and psychopathology. .

Reliability and Validity of a Chinese-Translated Version of a Pregnancy Physical Activity Questionnaire.

PubMed

Xiang, Mi; Konishi, Massayuki; Hu, Huanhuan; Takahashi, Masaki; Fan, Wenbi; Nishimaki, Mio; Ando, Karina; Kim, Hyeon-Ki; Tabata, Hiroki; Arao, Takashi; Sakamoto, Shizuo

2016-09-01

Objectives The objectives of the present study were to translate the English version of the Pregnancy Physical Activity Questionnaire into Chinese (PPAQ-C) and to determine its reliability and validity for use by pregnant Chinese women. Methods The study included 224 pregnant women during their first, second, or third trimesters of pregnancy who completed the PPAQ-C on their first visit and wore a uniaxial accelerometer (Lifecorder; Suzuken Co. Ltd) for 7 days. One week after the first visit, we collected the data from the uniaxial accelerometer records, and the women were asked to complete the PPAQ-C again. Results We used intraclass correlation coefficients to determine the reliability of the PPAQ-C. The intraclass correlation coefficients were 0.77 for total activity (light and above), 0.76 for sedentary activity, 0.75 for light activity, 0.59 for moderate activity, and 0.28 for vigorous activity. The intraclass correlation coefficients were 0.74 for "household and caregiving", 0.75 for "occupational" activities, and 0.34 for "sports/exercise". Validity between the PPAQ-C and accelerometer data was determined by Spearman correlation coefficients. Although there were no significant correlations for moderate activity (r = 0.19, P > 0.05) or vigorous activity (r = 0.15, P > 0.05), there were significant correlations for total activity [light and above; r = 0.35, P < 0.01)] and for light activity (r = 0.33, P < 0.01). Conclusions for Practice The PPAQ-C is reliable and moderately accurate for measuring physical activity in pregnant Chinese women.

Establishing high resolution melting analysis: method validation and evaluation for c-RET proto-oncogene mutation screening.

PubMed

Benej, Martin; Bendlova, Bela; Vaclavikova, Eliska; Poturnajova, Martina

2011-10-06

Reliable and effective primary screening of mutation carriers is the key condition for common diagnostic use. The objective of this study is to validate the method high resolution melting (HRM) analysis for routine primary mutation screening and accomplish its optimization, evaluation and validation. Due to their heterozygous nature, germline point mutations of c-RET proto-oncogene, associated to multiple endocrine neoplasia type 2 (MEN2), are suitable for HRM analysis. Early identification of mutation carriers has a major impact on patients' survival due to early onset of medullary thyroid carcinoma (MTC) and resistance to conventional therapy. The authors performed a series of validation assays according to International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) guidelines for validation of analytical procedures, along with appropriate design and optimization experiments. After validated evaluation of HRM, the method was utilized for primary screening of 28 pathogenic c-RET mutations distributed among nine exons of c-RET gene. Validation experiments confirm the repeatability, robustness, accuracy and reproducibility of HRM. All c-RET gene pathogenic variants were detected with no occurrence of false-positive/false-negative results. The data provide basic information about design, establishment and validation of HRM for primary screening of genetic variants in order to distinguish heterozygous point mutation carriers among the wild-type sequence carriers. HRM analysis is a powerful and reliable tool for rapid and cost-effective primary screening, e.g., of c-RET gene germline and/or sporadic mutations and can be used as a first line potential diagnostic tool.

Validation and application of the Chinese version of the Perceived Stress Questionnaire (C-PSQ) in nursing students

PubMed Central

Cao, Xiaoping; Tang, Shuang; Fang, Hongzhi; Zhao, Xing; Liu, Bing

2018-01-01

Objective To translate the Perceived Stress Questionnaire (PSQ) into Chinese, validate its reliability and validity in nursing students and investigate the perceived stress level of nursing students. Method Forward- and back-translation combined with expert assessment and cross-cultural adaptations were used to construct the Chinese version of the PSQ (C-PSQ). This research adopted a stratified sampling method among 1,519 nursing students in 30 classes of Ningbo College of Health Sciences to assess the reliability and validity of the C-PSQ. Among them, we used the Recent C-PSQ (only the last month). Results The C-PSQ retained all 30 items of the original scale. Principal component analysis extracted five factors that explained 52.136% of the total variance. The S-CVI/Ave was 0.913. Concurrent validity was 0.525 and 0.567 for anxiety and depression respectively. The results of the confirmatory factor analysis were as follows: χ2/df = 4.376, RMR = 0.023, GFI = 0.921, AGFI = 0.907, CFI = 0.916, RMSEA = 0.048, PNFI = 0.832, PGFI = 0.782, CN = 342 and AIC/CAIC = 0.809. The scale’s Cronbach’s alpha was 0.922, and Cronbach’s α of each dimension was 0.899 (worries/tension), 0.821 (joy), 0.688 (overload), 0.703 (conflict), 0.523 (self-realization). The correlation coefficient between the first and second test, the first and third test and the second and third test was 0.725, 0.787 and 0.731, respectively. Mean values and distribution of overall PSQ index in nursing students was 0.399 ± 0.138. Different demographic factors were significantly associated with the perceived stress of nursing students. Conclusion The C-PSQ has an appropriate reliability and validity, which means that the scale can be used as a universal tool for psychosomatic studies. The perceived stress of nursing students was relatively high. Further studies are needed. PMID:29568711

Civilian Availability Model.

DTIC Science & Technology

1991-07-01

23 Accession For NTIS GRA&I / DTIC TAB Unannounced El Justificatio By-- _DI!A; tr 1tit Ion/ Av~h-.b111ty Codes Avrail and/or Dist p.Cq FIGURES Figure...N3 :EGM.ENTATION1 EN T;;Y ~MSTA NZ AP ZS S 7’-’AT E S A’ POTENTIAL YATS I__ _ DATA INTEGRATED TRENCS AND0 DATA EC. -NIIIA E M T NC IC AT CPS DA TA 7...Coefficient ( TIC ). For an extended discussion of these three measures, refer to Appendix A of Stone, Looper, and McGarrity, 1989. The equation

School-based behavioral assessment tools are reliable and valid for measurement of fruit and vegetable intake, physical activity, and television viewing in young children.

PubMed

Economos, Christina D; Sacheck, Jennifer M; Kwan Ho Chui, Kenneth; Irizarry, Laura; Irizzary, Laura; Guillemont, Juliette; Collins, Jessica J; Hyatt, Raymond R

2008-04-01

Interventions aiming to modify the dietary and physical activity behaviors of young children require precise and accurate measurement tools. As part of a larger community-based project, three school-based questionnaires were developed to assess (a) fruit and vegetable intake, (b) physical activity and television (TV) viewing, and (c) perceived parental support for diet and physical activity. Test-retest reliability was performed on all questionnaires and validity was measured for fruit and vegetable intake, physical activity, and TV viewing. Eighty-four school children (8.3+/-1.1 years) were studied. Test-retest reliability was performed by administering questionnaires twice, 1 to 2 hours apart. Validity of the fruit and vegetable questionnaire was measured by direct observation, while the physical activity and TV questionnaire was validated by a parent phone interview. All three questionnaires yielded excellent test-retest reliability (P<0.001). The majority of fruit and vegetable questions and the questions regarding specific physical activities and TV viewing were valid. Low validity scores were found for questions on watching TV during breakfast or dinner. These questionnaires are reliable and valid tools to assess fruit and vegetable intake, physical activity, and TV viewing behaviors in early elementary school-aged children. Methods for assessment of children's TV viewing during meals should be further investigated because of parent-child discrepancies.

Development and validation of the Chinese version of the Diabetes Management Self-efficacy Scale.

PubMed

Vivienne Wu, Shu-Fang; Courtney, Mary; Edwards, Helen; McDowell, Jan; Shortridge-Baggett, Lillie M; Chang, Pei-Jen

2008-04-01

The purpose of this study was to translate the Diabetes Management Self-Efficacy Scale (DMSES) into Chinese and test the validity and reliability of the instrument within a Taiwanese population. A two-stage design was used for this study. Stage I consisted of a multi-stepped process of forward and backward translation, using focus groups and consensus meetings to translate the 20-item Australia/English version DMSES to Chinese and test content validity. Stage II established the psychometric properties of the Chinese version DMSES (C-DMSES) by examining the criterion, convergent and construct validity, internal consistency and stability testing. The sample for Stage II comprised 230 patients with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic in Taiwan. Three items were modified to better reflect Chinese practice. The C-DMSES obtained a total average CVI score of .86. The convergent validity of the C-DMSES correlated well with the validated measure of the General Self-Efficacy Scale in measuring self-efficacy (r=.55; p<.01). Criterion-related validity showed that the C-DMSES was a significant predictor of the Summary of Diabetes Self-Care Activities scores (Beta=.58; t=10.75, p<.01). Factor analysis supported the C-DMSES being composed of four subscales. Good internal consistency (Cronbach's alpha=.77 to .93) and test-retest reliability (Pearson correlation coefficient r=.86, p<.01) were found. The C-DMSES is a brief and psychometrically sound measure for evaluation of self-efficacy towards management of diabetes by persons with type 2 diabetes in Chinese populations.

Development and validation of a cancer-specific swallowing assessment tool: MASA-C.

PubMed

Carnaby, Giselle D; Crary, Michael A

2014-03-01

We present data from a sample of patients receiving radiotherapy for head/neck cancer to define and measure the validity of a new clinical assessment measure for swallowing. Fifty-eight patients undergoing radiotherapy (±chemotherapy) for head/neck cancer (HNC) supported the development of a physiology-based assessment tool of swallowing (Mann Assessment of Swallowing Ability--Cancer: MASA-C) administered at two time points (baseline and following radiotherapy treatment). The new exam was evaluated for internal consistency of items using Cronbach's alpha. Reliability of measurement was evaluated with intraclass correlation (ICC) and the Kappa statistic between two independent raters. Concurrent validity was established through comparison with the original MASA examination and against the referent standard videofluoroscopic swallowing examination (VFE). Sensitivity, specificity, and likelihood ratios along with 95 % confidence intervals (CIs) were derived for comparison of the two evaluation forms (MASA vs. MASA-C). Accuracy of diagnostic precision was displayed using receiver operator characteristic curves. The new MASA-C tool demonstrated superior validity to the original MASA examination applied to a HNC population. In comparison to the VFE referent exam, the MASA-C revealed strong sensitivity and specificity (Se 83, Sp 96), predictive values (positive predictive value (PPV) 0.95, negative predictive value (NPV) 0.86), and likelihood ratios (21.6). In addition, it demonstrated good reliability (ICC = 0.96) between speech-language pathology raters. The MASA-C is a reliable and valid scale that is sensitive to differences in swallowing performance in HNC patients with and without dysphagia. Future longitudinal evaluation of this tool in larger samples is suggested. The development and refinement of this swallowing assessment tool for use in multidisciplinary HNC teams will facilitate earlier identification of patients with swallowing difficulties and enable more efficient allocation of resources to the management of dysphagia in this population. The MASA-C may also prove useful in future clinical HNC rehabilitation trials with this population.

Reliability and validity enhancement: a treatment package for increasing fidelity of self-report.

PubMed

Bornstein, P H; Hamilton, S B; Miller, R K; Quevillon, R P; Spitzform, M

1977-07-01

This study investigated the effects of reliability and validity "enhancers" on fidelity of self-report data in an analogue therapy situation. Under the guise of a Concentration Skills Training Program, 57 Ss were assigned randomly to one of the following conditions: (a) Reliability Enhancement; (b) Truth Talk; (c) No Comment Control. Results indicated significant differences among groups (p less than .05). In addition, tests of multiple comparisons revealed that Reliability Enhancement was significantly different from Truth Talk in occurrences of unreliability (p less than .05). These findings are discussed in light of the increased reliance on self-report data in behavioral intervention, and recommendations are made for future research.

Measuring the Nursing Work Environment in Mainland China: Further Development of the Chinese Nursing Work Environment Scale.

PubMed

Shao, Jing; Tang, Leiwen; Ye, Zhihong

For the stabilization of the nursing profession in mainland China, a valid and reliable nursing work environment instrument, grounded in China's context, should be developed to better provide rigorous evidence for policy makers. The purpose of the current research was to further develop a scale that could capture the characteristics of the nursing work environment in mainland China. A convenience sample of 542 nurses employed in a tertiary hospital of mainland China completed the 108-item Chinese Nursing Work Environment (C-NWE) Scale (1st ed.). Items that did not differentiate between respondents with the highest and lowest 27% of total scores and those that did not meet criteria for factor loadings were set aside. Exploratory factor analysis based on the maximum likelihood method was used to identify the structure of the scale. The chi-square test was used to evaluate model fit, and expert review was conducted to test content validity. Reliability was estimated using Cronbach's alpha coefficient. The revised C-NWE Scale, which consists of nine subscales and 47 items, is a simplified version of the C-NWE (1st ed.). Using exploratory maximum likelihood factor analysis, the normed chi-square fit index for a nine-factor solution was 1.97. The content validity index for the total scale was 0.93; Cronbach's alpha was .94. Initial evidence of the psychometric properties of C-NWE scores was presented. Further studies could be conducted in various settings to identify the C-NWE Scale's validity and reliability.

Psychometric evaluation of the Chinese version of the fear of intimacy with helping professionals scale

PubMed Central

Chan, Kin Sun

2018-01-01

Objectives This study aimed to evaluate the internal consistency, reliability, convergent validity, known-group comparisons, and structural validity of the Chinese version of Fear of Intimacy with Helping Professionals (C–FIS–HP) scale in Macau. Methods A cross-sectional design was used on a sample of 593 older people in 6 health centers. We used Chinese version of Exercise of Self-Care Agency Scale (C-ESCAS) and Morisky 4-item medication adherence scale to evaluate self-care actions and medication adherence. The internal consistency and reliability of C–FIS–HP were analyzed using the Spearman-Brown split-half reliability, Cronbach’s alpha, and test–retest reliability. Convergent validity was tested the construct of C–FIS–HP and self-care actions. Known-group comparisons differentiated predefined groups in an expected direction. Two separated samples were used to test the structural validity. An exploratory factor analysis (EFA) tested the factor structure of C–FISHP using the principal axis factoring. A confirmatory factor analysis (CFA) was further conducted to confirm the factor structure constructed in the prior EFA. Results The C–FIS–HP had a Spearman-Brown split-half coefficient, Cronbach’s alpha, and intraclass correlation coefficient of 0.96, 0.93, and 0.96, respectively. Convergent validity was satisfactory with significantly correlations between the C-FIS-HP and C-ESCAS. C–FIS–HP to differentiate the differences between high-, moderate-, and low- medication adherence groups. EFA demonstrated a two-factor structure among 297 older people. A first-order CFA was performed to confirm the construct dimensionality of C–FIS–HP with satisfactory fit indices (NFI = 0.92; IFI = 0.95; TLI = 0.94; CFI = 0.95 and RMSEA = 0.07) among 296 older people. Conclusions C–FIS–HP is a reliable and valid test for assessing helping relationships in older Chinese people. Health professionals can use C–FIS–HP as a clinical tool to assess the comfort level of patients in a helping relationship, and use this information to develop culturally sensitive therapeutic interventions and treatment plans. Further studies need to be conducted concerning the different psychometric properties, as well as the application of C–FIS–HP in various regions. PMID:29795563

An Italian multicentre validation study of the coma recovery scale-revised.

PubMed

Estraneo, A; Moretta, P; De Tanti, A; Gatta, G; Giacino, J T; Trojano, L

2015-10-01

Rate of misdiagnosis of disorders of consciousness (DoC) can be reduced by employing validated clinical diagnostic tools, such as the Coma Recovery Scale-Revised (CRS-R). An Italian version of the CRS-R has been recently developed, but its applicability across different clinical settings, and its concurrent validity and diagnostic sensitivity have not been estimated yet. To perform a multicentre validation study of the Italian version of the Coma Recovery Scale-Revised (CRS-R). Analysis of inter-rater reliability, concurrent validity and diagnostic sensitivity of the scale. One Intensive Care Unit, 8 Post-acute rehabilitation centres and 2 Long-term facilities Twenty-seven professionals (physicians, N.=11; psychologists, N.=5; physiotherapists, N.=3; speech therapists, N.=6; nurses, N.=2) from 11 Italian Centres. CRS-R and Disability Rating Scale (DRS) applied to 122 patients with clinical diagnosis of Vegetative State (VS) or Minimally Conscious State (MCS). CRS-R has good-to-excellent inter-rater reliability for all subscales, particularly for the communication subscale. The Italian version of the CRS-R showed a high sensitivity and specificity in detecting MCS with reference to clinical consensus diagnosis. The CRS-R showed good concurrent validity with the Disability Rating Scale, which had very low specificity with reference to clinical consensus diagnosis. The Italian version of the CRS-R is a valid scale for use from the sub-acute to chronic stages of DoC. It can be administered reliably by all members of the rehabilitation team with different specialties, levels of experience and settings. The present study promote use of the Italian version of the CRS-R to improve diagnosis of DoC patients, and plan tailored rehabilitation treatment.

Validation of the German prostate-specific module.

PubMed

Bestmann, Beate; Rohde, Volker; Siebmann, Jens-Ulrich; Galalae, Razvan; Weidner, Wolfgang; Küchler, Thomas

2006-02-01

Theoretically, all patients newly diagnosed with prostate cancer are faced with a choice of treatment options: radical prostatectomy or radio therapy. Although these different treatments may have no differences in terms of survival, they may have very different consequences on the subsequent quality of life (QoL). Prerequisite to analyze QoL is a reliable and valid instrument to assess these differences not only in terms of general QoL (EORTC QLQ-C30) but prostate specific symptoms with a prostate specific module as well. Therefore, the aim of this study was a psychometric evaluation (validation) of the prostate-specific module (PSM). Five historical cohort studies were put together for an empirical meta-analysis. The main objective was to analyze the module's psychometric properties. The total sample consisted of 1,185 patients, of whom 950 completed the QoL questionnaires (EORTC QLQ-C30 and a prostate specific module developed by Kuechler et al.). First step of analysis was a principal component analysis that revealed the following scales: urinary problems, incontinence, erectile dysfunction, sexual problems, problems with partner, pain, heat, nutrition, and psychic strain. The module showed good reliability and concurrent validity and very good construct validity, since the module is able to discriminate between different treatment regimes, tumor stages and age. The German PSM is a reliable, valid and applicable tool for QoL in patients with prostate cancer.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Reliability and validity of procedure-based assessments in otolaryngology training.

PubMed

Awad, Zaid; Hayden, Lindsay; Robson, Andrew K; Muthuswamy, Keerthini; Tolley, Neil S

2015-06-01

To investigate the reliability and construct validity of procedure-based assessment (PBA) in assessing performance and progress in otolaryngology training. Retrospective database analysis using a national electronic database. We analyzed PBAs of otolaryngology trainees in North London from core trainees (CTs) to specialty trainees (STs). The tool contains six multi-item domains: consent, planning, preparation, exposure/closure, technique, and postoperative care, rated as "satisfactory" or "development required," in addition to an overall performance rating (pS) of 1 to 4. Individual domain score, overall calculated score (cS), and number of "development-required" items were calculated for each PBA. Receiver operating characteristic analysis helped determine sensitivity and specificity. There were 3,152 otolaryngology PBAs from 46 otolaryngology trainees analyzed. PBA reliability was high (Cronbach's α 0.899), and sensitivity approached 99%. cS correlated positively with pS and level in training (rs : +0.681 and +0.324, respectively). ST had higher cS and pS than CT (93% ± 0.6 and 3.2 ± 0.03 vs. 71% ± 3.1 and 2.3 ± 0.08, respectively; P < .001). cS and pS increased from CT1 to ST8 showing construct validity (rs : +0.348 and +0.354, respectively; P < .001). The technical skill domain had the highest utilization (98% of PBAs) and was the best predictor of cS and pS (rs : +0.96 and +0.66, respectively). PBA is reliable and valid for assessing otolaryngology trainees' performance and progress at all levels. It is highly sensitive in identifying competent trainees. The tool is used in a formative and feedback capacity. The technical domain is the best predictor and should be given close attention. NA. © 2014 The American Laryngological, Rhinological and Otological Society, Inc.

Which symptom assessments and approaches are uniquely appropriate for paediatric concussion?

PubMed

Gioia, G A; Schneider, J C; Vaughan, C G; Isquith, P K

2009-05-01

To (a) identify post-concussion symptom scales appropriate for children and adolescents in sports; (b) review evidence for reliability and validity; and (c) recommend future directions for scale development. Quantitative and qualitative literature review of symptom rating scales appropriate for children and adolescents aged 5 to 22 years. Literature identified via search of Medline, Ovid-Medline and PsycInfo databases; review of reference lists in identified articles; querying sports concussion specialists. 29 articles met study inclusion criteria. 5 symptom scales examined in 11 studies for ages 5-12 years and in 25 studies for ages 13-22. 10 of 11 studies for 5-12-year-olds presented validity evidence for three scales; 7 studies provided reliability evidence for two scales; 7 studies used serial administrations but no reliable change metrics. Two scales included parent-reports and one included a teacher report. 24 of 25 studies for 13-22 year-olds presented validity evidence for five measures; seven studies provided reliability evidence for four measures with 18 studies including serial administrations and two examining Reliable Change. Psychometric evidence for symptom scales is stronger for adolescents than for younger children. Most scales provide evidence of concurrent validity, discriminating concussed and non-concussed groups. Few report reliability and evidence for validity is narrow. Two measures include parent/teacher reports. Few scales examine reliable change statistics, limiting interpretability of temporal changes. Future studies are needed to fully define symptom scale psychometric properties with the greatest need in younger student-athletes.

The FLIR ONE thermal imager for the assessment of burn wounds: Reliability and validity study.

PubMed

Jaspers, M E H; Carrière, M E; Meij-de Vries, A; Klaessens, J H G M; van Zuijlen, P P M

2017-11-01

Objective measurement tools may be of great value to provide early and reliable burn wound assessment. Thermal imaging is an easy, accessible and objective technique, which measures skin temperature as an indicator of tissue perfusion. These thermal images might be helpful in the assessment of burn wounds. However, before implementation of a novel measurement tool into clinical practice is considered, it is appropriate to test its clinimetric properties (i.e. reliability and validity). The objective of this study was to assess the reliability and validity of the recently introduced FLIR ONE thermal imager. Two observers obtained thermal images of burn wounds in adult patients at day 1-3, 4-7 and 8-10 after burn. Subsequently, temperature differences between the burn wound and healthy skin (ΔT) were calculated on an iPad mini containing the FLIR Tools app. To assess reliability, ΔT values of both observers were compared by calculating the intraclass correlation coefficient (ICC) and measurement error parameters. To assess validity, the ΔT values of the first observer were compared to the registered healing time of the burn wounds, which was specified into three categories: (I) ≤14 days, (II) 15-21 days and (III) >21 days. The ability of the FLIR ONE to discriminate between healing ≤21 days and >21 days was evaluated by means of a receiver operating characteristic curve and an optimal ΔT cut-off value. Reliability: ICCs were 0.99 for each time point, indicating excellent reliability up to 10 days after burn. The standard error of measurement varied between 0.17-0.22°C. the area under the curve was calculated at 0.69 (95% CI 0.54-0.84). A cut-off value of -1.15°C shows a moderate discrimination between burn wound healing ≤21 days and >21 days (46% sensitivity; 82% specificity). Our results show that the FLIR ONE thermal imager is highly reliable, but the moderate validity calls for additional research. However, the FLIR ONE is pre-eminently feasible, allowing easy and fast measurements in clinical burn practice. Copyright © 2017 Elsevier Ltd and ISBI. All rights reserved.

Assessing fidelity in individual and family therapy for adolescent substance abuse.

PubMed

Hogue, Aaron; Dauber, Sarah; Chinchilla, Priscilla; Fried, Adam; Henderson, Craig; Inclan, Jaime; Reiner, Robert H; Liddle, Howard A

2008-09-01

This study introduces an observational measure of fidelity in evidence-based practices for adolescent substance abuse treatment. The Therapist Behavior Rating Scale-Competence (TBRS-C) measures adherence and competence in individual cognitive-behavioral therapy and multidimensional family therapy for adolescent substance abuse. The TBRS-C assesses fidelity to the core therapeutic goals of each approach and also contains global ratings of therapist competence. Study participants were 136 clinically referred adolescents and their families observed in 437 treatment sessions. The TBRS-C demonstrated strong interrater reliability for goal-specific ratings of treatment adherence, and modest reliability for goal-specific and global ratings of therapist competence, evidence of construct validity, and discriminant validity with an observational measure of therapeutic alliance. The utility of the TBRS-C for evaluating treatment fidelity in field settings is discussed.

75 FR 5779 - Proposed Emergency Agency Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-04

... proposed collection of information, including the validity of the methodology and assumptions used; (c... Collection Request Title: Electricity Delivery and Energy Reliability Recovery Act Smart Grid Grant Program..., Chief Operating Officer, Electricity Delivery and Energy Reliability. [FR Doc. 2010-2422 Filed 2-3-10; 8...

Comparison of three shortened questionnaires for assessment of quality of life in advanced cancer.

PubMed

Chiu, Leonard; Chiu, Nicholas; Chow, Edward; Cella, David; Beaumont, Jennifer L; Lam, Henry; Popovic, Marko; Bedard, Gillian; Poon, Michael; Wong, Erin; Zeng, Liang; Bottomley, Andrew

2014-08-01

Quality of life (QoL) assessment questionnaires can be burdensome to advanced cancer patients, thus necessitating the need for shorter assessment instruments than traditionally available. We compare three shortened QoL questionnaires in regards to their characteristics, validity, and reliability. A literature search was conducted to identify studies that employed or discussed three abridged QoL questionnaires: the European Organization for Research and Treatment of Cancer Quality of Life Core 15-Palliative Care (EORTC QLQ-C15-PAL), the Functional Assessment of Cancer Therapy-General-7 (FACT-G7), and the Functional Assessment of Chronic Illness Therapy-Palliative Care-14 (FACIT-PAL-14). Articles that discussed questionnaire length, intended use, scoring procedure, and validation were included. The 7-item FACT-G7 is the shortest instrument, whereas the EORTC QLQ-C15-PAL and the FACIT-PAL-14 contain 14 and 15 items, respectively. All three questionnaires have similar recall period, item organization, and subscale components. Designed as core questionnaires, all three maintain content and concurrent validity of their unabridged original questionnaires. Both the EORTC QLQ-C15-PAL and the FACT-G7 demonstrate good internal consistency and reliability, with Cronbach's α ≥0.7 deemed acceptable. The developmental study for the FACIT-PAL-14 was published in 2013 and subsequent validation studies are not yet available. The EORTC QLQ-C15-PAL and the FACT-G7 were found to be reliable and appropriate for assessing health-related QoL issues-the former for palliative cancer patients and the latter for advanced cancer patients receiving chemotherapy. Conceptually, the FACIT-PAL-14 holds promise to cover social and emotional support issues that are not completely addressed by the other two questionnaires; however, further validation is needed.

The brief multidimensional students' life satisfaction scale-college version.

PubMed

Zullig, Keith J; Huebner, E Scott; Patton, Jon M; Murray, Karen A

2009-01-01

To investigate the psychometric properties of the BMSLSS-College among 723 college students. Internal consistency estimates explored scale reliability, factor analysis explored construct validity, and known-groups validity was assessed using the National College Youth Risk Behavior Survey and Harvard School of Public Health College Alcohol Study. Criterion-related validity was explored through analyses with the CDC's health-related quality of life scale and a social isolation scale. Acceptable internal consistency reliability, construct, known-groups, and criterion-related validity were established. Findings offer preliminary support for the BMSLSS-C; it could be useful in large-scale research studies, applied screening contexts, and for program evaluation purposes toward achieving Healthy People 2010 objectives.

Reliability and validity of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in evaluations of chronic low back pain patients.

PubMed

Tarescavage, Anthony M; Scheman, Judith; Ben-Porath, Yossef S

2015-06-01

The purpose of the current study was to investigate the reliability and concurrent validity of Minnesota Multiphasic Personality Inventory (MMPI)-2-Restructured Form (2-RF) (Ben-Porath & Tellegen, 2008/2011) scores in a sample of 811 chronic low back pain patients (346 males, 529 females) beginning treatment in a short-term interdisciplinary pain rehabilitation program. We calculated internal consistency coefficients, mean-item correlations, and SEM for all substantive scales, as well as zero-order correlations with collateral medical record information and self-report testing. Results indicated reliability and validity for most of the MMPI-2-RF substantive scales. Implications of these findings and limitations of this study are discussed. (c) 2015 APA, all rights reserved).

Reliability, validity, and utility of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in assessments of bariatric surgery candidates.

PubMed

Tarescavage, Anthony M; Wygant, Dustin B; Boutacoff, Lana I; Ben-Porath, Yossef S

2013-12-01

In the current study, we examined the reliability, validity, and clinical utility of Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2011) scores in a sample of 759 bariatric surgery candidates. We provide descriptives for all scales, internal consistency and standard error of measurement estimates for all substantive scales, external correlates of substantive scales using chart review and self-report criteria, and relative risk ratios to assess the clinical utility of the instrument. Results generally support the reliability, validity, and clinical utility of MMPI-2-RF scale scores in the psychological evaluation of bariatric surgery candidates. Limitations, future directions, and practical application of these results are discussed. (c) 2013 APA, all rights reserved.

Validation of the nursing workload scoring systems "Nursing Activities Score" (NAS), and "Therapeutic Intervention Scoring System For Critically Ill Children" (TISS-C) in a Greek Paediatric Intensive Care Unit.

PubMed

Nieri, Alexandra-Stavroula; Manousaki, Kalliopi; Kalafati, Maria; Padilha, Katia Grilio; Stafseth, Siv K; Katsoulas, Theodoros; Matziou, Vasiliki; Giannakopoulou, Margarita

2018-04-11

To assess the reliability and validity of the Greek version of Nursing Activities Score (NAS), and Therapeutic Intervention Scoring System for Critically Ill Children (TISS-C) in a Greek Paediatric Intensive Care Unit (PICU). A methodological study was performed in one PICU of the largest Paediatric Hospital in Athens-Greece. The culturally adapted and validated Greek NAS version, enriched according to the Norwegian paediatric one (P-NAS), was used. TISS-C and Norwegian paediatric interventions were translated to Greek language and backwards. Therapeutic Intervention Scoring System (TISS-28) was used as a gold standard. Two independent observers simultaneously recorded 30 daily P-NAS and TISS-C records. Totally, 188 daily P-NAS, TISS-C and TISS-28 reports in a sample of 29 patients have been obtained during 5 weeks. Descriptive statistics, reliability and validity measures were applied using SPSS (ver 22.0) (p ≤ 0.05). Kappa was 0.963 for P-NAS and 0.9895 for TISS-C (p < 0.001) and Intraclass Correlation Coefficient for all scale items of TISS-C was 1.00 (p < 0.001). P-NAS, TISS-28 and TISS-C measurements were significantly correlated (0.680 ≤ rho ≤ 0.743, p < 0.001). The mean score(±SD) for TISS-28, P-NAS and TISS-C was 23.05(±5.72), 58.14(±13.98) and 20.21(±9.66) respectively. These results support the validity of P-NAS and TISS-C scales to be used in Greek PICUs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Mathematical Capture of Human Crowd Behavioral Data for Computational Model Building, Verification, and Validation

DTIC Science & Technology

2011-03-21

throughout the experimental runs. Reliable and validated measures of anxiety ( Spielberger , 1983), as well as custom-constructed questionnaires about...Crowd modeling and simulation technologies. Transactions on modeling and computer simulation, 20(4). Spielberger , C. D. (1983

Validation of Brief Multidimensional Spirituality/Religiousness Inventory (BMMRS) in Italian Adult Participants and in Participants with Medical Diseases.

PubMed

Vespa, Anna; Giulietti, Maria Velia; Spatuzzi, Roberta; Fabbietti, Paolo; Meloni, Cristina; Gattafoni, Pisana; Ottaviani, Marica

2017-06-01

This study aimed at assessing the reliability and construct validity of Brief Multidimensional Measure of Religiousness/Spirituality (BMMRS) on Italian sample. 353 Italian participants: 58.9% affected by different diseases and 41.1% healthy subjects. The results of descriptive statistics of internal consistency reliabilities (Chronbach's coefficient) of the BMMRS revealed a remarkable consistency and reliability of different scales DSE, SpC, SC, CSC, VB, SPY-WELL and a good Inter-Class Correlations ≥70 maintaining a good stability of the measures over the time. BMMRS is a useful inventory for the evaluation of the principal spiritual dimensions.

A Structured Clinical Interview for Kleptomania (SCI-K): preliminary validity and reliability testing.

PubMed

Grant, Jon E; Kim, Suck Won; McCabe, James S

2006-06-01

Kleptomania presents difficulties in diagnosis for clinicians. This study aimed to develop and test a DSM-IV-based diagnostic instrument for kleptomania. To assess for current kleptomania the Structured Clinical Interview for Kleptomania (SCI-K) was administered to 112 consecutive subjects requesting psychiatric outpatient treatment for a variety of disorders. Reliability and validity were determined. Classification accuracy was examined using the longitudinal course of illness. The SCI-K demonstrated excellent test-retest (Phi coefficient = 0.956 (95% CI = 0.937, 0.970)) and inter-rater reliability (phi coefficient = 0.718 (95% CI = 0.506, 0.848)) in the diagnosis of kleptomania. Concurrent validity was observed with a self-report measure using DSM-IV kleptomania criteria (phi coefficient = 0.769 (95% CI = 0.653, 0.850)). Discriminant validity was observed with a measure of depression (point biserial coefficient = -0.020 (95% CI = -0.205, 0.166)). The SCI-K demonstrated both high sensitivity and specificity based on longitudinal assessment. The SCI-K demonstrated excellent reliability and validity in diagnosing kleptomania in subjects presenting with various psychiatric problems. These findings require replication in larger groups, including non-psychiatric populations, to examine their generalizability. Copyright (c) 2006 John Wiley & Sons, Ltd.

[Reliability and construct validity of an instrument to asses the Self-perception of Family Health Status].

PubMed

Lima Rodríguez, Joaquín Salvador; Lima Serrano, Marta; Jiménez Picón, Nerea; Domínguez Sánchez, Isabel

2012-10-01

Family health determines and it is determined by family´s capacity to function effectively as a biosocial unit in a given culture and society. The main of study has been to test reliability and construct validity of an instrument to asses the Self-perception of Family Health Status. We validated its content by an on-line Dephi panel with experts. We surveyed 258 families in them homes or in primary health centres from Seville, Spain. We administered the instrument that has five Likert scales: Family climate, Family integrity, Family functioning, and Family resistance. We tested reliability by Cronbach Alpha and construct validity by exploratory factor analysis. The five scales obtained values α between 0.73 for the Family Climate and 0.89 for Family Integrity. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The scales showed their reliability and validity. They could be employed to assess the self-perception of family health status.

Validation study of the EORTC information questionnaire (EORTC QLQ-INFO25) in Iranian cancer patients.

PubMed

Asadi-Lari, Mohsen; Ahmadi Pishkuhi, Mahin; Almasi-Hashiani, Amir; Safiri, Saeid; Sepidarkish, Mahdi

2015-07-01

Developing a tool for measuring patient's needs is a vital step in the process of cancer treatment and research. In recent years, the European Organization for Research and Treatment of Cancer (EORTC) made a questionnaire to measure cancer patients' received information. Since validity and reliability of any instrument should be evaluated in the new environment and culture, the aim of this study was to assess the validity and reliability of the EORTC QLQ-INFO25 in Iranian cancer patients. One hundred seventy-three patients with different stages of cancer filled questionnaire EORTC QLQ-INFO25, EORTC QLQ-C30, and EORTC IN-PATSAT32. Twenty-five patients answered the questionnaire twice at an interval of 2 weeks. Reliability and validity of the questionnaire was measured by Cronbach's alpha, interclass correlation, test retest, inter-rater agreement (IRA), and exploratory factorial analyses. Using a conservative approach, the IRA for the overall relevancy and clarity of the tool was 87/86% and 83.33%, respectively. Overall appropriateness and clarity were 94.13 and 91.87%, respectively. Overall integrity of the instrument was determined to be 85%. Cronbach's alpha coefficients for all domains and total inventory were top 70 and 90%, respectively. Interclass correlation index ranges between 0.708 and 0.965. Exploratory factorial analyses demonstrate six fields suitable for instrument. Correlation between areas of the questionnaires EORTC QLQ-INFO25 and EORTC in-Patsat32 represents the convergent validity of the questionnaire. Also, results show a standard divergent validity in all domains of the questionnaire (Rho <0.3). Low correlation between the areas of the questionnaires EORTC QLQ-INFO25 and EORTC QLQ-C30 (<0.3) demonstrates the divergence validity of the questionnaire. The results showed that Persian version of the questionnaire EORTC QLQ-INFO25 is a reliable and valid instrument for measuring the perception of information in cancer patients.

Advancing implementation science through measure development and evaluation: a study protocol.

PubMed

Lewis, Cara C; Weiner, Bryan J; Stanick, Cameo; Fischer, Sarah M

2015-07-22

Significant gaps related to measurement issues are among the most critical barriers to advancing implementation science. Three issues motivated the study aims: (a) the lack of stakeholder involvement in defining pragmatic measure qualities; (b) the dearth of measures, particularly for implementation outcomes; and (c) unknown psychometric and pragmatic strength of existing measures. Aim 1: Establish a stakeholder-driven operationalization of pragmatic measures and develop reliable, valid rating criteria for assessing the construct. Aim 2: Develop reliable, valid, and pragmatic measures of three critical implementation outcomes, acceptability, appropriateness, and feasibility. Aim 3: Identify Consolidated Framework for Implementation Research and Implementation Outcome Framework-linked measures that demonstrate both psychometric and pragmatic strength. For Aim 1, we will conduct (a) interviews with stakeholder panelists (N = 7) and complete a literature review to populate pragmatic measure construct criteria, (b) Q-sort activities (N = 20) to clarify the internal structure of the definition, (c) Delphi activities (N = 20) to achieve consensus on the dimension priorities, (d) test-retest and inter-rater reliability assessments of the emergent rating system, and (e) known-groups validity testing of the top three prioritized pragmatic criteria. For Aim 2, our systematic development process involves domain delineation, item generation, substantive validity assessment, structural validity assessment, reliability assessment, and predictive validity assessment. We will also assess discriminant validity, known-groups validity, structural invariance, sensitivity to change, and other pragmatic features. For Aim 3, we will refine our established evidence-based assessment (EBA) criteria, extract the relevant data from the literature, rate each measure using the EBA criteria, and summarize the data. The study outputs of each aim are expected to have a positive impact as they will establish and guide a comprehensive measurement-focused research agenda for implementation science and provide empirically supported measures, tools, and methods for accomplishing this work.

Psychometric properties of the Brunel Mood Scale in Chinese adolescents and adults.

PubMed

Zhang, Chun-Qing; Si, Gangyan; Chung, Pak-Kwong; Du, Mengmeng; Terry, Peter C

2014-01-01

Building on the work of Terry and colleagues (Terry, P. C., Lane, A. M., Lane, H. J., & Keohane, L. (1999). Development and validation of a mood measure for adolescents. Journal of Sports Sciences, 17, 861-872; Terry, P. C., Lane, A. M., & Fogarty, G. J. (2003). Construct validity of the Profile of Mood States-Adolescents for use with adults. Psychology of Sport & Exercise, 4, 125-139.), the present study examined the validity and internal consistency reliability of the Chinese version of the Brunel Mood Scale (BRUMS-C) among 2,548 participants, comprising adolescent athletes (n = 520), adult athletes (n = 434), adolescent students (n = 673), and adult students (n = 921). Both adolescent and adult athletes completed the BRUMS-C before, during, or after regular training and both adolescent and adult students completed the BRUMS-C in a classroom setting. Confirmatory factor analyses (CFAs) provided support for the factorial validity of a 23-item six-factor model, with one item removed from the hypothesised measurement model. Internal consistency reliabilities were satisfactory for all subscales across each of the four samples. Criterion validity was supported with strong relationships between the BRUMS-C, abbreviated POMS, and Chinese Affect Scale consistent with theoretical predictions. Multi-sample CFAs showed the BRUMS-C to be invariant at the configural, metric, strong, and structural levels for all samples. Furthermore, latent mean difference analyses showed that athletes reported significantly higher levels of fatigue than students while maintaining almost the same levels of vigour, and adolescent students reported significantly higher levels of depressed mood than the other three samples.

Anatomical landmark position--can we trust what we see? Results from an online reliability and validity study of osteopaths.

PubMed

Pattyn, Elise; Rajendran, Dévan

2014-04-01

Practitioners traditionally use observation to classify the position of patients' anatomical landmarks. This information may contribute to diagnosis and patient management. To calculate a) Inter-rater reliability of categorising the sagittal plane position of four anatomical landmarks (lateral femoral epicondyle, greater trochanter, mastoid process and acromion) on side-view photographs (with landmarks highlighted and not-highlighted) of anonymised subjects; b) Intra-rater reliability; c) Individual landmark inter-rater reliability; d) Validity against a 'gold standard' photograph. Online inter- and intra-rater reliability study. Photographed subjects: convenience sample of asymptomatic students; raters: randomly selected UK registered osteopaths. 40 photographs of 30 subjects were used, a priori clinically acceptable reliability was ≥0.4. Inter-rater arm: 20 photographs without landmark highlights plus 10 with highlights; Intra-rater arm: 10 duplicate photographs (non-highlighted landmarks). Validity arm: highlighted landmark scores versus 'gold standard' photographs with vertical line. Research ethics approval obtained. Osteopaths (n = 48) categorised landmark position relative to imagined vertical-line; Gwet's Agreement Coefficient 1 (AC1) calculated and chance-corrected coefficient benchmarked against Landis and Koch's scale; Validity calculation used Kendall's tau-B. Inter-rater reliability was 'fair' (AC1 = 0.342; 95% confidence interval (CI) = 0.279-0.404) for non-highlighted landmarks and 'moderate' (AC1 = 0.700; 95% CI = 0.596-0.805) for highlighted landmarks. Intra-rater reliability was 'fair' (AC1 = 0.522); range was 'poor' (AC1 = 0.160) to 'substantial' (AC1 = 0.896). No differences were found between individual landmarks. Validity was 'low' (TB = 0.327; p = 0.104). Both inter- and intra-rater reliability was 'fair' but below clinically acceptable levels, validity was 'low'. Together these results challenge the clinical practice of using observation to categorise anterio-posterior landmark position. Copyright © 2014 Elsevier Ltd. All rights reserved.

Validity and Reliability of Devices That Assess Body Temperature During Indoor Exercise in the Heat

PubMed Central

Ganio, Matthew S; Brown, Christopher M; Casa, Douglas J; Becker, Shannon M; Yeargin, Susan W; McDermott, Brendon P; Boots, Lindsay M; Boyd, Paul W; Armstrong, Lawrence E; Maresh, Carl M

2009-01-01

Context: When assessing exercise hyperthermia outdoors, the validity of certain commonly used body temperature measuring devices has been questioned. A controlled laboratory environment is generally less influenced by environmental factors (eg, ambient temperature, solar radiation, wind) than an outdoor setting. The validity of these temperature measuring devices in a controlled environment may be more acceptable. Objective: To assess the validity and reliability of commonly used temperature devices compared with rectal temperature in individuals exercising in a controlled, high environmental temperature indoor setting and then resting in a cool environment. Design: Time series study. Setting: Laboratory environmental chamber (temperature  =  36.4 ± 1.2°C [97.5 ± 2.16°F], relative humidity  =  52%) and cool laboratory (temperature  =  approximately 23.3°C [74.0°F], relative humidity  =  40%). Patients or Other Participants: Fifteen males and 10 females. Intervention(s): Rectal, gastrointestinal, forehead, oral, aural, temporal, and axillary temperatures were measured with commonly used temperature devices. Temperature was measured before and 20 minutes after entering the environmental chamber, every 30 minutes during a 90-minute treadmill walk in the heat, and every 20 minutes during a 60-minute rest in mild conditions. Device validity and reliability were assessed with various statistical measures to compare the measurements using each device with rectal temperature. A device was considered invalid if the mean bias (average difference between rectal and device temperatures) was more than ±0.27°C (±0.50°F). Main Outcome Measure(s): Measured temperature from each device (mean and across time). Results: The following devices provided invalid estimates of rectal temperature: forehead sticker (0.29°C [0.52°F]), oral temperature using an inexpensive device (−1.13°C [−2.03°F]), temporal temperature measured according to the instruction manual (−0.87°C [−1.56°F]), temporal temperature using a modified technique (−0.63°C [−1.13°F]), oral temperature using an expensive device (−0.86°C, [−1.55°F]), aural temperature (−0.67°C, [−1.20°F]), axillary temperature using an inexpensive device (−1.25°C, [−2.24°F]), and axillary temperature using an expensive device (−0.94°F [−1.70°F]). Measurement of intestinal temperature (mean bias of −0.02°C [−0.03°F]) was the only device considered valid. Devices measured in succession (intestinal, forehead, temporal, and aural) showed acceptable reliability (all had a mean bias  =  0.09°C [0.16°F] and r ≥ 0.94]). Conclusions: Even during laboratory exercise in a controlled environment, devices used to measure forehead, temporal, oral, aural, and axillary body sites did not provide valid estimates of rectal temperature. Only intestinal temperature measurement met the criterion. Therefore, we recommend that rectal or intestinal temperature be used to assess hyperthermia in individuals exercising indoors in the heat. PMID:19295956

Validation of the Intrinsic Spirituality Scale (ISS) with Muslims.

PubMed

Hodge, David R; Zidan, Tarek; Husain, Altaf

2015-12-01

This study validates an existing spirituality measure--the intrinsic spirituality scale (ISS)--for use with Muslims in the United States. A confirmatory factor analysis was conducted with a diverse sample of self-identified Muslims (N = 281). Validity and reliability were assessed along with criterion and concurrent validity. The measurement model fit the data well, normed χ2 = 2.50, CFI = 0.99, RMSEA = 0.07, and SRMR = 0.02. All 6 items that comprise the ISS demonstrated satisfactory levels of validity (λ > .70) and reliability (R2 > .50). The Cronbach's alpha obtained with the present sample was .93. Appropriate correlations with theoretically linked constructs demonstrated criterion and concurrent validity. The results suggest the ISS is a valid measure of spirituality in clinical settings with the rapidly growing Muslim population. The ISS may, for instance, provide an efficient screening tool to identify Muslims that are particularly likely to benefit from spiritually accommodative treatments. (c) 2015 APA, all rights reserved).

15 CFR 747.5 - SIRL application review process.

Code of Federal Regulations, 2010 CFR

2010-01-01

... establish the reliability of the proposed parties to the application, it may deny the application, or modify... potential impact of the proposed transaction on the security situation in Iraq; and (v) The reliability of... SIRL procedure and may seek authorization under standard license procedures. (c) Validity period. SIRLs...

Pictorial Personality Traits Questionnaire for Children (PPTQ-C)-A New Measure of Children's Personality Traits.

PubMed

Maćkiewicz, Marta; Cieciuch, Jan

2016-01-01

In order to adjust personality measurements to children's developmental level, we constructed the Pictorial Personality Traits Questionnaire for Children (PPTQ-C). To validate the measure, we conducted a study with a total group of 1028 children aged between 7 and 13 years old. Structural validity was established through Exploratory Structural Equation Model (ESEM). Criterion validity was confirmed with a multitrait-multimethod analysis for which we introduced the children's self-assessment scores from the Big Five Questionnaire for Children. Despite some problems with reliability, one can conclude that the PPTQ-C can be a valid instrument for measuring personality traits, particularly in a group of young children (aged ~7-10 years).

Quality of life in multiple myeloma: clinical validation of the Mexican-Spanish version of the QLQ-MY20 instrument.

PubMed

Espinoza-Zamora, José Ramiro; Portilla-Espinosa, César Miguel; Labardini-Méndez, Juan Rafael; Cervera, Eduardo; Niesvisky, Ruben; Oñate-Ocaña, Luis F

2015-06-01

Health-related quality of life (HRQL) has become an important outcome measurement in hematology. Our aim was to validate the quality of life questionnaire (QLQ)-MY20 instrument in patients with multiple myeloma (MM) in Mexico. The Mexican-Spanish versions of the QLQ-C30 and QLQ-MY20 instruments were applied to patients with MM at a cancer referral centre. Reliability and validity tests were performed. Test-retest was carried out in selected patients. Ninety-eight patients with MM were included in this study. Questionnaire compliance rates were high, and the instrument was well accepted; internal consistency tests demonstrated good convergent and divergent validity. Cronbach's α coefficients of seven of nine multi-item scales of the QLQ-C30 and of all three multi-item scales of the QLQ-MY20 instruments were >0.7 (range, 0.36-0.89). The scales of the QLQ-C30 and QLQ-MY20 instruments distinguished among clinically distinct groups of patients; 9 of 15 scales of the QLQ-C30 and all 4 scales of the QLQ-MY20 presented responsiveness after change over time. The Mexican-Spanish version of the QLQ-MY20 questionnaire is reliable and valid for the assessment of HRQL in patients with MM and can be used in clinical trials in the Mexican community.

Psychometric Validation of the Malaysian Chinese Version of the EORTC QLQ-C30 in Colorectal Cancer Patients.

PubMed

Magaji, Bello Arkilla; Moy, Foong Ming; Roslani, April Camilla; Law, Chee Wei; Sagap, Ismail

2015-01-01

Colorectal cancer is the second most frequent cancer in Malaysia. We aimed to assess the validity and reliability of the Malaysian Chinese version of European Organization for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire core (QLQ-C30) in patients with colorectal cancer. Translated versions of the QLQ-C30 were obtained from the EORTC. A cross sectional study design was used to obtain data from patients receiving treatment at two teaching hospitals in Kuala Lumpur, Malaysia. The Malaysian Chinese version of QLQ-C30 was self-administered in 96 patients while the Karnofsky Performance Scales (KPS) was generated by attending surgeons. Statistical analysis included reliability, convergent, discriminate validity, and known-groups comparisons. Statistical significance was based on p value ≤0.05. The internal consistencies of the Malaysian Chinese version were acceptable [Cronbach's alpha (α≥ 0.70)] in the global health status/overall quality of life (GHS/QOL), functioning scales except cognitive scale (α≤0.32) in all levels of analysis, and social/family functioning scale (α=0.63) in patients without a stoma. All questionnaire items fulfilled the criteria for convergent and discriminant validity except question number 5, with correlation with role (r = 0.62) and social/family (r = 0.41) functioning higher than with physical functioning scales (r = 0.34). The test-retest coefficients in the GHS/QOL, functioning scales and in most of the symptoms scales were moderate to high (r = 0.58 to 1.00). Patients with a stoma reported statistically significant lower physical functioning (p=0.015), social/family functioning (p=0.013), and higher constipation (p=0.010) and financial difficulty (p=0.037) compared to patients without stoma. There was no significant difference between patients with high and low KPS scores. Malaysian Chinese version of the QLQ-C30 is a valid and reliable measure of HRQOL in patients with colorectal cancer.

Psychometric Properties of the Chinese Version of the Arabic Scale of Death Anxiety.

PubMed

Qiu, Qi; Zhang, Shengyu; Lin, Xiang; Ban, Chunxia; Yang, Haibo; Liu, Zhengwen; Wang, Jingrong; Wang, Tao; Xiao, Shifu; Abdel-Khalek, Ahmed M; Li, Xia

2016-06-25

Death anxiety is regarded as a risk and maintaining factor of psychopathology. While the Arabic Scale of Death Anxiety (ASDA) is a brief, commonly used assessment, such a tool is lacking in Chinese clinical practice. The current study was conducted to develop a Chinese version of the ASDA, i.e., the ASDA(C), using a multistage back-translation technique, and examine the psychometric properties of the scale. A total of 1372 participants from hospitals and universities located in three geographic areas of China were recruited for this study. To calculate the criterion-related validity of the ASDA(C) compared to the Chinese version of the longer-form Multidimensional Orientation toward Dying and Death Inventory (MODDI-F/chin), 49 undergraduates were randomly assigned to complete both questionnaires. Of the total participants, 56 were randomly assigned to retake the ASDA(C) in order to estimate the one-week, test-retest reliability of the ASDA(C). The overall Cronbach's alpha was 0.91 for the whole scale. The one-week, test-retest reliability was 0.96. Exploratory Factor Analysis (EFA) revealed three factors, "fear of dead people and tombs," "fear of lethal disease," and "fear of postmortem events," accounted for 57.09% of the total variance. Factor structure for the three-factor model was sound. The correlation between the total scores on the ASDA(C) and the MODDI-F/chin was 0.54, indicating acceptable concurrent validity. ASDA(C) has adequate psychometrics and properties that make it a reliable and valid scale to assess death anxiety in Mandarin-speaking Chinese.

Validity and reliability of the Physical Activity Questionnaire for Children (PAQ-C) and Adolescents (PAQ-A) in individuals with congenital heart disease.

PubMed

Voss, Christine; Dean, Paige H; Gardner, Ross F; Duncombe, Stephanie L; Harris, Kevin C

2017-01-01

To assess the criterion validity, internal consistency, reliability and cut-point for the Physical Activity Questionnaire for Children (PAQ-C) and Adolescents (PAQ-A) in children and adolescents with congenital heart disease-a special population at high cardiovascular risk in whom physical activity has not been extensively evaluated. We included 84 participants (13.6±2.9 yrs, 50% female) with simple (37%), moderate (31%), or severe congenital heart disease (27%), as well as cardiac transplant recipients (6%), from BC Children's Hospital, Canada. They completed the PAQ-C (≤11yrs, n = 28) or-A (≥12yrs, n = 56), and also wore a triaxial accelerometer (GT3X+ or GT9X) over the right hip for 7 days (n = 59 met valid wear time criteria). Median daily moderate-to-vigorous physical activity was 46.9 minutes per day (IQR 31.6-61.8) and 25% met physical activity guidelines defined as ≥60 minutes of moderate-to-vigorous physical activity per day. Median PAQ-score was 2.6 (IQR 1.9-3.0). PAQ-Scores were significantly related to accelerometry-derived metrics of physical activity (rho = 0.44-0.55, all p<0.01) and sedentary behaviour (rho = -0.53, p<0.001). Internal consistency was high (α = 0.837), as was reliability (stability) of PAQ-Scores over a 4-months period (ICC = 0.73, 95%CI 0.55-0.84; p<0.001). We identified that a PAQ-Score cut-point of 2.87 discriminates between those meeting physical guidelines and those that do not in the combined PAQ-C and-A samples (area under the curve = 0.80 (95%CI 0.67-0.92). Validity and reliability of the PAQ in children and adolescents with CHD was comparable to or stronger than previous studies in healthy children. Therefore, the PAQ may be used to estimate general levels of physical activity in children and adolescents with CHD.

Validation of an Instrument to Measure High School Students' Attitudes toward Fitness Testing

ERIC Educational Resources Information Center

Mercier, Kevin; Silverman, Stephen

2014-01-01

Purpose: The purpose of this investigation was to develop an instrument that has scores that are valid and reliable for measuring students' attitudes toward fitness testing. Method: The method involved the following steps: (a) an elicitation study, (b) item development, (c) a pilot study, and (d) a validation study. The pilot study included 427…

Reliability and Validity of a Chinese Version of the Stroke Action Test: A New Instrument for Assessment of Stroke Knowledge and Response

PubMed Central

HA, Mei; QIAN, Xiaoling; YANG, Hong; HUANG, Jichun; LIU, Changjiang

2016-01-01

Background: The public’s cognition of stroke and responses to stroke symptoms are important to prevent complications and decrease the mortality when stroke occurs. The aim of study was to develop and validate the Chinese version of the Stroke Action Test (C-STAT) in a Chinese population. Methods: This study was rigorously implemented with the published guideline for the translation, adaptation and validation of instruments for the cross-cultural use in healthcare care research. A cross-sectional study was performed among 328 stroke patients and family members in the Department of Neurology in the Second Hospital of Lanzhou University, Gansu province, China in 2014. Results: The Chinese version of the instrument showed favorable content equivalence with the source version. Values of Cronbach’s alpha and test-retest reliability of the C-STAT were 0.88 and 0.86, respectively. Principal component analysis supported four-factor solutions of the C-STAT. Criterion-related validity showed that the C-STAT was a significant predictor of the 7-item stroke symptom scores (R = 0.77; t = 21.74, P< 0.001). Conclusion: The C-STAT is an intelligible and brief psychometrical tool to assess individuals’ knowledge of the appropriate responses to stroke symptoms in Chinese populations. It could also be used by health care providers to assess educational programs on stroke prevention. PMID:28053925

Do Young Heroin Users in Madrid, Barcelona and Seville have Sufficient Knowledge of the Risk Factors for Unintentional Opioid Overdose?

PubMed Central

Barrio, Gregorio; Brugal, M. Teresa; de la Fuente, Luis; Ballesta, Rosario; Bravo, María J.; Silva, Teresa C.; Rodríguez-Martos, Alicia

2006-01-01

To identify the self-perceived reasons for unintentional opioid overdose of young heroin users in three Spanish cities and their agreement with objective risk factors for overdose. Computer-Assisted Personal Interviews (CAPI) were held with 991 street-recruited current heroin users aged 18–30. The general reasons for overdose and the reasons for the last overdose suffered were explored with open-ended (OEQs) and pre-coded questions (PCQs). Limited knowledge of overdose risk factors was defined as mention of fewer than two objective risk factors for unintentional overdose in the OEQ. Univariate, bivariate, and logistic regression methods were used. 77.8% (Seville), 64.9% (Madrid) and 57.2% (Barcelona) of participants have limited knowledge of overdose risk factors. Residence in Seville and not having attended courses or meetings on overdoses were significantly associated with limited knowledge, after adjusting for other factors. The most frequently identified general reasons in OEQ or PCQ were using heroin in large amounts (66.8%), together with tranquilizers (62.0%), adulterated (60.7%), or purer than usual (57.6%). Most reasons were selected more frequently in PCQ than in OEQ, especially rapid injection of the entire dose and using heroin shortly after using tranquilizers or alcohol, by injection, or after a period of abstinence. The results were similar for overdoses suffered by participants. Most young heroin users do not have sufficient knowledge of overdose risk factors, especially the use of heroin by injection, after a period of abstinence, or together with alcohol or methadone. Specific informational or educational programs adapted to the local context are critically needed. PMID:16739049

The EORTC information questionnaire, EORTC QLQ-INFO25. Validation study for Spanish patients.

PubMed

Arraras, Juan Ignacio; Manterola, Ana; Hernández, Berta; Arias de la Vega, Fernando; Martínez, Maite; Vila, Meritxell; Eito, Clara; Vera, Ruth; Domínguez, Miguel Ángel

2011-06-01

The EORTC QLQ-INFO25 evaluates the information received by cancer patients. This study assesses the psychometric properties of the QLQ-INFO25 when applied to a sample of Spanish patients. A total of 169 patients with different cancers and stages of disease completed the EORTC QLQINFO25, the EORTC QLQ-C30 and the information scales of the inpatient satisfaction module EORTC IN-PATSAT32 on two occasions during the patients' treatment and follow- up period. Psychometric evaluation of the structure, reliability, validity and responsiveness to changes was conducted. Patient acceptability was assessed with a debriefing questionnaire. Multi-trait scaling confirmed the 4 multi-item scales (information about disease, medical tests, treatment and other services) and eight single items. All items met the standards for convergent validity and all except one met the standards of item discriminant validity. Internal consistency for all scales (α>0.70) and the whole questionnaire (α>0.90) was adequate in the three measurements, except information about the disease (0.67) and other services (0.68) in the first measurement, as was test-retest reliability (intraclass correlations >0.70). Correlations with related areas of IN-PATSAT32 (r>0.40) supported convergent validity. Divergent validity was confirmed through low correlations with EORTC QLQ-C30 scales (r<0.30). The EORTC QLQ-INFO-25 discriminated among groups based on gender, age, education, levels of anxiety and depression, treatment line, wish for information and satisfaction. One scale and an item showed changes over time. The EORTC QLQ-INFO 25 is a reliable and valid instrument when applied to a sample of Spanish cancer patients. These results are in line with those of the EORTC validation study.

Validation of the Narcissistic Admiration and Rivalry Questionnaire Short Scale (NARQ-S) in convenience and representative samples.

PubMed

Leckelt, Marius; Wetzel, Eunike; Gerlach, Tanja M; Ackerman, Robert A; Miller, Joshua D; Chopik, William J; Penke, Lars; Geukes, Katharina; Küfner, Albrecht C P; Hutteman, Roos; Richter, David; Renner, Karl-Heinz; Allroggen, Marc; Brecheen, Courtney; Campbell, W Keith; Grossmann, Igor; Back, Mitja D

2018-01-01

Due to increased empirical interest in narcissism across the social sciences, there is a need for inventories that can be administered quickly while also reliably measuring both the agentic and antagonistic aspects of grandiose narcissism. In this study, we sought to validate the factor structure, provide representative descriptive data and reliability estimates, assess the reliability across the trait spectrum, and examine the nomological network of the short version of the Narcissistic Admiration and Rivalry Questionnaire (NARQ-S; Back et al., 2013). We used data from a large convenience sample (total N = 11,937) as well as data from a large representative sample (total N = 4,433) that included responses to other narcissism measures as well as related constructs, including the other Dark Triad traits, Big Five personality traits, and self-esteem. Confirmatory factor analysis and item response theory were used to validate the factor structure and estimate the reliability across the latent trait spectrum, respectively. Results suggest that the NARQ-S shows a robust factor structure and is a reliable and valid short measure of the agentic and antagonistic aspects of grandiose narcissism. We also discuss future directions and applications of the NARQ-S as a short and comprehensive measure of grandiose narcissism. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Psychometric properties of the Social Phobia and Anxiety Inventory for Children in a Spanish sample.

PubMed

Olivares, José; Sánchez-García, Raquel; López-Pina, José Antonio; Rosa-Alcázar, Ana Isabel

2010-11-01

The objectives of the present study were to adapt and analyze the factor structure, reliability, and validity of the Social Phobia and Anxiety Inventory for Children (SPAI-C; Beidel, Turner, & Morris, 1995) in a Spanish population. The SPAI-C was applied to a sample of 1588 children and adolescents with ages ranging from 10 to 17 years. The confirmatory factor analysis (CFA) showed a four-factor structure: Public performance, Assertiveness, Fear and avoidance/escape in social encounters, and Cognitive and psychophysiological interferences. Internal consistency was high (.90) and test-retest reliability was moderate (.56). Significant differences were found in the variables sex and age, although the effect size was small in both variables and their interaction. Overall, the increase of the age value was inversely proportional to that of social anxiety measured with the SPAI-C; in participants of the same age, values were higher for girls than for boys. Results suggest that the Social Phobia and Anxiety Inventory For Children is a valid and reliable instrument to assess social anxiety in Spanish children and adolescents.

Psychometric properties of a Chinese version of the Home Environment Measure for Motor Development.

PubMed

Hsieh, Yu-Hsin; Hwang, Ai-Wen; Liao, Hua-Fang; Chen, Pau-Chung; Hsieh, Wu-Shiun; Chu, Pei-Yi

2011-01-01

This study examined the psychometric properties of the Chinese version of the Affordance in the Home Environment for Motor Development - Toddler version (AHEMD-Toddler-C) for children developing typically (DT) or having motor delays (MD). This was a methodology study. Parent-child dyads with DT (n = 106, mean age of 27.9 months) and with MD (n = 45, 23.6 months) were enrolled. For test-retest reliability, parents completed AHEMD-Toddler-C twice within 2 weeks. For convergent validity, correlations were analysed between AHEMD-Toddler-C and Home Observation for Measurement of the Environment Inventory (HOME), and between AHEMD-Toddler-C and family variables. Test-retest reliabilities for AHEMD-Toddler-C were adequate except for Variety of Stimulation (VS) subscale. For convergent validity, the correlation coefficients between AHEMD and HOME were 0.44 (p <0.05). Two subscales of motor toys of AHEMD demonstrated convergent validity with Learning Material subscale of HOME and some family variables in children with MD. Inside Space subscale of AHEMD correlated with family variables. Outside Space (OS) subscale of AHEMD was not significantly correlated with HOME or family variables. AHEMD-Toddler-C is a new measure option to explore the relationships between home environment and motor development in Chinese-speaking countries. Nevertheless, VS and OS subscales should be used cautiously.

The Beck Cognitive Insight Scale (BCIS): translation and validation of the Taiwanese version.

PubMed

Kao, Yu-Chen; Liu, Yia-Ping

2010-04-09

Over the last few decades, research concerning the insight of patients with schizophrenia and its relationships with other clinical variables has been given much attention in the clinical setting. Since that time, a series of instruments assessing insight have been developed. The purpose of this study was to examine the reliability and validity of the Taiwanese version of the Beck Cognitive Insight Scale (BCIS). The BCIS is a self-administered instrument designed to evaluate cognitive processes that involves reevaluating patients' anomalous experiences and specific misinterpretations. The English language version of the BCIS was translated into Taiwanese for use in this study. A total of 180 subjects with and without psychosis completed the Taiwanese version of the BCIS and additional evaluations to assess researcher-rated insight scales and psychopathology. Psychometric properties (factor structures and various types of reliability and validity) were assessed for this translated questionnaire. Overall, the Taiwanese version of the BCIS showed good reliability and stability over time. This translated scale comprised a two-factor solution corresponding to reflective attitude and certain attitude subscales. Following the validation of the internal structure of the scale, we obtained an R-C (reflective attitude minus certain attitude) index of the translated BCIS, representing the measurement of cognitive insight by subtracting the score of the certain attitude subscale from that of the reflective attitude subscale. As predicted, the differences in mean reflective attitude, certain attitude and R-C index between subjects with and without psychosis were significant. Our data also demonstrated that psychotic patients were significantly less reflective, more confident in their beliefs, and had less cognitive insight compared with nonpsychotic control groups. In light of these findings, we believe that the Taiwanese version of BCIS is a valid and reliable instrument for the assessment of cognitive insight in psychotic patients.

Development, reliability, and validity testing of Toddler NutriSTEP: a nutrition risk screening questionnaire for children 18-35 months of age.

PubMed

Randall Simpson, Janis; Gumbley, Jillian; Whyte, Kylie; Lac, Jane; Morra, Crystal; Rysdale, Lee; Turfryer, Mary; McGibbon, Kim; Beyers, Joanne; Keller, Heather

2015-09-01

Nutrition is vital for optimal growth and development of young children. Nutrition risk screening can facilitate early intervention when followed by nutritional assessment and treatment. NutriSTEP (Nutrition Screening Tool for Every Preschooler) is a valid and reliable nutrition risk screening questionnaire for preschoolers (aged 3-5 years). A need was identified for a similar questionnaire for toddlers (aged 18-35 months). The purpose was to develop a reliable and valid Toddler NutriSTEP. Toddler NutriSTEP was developed in 4 phases. Content and face validity were determined with a literature review, parent focus groups (n = 6; 48 participants), and experts (n = 13) (phase A). A draft questionnaire was refined with key intercept interviews of 107 parents/caregivers (phase B). Test-retest reliability (phase C), based on intra-class correlations (ICC), Kappa (κ) statistics, and Wilcoxon tests was assessed with 133 parents/caregivers. Criterion validity (phase D) was assessed using Receiver Operating Characteristic (ROC) curves by comparing scores on the Toddler NutriSTEP to a comprehensive nutritional assessment of 200 toddlers with a registered dietitian (RD). The Toddler NutriSTEP was reliable between 2 administrations (ICC = 0.951, F = 20.53, p < 0.001); most questions had moderate (κ ≥ 0.6) or excellent (κ ≥ 0.8) agreement. Scores on the RD nutrition risk rating and the Toddler NutriSTEP were correlated (r = 0.67, p < 0.000). The area under the ROC curve for moderate and high RD risk ratings were 84.6% and 82.7%, respectively. Cut-points of ≥21 (sensitivity 86%; specificity 61%) (moderate risk) and ≥26 (sensitivity 95%; specificity 63%) (high risk) were determined. The Toddler NutriSTEP questionnaire is both reliable and valid for screening for nutritional risk in toddlers.

[Reliability and Validity of the Behavioral Check List for Preschool Children to Measure Attention Deficit Hyperactivity Behaviors].

PubMed

Tsuno, Kanami; Yoshimasu, Kouichi; Hayashi, Takashi; Tatsuta, Nozomi; Ito, Yuki; Kamijima, Michihiro; Nakai, Kunihiko

2018-01-01

Nowadays, attention deficit hyperactivity (ADH) problems are observed commonly among school-age children. However, questionnaires specific to ADH behaviors among preschool children are very few. The aim of this study was to investigate the reliability and validity of the 25-item Behavioral Check List (BCL), which was developed from interviews of parents with children who were diagnosed as having Attention-deficit/hyperactivity disorder (ADHD) and measures ADH behaviors in preschool age. We recruited 22 teachers from 10 nurseries/kindergartens in Miyagi Prefecture, Japan. A total of 138 preschool children were assessed using the BCL. To investigate inter-rater reliability, two teachers from each facility assess seven to twenty children in their class, and intraclass correlation coefficients (ICCs) were calculated. The teachers additionally answered questions in the 1/5-5 Caregiver-Teacher Report Form (C-TRF) to investigate the criterion validity of the BCL. To investigate structural validity, exploratory factor analysis with promax rotation and confirmatory factor analysis were performed. The internal consistency reliability of the BCL was good (α = 0.92) and correlation analyses also confirmed its excellent criterion validity. Although exploratory factor analysis for the BCL yielded a five-factor model that consisted of a factor structure different from that of the original one, the results were similar to the original six factors. The ICCs of the BCL were 0.38-0.99 and it was not high enough for inter-rater reliability in some facilities. However, there is a possibility to improve it by giving raters adequate explanations when using BCL. The present study showed acceptable levels of reliability and validity of the BCL among Japanese preschool children.

Cross-cultural adaptation and validation of the Ankle Osteoarthritis Scale for use in French-speaking populations.

PubMed

Angers, Magalie; Svotelis, Amy; Balg, Frederic; Allard, Jean-Pascal

2016-04-01

The Ankle Osteoarthritis Scale (AOS) is a self-administered score specific for ankle osteoarthritis (OA) with excellent reliability and strong construct and criterion validity. Many recent randomized multicentre trials have used the AOS, and the involvement of the French-speaking population is limited by the absence of a French version. Our goal was to develop a French version and validate the psychometric properties to assure equivalence to the original English version. Translation was performed according to American Association of Orthopaedic Surgeons (AAOS) 2000 guidelines for cross-cultural adaptation. Similar to the validation process of the English AOS, we evaluated the psychometric properties of the French version (AOS-Fr): criterion validity (AOS-Fr v. Western Ontario and McMaster Universities Arthritis Index [WOMAC] and SF-36 scores), construct validity (AOS-Fr correlation to single heel-lift test), and reliability (AOS-Fr test-retest). Sixty healthy individuals tested a prefinal version of the AOS-Fr for comprehension, leading to modifications and a final version that was approved by C. Saltzman, author of the AOS. We then recruited patients with ankle OA for evaluation of the AOS-Fr psychometric properties. Twenty-eight patients with ankle OA participated in the evaluation. The AOS-Fr showed strong criterion validity (AOS:WOMAC r = 0.709 and AOS:SF-36 r = -0.654) and construct validity (r = 0.664) and proved to be reliable (test-retest intraclass correlation coefficient = 0.922). The AOS-Fr is a reliable and valid score equivalent to the English version in terms of psychometric properties, thus is available for use in multicentre trials.

Pictorial Personality Traits Questionnaire for Children (PPTQ-C)—A New Measure of Children's Personality Traits

PubMed Central

Maćkiewicz, Marta; Cieciuch, Jan

2016-01-01

In order to adjust personality measurements to children's developmental level, we constructed the Pictorial Personality Traits Questionnaire for Children (PPTQ-C). To validate the measure, we conducted a study with a total group of 1028 children aged between 7 and 13 years old. Structural validity was established through Exploratory Structural Equation Model (ESEM). Criterion validity was confirmed with a multitrait-multimethod analysis for which we introduced the children's self-assessment scores from the Big Five Questionnaire for Children. Despite some problems with reliability, one can conclude that the PPTQ-C can be a valid instrument for measuring personality traits, particularly in a group of young children (aged ~7–10 years). PMID:27252661

Validating a Chinese version of the Weight Self-stigma Questionnaire for use with obese adults.

PubMed

Lin, Kuan Pin; Lee, Mei Li

2017-08-01

Although weight-based stigmatization is pervasive in everyday life, a suitable measure of weight self-stigma is currently unavailable for the obese Chinese population. The purpose of this study was to translate and test the psychometric properties of the Weight Self-stigma Questionnaire into Chinese (C-WSSQ) for use with obese Chinese people. A cross-sectional study was conducted on 156 overweight or obese adults. The data were collected from September to December 2015. Data on the body mass index, C-WSSQ, and Multidimensional Body Self-relation Questionnaire were used. The reproducibility and Cronbach a of the C-WSSQ were .892 and .880, respectively, indicating acceptable reliability. The exploratory factor analysis revealed that 2 extracted factors identified to the domain structures of the C-WSSQ, as explained by the 67.05% total variance. The C-WSSQ also demonstrated that the 2-factor model, self-devaluation, and fear of enacted stigma fit the data on the basis of confirmatory factor analysis. Meanwhile, the C-WSSQ was correlated with body mass index and Multidimensional Body Self-relation Questionnaire, indicating an acceptable criterion-related validity. The C-WSSQ shows adequate reliability and validity. The health professionals can use the C-WSSQ to assess weight self-stigma of obese Chinese adults before and after intervention of a weight-loss program. © 2017 John Wiley & Sons Australia, Ltd.

Investigating the Reliability and Factor Structure of Kalichman's "Survey 2: Research Misconduct" Questionnaire: A Post Hoc Analysis Among Biomedical Doctoral Students in Scandinavia.

PubMed

Holm, Søren; Hofmann, Bjørn

2017-10-01

A precondition for reducing scientific misconduct is evidence about scientists' attitudes. We need reliable survey instruments, and this study investigates the reliability of Kalichman's "Survey 2: research misconduct" questionnaire. The study is a post hoc analysis of data from three surveys among biomedical doctoral students in Scandinavia (2010-2015). We perform reliability analysis, and exploratory and confirmatory factor analysis using a split-sample design as a partial validation. The results indicate that a reliable 13-item scale can be formed (Cronbach's α = .705), and factor analysis indicates that there are four reliable subscales each tapping a different construct: (a) general attitude to misconduct (α = .768), (b) attitude to personal misconduct (α = .784), (c) attitude to whistleblowing (α = .841), and (d) attitude to blameworthiness/punishment (α = .877). A full validation of the questionnaire requires further research. We, nevertheless, hope that the results will facilitate the increased use of the questionnaire in research.

Translation and validation of the Chinese version of the short Warwick-Edinburgh Mental Well-being Scale for patients with mental illness in Hong Kong.

PubMed

Ng, S S W; Lo, A W Y; Leung, T K S; Chan, F S M; Wong, A T Y; Lam, R W T; Tsang, D K Y

2014-03-01

Quality of life outcomes are useful in the assessment of mental and social wellbeing and for informed health care decision-making, especially in the choice of interventions in psychiatric rehabilitation. In its original form, the Warwick-Edinburgh Mental Well-being Scale (WEMWBS) is a proven reliable and valid tool for assessing quality of life in normal adults, but not in adults from Asian countries. A shortened 7-item version of WEMWBS (SWEMWBS) with good internal construct validity was used for this study. The present study describes the translation of WEMWBS from English to Chinese and its validation in a sample of Chinese-speaking patient population. Participants included patients admitted to the inpatient units, and those attending the day hospital and outpatient units of the Kowloon Hospital (n = 126). Translation was performed using the multiple forward and backward translation protocol. Patients also completed the 5-item World Health Organization Well-being Index (WHO5) questionnaire. A case therapist completed the Brief Psychiatric Rating Scale within 2 days. A total of 20 patients were selected for test-retest measurements performed after 2 weeks. The sample displayed a normal distribution of the Chinese version of SWEMWBS (C-SWEMWBS) scores (mean ± standard deviation, 23.16 ± 5.39; skewness, -0.068; kurtosis, -0.355). Internal reliability coefficient (Cronbach's alpha) for C-SWEMWBS was 0.89 which was consistent with that of English version. The corrected item-total correlation was high with Spearman's rank correlation coefficients ranging from 0.57 (item 6) to 0.75 (item 5). Good test-retest reliability was observed (r = 0.677; p = 0.001). Principal components factor analysis identified a single component (eigenvalues, 4.28; 61.1% variance), similar to the English version. Scores of C-SWEMWBS were positively correlated with the scores of WHO5 (r = 0.49; p < 0.001), suggesting good concurrent validity. Few item scores including 'feeling useful', 'dealing with problems well', 'able to make decisions', and the total score were significantly correlated with diagnostic groups (p < 0.05). Education and diagnosis of mental illness were valid predictors for C-SWEMWBS (F = 5.41; p = 0.01). There were no effects due to age and gender. The C-SWEMWBS showed high levels of internal consistency and reliability against accepted criteria. It is short, acceptable, and culturally meaningful to clients with mental illness. Further large-scale studies in normal subjects and varied patient groups are recommended to generalise the findings.

Specificity rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures.

PubMed

Gasquoine, Philip G; Weimer, Amy A; Amador, Arnoldo

2017-04-01

To measure specificity as failure rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures: (a) the language format Reliable Digit Span; (b) visual-perceptual format Test of Memory Malingering; and (c) visual-perceptual format Dot Counting, using optimal/suboptimal effort cut scores developed for monolingual, English-speakers. Participants were 61 consecutive referrals, aged between 18 and 65 years, with <16 years of education who were subjectively bilingual (confirmed via formal assessment) and chose the language of assessment, Spanish or English, for the performance validity tests. Failure rates were 38% for Reliable Digit Span, 3% for the Test of Memory Malingering, and 7% for Dot Counting. For Reliable Digit Span, the failure rates for Spanish (46%) and English (31%) languages of administration did not differ significantly. Optimal/suboptimal effort cut scores derived for monolingual English-speakers can be used with Spanish/English bilinguals when using the visual-perceptual format Test of Memory Malingering and Dot Counting. The high failure rate for Reliable Digit Span suggests it should not be used as a performance validity measure with Spanish/English bilinguals, irrespective of the language of test administration, Spanish or English.

[Eppendorf Schizophrenia Inventory (ESI) vs. Frankfurt Complaint Questionnaire (FCQ). Direct comparison in a clinical trial].

PubMed

Mass, R

2005-09-01

This study is the first to directly compare two clinical questionnaires which are both aimed at self-experienced cognitive dysfunctions of schizophrenia: Eppendorf Schizophrenia Inventory (ESI) and Frankfurt Complaint Questionnaire (FCQ). Evaluated were (a) diagnostic validity, (b) psychometric properties, (c) scale intercorrelations, and (d) factor analytic stability. Ad (a): schizophrenic subjects (n=36) show highly significant increases in the ESI scales and sum score when compared to other clinical groups (patients with depression, alcohol dependence, or obsessive-compulsive disorder, n>30, respectively); on the other hand, the FCQ yields no systematic group differences. Ad (b): mean of reliability coefficients (Cronbach alpha) of the ESI scales is r(tt)=0.86, mean of reliability coefficients of the FCQ scales is significantly lower. Ad (c): the mean intercorrelation between ESI and FCQ scales amounts to r(xy)=0.56 (minimum 0.29, maximum 0.73), corresponding to an average shared variance of about 31%. Ad (d): factor analysis yielded an ESI factor and a FBF factor; one-way ANOVA with the factor scores confirms the diagnostic validity of the ESI. ESI and FCQ measure essentially different aspects of schizophrenic psychopathology. Regarding reliability and diagnostic validity, the ESI is superior to the FCQ.

Developing a measure of cultural-, maturity-, or esteem-driven modesty among Jewish women.

PubMed

Andrews, Caryn Scheinberg

2014-01-01

Understanding modesty and how it relates to religiosity among Jewish women was relatively unexplained, and as part of a larger study, a measure was needed. The purpose of this article is to report on three studies which represent the three stages of instrument development of a measure of modesty among Jewish women, "Your Views of Modesty": (a) content/concept definition; (b) instrument development; and (c) evaluation of the psychometric properties of the instrument: reliability and validity. In Study I, Q methodology was used to define the domain and results suggesting that modesty has multidimensions. In Study II, an instrument was developed based on distinctive perspectives from each group or what was important and not so important. This formed a 25-item Likert scale. In Study III, a survey of 300 Jewish women revealed internal consistency estimates with Cronbach's alpha 0.92, indicating high degree of internal consistency reliability for "Your Views of Modesty." For construct validity, four factors were found explaining 55% of the variance of modesty: (a) religion-driven, (b) maturity-driven, (c) esteem-driven, and (d) public-based modesty was identified. "Your Views of Modesty" shows good evidence for reliability and validity in this Jewish population.

Development and Psychometric Properties of the Instrumental Activities of Daily Living: Compensation Scale

PubMed Central

Schmitter-Edgecombe, Maureen; Parsey, Carolyn; Lamb, Richard

2014-01-01

The Instrumental Activities of Daily Living – Compensation (IADL-C) scale was developed to capture early functional difficulties and to quantify compensatory strategy use that may mitigate functional decline in the aging population. The IADL-C was validated in a sample of cognitively healthy older adults (N=184) and individuals with mild cognitive impairment (MCI; N=92) and dementia (N=24). Factor analysis and Rasch item analysis led to the 27-item IADL-C informant questionnaire with four functional domain subscales (money and self-management, home daily living, travel and event memory, and social skills). The subscales demonstrated good internal consistency (Rasch reliability 0.80 to 0.93) and test-retest reliability (Spearman coefficients 0.70 to 0.91). The IADL-C total score and subscales showed convergent validity with other IADL measures, discriminant validity with psychosocial measures, and the ability to discriminate between diagnostic groups. The money and self management subscale showed notable difficulties for individuals with MCI, whereas difficulties with home daily living became more prominent for dementia participants. Compensatory strategy use increased in the MCI group and decreased in the dementia group. PMID:25344901

Psychometric Properties of the Chinese Version of the Arabic Scale of Death Anxiety

PubMed Central

QIU, Qi; ZHANG, Shengyu; LIN, Xiang; BAN, Chunxia; YANG, Haibo; LIU, Zhengwen; WANG, Jingrong; WANG, Tao; XIAO, Shifu; ABDEL-KHALEK, Ahmed M; LI, Xia

2016-01-01

Background Death anxiety is regarded as a risk and maintaining factor of psychopathology. While the Arabic Scale of Death Anxiety (ASDA) is a brief, commonly used assessment, such a tool is lacking in Chinese clinical practice. Aim The current study was conducted to develop a Chinese version of the ASDA, i.e., the ASDA(C), using a multistage back-translation technique, and examine the psychometric properties of the scale. Methods A total of 1372 participants from hospitals and universities located in three geographic areas of China were recruited for this study. To calculate the criterion-related validity of the ASDA(C) compared to the Chinese version of the longer-form Multidimensional Orientation toward Dying and Death Inventory (MODDI-F/chin), 49 undergraduates were randomly assigned to complete both questionnaires. Of the total participants, 56 were randomly assigned to retake the ASDA(C) in order to estimate the one-week, test-retest reliability of the ASDA(C). Results The overall Cronbach’s alpha was 0.91 for the whole scale. The one-week, test-retest reliability was 0.96. Exploratory Factor Analysis (EFA) revealed three factors, “fear of dead people and tombs,” “fear of lethal disease,” and “fear of postmortem events,” accounted for 57.09% of the total variance. Factor structure for the three-factor model was sound. The correlation between the total scores on the ASDA(C) and the MODDI-F/chin was 0.54, indicating acceptable concurrent validity. Conclusions ASDA(C) has adequate psychometrics and properties that make it a reliable and valid scale to assess death anxiety in Mandarin-speaking Chinese. PMID:28638183

Linguistic Validation of the M. D. Anderson Symptom Inventory in Persian-Speaking Iranian Cancer Patients.

PubMed

Saadatpour, Leila; Hemati, Simin; Habibi, Farzaneh; Behzadi, Erfan; Hashemi-Jazi, Marsa Sadat; Kheirabadi, Gholamreza; Mirbagher, Leila; Gholamrezaei, Ali

2015-09-01

Various symptoms frequently affect cancer patients' quality of life. Appropriate assessment of these symptoms provides valuable data for cancer management. This study aimed to validate the Persian version of the M. D. Anderson Symptom Inventory (MDASI-P). This cross-sectional study was conducted at four cancer treatment centers in two cities in Iran. Breast cancer and colorectal cancer patients aged 18 years and older were consecutively included in the study. The standard forward-backward translation method was applied. Patients completed the MDASI-P along with the previously validated Persian version of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 (EORTC QLQ-C30). Construct validity (factor analysis), criterion validity (against the EORTC QLQ-C30), and reliability (Cronbach's alpha) were analyzed. A total of 146 breast cancer and 94 colorectal cancer patients were studied. Factor analysis for the symptom severity items resulted in a three-factor solution, further reduced to a two-factor solution: general symptoms and gastrointestinal symptoms. Correlation of the MDASI-P symptom severity items with corresponding EORTC QLQ-C30 symptom items (r = 0.48-0.75) and MDASI-P interference items with corresponding EORTC QLQ-C30 functioning domains (r = -0.46 to -0.23) supported the criterion validity. Cronbach's alpha was 0.90, 0.88, and 0.77 for the total questionnaire, symptom severity items, and the interference subscale, respectively. The MDASI-P is a feasible, valid, and reliable instrument for evaluation of symptoms in Persian-speaking cancer patients and can be used to improve symptom management in these patients. Copyright © 2015 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

The reliability and validity of the Japanese version of the Appraisal of Diabetes Scale for type 2 diabetes patients.

PubMed

Hara, Yoriko; Koyama, Satoshi; Morinaga, Toru; Ito, Hisao; Kohno, Shusuke; Hirai, Hiroyuki; Kikuchi, Toshio; Tsuda, Toru; Ichino, Isao; Takei, Satoko; Yamada, Kentaro; Tsuboi, Koji; Breugelmans, Raoul; Ishihara, Yoko

2011-01-01

An appropriate questionnaire for measurement of the psychological burden of self-management or behavior modification in type-2 diabetes patients has yet to be developed in Japan. This study was conducted to test the reliability and validity of the Japanese version of the Appraisal of Diabetes Scale (ADS). the study enrolled 346 Japanese patients with type 2 diabetes: 200 men and 146 women who were 63.2 ± 10.1 and 62.2 ± 11.9 years of age and had HbA1c levels of 6.9 ± 1.2% and 7.3 ± 1.9%, respectively. the questionnaire was divided into three components: "Psychological impact of diabetes", "Sense of self-control", and "Efforts for symptom management". Cronbach's alpha was 0.746-0.628. Significant correlations were observed between "Sense of self-control" and self-managed dietary and exercise behaviors and HbA1c levels; between "Psychological impact of diabetes" and various treatments, symptoms causing anxiety, and HbA1c levels; and between "Efforts for symptom management" and dietary and nutritional behaviors. The questionnaire showed better evidence of internal consistency, test-retest reliability and validity. our results suggested that the Japanese version of ADS may be a useful tool for the quick assessment of common anxieties and motivation toward treatment in patients with type 2 diabetes. 2010 Elsevier Ireland Ltd. All rights reserved.

Reliability of an e-PRO Tool of EORTC QLQ-C30 for Measurement of Health-Related Quality of Life in Patients With Breast Cancer: Prospective Randomized Trial.

PubMed

Wallwiener, Markus; Matthies, Lina; Simoes, Elisabeth; Keilmann, Lucia; Hartkopf, Andreas D; Sokolov, Alexander N; Walter, Christina B; Sickenberger, Nina; Wallwiener, Stephanie; Feisst, Manuel; Gass, Paul; Fasching, Peter A; Lux, Michael P; Wallwiener, Diethelm; Taran, Florin-Andrei; Rom, Joachim; Schneeweiss, Andreas; Graf, Joachim; Brucker, Sara Y

2017-09-14

Breast cancer represents the most common malignant disease in women worldwide. As currently systematic palliative treatment only has a limited effect on survival rates, the concept of health-related quality of life (HRQoL) is gaining more and more importance in the therapy setting of metastatic breast cancer. One of the major patient-reported outcomes (PROs) for measuring HRQoL in patients with breast cancer is provided by the European Organization for Research and Treatment of Cancer (EORTC). Currently, paper-based surveys still predominate, as only a few reliable and validated electronic-based questionnaires are available. Facing the possibilities associated with evolving digitalization in medicine, validation of electronic versions of well-established PRO is essential in order to contribute to comprehensive and holistic oncological care and to ensure high quality in cancer research. The aim of this study was to analyze the reliability of a tablet-based measuring application for EORTC QLQ-C30 in German language in patients with adjuvant and (curative) metastatic breast cancer. Paper- and tablet-based questionnaires were completed by a total of 106 female patients with adjuvant and metastatic breast cancer recruited as part of the e-PROCOM study. All patients were required to complete the electronic- (e-PRO) and paper-based versions of the HRQoL EORTC QLQ-C30 questionnaire. A frequency analysis was performed to determine descriptive sociodemographic characteristics. Both dimensions of reliability (parallel forms reliability [Wilcoxon test] and test of internal consistency [Spearman rho and agreement rates for single items, Pearson correlation and Kendall tau for each scale]) were analyzed. High correlations were shown for both dimensions of reliability (parallel forms reliability and internal consistency) in the patient's response behavior between paper- and electronic-based questionnaires. Regarding the test of parallel forms reliability, no significant differences were found in 27 of 30 single items and in 14 of 15 scales, whereas a statistically significant correlation in the test of consistency was found in all 30 single items and all 15 scales. The evaluated e-PRO version of the EORTC QLQ-C30 is reliable for patients with both adjuvant and metastatic breast cancer, showing a high correlation in almost all questions (and in many scales). Thus, we conclude that the validated paper-based PRO assessment and the e-PRO tool are equally valid. However, the reliability should also be analyzed in other prospective trials to ensure that usability is reliable in all patient groups. ClinicalTrials.gov NCT03132506; https://clinicaltrials.gov/ct2/show/NCT03132506 (Archived by WebCite at http://www.webcitation.org/6tRcgQuou). ©Markus Wallwiener, Lina Matthies, Elisabeth Simoes, Lucia Keilmann, Andreas D Hartkopf, Alexander N Sokolov, Christina B Walter, Nina Sickenberger, Stephanie Wallwiener, Manuel Feisst, Paul Gass, Peter A Fasching, Michael P Lux, Diethelm Wallwiener, Florin-Andrei Taran, Joachim Rom, Andreas Schneeweiss, Joachim Graf, Sara Y Brucker. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.09.2017.

Patterns of Cognitive Strengths and Weaknesses: Identification Rates, Agreement, and Validity for Learning Disabilities Identification

ERIC Educational Resources Information Center

Miciak, Jeremy; Fletcher, Jack M.; Stuebing, Karla K.; Vaughn, Sharon; Tolar, Tammy D.

2014-01-01

Few empirical investigations have evaluated learning disabilities (LD) identification methods based on a pattern of cognitive strengths and weaknesses (PSW). This study investigated the reliability and validity of two proposed PSW methods: the concordance/discordance method (C/DM) and cross battery assessment (XBA) method. Cognitive assessment…

Reliability and validity of a treatment adherence measure for child psychiatric rehabilitation.

PubMed

Williams, Nathaniel J; Green, Philip

2012-09-01

Treatment adherence, defined as the degree to which practitioners implemented prescribed program principles and activities and avoided proscribed activities, has been an area of growing interest in mental health services for children with severe emotional and behavioral disorders. This study evaluated the reliability and validity of a treatment adherence measure for child psychiatric rehabilitation (CPSR). Parents of children receiving CPSR (n = 79) or psychotherapy (n = 27) completed the Children's Psychosocial Rehabilitation Treatment Adherence Measure (CTAM) and a measure of 2-week session impact. Psychiatric rehabilitation (PSR) supervisors identified PSR practitioners with reputations for high or low adherence to the model. The CTAM's discriminant validity was assessed by using known-groups procedures and predictive validity by examining its relationship to 2-week session impact. The CTAM demonstrated excellent internal consistency (α = .92), discriminant validity (p = .002, d = .72; p = .021, d = .59), and predictive validity (B = 2.24, SE = .31, p < .001), accounting for 28% of the child-level variance in 2-week session impact. Findings suggest the CTAM is a reliable and valid measure of treatment adherence for CPSR programs with a skill-teaching focus. Providers and agencies should take steps to enhance treatment adherence because it may be an important predictor of children's short-term response to CPSR. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

Reliability and Validity of a Submaximal Warm-up Test for Monitoring Training Status in Professional Soccer Players.

PubMed

Rabbani, Alireza; Kargarfard, Mehdi; Twist, Craig

2018-02-01

Rabbani, A, Kargarfard, M, and Twist, C. Reliability and validity of a submaximal warm-up test for monitoring training status in professional soccer players. J Strength Cond Res 32(2): 326-333, 2018-Two studies were conducted to assess the reliability and validity of a submaximal warm-up test (SWT) in professional soccer players. For the reliability study, 12 male players performed an SWT over 3 trials, with 1 week between trials. For the validity study, 14 players of the same team performed an SWT and a 30-15 intermittent fitness test (30-15IFT) 7 days apart. Week-to-week reliability in selected heart rate (HR) responses (exercise heart rate [HRex], heart rate recovery [HRR] expressed as the number of beats recovered within 1 minute [HRR60s], and HRR expressed as the mean HR during 1 minute [HRpost1]) was determined using the intraclass correlation coefficient (ICC) and typical error of measurement expressed as coefficient of variation (CV). The relationships between HR measures derived from the SWT and the maximal speed reached at the 30-15IFT (VIFT) were used to assess validity. The range for ICC and CV values was 0.83-0.95 and 1.4-7.0% in all HR measures, respectively, with the HRex as the most reliable HR measure of the SWT. Inverse large (r = -0.50 and 90% confidence limits [CLs] [-0.78 to -0.06]) and very large (r = -0.76 and CL, -0.90 to -0.45) relationships were observed between HRex and HRpost1 with VIFT in relative (expressed as the % of maximal HR) measures, respectively. The SWT is a reliable and valid submaximal test to monitor high-intensity intermittent running fitness in professional soccer players. In addition, the test's short duration (5 minutes) and simplicity mean that it can be used regularly to assess training status in high-level soccer players.

Examining parents' ratings of middle-school students' academic self-regulation using principal axis factoring analysis.

PubMed

Chen, Peggy P; Cleary, Timothy J; Lui, Angela M

2015-09-01

This study examined the reliability and validity of a parent rating scale, the Self-Regulation Strategy Inventory: Parent Rating Scale (SRSI-PRS), using a sample of 451 parents of sixth- and seventh-grade middle-school students. Principal axis factoring (PAF) analysis revealed a 3-factor structure for the 23-item SRSI-PRS: (a) Managing Behavior and Learning (α = .92), (b) Maladaptive Regulatory Behaviors (α = .76), and (c) Managing Environment (α = .84). The majority of the observed relations between these 3 subscales, and the SRSI-SR, student motivation beliefs, and student mathematics grades were statistically significant and in the small to medium range. After controlling for various student variables and motivation indices of parental involvement, 2 SRSI-PRS factors (Managing Behavior and Learning, Maladaptive Regulatory Behaviors) reliably predicted students' achievement in their mathematics course. This study provides initial support for the validity and reliability of the SRSI-PRS and underscores the advantages of obtaining parental ratings of students' SRL behaviors. (c) 2015 APA, all rights reserved).

Validation of the Japanese version of the Pediatric Quality of Life Inventory (PedsQL) Cancer Module.

PubMed

Tsuji, Naoko; Kakee, Naoko; Ishida, Yasushi; Asami, Keiko; Tabuchi, Ken; Nakadate, Hisaya; Iwai, Tsuyako; Maeda, Miho; Okamura, Jun; Kazama, Takuro; Terao, Yoko; Ohyama, Wataru; Yuza, Yuki; Kaneko, Takashi; Manabe, Atsushi; Kobayashi, Kyoko; Kamibeppu, Kiyoko; Matsushima, Eisuke

2011-04-10

The PedsQL 3.0 Cancer Module is a widely used instrument to measure pediatric cancer specific health-related quality of life (HRQOL) for children aged 2 to 18 years. We developed the Japanese version of the PedsQL Cancer Module and investigated its reliability and validity among Japanese children and their parents. Participants were 212 children with cancer and 253 of their parents. Reliability was determined by internal consistency using Cronbach's coefficient alpha and test-retest reliability using intra-class correlation coefficient (ICC). Validity was assessed through factor validity, convergent and discriminant validity, concurrent validity, and clinical validity. Factor validity was examined by exploratory factor analysis. Convergent and discriminant validity were examined by multitrait scaling analysis. Concurrent validity was assessed using Spearman's correlation coefficients between the Cancer Module and Generic Core Scales, and the comparison of the scores of child self-reports with those of other self-rating depression scales for children. Clinical validity was assessed by comparing the on- and off- treatment scores using Kruskal-Wallis and Mann-Whitney U tests. Cronbach's coefficient alpha was over 0.70 for the total scale and over 0.60 for each subscale by age except for the 'pain and hurt' subscale for children aged 5 to 7 years. For test-retest reliability, the ICC exceeded 0.70 for the total scale for each age. Exploratory factor analysis demonstrated sufficient factorial validity. Multitrait scaling analysis showed high success rates. Strong correlations were found between the reports by children and their parents, and the scores of the Cancer Module and the Generic Core Scales except for 'treatment anxiety' subscales for child reports. The Depression Self-Rating Scale for Children (DSRS-C) scores were significantly correlated with emotional domains and the total score of the cancer module. Children who had been off treatment over 12 months demonstrated significantly higher scores than those on treatment. The results demonstrate the reliability and validity of the Japanese version of the PedsQL Cancer Module among Japanese children.

Reliability and validity of the C-BiLLT: a new instrument to assess comprehension of spoken language in young children with cerebral palsy and complex communication needs.

PubMed

Geytenbeek, Joke J; Mokkink, Lidwine B; Knol, Dirk L; Vermeulen, R Jeroen; Oostrom, Kim J

2014-09-01

In clinical practice, a variety of diagnostic tests are available to assess a child's comprehension of spoken language. However, none of these tests have been designed specifically for use with children who have severe motor impairments and who experience severe difficulty when using speech to communicate. This article describes the process of investigating the reliability and validity of the Computer-Based Instrument for Low Motor Language Testing (C-BiLLT), which was specifically developed to assess spoken Dutch language comprehension in children with cerebral palsy and complex communication needs. The study included 806 children with typical development, and 87 nonspeaking children with cerebral palsy and complex communication needs, and was designed to provide information on the psychometric qualities of the C-BiLLT. The potential utility of the C-BiLLT as a measure of spoken Dutch language comprehension abilities for children with cerebral palsy and complex communication needs is discussed.

The push-off test: development of a simple, reliable test of upper extremity weight-bearing capability.

PubMed

Vincent, Joshua I; MacDermid, Joy C; Michlovitz, Susan L; Rafuse, Richard; Wells-Rowsell, Christina; Wong, Owen; Bisbee, Leslie

2014-01-01

Longitudinal clinical measurement study. The push-off test (POT) is a novel and simple measure of upper extremity weight-bearing that can be measured with a grip dynamometer. There are no published studies on the validity and reliability of the POT. The relationship between upper extremity self-report activity/participation and impairment measures remain an unexplored realm. The primary purpose of this study is to estimate the intra and inter-rater reliability and construct validity of the POT. The secondary purpose is to estimate the relationship between upper extremity self-report activity/participation questionnaires and impairment measures. A convenience sample of 22 patients with wrist or elbow injuries were tested for POT, wrist/elbow range of motion (ROM), isometric wrist extension strength (WES) and grip strength; and completed two self-report activity/participation questionnaires: Disability of the Arm, Shoulder and the Hand (DASH) and Work Limitations Questionnaire (WLQ-26). POT's inter and intra-rater reliability and construct validity was tested. Pearson's correlations were run between the impairment measures and self-report questionnaires to look into the relationship amongst them. The POT demonstrated high inter-rater reliability (ICC affected = 0.97; 95% C.I. 0.93-0.99; ICC unaffected = 0.85; 95% C.I. 0.68-0.94) and intra-rater reliability (ICC affected = 0.96; 95% C.I. 0.92-0.97; ICC unaffected = 0.92; 95% C.I. 0.85-0.97). The POT was correlated moderately with the DASH (r = -0.47; p = 0.03). While examining the relationship between upper extremity self-reported activity/participation questionnaires and impairment measures the strongest correlation was between the DASH and the POT (r = -0.47; p = 0.03) and none of the correlations with the other physical impairment measures reached significance. At-work disability demonstrated insignificant correlations with physical impairments. The POT test provides a reliable and easily administered quantitative measure of ability to bear the load through an injured arm. Preliminary evidence supports a moderate relationship between loading bearing measured by the POT and upper extremity function measured by the DASH. 1b. Copyright © 2014 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

An empirical look at the Defense Mechanism Test (DMT): reliability and construct validity.

PubMed

Ekehammar, Bo; Zuber, Irena; Konstenius, Marja-Liisa

2005-07-01

Although the Defense Mechanism Test (DMT) has been in use for almost half a century, there are still quite contradictory views about whether it is a reliable instrument, and if so, what it really measures. Thus, based on data from 39 female students, we first examined DMT inter-coder reliability by analyzing the agreement among trained judges in their coding of the same DMT protocols. Second, we constructed a "parallel" photographic picture that retained all structural characteristic of the original and analyzed DMT parallel-test reliability. Third, we examined the construct validity of the DMT by (a) employing three self-report defense-mechanism inventories and analyzing the intercorrelations between DMT defense scores and corresponding defenses in these instruments, (b) studying the relationships between DMT responses and scores on trait and state anxiety, and (c) relating DMT-defense scores to measures of self-esteem. The main results showed that the DMT can be coded with high reliability by trained coders, that the parallel-test reliability is unsatisfactory compared to traditional psychometric standards, that there is a certain generalizability in the number of perceptual distortions that people display from one picture to another, and that the construct validation provided meager empirical evidence for the conclusion that the DMT measures what it purports to measure, that is, psychological defense mechanisms.

General inattentiveness is a long-term reliable trait independently predictive of psychological health: Danish validation studies of the Mindful Attention Awareness Scale.

PubMed

Jensen, Christian Gaden; Niclasen, Janni; Vangkilde, Signe Allerup; Petersen, Anders; Hasselbalch, Steen Gregers

2016-05-01

The Mindful Attention Awareness Scale (MAAS) measures perceived degree of inattentiveness in different contexts and is often used as a reversed indicator of mindfulness. MAAS is hypothesized to reflect a psychological trait or disposition when used outside attentional training contexts, but the long-term test-retest reliability of MAAS scores is virtually untested. It is unknown whether MAAS predicts psychological health after controlling for standardized socioeconomic status classifications. First, MAAS translated to Danish was validated psychometrically within a randomly invited healthy adult community sample (N = 490). Factor analysis confirmed that MAAS scores quantified a unifactorial construct of excellent composite reliability and consistent convergent validity. Structural equation modeling revealed that MAAS scores contributed independently to predicting psychological distress and mental health, after controlling for age, gender, income, socioeconomic occupational class, stressful life events, and social desirability (β = 0.32-.42, ps < .001). Second, MAAS scores showed satisfactory short-term test-retest reliability in 100 retested healthy university students. Finally, MAAS sample mean scores as well as individuals' scores demonstrated satisfactory test-retest reliability across a 6 months interval in the adult community (retested N = 407), intraclass correlations ≥ .74. MAAS scores displayed significantly stronger long-term test-retest reliability than scores measuring psychological distress (z = 2.78, p = .005). Test-retest reliability estimates did not differ within demographic and socioeconomic strata. Scores on the Danish MAAS were psychometrically validated in healthy adults. MAAS's inattentiveness scores reflected a unidimensional construct, long-term reliable disposition, and a factor of independent significance for predicting psychological health. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

The psychometric testing of the diabetes health promotion self-care scale.

PubMed

Wang, Ruey-Hsia; Lin, Li-Ying; Cheng, Chung-Ping; Hsu, Min-Tao; Kao, Chia-Chan

2012-06-01

Health-promoting behavior is an important strategy to maintain and enhance health of patients with Type 2 diabetes. Few instruments have been developed to measure health promotion self-care behavior of patients with Type 2 diabetes. Developing and psychometric testing of the Chinese version of the Diabetes Health Promotion Self-Care Scale (DHPSC) for patients with Type 2 diabetes. Four hundred and eighty-nine patients with Type 2 diabetes were recruited from endocrine clinics in four hospitals in Kaohsiung City in southern Taiwan. Exploratory and confirmatory factor analyses were used to assess the construct validity of the scale. Correlations between the DHPSC and the satisfaction subscale of Diabetes Quality of Life, Diabetes Empowerment Scale, and HbA1c were calculated to evaluate concurrent validity. Internal consistency and test-retest reliability were used to assess the reliability of the scale. The study was conducted in 2007 and 2008. A proposed second-order factor model with seven subscales and 26 items fit the data well. The seven subscales were interpersonal relationships, diet, blood glucose self-monitoring, personal health responsibility, exercise, adherence to the recommended regimens, and foot care. The DHPSC statistically significantly correlated with the satisfaction subscale of Diabetes Quality of Life and the Diabetes Empowerment Scale. HbA1c only statistically significantly correlated with the subscale of health responsibility. Reliability was supported by acceptable Cronbach's alpha (range, .78-.94) and test-retest reliability (range, .76-.95). The DHPSC has satisfactory reliability and validity. Healthcare providers can use the DHPSC to comprehensively assess the health promotion self-care behaviors of patients with Type 2 diabetes.

Timed activity performance in persons with upper limb amputation: A preliminary study.

PubMed

Resnik, Linda; Borgia, Mathew; Acluche, Frantzy

55 subjects with upper limb amputation were administered the T-MAP twice within one week. To develop a timed measure of activity performance for persons with upper limb amputation (T-MAP); examine the measure's internal consistency, test-retest reliability and validity; and compare scores by prosthesis use. Measures of activity performance for persons with upper limb amputation are needed The time required to perform daily activities is a meaningful metric that implication for participation in life roles. Internal consistency and test-retest reliability were evaluated. Construct validity was examined by comparing scores by amputation level. Exploratory analyses compared sub-group scores, and examined correlations with other measures. Scale alpha was 0.77, ICC was 0.93. Timed scores differed by amputation level. Subjects using a prosthesis took longer to perform all tasks. T-MAP was not correlated with other measures of dexterity or activity, but was correlated with pain for non-prosthesis users. The timed scale had adequate internal consistency and excellent test-retest reliability. Analyses support reliability and construct validity of the T-MAP. 2c "outcomes" research. Published by Elsevier Inc.

Evaluation of the spoken knowledge in low literacy in diabetes scale for use with Mexican Americans.

PubMed

Garcia, Alexandra A; Zuniga, Julie; Reynolds, Raquel; Cairampoma, Laura; Sumlin, Lisa

2015-05-01

This article evaluates the Spoken Knowledge in Low Literacy in Diabetes (SKILLD) questionnaire, a measure of essential knowledge for type 2 diabetes self-management, after it was modified for English- and Spanish-speaking Mexican Americans. We collected surveys (SKILLD, demographic, acculturation) and blood for A1C analysis from 72 community-recruited participants to analyze the SKILLD's internal consistency, interrater reliability, item analysis, and construct validity. Clinical experts evaluated content validity. The SKILLD demonstrated low internal consistency but high interrater reliability and content and construct validity. There were significant correlations in expected directions between SKILLD scores and acculturation, education, and A1C and significant differences in SKILLD scores between and within groups after an educational intervention and between high- and low-acculturated participants. The SKILLD generates useful information about Mexican Americans' diabetes knowledge. Lower SKILLD scores suggest less diabetes knowledge, lower health literacy, and participants' difficulties understanding items. Further modifications should improve use with low-acculturated Mexican Americans. © The Author(s) 2014.

Toward the Reliable Diagnosis of DSM-5 Premenstrual Dysphoric Disorder: The Carolina Premenstrual Assessment Scoring System (C-PASS)

PubMed Central

Eisenlohr-Moul, Tory A.; Girdler, Susan S.; Schmalenberger, Katja M.; Dawson, Danyelle N.; Surana, Pallavi; Johnson, Jacqueline L.; Rubinow, David R.

2016-01-01

Objective Despite evidence for the validity of premenstrual dysphoric disorder (PMDD) and its recent inclusion in DSM-5, variable diagnostic practices compromise the construct validity of the diagnosis and threaten the clarity of efforts to understand and treat its underlying pathophysiology. In an effort to hasten and streamline the translation of the new DSM-5 criteria for PMDD into terms compatible with existing research practices, we present the development and initial validation of the Carolina Premenstrual Assessment Scoring System (C-PASS). The C-PASS is a standardized scoring system for making DSM-5 PMDD diagnoses using 2 or more menstrual cycles of daily symptom ratings using the Daily Record of Severity of Problems (DRSP). Method Two hundred women recruited for retrospectively-reported premenstrual emotional symptoms provided 2–4 menstrual cycles of daily symptom ratings on the DRSP. Diagnoses were made by expert clinician and the C-PASS. Results Agreement of C-PASS diagnosis with expert clinical diagnosis was excellent; overall correct classification by the C-PASS was estimated at 98%. Consistent with previous evidence, retrospective reports of premenstrual symptom increases were a poor predictor of prospective C-PASS diagnosis. Conclusions The C-PASS (available as a worksheet, Excel macro, and SAS macro) is a reliable and valid companion protocol to the DRSP that standardizes and streamlines the complex, multilevel diagnosis of DSM-5 PMDD. Consistent use of this robust diagnostic method would result in more clearly-defined, homogeneous samples of women with PMDD, thereby improving the clarity of studies seeking to characterize or treat the underlying pathophysiology of the disorder. PMID:27523500

Cross-Cultural Aspect of Behavior Assessment System for Children-2, Parent Rating Scale-Child: Standardization in Korean Children

PubMed Central

Song, Jungeun; Leventhal, Bennett L.; Koh, Yun-Joo; Cheon, Keun-Ah; Hong, Hyun Ju; Kim, Young-Key; Cho, Kyungjin; Lim, Eun-Chung; Park, Jee In

2017-01-01

Purpose Our study aimed to examine psychometric properties and cross-cultural utility of the Behavior Assessment System for Children-2, Parent Rating Scale-Child (BASC-2 PRS-C) in Korean children. Materials and Methods Two study populations were recruited: a general population sample (n=2115) of 1st to 6th graders from 16 elementary schools and a clinical population (n=219) of 6–12 years old from 5 child psychiatric clinics and an epidemiological sample of autism spectrum disorder. We assessed the validity and reliability of the Korean version of BASC-2 PRS-C (K-BASC-2 PRS-C) and compared subscales with those used for US populations. Results Our results indicate that the K-BASC-2 PRS-C is a valuable instrument with reliability and validity for measuring developmental psychopathology that is comparable to those in Western population. However, there were some differences noted in the mean scores of BASC-2 PRS-C between Korean and US populations. Conclusion K-BASC-2 PRS-C is an effective and useful instrument with psychometric properties that permits measurement of general developmental psychopathology. Observed Korean-US differences in patterns of parental reports of children's behaviors indicate the importance of the validation, standardization and cultural adaptation for tools assessing psychopathology especially when used in populations different from those for which the instrument was originally created. PMID:28120577

Cross-Cultural Aspect of Behavior Assessment System for Children-2, Parent Rating Scale-Child: Standardization in Korean Children.

PubMed

Song, Jungeun; Leventhal, Bennett L; Koh, Yun Joo; Cheon, Keun Ah; Hong, Hyun Ju; Kim, Young Key; Cho, Kyungjin; Lim, Eun Chung; Park, Jee In; Kim, Young Shin

2017-03-01

Our study aimed to examine psychometric properties and cross-cultural utility of the Behavior Assessment System for Children-2, Parent Rating Scale-Child (BASC-2 PRS-C) in Korean children. Two study populations were recruited: a general population sample (n=2115) of 1st to 6th graders from 16 elementary schools and a clinical population (n=219) of 6-12 years old from 5 child psychiatric clinics and an epidemiological sample of autism spectrum disorder. We assessed the validity and reliability of the Korean version of BASC-2 PRS-C (K-BASC-2 PRS-C) and compared subscales with those used for US populations. Our results indicate that the K-BASC-2 PRS-C is a valuable instrument with reliability and validity for measuring developmental psychopathology that is comparable to those in Western population. However, there were some differences noted in the mean scores of BASC-2 PRS-C between Korean and US populations. K-BASC-2 PRS-C is an effective and useful instrument with psychometric properties that permits measurement of general developmental psychopathology. Observed Korean-US differences in patterns of parental reports of children's behaviors indicate the importance of the validation, standardization and cultural adaptation for tools assessing psychopathology especially when used in populations different from those for which the instrument was originally created.

75 FR 29333 - Proposed Agency Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-25

..., including the validity of the methodology and assumptions used; (c) ways to enhance the quality, utility..., 2010. Terri T. Lee, Chief Operating Officer, Electricity Delivery and Energy Reliability. [FR Doc. 2010...

Validity and reliability of the Physical Activity Questionnaire for Children (PAQ-C) and Adolescents (PAQ-A) in individuals with congenital heart disease

PubMed Central

Dean, Paige H.; Gardner, Ross F.; Duncombe, Stephanie L.; Harris, Kevin C.

2017-01-01

Objective To assess the criterion validity, internal consistency, reliability and cut-point for the Physical Activity Questionnaire for Children (PAQ-C) and Adolescents (PAQ-A) in children and adolescents with congenital heart disease–a special population at high cardiovascular risk in whom physical activity has not been extensively evaluated. Methods We included 84 participants (13.6±2.9 yrs, 50% female) with simple (37%), moderate (31%), or severe congenital heart disease (27%), as well as cardiac transplant recipients (6%), from BC Children’s Hospital, Canada. They completed the PAQ-C (≤11yrs, n = 28) or–A (≥12yrs, n = 56), and also wore a triaxial accelerometer (GT3X+ or GT9X) over the right hip for 7 days (n = 59 met valid wear time criteria). Results Median daily moderate-to-vigorous physical activity was 46.9 minutes per day (IQR 31.6–61.8) and 25% met physical activity guidelines defined as ≥60 minutes of moderate-to-vigorous physical activity per day. Median PAQ-score was 2.6 (IQR 1.9–3.0). PAQ-Scores were significantly related to accelerometry-derived metrics of physical activity (rho = 0.44–0.55, all p<0.01) and sedentary behaviour (rho = -0.53, p<0.001). Internal consistency was high (α = 0.837), as was reliability (stability) of PAQ-Scores over a 4-months period (ICC = 0.73, 95%CI 0.55–0.84; p<0.001). We identified that a PAQ-Score cut-point of 2.87 discriminates between those meeting physical guidelines and those that do not in the combined PAQ-C and–A samples (area under the curve = 0.80 (95%CI 0.67–0.92). Conclusion Validity and reliability of the PAQ in children and adolescents with CHD was comparable to or stronger than previous studies in healthy children. Therefore, the PAQ may be used to estimate general levels of physical activity in children and adolescents with CHD. PMID:28445485

Psychometric properties of the Children's Scale of Hostility and Aggression: Reactive/Proactive (C-SHARP).

PubMed

Farmer, Cristan A; Aman, Michael G

2010-01-01

Although often lacking "malice", aggression is fairly common in children with intellectual or developmental disability (I/DD). Despite this, there are no scales available that are appropriate for an in-depth analysis of aggressive behavior in this population. Such scales are needed for the study of aggressive behavior, which is a common target symptom in clinical trials. We assessed the reliability and validity of the Children's Scale of Hostility and Aggression: Reactive/Proactive (C-SHARP), a new aggression scale created for children with I/DD. Data are presented from a survey of 365 children with I/DD aged 3-21 years. Interrater reliability was very high for the Problem Scale, which characterizes type of aggression. Reliability was lower but largely acceptable for the Provocation Scale, which assesses motivation. Validity of the Problem Scale was supported by expected differences in children with autism, Down syndrome, comorbid disruptive behavior disorders (DBDs) and ADHD. The Provocation Scale, which categorizes behavior as proactive or reactive, showed expected differences in children with DBD, but was less effective in those with ADHD. The C-SHARP appears to have fundamentally sound psychometric characteristics, although more research is needed.

A Validation of the Classroom Assessment Scoring System in Finnish Kindergartens

ERIC Educational Resources Information Center

Pakarinen, Eija; Lerkkanen, Marja-Kristiina; Poikkeus, Anna-Maija; Kiuru, Noona; Siekkinen, Martti; Rasku-Puttonen, Helena; Nurmi, Jari-Erik

2010-01-01

Research Findings: This study examined the validity and reliability of the Classroom Assessment Scoring System (CLASS; R. C. Pianta, K. M. La Paro, & B. K. Hamre, 2008) in Finnish kindergartens. A pair of trained observers used the CLASS to observe 49 kindergarten teachers (47 female, 2 male) on two different days. Questionnaires measuring…

Validation of EORTC IN-PATSAT32 for Chinese cancer patients.

PubMed

Zhang, Lei; Dai, Zhenbo; Cheng, Siying; Xie, Shumin; Woo, Stephanie Mu-Lian; Luo, Zhiqin; Wu, Jinglian; Gao, Tianwen; Liu, Jiahao; Zhang, Kai; Zhang, Jing; Jia, Xinyu; Miller, Adam R; Wang, Changli

2015-09-01

The aim of this study is to test the psychometric properties and acceptability of the European Organization for Research and Treatment of Cancer (EORTC) inpatient satisfaction with care questionnaire 32 (IN-PATSAT32) for evaluating Chinese cancer patients and to analyze the influence of age, educational level, diagnostic time, and tumor stage on patient satisfaction. Three hundred two cancer inpatients in Tianjin Cancer Institution and Hospital from June 2013 to December 2013 were recruited for this study. All participants self-administered the EORTC IN-PATSAT32 and EORTC quality of life questionnaire-core 30 (QLQ-C30). Psychometric evaluation of the validity, reliability, acceptability, as well as the influence of age, educational level, diagnostic time, and tumor stage on patient satisfaction, was conducted. A favorable internal consistency reliability was confirmed, as the Cronbach's α coefficients were >0.80 for all scales in the EORTC IN-PATSAT32, ranging from 0.849 to 0.944. Multi-trait scaling analysis showed that all item-scale correlation coefficients met the standard of convergent validity, and 79.3 % met the standard of discriminant validity. Weak correlations were found between the scales and single items of the EORTC IN-PATSAT32 and EORTC QLQ-C30, proving the validity of EORTC IN-PATSAT32. None of the EORTC IN-PATSAT32 scales were able to discriminate between patients across age categories, while significant influences of educational level on doctors' and nurses' conduct, as well as influences of diagnostic time and tumor stage on nurses' conduct, and information provision scales were discovered. The questionnaire was easily understood with a satisfactory acceptability. The EORTC IN-PATSAT32 appears to be a reliable, valid, and acceptable instrument to use on cancer patients and is appropriate for measuring the patient satisfaction of Chinese patients.

Predicting functional outcomes among college drinkers: reliability and predictive validity of the Young Adult Alcohol Consequences Questionnaire.

PubMed

Read, Jennifer P; Merrill, Jennifer E; Kahler, Christopher W; Strong, David R

2007-11-01

Heavy drinking and associated consequences are widespread among U.S. college students. Recently, Read et al. (Read, J. P., Kahler, C. W., Strong, D., & Colder, C. R. (2006). Development and preliminary validation of the Young Adult Alcohol Consequences Questionnaire. Journal of Studies on Alcohol, 67, 169-178) developed the Young Adult Alcohol Consequences Questionnaire (YAACQ) to assess the broad range of consequences that may result from heavy drinking in the college milieu. In the present study, we sought to add to the psychometric validation of this measure by employing a prospective design to examine the test-retest reliability, concurrent validity, and predictive validity of the YAACQ. We also sought to examine the utility of the YAACQ administered early in the semester in the prediction of functional outcomes later in the semester, including the persistence of heavy drinking, and academic functioning. Ninety-two college students (48 females) completed a self-report assessment battery during the first weeks of the Fall semester, and approximately one week later. Additionally, 64 subjects (37 females) participated at an optional third time point at the end of the semester. Overall, the YAACQ demonstrated strong internal consistency, test-retest reliability, and concurrent and predictive validity. YAACQ scores also were predictive of both drinking frequency, and "binge" drinking frequency. YAACQ total scores at baseline were an early indicator of academic performance later in the semester, with greater number of total consequences experienced being negatively associated with end-of-semester grade point average. Specific YAACQ subscale scores (Impaired Control, Dependence Symptoms, Blackout Drinking) showed unique prediction of persistent drinking and academic outcomes.

European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30: factorial models to Brazilian cancer patients

PubMed Central

Campos, Juliana Alvares Duarte Bonini; Spexoto, Maria Cláudia Bernardes; da Silva, Wanderson Roberto; Serrano, Sergio Vicente; Marôco, João

2018-01-01

ABSTRACT Objective To evaluate the psychometric properties of the seven theoretical models proposed in the literature for European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30 (EORTC QLQ-C30), when applied to a sample of Brazilian cancer patients. Methods Content and construct validity (factorial, convergent, discriminant) were estimated. Confirmatory factor analysis was performed. Convergent validity was analyzed using the average variance extracted. Discriminant validity was analyzed using correlational analysis. Internal consistency and composite reliability were used to assess the reliability of instrument. Results A total of 1,020 cancer patients participated. The mean age was 53.3±13.0 years, and 62% were female. All models showed adequate factorial validity for the study sample. Convergent and discriminant validities and the reliability were compromised in all of the models for all of the single items referring to symptoms, as well as for the “physical function” and “cognitive function” factors. Conclusion All theoretical models assessed in this study presented adequate factorial validity when applied to Brazilian cancer patients. The choice of the best model for use in research and/or clinical protocols should be centered on the purpose and underlying theory of each model. PMID:29694609

Psychometric Properties of the Modified Personal Diabetes Questionnaire Among Chinese Patients With Type 2 Diabetes.

PubMed

Cheng, Li; Leung, Doris Y P; Wu, Yu-Ning; Sit, Janet W H; Yang, Miao-Yan; Li, Xiao-Mei

2018-03-01

This study examined the psychometric properties of the Chinese version of the Personal Diabetes Questionnaire (C-PDQ). The PDQ was translated into Chinese using a forward and backward translation approach. After being reviewed by an expert panel, the C-PDQ was administered to a convenience sample of 346 adults with Type 2 diabetes. The Chinese version of the Summary of Diabetes Self-Care Activities (C-SDSCA) was also administered. The results of the exploratory factor analysis revealed a one-factor structure for the Diet Knowledge, Decision-Making, and Eating Problems subscales and a two-factor structure for the barriers-related subscales. The criterion and convergent validity were supported by significant correlations of the subscales of the C-PDQ with the glycated hemoglobin values and the parallel subscales in the C-SDSCA, respectively. The C-PDQ subscales also showed acceptable internal consistency (α = .61-.89) and excellent test-retest reliability (intraclass correlation coefficients: .73-.96). The results provide preliminary support for the reliability and validity of the C-PDQ. This comprehensive, patient-centered instrument could be useful to identify the needs, concerns, and priorities of Chinese patients with type 2 diabetes.

The Chinese version of hospital anxiety and depression scale: Psychometric properties in Chinese cancer patients and their family caregivers.

PubMed

Li, Qiuping; Lin, Yi; Hu, Caiping; Xu, Yinghua; Zhou, Huiya; Yang, Liping; Xu, Yongyong

2016-12-01

The Hospital Anxiety and Depression Scale (HADS) acts as one of the most frequently used self-reported measures in cancer practice. The evidence for construct validity of HADS, however, remains inconclusive. The objective of this study is to evaluate the psychometric properties of the Chinese version HADS (C-HADS) in terms of construct validity, internal consistency reliability, and concurrent validity in dyads of Chinese cancer patients and their family caregivers. This was a cross-sectional study, conducted in multiple centers: one hospital in each of the seven different administrative regions in China from October 2014 to May 2015. A total of 641 dyads, consisting of cancer patients and family caregivers, completed a survey assessing their demographic and background information, anxiety and depression using C-HADS, and quality of life (QOL) using Chinese version SF-12. Data analysis methods included descriptive statistics, confirmatory factor analysis (CFA), and Pearson correlations. Both the two-factor and one-factor models offered the best and adequate fit to the data in cancer patients and family caregivers respectively. The comparison of the two-factor and single-factor models supports the basic assumption of two-factor construct of C-HADS. The overall and two subscales of C-HADS in both cancer patients and family caregivers had good internal consistency and acceptable concurrent validity. The Chinese version of the HADS may be a reliable and valid screening tool, as indicated by its original two-factor structure. The finding supports the basic assumption of two-factor construct of HADS. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validity of inner canthus temperature recorded by infrared thermography as a non-invasive surrogate measure for core temperature at rest, during exercise and recovery.

PubMed

Fernandes, Alex Andrade; Moreira, Danilo Gomes; Brito, Ciro José; da Silva, Cristiano Diniz; Sillero-Quintana, Manuel; Pimenta, Eduardo Mendonça; Bach, Aaron J E; Garcia, Emerson Silami; Bouzas Marins, João Carlos

2016-12-01

Research into obtaining a fast, valid, reliable and non-invasive measure of core temperature is of interest in many disciplinary fields. Occupational and sports medicine research has attempted to determine a non-invasive proxy for core temperature particularly when access to participants is limited and thermal safety is of a concern due to protective encapsulating clothing, hot ambient environments and/or high endogenous heat production during athletic competition. This investigation aimed to determine the validity of inner canthus of the eye temperature (T EC ) as an alternate non-invasive measure of intestinal core temperature (T C ) during rest, exercise and post-exercise conditions. Twelve physically active males rested for 30min prior to exercise, performed 60min of aerobic exercise at 60% V̇O 2max and passively recovered a further 60min post-exercise. T EC and T C were measured at 5min intervals during each condition. Mean differences between T EC and T C were 0.61°C during pre-exercise, -1.78°C during exercise and -1.00°C during post-exercise. The reliability between the methods was low in the pre-exercise (ICC=0.49 [-0.09 to 0.82]), exercise (ICC=-0.14 [-0.65 to 0.44]) and post-exercise (ICC=-0.25 [-0.70 to 0.35]) conditions. In conclusion, poor agreement was observed between the T EC values measured through IRT and T C measured through a gastrointestinal telemetry pill. Therefore, T EC is not a valid substitute measurement to gastrointestinal telemetry pill in sports and exercise science settings. Copyright © 2016 Elsevier Ltd. All rights reserved.

77 FR 29644 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-18

... reliability and construct validity of survey items and composites. (c) Case mix adjustment analysis--Assess the variables that may be considered as case mix adjusters. These preliminary research activities are...

Cross-cultural validation of the St. Louis Inventory of Community Living Skills for Chinese patients with schizophrenia in Hong Kong.

PubMed

Au, Raymond Wing Cheong; Tam, Peter Wai Chung; Tam, Gladys Wai Chi; Ungvari, Gabor Sander

2005-01-01

The study validated a culturally sensitive community living skills rating scale for Chinese patients by adapting the St. Louis Inventory of Community Living Skills (SLICLS). The Chinese version (SLICLS-C) was produced by forward and backward translation. An expert panel evaluated its content validity. Its internal consistency, inter-rater reliability, construct and concurrent validity were tested on 80 DSM-IV schizophrenia inpatients in a long-term facility. For predictive validity, the above sample was extended to ensure at least 20 subjects discharged to each of three levels of community care were included in the study sample. The SLICLS-C was psychometrically sound and could be used for predicting level of community care, program evaluation and measuring outcome.

Prior Study of Cross-Cultural Validation of McGill Quality-of-Life Questionnaire in Mainland Mandarin Chinese Patients With Cancer.

PubMed

Hu, Liya; Li, Jingwen; Wang, Xu; Payne, Sheila; Chen, Yuan; Mei, Qi

2015-11-01

The validation of McGill quality-of-life questionnaire (MQOLQ) in mainland China, which had already been used in multicultural palliative care background including Hong Kong and Taiwan, remained unknown. Eligible patients completed the translated Chinese version of McGill questionnaires (MQOL-C), which had been examined before the study. Construct validity was preliminarily assessed through exploratory factor analysis extracting 4 factors that construct a new hypothesis model and then the original model was proved to be better confirmed by confirmatory factor analysis. Internal consistency of all the subscales was within 0.582 to 0.917. Furthermore, test-retest reliability ranged from 0.509 to 0.859, which was determined by Spearman rank correlation coefficient. Face validation and feasibility also confirm the good validity of MQOL-C. The MQOL-C has satisfied validation in mainland Chinese patients with cancer, although cultural difference should be considered while using it. © The Author(s) 2014.

[Reliability study on the infrared spectrometry for measuring the delta over baseline for breath 13C].

PubMed

Wang, Min; Wang, Zhiling; Gou, Lingyan; Zhang, Yuhui; Yang, Xiaoguang; Sha, Lei; Li, Min

2013-03-01

To assess the validity and reliability of the infrared spectrometry for measuring the delta over baseline for breath 13C. Twenty-four healthy adults were selected, including twelve males and twelve females. 13C-Leucine was used as tracer in stable isotope metabolic experiments. One baseline breath was collected before the tracer protocol began. Other breath samples were collected at 60, 120, 180, 195, 210, 225, 240, 255, 270 and 300 min post-tracer challenge. The delta over baseline for breath 13C was measured by the infrared spectrometry and Heliview 13C breath analyzer. No significant differences were found between the infrared spectrometry and Heliview 13C breath analyzer in measuring the delta over baseline for breath 13C. The F value and p value of two-way ANOVA were 0.29 and 0.5874 respectively. The t and p value of consistency test were 0.48 and 0.6346 respectively. The 13C infrared spectrometry can reliably measure the delta over baseline for breath 13C.

Protocol and Demonstrations of Probabilistic Reliability Assessment for Structural Health Monitoring Systems (Preprint)

DTIC Science & Technology

2011-11-01

assessment to quality of localization/characterization estimates. This protocol includes four critical components: (1) a procedure to identify the...critical factors impacting SHM system performance; (2) a multistage or hierarchical approach to SHM system validation; (3) a model -assisted evaluation...Lindgren, E. A ., Buynak, C. F., Steffes, G., Derriso, M., “ Model -assisted Probabilistic Reliability Assessment for Structural Health Monitoring

Development and validation of a Spanish diabetes-specific numeracy measure: DNT-15 Latino.

PubMed

White, Richard O; Osborn, Chandra Y; Gebretsadik, Tebeb; Kripalani, Sunil; Rothman, Russell L

2011-09-01

Although deficits in health literacy and numeracy have been described among Latinos, the impact of low numeracy on diabetes outcomes has not been studied. Study objectives were (1) to establish the reliability and validity of a 15-item Spanish, diabetes-specific numeracy measure (Diabetes Numeracy Test [DNT]-15 Latino) and (2) to examine the relationship between diabetes-specific numeracy and diabetes-related outcomes among a sample of Latino adults with diabetes. Data collection included patient demographics, health literacy, general numeracy, diabetes-specific numeracy, acculturation, self-efficacy, self-care behaviors, and most recent glycosylated hemoglobin (HbA1c). Participants (n=144) were on average 47.8 years old (SD=12.1). The majority were female (62%), uninsured (81%), and of Mexican nationality (78%) and reported low levels of acculturation (96%). The DNT-15 Latino had high internal reliability (Kruder-Richardson 20=0.78). The DNT-15 Latino demonstrated construct validity, correlating with measures of health literacy (ρ=0.291), general numeracy (ρ=0.500), education (ρ=0.361), and income (ρ=0.270) (P<0.001 for each). The DNT-15 Latino was significantly associated with acculturation but unrelated to self-efficacy, self-care behaviors, insulin use, and HbA1c. The DNT-15 Latino is a reliable and valid measure of diabetes-specific numeracy for Latino patients with diabetes; however, additional studies are needed to further explore the association between diabetes-specific numeracy and acculturation and their impact on diabetes-related outcomes for Latinos.

Development and validation of the Acculturative Stress Scale for Chinese College Students in the United States (ASSCS).

PubMed

Bai, Jieru

2016-04-01

Chinese students are the biggest ethnic group of international students in the United States. This study aims to develop a reliable and valid scale to accurately measure their acculturative stress. A 72-item pool was sent online to Chinese students and a five-factor scale of 32 items was generated by exploratory factor analysis. The five factors included language insufficiency, social isolation, perceived discrimination, academic pressure, and guilt toward family. The Acculturative Stress Scale for Chinese Students demonstrated high reliability and initial validity by predicting depression and life satisfaction. It was the first Chinese scale of acculturative stress developed and validated among a Chinese student sample in the United States. In the future, the scale can be used as a diagnostic tool by mental health professionals and a self-assessment tool by Chinese students. (c) 2016 APA, all rights reserved.

The validity of three tests of temperament in guppies (Poecilia reticulata).

PubMed

Burns, James G

2008-11-01

Differences in temperament (consistent differences among individuals in behavior) can have important effects on fitness-related activities such as dispersal and competition. However, evolutionary ecologists have put limited effort into validating their tests of temperament. This article attempts to validate three standard tests of temperament in guppies: the open-field test, emergence test, and novel-object test. Through multiple reliability trials, and comparison of results between different types of test, this study establishes the confidence that can be placed in these temperament tests. The open-field test is shown to be a good test of boldness and exploratory behavior; the open-field test was reliable when tested in multiple ways. There were problems with the emergence test and novel-object test, which leads one to conclude that the protocols used in this study should not be considered valid tests for this species. (PsycINFO Database Record (c) 2008 APA, all rights reserved).

Development of a computer-assisted forensic radiographic identification method using the lateral cervical and lumbar spine.

PubMed

Derrick, Sharon M; Raxter, Michelle H; Hipp, John A; Goel, Priya; Chan, Elaine F; Love, Jennifer C; Wiersema, Jason M; Akella, N Shastry

2015-01-01

Medical examiners and coroners (ME/C) in the United States hold statutory responsibility to identify deceased individuals who fall under their jurisdiction. The computer-assisted decedent identification (CADI) project was designed to modify software used in diagnosis and treatment of spinal injuries into a mathematically validated tool for ME/C identification of fleshed decedents. CADI software analyzes the shapes of targeted vertebral bodies imaged in an array of standard radiographs and quantifies the likelihood that any two of the radiographs contain matching vertebral bodies. Six validation tests measured the repeatability, reliability, and sensitivity of the method, and the effects of age, sex, and number of radiographs in array composition. CADI returned a 92-100% success rate in identifying the true matching pair of vertebrae within arrays of five to 30 radiographs. Further development of CADI is expected to produce a novel identification method for use in ME/C offices that is reliable, timely, and cost-effective. © 2014 American Academy of Forensic Sciences.

Intersession and Intrasession Reliability and Validity of the My Jump App for Measuring Different Jump Actions in Trained Male and Female Athletes.

PubMed

Gallardo-Fuentes, Francisco; Gallardo-Fuentes, Jorge; Ramírez-Campillo, Rodrigo; Balsalobre-Fernández, Carlos; Martínez, Cristian; Caniuqueo, Alexis; Cañas, Rodrigo; Banzer, Winfried; Loturco, Irineu; Nakamura, Fabio Y; Izquierdo, Mikel

2016-07-01

Gallardo-Fuentes, F, Gallardo-Fuentes, J, Ramírez-Campillo, R, Balsalobre-Fernández, C, Martínez, C, Caniuqueo, A, Cañas, R, Banzer, W, Loturco, I, Nakamura, FY, and Izquierdo, M. Intersession and intrasession reliability and validity of the My Jump app for measuring different jump actions in trained male and female athletes. J Strength Cond Res 30(7): 2049-2056, 2016-The purpose of this study was to analyze the concurrent validity and reliability of the iPhone app named My Jump for measuring jump height in 40-cm drop jumps (DJs), countermovement jumps (CMJs), and squat jumps (SJs). To do this, 21 male and female athletes (age, 22.1 ± 3.6 years) completed 5 maximal DJs, CMJs, and SJs on 2 separate days, which were evaluated using a contact platform and the app My Jump, developed to calculate jump height from flight time using the high-speed video recording facility on the iPhone. A total of 630 jumps were compared using the intraclass correlation coefficient (ICC), Bland-Altman plots, Pearson's product moment correlation coefficient (r), Cronbach's alpha (α), and coefficient of variation (CV). There was almost perfect agreement between the measurement instruments for all jump height values (ICC = 0.97-0.99), with no differences between the instruments (p > 0.05; mean difference of 0.2 cm). Almost perfect correlation was observed between the measurement instruments for SJs, CMJs, and DJs (r = 0.96-0.99). My Jump showed very good within-subject reliability (α = 0.94-0.99; CV = 3.8-7.6) and interday reliability (r = 0.86-0.95) for SJs, CMJs, and DJs in all subjects. Therefore, the iPhone app named My Jump provides reliable intersession and intrasession data, as well as valid measurements for maximal jump height during fast (i.e., DJs) and slow (i.e., CMJs) stretch-shortening cycle muscle actions, and during concentric-only explosive muscle actions (i.e., SJs), in both male and female athletes in comparison with a professional contact platform.

Arabic validation of the Urogenital Distress Inventory and Adapted Incontinence Impact Questionnaires--short forms.

PubMed

El-Azab, Ahmed S; Mascha, Edward J

2009-01-01

The purpose of this study was to adapt the IIQ-7 to suit the Egyptian culture and then to assess validity and reliability of the adapted and translated IIQ-7 and UDI-6. IIQ-7 was modified to suit Egyptian culture. Linguistic validation of the two questionnaires was done. Initial test-retest reliability and internal consistency of adapted translated questionnaires were done in a pilot study. The final validity, test-retest reliability and internal consistency study included 204 women with urinary incontinence (UI). Participants completed the two questionnaires at enrollment and after 2 weeks. All participants underwent urodynamics. Baseline urodynamic diagnosis was compared with diagnoses made by questionnaires to assess validity. Test-retest reliability was excellent for both the IIQ-7 and UDI-6. For the UDI-6, the mean difference (SD) between first and second visits was -1.63 (7.0), and the 95% CI for the mean difference was -2.6 and -0.68. The 95% limits of agreement were -15.3 and 12.0. Lin's concordance correlation coefficient (LCCC) (95% CI) for the UDI was 0.89 (0.85 and 0.91). For the IIQ-7, the mean difference (SD) was 0.37 (7.1), and the 95% CI for the mean difference was -0.60 and 1.3. The 95% limits of agreement were -13.5 and 14.2. LCCC (95% CI) for the IIQ was 0.90 (0.87 and 0.92). Internal consistency as assessed using Cronbach's alpha was 0.32 and 0.31 for the UDI-6 and IIQ-7, respectively. Validity assessments indicated that both IIQ and UDI scales can distinguish objective disease states. UDI-6 and the modified IIQ-7 are easy to administer, test-retest reliable, and valid questionnaires, with relatively low internal consistency. (c) 2008 Wiley-Liss, Inc.

Development of an opioid-related Overdose Risk Behavior Scale (ORBS).

PubMed

Pouget, Enrique R; Bennett, Alex S; Elliott, Luther; Wolfson-Stofko, Brett; Almeñana, Ramona; Britton, Peter C; Rosenblum, Andrew

2017-01-01

Drug overdose has emerged as the leading cause of injury-related death in the United States, driven by prescription opioid (PO) misuse, polysubstance use, and use of heroin. To better understand opioid-related overdose risks that may change over time and across populations, there is a need for a more comprehensive assessment of related risk behaviors. Drawing on existing research, formative interviews, and discussions with community and scientific advisors an opioid-related Overdose Risk Behavior Scale (ORBS) was developed. Military veterans reporting any use of heroin or POs in the past month were enrolled using venue-based and chain referral recruitment. The final scale consisted of 25 items grouped into 5 subscales eliciting the number of days in the past 30 during which the participant engaged in each behavior. Internal reliability, test-retest reliability and criterion validity were assessed using Cronbach's alpha, intraclass correlations (ICC) and Pearson's correlations with indicators of having overdosed during the past 30 days, respectivelyInternal reliability, test-retest reliability and criterion validity were assessed using Cronbach's alpha, intraclass correlations (ICC) and Pearson's correlations with indicators of having overdosed during the past 30 days, respectively. Data for 220 veterans were analyzed. The 5 subscales-(A) Adherence to Opioid Dosage and Therapeutic Purposes; (B) Alternative Methods of Opioid Administration; (C) Solitary Opioid Use; (D) Use of Nonprescribed Overdose-associated Drugs; and (E) Concurrent Use of POs, Other Psychoactive Drugs and Alcohol-generally showed good internal reliability (alpha range = 0.61 to 0.88), test-retest reliability (ICC range = 0.81 to 0.90), and criterion validity (r range = 0.22 to 0.66). The subscales were internally consistent with each other (alpha = 0.84). The scale mean had an ICC value of 0.99, and correlations with validators ranged from 0.44 to 0.56. These results constitute preliminary evidence for the reliability and validity of the new scale. If further validated, it could help improve overdose prevention and response research and could help improve the precision of overdose education and prevention efforts.

Patient-reported outcome instruments that evaluate adherence behaviours in adults with asthma: A systematic review of measurement properties.

PubMed

Gagné, Myriam; Boulet, Louis-Philippe; Pérez, Norma; Moisan, Jocelyne

2018-04-30

To systematically identify the measurement properties of patient-reported outcome instruments (PROs) that evaluate adherence to inhaled maintenance medication in adults with asthma. We conducted a systematic review of six databases. Two reviewers independently included studies on the measurement properties of PROs that evaluated adherence in asthmatic participants aged ≥18 years. Based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), the reviewers (1) extracted data on internal consistency, reliability, measurement error, content validity, structural validity, hypotheses testing, cross-cultural validity, criterion validity, and responsiveness; (2) assessed the methodological quality of the included studies; (3) assessed the quality of the measurement properties (positive or negative); and (4) summarised the level of evidence (limited, moderate, or strong). We screened 6,068 records and included 15 studies (14 PROs). No studies evaluated measurement error or responsiveness. Based on methodological and measurement property quality assessments, we found limited positive evidence of: (a) internal consistency of the Adherence Questionnaire, Refined Medication Adherence Reason Scale (MAR-Scale), Medication Adherence Report Scale for Asthma (MARS-A), and Test of the Adherence to Inhalers (TAI); (b) reliability of the TAI; and (c) structural validity of the Adherence Questionnaire, MAR-Scale, MARS-A, and TAI. We also found limited negative evidence of: (d) hypotheses testing of Adherence Questionnaire; (e) reliability of the MARS-A; and (f) criterion validity of the MARS-A and TAI. Our results highlighted the need to conduct further high-quality studies that will positively evaluate the reliability, validity, and responsiveness of the available PROs. This article is protected by copyright. All rights reserved.

The intelligibility in Context Scale: validity and reliability of a subjective rating measure.

PubMed

McLeod, Sharynne; Harrison, Linda J; McCormack, Jane

2012-04-01

To describe a new measure of functional intelligibility, the Intelligibility in Context Scale (ICS), and evaluate its validity, reliability, and sensitivity using 3 clinical measures of severity of speech sound disorder: (a) percentage of phonemes correct (PPC), (b) percentage of consonants correct (PCC), and (c) percentage of vowels correct (PVC). Speech skills of 120 preschool children (109 with parent-/teacher-identified concern about how they talked and made speech sounds and 11 with no identified concern) were assessed with the Diagnostic Evaluation of Articulation and Phonology (Dodd, Hua, Crosbie, Holm, & Ozanne, 2002). Parents completed the 7-item ICS, which rates the degree to which children's speech is understood by different communication partners (parents, immediate family, extended family, friends, acquaintances, teachers, and strangers) on a 5-point scale. Parents' ratings showed that most children were always (5) or usually (4) understood by parents, immediate family, and teachers, but only sometimes (3) by strangers. Factor analysis confirmed the internal consistency of the ICS items; therefore, ratings were averaged to form an overall intelligibility score. The ICS had high internal reliability (α = .93), sensitivity, and construct validity. Criterion validity was established through significant correlations between the ICS and PPC (r = .54), PCC (r = .54), and PVC (r = .36). The ICS is a promising new measure of functional intelligibility. These data provide initial support for the ICS as an easily administered, valid, and reliable estimate of preschool children's intelligibility when speaking with people of varying levels of familiarity and authority.

An investigation of the psychometric properties of the Chinese (Cantonese) version of Subjective Index of Physical and Social Outcome (SIPSO).

PubMed

Kwong, Patrick Wh; Ng, Shamay Sm; Ng, Gabriel Yf

2017-11-01

The objectives of this study were 1) to translate and make cultural adaptations to the English version of the SIPSO questionnaire to create a Chinese (Cantonese) version, 2) evaluate the internal consistency, test-retest reliability the C-SIPSO questionnaire, and 3) compare the SIPSO-C scores of stroke survivors with different demographic characteristics to establish the discriminant validity of the questionnaire Design: Translation of questionnaire, cross sectional study. University-based clinical research laboratory. Subjects Community-dwelling chronic stroke survivors. Not applicable. Subjective Index of Physical and Social Outcome, Geriatric Depression Scale, 10-metre Walk test. Two bilingual professional translators translated the SIPSO questionnaire independently. An expert panel comprising five registered physiotherapists verified the content validity of the final version (C-SIPSO). C-SIPSO demonstrated good internal consistency (Cronbach's α = 0.83) and excellent test-retest reliability (ICC 3,1 = 0.866) in ninety-two community dwelling chronic stroke survivors. Stroke survivors scored higher than 10 in the Geriatric Depression Scale ( U = 555.0, P < 0.001) and with the comfortable walking speed lower than 0.8ms -1 ( U = 726.5; P = 0.012) scored significantly lower on SIPSO-C. SIPSO-C is a reliable instrument that can be used to measure the level of community integration in community-dwelling stroke survivors in Hong Kong and southern China. Stroke survivors who were at high risk of minor depression and with limited community ambulation ability demonstrated a lower level of community integration as measured with SIPSO-C.

Development and psychometric properties of the Carer - Head Injury Neurobehavioral Assessment Scale (C-HINAS) and the Carer - Head Injury Participation Scale (C-HIPS): patient and family determined outcome scales.

PubMed

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-06-01

Develop and assess the psychometric properties of the Carer - Head Injury Participation Scale (C-HIPS) and its biggest factor the Carer - Head Injury Neurobehavioral Assessment Scale (C-HINAS). Furthermore, the aim was to examine the inter-informant reliability by comparing the self reports of individuals with traumatic brain injury (TBI) with the carer reports on the C-HIPS and the C-HINAS. Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analysed and key themes and concepts were used to construct a 49-item and 58-item patient (Patient - Head Injury Participation Scale [P-HIPS]) and carer outcome measure (C-HIPS) respectively, of which 49 were parallel items and nine additional items were used to assess carer burden. Postal versions of the P-HIPS, C-HIPS, Mayo Portland Adaptability Inventory-3 (MPAI-3), and the Glasgow Outcome Scale-Extended (GOSE) were completed by a cohort of 113 TBI individuals and 80 carers. Data from a sub-group of 66 patient/carer pairs were used to compare inter-informant reliability between the P-HIPS and the C-HIPS, and the P-HINAS and the C-HINAS respectively. All individual 49 items of the C-HIPS and their total score showed good test-retest reliability (0.95) and internal consistency (0.95). Comparisons with the MPAI-3 and GOSE found a good correlation with the MPAI-3 (0.7) and a moderate negative correlation with the GOSE (-0.6). Factor analysis of these items extracted a 4-factor structure which represented the domains 'Emotion/Behavior' (C-HINAS), 'Independence/Community Living', 'Cognition', and 'Physical'. The C-HINAS showed good internal consistency (0.92), test-retest reliability (0.93), and concurrent validity with one MPAI subscale (0.7). Assessment of inter-informant reliability revealed good correspondence between the reports of the patients and the carers for both the C-HIPS (0.83) and the C-HINAS (0.82). Both the C-HINAS and the C-HIPS show strong psychometric properties. The qualitative methodology employed in the construction stage of the questionnaires provided good evidence of face and content validity. Comparisons between the P-HIPS and the C-HIPS, and the P-HINAS and the C-HINAS indicated high levels of agreement suggesting that in situations where the patient is unable to provide self-reports, information provided by the carer could be used.

Learned helplessness: validity and reliability of depressive-like states in mice.

PubMed

Chourbaji, S; Zacher, C; Sanchis-Segura, C; Dormann, C; Vollmayr, B; Gass, P

2005-12-01

The learned helplessness paradigm is a depression model in which animals are exposed to unpredictable and uncontrollable stress, e.g. electroshocks, and subsequently develop coping deficits for aversive but escapable situations (J.B. Overmier, M.E. Seligman, Effects of inescapable shock upon subsequent escape and avoidance responding, J. Comp. Physiol. Psychol. 63 (1967) 28-33 ). It represents a model with good similarity to the symptoms of depression, construct, and predictive validity in rats. Despite an increased need to investigate emotional, in particular depression-like behaviors in transgenic mice, so far only a few studies have been published using the learned helplessness paradigm. One reason may be the fact that-in contrast to rats (B. Vollmayr, F.A. Henn, Learned helplessness in the rat: improvements in validity and reliability, Brain Res. Brain Res. Protoc. 8 (2001) 1-7)--there is no generally accepted learned helplessness protocol available for mice. This prompted us to develop a reliable helplessness procedure in C57BL/6N mice, to exclude possible artifacts, and to establish a protocol, which yields a consistent fraction of helpless mice following the shock exposure. Furthermore, we validated this protocol pharmacologically using the tricyclic antidepressant imipramine. Here, we present a mouse model with good face and predictive validity that can be used for transgenic, behavioral, and pharmacological studies.

Translation and validation of Pediatric Quality of Life Inventory™ 3.0 Diabetes Module (PedsQL™ 3.0 Diabetes Module) in Brazil-Portuguese language.

PubMed

Garcia, Leila F Dos S; Manna, Thais Della; Passone, Caroline de Gouveia Buff; Oliveira, Lygia Spassapan de

2017-11-14

The aim of the present study was to create a translated version of the Pediatric Quality of Life Inventory™ 3.0 Diabetes Module (PedsQL™ 3.0 Diabetes Module) in Brazilian Portuguese that was conceptually equivalent to the original American English version and to linguistically validate it in a Brazilian pediatric population with type 1 diabetes mellitus and their parents or caregivers. The instrument was translated, back-translated, and then administered to 83 children/adolescents (5-18 years) with type 1 diabetes mellitus and their family members and to 25 parents/caregivers of patients aged between 2 and 4 years. The final translated version was tested for reliability by analyzing internal consistency, intraobserver (test-retest) reliability, and concurrent validity. Cronbach's alpha coefficient for the total score of the questionnaires of children/adolescents (α=0.85) and their parents (α=0.82) was above the recommended minimum of 0.70 for group comparisons. Intraobserver reliability and concurrent validity exhibited a significant positive correlation (p<0.001), indicating the reliability of the translated instrument. A moderate but significant positive correlation (r=0.40; p<0.001) was demonstrated between the total scores of patient self-report and parent proxy-report scales. There was no significant correlation between glycated hemoglobin (HbA1c) levels and the respective scores in the questionnaires answered by patients and their parents/caregivers. The analysis of the translated version of the PedsQL™ 3.0 Diabetes Module revealed adequate psychometric characteristics with respect to reliability and validity following administration to a sample of Brazilian children/adolescents with type 1 diabetes mellitus and their caregivers. Copyright © 2017. Published by Elsevier Editora Ltda.

The real relationship inventory: development and psychometric investigation of the client form.

PubMed

Kelley, Frances A; Gelso, Charles J; Fuertes, Jairo N; Marmarosh, Cheri; Lanier, Stacey Holmes

2010-12-01

The development and validation of a client version of the Real Relationship Inventory (RRI-C) is reported. Using a sample of clients (n = 94) who were currently in psychotherapy, a 24-item measure was developed consisting of two subscales (Realism and Genuineness) and a total score. This 24-item version and other measures used for validation were completed by 93 additional clients. Results of the present study offer initial support for the validity and reliability of the RRI-C. The RRI-C correlated significantly in theoretically expected ways with measures of the client-rated working alliance and therapists' congruence, clients' observing ego, and client ratings of client and therapist real relationship on an earlier measure of the real relationship (Eugster & Wampold, 1996). A nonsignificant relation was found between the RRI-C and a measure of social desirability, providing support for discriminant validity. A confirmatory factor analysis supported the two theorized factors of the RRI-C. The authors discuss the importance of measuring clients' perceptions of the real relationship. (PsycINFO Database Record (c) 2010 APA, all rights reserved).

The reliability, validity, and accuracy of self-reported absenteeism from work: a meta-analysis.

PubMed

Johns, Gary; Miraglia, Mariella

2015-01-01

Because of a variety of access limitations, self-reported absenteeism from work is often employed in research concerning health, organizational behavior, and economics, and it is ubiquitous in large scale population surveys in these domains. Several well established cognitive and social-motivational biases suggest that self-reports of absence will exhibit convergent validity with records-based measures but that people will tend to underreport the behavior. We used meta-analysis to summarize the reliability, validity, and accuracy of absence self-reports. The results suggested that self-reports of absenteeism offer adequate test-retest reliability and that they exhibit reasonably good rank order convergence with organizational records. However, people have a decided tendency to underreport their absenteeism, although such underreporting has decreased over time. Also, self-reports were more accurate when sickness absence rather than absence for any reason was probed. It is concluded that self-reported absenteeism might serve as a valid measure in some correlational research designs. However, when accurate knowledge of absolute absenteeism levels is essential, the tendency to underreport could result in flawed policy decisions. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Validation of the Avoidance and Inflexibility Scale (AIS) among treatment-seeking smokers.

PubMed

Farris, Samantha G; Zvolensky, Michael J; DiBello, Angelo M; Schmidt, Norman B

2015-06-01

The Avoidance and Inflexibility Scale (AIS; Gifford et al., 2004) was derived as a smoking-specific measure of experiential avoidance. However, there has been little investigation of the psychometric proprieties of the AIS and no published work on the topic. The current study aimed to test the reliability and validity of the AIS among a sample of adult treatment-seeking daily smokers (n = 465; 48.2% female, 17.8 [SD = 9.60] cigarettes per day). The AIS was administered at 3 time points (baseline, quit-day, and 1 month postquit) as part of a larger smoking cessation trial. An exploratory factor analysis indicated a 2-factor solution, described by inflexibility and avoidance because of smoking related "thoughts/feelings" (9 items) and "somatic sensations" (4 items). Results revealed that the AIS-total and factor scores demonstrated high internal consistency and test-retest reliability. The AIS total and factor scores also displayed high convergent, discriminant, and incremental predictive validity with theoretically relevant smoking and affective variables. The present data suggest that the AIS measure appears to be a valid and reliable smoking-specific index of experiential avoidance. (c) 2015 APA, all rights reserved).

[*C]octanoic acid breath test to measure gastric emptying rate of solids.

PubMed

Maes, B D; Ghoos, Y F; Rutgeerts, P J; Hiele, M I; Geypens, B; Vantrappen, G

1994-12-01

We have developed a breath test to measure solid gastric emptying using a standardized scrambled egg test meal (250 kcal) labeled with [14C]octanoic acid or [13C]octanoic acid. In vitro incubation studies showed that octanoic acid is a reliable marker of the solid phase. The breath test was validated in 36 subjects by simultaneous radioscintigraphic and breath test measurements. Nine healthy volunteers were studied after intravenous administration of 200 mg erythromycin and peroral administration of 30 mg propantheline, respectively. Erythromycin significantly enhanced gastric emptying, while propantheline significantly reduced gastric emptying rates. We conclude that the [*C]octanoic breath test is a promising and reliable test for measuring the gastric emptying rate of solids.

Using Dynamic Risk and Protective Factors to Predict Inpatient Aggression: Reliability and Validity of START Assessments

ERIC Educational Resources Information Center

Desmarais, Sarah L.; Nicholls, Tonia L.; Wilson, Catherine M.; Brink, Johann

2012-01-01

The Short-Term Assessment of Risk and Treatability (START; C. D. Webster, M. L. Martin, J. Brink, T. L. Nicholls, & S. L. Desmarais, 2009; C. D. Webster, M. L. Martin, J. Brink, T. L. Nicholls, & C. Middleton, 2004) is a relatively new structured professional judgment guide for the assessment and management of short-term risks associated…

Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

ERIC Educational Resources Information Center

Goodwin, Laura D.; Goodwin, William L.

1984-01-01

The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

Cross-cultural adaptation and validation of the Korean Toronto Extremity Salvage Score for extremity sarcoma.

PubMed

Kim, Han-Soo; Yun, JiYeon; Kang, Seungcheol; Han, Ilkyu

2015-07-01

A Korean version of Toronto Extremity Salvage Score (TESS), a widely used disease-specific patient-reported questionnaire for assessing physical function of sarcoma patients, has not been developed. 1) to translate and cross-culturally adapt the TESS into Korean, and 2) to examine its comprehensibility, reliability and validity. TESS was translated into Korean, then translated back into English, and reviewed by a committee to develop the consensus version of the Korean TESS. The Korean TESS was administered to 126 patients to examine its comprehensibility, reliability, and validity. Comprehensibility was high, as the patients rated questions as "easy" or "very easy" in 96% for the TESS lower extremity (LE) and in 97% for the TESS upper extremity (UE). Test-retest reliability with intraclass coefficient (0.874 for LE and 0.979 for UE) and internal consistency with Cronbach's alpha (0.978 for LE and 0.989 for UE) were excellent. Korean TESS correlated with the MSTS score (r = 0.772 for LE and r = 0.635 for UE), and physical functioning domain of EORTC-CLQ C30 (r = 0.840 for LE and r = 0.630 for UE). Our study suggests that Korean version of the TESS is a comprehensible, reliable, and valid instrument to measure patient-reported functional outcome in patients with extremity sarcoma. © 2015 Wiley Periodicals, Inc.

The Dutch version of the Oxford Ankle and Foot Questionnaire for Children: Useful for evaluation of pediatric foot problems in groups.

PubMed

Burger, Elise; Selles, Ruud; van Nieuwkasteele, Shelly; Bessems, Gert; Pollet, Virginie; Hovius, Steven; van Nieuwenhoven, Christianne

2017-11-04

The purpose of this study is to develop a Dutch version of the Oxford Ankle and Foot Questionnaire for Children (OxAFQ-c) to allow evaluation of pediatric foot care. The OxAFQ-c was translated into Dutch, according to the ISPOR-guidelines. Children with different foot and ankle complaints completed the OxAFQ-c at baseline, after two weeks, and after 4-6 months. Measurement properties were assessed in terms of reliability, responsiveness, and construct validity. Test-retest reliability showed moderate intraclass correlation coefficients. Bland-Altman plots showed wide limits of agreement. After 4-6 months, the group that experienced improvement also showed improved questionnaire outcomes, indicating responsiveness. Moderate correlation between the OxAFQ-c and the Kidscreen and foot-specific VAS-scores were observed, indicating moderate construct validity. The Dutch OxAFQ-c showed moderate to good measurement properties. However, because we observed limited sensitivity to changes and wide limits of agreement in individual patients, we think the questionnaire should only be used in groups. Copyright © 2017 European Foot and Ankle Society. Published by Elsevier Ltd. All rights reserved.

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Noninvasive measurement of burn wound depth applying infrared thermal imaging (Conference Presentation)

NASA Astrophysics Data System (ADS)

Jaspers, Mariëlle E.; Maltha, Ilse M.; Klaessens, John H.; Vet, Henrica C.; Verdaasdonk, Rudolf M.; Zuijlen, Paul P.

2016-02-01

In burn wounds early discrimination between the different depths plays an important role in the treatment strategy. The remaining vasculature in the wound determines its healing potential. Non-invasive measurement tools that can identify the vascularization are therefore considered to be of high diagnostic importance. Thermography is a non-invasive technique that can accurately measure the temperature distribution over a large skin or tissue area, the temperature is a measure of the perfusion of that area. The aim of this study was to investigate the clinimetric properties (i.e. reliability and validity) of thermography for measuring burn wound depth. In a cross-sectional study with 50 burn wounds of 35 patients, the inter-observer reliability and the validity between thermography and Laser Doppler Imaging were studied. With ROC curve analyses the ΔT cut-off point for different burn wound depths were determined. The inter-observer reliability, expressed by an intra-class correlation coefficient of 0.99, was found to be excellent. In terms of validity, a ΔT cut-off point of 0.96°C (sensitivity 71%; specificity 79%) differentiates between a superficial partial-thickness and deep partial-thickness burn. A ΔT cut-off point of -0.80°C (sensitivity 70%; specificity 74%) could differentiate between a deep partial-thickness and a full-thickness burn wound. This study demonstrates that thermography is a reliable method in the assessment of burn wound depths. In addition, thermography was reasonably able to discriminate among different burn wound depths, indicating its potential use as a diagnostic tool in clinical burn practice.

Measuring functional, interactive and critical health literacy of Chinese secondary school students: reliable, valid and feasible?

PubMed

Guo, Shuaijun; Davis, Elise; Yu, Xiaoming; Naccarella, Lucio; Armstrong, Rebecca; Abel, Thomas; Browne, Geoffrey; Shi, Yanqin

2018-04-01

Health literacy is an increasingly important topic in the global context. In mainland China, health literacy measures mainly focus on health knowledge and practices or on the functional domain for adolescents. However, little is known about interactive and critical domains. This study aimed to adopt a skills-based and three-domain (functional, interactive and critical) instrument to measure health literacy in Chinese adolescents and to examine the status and determinants of each domain. Using a systematic review, the eight-item Health Literacy Assessment Tool (HLAT-8) was selected and translated from English to Chinese (c-HLAT-8). Following the translation process, a cross-sectional study was conducted in four secondary schools in Beijing, China. A total of 650 students in Years 7-9 were recruited to complete a self-administered questionnaire that assessed socio-demographics, self-efficacy, social support, school environment, community environment and health literacy. Results showed that the c-HLAT-8 had satisfactory reliability (Cronbach's α = 0.79; intra-class correlation coefficient = 0.72) and strong validity (translation validity index (TVI) ≥0.95; χ 2 / df = 3.388, p < 0.001; comparative fit index = 0.975, Tucker and Lewis's index of fit = 0.945, normed fit index = 0.965, root mean error of approximation = 0.061; scores on the c-HLAT-8 were moderately correlated with the Health Literacy Study-Taiwan, but weakly with the Newest Vital Sign). Chinese students had an average score of 26.37 (±5.89) for the c-HLAT-8. When the determinants of each domain of health literacy were examined, social support was the strongest predictor of interactive and critical health literacy. On the contrary, self-efficacy and school environment played more dominant roles in predicting functional health literacy. The c-HLAT-8 was demonstrated to be a reliable, valid and feasible instrument for measuring functional, interactive and critical health literacy among Chinese students. The current findings indicate that increasing self-efficacy, social support and creating supportive environments are important for promoting health literacy in secondary school settings in China.

Psychometric properties of the AIR Self-Determination Scale: the Chinese version (AIR SDS-C) for Chinese people with intellectual disabilities.

PubMed

Wong, P K S; Wong, D F K; Zhuang, X Y; Liu, Y

2017-03-01

The construct of self-determination has received considerable attention in the international field of intellectual disabilities (ID). Recently, there has been a rapid development of this construct in Chinese societies including Hong Kong. However, there is no locally validated instrument to measure self-determination in people with ID. This article explains the validation process of the AIR Self-Determination Scale - Chinese version (AIR SDS-C) adapted from the 24-item AIR Self-Determination Scale, developed by Wolman and his colleagues, which is used in school setting. People with mild/moderate ID aged 15 years or above were recruited from special schools and social services units in different regions of Hong Kong. Factor analysis and reliability tests were conducted. Data for a total of 356 participants were used for the analysis. A confirmatory factor analysis was performed to test the factorial construct, and Mplus 7.0 was used for the analysis. The factor structure proposed in the original English version was supported by the data, and all factor loadings were between 0.42 and 0.76. The whole scale achieved good reliability (Cronbach's α = 0.88 and ω = 0.90). The AIR SDS-C appears to be a valid and reliable scale. This study examined adult groups as well as student groups. The application of the scale can thus be extended to a wider population. The implications for theory building and practice are discussed. © 2016 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Young Adult Follow-up of Adolescent Girls in Juvenile Justice Using the Columbia Suicide Severity Rating Scale

PubMed Central

Kerr, David C. R.; Gibson, Brandon; Leve, Leslie D.; DeGarmo, David S.

2014-01-01

We studied the reliability and validity of the Columbia Suicide Severity Scale (C-SSRS). Severely delinquent adolescent girls (n = 166) participated in a treatment trial and repeated assessments over time. Lifetime suicide attempt history was measured using the C-SSRS in early adulthood (n = 144; 7–12 years post-baseline). Nonclinician raters showed strong interrater reliability using the C-SSRS. Self-, caseworker-, and caregiver-reports of girls’ suicide attempt histories collected at baseline correlated with adult participants’ recollections of their baseline attempt histories. Suicidal ideation measured prospectively across a 7–12 year period was associated with retrospectively reported suicide attempt across the same period. PMID:24446880

Development and validation of The Personal Diabetes Questionnaire (PDQ): a measure of diabetes self-care behaviors, perceptions and barriers.

PubMed

Stetson, Barbara; Schlundt, David; Rothschild, Chelsea; Floyd, Jennifer E; Rogers, Whitney; Mokshagundam, Sri Prakash

2011-03-01

To develop and evaluate the validity and reliability of The Personal Diabetes Questionnaire (PDQ), a brief, yet comprehensive measure of diabetes self-care behaviors, perceptions and barriers. To examine individual items to provide descriptive and normative information and provide data on scale reliability and associations between PDQ scales and concurrently assessed HBA(1c) and BMI. Items were written to address nutritional management, medication utilization, blood glucose monitoring, and physical activity. The initial instrument was reviewed by multidisciplinary diabetes care providers and items subsequently revised until the measure provided complete coverage of the diabetes care domains using as few items as possible. The scoring scheme was generated rationally. Subjects were 790 adults (205 with type 1 and 585 with type 2 diabetes) who completed the PDQ while waiting for clinic appointments. Item completion rates were high, with few items skipped by participants. Subscales demonstrated good internal consistency (Cronbach α=.650-.834) and demonstrated significant associations with BMI (p ≤.001) and HbA(1c) (p ≤.001). The PDQ is a useful measure of diabetes self-care behaviors and related perceptions and barriers that is reliable and valid and feasible to administer in a clinic setting. This measure may be used to obtain data for assessing diabetes self-management and barriers and to guide patient care. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

[Validation of the Spanish version of the Palliative Care Outcome Scale].

PubMed

Serra-Prat, Mateu; Nabal, Maria; Santacruz, Víctor; Picaza, Josep M; Trelis, Jordi

2004-10-02

The objective of this study was to translate the Palliative Care Outcome Scale (POS) into Spanish and to validate it. The translation and adaptation was based on the conceptual equivalence of the terms used. In order to study the psychometric properties, 200 patients receiving palliative care were asked to fill out the POS questionnaire, the European Organization for Research on Cancer Treatment Quality of Life Questionnaire (EORCT QLQ C-30), the Barthel Index and the Karnofsky Index on their first visit. The Spanish version of the POS questionnaire was given to the patients again, a week later, to measure the intra-observer reliability. There were no major problems with the translation and adaptation process. The Spanish POS adapted very well for both the staff and the patients versions. Inter- and intra-observer reliability was good, with intraclass correlation coefficients of between 0.61 and 0.93 according to the item. Internal consistency analysis showed a Cronbach's alpha of 0.62 for the staff version and 0.64 for the patients version. Most of the Spanish POS correlated with the EORTC QLQ C-30 emotional function scale and quality of life scale. The Spanish POS is a valid and reliable instrument for measuring the quality of life of patients receiving palliative care. It is useful in research as well as in everyday clinical practice.

Military to civilian questionnaire: a measure of postdeployment community reintegration difficulty among veterans using Department of Veterans Affairs medical care.

PubMed

Sayer, Nina A; Frazier, Patricia; Orazem, Robert J; Murdoch, Maureen; Gravely, Amy; Carlson, Kathleen F; Hintz, Samuel; Noorbaloochi, Siamak

2011-12-01

The primary objective of this study was to describe the development, reliability, and construct validity of scores on the Military to Civilian Questionnaire (M2C-Q), a 16-item self-report measure of postdeployment community reintegration difficulty. We surveyed a national, stratified sample of 1,226 Iraq and Afghanistan veterans who used U.S. Department of Veterans Affairs (VA) medical care; 745 completed the M2C-Q and validated mental health screening measures. All analyses were based on weighted estimates. The internal consistency of the M2C-Q was .95 in this sample. Factor analyses indicated a single total score was the best-fitting model. Total scores were associated with measures theoretically related to reintegration difficulties including perception of overall difficulty readjusting back into civilian life (R(2) = .49), probable PTSD (d = 1.07), probable problem drug or alcohol use (d = 0.34), and overall mental health (r = -.83). Subgroup analyses revealed a similar pattern of findings in those who screened negative for PTSD. Nonwhite and unemployed veterans reported greater community reintegration difficulty (d = 0.20 and 0.45, respectively). Findings offer preliminary support for the reliability and construct validity of M2C-Q scores. Published 2011. This article is a US Government work and is in the public domain in the USA.

The Standardization of the Concepts about Print into Greek

ERIC Educational Resources Information Center

Tafa, Eufimia

2009-01-01

The purpose of this study was to translate and standardize Concepts About Print (C.A.P.) into Greek, and to assess its psychometric properties. Particularly, this study evaluated the reliability and validity of the Greek version of C.A.P., and item difficulty and discrimination index and examined whether there were differences between boys and…

Psychometric Properties of the Chinese Family Assessment Instrument in Chinese Adolescents in Hong Kong

ERIC Educational Resources Information Center

Siu, Andrew M. H.; Shek, Daniel T. L.

2005-01-01

This paper reports evidence on the factor structure, reliability, and validity of the Chinese Family Assessment Instrument (C-FAI), an instrument developed to assess family functioning in Chinese populations. A convenience sample of 1,462 adolescents from junior secondary schools completed the C-FAI and measures of parent-adolescent conflict.…

The Validation of the Interpersonal Reactivity Index for Chinese Teachers from Primary and Middle Schools

ERIC Educational Resources Information Center

Huang, Xiaozhong; Li, Weijian; Sun, Binghai; Chen, Haide; Davis, Mark H.

2012-01-01

Psychometric properties of the Chinese version of Interpersonal Reactivity Index (C-IRI) were examined in a sample of 930 teachers in China. The subscales of the C-IRI demonstrated acceptable to good internal consistency and test-retest reliability. Exploratory and confirmatory factor analyses revealed a stable four-factor structure across three…

Measuring Nigrescence Attitudes in School-Aged Adolescents

ERIC Educational Resources Information Center

Gardner-Kitt, Donna L.; Worrell, Frank C.

2007-01-01

In this study, we examined the reliability and validity of Cross Racial Identity Scale (CRIS; Vandiver, B. J., Cross Jr., W. E., Fhagen-Smith, P. E., Worrell, F. C., Swim, J. K., & Caldwell, L. D. (2000). "The Cross Racial Identity Scale." Unpublished scale; Worrell, F. C., Vandiver, B. J., & Cross Jr., W. E., (2004). "The Cross Racial Identity…

The Supports Intensity Scale-Children's Version: Preliminary Reliability and Validity

ERIC Educational Resources Information Center

Thompson, James R.; Wehmeyer, Michael L.; Hughes, Carolyn; Shogren, Karrie A.; Palmer, Susan B.; See, Hyojeong

2014-01-01

This article introduces the Supports Intensity Scale-Children's Version (SIS-C) designed and normed to be used with children across multiple contexts, including home, school, and community life. Steps taken to develop the scale are described, and findings from data collected on a field test version of the SIS-C are shared. Preliminary findings in…

Considerations regarding the validation of chromatographic mass spectrometric methods for the quantification of endogenous substances in forensics.

PubMed

Hess, Cornelius; Sydow, Konrad; Kueting, Theresa; Kraemer, Michael; Maas, Alexandra

2018-02-01

The requirement for correct evaluation of forensic toxicological results in daily routine work and scientific studies is reliable analytical data based on validated methods. Validation of a method gives the analyst tools to estimate the efficacy and reliability of the analytical method. Without validation, data might be contested in court and lead to unjustified legal consequences for a defendant. Therefore, new analytical methods to be used in forensic toxicology require careful method development and validation of the final method. Until now, there are no publications on the validation of chromatographic mass spectrometric methods for the detection of endogenous substances although endogenous analytes can be important in Forensic Toxicology (alcohol consumption marker, congener alcohols, gamma hydroxy butyric acid, human insulin and C-peptide, creatinine, postmortal clinical parameters). For these analytes, conventional validation instructions cannot be followed completely. In this paper, important practical considerations in analytical method validation for endogenous substances will be discussed which may be used as guidance for scientists wishing to develop and validate analytical methods for analytes produced naturally in the human body. Especially the validation parameters calibration model, analytical limits, accuracy (bias and precision) and matrix effects and recovery have to be approached differently. Highest attention should be paid to selectivity experiments. Copyright © 2017 Elsevier B.V. All rights reserved.

Validity, reliability and responsiveness to change of the Italian palliative care outcome scale: a multicenter study of advanced cancer patients.

PubMed

Costantini, Massimo; Rabitti, Elisa; Beccaro, Monica; Fusco, Flavio; Peruselli, Carlo; La Ciura, Pietro; Valle, Alessandro; Suriani, Cinzia; Berardi, Maria Alejandra; Valenti, Danila; Mosso, Felicita; Morino, Piero; Zaninetta, Giovanni; Tubere, Giorgio; Piazza, Massimo; Sofia, Michele; Di Leo, Silvia; Higginson, Irene J

2016-02-26

There is an increasing requirement to assess outcomes, but few measures have been tested for advanced medical illness. We aimed to test the validity, reliability and responsiveness of the Palliative care Outcome Scale (POS), and to analyse predictors of change after the transition to palliative care. Phase 1: multicentre, mixed method study comprising cognitive and qualitative interviews with patients and staff, cultural refinement and adaption. Phase 2: consecutive cancer patients on admission to 8 inpatient hospices and 7 home-based teams were asked to complete the POS, the EORTC QLQ-C15-PAL and the FACIT-Sp (T0), to assess internal consistency, convergent and divergent validity. After 6 days (T1) patients and staff completed the POS to assess responsiveness to change (T1-T0), and agreement between self-assessed POS and POS completed by the staff. Finally, we asked hospices an assessment 24-48 h after T1 to assess its reliability (test re-test analysis). Phase I: 209 completed POS questionnaires and 29 cognitive interviews were assessed, revisions made and one item substituted. Phase II: 295 consecutive patients admitted to 15 PCTs were approached, 175 (59.3 %) were eligible, and 150 (85.7 %) consented. Consent was limited by the severity of illness in 40 % patients. We found good convergent validity, with strong and moderate correlations (r ranged 0.5-0.8) between similar items from the POS, the QLQ-C15-PAL and the FACIT-Sp. As hypothesised, the physical function subscale of QLQ-C15-PAL was not correlated with any POS item (r ranged -0.16-0.02). We found acceptable to good test re-test reliability in both versions for 6 items. We found significant clinical improvements during the first week of palliative care in 7/10 items assessed-pain, other symptoms, patient and family anxiety, information, feeling at peace and wasted time. Both the patient self-assessed and professional POS versions are valid and with an acceptable internal consistency. POS detected significant clinical improvements during palliative care, at a time when patients are usually expected to deteriorate. These results suggest that there is room for substantial improvement in the management of patients with advanced disease, across all key domains-symptoms, psychological, information, social and spiritual.

Ethical Implications of Validity-vs.-Reliability Trade-Offs in Educational Research

ERIC Educational Resources Information Center

Fendler, Lynn

2016-01-01

In educational research that calls itself empirical, the relationship between validity and reliability is that of trade-off: the stronger the bases for validity, the weaker the bases for reliability (and vice versa). Validity and reliability are widely regarded as basic criteria for evaluating research; however, there are ethical implications of…

IMPLEMENTATION AND VALIDATION OF STATISTICAL TESTS IN RESEARCH'S SOFTWARE HELPING DATA COLLECTION AND PROTOCOLS ANALYSIS IN SURGERY.

PubMed

Kuretzki, Carlos Henrique; Campos, Antônio Carlos Ligocki; Malafaia, Osvaldo; Soares, Sandramara Scandelari Kusano de Paula; Tenório, Sérgio Bernardo; Timi, Jorge Rufino Ribas

2016-03-01

The use of information technology is often applied in healthcare. With regard to scientific research, the SINPE(c) - Integrated Electronic Protocols was created as a tool to support researchers, offering clinical data standardization. By the time, SINPE(c) lacked statistical tests obtained by automatic analysis. Add to SINPE(c) features for automatic realization of the main statistical methods used in medicine . The study was divided into four topics: check the interest of users towards the implementation of the tests; search the frequency of their use in health care; carry out the implementation; and validate the results with researchers and their protocols. It was applied in a group of users of this software in their thesis in the strict sensu master and doctorate degrees in one postgraduate program in surgery. To assess the reliability of the statistics was compared the data obtained both automatically by SINPE(c) as manually held by a professional in statistics with experience with this type of study. There was concern for the use of automatic statistical tests, with good acceptance. The chi-square, Mann-Whitney, Fisher and t-Student were considered as tests frequently used by participants in medical studies. These methods have been implemented and thereafter approved as expected. The incorporation of the automatic SINPE (c) Statistical Analysis was shown to be reliable and equal to the manually done, validating its use as a research tool for medical research.

Psychometric validation of the Columbia-Suicide Severity rating scale in Spanish-speaking adolescents.

PubMed

Serrani Azcurra, Daniel

2017-12-30

Adolescent suicide is a major public health issue, and early and accurate detection is of great concern. There are many reliable instruments for this purpose, such as the Columbia-Suicide severity rating scale (C-SSRS), but no validation exists for Spanish speaking Latin American adolescents. To assess psychometric properties and cut-off scores of the C-SSRS in Spanish speaking adolescents. Exploratory assessment with principal component analysis (PCA) and Varimax rotation, and confirmatory analysis (CFA) were performed on two groups with 782 and 834 participants respectively (N=1616). Mean age was 24.8 years. A Receiver operator analysis was applied to distinguish between control and suicide-risk subgroups adolescents. Promax rotation yielded two 10-items factors, for suicide ideation and behavior respectively. C-SSRS was positively correlated with other suicide risk scales, such as Beck Depression Inventory-II, Suicidal Behaviors Questionnaire-Revised, or PHQ-9. Confirmatory factor analysis yielded a two-factor solution as the best goodness of fit model. C-SSRS showed adequate ability to detect suicide risk group with positive predictive value of 68.3%. ROC analyses showed cutoff scores of ≥ 6 and ≥ 4 for suicide ideation and behavior scales respectively. This research offers data supporting psychometric validity and reliability of C-SSRS in nonclinical Spanish-speaking students. Added benefits are flexible scoring and management easiness. This questionnaire yields data on distinct aspects of suicidality, being more parsimonious than separate administration of a bunch of questionnaires.

Psychometric validation of the Columbia-Suicide Severity rating scale in Spanish-speaking adolescents

PubMed Central

2017-01-01

Abstract Introduction: Adolescent suicide is a major public health issue, and early and accurate detection is of great concern. There are many reliable instruments for this purpose, such as the Columbia-Suicide severity rating scale (C-SSRS), but no validation exists for Spanish speaking Latin American adolescents. Objetive: To assess psychometric properties and cut-off scores of the C-SSRS in Spanish speaking adolescents. Methods: Exploratory assessment with principal component analysis (PCA) and Varimax rotation, and confirmatory analysis (CFA) were performed on two groups with 782 and 834 participants respectively (N=1616). Mean age was 24.8 years. A Receiver operator analysis was applied to distinguish between control and suicide-risk subgroups adolescents. Results: Promax rotation yielded two 10-items factors, for suicide ideation and behavior respectively. C-SSRS was positively correlated with other suicide risk scales, such as Beck Depression Inventory-II, Suicidal Behaviors Questionnaire-Revised, or PHQ-9. Confirmatory factor analysis yielded a two-factor solution as the best goodness of fit model. C-SSRS showed adequate ability to detect suicide risk group with positive predictive value of 68.3%. ROC analyses showed cutoff scores of ≥ 6 and ≥ 4 for suicide ideation and behavior scales respectively Conclusion: This research offers data supporting psychometric validity and reliability of C-SSRS in nonclinical Spanish-speaking students. Added benefits are flexible scoring and management easiness. This questionnaire yields data on distinct aspects of suicidality, being more parsimonious than separate administration of a bunch of questionnaires. PMID:29662259

What to Do With "Moderate" Reliability and Validity Coefficients?

PubMed

Post, Marcel W

2016-07-01

Clinimetric studies may use criteria for test-retest reliability and convergent validity such that correlation coefficients as low as .40 are supportive of reliability and validity. It can be argued that moderate (.40-.60) correlations should not be interpreted in this way and that reliability coefficients <.70 should be considered as indicative of unreliability. Convergent validity coefficients in the .40 to .60 or .40 to .70 range should be considered as indications of validity problems, or as inconclusive at best. Studies on reliability and convergent should be designed in such a way that it is realistic to expect high reliability and validity coefficients. Multitrait multimethod approaches are preferred to study construct (convergent-divergent) validity. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Preliminary validation of the Yale Food Addiction Scale for children.

PubMed

Gearhardt, Ashley N; Roberto, Christina A; Seamans, Marissa J; Corbin, William R; Brownell, Kelly D

2013-12-01

Evidence is growing that an addictive process may play a role in problematic eating behavior. The majority of research on this topic has examined the concept of "food addiction" solely in adult samples. If certain foods have addictive potential, children may be impacted as much as (or more) than adults due to psychological and neurobiological vulnerabilities at younger developmental stages. In the current study, we developed a measure of food addiction in children that reflects the diagnostic indicators of addiction. The content and reading level of the Yale Food Addiction Scale (YFAS) was altered to be appropriate for children (YFAS-C). The YFAS-C and other eating-related measures were administered to study participants to examine the validity and reliability of the YFAS-C. 75 children were recruited from the community ranging from lean to obese. The validation of the YFAC-C provides preliminary support for its convergent validity with like constructs and incremental validity in predicting body mass index. Internal consistency was adequate given the small number of items on the scale. The YFAS-C appears to be a helpful tool for identifying addictive-like eating in children. © 2013.

Chinese version of Impact of Weight on Quality of Life for Kids: psychometric properties in a large school-based sample.

PubMed

He, Jinbo; Zhu, Hong; Luo, Xingwei; Cai, Taisheng; Wu, Siyao; Lu, Yao

2016-06-01

The Impact of Weight on Quality of Life for Kids (IWQOL-Kids) is the first self-report questionnaire for assessing weight-related quality of life for youth. However, there is no Chinese version of IWQOL-Kids. Thus, the objective of this research was to translate IWQOL-Kids into Mandarin and evaluate its psychometric properties in a large school-based sample. The total sample included 2282 participants aged 11-18 years old, including 1703 non-overweight, 386 overweight and 193 obese students. IWQOL-Kids was translated and culturally adapted by following the international guidelines for instrument linguistic validation procedures. The psychometric evaluation included internal consistency, test-retest reliability, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), convergent validity and discriminant validity. Cronbach's α for the Chinese version of IWQOL-Kids (IWQOL-Kids-C) was 0.956 and ranged from 0.891 to 0.927 for subscales. IWQOL-Kids-C showed a test-retest coefficient of 0.937 after 2 weeks and ranged from 0.847 to 0.903 for subscales. The original four-factor model was reproduced by EFA after seven iterations, accounting for 69.28% of the total variance. CFA demonstrated that the four-factor model had good fit indices with comparative fit index = 0.92, normed fit index = 0.91, goodness of fit index = 0.86, root mean square error of approximation = 0.07 and root mean square residual = 0.03. Convergent validity and discriminant validity were demonstrated with higher correlations between similar constructs and lower correlations between dissimilar constructs of IWQOL-Kids-C and PedsQL™ 4.0. The significant differences were found across the body mass index groups, and IWQOL-Kids-C had higher effect sizes than PedsQL™4.0 when comparing non-overweight and obese groups, supporting the sensitivity of IWQOL-Kids-C. IWQOL-Kids-C is a satisfactory, valid and reliable instrument to assess weight-related quality of life for Chinese children and adolescents aged 11-18 years old. © The Author 2015. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Cross-cultural adaptation, reliability, and validity of the Turkish version of the Cancer Fatigue Scale in patients with breast cancer

PubMed

Şahin, Sedef; Huri, Meral; Aran, Orkun Tahir; Uyanık, Mine

2018-02-23

Background/aim: The Cancer Fatigue Scale (CFS) was developed to evaluate the severity of fatigue in patients with breast cancer. The aim of this study is to translate and culturally adapt a Turkish version and investigate the validity and reliability of the CFS in Turkish patients with fatigue symptoms. Materials and methods: Eighty participants completed the Turkish version of the CFS for breast cancer and the European Organization for Research and Treatment of Cancer Quality of Life Core Questionnaire ″Core 30″ (EORTC QLQ-C30). Test-retest reliability was evaluated by repeating the CFS with a 7-day interval. Results: The CFS demonstrated high test-retest reliability (ICC = 0.95) and good internal consistency (Cronbach′s alpha = 0.74) for all domains. The Kaiser-Meyer-Olkin measure of sampling adequacy was found to be 0.819, which is considered to be satisfactory (>0.5). Correlations between domains of CFS physical and EORTC physical (r: 0.77), CFS cognitive and EORTC cognitive (r: 0.70), and CFS physical and EORTC fatigue (r: 0.80) were found to be significant. Conclusion: The Turkish version of the CFS is a reliable and valid instrument to assess physical, effective, and cognitive dimensions of fatigue. The CFS may be used to evaluate the severity of fatigue in Turkish-speaking breast cancer patients.

Item analysis using Rasch models confirms that the Danish versions of the DISABKIDS® chronic-generic and diabetes-specific modules are valid and reliable.

PubMed

Nielsen, Julie Bøjstrup; Kyvsgaard, Julie Nyholm; Sildorf, Stine Møller; Kreiner, Svend; Svensson, Jannet

2017-03-01

Type 1 Diabetes (T1D) has a negative impact on psychological and overall well-being. Screening for Health-related Quality of Life (HrQoL) and addressing HrQoL issues in the clinic leads to improved well-being and metabolic outcomes. The aim of this study was to translate the generic and diabetes-specific validated multinational DISABKIDS® questionnaires into Danish, and then determine their validity and reliability. The questionnaires were translated using a validated translation procedure and completed by 99 children and adolescents from our diabetes-department; all diagnosed with T1D and were aged between 8 and 18 years old. The Rasch and the graphical log linear Rasch model (GLLRM) were used to determine validity. Monte Carlo methods and Cronbach's α were used to confirm reliability. The data did not fit a pure Rasch model but did fit a GLLRM when item six in the independence scale is excluded. The six subscales measure different aspects of HrQoL indicating that all the subscales are necessary. The questionnaire shows local dependency between items and differential item functioning (DIF). Therefore age, gender, and glycated hemoglobin (HbA1c) levels must be taken into account when comparing HrQoL between groups. The Danish versions of the DISABKIDS® chronic-generic and diabetes-specific modules provide valid and objective measurements with adequate reliability. These Danish versions are useful tools for evaluating HrQoL in Danish patients with T1D. However, guidelines on how to manage DIF and local independence will be required, and item six should be rephrased.

Design of piezoelectric transducer layer with electromagnetic shielding and high connection reliability

NASA Astrophysics Data System (ADS)

Qiu, Lei; Yuan, Shenfang; Shi, Xiaoling; Huang, Tianxiang

2012-07-01

Piezoelectric transducer (PZT) and Lamb wave based structural health monitoring (SHM) method have been widely studied for on-line SHM of high-performance structures. To monitor large-scale structures, a dense PZTs array is required. In order to improve the placement efficiency and reduce the wire burden of the PZTs array, the concept of the piezoelectric transducers layer (PSL) was proposed. The PSL consists of PZTs, a flexible interlayer with printed wires and signal input/output interface. For on-line SHM on real aircraft structures, there are two main issues on electromagnetic interference and connection reliability of the PSL. To address the issues, an electromagnetic shielding design method of the PSL to reduce spatial electromagnetic noise and crosstalk is proposed and a combined welding-cementation process based connection reliability design method is proposed to enhance the connection reliability between the PZTs and the flexible interlayer. Two experiments on electromagnetic interference suppression are performed to validate the shielding design of the PSL. The experimental results show that the amplitudes of the spatial electromagnetic noise and crosstalk output from the shielded PSL developed by this paper are - 15 dB and - 25 dB lower than those of the ordinary PSL, respectively. Other two experiments on temperature durability ( - 55 °C-80 °C ) and strength durability (160-1600μɛ, one million load cycles) are applied to the PSL to validate the connection reliability. The low repeatability errors (less than 3% and less than 5%, respectively) indicate that the developed PSL is of high connection reliability and long fatigue life.

Psychometric evaluation of the Dutch version of the Subjective Opiate Withdrawal Scale (SOWS).

PubMed

Dijkstra, Boukje A G; Krabbe, Paul F M; Riezebos, Truus G M; van der Staak, Cees P F; De Jong, Cor A J

2007-01-01

To evaluate the psychometric properties of the Dutch version of the 16-item Subjective Opiate Withdrawal Scale (SOWS). The SOWS measures withdrawal symptoms at the time of assessment. The Dutch SOWS was repeatedly administered to a sample of 272 opioid-dependent inpatients of four addiction treatment centers during rapid detoxification with or without general anesthesia. Examination of the psychometric properties of the SOWS included exploratory factor analysis, internal consistency, test-retest reliability, and criterion validity. Exploratory factor analysis of the SOWS revealed a general pattern of four factors with three items not always clustered in the same factors at different points of measurement. After excluding these items from factor analysis four factors were identified during detoxification (temperature dysregulation, tractus locomotorius, tractus gastro-intestinalis and facial disinhibition). The 13-item SOWS shows high internal consistency and test-retest reliability and good validity at different stages of withdrawal. The 13-item SOWS is a reliable and valid instrument to assess opioid withdrawal during rapid detoxification. Three items were deleted because their content does not correspond directly with opioid withdrawal symptoms. Copyright (c) 2007 S. Karger AG, Basel.

Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs.

PubMed

Pololi, Linda H; Evans, Arthur T; Civian, Janet T; Shea, Sandy; Brennan, Robert T

2017-07-01

A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents. To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment. During 2014-2015, we surveyed residents using the C - Change Resident Survey to assess residents' perceptions of the culture in their programs. Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems. The C - Change Resident Survey assessed residents' perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work-Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions. A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51-87%). Internal consistency of each dimension was high (Cronbach α: 0.73-0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model. The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different contexts. Results could be used to facilitate and monitor improvements in the clinical learning environment and resident well-being.

25 CFR 39.114 - What characteristics may qualify a student as gifted and talented for purposes of supplemental...

Code of Federal Regulations, 2011 CFR

2011-04-01

... intellectual ability. (b) Creativity/Divergent Thinking means scoring in the top 5 percent of performance on a statistically valid and reliable measurement tool of creativity/divergent thinking. (c) Academic Aptitude...

25 CFR 39.114 - What characteristics may qualify a student as gifted and talented for purposes of supplemental...

Code of Federal Regulations, 2014 CFR

2014-04-01

... intellectual ability. (b) Creativity/Divergent Thinking means scoring in the top 5 percent of performance on a statistically valid and reliable measurement tool of creativity/divergent thinking. (c) Academic Aptitude...

25 CFR 39.114 - What characteristics may qualify a student as gifted and talented for purposes of supplemental...

Code of Federal Regulations, 2013 CFR

2013-04-01

... intellectual ability. (b) Creativity/Divergent Thinking means scoring in the top 5 percent of performance on a statistically valid and reliable measurement tool of creativity/divergent thinking. (c) Academic Aptitude...

25 CFR 39.114 - What characteristics may qualify a student as gifted and talented for purposes of supplemental...

Code of Federal Regulations, 2012 CFR

2012-04-01

... intellectual ability. (b) Creativity/Divergent Thinking means scoring in the top 5 percent of performance on a statistically valid and reliable measurement tool of creativity/divergent thinking. (c) Academic Aptitude...

Validity and reliability of the International Cooperative Ataxia Rating Scale (ICARS) and the Scale for the Assessment and Rating of Ataxia (SARA) in multiple sclerosis patients with ataxia.

PubMed

Salcı, Yeliz; Fil, Ayla; Keklicek, Hilal; Çetin, Barış; Armutlu, Kadriye; Dolgun, Anıl; Tuncer, Aslı; Karabudak, Rana

2017-11-01

Ataxia is an extremely common problem in multiple sclerosis (MS) patients. Thus, appropriate scales are required for detailed assessment of this issue. The aim of our study was to investigate the reliability and validity of the Turkish version of the International Cooperative Ataxia Rating Scale (ICARS) and Scale for the Assessment and Rating of Ataxia (SARA), which are widely used in ataxia evaluation in the context of other cerebellar diseases. This cross-sectional study included 80 MS patients with Kurtzke cerebellar functional system score (C-FSS) greater than zero and slight pyramidal involvement. The Expanded Disability Status Scale (EDSS), C-FSS, and Berg Balance Scale (BBS) were administered. SARA and ICARS were assessed on first admission by two physical therapists. Seven days later, second assessments were repeated in same way for reliability. Intra-rater and inter-rater reliability were found to be high for both ICARS and SARA (p< 0.001) The Cronbach's α coefficients were 0.922 and 0.921 for SARA (reviewer 1 and reviewer 2 respectively) and 0.952 and 0.952 for ICARS (reviewer 1 and reviewer 2, respectively). There were no floor or ceiling effects determined for either scale except for item 17 of ICARS (p= 0.055). The EDSS total score had significant correlations with both SARA and ICARS (rho: 0.557 and 0.707, respectively). C-FSS had moderate correlation with SARA and high correlation with ICARS (rho: 0.469 and 0.653, respectively). BBS had no significant correlation with SARA and ICARS. (rho: -0.048 and -0.008 respectively). According to the area under the curve (AUC) value, ICARS is the best scale to discriminate mild and moderate ataxia. (AUC: 0.875). Factor analyses of ICARS showed that the rating results were determined by five different factors that did not coincide with the ICARS sub-scales. Our study demonstrated that ICARS and SARA are both reliable in MS patients with ataxia. Although ICARS has some structural problems, it seems to be more valid given its high correlations with EDSS and C-FSS. SARA also can be preferred as a brief assessment. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation and determination of a reference interval for canine HbA1c using an immunoturbidimetric assay.

PubMed

Goemans, Anne F; Spence, Susanna J; Ramsey, Ian K

2017-06-01

Hemoglobin A1c (HbA1c) provides a reliable measure of glycemic control over 2-3 months in human diabetes mellitus. In dogs, presence of HbA1c has been demonstrated, but there are no validated commercial assays. The purpose of the study was to validate a commercially available automated immunoturbidimetric assay for canine HbA1c and determine an RI in a hospital population. The specificity of the assay was assessed by inducing glycosylation in vitro using isolated canine hemoglobin, repeatability by measuring canine samples 5 times in succession, long term inter-assay imprecision by measuring supplied control materials, stability using samples stored at 4°C over 5 days and -20°C over 8 weeks, linearity by mixing samples of known HbA1c in differing proportions, and the effect of anticoagulants with paired samples. An RI was determined using EDTA-anticoagulated blood samples from 60 nondiabetic hospitalized animals of various ages and breeds. Hemoglobin A1c was also measured in 10 diabetic dogs. The concentration of HbA1c increased proportionally with glucose concentration in vitro. For repeat measurements, the CV was 4.08% (range 1.16-6.10%). Samples were stable for 5 days at 4°C. The assay was linear within the assessed range. Heparin- and EDTA-anticoagulated blood provided comparable results. The RI for HbA1c was 9-18.5 mmol/mol. There was no apparent effect of age or breed on HbA1c. In diabetic dogs, HbA1c ranged from 14 to 48 mmol/mol. The assay provides a reliable method for canine HbA1c measurement with good analytic performance. © 2017 American Society for Veterinary Clinical Pathology.

Reliability and validity of the revised Gibson Test of Cognitive Skills, a computer-based test battery for assessing cognition across the lifespan.

PubMed

Moore, Amy Lawson; Miller, Terissa M

2018-01-01

The purpose of the current study is to evaluate the validity and reliability of the revised Gibson Test of Cognitive Skills, a computer-based battery of tests measuring short-term memory, long-term memory, processing speed, logic and reasoning, visual processing, as well as auditory processing and word attack skills. This study included 2,737 participants aged 5-85 years. A series of studies was conducted to examine the validity and reliability using the test performance of the entire norming group and several subgroups. The evaluation of the technical properties of the test battery included content validation by subject matter experts, item analysis and coefficient alpha, test-retest reliability, split-half reliability, and analysis of concurrent validity with the Woodcock Johnson III Tests of Cognitive Abilities and Tests of Achievement. Results indicated strong sources of evidence of validity and reliability for the test, including internal consistency reliability coefficients ranging from 0.87 to 0.98, test-retest reliability coefficients ranging from 0.69 to 0.91, split-half reliability coefficients ranging from 0.87 to 0.91, and concurrent validity coefficients ranging from 0.53 to 0.93. The Gibson Test of Cognitive Skills-2 is a reliable and valid tool for assessing cognition in the general population across the lifespan.

Is the Attitudes toward Seeking Professional Psychological Help Scale Applicable to Ethnic Chinese Students? Psychometric Properties and Cultural Considerations

ERIC Educational Resources Information Center

Han, Der-Yan; Chen, Sue-Huei

2015-01-01

The Attitudes Toward Seeking Professional Psychological Help Scale has been applied widely. However, there is no complete report on the reliability and validity of its Chinese version (ATSPPHS-C). A total of 353 Taiwanese undergraduates completed the ATSPPHS-C, Help-Seeking Willingness Scale, Symptom Check List-90R, and Marlowe-Crowne Social…

Evaluation of tools used to measure calcium and/or dairy consumption in adults.

PubMed

Magarey, Anthea; Baulderstone, Lauren; Yaxley, Alison; Markow, Kylie; Miller, Michelle

2015-05-01

To identify and critique tools for the assessment of Ca and/or dairy intake in adults, in order to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles reporting on originally developed tools or testing the reliability or validity of existing tools that measure Ca and/or dairy intake in adults were included. Author-defined criteria for reporting reliability and validity properties were applied. Studies conducted in Western countries. Adults. Thirty papers, utilising thirty-six tools assessing intake of dairy, Ca or both, were identified. Reliability testing was conducted on only two dairy and five Ca tools, with results indicating that only one dairy and two Ca tools were reliable. Validity testing was conducted for all but four Ca-only tools. There was high reliance in validity testing on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful differences. Results of the validity testing suggest one dairy and five Ca tools are valid. Thus one tool was considered both reliable and valid for the assessment of dairy intake and only two tools proved reliable and valid for the assessment of Ca intake. While several tools are reliable and valid, their application across adult populations is limited by the populations in which they were tested. These results indicate a need for tools that assess Ca and/or dairy intake in adults to be rigorously tested for reliability and validity.

Validation of the M. D. Anderson Symptom Inventory multiple myeloma module

PubMed Central

2013-01-01

Background The symptom burden associated with multiple myeloma (MM) is often severe. Presently, no instrument comprehensively assesses disease-related and treatment-related symptoms in patients with MM. We sought to validate a module of the M. D. Anderson Symptom Inventory (MDASI) developed specifically for patients with MM (MDASI-MM). Methods The MDASI-MM was developed with clinician input, cognitive debriefing, and literature review, and administered to 132 patients undergoing induction chemotherapy or stem cell transplantation. We demonstrated the MDASI-MM’s reliability (Cronbach α values); criterion validity (item and subscale correlations between the MDASI-MM and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ-C30) and the EORTC MM module (QLQ-MY20)), and construct validity (differences between groups by performance status). Ratings from transplant patients were examined to demonstrate the MDASI-MM’s sensitivity in detecting the acute worsening of symptoms post-transplantation. Results The MDASI-MM demonstrated excellent correlations with subscales of the 2 EORTC instruments, strong ability to distinguish clinically different patient groups, high sensitivity in detecting change in patients’ performance status, and high reliability. Cognitive debriefing confirmed that the MDASI-MM encompasses the breadth of symptoms relevant to patients with MM. Conclusion The MDASI-MM is a valid, reliable, comprehensive-yet-concise tool that is recommended as a uniform symptom assessment instrument for patients with MM. PMID:23384030

Validation of the malaysian versions of parents and children health survey for asthma by using rasch-model.

PubMed

Hussein, Maryam Se; Akram, Waqas; Mamat, Mohd Nor; Majeed, Abu Bakar Abdul; Ismail, Nahlah Elkudssiah Binti

2015-04-01

In recent years, health-related quality of life (HRQOL) has become an important outcome measure in epidemiologic studies and clinical trials. For patients with asthma there are many instruments but most of them have been developed in English. With the increase in research project, researchers working in other languages have two options; either to develop a new measure or to translate an already developed measure. Children Health Survey for Asthma is developed by American Academy of Paediatrics which has two versions one for the parents (CHSA) and the other for the child (CHSA-C). However, there is no Malay version of the CHSA or the CHSA-C. The aim of this study was to translate and determine the validity and reliability of the Malaysian versions of Parent and Children Health Survey for Asthma. Questionnaires were translated to Bahasa Malayu using previously established guidelines, data from 180 respondents (asthmatic children and their parent) were analysed using Rasch-Model; as, it is an approach that has been increasingly used in health field and also it explores the performance of each item rather than total set score. The internal consistency was high for the parent questionnaire (CHSA) (reliability score for persons = 0.88 and for items was 0.97), and good for child questionnaire (CHSA-C) (reliability score for persons = 0.83 and for items was 0.94). Also, this study shows that all items measure for both questionnaires (CHSA and CHSA-C) are fitted to Rasch-Model. This study produced questionnaires that are conceptually equivalent to the original, easy to understand for the children and their parents, and good in terms of internal consistency. Because of the questionnaire has two versions one for the child and the other for the parents, they could be used in clinical practice to measure the effect of asthma on the child and their families. This current research had translated two instruments to other language (BahasaMalayu) and evaluated their reliability and validity hence will help researchers from the same country to use these translated instruments in their studies.

Healing of voids in the aluminum metallization of integrated circuit chips

NASA Technical Reports Server (NTRS)

Cuddihy, Edward F.; Lawton, Russell A.; Gavin, Thomas R.

1990-01-01

The thermal stability of GaAs modulation-doped field effect transistors (MODFETs) is evaluated in order to identify failure mechanisms and validate the reliability of these devices. The transistors were exposed to thermal step-stress and characterized at ambient temperatures to indicate device reliability, especially that of the transistor ohmic contacts with and without molybdenum diffusion barriers. The devices without molybdenum exhibited important transconductance deterioration. MODFETs with molybdenum diffusion barriers were tolerant to temperatures above 300 C. This tolerance indicates that thermally activated failure mechanisms are slow at operational temperatures. Therefore, high-reliability MODFET-based circuits are possible.

Development and psychometric properties of the Carer – Head Injury Neurobehavioral Assessment Scale (C-HINAS) and the Carer – Head Injury Participation Scale (C-HIPS): patient and family determined outcome scales

PubMed Central

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-01-01

Objective Develop and assess the psychometric properties of the Carer – Head Injury Participation Scale (C-HIPS) and its biggest factor the Carer – Head Injury Neurobehavioral Assessment Scale (C-HINAS). Furthermore, the aim was to examine the inter-informant reliability by comparing the self reports of individuals with traumatic brain injury (TBI) with the carer reports on the C-HIPS and the C-HINAS. Method Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analysed and key themes and concepts were used to construct a 49-item and 58-item patient (Patient – Head Injury Participation Scale [P-HIPS]) and carer outcome measure (C-HIPS) respectively, of which 49 were parallel items and nine additional items were used to assess carer burden. Postal versions of the P-HIPS, C-HIPS, Mayo Portland Adaptability Inventory-3 (MPAI-3), and the Glasgow Outcome Scale-Extended (GOSE) were completed by a cohort of 113 TBI individuals and 80 carers. Data from a sub-group of 66 patient/carer pairs were used to compare inter-informant reliability between the P-HIPS and the C-HIPS, and the P-HINAS and the C-HINAS respectively. Results All individual 49 items of the C-HIPS and their total score showed good test-retest reliability (0.95) and internal consistency (0.95). Comparisons with the MPAI-3 and GOSE found a good correlation with the MPAI-3 (0.7) and a moderate negative correlation with the GOSE (−0.6). Factor analysis of these items extracted a 4-factor structure which represented the domains ‘Emotion/Behavior’ (C-HINAS), ‘Independence/Community Living’, ‘Cognition’, and ‘Physical’. The C-HINAS showed good internal consistency (0.92), test-retest reliability (0.93), and concurrent validity with one MPAI subscale (0.7). Assessment of inter-informant reliability revealed good correspondence between the reports of the patients and the carers for both the C-HIPS (0.83) and the C-HINAS (0.82). Conclusion Both the C-HINAS and the C-HIPS show strong psychometric properties. The qualitative methodology employed in the construction stage of the questionnaires provided good evidence of face and content validity. Comparisons between the P-HIPS and the C-HIPS, and the P-HINAS and the C-HINAS indicated high levels of agreement suggesting that in situations where the patient is unable to provide self-reports, information provided by the carer could be used. PMID:19300569

Rapid Detection and Molecular Differentiation of Toxigenic Corynebacterium diphtheriae and Corynebacterium ulcerans Strains by LightCycler PCR ▿

PubMed Central

Sing, Andreas; Berger, Anja; Schneider-Brachert, Wulf; Holzmann, Thomas; Reischl, Udo

2011-01-01

The systemic symptoms of diphtheria are caused by the tox-encoded diphtheria toxin (DT) which is produced by toxigenic Corynebacterium spp. Besides the classical agent C. diphtheriae, the zoonotic pathogen C. ulcerans has increasingly been reported as an emerging pathogen for diphtheria. The reliable detection of toxigenic Corynebacterium spp. is of substantial importance for both diphtheria surveillance in the public health sector and the clinical workup of a patient with diphtherialike symptoms. Since the respective tox genes of C. diphtheriae and C. ulcerans differ from each other in both DNA and amino acid sequence, both tox genes should be covered by novel real-time PCR methods. We describe the development and validation of a LightCycler PCR assay which reliably recognizes tox genes from both C. diphtheriae and C. ulcerans and differentiates the respective target genes by fluorescence resonance energy transfer (FRET) hybridization probe melting curve analysis. PMID:21593261

Determination of vitamin C in foods: current state of method validation.

PubMed

Spínola, Vítor; Llorent-Martínez, Eulogio J; Castilho, Paula C

2014-11-21

Vitamin C is one of the most important vitamins, so reliable information about its content in foodstuffs is a concern to both consumers and quality control agencies. However, the heterogeneity of food matrixes and the potential degradation of this vitamin during its analysis create enormous challenges. This review addresses the development and validation of high-performance liquid chromatography methods for vitamin C analysis in food commodities, during the period 2000-2014. The main characteristics of vitamin C are mentioned, along with the strategies adopted by most authors during sample preparation (freezing and acidification) to avoid vitamin oxidation. After that, the advantages and handicaps of different analytical methods are discussed. Finally, the main aspects concerning method validation for vitamin C analysis are critically discussed. Parameters such as selectivity, linearity, limit of quantification, and accuracy were studied by most authors. Recovery experiments during accuracy evaluation were in general satisfactory, with usual values between 81 and 109%. However, few methods considered vitamin C stability during the analytical process, and the study of the precision was not always clear or complete. Potential future improvements regarding proper method validation are indicated to conclude this review. Copyright © 2014. Published by Elsevier B.V.

Validation of the Chinese version of the Modified Caregivers Strain Index among Hong Kong caregivers: an initiative of medical social workers.

PubMed

Chan, Wallace Chi Ho; Chan, Christopher L F; Suen, Margaret

2013-11-01

Family caregivers may often experience caregiving stress and burden. To systematically assess this issue, medical social workers may need to use a brief and valid measurement in their practice. In the Hong Kong Chinese context, one additional challenge is to examine whether a measurement developed in the West is valid for Hong Kong Chinese caregivers. Thus, medical social workers in Hong Kong initiated this research study to validate the Chinese version of the Modified Caregiver Strain Index (C-M-CSI). A total of 223 Chinese caregivers of patients with various chronic illnesses were recruited for this validation study. C-M-CSI demonstrated good reliability (Cronbach's alpha coefficient = .91), concurrent validity with the Chinese version of the Caregiver Burden Inventory, and discriminant validity with the Chinese version of the Meaning in Life Questionnaire. Factor analysis yielded a single factor as the original M-CSI, which explained 49 percent of variance. Construct validity was shown by differentiating spousal and nonspousal caregivers, as well as caregivers of patients with and without behavioral problems. C-M-CSI is recommended as a brief and valid measurement that can be used by medical social workers in assessing the caregiving strain of Chinese caregivers of patients in Hong Kong.

[Evaluation of Suicide Risk Levels in Hospitals: Validity and Reliability Tests].

PubMed

Macagnino, Sandro; Steinert, Tilman; Uhlmann, Carmen

2018-05-01

Examination of in-hospital suicide risk levels concerning their validity and their reliability. The internal suicide risk levels were evaluated in a cross sectional study of in 163 inpatients. A reliability check was performed via determining interrater-reliability of senior physician, therapist and the responsible nurse. Within the scope of the validity check, we conducted analyses of criterion validity and construct validity. For the total sample an "acceptable" to "good" interrater-reliability (Kendalls W = .77) of suicide risk levels were obtained. Schizophrenic disorders showed the lowest values, for personality disorders we found the highest level of interrater-reliability. When examining the criterion validity, Item-9 of the BDI-II is substantial correlated to our suicide risk levels (ρ m  = .54, p < .01). Within the scope of construct validity check, affective disorders showed the highest correlation (ρ = .77), compatible also with "convergent validity". They differed with schizophrenic disorders which showed the least concordance (ρ = .43). In-hospital suicide risk levels may represent an important contribution to the assessment of suicidal behavior of inpatients experiencing psychiatric treatment due to their overall good validity and reliability. © Georg Thieme Verlag KG Stuttgart · New York.

The development of an instrument to measure quality of vision: the Quality of Vision (QoV) questionnaire.

PubMed

McAlinden, Colm; Pesudovs, Konrad; Moore, Jonathan E

2010-11-01

To develop an instrument to measure subjective quality of vision: the Quality of Vision (QoV) questionnaire. A 30-item instrument was designed with 10 symptoms rated in each of three scales (frequency, severity, and bothersome). The QoV was completed by 900 subjects in groups of spectacle wearers, contact lens wearers, and those having had laser refractive surgery, intraocular refractive surgery, or eye disease and investigated with Rasch analysis and traditional statistics. Validity and reliability were assessed by Rasch fit statistics, principal components analysis (PCA), person separation, differential item functioning (DIF), item targeting, construct validity (correlation with visual acuity, contrast sensitivity, total root mean square [RMS] higher order aberrations [HOA]), and test-retest reliability (two-way random intraclass correlation coefficients [ICC] and 95% repeatability coefficients [R(c)]). Rasch analysis demonstrated good precision, reliability, and internal consistency for all three scales (mean square infit and outfit within 0.81-1.27; PCA >60% variance explained by the principal component; person separation 2.08, 2.10, and 2.01 respectively; and minimal DIF). Construct validity was indicated by strong correlations with visual acuity, contrast sensitivity and RMS HOA. Test-retest reliability was evidenced by a minimum ICC of 0.867 and a minimum 95% R(c) of 1.55 units. The QoV Questionnaire consists of a Rasch-tested, linear-scaled, 30-item instrument on three scales providing a QoV score in terms of symptom frequency, severity, and bothersome. It is suitable for measuring QoV in patients with all types of refractive correction, eye surgery, and eye disease that cause QoV problems.

Psychometric properties of the Calgary Cambridge guides to assess communication skills of undergraduate medical students.

PubMed

Simmenroth-Nayda, Anne; Heinemann, Stephanie; Nolte, Catharina; Fischer, Thomas; Himmel, Wolfgang

2014-12-06

The aim of this study was to analyse the psychometric properties of the short version of the Calgary Cambridge Guides and to decide whether it can be recommended for use in the assessment of communications skills in young undergraduate medical students. Using a translated version of the Guide, 30 members from the Department of General Practice rated 5 videotaped encounters between students and simulated patients twice. Item analysis should detect possible floor and/or ceiling effects. The construct validity was investigated using exploratory factor analysis. Intra-rater reliability was measured in an interval of 3 months, inter-rater reliability was assessed by the intraclass correlation coefficient. The score distribution of the items showed no ceiling or floor effects. Four of the five factors extracted from the factor analysis represented important constructs of doctor-patient communication The ratings for the first and second round of assessing the videos correlated at 0.75 (p<0.0001). Intraclass correlation coefficients for each item ranged were moderate and ranged from 0.05 to 0.57. Reasonable score distributions of most items without ceiling or floor effects as well as a good test-retest reliability and construct validity recommend the C-CG as an instrument for assessing communication skills in undergraduate medical students. Some deficiencies in inter-rater reliability are a clear indication that raters need a thorough instruction before using the C-CG.

Evaluation of the Swedish version of the Child Drawing: Hospital Manual.

PubMed

Wennström, Berith; Nasic, Salmir; Hedelin, Hans; Bergh, Ingrid

2011-05-01

This paper is a report of psychometric testing of the Swedish version of the Child Drawing: Hospital Manual. Drawings have shown to be useful in assessing emotional status and anxiety in children because they generally speak to us more clearly and openly through their drawings than they are willing or able to verbally. The Child Drawing: Hospital Manual was translated into Swedish according to World Health Organization guidelines (a routine procedure for translation of English instruments) in order to assess anxiety by analysing the drawings of 59 children (5-11 years), of whom nine were girls and 50 boys undergoing day surgery during 2007-2009. Inter-rater reliability (five independent scorers) was high and internal consistency reliability was good (coefficient alpha =0·77). Parts A and C, as well as the total scale score of the Child Drawing: Hospital Manual, discriminated anxiety significantly between the group of children undergoing day surgery and a comparison group of school children, indicating adequate construct validity. For the Swedish version of the Child Drawing: Hospital Manual, our study demonstrates evidence for adequate construct validity in Parts A and C (and total scale score), high inter-rater reliability and acceptable internal consistency reliability. However, some improvements are needed before the instrument will be a clinically useful assessment of anxiety in children undergoing day surgery. © 2011 Blackwell Publishing Ltd.

Educational testing validity and reliability in pharmacy and medical education literature.

PubMed

Hoover, Matthew J; Jung, Rose; Jacobs, David M; Peeters, Michael J

2013-12-16

To evaluate and compare the reliability and validity of educational testing reported in pharmacy education journals to medical education literature. Descriptions of validity evidence sources (content, construct, criterion, and reliability) were extracted from articles that reported educational testing of learners' knowledge, skills, and/or abilities. Using educational testing, the findings of 108 pharmacy education articles were compared to the findings of 198 medical education articles. For pharmacy educational testing, 14 articles (13%) reported more than 1 validity evidence source while 83 articles (77%) reported 1 validity evidence source and 11 articles (10%) did not have evidence. Among validity evidence sources, content validity was reported most frequently. Compared with pharmacy education literature, more medical education articles reported both validity and reliability (59%; p<0.001). While there were more scholarship of teaching and learning (SoTL) articles in pharmacy education compared to medical education, validity, and reliability reporting were limited in the pharmacy education literature.

Development, validity, and reliability of a food frequency questionnaire for antioxidants in elderly Iranian people

PubMed Central

Malekahmadi, Mahsa; Naeini, Amirmansour Alavi; Shab-Bidar, Sakineh; Feizi, Awat; Djazayery, Abolghasem

2016-01-01

Background: The food frequency questionnaire (FFQ), as a way to assess the dietary intake in comparison with other methods, is easier to analyze and takes less time and is less costly. Our aim in this study was to develop and validate an FFQ for estimating the intakes of selected antioxidants in elderly Iranian people. Materials and Methods: A total of 185 elderly people were randomly selected. Three-day food records were completed by the subjects and collected every 2 months and dietary intake levels of zinc, selenium, carotenes and vitamins C and E were estimated. Based on the food records data, geographic location, and age, an FFQ was designed to estimate antioxidant intakes during 1 year. In addition, for controlling energy intake, 2-day food records were also collected with the food frequency questionnaire. To assess the reliability, 40 individuals were asked to complete the FFQ twice with an interval of 3 months in between. Results: Intraclass correlation coefficient (ICC) between the two FFQs for antioxidant C, antioxidant E, carotene, selenium, and zinc were 0.62, 0.47, 0.51, 0.54, and 0.58, respectively (P < 0.05). In addition, Pearson correlation coefficients between the FFQ and the food records, after controlling energy for vitamin C, vitamin E, carotene, selenium, and zinc, were 0.46, 0.48, 0.38, 0.55, and 0.47 respectively (P < 0.001). Conclusion: According to the results of this study, considering the fact that the FFQ was designed for the elderly and the special conditions (patience, memory, etc.) and vulnerability of this age group, the questionnaire is relatively valid and reliable to use. PMID:27904560

International field testing of the reliability and validity of the EORTC QLQ-BM22 module to assess health-related quality of life in patients with bone metastases.

PubMed

Chow, Edward; Nguyen, Janet; Zhang, Liying; Tseng, Ling-Ming; Hou, Ming-Feng; Fairchild, Alysa; Vassiliou, Vassilios; Jesus-Garcia, Reynaldo; Alm El-Din, Mohamed A; Kumar, Aswin; Forges, Fabien; Chie, Wei-Chu; Bottomley, Andrew

2012-03-01

The objective of this international field study was to test the reliability, validity, and responsiveness of the European Organization for Research and Treatment of Cancer (EORTC) QLQ-BM22 module to assess health-related quality of life (HRQOL) in patients with bone metastases. Patients undergoing a variety of bone metastases-specific treatments were accrued. The QLQ-BM22 was administered with the QLQ-C30 at baseline and at 1 follow-up time point internationally. A debriefing questionnaire was administered to determine patient acceptability and understanding. Large-scale field testing of the QLQ-BM22 in addition to the QLQ-C30 took place in 7 countries: Brazil, Canada, Cyprus, Egypt, France, India, and Taiwan. A total of 400 patients participated. Multitrait scaling analyses confirmed 4 scales in the 22-item module. The scales were able to discriminate between clinically distinct patient groups, such as between those with a poor and those with a better performance status. The QLQ-BM22 was well received in all 7 countries, and the majority of patients did not recommend any significant changes from the module in its current form. The final QLQ-BM22 module contains 22 items and 4 scales assessing Painful Sites, Painful Characteristics, Functional Interference, and Psychosocial Aspects. Results confirmed the validity, reliability, cross-cultural applicability, and sensitivity of the 22-item EORTC QLQ-BM22. It is therefore recommended that the QLQ-BM22 be used in addition to the QLQ-C30 in clinical trials to assess HRQOL in patients with bone metastases. Copyright © 2011 American Cancer Society.

The Wartegg Zeichen Test: a literature overview and a meta-analysis of reliability and validity.

PubMed

Soilevuo Grønnerød, Jarna; Grønnerød, Cato

2012-06-01

All available studies on the Wartegg Zeichen Test (WZT; Wartegg, 1939) were collected and evaluated through a literature overview and a meta-analysis. The literature overview shows that the history of the WZT reflects the geographical and language-based processes of marginalization where relatively isolated traditions have lived and vanished in different parts of the world. The meta-analytic review indicates a high average interscorer reliability of rw = .74 and high validity effect size for studies with clear hypotheses of rw = .33. Although the results were strong, we conclude that the WZT research has not been able to establish cumulative knowledge of the method because of the isolation of research traditions. (c) 2012 APA, all rights reserved

Reliability and validity of non-radiographic methods of thoracic kyphosis measurement: a systematic review.

PubMed

Barrett, Eva; McCreesh, Karen; Lewis, Jeremy

2014-02-01

A wide array of instruments are available for non-invasive thoracic kyphosis measurement. Guidelines for selecting outcome measures for use in clinical and research practice recommend that properties such as validity and reliability are considered. This systematic review reports on the reliability and validity of non-invasive methods for measuring thoracic kyphosis. A systematic search of 11 electronic databases located studies assessing reliability and/or validity of non-invasive thoracic kyphosis measurement techniques. Two independent reviewers used a critical appraisal tool to assess the quality of retrieved studies. Data was extracted by the primary reviewer. The results were synthesized qualitatively using a level of evidence approach. 27 studies satisfied the eligibility criteria and were included in the review. The reliability, validity and both reliability and validity were investigated by sixteen, two and nine studies respectively. 17/27 studies were deemed to be of high quality. In total, 15 methods of thoracic kyphosis were evaluated in retrieved studies. All investigated methods showed high (ICC ≥ .7) to very high (ICC ≥ .9) levels of reliability. The validity of the methods ranged from low to very high. The strongest levels of evidence for reliability exists in support of the Debrunner kyphometer, Spinal Mouse and Flexicurve index, and for validity supports the arcometer and Flexicurve index. Further reliability and validity studies are required to strengthen the level of evidence for the remaining methods of measurement. This should be addressed by future research. Copyright © 2013 Elsevier Ltd. All rights reserved.

Can we measure patients' perception during dental impressions? The Burdens in Dental Impression-Making Questionnaire - BiDIM-Q.

PubMed

Tsirogiannis, Panagiotis; Neophytou, Sophia; Reul, Anika; Heydecke, Guido; Reissmann, Daniel R

2017-01-01

To develop a reliable and valid instrument for the comprehensive assessment of patients' burdens during dental impression making, the Burdens in Dental Impression Making Questionnaire, BiDIM-Q. The item pool was generated in a convenience sample of 20 prosthodontic patients using semi-structured face-to-face interviews. The final instrument was tested in 145 consecutively recruited patients, and psychometric properties of the BiDIM-Q were determined. Four different impression materials were used according to the manufacturers' instructions and indications: alginate, c-silicone, polyvinylsiloxane, and polyether. The final BiDIM-Q consisting of 12 items showed sufficient reliability, indicated by Cronbach's alpha of .82 and an average inter-item correlation of .29. Validity was supported by Pearson correlation coefficients for the correlation between the instrument's total score with the patients' overall satisfaction rating (r=.63), and by the correlation matrix for the correlations of the patients' perceptions with the practitioners' satisfaction ratings. Overall, patient perceived burdens were low with highest burdens observed when using polyether in partially dentate patients for pick-up impressions, while lowest burdens were reported when using c-silicone for impressions of edentulous jaws. The BiDIM-Q is a reliable and valid tool for assessing patient-based process-related quality of care in dentistry allowing a deeper insight into patients' perspective during dental impression making. Copyright © 2016 Japan Prosthodontic Society. Published by Elsevier Ltd. All rights reserved.

Validity and reliability of the Palliative Care Transition Measure for Caregivers (PCTM-C).

PubMed

D'Angelo, Daniela; Mastroianni, Chiara; Artico, Marco; Biagioli, Valentina; Latina, Roberto; Guarda, Michela; Piredda, Michela; De Marinis, Maria Grazia

2018-01-21

Patients suffering from advanced disease face different care transitions. The transition from acute to palliative care is challenging and may lead to the discontinuity of care. Family caregivers become important sources of information, as patients begin to experience difficulties in coping with emotional transition events. The Care Transition Measure was developed to evaluate care transitions as experienced by the elderly. It has never been used in palliative care. The aim of this study was to test the validity and reliability of a modified version of the Palliative Care Transition Measure, specifically the Palliative Care Transition Measure for Caregivers (PCTM-C). The study included two main phases. Phase I focused on the construction of a modified version of the Palliative Care Transition Measure through two focus groups and by computing the content validity index. Phase II focused on testing the psychometric properties of the PCTM-C on 272 family caregivers through confirmatory factor analysis. Result The content validity index for each of the items was higher than 0.80, whereas that for the scale was 0.95. The model tested with confirmatory factor analysis fitted the data well and confirmed that the transition measures referred to communication, integrated care and a trusting-relationship, and therefore the core dimensions of continuity according to existing conceptual models. The internal consistency was high (Cronbach's alpha = 0.94). Significance of results The PCTM-C proved to be a suitable measure of the quality of such transitions. It may be used in clinical practice as a continuity quality indicator and has the potential to guide interventions to enhance family caregivers' experience of care continuity.

A self-rating scale to measure tridoṣas in children

PubMed Central

Suchitra, S.P.; Nagendra, H.R.

2013-01-01

Background: Self – rating inventories to assess the Prakṛti (constitution) and personality have been developed and validated for adults. To analyze the effect of personality development programs on Prakṛti of the children, standardized scale is not available. Hence, present study was carried out to develop and standardize Caraka Child Personality inventory (CCPI). Materials and Methods: The 77- item CCPI scale was developed on the basis of translation of Sanskrit verses describing vātaja (a), pittaja (b) and kaphaja prakṛti (c) characteristics described in Ayurveda texts and by taking the opinions of 5 Ayurveda experts and psychologists. The scale was administered on children of the age group 8-12 years in New Generation National public school, Bangalore. Results: This inventory was named CCPI and showed excellent internal consistency. The Cronbach's alpha for A, B and C scales were 0.54, 0.64 and 0.64 respectively. The Split - Half reliability scores for A, B and C subscales were 0.64. 0.60 and 0.66 respectively. Factor validity coefficient Scores on each item was above 0.4. Scores on vātaja, pittaja and kaphaja scales were inversely correlated. Test-retest reliability scores for A,B and C scales were 0.87,0.88 and 0.89 respectively. The result of CCPI was compared with a parent rating scale Ayurveda Child Personality Inventory (ACPI). Subscales of CCPI correlated significantly highly (above 0.80) with subscales of ACPI which was done for the purpose of cross-validation with respect to ACPI. Conclusions: The prakṛti of the children can be measured consistently by this scale. Correlations with ACPI pointed toward concurrent validity. PMID:25284940

Improving the quality of discrete-choice experiments in health: how can we assess validity and reliability?

PubMed

Janssen, Ellen M; Marshall, Deborah A; Hauber, A Brett; Bridges, John F P

2017-12-01

The recent endorsement of discrete-choice experiments (DCEs) and other stated-preference methods by regulatory and health technology assessment (HTA) agencies has placed a greater focus on demonstrating the validity and reliability of preference results. Areas covered: We present a practical overview of tests of validity and reliability that have been applied in the health DCE literature and explore other study qualities of DCEs. From the published literature, we identify a variety of methods to assess the validity and reliability of DCEs. We conceptualize these methods to create a conceptual model with four domains: measurement validity, measurement reliability, choice validity, and choice reliability. Each domain consists of three categories that can be assessed using one to four procedures (for a total of 24 tests). We present how these tests have been applied in the literature and direct readers to applications of these tests in the health DCE literature. Based on a stakeholder engagement exercise, we consider the importance of study characteristics beyond traditional concepts of validity and reliability. Expert commentary: We discuss study design considerations to assess the validity and reliability of a DCE, consider limitations to the current application of tests, and discuss future work to consider the quality of DCEs in healthcare.

77 FR 56650 - Food and Drug Administration/American Glaucoma Society Workshop on the Validity, Reliability, and...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-13

...] Food and Drug Administration/American Glaucoma Society Workshop on the Validity, Reliability, and... entitled ``FDA/American Glaucoma Society (AGS) Workshop on the Validity, Reliability, and Usability of... research. The purpose of this public workshop is to provide a forum for discussing the validity...

Residual stress investigation of via-last through-silicon via by polarized Raman spectroscopy measurement and finite element simulation

NASA Astrophysics Data System (ADS)

Feng, Wei; Watanabe, Naoya; Shimamoto, Haruo; Aoyagi, Masahiro; Kikuchi, Katsuya

2018-07-01

The residual stresses induced around through-silicon vias (TSVs) by a fabrication process is one of the major concerns of reliability. We proposed a methodology to investigate the residual stress in a via-last TSV. Firstly, radial and axial thermal stresses were measured by polarized Raman spectroscopy. The agreement between the simulated stress level and measured results validated the detail simulation model. Furthermore, the validated simulation model was adopted to the study of residual stress by element death/birth methods. The residual stress at room temperature concentrates at passivation layers owing to the high fabrication process temperatures of 420 °C for SiN film and 350 °C for SiO2 films. For a Si substrate, a high-level stress was observed near potential device locations, which requires attention to address reliability concerns in stress-sensitive devices. This methodology of residual stress analysis can be adopted to investigate the residual stress in other devices.

Validity and Reliability of Field-Based Measures for Assessing Movement Skill Competency in Lifelong Physical Activities: A Systematic Review.

PubMed

Hulteen, Ryan M; Lander, Natalie J; Morgan, Philip J; Barnett, Lisa M; Robertson, Samuel J; Lubans, David R

2015-10-01

It has been suggested that young people should develop competence in a variety of 'lifelong physical activities' to ensure that they can be active across the lifespan. The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71% reporting inter-rater reliability and 41% reporting intra-rater reliability. Only four studies in this review reported test-retest reliability. Ten studies reported validity results; content validity was cited in 41% of these studies. Construct validity was reported in 24% of studies, while criterion validity was only reported in 12% of studies. Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test-retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of 'lifelong physical activity' movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

Validity and Reliability of Turkish Male Breast Self-Examination Instrument.

PubMed

Erkin, Özüm; Göl, İlknur

2018-04-01

This study aims to measure the validity and reliability of Turkish male breast self-examination (MBSE) instrument. The methodological study was performed in 2016 at Ege University, Faculty of Nursing, İzmir, Turkey. The MBSE includes ten steps. For validity studies, face validity, content validity, and construct validity (exploratory factor analysis) were done. For reliability study, Kuder Richardson was calculated. The content validity index was found to be 0.94. Kendall W coefficient was 0.80 (p=0.551). The total variance explained by the two factors was found to be 63.24%. Kuder Richardson 21 was done for reliability study and found to be 0.97 for the instrument. The final instrument included 10 steps and two stages. The Turkish version of MBSE is a valid and reliable instrument for early diagnose. The MBSE can be used in Turkish speaking countries and cultures with two stages and 10 steps.

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Reliability and validity of the German version of the Structured Interview of Personality Organization (STIPO)

PubMed Central

2013-01-01

Background The assessment of personality organization and its observable behavioral manifestations, i.e. personality functioning, has a long tradition in psychodynamic psychiatry. Recently, the DSM-5 Levels of Personality Functioning Scale has moved it into the focus of psychiatric diagnostics. Based on Kernberg’s concept of personality organization the Structured Interview of Personality Organization (STIPO) was developed for diagnosing personality functioning. The STIPO covers seven dimensions: (1) identity, (2) object relations, (3) primitive defenses, (4) coping/rigidity, (5) aggression, (6) moral values, and (7) reality testing and perceptual distortions. The English version of the STIPO has previously revealed satisfying psychometric properties. Methods Validity and reliability of the German version of the 100-item instrument have been evaluated in 122 psychiatric patients. All patients were diagnosed according to the Diagnostic and Statistical Manual for Mental Disorders (DSM-IV) and were assessed by means of the STIPO. Moreover, all patients completed eight questionnaires that served as criteria for external validity of the STIPO. Results Interrater reliability varied between intraclass correlations of .89 and 1.0, Crohnbach’s α for the seven dimensions was .69 to .93. All a priori selected questionnaire scales correlated significantly with the corresponding STIPO dimensions. Patients with personality disorder (PD) revealed significantly higher STIPO scores (i.e. worse personality functioning) than patients without PD; patients cluster B PD showed significantly higher STIPO scores than patients with cluster C PD. Conclusions Interrater reliability, Crohnbach’s α, concurrent validity, and differential validity of the STIPO are satisfying. The STIPO represents an appropriate instrument for the assessment of personality functioning in clinical and research settings. PMID:23941404

Reliability and validity of a new scale on internal coherence (ICS) of cancer patients

PubMed Central

Kröz, Matthias; Büssing, Arndt; von Laue, Hans Broder; Reif, Marcus; Feder, Gene; Schad, Friedemann; Girke, Matthias; Matthes, Harald

2009-01-01

Background Current inventories on quality of life used in oncology mainly focus on functional aspects of patients in the context of disease adaption and treatments (side) effects (EORTC QLQ C30) or generically the status of common functions (Medical Outcome Study SF 36). Beyond circumscribed dimensions of quality of life (i.e., physical, emotional, social, cognitive etc.), there is a lack of inventories which also address other relevant dimensions such as the 'sense of coherence' (SOC) in cancer patients. SOC is important because of its potential prognostic relevance in cancer patients, but the current SOC scale has mainly been validated for psychiatric and psychosomatic patients. Our two-step validation study addresses the internal coherence (ICS) scale, which is based on expert rating, using specific items for oncological patients, with respect to its reliability, validity and sensitivity to chemotherapy. Methods The items were tested on 114 participants (57 cancer patients and a matched control group), alongside questions on autonomic regulation (aR), the Hospital Anxiety and Depression Scale (HADS), self-regulation (SRQ) and Karnofsky the Performance-Index (KPI). A retest of 65 participants was carried out after a median time span of four weeks. In the second part of the study, the ICS was used to assess internal coherence during chemotherapy in 25 patients with colorectal carcinoma (CRC) and 17 breast cancer patients. ICS was recorded before, during and 4 – 8 weeks after treatment. Results The 10-item scale of 'internal coherence' (ICS) shows good to very good reliability: Cronbach-α r = 0.91, retest-reliability r = 0.80. The ICS correlates with r = 0.43 – 0.72 to the convergence criteria (all p < 0.001). We are able to show decreased ICS-values after the third cycle for CRC and breast cancer patients, with a subsequent increase of ICS scores after the end of chemotherapy. Conclusion The ICS has good to very good reliability, validity and sensitivity to chemotherapy. PMID:19552807

Development and validation of criterion-referenced clinically relevant fitness standards for maintaining physical independence in later years.

PubMed

Rikli, Roberta E; Jones, C Jessie

2013-04-01

To develop and validate criterion-referenced fitness standards for older adults that predict the level of capacity needed for maintaining physical independence into later life. The proposed standards were developed for use with a previously validated test battery for older adults-the Senior Fitness Test (Rikli, R. E., & Jones, C. J. (2001). Development and validation of a functional fitness test for community--residing older adults. Journal of Aging and Physical Activity, 6, 127-159; Rikli, R. E., & Jones, C. J. (1999a). Senior fitness test manual. Champaign, IL: Human Kinetics.). A criterion measure to assess physical independence was identified. Next, scores from a subset of 2,140 "moderate-functioning" older adults from a larger cross-sectional database, together with findings from longitudinal research on physical capacity and aging, were used as the basis for proposing fitness standards (performance cut points) associated with having the ability to function independently. Validity and reliability analyses were conducted to test the standards for their accuracy and consistency as predictors of physical independence. Performance standards are presented for men and women ages 60-94 indicating the level of fitness associated with remaining physically independent until late in life. Reliability and validity indicators for the standards ranged between .79 and .97. The proposed standards provide easy-to-use, previously unavailable methods for evaluating physical capacity in older adults relative to that associated with physical independence. Most importantly, the standards can be used in planning interventions that target specific areas of weakness, thus reducing risk for premature loss of mobility and independence.

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

Internal Consistency, Retest Reliability, and their Implications For Personality Scale Validity

PubMed Central

McCrae, Robert R.; Kurtz, John E.; Yamagata, Shinji; Terracciano, Antonio

2010-01-01

We examined data (N = 34,108) on the differential reliability and validity of facet scales from the NEO Inventories. We evaluated the extent to which (a) psychometric properties of facet scales are generalizable across ages, cultures, and methods of measurement; and (b) validity criteria are associated with different forms of reliability. Composite estimates of facet scale stability, heritability, and cross-observer validity were broadly generalizable. Two estimates of retest reliability were independent predictors of the three validity criteria; none of three estimates of internal consistency was. Available evidence suggests the same pattern of results for other personality inventories. Internal consistency of scales can be useful as a check on data quality, but appears to be of limited utility for evaluating the potential validity of developed scales, and it should not be used as a substitute for retest reliability. Further research on the nature and determinants of retest reliability is needed. PMID:20435807

Utilisation, Reliability and Validity of Clinical Evaluation Exercise in Otolaryngology Training.

PubMed

Awad, Z; Hayden, L; Muthuswamy, K; Tolley, N S

2015-10-01

To investigate the utilisation, reliability and validity of clinical evaluation exercise (CEX) in otolaryngology training. Retrospective database analysis. Online assessment database. We analysed all CEXs submitted by north London core (CT) and speciality trainees (ST) in otolaryngology from 2010 to 2013. Internal consistency of the 7 CEX items rated as either O: outstanding, S: satisfactory or D: development required. Overall performance rating (pS) of 1-4 assessed against completion of training level. Receiver operating characteristic was used to describe CEX sensitivity and specificity. Overall score (cS), pS and the number of 'D'-rated items were used to investigate construct validity. One thousand one hundred and sixty CEXs from 45 trainees were included. CEX showed good internal consistency (Cronbach's alpha= 0.85). CEX was highly sensitive (99%), yet not specific (6%). cS and pS for ST was higher than CT (99.1% ± 0.4 versus 96.6% ± 0.8 and 3.06 ± 0.05 versus 1.92 ± 0.04, respectively P < 0.001). pS showed a significant stepwise increase from CT1 to ST6 (P < 0.001). In contrast, cS only showed improvement up to ST4 (P = 0.025). The most frequently utilised item 'management and follow-up planning' was found to be the best predictor of cS and pS (rs  = +0.69 and +0.21, respectively). CEX is reliable in assessing early years otolaryngology trainees in clinical examination, but not at higher level. It has the potential to be used in a summative capacity in selecting trainees for ST positions. This would also encourage trainees to master all domains of otolaryngology clinical examination by end of CT. © 2015 John Wiley & Sons Ltd.

The δ13C Value of Fingerstick Blood Is a Valid, Reliable, and Sensitive Biomarker of Sugar-Sweetened Beverage Intake in Children and Adolescents.

PubMed

MacDougall, Carly R; Hill, Catelyn E; Jahren, A Hope; Savla, Jyoti; Riebl, Shaun K; Hedrick, Valisa E; Raynor, Hollie A; Dunsmore, Julie C; Frisard, Madlyn I; Davy, Brenda M

2018-01-01

Reliance on self-reported dietary intake methods is a commonly cited research limitation, and dietary misreporting is a particular problem in children and adolescents. Objective indicators of dietary intake, such as dietary biomarkers, are needed to overcome this research limitation. The added sugar (AS) biomarker δ13C, which measures the relative abundance of 13C to 12C, has demonstrated preliminary validity in adults. The purpose of this investigation was to determine the comparative validity, test-retest reliability, and sensitivity of the δ13C biomarker to detect AS and sugar-sweetened beverage (SSB) intake using fingerstick blood samples in children and adolescents. Children (aged 6-11 y, n = 126, 56% male, mean ± SD age: 9 ± 2 y) and adolescents (aged 12-18 y, n = 200, 44% male, mean ± SD age: 15 ± 2 y) completed 4 testing sessions within a 3-wk period. Participants' height, weight, demographic characteristics, and health history were determined at the first session; 24-h recalls were obtained at each visit and fingerstick blood samples were collected at visits 1 and 3. Samples were analyzed for δ13C value using natural abundance stable isotope mass spectrometry. δ13C value was compared with dietary outcomes in the full sample, and in child and adolescent subgroups. t Tests and correlational analyses were used to assess biomarker validity and reliability, whereas logistic regression and area under the receiver-operator characteristic curve (AUC) were used to evaluate sensitivity. Reported mean ± SD AS consumption was 82.2 ± 35.8 g/d and 329 ± 143 kcal/d, and SSB consumption was 222 ± 243 mL/d and 98 ± 103 kcal/d. Mean δ13C value was -19.65 ± 0.69‰, and was lower in children than in adolescents (-19.80 ± 0.67‰ compared with -19.56 ± 0.67‰, P = 0.002). δ13C values were similar across sessions (visit 1: -19.66 ± 0.68‰; visit 3: -19.64 ± 0.68‰; r = 0.99, P < 0.001) and were associated (P < 0.001) with intake of total AS (grams, kilocalories: r = 0.29) and SSB (milliliters, kilocalories: r = 0.35). The biomarker was able to better discriminate between high and low SSB consumers than high and low AS consumers, as demonstrated by the AUC (0.75 and 0.62, respectively). The δ13C biomarker is a promising, minimally invasive, objective biomarker of SSB intake in children and adolescents. Further evaluation using controlled feeding designs is warranted. Registered at clinicaltrials.gov as NCT02455388. © 2018 American Society for Nutrition. All rights reserved.

Study on the Validity and Reliability of Melbourne Decision Making Scale in Turkey

ERIC Educational Resources Information Center

Çolakkadioglu, Oguzhan; Deniz, M. Engin

2015-01-01

This study is to analyze the validity and reliability of Melbourne Decision Making Questionnaire (MDMQ). The sample consisted of 650 university students. The structural validity of the MDMQ, as well as correlations among its sub-scales, measure-bound validity, internal consistency, item total correlations and test-retest reliability coefficients…

A Model for Estimating the Reliability and Validity of Criterion-Referenced Measures.

ERIC Educational Resources Information Center

Edmonston, Leon P.; Randall, Robert S.

A decision model designed to determine the reliability and validity of criterion referenced measures (CRMs) is presented. General procedures which pertain to the model are discussed as to: Measures of relationship, Reliability, Validity (content, criterion-oriented, and construct validation), and Item Analysis. The decision model is presented in…

The Psychosocial Impact of Assistive Devices Scale (PIADS): translation and psychometric evaluation of a Chinese (Taiwanese) version.

PubMed

Hsieh, Yi-Ju; Lenker, James A

2006-01-01

Chinese language instruments for measuring the impact of assistive technology are needed. This article reports on the development and preliminary evaluation of a Chinese (Taiwanese) translation of the Psychosocial Impact of Assistive Devices Scale. The language translation process followed standard procedures for cross-cultural adaptation, including: two versions of forward and backward translations, committee review, and pilot testing with bilingual participants. Test-retest reliability, internal consistency, and concurrent validity of the Chinese PIADS (C-PIADS) were evaluated with 60 participants from Taiwan who wear eyeglasses or contact lenses. Cronbach's alpha values for internal consistency ranged from 0.72 to 0.93 for the C-PIADS total scale and three subscales. Test-retest reliability was evaluated using intraclass correlation coefficient analysis, which produced values ranging from 0.79 to 0.88 for the overall C-PIADS score and three sub-scales. Overall C-PIADS scores were not statistically different from data obtained from a similar device user population in the original PIADS validation study. The results of our preliminary psychometric assessment support continued development of the C-PIADS. Future research should focus on three things: additional data collection from a similar participant population, data collection from people with disabilities using assistive technology in Taiwan; and modification of the C-PIADS for use in other Mandarin-speaking regions, e.g., China and Hong Kong.

The Malaysian Medication Adherence Scale (MALMAS): Concurrent Validity Using a Clinical Measure among People with Type 2 Diabetes in Malaysia.

PubMed

Chung, Wen Wei; Chua, Siew Siang; Lai, Pauline Siew Mei; Morisky, Donald E

2015-01-01

Medication non-adherence is a prevalent problem worldwide but up to today, no gold standard is available to assess such behavior. This study was to evaluate the psychometric properties, particularly the concurrent validity of the English version of the Malaysian Medication Adherence Scale (MALMAS) among people with type 2 diabetes in Malaysia. Individuals with type 2 diabetes, aged 21 years and above, using at least one anti-diabetes agent and could communicate in English were recruited. The MALMAS was compared with the 8-item Morisky Medication Adherence Scale (MMAS-8) to assess its convergent validity while concurrent validity was evaluated based on the levels of glycated hemoglobin (HbA1C). Participants answered the MALMAS twice: at baseline and 4 weeks later. The study involved 136 participants. The MALMAS achieved acceptable internal consistency (Cronbach's alpha=0.565) and stable reliability as the test-retest scores showed fair correlation (Spearman's rho=0.412). The MALMAS has good correlation with the MMAS-8 (Spearman's rho=0.715). Participants who were adherent to their anti-diabetes medications had significantly lower median HbA1C values than those who were non-adherence (7.90 versus 8.55%, p=0.032). The odds of participants who were adherent to their medications achieving good glycemic control was 3.36 times (95% confidence interval: 1.09-10.37) of those who were non-adherence. This confirms the concurrent validity of the MALMAS. The sensitivity of the MALMAS was 88.9% while its specificity was 29.6%. The findings of this study further substantiates the reliability and validity of the MALMAS, in particular its concurrent validity and sensitivity for assessing medication adherence of people with type 2 diabetes in Malaysia.

The Malaysian Medication Adherence Scale (MALMAS): Concurrent Validity Using a Clinical Measure among People with Type 2 Diabetes in Malaysia

PubMed Central

Lai, Pauline Siew Mei; Morisky, Donald E.

2015-01-01

Medication non-adherence is a prevalent problem worldwide but up to today, no gold standard is available to assess such behavior. This study was to evaluate the psychometric properties, particularly the concurrent validity of the English version of the Malaysian Medication Adherence Scale (MALMAS) among people with type 2 diabetes in Malaysia. Individuals with type 2 diabetes, aged 21 years and above, using at least one anti-diabetes agent and could communicate in English were recruited. The MALMAS was compared with the 8-item Morisky Medication Adherence Scale (MMAS-8) to assess its convergent validity while concurrent validity was evaluated based on the levels of glycated hemoglobin (HbA1C). Participants answered the MALMAS twice: at baseline and 4 weeks later. The study involved 136 participants. The MALMAS achieved acceptable internal consistency (Cronbach’s alpha=0.565) and stable reliability as the test-retest scores showed fair correlation (Spearman’s rho=0.412). The MALMAS has good correlation with the MMAS-8 (Spearman’s rho=0.715). Participants who were adherent to their anti-diabetes medications had significantly lower median HbA1C values than those who were non-adherence (7.90 versus 8.55%, p=0.032). The odds of participants who were adherent to their medications achieving good glycemic control was 3.36 times (95% confidence interval: 1.09-10.37) of those who were non-adherence. This confirms the concurrent validity of the MALMAS. The sensitivity of the MALMAS was 88.9% while its specificity was 29.6%. The findings of this study further substantiates the reliability and validity of the MALMAS, in particular its concurrent validity and sensitivity for assessing medication adherence of people with type 2 diabetes in Malaysia. PMID:25909363

Improved switching reliability achieved in HfOx based RRAM with mountain-like surface-graphited carbon layer

NASA Astrophysics Data System (ADS)

Tao, Ye; Ding, Wentao; Wang, Zhongqiang; Xu, Haiyang; Zhao, Xiaoning; Li, Xuhong; Liu, Weizhen; Ma, Jiangang; Liu, Yichun

2018-05-01

In this work, we demonstrated an effective method to improve the switching reliability of HfOx based RRAM device by inserting mountain-like surface-graphited carbon (MSGC) layer. The MSGC layer was fabricated through thermal annealing of amorphous carbon (a-C) film with high sp2 proportion (49.7%) under 500 °C on Pt substrate, whose characteristics were validated by XPS and Raman spectrums. The local electric-field (LEF) was enhanced around the nanoscale tips of MSGC layer due to large surface curvature, which leads to simplified CFs and localization of resistive switching region. It takes responsibility to the reduction of high/low resistance states (HRS/LRS) fluctuation from 173.8%/64.9% to 23.6%/6.5%, respectively. In addition, the resulting RRAM devices exhibited fast switching speed (<65 ns), good retention (>104 s at 85 °C) and low cycling degradation. This method could be promising to develop reliable and repeatable high-performance RRAM for practical applications.

Cross-Cultural Validation of the High Blood Pressure Health Literacy Scale in a Chinese Community.

PubMed

Zhang, Qinghua; Huang, Feifei; Liu, Zaoling; Zhang, Na; Mahapatra, Tanmay; Tang, Weiming; Lei, Yang; Dai, Yali; Tang, Songyuan; Zhang, Jingping

2016-01-01

Considering the importance of health literacy (HL) for the maximum yield from the hypertension control programs, development of a reliable and valid instrument of hypertension-related HL is critical. This study aimed to translate and validate the High Blood Pressure-Health Literacy Scale (HBP-HLS) into Chinese (C-HBP-HLS) and evaluate its psychometric properties in Chinese context. Between June 2013 and January 2014, a cross-sectional study was conducted among recruited hypertensive patients belonging to the Han and Kazakh-Chinese communities in Urumqi, Xinjiang, China. A pilot sample (n = 242) was selected for the exploratory factor analysis of the translated and modified instrument. Another sample (n = 308) was recruited for the confirmatory factor analysis. C-HBP-HLS consisted of five dimensions (Print Health Literacy, Medication Label, Understanding Ability, Newest Vital Sign Test, and Avoiding Food Allergy) containing 15 items, accounting for 77.7% of the total variance. The 5-factor model demonstrated a good overall fit. The scale-level content validity index was 0.85. Cronbach's alpha of the overall scale was 0.78 and test-retest reliability was 0.96. Education level had a strong positive correlation with the scores for items Q1, Q2, and Q3(r = 0.481, 0.492, 0.475, respectively). Health Literacy scores among Kazakh patients were significantly lower than Han (7.13±7.90 vs. 30.10±13.42, Z = -14.573, P<0.001). C-HBP-HLS demonstrated suitable factor structure and robust psychometric properties for measuring health literacy level among hypertensive patients in China.

Stress Response as a Function of Task Relevance

DTIC Science & Technology

2010-12-01

be benchmarked for validity and reliability. The State-Trait Anxiety Index (or STAI; Spielberger and Sydeman, 1994) is a popular self-report...and human performance. In J.E. Driskell & E. Salas (Eds.), Stress and Human Performance Spielberger , C.D. and Sydeman, S.J. (1994). State-Trait

Psychometric Evaluation of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID).

PubMed

Duncan, Laura; Georgiades, Kathy; Wang, Li; Van Lieshout, Ryan J; MacMillan, Harriet L; Ferro, Mark A; Lipman, Ellen L; Szatmari, Peter; Bennett, Kathryn; Kata, Anna; Janus, Magdalena; Boyle, Michael H

2017-12-04

The goals of the study were to examine test-retest reliability, informant agreement and convergent and discriminant validity of nine DSM-IV-TR psychiatric disorders classified by parent and youth versions of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Using samples drawn from the general population and child mental health outpatient clinics, 283 youth aged 9 to 18 years and their parents separately completed the MINI-KID with trained lay interviewers on two occasions 7 to 14 days apart. Test-retest reliability estimates based on kappa (κ) went from 0.33 to 0.79 across disorders, samples and informants. Parent-youth agreement on disorders was low (average κ = 0.20). Confirmatory factor analysis provided evidence supporting convergent and discriminant validity. The MINI-KID disorder classifications yielded estimates of test-retest reliability and validity comparable to other standardized diagnostic interviews in both general population and clinic samples. These findings, in addition to the brevity and low administration cost, make the MINI-KID a good candidate for use in epidemiological research and clinical practice. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Assessing physical activity during youth sport: the Observational System for Recording Activity in Children: Youth Sports.

PubMed

Cohen, Alysia; McDonald, Samantha; McIver, Kerry; Pate, Russell; Trost, Stewart

2014-05-01

The purpose of this study was to evaluate the validity and interrater reliability of the Observational System for Recording Activity in Children: Youth Sports (OSRAC:YS). Children (N = 29) participating in a parks and recreation soccer program were observed during regularly scheduled practices. Physical activity (PA) intensity and contextual factors were recorded by momentary time-sampling procedures (10-second observe, 20-second record). Two observers simultaneously observed and recorded children's PA intensity, practice context, social context, coach behavior, and coach proximity. Interrater reliability was based on agreement (Kappa) between the observer's coding for each category, and the Intraclass Correlation Coefficient (ICC) for percent of time spent in MVPA. Validity was assessed by calculating the correlation between OSRAC:YS estimated and objectively measured MVPA. Kappa statistics for each category demonstrated substantial to almost perfect interobserver agreement (Kappa = 0.67-0.93). The ICC for percent time in MVPA was 0.76 (95% C.I. = 0.49-0.90). A significant correlation (r = .73) was observed for MVPA recorded by observation and MVPA measured via accelerometry. The results indicate the OSRAC:YS is a reliable and valid tool for measuring children's PA and contextual factors during a youth soccer practice.

Feelings about culture scales: development, factor structure, reliability, and validity.

PubMed

Maffini, Cara S; Wong, Y Joel

2015-04-01

Although measures of cultural identity, values, and behavior exist in the multicultural psychological literature, there is currently no measure that explicitly assesses ethnic minority individuals' positive and negative affect toward culture. Therefore, we developed 2 new measures called the Feelings About Culture Scale--Ethnic Culture and Feelings About Culture Scale--Mainstream American Culture and tested their psychometric properties. In 6 studies, we piloted the measures, conducted factor analyses to clarify their factor structure, and examined reliability and validity. The factor structure revealed 2 dimensions reflecting positive and negative affect for each measure. Results provided evidence for convergent, discriminant, criterion-related, and incremental validity as well as the reliability of the scales. The Feelings About Culture Scales are the first known measures to examine both positive and negative affect toward an individual's ethnic culture and mainstream American culture. The focus on affect captures dimensions of psychological experiences that differ from cognitive and behavioral constructs often used to measure cultural orientation. These measures can serve as a valuable contribution to both research and counseling by providing insight into the nuanced affective experiences ethnic minority individuals have toward culture. (c) 2015 APA, all rights reserved).

Validation of the Chinese version of EORTC QLQ-BN20 for patients with brain cancer.

PubMed

Zhang, K; Tian, J; He, Z; Sun, W; Pekbay, B; Lin, Y; Wu, D; Zhang, J; Chen, P; Guo, H; Wan, Y; Wang, M; Yang, S; Zheng, J; Zhang, L

2018-03-01

This is a single centre study in mainland China aiming to evaluate the reliability, validity and responsiveness of the Chinese version of EORTC QLQ-BN20, designed by The European Organization for Research and Treatment of Cancer Quality of Life Group to evaluate the life quality of patients with brain tumour, cancer or metastases. One hundred and eighty-eight patients with primary or secondary brain cancer from Hunan Provincial Tumor Hospital during September 2013 to June 2014 completed the Chinese EORTC QLQ-C30/BN20 questionnaires developed by translation, back translation and cultural adaptation. Results were statistically analysed using SPSS17.0. The internal consistency (Cronbach's α coefficient) was between .753 and .869, the correlation coefficients among items and its own dimension were bigger than .4, and all items had a better correlation with its own dimension. The Spearman was used to analyse the correlation of each dimension between EORTC QLQ-BN20 and EORTC QLQ-C30, and the result showed that individual dimensions were moderately correlated, other dimensions were weakly correlated. In conclusion, the Chinese version of EORTC QLQ BN20 questionnaire had great relevance, reliability, convergent validity and discriminant validity. It provides a valuable tool for the assessment of health-related quality of life in clinical studies of Chinese patients with primary or secondary brain cancer. © 2018 John Wiley & Sons Ltd.

Validity and Reliability of the US National Cancer Institute's Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE).

PubMed

Dueck, Amylou C; Mendoza, Tito R; Mitchell, Sandra A; Reeve, Bryce B; Castro, Kathleen M; Rogak, Lauren J; Atkinson, Thomas M; Bennett, Antonia V; Denicoff, Andrea M; O'Mara, Ann M; Li, Yuelin; Clauser, Steven B; Bryant, Donna M; Bearden, James D; Gillis, Theresa A; Harness, Jay K; Siegel, Robert D; Paul, Diane B; Cleeland, Charles S; Schrag, Deborah; Sloan, Jeff A; Abernethy, Amy P; Bruner, Deborah W; Minasian, Lori M; Basch, Ethan

2015-11-01

To integrate the patient perspective into adverse event reporting, the National Cancer Institute developed a patient-reported outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). To assess the construct validity, test-retest reliability, and responsiveness of PRO-CTCAE items. A total of 975 adults with cancer undergoing outpatient chemotherapy and/or radiation therapy enrolled in this questionnaire-based study between January 2011 and February 2012. Eligible participants could read English and had no clinically significant cognitive impairment. They completed PRO-CTCAE items on tablet computers in clinic waiting rooms at 9 US cancer centers and community oncology practices at 2 visits 1 to 6 weeks apart. A subset completed PRO-CTCAE items during an additional visit 1 business day after the first visit. Primary comparators were clinician-reported Eastern Cooperative Oncology Group Performance Status (ECOG PS) and the European Organisation for Research and Treatment of Cancer Core Quality of Life Questionnaire (QLQ-C30). A total of 940 of 975 (96.4%) and 852 of 940 (90.6%) participants completed PRO-CTCAE items at visits 1 and 2, respectively. At least 1 symptom was reported by 938 of 940 (99.8%) participants. Participants' median age was 59 years; 57.3% were female, 32.4% had a high school education or less, and 17.1% had an ECOG PS of 2 to 4. All PRO-CTCAE items had at least 1 correlation in the expected direction with a QLQ-C30 scale (111 of 124, P<.05 for all). Stronger correlations were seen between PRO-CTCAE items and conceptually related QLQ-C30 domains. Scores for 94 of 124 PRO-CTCAE items were higher in the ECOG PS 2 to 4 vs 0 to 1 group (58 of 124, P<.05 for all). Overall, 119 of 124 items met at least 1 construct validity criterion. Test-retest reliability was 0.7 or greater for 36 of 49 prespecified items (median [range] intraclass correlation coefficient, 0.76 [0.53-.96]). Correlations between PRO-CTCAE item changes and corresponding QLQ-C30 scale changes were statistically significant for 27 prespecified items (median [range] r=0.43 [0.10-.56]; all P≤.006). Evidence demonstrates favorable validity, reliability, and responsiveness of PRO-CTCAE in a large, heterogeneous US sample of patients undergoing cancer treatment. Studies evaluating other measurement properties of PRO-CTCAE are under way to inform further development of PRO-CTCAE and its inclusion in cancer trials.

Validation of the Intelligibility in Context Scale for Jamaican Creole-Speaking Preschoolers.

PubMed

Washington, Karla N; McDonald, Megan M; McLeod, Sharynne; Crowe, Kathryn; Devonish, Hubert

2017-08-15

To describe validation of the Intelligibility in Context Scale (ICS; McLeod, Harrison, & McCormack, 2012a) and ICS-Jamaican Creole (ICS-JC; McLeod, Harrison, & McCormack, 2012b) in a sample of typically developing 3- to 6-year-old Jamaicans. One-hundred and forty-five preschooler-parent dyads participated in the study. Parents completed the 7-item ICS (n = 145) and ICS-JC (n = 98) to rate children's speech intelligibility (5-point scale) across communication partners (parents, immediate family, extended family, friends, acquaintances, strangers). Preschoolers completed the Diagnostic Evaluation of Articulation and Phonology (DEAP; Dodd, Hua, Crosbie, Holm, & Ozanne, 2006) in English and Jamaican Creole to establish speech-sound competency. For this sample, we examined validity and reliability (interrater, test-rest, internal consistency) evidence using measures of speech-sound production: (a) percentage of consonants correct, (b) percentage of vowels correct, and (c) percentage of phonemes correct. ICS and ICS-JC ratings showed preschoolers were always (5) to usually (4) understood across communication partners (ICS, M = 4.43; ICS-JC, M = 4.50). Both tools demonstrated excellent internal consistency (α = .91), high interrater, and test-retest reliability. Significant correlations between the two tools and between each measure and language-specific percentage of consonants correct, percentage of vowels correct, and percentage of phonemes correct provided criterion-validity evidence. A positive correlation between the ICS and age further strengthened validity evidence for that measure. Both tools show promising evidence of reliability and validity in describing functional speech intelligibility for this group of typically developing Jamaican preschoolers.

Young adult follow-up of adolescent girls in juvenile justice using the Columbia suicide severity rating scale.

PubMed

Kerr, David C R; Gibson, Brandon; Leve, Leslie D; Degarmo, David S

2014-04-01

This study focused on the reliability and validity of the Columbia Suicide Severity Scale (C-SSRS). Severely delinquent adolescent girls (n = 166) participated in a treatment trial and repeated assessments over time. Lifetime suicide attempt history was measured using the C-SSRS in early adulthood (n = 144; 7-12 years postbaseline). Nonclinician raters showed strong interrater reliability using the C-SSRS. Self-reports, caseworker reports, and caregiver reports of girls' suicide attempt histories collected at baseline correlated with adult participants' recollections of their baseline attempt histories. Suicidal ideation measured prospectively across a 7- to -12-year period was associated with retrospectively reported suicide attempt across the same period. © 2014 The American Association of Suicidology.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Improved spectrophotometric analysis of fullerenes C60 and C70 in high-solubility organic solvents.

PubMed

Törpe, Alexander; Belton, Daniel J

2015-01-01

Fullerenes are among a number of recently discovered carbon allotropes that exhibit unique and versatile properties. The analysis of these materials is of great importance and interest. We present previously unreported spectroscopic data for C60 and C70 fullerenes in high-solubility solvents, including error bounds, so as to allow reliable colorimetric analysis of these materials. The Beer-Lambert-Bouguer law is found to be valid at all wavelengths. The measured data were highly reproducible, and yielded high-precision molar absorbance coefficients for C60 and C70 in o-xylene and o-dichlorobenzene, which both exhibit a high solubility for these fullerenes, and offer the prospect of improved extraction efficiency. A photometric method for a C60/C70 mixture analysis was validated with standard mixtures, and subsequently improved for real samples by correcting for light scattering, using a power-law fit. The method was successfully applied to the analysis of C60/C70 mixtures extracted from fullerene soot.

Examining the factor structure of MUIS-C scale among baby boomers with hepatitis C.

PubMed

Reinoso, Humberto; Türegün, Mehmet

2016-11-01

Baby boomers account for two out of every three cases of hepatitis C infection in the U.S. To conduct an exploratory factor analysis directed at supporting the use of the MUIS-C as a reliable instrument in measuring illness uncertainty among baby boomers with hepatitis C. The steps of conducting a typical principal component analysis (PCA) with an oblique rotation were used on a sample of 146 participants, the sampling adequacy of items was examined via the Kaiser-Meyer-Olkin (KMO) measure, and the Bartlett's sphericity test was used for appropriateness of conducting a factor analysis. A two-factor structure was obtained by using Horn's parallel analysis method. The two factors explained a cumulative total of 45.8% of the variance. The results of the analyses indicated that the MUIS-C was a valid and reliable instrument and potentially suitable for use in baby boomer population diagnosed with hepatitis C. Published by Elsevier Inc.

Validation of a diabetes numeracy test in Arabic.

PubMed

Alghodaier, Hussah; Jradi, Hoda; Mohammad, Najwa Samantha; Bawazir, Amen

2017-01-01

The prevalence of diabetes Mellitus in Saudi Arabia is 24%, ranking it among the top ten Worldwide. Diabetes education focuses on self-management and relies on numeracy skills. Poor numeracy may go unrecognized and it is important to have an assessment tool in Arabic to measure such a skill in diabetes care. To validate a 15-item Diabetes Numeracy Test (DNT-15) in the Arabic Language as a tool to assess the numeracy skills of patients with diabetes and to test its properties among Saudi patients with diabetes. A 15-question Arabic-language test to assess diabetes numeracy among patients with diabetes on the basis of the diabetes numeracy test (DNT-15) was validated among a sample Arabic speaking Saudi patients with diabetes. Data collection included patients' demographics, long-term glycemic control, diabetes type, duration, co-morbidities, and diabetes related knowledge questions. Internal reliability was assessed using Kuder-Richardson Formula 20 (KR-20). The average score of Arabic DNT-15 was 53.3% and took an average of 30 minutes to complete. The scores significantly correlated with education, income, HbA1c, and diabetes knowledge (p<0.05). Content Validity Ratio (CVR) of 0.75 and Content Validity Index (CVI) of 0.89 supported good content validity. The Arabic DNT-15 also had good internal reliability (KR20 = 0.90). Patients with diabetes need numeracy skills to manage their disease. Level of education does not reflect level of numeracy, and low numeracy skills might be unnoticed by health care providers. The Arabic DNT-15 is a valid and reliable scale to identify Arabic speaking patients with difficulties in certain diabetes-related numeracy skills.

Soldier Dimensions in Combat Models

DTIC Science & Technology

1990-05-07

and performance. Questionnaires, SQTs, and ARTEPs were often used. Many scales had estimates of reliability but few had validity data. Most studies...pending its validation . Research plans were provided for applications in simulated combat and with simulation devices, for data previously gathered...regarding reliability and validity . Lack of information following an instrument indicates neither reliability nor validity information was provided by the

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms - Part II.

PubMed

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources.

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms – Part II

PubMed Central

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources. PMID:28584367

Reliability and Validity of the Chinese Version of FACIT-AI, a New Tool for Assessing Quality of Life in Patients with Malignant Ascites.

PubMed

Lou, Yanni; Lu, Linghui; Li, Yuan; Liu, Meng; Bredle, Jason M; Jia, Liqun

2015-10-01

The study objective was to determine the reliability and validity of the Chinese version of the Functional Assessment of Chronic Illness Therapy - Ascites Index (FACIT-AI). A forward-backward translation procedure was adopted to develop the Chinese version of the FACIT-AI, which was tested in 69 patients with malignant ascites. Cronbach's α, split-half reliability, and test-retest reliability were used to assess the reliability of the scale. The content validity index was used to assess the content validity, while factor analysis was used for construct validity and correlation analysis was used for criterion validity. The Cronbach's α was 0.772 for the total scale, and the split-half reliability was 0.693. The test-retest correlation was 0.972. The content validity index for the scale was 0.8-1.0. Four factors were extracted by factor analysis, and these contributed 63.51% of the total variance. Item-total correlations ranged from 0.591 to 0.897, and these were correlated with visual analog scale scores (correlation coefficient, 0.889; P<0.01). The Chinese version of the FACIT-AI has good reliability and validity and can be used as a tool to measure quality of life in Chinese patients with malignant ascites.

Validity and reliability of clinical prediction rules used to screen for cervical spine injury in alert low-risk patients with blunt trauma to the neck: part 2. A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration.

PubMed

Moser, N; Lemeunier, N; Southerst, D; Shearer, H; Murnaghan, K; Sutton, D; Côté, P

2018-06-01

To update findings of the 2000-2010 Bone and Joint Decade Task Force on Neck Pain and its Associated Disorders (Neck Pain Task Force) on the validity and reliability of clinical prediction rules used to screen for cervical spine injury in alert low-risk adult patients with blunt trauma to the neck. We searched four databases from 2005 to 2015. Pairs of independent reviewers critically appraised eligible studies using the modified QUADAS-2 and QAREL criteria. We synthesized low risk of bias studies following best evidence synthesis principles. We screened 679 citations; five had a low risk of bias and were included in our synthesis. The sensitivity of the Canadian C-spine rule ranged from 0.90 to 1.00 with negative predictive values ranging from 99 to 100%. Inter-rater reliability of the Canadian C-spine rule varied from k = 0.60 between nurses and physicians to k = 0.93 among paramedics. The inter-rater reliability of the Nexus Low-Risk Criteria was k = 0.53 between resident physicians and faculty physicians. Our review adds new evidence to the Neck Pain Task Force and supports the use of clinical prediction rules in emergency care settings to screen for cervical spine injury in alert low-risk adult patients with blunt trauma to the neck. The Canadian C-spine rule consistently demonstrated excellent sensitivity and negative predictive values. Our review, however, suggests that the reproducibility of the clinical predictions rules varies depending on the examiners level of training and experience.

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review.

PubMed

Mani, Suresh; Sharma, Shobha; Omar, Baharudin; Paungmali, Aatit; Joseph, Leonard

2017-04-01

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.

Enhanced definitions of intimate partner violence for DSM-5 and ICD-11 may promote improved screening and treatment.

PubMed

Heyman, Richard E; Slep, Amy M Smith; Foran, Heather M

2015-03-01

Nuanced, multifaceted, and content valid diagnostic criteria for intimate partner violence (IPV) have been created and can be used reliably in the field even by those with little-to-no clinical training/background. The use of such criteria such as these would likely lead to more reliable decision making in the field and more consistency across studies. Further, interrater agreement was higher than that usually reported for individual mental disorders. This paper will provide an overview of (a) IPV's scope and impact; (b) the reliable and valid diagnostic criteria that have been used and the adaptation of these criteria inserted in the latest Diagnostic and Statistical Manual of Mental Disorders (DSM) and another adaptation proposed for the forthcoming International Statistical Classification of Diseases and Related Health Problems (ICD); (c) suggestions for screening of IPV in primary care settings; (d) interventions for IPV; and (e) suggested steps toward globally accepted programs. © 2015 Family Process Institute.

A new validated method for the simultaneous determination of benzocaine, propylparaben and benzyl alcohol in a bioadhesive gel by HPLC.

PubMed

Pérez-Lozano, P; García-Montoya, E; Orriols, A; Miñarro, M; Ticó, J R; Suñé-Negre, J M

2005-10-04

A new HPLC-RP method has been developed and validated for the simultaneous determination of benzocaine, two preservatives (propylparaben (nipasol) and benzyl alcohol) and degradation products of benzocaine in a semisolid pharmaceutical dosage form (benzocaine gel). The method uses a Nucleosil 120 C18 column and gradient elution. The mobile phase consisted of a mixture of methanol and glacial acetic acid (10%, v/v) at different proportion according to a time-schedule programme, pumped at a flow rate of 2.0 ml min(-1). The DAD detector was set at 258 nm. The validation study was carried out fulfilling the ICH guidelines in order to prove that the new analytical method, meets the reliability characteristics, and these characteristics showed the capacity of analytical method to keep, throughout the time, the fundamental criteria for validation: selectivity, linearity, precision, accuracy and sensitivity. The method was applied during the quality control of benzocaine gel in order to quantify the drug (benzocaine), preservatives and degraded products and proved to be suitable for rapid and reliable quality control method.

Exercise stereotypes and health-related outcomes in French people living with HIV: development and validation of an HIV Exercise Stereotypes Scale (HIVESS).

PubMed

Gray, Laura; Falzon, Charlène; Bergamaschi, Alessandro; Schuft, Laura; Durant, Jacques; Rosenthal, Eric; Pradier, Christian; Duracinsky, Martin; Rouanet, Isabelle; Colson, Serge S; d'Arripe-Longueville, Fabienne

2016-11-14

The main objective of the current study was to develop and validate a French exercise stereotype scale for people living with HIV (PLHIV) in order to gain visibility to the possible barriers and facilitators for exercise in PLHIV and thus enhance their quality of life. A series of four complementary studies was carried out with a total sample of 524 participants to: (a) develop a preliminary version of the HIV Exercise Stereotype Scale (HIVESS) (Stage 1), (b) confirm the factorial structure of the instrument (Stage 2), (c) evaluate the stability of the instrument (Stage 3), and (d) examine the construct and divergent validity of the scale (Stage 4). Results provided support for a 14-item scale with three sub-scales reporting stereotypes related to exercise benefits, exercise risks and lack of capacity for exercise with Cronbach's alphas of .77, .69 and .76 respectively. Results showed good factorial structure, strong reliability and indicators of convergent validity relating to self-efficacy, exercise and quality of life. The HIVESS presented satisfactory psychometric properties, constitutes a reliable and valid instrument to measure exercise stereotypes among PLHIV and has applications for future research and clinical practice.

The Coopersmith Self-Esteem Inventory in an Adult Sample.

ERIC Educational Resources Information Center

Noller, Patricia; Shugm, David

1988-01-01

The reliability and validity of the Self-Esteem Inventory developed by S. C. Coopersmith (1975) were evaluated via item-total correlation, discriminant analysis, factor analysis, and analysis of variance of data for 352 Australian adults. The instrument had high internal consistency and discriminated well between subjects with high and low…

78 FR 78740 - Isopyrazam; Pesticide Tolerances

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-27

... access the OCSPP test guidelines referenced in this document electronically, please go to http://www.epa.gov/ocspp and select ``Test Methods and Guidelines.'' C. How can I file an objection or hearing... validity, completeness, and reliability as well as the relationship of the results of the studies to human...

Psychometric properties of the Calgary Cambridge guides to assess communication skills of undergraduate medical students

PubMed Central

Simmenroth-Nayda, Anne; Heinemann, Stephanie; Nolte, Catharina; Fischer, Thomas; Himmel, Wolfgang

2014-01-01

Objectives: The aim of this study was to analyse the psychometric properties of the short version of the Calgary Cambridge Guides and to decide whether it can be recommended for use in the assessment of communications skills in young undergraduate medical students. Methods: Using a translated version of the Guide, 30 members from the Department of General Practice rated 5 videotaped encounters between students and simulated patients twice. Item analysis should detect possible floor and/or ceiling effects. The construct validity was investigated using exploratory factor analysis. Intra-rater reliability was measured in an interval of 3 months, inter-rater reliability was assessed by the intraclass correlation coefficient. Results: The score distribution of the items showed no ceiling or floor effects. Four of the five factors extracted from the factor analysis represented important constructs of doctor-patient communication The ratings for the first and second round of assessing the videos correlated at 0.75 (p < 0.0001). Intraclass correlation coefficients for each item ranged were moderate and ranged from 0.05 to 0.57. Conclusions: Reasonable score distributions of most items without ceiling or floor effects as well as a good test-retest reliability and construct validity recommend the C-CG as an instrument for assessing communication skills in undergraduate medical students. Some deficiencies in inter-rater reliability are a clear indication that raters need a thorough instruction before using the C-CG. PMID:25480988

Psychometric properties of the Turkish version of the Emotional Eating Scale for children and adolescents.

PubMed

Bektas, Murat; Bektas, Ilknur; Selekoğlu, Yasemin; Kudubes, Aslı Akdeniz; Altan, Sema Sal; Ayar, Dijle

2016-08-01

This methodological-descriptive-sectional study was performed to assess the validity and reliability of the "Emotional Eating Scale Adapted for Use in Children and Adolescents (EES-C)" scale in Turkey. The sample group of the study was composed of 576 children and adolescents. The data were obtained by using the demographic data collection form and "Emotional Eating Scale Adapted for Use in Children and Adolescents (EES-C)". Cronbach's alpha values for the scale and its subscales were 0.90, 0.86, 0.76 and 0.71; respectively. Item-total correlations for the scale changed between 0.57 and 0.99 (p<0.001). The indices of Model Fit were determined to be Root Mean Square Error of Approximation (RMSA)=0.051, Goodness of Fit Index (GFI)=0.91 and Comparative Fit Index (CFI)=0.97. According to our results, it has been shown that the scale is a valid/reliable instrument to detect the emotional eating of Turkish children and adolescents. EES-C is a convenient tool for professionals to manage and prevent the emotional eating problems. Copyright © 2016 Elsevier Ltd. All rights reserved.

Assessing reliability and validity measures in managed care studies.

PubMed

Montoya, Isaac D

2003-01-01

To review the reliability and validity literature and develop an understanding of these concepts as applied to managed care studies. Reliability is a test of how well an instrument measures the same input at varying times and under varying conditions. Validity is a test of how accurately an instrument measures what one believes is being measured. A review of reliability and validity instructional material was conducted. Studies of managed care practices and programs abound. However, many of these studies utilize measurement instruments that were developed for other purposes or for a population other than the one being sampled. In other cases, instruments have been developed without any testing of the instrument's performance. The lack of reliability and validity information may limit the value of these studies. This is particularly true when data are collected for one purpose and used for another. The usefulness of certain studies without reliability and validity measures is questionable, especially in cases where the literature contradicts itself

Reliability and validity of Web-SPAN, a web-based method for assessing weight status, diet and physical activity in youth.

PubMed

Storey, K E; McCargar, L J

2012-02-01

Web-based surveys are becoming increasing popular. The present study aimed to assess the reliability and validity of the Web-Survey of Physical Activity and Nutrition (Web-SPAN) for self-report of height and weight, diet and physical activity by youth. School children aged 11-15years (grades 7-9; n=459) participated in the school-based research (boys, n=225; girls, n=233; mean age, 12.8years). Students completed Web-SPAN (self-administered) twice and participated in on-site school assessments [height, weight, 3-day food/pedometer record, Physical Activity Questionnaire for Older Children (PAQ-C), shuttle run]. Intraclass (ICC) and Pearson's correlation coefficients and paired samples t-tests were used to assess the test-retest reliability of Web-SPAN and to compare Web-SPAN with the on-site assessments. Test-retest reliability for height (ICC=0.90), weight (ICC=0.98) and the PAQ-C (ICC=0.79) were highly correlated, whereas correlations for nutrients were not as strong (ICC=0.37-0.64). There were no differences between Web-SPAN times 1 and 2 for height and weight, although there were differences for the PAQ-C and most nutrients. Web-SPAN was strongly correlated with the on-site assessments, including height (ICC=0.88), weight (ICC=0.93) and the PAQ-C (ICC=0.70). Mean differences for height and the PAQ-C were not significant, whereas mean differences for weight were significant resulting in an underestimation of being overweight/obesity prevalence (84% agreement). Correlations for nutrients were in the range 0.24-0.40; mean differences were small but generally significantly different. Correlations were weak between the web-based PAQ-C and 3-day pedometer record (r=0.28) and 20-m shuttle run (r=0.28). Web-SPAN is a time- and cost-effective method that can be used to assess the diet and physical activity status of youth in large cross-sectional studies and to assess group trends (weight status). © 2011 The Authors. Journal of Human Nutrition and Dietetics © 2011 The British Dietetic Association Ltd.

Measurement of fatigue: Comparison of the reliability and validity of single-item and short measures to a comprehensive measure.

PubMed

Kim, Hee-Ju; Abraham, Ivo

2017-01-01

Evidence is needed on the clinicometric properties of single-item or short measures as alternatives to comprehensive measures. We examined whether two single-item fatigue measures (i.e., Likert scale, numeric rating scale) or a short fatigue measure were comparable to a comprehensive measure in reliability (i.e., internal consistency and test-retest reliability) and validity (i.e., convergent, concurrent, and predictive validity) in Korean young adults. For this quantitative study, we selected the Functional Assessment of Chronic Illness Therapy-Fatigue for the comprehensive measure and the Profile of Mood States-Brief, Fatigue subscale for the short measure; and constructed two single-item measures. A total of 368 students from four nursing colleges in South Korea participated. We used Cronbach's alpha and item-total correlation for internal consistency reliability and intraclass correlation coefficient for test-retest reliability. We assessed Pearson's correlation with a comprehensive measure for convergent validity, with perceived stress level and sleep quality for concurrent validity and the receiver operating characteristic curve for predictive validity. The short measure was comparable to the comprehensive measure in internal consistency reliability (Cronbach's alpha=0.81 vs. 0.88); test-retest reliability (intraclass correlation coefficient=0.66 vs. 0.61); convergent validity (r with comprehensive measure=0.79); concurrent validity (r with perceived stress=0.55, r with sleep quality=0.39) and predictive validity (area under curve=0.88). Single-item measures were not comparable to the comprehensive measure. A short fatigue measure exhibited similar levels of reliability and validity to the comprehensive measure in Korean young adults. Copyright © 2016 Elsevier Ltd. All rights reserved.

Dynamic MRI to quantify musculoskeletal motion: A systematic review of concurrent validity and reliability, and perspectives for evaluation of musculoskeletal disorders.

PubMed

Borotikar, Bhushan; Lempereur, Mathieu; Lelievre, Mathieu; Burdin, Valérie; Ben Salem, Douraied; Brochard, Sylvain

2017-01-01

To report evidence for the concurrent validity and reliability of dynamic MRI techniques to evaluate in vivo joint and muscle mechanics, and to propose recommendations for their use in the assessment of normal and impaired musculoskeletal function. The search was conducted on articles published in Web of science, PubMed, Scopus, Academic search Premier, and Cochrane Library between 1990 and August 2017. Studies that reported the concurrent validity and/or reliability of dynamic MRI techniques for in vivo evaluation of joint or muscle mechanics were included after assessment by two independent reviewers. Selected articles were assessed using an adapted quality assessment tool and a data extraction process. Results for concurrent validity and reliability were categorized as poor, moderate, or excellent. Twenty articles fulfilled the inclusion criteria with a mean quality assessment score of 66% (±10.4%). Concurrent validity and/or reliability of eight dynamic MRI techniques were reported, with the knee being the most evaluated joint (seven studies). Moderate to excellent concurrent validity and reliability were reported for seven out of eight dynamic MRI techniques. Cine phase contrast and real-time MRI appeared to be the most valid and reliable techniques to evaluate joint motion, and spin tag for muscle motion. Dynamic MRI techniques are promising for the in vivo evaluation of musculoskeletal mechanics; however results should be evaluated with caution since validity and reliability have not been determined for all joints and muscles, nor for many pathological conditions.

Validity and Reliability of the 8-Item Work Limitations Questionnaire.

PubMed

Walker, Timothy J; Tullar, Jessica M; Diamond, Pamela M; Kohl, Harold W; Amick, Benjamin C

2017-12-01

Purpose To evaluate factorial validity, scale reliability, test-retest reliability, convergent validity, and discriminant validity of the 8-item Work Limitations Questionnaire (WLQ) among employees from a public university system. Methods A secondary analysis using de-identified data from employees who completed an annual Health Assessment between the years 2009-2015 tested research aims. Confirmatory factor analysis (CFA) (n = 10,165) tested the latent structure of the 8-item WLQ. Scale reliability was determined using a CFA-based approach while test-retest reliability was determined using the intraclass correlation coefficient. Convergent/discriminant validity was tested by evaluating relations between the 8-item WLQ with health/performance variables for convergent validity (health-related work performance, number of chronic conditions, and general health) and demographic variables for discriminant validity (gender and institution type). Results A 1-factor model with three correlated residuals demonstrated excellent model fit (CFI = 0.99, TLI = 0.99, RMSEA = 0.03, and SRMR = 0.01). The scale reliability was acceptable (0.69, 95% CI 0.68-0.70) and the test-retest reliability was very good (ICC = 0.78). Low-to-moderate associations were observed between the 8-item WLQ and the health/performance variables while weak associations were observed between the demographic variables. Conclusions The 8-item WLQ demonstrated sufficient reliability and validity among employees from a public university system. Results suggest the 8-item WLQ is a usable alternative for studies when the more comprehensive 25-item WLQ is not available.

A Turkish version of myocardial infarction dimensional assessment scale (TR-MIDAS): reliability-validity assesment.

PubMed

Uysal, Hilal; Ozcan, Şeyda

2011-06-01

Many new measuring devices have been developed so that broader psychometric measurements in the coronary artery disease, disease-specific health status measurements, and identification of the broader quality of life can be performed in the recent years. The study was intended to determine whether, and to what extent, MIDAS is a valid and reliable measurement to the patients suffering from myocardial infarction for the first time in Turkey. The research was conducted with the patients hospitalized and treated with myocardial infarction in the cardiology departments of 2 hospitals in Istanbul, Turkey, between 2007 and 2008. Psychometric evaluations of TR-MIDAS were used for validity studies; language validity, content validity, construct validity were examined. For reliability studies; the tool's internal consistency reliability, Cronbach's alpha reliability coefficient, and test-retest reliability were completed. The instrument's content validity index was determined to be "0.95". Principal component analysis revealed six factors with an eigenvalue >1.5. Cronbach's alpha was found to be 0.89 for total scale which was an acceptable value. The total's test-retest reliability was 0.51 (p<0.01). Data obtained at the end of the study supports that Turkish Myocardial Infarction Dimensional Assessment Scale is a valid and reliable instrument as a disease-specific scale to assess the patients' quality of life suffering from myocardial infarction in Turkey. Copyright © 2010 European Society of Cardiology. Published by Elsevier B.V. All rights reserved.

The validity and scalability of the Theory of Mind Scale with toddlers and preschoolers.

PubMed

Hiller, Rachel M; Weber, Nathan; Young, Robyn L

2014-12-01

Despite the importance of theory of mind (ToM) for typical development, there remain 2 key issues affecting our ability to draw robust conclusions. One is the continued focus on false belief as the sole measure of ToM. The second is the lack of empirically validated measures of ToM as a broad construct. Our key aim was to examine the validity and reliability of the 5-item ToM scale (Peterson, Wellman, & Liu, 2005). In particular, we extended on previous research of this scale by assessing its scalability and validity for use with children from 2 years of age. Sixty-eight typically developing children (aged 24 to 61 months) were assessed on the scale's 5 tasks, along with a sixth Sally-Anne false-belief task. Our data replicated the scalability of the 5 tasks for a Rasch-but not Guttman-scale. Guttman analysis showed that a 4-item scale may be more suitable for this age range. Further, the tasks showed good internal consistency and validity for use with children as young as 2 years of age. Overall, the measure provides a valid and reliable tool for the assessment of ToM, and in particular, the longitudinal assessment of this ability as a construct. (c) 2014 APA, all rights reserved.

Development and validation of a brief trauma screening measure for children: The Child Trauma Screen.

PubMed

Lang, Jason M; Connell, Christian M

2017-05-01

Childhood exposure to trauma, including violence and abuse, is a major public health concern that has resulted in increased efforts to promote trauma-informed child-serving systems. Trauma screening is an important component of such trauma-informed systems, yet widespread use of trauma screening is rare in part due to the lack of brief, validated trauma screening measures for children. We describe development and validation of the Child Trauma Screen (CTS), a 10-item screening measure of trauma exposure and posttraumatic stress disorder (PTSD) symptoms for children consistent with the DSM-5 definition of PTSD. Study 1 describes measure development incorporating analysis to derive items based on existing measures from 1,065 children and caregivers together with stakeholder input to finalize item selection. Study 2 describes validation of the CTS with a clinical sample of 74 children and their caregivers. Results support the CTS as an empirically derived, reliable measure to screen children for trauma exposure and PTSD symptoms with strong convergent, divergent, and criterion validity. The CTS is a promising measure for rapidly and reliably screening children for trauma exposure and PTSD symptoms. Future research is needed to confirm validation and to examine feasibility and utility of its use across various child-serving systems. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Workplace status: The development and validation of a scale.

PubMed

Djurdjevic, Emilija; Stoverink, Adam C; Klotz, Anthony C; Koopman, Joel; da Motta Veiga, Serge P; Yam, Kai Chi; Chiang, Jack Ting-Ju

2017-07-01

Research suggests that employee status, and various status proxies, relate to a number of meaningful outcomes in the workplace. The advancement of the study of status in organizational settings has, however, been stymied by the lack of a validated workplace status measure. The purpose of this manuscript, therefore, is to develop and validate a measure of workplace status based on a theoretically grounded definition of status in organizations. Subject-matter experts were used to examine the content validity of the measure. Then, 2 separate samples were employed to assess the psychometric properties (i.e., factor structure, reliability, convergent and discriminant validity) and nomological network of a 5-item, self-report Workplace Status Scale (WSS). To allow for methodological flexibility, an additional 3 samples were used to extend the WSS to coworker reports of a focal employee's status, provide additional evidence for the validity and reliability of the WSS, and to demonstrate consensus among coworker ratings. Together, these studies provide evidence of the psychometric soundness of the WSS for assessing employee status using either self-reports or other-source reports. The implications of the development of the WSS for the study of status in organizations are discussed, and suggestions for future research using the new measure are offered. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Longitudinal Models of Reliability and Validity: A Latent Curve Approach.

ERIC Educational Resources Information Center

Tisak, John; Tisak, Marie S.

1996-01-01

Dynamic generalizations of reliability and validity that will incorporate longitudinal or developmental models, using latent curve analysis, are discussed. A latent curve model formulated to depict change is incorporated into the classical definitions of reliability and validity. The approach is illustrated with sociological and psychological…

Scoring Rubric Development: Validity and Reliability.

ERIC Educational Resources Information Center

Moskal, Barbara M.; Leydens, Jon A.

2000-01-01

Provides clear definitions of the terms "validity" and "reliability" in the context of developing scoring rubrics and illustrates these definitions through examples. Also clarifies how validity and reliability may be addressed in the development of scoring rubrics, defined as descriptive scoring schemes developed to guide the analysis of the…

An alternative to the balance error scoring system: using a low-cost balance board to improve the validity/reliability of sports-related concussion balance testing.

PubMed

Chang, Jasper O; Levy, Susan S; Seay, Seth W; Goble, Daniel J

2014-05-01

Recent guidelines advocate sports medicine professionals to use balance tests to assess sensorimotor status in the management of concussions. The present study sought to determine whether a low-cost balance board could provide a valid, reliable, and objective means of performing this balance testing. Criterion validity testing relative to a gold standard and 7 day test-retest reliability. University biomechanics laboratory. Thirty healthy young adults. Balance ability was assessed on 2 days separated by 1 week using (1) a gold standard measure (ie, scientific grade force plate), (2) a low-cost Nintendo Wii Balance Board (WBB), and (3) the Balance Error Scoring System (BESS). Validity of the WBB center of pressure path length and BESS scores were determined relative to the force plate data. Test-retest reliability was established based on intraclass correlation coefficients. Composite scores for the WBB had excellent validity (r = 0.99) and test-retest reliability (R = 0.88). Both the validity (r = 0.10-0.52) and test-retest reliability (r = 0.61-0.78) were lower for the BESS. These findings demonstrate that a low-cost balance board can provide improved balance testing accuracy/reliability compared with the BESS. This approach provides a potentially more valid/reliable, yet affordable, means of assessing sports-related concussion compared with current methods.

The revised critical thinking skills scale for a life-and-death course: preliminary scale refinement.

PubMed

Hwang, Huei-Lih; Lin, Huey-Shyan; Wang, Hsiu-Hung

2010-12-01

Death education involves acquiring knowledge, changing behavior, and developing proper views of life in both the affective and the value domains. Critical thinking that is honed through reflecting on life-and-death issues represents a way to reach these goals. Designing assessments able to measure college student content and critical thinking skills related to life-and-death issues is thus important. The Test of Critical Thinking Skills for Life-And-Death content (TCTS-LD) instrument requires the administration of additional tests to assess reliability and validity for future use in the assessment of perceptions on life and death. The purpose of this study was to refine the TCTS-LD. A cross-sectional, descriptive design was used to recruit 715 college students in southern Taiwan. Three structured scales were administered in class to the participants. Data were collected in 2004 and 2006. Confirmatory factor analysis was applied to validate the structure of scales. Examination of the reliability of the three-factor and 15-item scale revealed a Kuder-Richardson coefficient of internal consistency of .54. The split-half reliability coefficients were .47 in the Spearman-Brown correlation and .40 in the intraclass correlation coefficient (ICC). The test-retest reliability coefficients (n = 22) were .58 in Pearson correlation and .56 in ICC. In addition to content validity verification by experts and face validity by students, the validity of this test was assessed using three methods, including (a) a comparable validity rating between this test and the TCTS-A (r = .34, p < .001; (b) a contrast-group technique with different responses to the instrument between those in education and nursing majors (t = 2.71, p < .01), with scores of 10.98 (SD = 2.42) and 9.82 (SD = 2.25), respectively; and (c) a confirmatory factor analysis confirming that TCTS-LD is related to the three dimensions of assumption, evaluation, and induction (χ = 81.800, p = .158, normed chi-square χ/df = 1.169, comparative fit index [CFI] = .976, Tucker-Lewis index = .984, root mean square error of approximation [RMSEA] = 0.015). Three factors explained 31.19% of total variance for the revised TCTS-LD. The revised TCTS-LD scale improved performance and effectiveness to a certain degree. However, reliability and construct validity must be further tested to permit its use as an evaluation tool.

Development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS): An observation-based tool for assessing cognitive behavioral therapy competence.

PubMed

Muse, Kate; McManus, Freda; Rakovshik, Sarah; Thwaites, Richard

2017-05-01

This article outlines the development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS) rating scale. The ACCS aims to provide a novel assessment framework to deliver formative and summative feedback regarding therapists' performance within observed cognitive-behavioral treatment sessions, and for therapists to rate and reflect on their own performance. Findings from 3 studies are outlined: (a) a feedback study (n = 66) examining content validity, face validity and usability; (b) a focus group (n = 9) evaluating usability and utility; and (c) an evaluation of the psychometric properties of the ACCS in real world cognitive behavioral therapy (CBT) training and routine clinical practice contexts. Results suggest that the ACCS has good face validity, content validity, and usability and provides a user-friendly tool that is useful for promoting self-reflection and providing formative feedback. Scores on both the self and assessor-rated versions of the ACCS demonstrate good internal consistency, interrater reliability, and discriminant validity. In addition, ACCS scores were found to be correlated with, but distinct from, the Revised Cognitive Therapy Scale (CTS-R) and were comparable to CTS-R scores in terms of internal consistency and discriminant validity. In addition, the ACCS may have advantages over the CTS-R in terms of interrater reliability of scores. The studies also provided insight into areas for refinement and a number of modifications were undertaken to improve the scale. In summary, the ACCS is an appropriate and useful measure of CBT competence that can be used to promote self-reflection and provide therapists with formative and summative feedback. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Cross-cultural application of the Korean version of the EORTC QLQ-ELD14 questionnaire for elderly patients with cancer.

PubMed

Goo, Ae Jin; Shin, Dong Wook; Yang, Hyung Kook; Park, Jong-Hyock; Kim, So-Young; Shin, Joo Yeon; Kim, Young Ae; Kim, Changhoon; Hong, Nam-Soo; Min, Young Joo; Park, Keeho

2017-07-01

The European Organization for Research and Treatment of Cancer (EORTC) QLQ-ELD14 is a validated tool that measures Health-related Quality-of-life (HRQOL) for elderly patients with cancer. This study was conducted to evaluate the psychometric properties of the Korean version of the EORTC QLQ-ELD14 to determine if this tool can be used to evaluate HRQOL for older Korean patients with cancer. We recruited 439 elderly patients with cancer aged ≥60years from 11 cancer centers and completed the EORTC QLQ-ELD14 questionnaires. The reliability and validity of the EORTC QLQ-ELD14 questionnaire were assessed via Cronbach alpha, multitrait scaling analyses, correlation analyses with the EORTC QLQ-C30, and known-group comparisons. Known-group comparisons were conducted by dividing the patients into groups based on the cancer stage, depression level, and loss of mobility. The scale structure of the Korean version of the EORTC QLQ-ELD14 was consistent with the originally hypothesized scale structure. Cronbach alpha coefficients ranged 0.65-0.88. Multitrait scaling analysis showed good item convergent and discriminant validity. Low scaling errors (3.1%) were observed. Divergent validity was demonstrated by no strong correlation with the EORTC QLQ C30. The clinical validity of the Korean version of the EORTC QLQ-ELD14 was demonstrated by its ability to discriminate among patient subgroups categorized by AJCC stage, depression level, and loss of mobility. Our findings indicate that the Korean version of the EORTC QLQ-ELD14 questionnaire is reliable and valid for measuring QOL of older Korean patients with cancer. Copyright © 2017 Elsevier Inc. All rights reserved.

The cross-cultural adaptation, reliability, and validity of the Copenhagen Neck Functional Disability Scale in patients with chronic neck pain: Turkish version study.

PubMed

Yapali, Gökmen; Günel, Mintaze Kerem; Karahan, Sevilay

2012-05-15

The study design was cross-cultural adaptation and investigation of reliability and validity of the Copenhagen Neck Functional Disability Scale (CNFDS). The aim of this study was to translate the CNFDS into Turkish language and assess its reliability and validity among patients with neck pain in Turkish population. The CNFDS is a reliable and valid evaluation instrument for disability, but there is no published the Turkish version of the CNFDS. One hundred one subjects who had chronic neck pain were included in this study. The CNFDS, Neck Pain and Disability Scale, and visual analogue scale were administered to all subjects. For investigating test-retest reliability, correlation between CNFDS scores, applied at 1-week interval, intraclass correlation coefficient score for test-retest reliability was 0.86 (95% confidence interval = 0.679-0.935). There was no difference between test-retest scores (P < 0.001). For investigating concurrent validity, correlation between total score of the CNFDS and the mean visual analogue scale was r = 0.73 (P < 0.001). Concurrent validity of the CNFDS was very good. For investigating construct validity, correlation between total score of the CNFDS and the Neck Pain and Disability Scale was r = 0.78 (P < 0.001). Construct validity of the CNFDS was also very good. Our results suggest that the Turkish version of the CNFDS is a reliable and valid instrument for Turkish people.

Development of a Conservative Model Validation Approach for Reliable Analysis

DTIC Science & Technology

2015-01-01

CIE 2015 August 2-5, 2015, Boston, Massachusetts, USA [DRAFT] DETC2015-46982 DEVELOPMENT OF A CONSERVATIVE MODEL VALIDATION APPROACH FOR RELIABLE...obtain a conservative simulation model for reliable design even with limited experimental data. Very little research has taken into account the...3, the proposed conservative model validation is briefly compared to the conventional model validation approach. Section 4 describes how to account

Evaluation of Validity and Reliability for Hierarchical Scales Using Latent Variable Modeling

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.

2012-01-01

A latent variable modeling method is outlined, which accomplishes estimation of criterion validity and reliability for a multicomponent measuring instrument with hierarchical structure. The approach provides point and interval estimates for the scale criterion validity and reliability coefficients, and can also be used for testing composite or…

The Reliability and Validity of a Scale to Measure Teachers' Attitudes toward Integration in an Australian Context.

ERIC Educational Resources Information Center

Roberts, Clare; Pratt, Chris

1988-01-01

The study evaluated the psychometric properties of reliability and construct validity of the Attitude Toward Mainstreaming Scale (ATMS) in an Australian context. It was concluded that the scale is both reliable and factorially valid in an Australian context. (Author/DB)

Self-esteem among nursing assistants: reliability and validity of the Rosenberg Self-Esteem Scale.

PubMed

McMullen, Tara; Resnick, Barbara

2013-01-01

To establish the reliability and validity of the Rosenberg Self-Esteem Scale (RSES) when used with nursing assistants (NAs). Testing the RSES used baseline data from a randomized controlled trial testing the Res-Care Intervention. Female NAs were recruited from nursing homes (n = 508). Validity testing for the positive and negative subscales of the RSES was based on confirmatory factor analysis (CFA) using structural equation modeling and Rasch analysis. Estimates of reliability were based on Rasch analysis and the person separation index. Evidence supports the reliability and validity of the RSES in NAs although we recommend minor revisions to the measure for subsequent use. Establishing reliable and valid measures of self-esteem in NAs will facilitate testing of interventions to strengthen workplace self-esteem, job satisfaction, and retention.

Construct Validity and Reliability of the Questionnaire on the Quality of Physician-Patient Interaction in Adults With Hypertension.

PubMed

Hickman, Ronald L; Clochesy, John M; Hetland, Breanna; Alaamri, Marym

2017-04-01

There are limited reliable and valid measures of the patient- provider interaction among adults with hypertension. Therefore, the purpose of this report is to describe the construct validity and reliability of the Questionnaire on the Quality of Physician-Patient Interaction (QQPPI), in community-dwelling adults with hypertension. A convenience sample of 109 participants with hypertension was recruited and administered the QQPPI at baseline and 8 weeks later. The exploratory factor analysis established a 12-item, 2-factor structure for the QQPPI was valid in this sample. The modified QQPPI proved to have sufficient internal consistency and test- retest reliability. The modified QQPPI is a valid and reliable measure of the provider-patient interaction, a construct posited to impact self-management, in adults with hypertension.

Psychometrics of the Home Safety Self-Assessment Tool (HSSAT) to prevent falls in community-dwelling older adults.

PubMed

Tomita, Machiko R; Saharan, Sumandeep; Rajendran, Sheela; Nochajski, Susan M; Schweitzer, Jo A

2014-01-01

OBJECTIVE. To identify psychometric properties of the Home Safety Self-Assessment Tool (HSSAT) to prevent falls in community-dwelling older adults. METHOD. We tested content validity, test-retest reliability, interrater reliability, construct validity, convergent and discriminant validity, and responsiveness to change. RESULTS. The content validity index was .98, the intraclass correlation coefficient for test-retest reliability was .97, and the interrater reliability was .89. The difference on identified risk factors between the use and nonuse of the HSSAT was significant (p = .005). Convergent validity with the Centers for Disease Control and Prevention Home Safety Checklist was high (r = .65), and discriminant validity with fear of falling was very low (r = .10). The responsiveness to change was moderate (standardized response mean = 0.57). CONCLUSION. The HSSAT is a reliable and valid instrument to identify fall risks in a home environment, and the HSSAT booklet is effective as educational material leading to improvement in home safety. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Cross-Cultural Adaptation, Reliability and Validity Study of the Persian Version of the Clinical COPD Questionnaire.

PubMed

Hasanpour, Neda; Attarbashi Moghadam, Behrouz; Sami, Ramin; Tavakol, Kamran

2016-08-01

The clinical COPD questionnaire (CCQ) has been developed to measure the health status of COPD patients. The aim of this study was to translate CCQ into the Persian language and assess the validity and reliability of the translated version. We used a forward-backward procedure to translate the questionnaire. In a cross-sectional study 100 COPD patients and 50 healthy subjects over 40 years old were selected to assess the reliability and construct validity of the instrument. The face and content validity were used for the questionnaire validity. Validity was examined in a population of patients with COPD, using the Persian validated version of the St George's Respiratory Questionnaire (PSGRQ). In order to assess the questionnaire's reliability, the Intraclass correlation coefficient (ICC) and Cronbach's alpha were calculated. Test-retest reliability was tested by re-administering the Persian version of the CCQ (PCCQ) after 1 week. Test-retest carry out of data demonstrates that the PCCQ has excellent reliability (ICC for all 3 domains were higher than 0.9). Internal consistency was found by Cronbach's alpha to be 0.96, 0.94, 0.97, and 0.98 for the symptom, mental state, functional state and total scores respectively. In addition, the correlation between the components of PCCQ and PSGRQ showed satisfactory construct validity. Analyzing the data from healthy subjects and patients divulged that the PCCQ has acceptable discriminant validity. In general, the PCCQ had satisfactory reliability and validity for assessing health-related quality of life status of Iranian COPD patients.

[Design and validation of scales to measure adolescent attitude toward eating and toward physical activity].

PubMed

Lima-Serrano, Marta; Lima-Rodríguez, Joaquín Salvador; Sáez-Bueno, Africa

2012-01-01

Different authors suggest that attitude is a mediator in behavior change, so it is a predictor of behavior practice. The main of this study was to design and to validate two scales for measure adolescent attitude toward healthy eating and adolescent attitude toward healthy physical activity. Scales were design based on a literature review. After, they were validated using an on-line Delphi Panel with eighteen experts, a pretest, and a pilot test with a sample of 188 high school students. Comprehensibility, content validity, adequacy, as well as the reliability (alpha of Cronbach test), and construct validity (exploratory factor analysis) of scales were tested. Scales validated by experts were considered appropriate in the pretest. In the pilot test, the ten-item Attitude to Eating Scale obtained α=0.72. The eight-item Attitude to Physical Activity Scale obtained α=0.86. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The Scales showed their reliability and validity. They could be employed to assess attitude to these priority intervention areas in Spanish adolescents, and to evaluate this intermediate result of health interventions and health programs.

Validity, Reliability, and the Questionable Role of Psychometrics in Plastic Surgery

PubMed Central

2014-01-01

Summary: This report examines the meaning of validity and reliability and the role of psychometrics in plastic surgery. Study titles increasingly include the word “valid” to support the authors’ claims. Studies by other investigators may be labeled “not validated.” Validity simply refers to the ability of a device to measure what it intends to measure. Validity is not an intrinsic test property. It is a relative term most credibly assigned by the independent user. Similarly, the word “reliable” is subject to interpretation. In psychometrics, its meaning is synonymous with “reproducible.” The definitions of valid and reliable are analogous to accuracy and precision. Reliability (both the reliability of the data and the consistency of measurements) is a prerequisite for validity. Outcome measures in plastic surgery are intended to be surveys, not tests. The role of psychometric modeling in plastic surgery is unclear, and this discipline introduces difficult jargon that can discourage investigators. Standard statistical tests suffice. The unambiguous term “reproducible” is preferred when discussing data consistency. Study design and methodology are essential considerations when assessing a study’s validity. PMID:25289354

The Validation of a Case-Based, Cumulative Assessment and Progressions Examination

PubMed Central

Coker, Adeola O.; Copeland, Jeffrey T.; Gottlieb, Helmut B.; Horlen, Cheryl; Smith, Helen E.; Urteaga, Elizabeth M.; Ramsinghani, Sushma; Zertuche, Alejandra; Maize, David

2016-01-01

Objective. To assess content and criterion validity, as well as reliability of an internally developed, case-based, cumulative, high-stakes third-year Annual Student Assessment and Progression Examination (P3 ASAP Exam). Methods. Content validity was assessed through the writing-reviewing process. Criterion validity was assessed by comparing student scores on the P3 ASAP Exam with the nationally validated Pharmacy Curriculum Outcomes Assessment (PCOA). Reliability was assessed with psychometric analysis comparing student performance over four years. Results. The P3 ASAP Exam showed content validity through representation of didactic courses and professional outcomes. Similar scores on the P3 ASAP Exam and PCOA with Pearson correlation coefficient established criterion validity. Consistent student performance using Kuder-Richardson coefficient (KR-20) since 2012 reflected reliability of the examination. Conclusion. Pharmacy schools can implement internally developed, high-stakes, cumulative progression examinations that are valid and reliable using a robust writing-reviewing process and psychometric analyses. PMID:26941435

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed Central

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-01-01

Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain. PMID:29843496

Organizational member involvement in physical activity coalitions across the United States: development and testing of a novel survey instrument for assessing coalition functioning.

PubMed

Bornstein, Daniel B; Pate, Russell R; Beets, Michael W; Saunders, Ruth P; Blair, Steven N

2015-06-01

Coalitions are often composed of member organizations. Member involvement is thought to be associated with coalition success. No instrument currently exists for evaluating organizational member involvement in physical activity coalitions. This study aimed to develop a survey instrument for evaluating organizational member involvement in physical activity coalitions. The study was carried out in three phases: (a) developing a draft survey, (b) assessing the content validity of the draft survey, and (c) assessing the underlying factor structure, reliability, and validity of the survey. A cross-sectional design was employed. In Phase 1, a team of experts in survey development produced a draft survey. In Phase 2, the content validity of the draft survey was evaluated by a panel of individuals with expertise in physical activity coalitions. In Phase 3, the survey was administered to 120 individuals on local-, state-, and national-level physical activity coalitions. Responses were subjected to an exploratory factor analysis in order to determine the survey's underlying factor structure, reliability, and validity. Phases 1 and 2yielded a survey instrument with demonstrated content validity. Phase 3 yielded a three-factor model with three subscales: Strategic Alignment, Organizational Alignment, and Providing Input. Each subscale demonstrated high internal consistency reliability and construct validity. The survey instrument developed here demonstrated sound psychometric properties and provides new insight into organizational member involvement in physical activity coalitions. This instrument may be an important tool in developing a more complete picture of coalition functioning in physical activity coalitions specifically and health-based coalitions overall. © 2014 Society for Public Health Education.

Dynamic MRI to quantify musculoskeletal motion: A systematic review of concurrent validity and reliability, and perspectives for evaluation of musculoskeletal disorders

PubMed Central

Lempereur, Mathieu; Lelievre, Mathieu; Burdin, Valérie; Ben Salem, Douraied; Brochard, Sylvain

2017-01-01

Purpose To report evidence for the concurrent validity and reliability of dynamic MRI techniques to evaluate in vivo joint and muscle mechanics, and to propose recommendations for their use in the assessment of normal and impaired musculoskeletal function. Materials and methods The search was conducted on articles published in Web of science, PubMed, Scopus, Academic search Premier, and Cochrane Library between 1990 and August 2017. Studies that reported the concurrent validity and/or reliability of dynamic MRI techniques for in vivo evaluation of joint or muscle mechanics were included after assessment by two independent reviewers. Selected articles were assessed using an adapted quality assessment tool and a data extraction process. Results for concurrent validity and reliability were categorized as poor, moderate, or excellent. Results Twenty articles fulfilled the inclusion criteria with a mean quality assessment score of 66% (±10.4%). Concurrent validity and/or reliability of eight dynamic MRI techniques were reported, with the knee being the most evaluated joint (seven studies). Moderate to excellent concurrent validity and reliability were reported for seven out of eight dynamic MRI techniques. Cine phase contrast and real-time MRI appeared to be the most valid and reliable techniques to evaluate joint motion, and spin tag for muscle motion. Conclusion Dynamic MRI techniques are promising for the in vivo evaluation of musculoskeletal mechanics; however results should be evaluated with caution since validity and reliability have not been determined for all joints and muscles, nor for many pathological conditions. PMID:29232401

Clinical instruments: reliability and validity critical appraisal.

PubMed

Brink, Yolandi; Louw, Quinette A

2012-12-01

RATIONALE, AIM AND OBJECTIVES: There is a lack of health care practitioners using objective clinical tools with sound psychometric properties. There is also a need for researchers to improve their reporting of the validity and reliability results of these clinical tools. Therefore, to promote the use of valid and reliable tools or tests for clinical evaluation, this paper reports on the development of a critical appraisal tool to assess the psychometric properties of objective clinical tools. A five-step process was followed to develop the new critical appraisal tool: (1) preliminary conceptual decisions; (2) defining key concepts; (3) item generation; (4) assessment of face validity; and (5) formulation of the final tool. The new critical appraisal tool consists of 13 items, of which five items relate to both validity and reliability studies, four items to validity studies only and four items to reliability studies. The 13 items could be scored as 'yes', 'no' or 'not applicable'. This critical appraisal tool will aid both the health care practitioner to critically appraise the relevant literature and researchers to improve the quality of reporting of the validity and reliability of objective clinical tools. © 2011 Blackwell Publishing Ltd.

Assessment of a condition-specific quality-of-life measure for patients with developmentally absent teeth: validity and reliability testing.

PubMed

Akram, A J; Ireland, A J; Postlethwaite, K C; Sandy, J R; Jerreat, A S

2013-11-01

This article describes the process of validity and reliability testing of a condition-specific quality-of-life measure for patients with hypodontia presenting for orthodontic treatment. The development of the instrument is described in a previous article. Royal Devon and Exeter NHS Foundation Trust & Musgrove Park Hospital, Taunton. The child perception questionnaire was used as a standard against which to test criterion validity. The Bland and Altman method was used to check agreement between the two questionnaires. Construct validity was tested using principal component analysis on the four sections of the questionnaire. Test-retest reliability was tested using intraclass correlation coefficient and Bland and Altman method. Cronbach's alpha was used to test internal consistency reliability. Overall the questionnaire showed good reliability, criterion and construct validity. This together with previous evidence of good face and content validity suggests that the instrument may prove useful in clinical practice and further research. This study has demonstrated that the newly developed condition-specific quality-of-life questionnaire is both valid and reliable for use in young patients with hypodontia. © 2013 John Wiley & Sons A/S. Published by Blackwell Publishing Ltd.

Validity and reliability of a scale to measure genital body image.

PubMed

Zielinski, Ruth E; Kane-Low, Lisa; Miller, Janis M; Sampselle, Carolyn

2012-01-01

Women's body image dissatisfaction extends to body parts usually hidden from view--their genitals. Ability to measure genital body image is limited by lack of valid and reliable questionnaires. We subjected a previously developed questionnaire, the Genital Self Image Scale (GSIS) to psychometric testing using a variety of methods. Five experts determined the content validity of the scale. Then using four participant groups, factor analysis was performed to determine construct validity and to identify factors. Further construct validity was established using the contrasting groups approach. Internal consistency and test-retest reliability was determined. Twenty one of 29 items were considered content valid. Two items were added based on expert suggestions. Factor analysis was undertaken resulting in four factors, identified as Genital Confidence, Appeal, Function, and Comfort. The revised scale (GSIS-20) included 20 items explaining 59.4% of the variance. Women indicating an interest in genital cosmetic surgery exhibited significantly lower scores on the GSIS-20 than those who did not. The final 20 item scale exhibited internal reliability across all sample groups as well as test-retest reliability. The GSIS-20 provides a measure of genital body image demonstrating reliability and validity across several populations of women.

[The appraisal of reliability and validity of subjective workload assessment technique and NASA-task load index].

PubMed

Xiao, Yuan-mei; Wang, Zhi-ming; Wang, Mian-zhen; Lan, Ya-jia

2005-06-01

To test the reliability and validity of two mental workload assessment scales, i.e. subjective workload assessment technique (SWAT) and NASA task load index (NASA-TLX). One thousand two hundred and sixty-eight mental workers were sampled from various kinds of occupations, such as scientific research, education, administration and medicine, etc, with randomized cluster sampling. The re-test reliability, split-half reliability, Cronbach's alpha coefficient and correlation coefficients between item score and total score were adopted to test the reliability. The test of validity included structure validity. The re-test reliability coefficients of these two scales and their items were ranged from 0.516 to 0.753 (P < 0.01), indicating the two scales had good re-test reliability; the split-half reliability of SWAT was 0.645, and its Cronbach's alpha coefficient was more than 0.80, all the correlation coefficients between its items score and total score were more than 0.70; as for NASA-TLX, both the split-half reliability and Cronbach's alpha coefficient were more than 0.80, the correlation coefficients between its items score and total score were all more than 0.60 (P < 0.01) except the item of performance. Both scales had good inner consistency. The Pearson correlation coefficient between the two scales was 0.492 (P < 0.01), implying the results of the two scales had good consistency. Factor analysis showed that the two scales had good structure validity. Both SWAT and NASA-TLX have good reliability and validity and may be used as a valid tool to assess mental workload in China after being revised properly.

Assessing the validity and reliability of the Pool Activity Level (PAL) Checklist for use with older people with dementia.

PubMed

Wenborn, Jennifer; Challis, David; Pool, Jackie; Burgess, Jane; Elliott, Nicola; Orrell, Martin

2008-03-01

Activity is key to maintaining physical and mental health and well-being. However, as dementia affects the ability to engage in activity, care-givers can find it difficult to provide appropriate activities. The Pool Activity Level (PAL) Checklist guides the selection of appropriate, personally meaningful activities. The aim of this study was to assess the reliability and validity of the PAL Checklist when used with older people with dementia. A postal questionnaire sent to activity providers assessed content validity. Validity and reliability were measured in a sample of 60 older people with dementia. The questionnaire response rate was 83% (102/122). Most respondents felt no important items were missing. Seven of the nine activities were ranked as 'very important' or 'essential' by at least 77% of the sample, indicating very good content validity. Correlation with measures of cognition, severity of dementia and activity performance demonstrated strong concurrent validity. Inter-item correlation indicated strong construct validity. Cronbach's alpha coefficient measured internal consistency as excellent (0.95). All items achieved acceptable test-retest reliability, and the majority demonstrated acceptable inter-rater reliability. We conclude that the PAL Checklist demonstrates adequate validity and reliability when used with older people with dementia and appears a useful tool for a variety of care settings.

Validity and test-retest reliability in assessing current body size with figure drawings in Chinese adolescents.

PubMed

Lo, Wing-Sze; Ho, Sai-Yin; Wong, Bonny Yee-Man; Mak, Kwok-Kei; Lam, Tai-Hing

2011-06-01

The reliability and validity of Stunkard's Figure Rating Scale (FRS) as a measure of current body size (CBS) was established in Western adolescent girls but not in non-Western population. We examined the validity and test-retest reliability of Stunkard's FRS in assessing CBS among Chinese adolescents. Methods. In a school-based survey in Hong Kong, 5666 adolescents (boys: 45.1%; mean age 14.7 years) provided data on self-reported height and weight, CBS, perceived weight status, and health-related quality of life using the Medical Outcomes Study Short-Form version 2 (SF-12v2). Height and weight were also objectively measured. Spearman's correlation was used to assess construct validity, concurrent validity and test-retest reliability. Convergent and discriminant validity were good: CBS correlated strongly with weight and self-reported/measured BMI, but only weakly with SF-12v2. CBS correlated strongly with perceived weight status, showing concurrent validity. Spearman's correlation (r) for CBS was 0.78 for girls and 0.72 for boys indicating good test-retest reliability. Validity and reliability results did not differ significantly between senior and junior grade adolescents. Our findings support the use of Stunkard's FRS to measure body size among Chinese adolescents.

A systematic review of the reliability and validity of discrete choice experiments in valuing non-market environmental goods.

PubMed

Rakotonarivo, O Sarobidy; Schaafsma, Marije; Hockley, Neal

2016-12-01

While discrete choice experiments (DCEs) are increasingly used in the field of environmental valuation, they remain controversial because of their hypothetical nature and the contested reliability and validity of their results. We systematically reviewed evidence on the validity and reliability of environmental DCEs from the past thirteen years (Jan 2003-February 2016). 107 articles met our inclusion criteria. These studies provide limited and mixed evidence of the reliability and validity of DCE. Valuation results were susceptible to small changes in survey design in 45% of outcomes reporting reliability measures. DCE results were generally consistent with those of other stated preference techniques (convergent validity), but hypothetical bias was common. Evidence supporting theoretical validity (consistency with assumptions of rational choice theory) was limited. In content validity tests, 2-90% of respondents protested against a feature of the survey, and a considerable proportion found DCEs to be incomprehensible or inconsequential (17-40% and 10-62% respectively). DCE remains useful for non-market valuation, but its results should be used with caution. Given the sparse and inconclusive evidence base, we recommend that tests of reliability and validity are more routinely integrated into DCE studies and suggest how this might be achieved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

An exploratory study into the effect of time-restricted internet access on face-validity, construct validity and reliability of postgraduate knowledge progress testing

PubMed Central

2013-01-01

Background Yearly formative knowledge testing (also known as progress testing) was shown to have a limited construct-validity and reliability in postgraduate medical education. One way to improve construct-validity and reliability is to improve the authenticity of a test. As easily accessible internet has become inseparably linked to daily clinical practice, we hypothesized that allowing internet access for a limited amount of time during the progress test would improve the perception of authenticity (face-validity) of the test, which would in turn improve the construct-validity and reliability of postgraduate progress testing. Methods Postgraduate trainees taking the yearly knowledge progress test were asked to participate in a study where they could access the internet for 30 minutes at the end of a traditional pen and paper test. Before and after the test they were asked to complete a short questionnaire regarding the face-validity of the test. Results Mean test scores increased significantly for all training years. Trainees indicated that the face-validity of the test improved with internet access and that they would like to continue to have internet access during future testing. Internet access did not improve the construct-validity or reliability of the test. Conclusion Improving the face-validity of postgraduate progress testing, by adding the possibility to search the internet for a limited amount of time, positively influences test performance and face-validity. However, it did not change the reliability or the construct-validity of the test. PMID:24195696

A multiple-feature and multiple-kernel scene segmentation algorithm for humanoid robot.

PubMed

Liu, Zhi; Xu, Shuqiong; Zhang, Yun; Chen, Chun Lung Philip

2014-11-01

This technical correspondence presents a multiple-feature and multiple-kernel support vector machine (MFMK-SVM) methodology to achieve a more reliable and robust segmentation performance for humanoid robot. The pixel wise intensity, gradient, and C1 SMF features are extracted via the local homogeneity model and Gabor filter, which would be used as inputs of MFMK-SVM model. It may provide multiple features of the samples for easier implementation and efficient computation of MFMK-SVM model. A new clustering method, which is called feature validity-interval type-2 fuzzy C-means (FV-IT2FCM) clustering algorithm, is proposed by integrating a type-2 fuzzy criterion in the clustering optimization process to improve the robustness and reliability of clustering results by the iterative optimization. Furthermore, the clustering validity is employed to select the training samples for the learning of the MFMK-SVM model. The MFMK-SVM scene segmentation method is able to fully take advantage of the multiple features of scene image and the ability of multiple kernels. Experiments on the BSDS dataset and real natural scene images demonstrate the superior performance of our proposed method.

The Reliability and Validity of Zimbardo Time Perspective Inventory Scores in Academically Talented Adolescents

ERIC Educational Resources Information Center

Worrell, Frank C.; Mello, Zena R.

2007-01-01

In this study, the authors examined the reliability, structural validity, and concurrent validity of Zimbardo Time Perspective Inventory (ZTPI) scores in a group of 815 academically talented adolescents. Reliability estimates of the purported factors' scores were in the low to moderate range. Exploratory factor analysis supported a five-factor…

Reliability and Validity of Information about Student Achievement: Comparing Large-Scale and Classroom Testing Contexts

ERIC Educational Resources Information Center

Cizek, Gregory J.

2009-01-01

Reliability and validity are two characteristics that must be considered whenever information about student achievement is collected. However, those characteristics--and the methods for evaluating them--differ in large-scale testing and classroom testing contexts. This article presents the distinctions between reliability and validity in the two…

Investigating Postgraduate College Admission Interviews: Generalizability Theory Reliability and Incremental Predictive Validity

ERIC Educational Resources Information Center

Arce-Ferrer, Alvaro J.; Castillo, Irene Borges

2007-01-01

The use of face-to-face interviews is controversial for college admissions decisions in light of the lack of availability of validity and reliability evidence for most college admission processes. This study investigated reliability and incremental predictive validity of a face-to-face postgraduate college admission interview with a sample of…

An Integrated Approach to Establish Validity and Reliability of Reading Tests

ERIC Educational Resources Information Center

Razi, Salim

2012-01-01

This study presents the processes of developing and establishing reliability and validity of a reading test by administering an integrative approach as conventional reliability and validity measures superficially reveals the difficulty of a reading test. In this respect, analysing vocabulary frequency of the test is regarded as a more eligible way…

A Validity and Reliability Update on the Informal Reading Inventory with Suggestions for Improvement.

ERIC Educational Resources Information Center

Klesius, Janell P.; Homan, Susan P.

1985-01-01

The article reviews validity and reliability studies on the informal reading inventory, a diagnostic instrument to identify reading grade-level placement and strengths and weaknesses in work recognition and comprehension. Gives suggestions to improve the validity and reliability of existing inventories and to evaluate them in newly published…

Validity and reliability of the Diagnostic Adaptive Behaviour Scale.

PubMed

Tassé, M J; Schalock, R L; Balboni, G; Spreat, S; Navas, P

2016-01-01

The Diagnostic Adaptive Behaviour Scale (DABS) is a new standardised adaptive behaviour measure that provides information for evaluating limitations in adaptive behaviour for the purpose of determining a diagnosis of intellectual disability. This article presents validity evidence and reliability data for the DABS. Validity evidence was based on comparing DABS scores with scores obtained on the Vineland Adaptive Behaviour Scale, second edition. The stability of the test scores was measured using a test and retest, and inter-rater reliability was assessed by computing the inter-respondent concordance. The DABS convergent validity coefficients ranged from 0.70 to 0.84, while the test-retest reliability coefficients ranged from 0.78 to 0.95, and the inter-rater concordance as measured by intraclass correlation coefficients ranged from 0.61 to 0.87. All obtained validity and reliability indicators were strong and comparable with the validity and reliability coefficients of the most commonly used adaptive behaviour instruments. These results and the advantages of the DABS for clinician and researcher use are discussed. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

[Reliability and validity of Driving Anger Scale in professional drivers in China].

PubMed

Li, Z; Yang, Y M; Zhang, C; Li, Y; Hu, J; Gao, L W; Zhou, Y X; Zhang, X J

2017-11-10

Objective: To assess the reliability and validity of the Chinese version of Driving Anger Scale (DAS) in professional drivers in China and provide a scientific basis for the application of the scale in drivers in China. Methods: Professional drivers, including taxi drivers, bus drivers, truck drivers and school bus drivers, were selected to complete the questionnaire. Cronbach's α and split-half reliability were calculated to evaluate the reliability of DAS, and content, contract, discriminant and convergent validity were performed to measure the validity of the scale. Results: The overall Cronbach's α of DAS was 0.934 and the split-half reliability was 0.874. The correlation coefficient of each subscale with the total scale was 0.639-0.922. The simplified version of DAS supported a presupposed six-factor structure, explaining 56.371% of the total variance revealed by exploratory factor analysis. The DAS had good convergent and discriminant validity, with the success rate of calibration experiment of 100%. Conclusion: DAS has a good reliability and validity in professional drivers in China, and the use of DAS is worth promoting in divers.

The Koukopoulos Mixed Depression Rating Scale (KMDRS): An International Mood Network (IMN) validation study of a new mixed mood rating scale.

PubMed

Sani, Gabriele; Vöhringer, Paul A; Barroilhet, Sergio A; Koukopoulos, Alexia E; Ghaemi, S Nassir

2018-05-01

It has been proposed that the broad major depressive disorder (MDD) construct is heterogenous. Koukopoulos has provided diagnostic criteria for an important subtype within that construct, "mixed depression" (MxD), which encompasses clinical pictures characterized by marked psychomotor or inner excitation and rage/anger, along with severe depression. This study provides psychometric validation for the first rating scale specifically designed to assess MxD symptoms cross-sectionally, the Koukopoulos Mixed Depression Rating Scale (KMDRS). 350 patients from the international mood network (IMN) completed three rating scales: the KMDRS, Montgomery-Asberg Depression Rating Scale (MADRS) and Young Mania Rating Scale (YMRS). KMDRS' psychometric properties assessed included Cronbach's alpha, inter-rater reliability, factor analysis, predictive validity, and Receiver Operator Curve analysis. Internal consistency (Cronbach's alpha = 0.76; 95% CI 0.57, 0.94) and interrater reliability (kappa = 0.73) were adequate. Confirmatory factor analysis identified 2 components: anger and psychomotor excitation (80% of total variance). Good predictive validity was seen (C-statistic = 0.82 95% CI 0.68, 0.93). Severity cut-off scores identified were as follows: none (0-4), possible (5-9), mild (10-15), moderate (16-20) and severe (> 21) MxD. Non DSM-based diagnosis of MxD may pose some difficulties in the initial use and interpretation of the scoring of the scale. Moreover, the cross-sectional nature of the evaluation does not verify the long-term stability of the scale. KMDRS was a reliable and valid instrument to assess MxD symptoms. Copyright © 2018 Elsevier B.V. All rights reserved.

Developing and investigating the use of single-item measures in organizational research.

PubMed

Fisher, Gwenith G; Matthews, Russell A; Gibbons, Alyssa Mitchell

2016-01-01

The validity of organizational research relies on strong research methods, which include effective measurement of psychological constructs. The general consensus is that multiple item measures have better psychometric properties than single-item measures. However, due to practical constraints (e.g., survey length, respondent burden) there are situations in which certain single items may be useful for capturing information about constructs that might otherwise go unmeasured. We evaluated 37 items, including 18 newly developed items as well as 19 single items selected from existing multiple-item scales based on psychometric characteristics, to assess 18 constructs frequently measured in organizational and occupational health psychology research. We examined evidence of reliability; convergent, discriminant, and content validity assessments; and test-retest reliabilities at 1- and 3-month time lags for single-item measures using a multistage and multisource validation strategy across 3 studies, including data from N = 17 occupational health subject matter experts and N = 1,634 survey respondents across 2 samples. Items selected from existing scales generally demonstrated better internal consistency reliability and convergent validity, whereas these particular new items generally had higher levels of content validity. We offer recommendations regarding when use of single items may be more or less appropriate, as well as 11 items that seem acceptable, 14 items with mixed results that might be used with caution due to mixed results, and 12 items we do not recommend using as single-item measures. Although multiple-item measures are preferable from a psychometric standpoint, in some circumstances single-item measures can provide useful information. (c) 2016 APA, all rights reserved).

The reliability and validity of a sexual functioning questionnaire.

PubMed

Corty, E W; Althof, S E; Kurit, D M

1996-01-01

The present study assessed the reliability and validity of a measure of sexual functioning, the CMSH-SFQ, for male patients and their partners. The CMSH-SFQ measures erectile and orgasmic functioning, sexual drive, frequency of sexual behavior, and sexual satisfaction. Test-retest reliability was assessed with 19 males and 19 females for the baseline CMSH-SFQ. Criterion validity was measured by comparing the answers of 25 male patients to those of their partners at baseline and follow-up. The majority of items had acceptable levels of reliability and validity. The CMSH-SFQ provides a reliable and valid device that can be used to measure global sexual functioning in men and their partners and may be used to evaluate the efficacy of treatments for sexual dysfunctions. Limitations and suggestions for use of the CMSH-SFQ are addressed.

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Assessing guilt toward the former spouse.

PubMed

Wietzker, Anne; Buysse, Ann

2012-09-01

Divorce is often accompanied by feelings of guilt toward the former spouse. So far, no scale has been available to measure such feelings. For this purpose, the authors developed the Guilt in Separation Scale (GiSS). Content validity was assured by using experts and lay experts to generate and select items. Exploratory analyses were run on samples of 214 divorced individuals and confirmatory analyses on 458 individuals who were in the process of divorcing. Evidence was provided for the reliability and construct validity of the GiSS. The internal consistency was high (α = .91), as were the 6-month and 12-month test-retest reliabilities (r = .72 and r = .76, respectively). The GiSS was related to shame, regret, compassion, locus of cause of the separation, unfaithfulness, and psychological functioning. PsycINFO Database Record (c) 2012 APA, all rights reserved.

The validity and reliability of the English version of the diabetes distress scale for type 2 diabetes patients in Malaysia.

PubMed

Chin, Ying Woei; Lai, Pauline Siew Mei; Chia, Yook Chin

2017-02-20

Several disease specific instruments have been developed to identify and assess diabetes distress. In Malaysia, the Problem Areas in Diabetes Scale has been validated in Malay, but it does not have specific domains to assess the different areas of diabetes-related distress. Hence, we decided to use the Diabetes Distress Scale instead. To date, only the Malay version of the Diabetes Distress Scale has been validated in Malaysia. However, English is widely spoken by Malaysians, and is an important second language in Malaysia. Therefore, our aim was to determine the validity and reliability of the English version of the Diabetes Distress Scale among patients with type 2 diabetes in Malaysia. The Diabetes Distress Scale was administered to 114 patients with type 2 diabetes, who could understand English, at baseline and 4 weeks later, at a primary care clinic in Malaysia. To assess for convergent validity, the Depression Anxiety Stress Scale was administered at baseline. Discriminative validity was assessed by analysing the total diabetes distress scores of participants with poor (Hb A1c  > 7.0%) and good glycaemic control (Hb A1c  ≤ 7.0%). The majority of our participants were male 65(57.0%), with a median duration of diabetes of 9.5 years. Exploratory factor analysis showed that the Diabetes Distress Scale had 4 subscales, as per the original Diabetes Distress Scale. The overall Cronbach's α was 0.920 (range = 0.784-0.859 for each subscale). The intraclass correlation ranged from 0.436 to 0.643 for test-retest. The Diabetes Distress Scale subscales were significantly correlated with the different subscales of the Depression Anxiety Stress Scale (spearman's rho range = 0.427-0.509, p < 0.001). Patients with poor glycaemic control had significantly higher diabetes distress score (1.88) compared to those with good glycaemic control (1.50) (p < 0.001). The English version of the Diabetes Distress Scale was found to be a valid and reliable instrument to evaluate diabetes distress among patients with type 2 diabetes in Malaysia. It can be used in clinical practice to offer a useful indicator of the effect of diabetes-induced distress during clinic visits, especially for patients with poor glycemic control. This would ensure that these patients are provided the care that is required.

Measuring teacher self-report on classroom practices: Construct validity and reliability of the Classroom Strategies Scale-Teacher Form.

PubMed

Reddy, Linda A; Dudek, Christopher M; Fabiano, Gregory A; Peters, Stephanie

2015-12-01

This article presents information about the construct validity and reliability of a new teacher self-report measure of classroom instructional and behavioral practices (the Classroom Strategies Scales-Teacher Form; CSS-T). The theoretical underpinnings and empirical basis for the instructional and behavioral management scales are presented. Information is provided about the construct validity, internal consistency, test-retest reliability, and freedom from item-bias of the scales. Given previous investigations with the CSS Observer Form, it was hypothesized that internal consistency would be adequate and that confirmatory factor analyses (CFA) of CSS-T data from 293 classrooms would offer empirical support for the CSS-T's Total, Composite and subscales, and yield a similar factor structure to that of the CSS Observer Form. Goodness-of-fit indices of χ2/df, Root Mean Square Error of Approximation, Goodness of Fit Index, and Adjusted Goodness of Fit Index suggested satisfactory fit of proposed CFA models whereas the Comparative Fit Index did not. Internal consistency estimates of .93 and .94 were obtained for the Instructional Strategies and Behavioral Strategies Total scales respectively. Adequate test-retest reliability was found for instructional and behavioral total scales (r = .79, r = .84, percent agreement 93% and 93%). The CSS-T evidences freedom from item bias on important teacher demographics (age, educational degree, and years of teaching experience). Implications of results are discussed. (c) 2015 APA, all rights reserved).

Validation of the breast evaluation questionnaire for breast hypertrophy and breast reduction.

PubMed

Lewin, Richard; Elander, Anna; Lundberg, Jonas; Hansson, Emma; Thorarinsson, Andri; Claudelin, Malin; Bladh, Helena; Lidén, Mattias

2018-06-13

There is a lack of published, validated questionnaires for evaluating psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. To validate the breast evaluation questionnaire (BEQ), originally developed for the assessment of breast augmentation patients, for the assessment of psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. Validation study Subjects: Women with macromastia Methods: The validation of the BEQ, adapted to breast reduction, was performed in several steps. Content validity, reliability, construct validity and responsiveness were assessed. The original version was adjusted according to the results for content validity and resulted in item reduction and a modified BEQ (mBEQ) that was then assessed for reliability, construct validity and responsiveness. Internal and external validation was performed for the modified BEQ. Convergent validity was tested against Breast-Q (reduction) and discriminate validity was tested against the SF-36. Known-groups validation revealed significant differences between the normal population and patients undergoing breast reduction surgery. The BEQ showed good reliability by test-re-test analysis and high responsiveness. The modified BEQ may be reliable, valid and responsive instrument for assessing women who undergo breast reduction.

Development and evaluation of oral Cancer quality-of-life questionnaire (QOL-OC).

PubMed

Nie, Min; Liu, Chang; Pan, Yi-Chen; Jiang, Chen-Xi; Li, Bao-Ru; Yu, Xi-Jie; Wu, Xin-Yu; Zheng, Shu-Ning

2018-05-03

In this study scales and items for the Oral Cancer Quality-of-life Questionnaire (QOL-OC) were designed and the instrument was evaluated. The QOL-OC was developed and modified using the international definition of quality of life (QOL) promulgated by the European Organization for Research and Treatment of Cancer (EORTC) and analysis of the precedent measuring instruments. The contents of each item were determined in the context of the specific characteristics of oral cancer. Two hundred thirteen oral cancer patients were asked to complete both the EORTC core quality of life questionnaire (EORTC QLC-C30) and the QOL-OC. Data collected was used to conduct factor analysis, test-retest reliability, internal consistency, and construct validity. Questionnaire compliance was relatively high. Fourteen of the 213 subjects accepted the same tests after 24 to 48 h demonstrating a high test-retest reliability for all five scales. Overall internal consistency surpasses 0.8. The outcome of the factor analysis coincides substantially with our theoretical conception. Each item shows a higher correlation coefficient within its own scale than the others which indicates high construct validity. QOL-OC demonstrates fairly good statistical reliability, validity, and feasibility. However, further tests and modification are needed to ensure its applicability to the quality-of-life assessment of Chinese oral cancer patients.

Reliability and validity of the test of incremental respiratory endurance measures of inspiratory muscle performance in COPD.

PubMed

Formiga, Magno F; Roach, Kathryn E; Vital, Isabel; Urdaneta, Gisel; Balestrini, Kira; Calderon-Candelario, Rafael A; Campos, Michael A; Cahalin, Lawrence P

2018-01-01

The Test of Incremental Respiratory Endurance (TIRE) provides a comprehensive assessment of inspiratory muscle performance by measuring maximal inspiratory pressure (MIP) over time. The integration of MIP over inspiratory duration (ID) provides the sustained maximal inspiratory pressure (SMIP). Evidence on the reliability and validity of these measurements in COPD is not currently available. Therefore, we assessed the reliability, responsiveness and construct validity of the TIRE measures of inspiratory muscle performance in subjects with COPD. Test-retest reliability, known-groups and convergent validity assessments were implemented simultaneously in 81 male subjects with mild to very severe COPD. TIRE measures were obtained using the portable PrO2 device, following standard guidelines. All TIRE measures were found to be highly reliable, with SMIP demonstrating the strongest test-retest reliability with a nearly perfect intraclass correlation coefficient (ICC) of 0.99, while MIP and ID clustered closely together behind SMIP with ICC values of about 0.97. Our findings also demonstrated known-groups validity of all TIRE measures, with SMIP and ID yielding larger effect sizes when compared to MIP in distinguishing between subjects of different COPD status. Finally, our analyses confirmed convergent validity for both SMIP and ID, but not MIP. The TIRE measures of MIP, SMIP and ID have excellent test-retest reliability and demonstrated known-groups validity in subjects with COPD. SMIP and ID also demonstrated evidence of moderate convergent validity and appear to be more stable measures in this patient population than the traditional MIP.

The reliability and validity of ultrasound to quantify muscles in older adults: a systematic review

PubMed Central

Scafoglieri, Aldo; Jager‐Wittenaar, Harriët; Hobbelen, Johannes S.M.; van der Schans, Cees P.

2017-01-01

Abstract This review evaluates the reliability and validity of ultrasound to quantify muscles in older adults. The databases PubMed, Cochrane, and Cumulative Index to Nursing and Allied Health Literature were systematically searched for studies. In 17 studies, the reliability (n = 13) and validity (n = 8) of ultrasound to quantify muscles in community‐dwelling older adults (≥60 years) or a clinical population were evaluated. Four out of 13 reliability studies investigated both intra‐rater and inter‐rater reliability. Intraclass correlation coefficient (ICC) scores for reliability ranged from −0.26 to 1.00. The highest ICC scores were found for the vastus lateralis, rectus femoris, upper arm anterior, and the trunk (ICC = 0.72 to 1.000). All included validity studies found ICC scores ranging from 0.92 to 0.999. Two studies describing the validity of ultrasound to predict lean body mass showed good validity as compared with dual‐energy X‐ray absorptiometry (r 2 = 0.92 to 0.96). This systematic review shows that ultrasound is a reliable and valid tool for the assessment of muscle size in older adults. More high‐quality research is required to confirm these findings in both clinical and healthy populations. Furthermore, ultrasound assessment of small muscles needs further evaluation. Ultrasound to predict lean body mass is feasible; however, future research is required to validate prediction equations in older adults with varying function and health. PMID:28703496

Reliability and concurrent and construct validity of the Strategies for Weight Management measure for adults.

PubMed

Kolodziejczyk, Julia K; Norman, Gregory J; Rock, Cheryl L; Arredondo, Elva M; Roesch, Scott C; Madanat, Hala; Patrick, Kevin

2016-01-01

This study evaluates the reliability and validity of the strategies for weight management (SWM) measure, a questionnaire that assesses weight management strategies for adults. The SWM includes 20 items that are categorized within the following subscales: (1) energy intake, (2) energy expenditure, (3) self-monitoring, and (4) self-regulation. Baseline and 6-month data were collected from 404 overweight/obese adults (mean age=22±3.8 years, 68% ethnic minority) enrolled in a randomized controlled trial aiming to reduce weight by improving diet and physical activity behaviours. Reliability and validity were assessed for each subscale separately. Cronbach alpha was conducted to assess reliability. Concurrent, construct I (sensitivity to the study treatment condition), and construct II (relationship to the outcomes) validity were assessed using linear regressions with the following outcome measures: weight, self-reported diet, and weekly energy expenditure. All subscales showed strong internal consistency. The strength of the validity evidence depended on subscale and validity type. The strongest validity evidence was concurrent validity of the energy intake and energy expenditure subscales; construct I validity of the energy intake and self-monitoring subscales; and construct II validity of the energy intake, energy expenditure, and self-regulation subscales. Results indicate that the SWM can be used to assess weight management strategies among an ethnically diverse sample of adults as each subscale showed evidence of reliability and select types of validity. As validity is an accumulation of evidence over multiple studies, this study provides initial reliability and validity evidence in one population segment. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

[Reliability and validity of the Chinese version on Alcohol Use Disorders Identification Test].

PubMed

Zhang, C; Yang, G P; Li, Z; Li, X N; Li, Y; Hu, J; Zhang, F Y; Zhang, X J

2017-08-10

Objective: To assess the reliability and validity of the Chinese version on Alcohol Use Disorders Identification Test (AUDIT) among medical students in China and to provide correct way of application on the recommended scales. Methods: An E-questionnaire was developed and sent to medical students in five different colleges. Students were all active volunteers to accept the testings. Cronbach's α and split-half reliability were calculated to evaluate the reliability of AUDIT while content, contract, discriminant and convergent validity were performed to measure the validity of the scales. Results: The overall Cronbach's α of AUDIT was 0.782 and the split-half reliability was 0.711. Data showed that the domain Cronbach's α and split-half reliability were 0.796 and 0.794 for hazardous alcohol use, 0.561 and 0.623 for dependence symptoms, and 0.647 and 0.640 for harmful alcohol use. Results also showed that the content validity index on the levels of items I-CVI) were from 0.83 to 1.00, the content validity index of scale level (S-CVI/UA) was 0.90, content validity index of average scale level (S-CVI/Ave) was 0.99 and the content validity ratios (CVR) were from 0.80 to 1.00. The simplified version of AUDIT supported a presupposed three-factor structure which could explain 61.175% of the total variance revealed through exploratory factor analysis. AUDIT semed to have good convergent and discriminant validity, with the success rate of calibration experiment as 100%. Conclusion: AUDIT showed good reliability and validity among medical students in China thus worth for promotion on its use.

Lifetime prediction and reliability estimation methodology for Stirling-type pulse tube refrigerators by gaseous contamination accelerated degradation testing

NASA Astrophysics Data System (ADS)

Wan, Fubin; Tan, Yuanyuan; Jiang, Zhenhua; Chen, Xun; Wu, Yinong; Zhao, Peng

2017-12-01

Lifetime and reliability are the two performance parameters of premium importance for modern space Stirling-type pulse tube refrigerators (SPTRs), which are required to operate in excess of 10 years. Demonstration of these parameters provides a significant challenge. This paper proposes a lifetime prediction and reliability estimation method that utilizes accelerated degradation testing (ADT) for SPTRs related to gaseous contamination failure. The method was experimentally validated via three groups of gaseous contamination ADT. First, the performance degradation model based on mechanism of contamination failure and material outgassing characteristics of SPTRs was established. Next, a preliminary test was performed to determine whether the mechanism of contamination failure of the SPTRs during ADT is consistent with normal life testing. Subsequently, the experimental program of ADT was designed for SPTRs. Then, three groups of gaseous contamination ADT were performed at elevated ambient temperatures of 40 °C, 50 °C, and 60 °C, respectively and the estimated lifetimes of the SPTRs under normal condition were obtained through acceleration model (Arrhenius model). The results show good fitting of the degradation model with the experimental data. Finally, we obtained the reliability estimation of SPTRs through using the Weibull distribution. The proposed novel methodology enables us to take less than one year time to estimate the reliability of the SPTRs designed for more than 10 years.

The Queensland high risk foot form (QHRFF) – is it a reliable and valid clinical research tool for foot disease?

PubMed Central

2014-01-01

Background Foot disease complications, such as foot ulcers and infection, contribute to considerable morbidity and mortality. These complications are typically precipitated by “high-risk factors”, such as peripheral neuropathy and peripheral arterial disease. High-risk factors are more prevalent in specific “at risk” populations such as diabetes, kidney disease and cardiovascular disease. To the best of the authors’ knowledge a tool capturing multiple high-risk factors and foot disease complications in multiple at risk populations has yet to be tested. This study aimed to develop and test the validity and reliability of a Queensland High Risk Foot Form (QHRFF) tool. Methods The study was conducted in two phases. Phase one developed a QHRFF using an existing diabetes foot disease tool, literature searches, stakeholder groups and expert panel. Phase two tested the QHRFF for validity and reliability. Four clinicians, representing different levels of expertise, were recruited to test validity and reliability. Three cohorts of patients were recruited; one tested criterion measure reliability (n = 32), another tested criterion validity and inter-rater reliability (n = 43), and another tested intra-rater reliability (n = 19). Validity was determined using sensitivity, specificity and positive predictive values (PPV). Reliability was determined using Kappa, weighted Kappa and intra-class correlation (ICC) statistics. Results A QHRFF tool containing 46 items across seven domains was developed. Criterion measure reliability of at least moderate categories of agreement (Kappa > 0.4; ICC > 0.75) was seen in 91% (29 of 32) tested items. Criterion validity of at least moderate categories (PPV > 0.7) was seen in 83% (60 of 72) tested items. Inter- and intra-rater reliability of at least moderate categories (Kappa > 0.4; ICC > 0.75) was seen in 88% (84 of 96) and 87% (20 of 23) tested items respectively. Conclusions The QHRFF had acceptable validity and reliability across the majority of items; particularly items identifying relevant co-morbidities, high-risk factors and foot disease complications. Recommendations have been made to improve or remove identified weaker items for future QHRFF versions. Overall, the QHRFF possesses suitable practicality, validity and reliability to assess and capture relevant foot disease items across multiple at risk populations. PMID:24468080

Cross-cultural validation of the 20-item Toronto Alexithymia Scale in Chinese adolescents.

PubMed

Ling, Y; Zeng, Y; Yuan, H; Zhong, M

2016-04-01

WHAT IS KNOWN ON THE SUBJECT?: The TAS-20 is the most widely used self-reported questionnaire to assess the level of alexithymia in students and community and clinical samples. WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: The TAS-20-C exhibited high levels of reliability and validity, indicating that it is appropriate for the assessment of alexithymia in Chinese adolescents. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Screening adolescents who are at risk of alexithymia through the TAS-20 could help to perform necessary and effective precautions to decrease the adverse effects of alexithymia, such as the risks of developing depressive mood and behavioral problems. Purpose The aim of this study was to examine the psychometric properties of the Chinese version of the 20-item Toronto Alexithymia Scale (TAS-20-C) in a sample of Chinese adolescents. Method Adolescents (n = 1260) recruited from three schools in mainland China completed the TAS-20-C, the somatization subscale of the Symptom Checklist 90 (SCL-90) and Center for Epidemiological Studies Depression Scale (CES-D). Five different factorial models of the TAS-20 were tested using confirmatory factor analysis (CFA). Cronbach's α, mean inter-item correlations and predictive validity were also evaluated. Results Among those five different factorial models, the four-factor structure model was suitable and invariant across gender and age in this sample. The TAS-20-C demonstrated adequate internal reliability. Gender and age accounted for insignificant amounts of variability in total TAS-20-C and factor scores. TAS-20-C total and subscale scores were correlated significantly with SCL-90 somatization subscale and CES-D. Girls scored higher than boys on difficulty identifying feelings (DIF) and pragmatic thinking (PR) subscales. DIF and lack of subjective significance or importance of emotions (IMs) subscale scores were higher among younger than among middle and older adolescents. Implications for Practice Validating the TAS-20 in adolescents is quite important to use it in evaluating adolescents' alexithymia, and screen those at risk of alexithymia. © 2016 John Wiley & Sons Ltd.

Construction of Valid and Reliable Test for Assessment of Students

ERIC Educational Resources Information Center

Osadebe, P. U.

2015-01-01

The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

Validity and Reliability of a Medicine Ball Explosive Power Test.

ERIC Educational Resources Information Center

Stockbrugger, Barry A.; Haennel, Robert G.

2001-01-01

Evaluated the validity and reliability of a medicine ball throw test to evaluate explosive power. Data on competitive sand volleyball players who performed a medicine ball throw and a standard countermovement jump indicated that the medicine ball throw test was a valid and reliable way to assess explosive power for an analogous total-body movement…

The Validity and Reliability of the Mobbing Scale (MS)

ERIC Educational Resources Information Center

Yaman, Erkan

2009-01-01

The aim of this research is to develop the Mobbing Scale and examine its validity and reliability. The sample of the study consisted of 515 persons from Sakarya and Bursa. In this study, construct validity, internal consistency, test-retest reliability, and item analysis of the scale were examined. As a result of factor analysis for construct…

Reliability and Validity of the Devereux Early Childhood Assessment (DECA) as a Function of Parent and Teacher Ratings

ERIC Educational Resources Information Center

Barbu, Otilia C.; Levine-Donnerstein, Deborah; Marx, Ronald W.; Yaden, David B., Jr.

2013-01-01

This study examined reliability and validity of the Devereux Early Childhood Assessment (DECA), based on samples of parents and teachers' ratings of 1,145 entering kindergartners in the Southwest. Confirmatory factor analysis showed that DECA presented good reliability and validity for manifest variables, corroborating previous findings. Three…

Convergence among Data Sources, Response Bias, and Reliability and Validity of a Structured Job Analysis Questionnaire.

ERIC Educational Resources Information Center

Smith, Jack E.; Hakel, Milton D.

1979-01-01

Examined are questions pertinent to the use of the Position Analysis Questionnaire: Who can use the PAQ reliably and validly? Must one rely on trained job analysts? Can people having no direct contact with the job use the PAQ reliably and validly? Do response biases influence PAQ responses? (Author/KC)

Validity and Reliability of the Arabic Token Test for Children

ERIC Educational Resources Information Center

Alkhamra, Rana A.; Al-Jazi, Aya B.

2016-01-01

Background: The Token Test for Children (2nd edition) (TTFC) is a measure for assessing receptive language. In this study we describe the translation process, validity and reliability of the Arabic Token Test for Children (A-TTFC). Aims: The aim of this study is to translate, validate and establish the reliability of the Arabic Token Test for…

Construction and Evaluation of Reliability and Validity of Reasoning Ability Test

ERIC Educational Resources Information Center

Bhat, Mehraj A.

2014-01-01

This paper is based on the construction and evaluation of reliability and validity of reasoning ability test at secondary school students. In this paper an attempt was made to evaluate validity, reliability and to determine the appropriate standards to interpret the results of reasoning ability test. The test includes 45 items to measure six types…

Conceptualizing Essay Tests' Reliability and Validity: From Research to Theory

ERIC Educational Resources Information Center

Badjadi, Nour El Imane

2013-01-01

The current paper on writing assessment surveys the literature on the reliability and validity of essay tests. The paper aims to examine the two concepts in relationship with essay testing as well as to provide a snapshot of the current understandings of the reliability and validity of essay tests as drawn in recent research studies. Bearing in…

The Reliability and Validity of Discrete and Continuous Measures of Psychopathology: A Quantitative Review

ERIC Educational Resources Information Center

Markon, Kristian E.; Chmielewski, Michael; Miller, Christopher J.

2011-01-01

In 2 meta-analyses involving 58 studies and 59,575 participants, we quantitatively summarized the relative reliability and validity of continuous (i.e., dimensional) and discrete (i.e., categorical) measures of psychopathology. Overall, results suggest an expected 15% increase in reliability and 37% increase in validity through adoption of a…

Paediatric Automatic Phonological Analysis Tools (APAT).

PubMed

Saraiva, Daniela; Lousada, Marisa; Hall, Andreia; Jesus, Luis M T

2017-12-01

To develop the pediatric Automatic Phonological Analysis Tools (APAT) and to estimate inter and intrajudge reliability, content validity, and concurrent validity. The APAT were constructed using Excel spreadsheets with formulas. The tools were presented to an expert panel for content validation. The corpus used in the Portuguese standardized test Teste Fonético-Fonológico - ALPE produced by 24 children with phonological delay or phonological disorder was recorded, transcribed, and then inserted into the APAT. Reliability and validity of APAT were analyzed. The APAT present strong inter- and intrajudge reliability (>97%). The content validity was also analyzed (ICC = 0.71), and concurrent validity revealed strong correlations between computerized and manual (traditional) methods. The development of these tools contributes to fill existing gaps in clinical practice and research, since previously there were no valid and reliable tools/instruments for automatic phonological analysis, which allowed the analysis of different corpora.

Reliability and validity: Part II.

PubMed

Davis, Debora Winders

2004-01-01

Determining measurement reliability and validity involves complex processes. There is usually room for argument about most instruments. It is important that the researcher clearly describes the processes upon which she made the decision to use a particular instrument, and presents the evidence available showing that the instrument is reliable and valid for the current purposes. In some cases, the researcher may need to conduct pilot studies to obtain evidence upon which to decide whether the instrument is valid for a new population or a different setting. In all cases, the researcher must present a clear and complete explanation for the choices, she has made regarding reliability and validity. The consumer must then judge the degree to which the researcher has provided adequate and theoretically sound rationale. Although I have tried to touch on most of the important concepts related to measurement reliability and validity, it is beyond the scope of this column to be exhaustive. There are textbooks devoted entirely to specific measurement issues if readers require more in-depth knowledge.

Validation of the Mexican Spanish version of the EORTC QLQ-H&N35 instrument to measure health-related quality of life in patients with head and neck cancers.

PubMed

Carrillo, José F; Ortiz-Toledo, Miguel Angel; Salido-Noriega, Zarahi; Romero-Ventura, Norma Berenice; Ochoa-Carrillo, Francisco J; Oñate-Ocaña, Luis F

2013-05-01

Health-related quality of life (HRQL) is an important outcome measurement in oncology. Our aim was to validate the Mexican Spanish version of the European Organisation for Research and Treatment of Cancer (EORTC) QLQ-H&N35 questionnaire to measure HRQL in patients with head and neck cancers. The QLQ-C30 and QLQ-H&N35 instruments were applied to Mexican patients with head and neck cancer at a cancer referral center. Reliability and validity tests were performed. Test-retest was carried out in selected patients. One hundred ninety-three patients were included in this cohort; tumor locations included the following: oral cavity 45 (23.3 %); larynx 35 (18.1 %); thyroid carcinoma invasive to aerodigestive tract 32 (16.6 %); oropharynx 17 (8.8 %); hypopharynx 12 (6.2 %); nasal cavity and paranasal sinuses 11 (5.7 %); salivary glands 11 (5.7 %); nasopharynx 8 (4.1 %); eye and adnexa 7 (3.6 %); cervical metastases of unknown origin 5 (2.6 %); primary sarcoma of the head and neck region 5 (2.6 %); maxillary antrum carcinoma 4 (2.1 %); and retinoblastoma 1 (0.5 %). Questionnaire compliance rates were high, and the instrument was well accepted; the internal consistency tests demonstrated good convergent and divergent validity. Cronbach's α coefficients of 8 of 9 multi-item scales of the QLQ-C30 and 6 of 8 scales of the QLQ-H&N35 instruments were >0.7 (range 0.22-0.89). Scales of the QLQ-C30 and QLQ-H&N35 instruments distinguished among clinically distinct groups of patients; some were highly sensitive to change over time. The Mexican Spanish version of the QLQ-H&N35 questionnaire is reliable and valid for the assessment of HRQL in patients with head and neck cancers and can be used in clinical trials in Mexican communities.

Measuring positive and negative affect and physiological hyperarousal among Serbian youth.

PubMed

Stevanovic, Dejan; Laurent, Jeff; Lakic, Aneta

2013-01-01

This study extended previous cross-cultural work regarding the tripartite model of anxiety and depression by developing Serbian translations of the Positive and Negative Affect Scale for Children (PANAS-C), the Physiological Hyperarousal Scale for Children (PH-C), and the Affect and Arousal Scale (AFARS). Characteristics of the scales were examined using 449 students (M age = 12.61 years). Applying item retention criteria established in other studies, PH-C, PANAS-C, and AFARS translations with psychometric properties similar to English-language versions were identified. Preliminary validation of the scales was conducted using a subset of 194 students (M age = 12.37 years) who also completed measures of anxiety and depression. Estimates of reliability, patterns of correlations among scales, and age and gender differences were consistent with previous studies with English-speaking samples. Findings regarding scale validity were mixed, although consistent with existing literature. Serbian translations of the PH-C, PANAS-C, and AFARS mirror the original English-language scales in terms of both strengths and weaknesses.

Reliability and validity of the Safe Routes to school parent and student surveys

PubMed Central

2011-01-01

Background The purpose of this study is to assess the reliability and validity of the U.S. National Center for Safe Routes to School's in-class student travel tallies and written parent surveys. Over 65,000 tallies and 374,000 parent surveys have been completed, but no published studies have examined their measurement properties. Methods Students and parents from two Charlotte, NC (USA) elementary schools participated. Tallies were conducted on two consecutive days using a hand-raising protocol; on day two students were also asked to recall the previous days' travel. The recall from day two was compared with day one to assess 24-hour test-retest reliability. Convergent validity was assessed by comparing parent-reports of students' travel mode with student-reports of travel mode. Two-week test-retest reliability of the parent survey was assessed by comparing within-parent responses. Reliability and validity were assessed using kappa statistics. Results A total of 542 students participated in the in-class student travel tally reliability assessment and 262 parent-student dyads participated in the validity assessment. Reliability was high for travel to and from school (kappa > 0.8); convergent validity was lower but still high (kappa > 0.75). There were no differences by student grade level. Two-week test-retest reliability of the parent survey (n = 112) ranged from moderate to very high for objective questions on travel mode and travel times (kappa range: 0.62 - 0.97) but was substantially lower for subjective assessments of barriers to walking to school (kappa range: 0.31 - 0.76). Conclusions The student in-class student travel tally exhibited high reliability and validity at all elementary grades. The parent survey had high reliability on questions related to student travel mode, but lower reliability for attitudinal questions identifying barriers to walking to school. Parent survey design should be improved so that responses clearly indicate issues that influence parental decision making in regards to their children's mode of travel to school. PMID:21651794

Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project.

PubMed

Singh, Amika S; Vik, Froydis N; Chinapaw, Mai J M; Uijtdewilligen, Léonie; Verloigne, Maïté; Fernández-Alvira, Juan M; Stomfai, Sarolta; Manios, Yannis; Martens, Marloes; Brug, Johannes

2011-12-09

Insight in children's energy balance-related behaviours (EBRBs) and their determinants is important to inform obesity prevention research. Therefore, reliable and valid tools to measure these variables in large-scale population research are needed. To examine the test-retest reliability and construct validity of the child questionnaire used in the ENERGY-project, measuring EBRBs and their potential determinants among 10-12 year old children. We collected data among 10-12 year old children (n = 730 in the test-retest reliability study; n = 96 in the construct validity study) in six European countries, i.e. Belgium, Greece, Hungary, the Netherlands, Norway, and Spain. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) and percentage agreement comparing scores from two measurements, administered one week apart. To assess construct validity, the agreement between questionnaire responses and a subsequent face-to-face interview was assessed using ICC and percentage agreement. Of the 150 questionnaire items, 115 (77%) showed good to excellent test-retest reliability as indicated by ICCs > .60 or percentage agreement ≥ 75%. Test-retest reliability was moderate for 34 items (23%) and poor for one item. Construct validity appeared to be good to excellent for 70 (47%) of the 150 items, as indicated by ICCs > .60 or percentage agreement ≥ 75%. From the other 80 items, construct validity was moderate for 39 (26%) and poor for 41 items (27%). Our results demonstrate that the ENERGY-child questionnaire, assessing EBRBs of the child as well as personal, family, and school-environmental determinants related to these EBRBs, has good test-retest reliability and moderate to good construct validity for the large majority of items.

Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project

PubMed Central

2011-01-01

Background Insight in children's energy balance-related behaviours (EBRBs) and their determinants is important to inform obesity prevention research. Therefore, reliable and valid tools to measure these variables in large-scale population research are needed. Objective To examine the test-retest reliability and construct validity of the child questionnaire used in the ENERGY-project, measuring EBRBs and their potential determinants among 10-12 year old children. Methods We collected data among 10-12 year old children (n = 730 in the test-retest reliability study; n = 96 in the construct validity study) in six European countries, i.e. Belgium, Greece, Hungary, the Netherlands, Norway, and Spain. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) and percentage agreement comparing scores from two measurements, administered one week apart. To assess construct validity, the agreement between questionnaire responses and a subsequent face-to-face interview was assessed using ICC and percentage agreement. Results Of the 150 questionnaire items, 115 (77%) showed good to excellent test-retest reliability as indicated by ICCs > .60 or percentage agreement ≥ 75%. Test-retest reliability was moderate for 34 items (23%) and poor for one item. Construct validity appeared to be good to excellent for 70 (47%) of the 150 items, as indicated by ICCs > .60 or percentage agreement ≥ 75%. From the other 80 items, construct validity was moderate for 39 (26%) and poor for 41 items (27%). Conclusions Our results demonstrate that the ENERGY-child questionnaire, assessing EBRBs of the child as well as personal, family, and school-environmental determinants related to these EBRBs, has good test-retest reliability and moderate to good construct validity for the large majority of items. PMID:22152048

Validation and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women.

PubMed

Abay, Halime; Kaplan, Sena

2016-04-01

There are a limited number of menopause-specific quality-of-life scales for the Turkish population. This study was conducted to evaluate the validity and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women. The study group was comprised of 250 postmenopausal women who applied to a training and research hospital's menopause clinic in Turkey. A survey form and the Turkish Utian quality-of-Life Scale were used to collect data, and the Turkish version of Short Form-36 was used to evaluate reliability with an equivalent form. Language-validity, content-validity, and construct-validity methods were used to assess the validity of the scale, and Cronbach's α coefficient calculation and the equivalent-form reliability methods were used to assess the reliability of the scale. The Turkish Utian Quality-of-Life Scale was determined to be a valid and reliable instrument for measuring the quality of life of postmenopausal women. Confirmatory factor analysis demonstrates that the instrument fits well with 23 items and a four-factor model. The Cronbach's α coefficient for the quality-of-life domains were as follows: 0.88 overall, 0.79 health, 0.78 emotional, 0.76 sexual, and 0.75 occupational. Reliability of the instrument was confirmed through significant correlations between scores on the Turkish version of the Utian Quality-of-Life Scale and the Turkish version of the Short Form-36 (r = 0.745, P < 0.001). This research emphasizes that the Turkish Utian Quality-of-Life Scale is reliable and valid in postmenopausal women-it is a useful instrument for measuring quality of life during menopause.

Alberta infant motor scale: reliability and validity when used on preterm infants in Taiwan.

PubMed

Jeng, S F; Yau, K I; Chen, L C; Hsiao, S F

2000-02-01

The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97-.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and.90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.

Assessment of the severity of dementia: validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS).

PubMed

Poon, Vickie Wan-kei; Lam, Linda Chiu-wa; Wong, Samuel Yeung-shan

2008-09-01

With the rapid growth of the older population, early detection of cognitive deficits is crucial in slowing down functional deterioration of the elderly persons. To examine the validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS) for Chinese older persons in Hong Kong. The HDS was translated into Cantonese Chinese. The content and cultural validity were evaluated by six expert panel members. Sixty-two participants with diagnosis of dementia were recruited for evaluation. Inter-rater reliability, test-retest reliability, internal consistency and concurrent validity were examined. The CV-HDS demonstrated satisfactory psychometric properties. inter-rater reliability and test-retest reliability were high (alpha=0.89 and alpha=0.94 respectively). High value of Cronbach's alpha (alpha=0.94) demonstrated good internal consistency. The concurrent validity of CV-HDS, through correlation with its scores with that of the Chinese version of Mini Mental Status Examination, was established (ranged from r=0.58 to r=0.78, p<0.01). The CV-HDS is a reliable and valid instrument for assessing severity of cognitive impairment in Cantonese speaking Chinese people with dementia. It facilitates treatment planning to optimize the effects of functional training and rehabilitation.

Cross-cultural application of the Korean version of the European Organization for Research and Treatment of Cancer quality of life questionnaire cervical cancer module.

PubMed

Shin, Dong Wook; Ahn, Eunmi; Kim, Yong-Man; Kang, Sokbom; Kim, Byoung-Gie; Seong, Seok Ju; Cha, Soon Do; Park, Chan-Yong; Yun, Young Ho

2009-01-01

This study was conducted to evaluate the psychometric properties of the Korean version of the Quality of Life questionnaire cervical cancer module (QLQ-CX24), developed by the European Organization for Research and Treatment of Cancer (EORTC). The EORTC QLQ-CX24 and the core questionnaire (the EORTC QLQ-C30) were administered to 860 Korean disease-free survivors of cervical cancer and 494 female control subjects from the general Korean population. The construct reliability and validity of the EORTC QLQ-CX24 questionnaire were assessed via factor analysis, multitrait scaling analyses and known group comparisons. Factor structure of the Korean version of the EORTC QLQ-CX24 questionnaire agreed with the originally hypothesized scale structure. Scale reliability was confirmed by Cronbach's alpha coefficients for internal consistency, which ranged from 0.78 to 0.87. Convergent and discriminant validity was confirmed by multitrait scaling analysis, which revealed scaling errors of 0.9. The clinical validity of the Korean version of the EORTC QLQ-CX24 was demonstrated by the ability to discriminate among controls and patient subgroups of different stages, treatments and overall health status. The Korean version of the EORTC QLQ-CX24 was found to be a reliable and a valid measure of quality of life among survivors of cervical cancer when administered in a large survey setting. Copyright 2009 S. Karger AG, Basel.

Reliability and validity of electrothermometers and associated thermocouples.

PubMed

Jutte, Lisa S; Knight, Kenneth L; Long, Blaine C

2008-02-01

Examine thermocouple model uncertainty (reliability+validity). First, a 3x3 repeated measures design with independent variables electrothermometers and thermocouple model. Second, a 1x3 repeated measures design with independent variable subprobe. Three electrothermometers, 3 thermocouple models, a multi-sensor probe and a mercury thermometer measured a stable water bath. Temperature and absolute temperature differences between thermocouples and a mercury thermometer. Thermocouple uncertainty was greater than manufactures'claims. For all thermocouple models, validity and reliability were better in the Iso-Themex than the Datalogger, but there were no practical differences between models within an electrothermometers. Validity of multi-sensor probes and thermocouples within a probe were not different but were greater than manufacturers'claims. Reliability of multiprobes and thermocouples within a probe were within manufacturers claims. Thermocouple models vary in reliability and validity. Scientists should test and report the uncertainty of their equipment rather than depending on manufactures' claims.

Reliability and concurrent validity of a Smartphone, bubble inclinometer and motion analysis system for measurement of hip joint range of motion.

PubMed

Charlton, Paula C; Mentiplay, Benjamin F; Pua, Yong-Hao; Clark, Ross A

2015-05-01

Traditional methods of assessing joint range of motion (ROM) involve specialized tools that may not be widely available to clinicians. This study assesses the reliability and validity of a custom Smartphone application for assessing hip joint range of motion. Intra-tester reliability with concurrent validity. Passive hip joint range of motion was recorded for seven different movements in 20 males on two separate occasions. Data from a Smartphone, bubble inclinometer and a three dimensional motion analysis (3DMA) system were collected simultaneously. Intraclass correlation coefficients (ICCs), coefficients of variation (CV) and standard error of measurement (SEM) were used to assess reliability. To assess validity of the Smartphone application and the bubble inclinometer against the three dimensional motion analysis system, intraclass correlation coefficients and fixed and proportional biases were used. The Smartphone demonstrated good to excellent reliability (ICCs>0.75) for four out of the seven movements, and moderate to good reliability for the remaining three movements (ICC=0.63-0.68). Additionally, the Smartphone application displayed comparable reliability to the bubble inclinometer. The Smartphone application displayed excellent validity when compared to the three dimensional motion analysis system for all movements (ICCs>0.88) except one, which displayed moderate to good validity (ICC=0.71). Smartphones are portable and widely available tools that are mostly reliable and valid for assessing passive hip range of motion, with potential for large-scale use when a bubble inclinometer is not available. However, caution must be taken in its implementation as some movement axes demonstrated only moderate reliability. Copyright © 2014 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Adaption and validation of the Safety Attitudes Questionnaire for the Danish hospital setting

PubMed Central

Kristensen, Solvejg; Sabroe, Svend; Bartels, Paul; Mainz, Jan; Christensen, Karl Bang

2015-01-01

Purpose Measuring and developing a safe culture in health care is a focus point in creating highly reliable organizations being successful in avoiding patient safety incidents where these could normally be expected. Questionnaires can be used to capture a snapshot of an employee’s perceptions of patient safety culture. A commonly used instrument to measure safety climate is the Safety Attitudes Questionnaire (SAQ). The purpose of this study was to adapt the SAQ for use in Danish hospitals, assess its construct validity and reliability, and present benchmark data. Materials and methods The SAQ was translated and adapted for the Danish setting (SAQ-DK). The SAQ-DK was distributed to 1,263 staff members from 31 in- and outpatient units (clinical areas) across five somatic and one psychiatric hospitals through meeting administration, hand delivery, and mailing. Construct validity and reliability were tested in a cross-sectional study. Goodness-of-fit indices from confirmatory factor analysis were reported along with inter-item correlations, Cronbach’s alpha (α), and item and subscale scores. Results Participation was 73.2% (N=925) of invited health care workers. Goodness-of-fit indices from the confirmatory factor analysis showed: c2=1496.76, P<0.001, CFI 0.901, RMSEA (90% CI) 0.053 (0.050–0056), Probability RMSEA (p close)=0.057. Inter-scale correlations between the factors showed moderate-to-high correlations. The scale stress recognition had significant negative correlations with each of the other scales. Questionnaire reliability was high, (α=0.89), and scale reliability ranged from α=0.70 to α=0.86 for the six scales. Proportions of participants with a positive attitude to each of the six SAQ scales did not differ between the somatic and psychiatric health care staff. Substantial variability at the unit level in all six scale mean scores was found within the somatic and the psychiatric samples. Conclusion SAQ-DK showed good construct validity and internal consistency reliability. SAQ-DK is potentially a useful tool for evaluating perceptions of patient safety culture in Danish hospitals. PMID:25674015

Residual stress measurement in a metal microdevice by micro Raman spectroscopy

NASA Astrophysics Data System (ADS)

Song, Chang; Du, Liqun; Qi, Leijie; Li, Yu; Li, Xiaojun; Li, Yuanqi

2017-10-01

Large residual stress induced during the electroforming process cannot be ignored to fabricate reliable metal microdevices. Accurate measurement is the basis for studying the residual stress. Influenced by the topological feature size of micron scale in the metal microdevice, residual stress in it can hardly be measured by common methods. In this manuscript, a methodology is proposed to measure the residual stress in the metal microdevice using micro Raman spectroscopy (MRS). To estimate the residual stress in metal materials, micron sized β-SiC particles were mixed in the electroforming solution for codeposition. First, the calculated expression relating the Raman shifts to the induced biaxial stress for β-SiC was derived based on the theory of phonon deformation potentials and Hooke’s law. Corresponding micro electroforming experiments were performed and the residual stress in Ni-SiC composite layer was both measured by x-ray diffraction (XRD) and MRS methods. Then, the validity of the MRS measurements was verified by comparing with the residual stress measured by XRD method. The reliability of the MRS method was further validated by the statistical student’s t-test. The MRS measurements were found to have no systematic error in comparison with the XRD measurements, which confirm that the residual stresses measured by the MRS method are reliable. Besides that, the MRS method, by which the residual stress in a micro inertial switch was measured, has been confirmed to be a convincing experiment tool for estimating the residual stress in metal microdevice with micron order topological feature size.

A new scale for the assessment of performance and capacity of hand function in children with hemiplegic cerebral palsy: reliability and validity studies.

PubMed

Rosa-Rizzotto, M; Visonà Dalla Pozza, L; Corlatti, A; Luparia, A; Marchi, A; Molteni, F; Facchin, P; Pagliano, E; Fedrizzi, E

2014-10-01

In hemiplegic children, the recognition of the activity limitation pattern and the possibility of grading its severity are relevant for clinicians while planning interventions, monitoring results, predicting outcomes. Aim of the study is to examine the reliability and validity of Besta Scale, an instrument used to measure in hemiplegic children from 18 months to 12 years of age both grasp on request (capacity) and spontaneous use of upper limb (performance) in bimanual play activities and in ADL. Psychometric analysis of reliability and of validity of the Besta scale was performed. Outpatient study sample Reliability study: A sample of 39 patients was enrolled. The administration of Besta scale was video-recorded in a standardized manner. All videos were scored by 20 independent raters on subsequent viewing. 3 raters randomly selected from the 20-raters group rescored the same video two years later for intra-rater reliability. Intra and inter-rater reliability were calculated using Intraclass Correlation Coefficient (ICC) and Kendall's coefficient (K), respectively. Internal consistency reliability was assessed using Alpha's Chronbach coefficient. Validity study: a sample of 105 children was assessed 5 times (at t0 and 2, 3, 6 and 12 months later) by 20 independent raters. Each patient underwent at the same time to QUEST and Besta scale administration and assessment. Criterion validity was calculated using rho-Pearson coefficient. Reliability study: The inter-rater reliability calculated with Kendall's coefficient resulted moderate K=0.47. The intra-rater (or test-retest) reliability for 3 raters was excellent (ICC=0.927). The Cronbach's alpha for internal consistency was 0.972. Validity study: Besta scale showed a good criterion validity compared to QUEST increasing by age and severity of impairment. Rho Pearson's correlation coefficient r was 0.81 (P<0.0001). Limitations. Besta scales in infants finds hard to distinguish between mild to moderately impaired hand function. Besta scale scoring system is a valid and reliable tool, utilizable in a clinical setting to monitor evolution of unimanual and bimanual manipulation and to distinguish hand's capacity from performance.

Psychometric testing of the healthy eating and physical activity self-efficacy questionnaire and the healthy eating and physical activity behavior recall questionnaire for children.

PubMed

Lassetter, Jane H; Macintosh, Christopher I; Williams, Mary; Driessnack, Martha; Ray, Gaye; Wisco, Jonathan J

2018-04-01

The purpose of this study was to develop and assess the psychometric properties for two related questionnaires: the Healthy Eating and Physical Activity Self-Efficacy Questionnaire for Children (HEPASEQ-C) and the Healthy Eating and Physical Activity Behavior Recall Questionnaire for Children (HEPABRQ-C). HEPASEQ-C and HEPABRQ-C were administered to 517 participating children with 492 completing. Data were analyzed to evaluate for reliability and validity of the questionnaires. Content validity was established through a 10-person expert panel. For the HEPASEQ-C, item content validity index (CVI) ranged from 0.80 to 1.00. The CVI for the total questionnaire was 1.0. All HEPASEQ-C items loaded on a single factor. Cronbach's alpha was deemed acceptable (.749). For the HEPABRQ-C, item CVI ranged from 0.88 to 1.00. CVI for the total questionnaire was 1.0. Pearson product moment correlation between HEPASEQ-C and HEPABRQ-C scores was significant (r = .501, p = .000). The HEPASEQ-C and HEPABRQ-C are easily administered and provide helpful insights into children's self-efficacy and behavior recall. They are easy to use and applicable for upper elementary school settings, in clinical settings for individual patients, and in health promotion settings. © 2018 Wiley Periodicals, Inc.

Validity and reliability of the Utrecht Work Engagement Scale-Student Version in Sri Lanka.

PubMed

Wickramasinghe, Nuwan Darshana; Dissanayake, Devani Sakunthala; Abeywardena, Gihan Sajiwa

2018-05-04

The present study was aimed at assessing the validity and the reliability of the Sinhala version of the Utrecht Work Engagement Scale-Student Version (UWES-S) among collegiate cycle students in Sri Lanka. The 17-item UWES-S was translated to Sinhala and the judgmental validity was assessed by a multi-disciplinary panel of experts. Construct validity of the UWES-S was appraised by using multi-trait scaling analysis and exploratory factor analysis (EFA) on data obtained from a sample of 194 grade thirteen students in the Kurunegala district, Sri Lanka. Reliability of the UWES-S was assessed by using internal consistency and test-retest reliability. Except for item 13, all other items showed good psychometric properties in judgemental validity, item-convergent validity and item-discriminant validity. EFA using principal component analysis with Oblimin rotation, suggested a three-factor solution (including vigor, dedication and absorption subscales) explaining 65.4% of the total variance for the 16-item UWES-S (with item 13 deleted). All three subscales show high internal consistency with Cronbach's α coefficient values of 0.867, 0.819, and 0.903 and test-retest reliability was high (p < 0.001). Hence, the Sinhala version of the 16-item UWES-S is a valid and a reliable instrument to assess work engagement among collegiate cycle students in Sri Lanka.

Validity and reliability of a Malay version of the Lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia.

PubMed

Kadar, Masne; Ibrahim, Suhaili; Razaob, Nor Afifi; Chai, Siaw Chui; Harun, Dzalani

2018-02-01

The Lawton Instrumental Activities of Daily Living Scale is a tool often used to assess independence among elderly at home. Its suitability to be used with the elderly population in Malaysia has not been validated. This current study aimed to assess the validity and reliability of the Lawton Instrumental Activities of Daily Living Scale - Malay Version to Malay speaking elderly in Malaysia. This study was divided into three phases: (1) translation and linguistic validity involving both forward and backward translations; (2) establishment of face validity and content validity; and (3) establishment of reliability involving inter-rater, test-retest and internal consistency analyses. Data used for these analyses were obtained by interviewing 65 elderly respondents. Percentages of Content Validity Index for 4 criteria were from 88.89 to 100.0. The Cronbach α coefficient for internal consistency was 0.838. Intra-class Correlation Coefficient of inter-rater reliability and test-retest reliability was 0.957 and 0.950 respectively. The result shows that the Lawton Instrumental Activities of Daily Living Scale - Malay Version has excellent reliability and validity for use with the Malay speaking elderly people in Malaysia. This scale could be used by professionals to assess functional ability of elderly who live independently in community. © 2018 Occupational Therapy Australia.

The Validity and Reliability Test of the Indonesian Version of Gastroesophageal Reflux Disease Quality of Life (GERD-QOL) Questionnaire.

PubMed

Siahaan, Laura A; Syam, Ari F; Simadibrata, Marcellus; Setiati, Siti

2017-01-01

to obtain a valid and reliable GERD-QOL questionnaire for Indonesian application. at the initial stage, the GERD-QOL questionnaire was first translated into Indonesian language and the translated questionnaire was subsequently translated back into the original language (back-to-back translation). The results were evaluated by the researcher team and therefore, an Indonesian version of GERD-QOL questionnaire was developed. Ninety-one patients who had been clinically diagnosed with GERD based on the Montreal criteria were interviewed using the Indonesian version of GERD-QOL questionnaire and the SF 36 questionnaire. The validity was evaluated using a method of construct validity and external validity, and reliability can be tested by the method of internal consistency and test retest. the Indonesian version of GERD-QOL questionnaire had a good internal consistency reliability with a Cronbach Alpha of 0.687-0.842 and a good test retest reliability with an intra-class correlation coefficient of 0.756-0.936; p<0.05). The questionnaire had also been demonstrated to have a good validity with a proven high correlation to each question of SF-36 (p<0.05). the Indonesian version of GERD-QOL questionnaire has been proven valid and reliable to evaluate the quality of life of GERD patients.

Validity and Reliability of the Turkish Version of Needs Based Biopsychosocial Distress Instrument for Cancer Patients (CANDI)

PubMed Central

Beyhun, Nazim Ercument; Can, Gamze; Tiryaki, Ahmet; Karakullukcu, Serdar; Bulut, Bekir; Yesilbas, Sehbal; Kavgaci, Halil; Topbas, Murat

2016-01-01

Background Needs based biopsychosocial distress instrument for cancer patients (CANDI) is a scale based on needs arising due to the effects of cancer. Objectives The aim of this research was to determine the reliability and validity of the CANDI scale in the Turkish language. Patients and Methods The study was performed with the participation of 172 cancer patients aged 18 and over. Factor analysis (principal components analysis) was used to assess construct validity. Criterion validities were tested by computing Spearman correlation between CANDI and hospital anxiety depression scale (HADS), and brief symptom inventory (BSI) (convergent validity) and quality of life scales (FACT-G) (divergent validity). Test-retest reliabilities and internal consistencies were measured with intraclass correlation (ICC) and Cronbach-α. Results A three-factor solution (emotional, physical and social) was found with factor analysis. Internal reliability (α = 0.94) and test-retest reliability (ICC = 0.87) were significantly high. Correlations between CANDI and HADS (rs = 0.67), and BSI (rs = 0.69) and FACT-G (rs = -0.76) were moderate and significant in the expected direction. Conclusions CANDI is a valid and reliable scale in cancer patients with a three-factor structure (emotional, physical and social) in the Turkish language. PMID:27621931

Recommendations for the Definition of Clinical Responder in Insulin Preservation Studies

PubMed Central

Gitelman, Stephen E.; Palmer, Jerry P.

2014-01-01

Clinical responder studies should contribute to the translation of effective treatments and interventions to the clinic. Since ultimately this translation will involve regulatory approval, we recommend that clinical trials prespecify a responder definition that can be assessed against the requirements and suggestions of regulatory agencies. In this article, we propose a clinical responder definition to specifically assist researchers and regulatory agencies in interpreting the clinical importance of statistically significant findings for studies of interventions intended to preserve β-cell function in newly diagnosed type 1 diabetes. We focus on studies of 6-month β-cell preservation in type 1 diabetes as measured by 2-h–stimulated C-peptide. We introduce criteria (bias, reliability, and external validity) for the assessment of responder definitions to ensure they meet U.S. Food and Drug Administration and European Medicines Agency guidelines. Using data from several published TrialNet studies, we evaluate our definition (no decrease in C-peptide) against published alternatives and determine that our definition has minimum bias with external validity. We observe that reliability could be improved by using changes in C-peptide later than 6 months beyond baseline. In sum, to support efficacy claims of β-cell preservation therapies in type 1 diabetes submitted to U.S. and European regulatory agencies, we recommend use of our definition. PMID:24722251

Determining the Appropriateness of the "What If" Situations Test (WIST) with Turkish Pre-Schoolers.

PubMed

Citak Tunc, Gulseren; Gorak, Gulay; Ozyazicioglu, Nurcan; Ak, Bedriye; Isil, Ozlem; Vural, Pinar

2018-04-01

Measurement instruments are needed to assess the child's sexual abuse prevention program. The purpose of the study was to determine the reliability and validity of the WIST (What If Situations Test) for Turkish culture. Participants were children of the 3-6 age group attending pre-school education institutions and the sample size was identified by means of a power analysis. Seventy children were identified as the sample with 0.85 power and 0.05 type I error according to the power analysis. Language validity, content validity, internal validity coefficient (Cronbach alpha coefficient), and test-retest analyses were conducted in terms of validity and reliability in the scope of efforts for adaptation to Turkish culture. Firstly, Kendall W = 0.83 was the score for the expert opinions concerning the content validity of the language validity scale. It was found that the Cronbach alpha coefficients were between 0.68 and 0.90 for the scale sub-dimensions of appropriate and inappropriate recognition, saying, doing, telling, and reporting. The test-retest reliability of the scale was found to be r = 0.89 and the test-retest reliabilities for the sub-dimensions (appropriate recognition, inappropriate recognition, say skills, do skills, tell skills, and reporting skills) were between r = 0.48 and r = 0.92. The test-retest reliability for the Personal Safety Questionnaire (PSQ), as having complimentary items to the WIST, was found to be r = 0.82. The reliability and validity analysis of the 'What If' Situations Test (WIST), used to evaluate pre-schoolers' skills regarding self-protection against sexual abuse, showed that the Test's adaptation to Turkish culture was reliable and valid.

Test-retest reliability and construct validity of the ENERGY-parent questionnaire on parenting practices, energy balance-related behaviours and their potential behavioural determinants: the ENERGY-project.

PubMed

Singh, Amika S; Chinapaw, Mai J M; Uijtdewilligen, Léonie; Vik, Froydis N; van Lippevelde, Wendy; Fernández-Alvira, Juan M; Stomfai, Sarolta; Manios, Yannis; van der Sluijs, Maria; Terwee, Caroline; Brug, Johannes

2012-08-13

Insight in parental energy balance-related behaviours, their determinants and parenting practices are important to inform childhood obesity prevention. Therefore, reliable and valid tools to measure these variables in large-scale population research are needed. The objective of the current study was to examine the test-retest reliability and construct validity of the parent questionnaire used in the ENERGY-project, assessing parental energy balance-related behaviours, their determinants, and parenting practices among parents of 10-12 year old children. We collected data among parents (n = 316 in the test-retest reliability study; n = 109 in the construct validity study) of 10-12 year-old children in six European countries, i.e. Belgium, Greece, Hungary, the Netherlands, Norway, and Spain. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) and percentage agreement comparing scores from two measurements, administered one week apart. To assess construct validity, the agreement between questionnaire responses and a subsequent interview was assessed using ICC and percentage agreement.All but one item showed good to excellent test-retest reliability as indicated by ICCs > .60 or percentage agreement ≥ 75%. Construct validity appeared to be good to excellent for 92 out of 121 items, as indicated by ICCs > .60 or percentage agreement ≥ 75%. From the other 29 items, construct validity was moderate for 24 and poor for 5 items. The reliability and construct validity of the items of the ENERGY-parent questionnaire on multiple energy balance-related behaviours, their potential determinants, and parenting practices appears to be good. Based on the results of the validity study, we strongly recommend adapting parts of the ENERGY-parent questionnaire if used in future research.

Reliability and Validity of the Turkish Version of the Gastrointestinal Symptom Rating Scale.

PubMed

Turan, Nuray; Aşt, Türkinaz Atabek; Kaya, Nurten

The purpose of this methodological study is to investigate the validity and reliability of the Turkish version of the Gastrointestinal Symptom Rating Scale (GSRS). The scale was adapted to the Turkish language via backward translation. Content validity was examined by referring to experts. Reliability was examined via test-retest reliability and internal consistency, and validity was examined with divergent and convergent validity. The Epworth Sleepiness Scale (ESS) and the Marlowe-Crowne Social Desirability Scale (MCSDS) were used for divergent validity. As for convergent validity, the Constipation Severity Instrument (CSI) and the Patient Assessment of Constipation Quality of Life Scale (PAC-QOLQ) were utilized. The relationship between the GSRS and the health-related quality of life (36-item short-form health survey [SF-36]) was also analyzed. The study population consisted of patients in orthopedic clinic who volunteered to participate. Test-retest reliability was examined with the participation of 30 patients; internal consistency and validity were examined with 150 patients. Test-retest reliability correlation coefficients of the GSRS varied from 0.39 to 0.87 for all items. For internal consistency, the GSRS's item total correlation was found to be 0.17-0.67, and Cronbach α was 0.82 for all items. There was a positive linear significant correlation between the GSRS, CSI, and PAC-QOLQ. There was no significant correlation between the GSRS, MCSDS, and ESS. Higher GSRS scores inversely correlated with general quality of life (SF-36). The Turkish version of the GSRS has been found to be a reliable and valid instrument for assessing patients' gastrointestinal symptoms. Therefore, this instrument can be confidently used with Turkish individuals.

Reliability and Validity of the Greek Migraine Disability Assessment (MIDAS) Questionnaire.

PubMed

Oikonomidi, Theodora; Vikelis, Michail; Artemiadis, Artemios; Chrousos, George P; Darviri, Christina

2018-03-01

The Migraine Disability Assessment (MIDAS) Questionnaire is a reliable and valid instrument for migraine-related disability. Such a tool is needed to quantify migraine-related disability in the Greek population. This validation study aims to assess the test-retest reliability, internal consistency, item discriminant and convergent validity of the Greek translation of the MIDAS. Adults diagnosed with migraine completed the MIDAS Questionnaire on two occasions 3 weeks apart to assess reliability, and completed the RAND-36 to assess validity. Participants (n = 152) had a median MIDAS score of 24 and mostly severe disability (58% were grade IV). The test-retest reliability analysis (N = 59) revealed excellent reliability for the total score. Internal consistency was α = 0.71 for initial and α = 0.82 for retest completion. For item discriminant validity, the correlations between each question and the total score were significant, with high correlations for questions 2-5 (range 0.67 ≤ r ≤ 0.79; p < 0.01). For convergent validity, there was significant negative correlation between the total score and all RAND-36 subscales except for 'emotional wellbeing'. The negative correlation indicates that patients with a lower degree of disability according to their MIDAS score tended to have better wellbeing. Psychometric properties are comparable with those of other published validation studies of the MIDAS and the original. Findings on question 1 show that missing work/school days may be closely related with increased affect issues. The Greek version of the MIDAS Questionnaire has good reliability and validity. This study allowed for cross-cultural comparability of research findings.

Validation and clinical significance of the Childhood Myositis Assessment Scale for assessment of muscle function in the juvenile idiopathic inflammatory myopathies.

PubMed

Huber, Adam M; Feldman, Brian M; Rennebohm, Robert M; Hicks, Jeanne E; Lindsley, Carol B; Perez, Maria D; Zemel, Lawrence S; Wallace, Carol A; Ballinger, Susan H; Passo, Murray H; Reed, Ann M; Summers, Ronald M; White, Patience H; Katona, Ildy M; Miller, Frederick W; Lachenbruch, Peter A; Rider, Lisa G

2004-05-01

To examine the measurement characteristics of the Childhood Myositis Assessment Scale (CMAS) in children with juvenile idiopathic inflammatory myopathy (juvenile IIM), and to obtain preliminary data on the clinical significance of CMAS scores. One hundred eight children with juvenile IIM were evaluated on 2 occasions, 7-9 months apart, using various measures of physical function, strength, and disease activity. Interrater reliability, construct validity, and responsiveness of the CMAS were examined. The minimum clinically important difference (MID) and CMAS scores corresponding to various degrees of physical disability were estimated. The intraclass correlation coefficient for 26 patients assessed by 2 examiners was 0.89, indicating very good interrater reliability. The CMAS score correlated highly with the Childhood Health Assessment Questionnaire (C-HAQ) score and with findings on manual muscle testing (MMT) (r(s) = -0.73 and 0.73, respectively) and moderately with physician-assessed global disease activity and skin activity, parent-assessed global disease severity, and muscle magnetic resonance imaging (r(s) = -0.44 to -0.61), thereby demonstrating good construct validity. The standardized response mean was 0.81 (95% confidence interval 0.53, 1.09) in patients with at least 0.8 cm improvement on a 10-cm visual analog scale for physician-assessed global disease activity, indicating strong responsiveness. In bivariate regression models predicting physician-assessed global disease activity, MMT remained significant in models containing the CMAS (P = 0.03) while the C-HAQ did not (P = 0.4). Estimates of the MID ranged from 1.5 to 3.0 points on a 0-52-point scale. CMAS scores corresponding to no, mild, mild-to-moderate, and moderate physical disability, respectively, were 48, 45, 39, and 30. The CMAS exhibits good reliability, construct validity, and responsiveness, and is therefore a valid instrument for the assessment of physical function, muscle strength, and endurance in children with juvenile IIM. Preliminary data on MID and corresponding levels of disability should aid in the clinical interpretation of CMAS scores when assessing patients with juvenile IIM.

The Reliability and Validity of Big Five Inventory Scores with African American College Students

ERIC Educational Resources Information Center

Worrell, Frank C.; Cross, William E., Jr.

2004-01-01

This article describes a study that examined the reliability and validity of scores on the Big Five Inventory (BFI; O. P. John, E. M. Donahue, & R. L. Kentle, 1991) in a sample of 336 African American college students. Results from the study indicated moderate reliability and structural validity for BFI scores. Additionally, BFI subscales had few…

Cross Cultural Perspectives of the Learning Organization: Assessing the Validity and Reliability of the DLOQ in Korea

ERIC Educational Resources Information Center

Song, Ji Hoon; Kim, Jin Yong; Chermack, Thomas J.; Yang; Baiyin

2008-01-01

The primary purpose of this research was to adapt the Dimensions of Learning Organization Questionnaire (DLOQ) from Watkins and Marsick (1993, 1996) and examine its validity and reliability in a Korean context. Results indicate that the DLOQ produces valid and reliable scores of learning organization characteristics in a Korean cultural context.…

Trusting Teachers' Judgement: Research Evidence of the Reliability and Validity of Teachers' Assessment Used for Summative Purposes

ERIC Educational Resources Information Center

Harlen, Wynne

2005-01-01

This paper summarizes the findings of a systematic review of research on the reliability and validity of teachers' assessment used for summative purposes. In addition to the main question, the review also addressed the question "What conditions affect the reliability and validity of teachers' summative assessment?" The initial search for studies…

Life Satisfaction Questionnaire (Lisat-9): Reliability and Validity for Patients with Acquired Brain Injury

ERIC Educational Resources Information Center

Boonstra, Anne M.; Reneman, Michiel F.; Stewart, Roy E.; Balk, Gerlof A.

2012-01-01

The aim of this study was to determine the reliability and discriminant validity of the Dutch version of the life satisfaction questionnaire (Lisat-9 DV) to assess patients with an acquired brain injury. The reliability study used a test-retest design, and the validity study used a cross-sectional design. The setting was the general rehabilitation…

Validity and Reliability of the Academic Resilience Scale in Turkish High School

ERIC Educational Resources Information Center

Kapikiran, Sahin

2012-01-01

The present study aims to determine the validity and reliability of the academic resilience scale in Turkish high school. The participances of the study includes 378 high school students in total (192 female and 186 male). A set of analyses were conducted in order to determine the validity and reliability of the study. Firstly, both exploratory…

Reliability and Validity of the Borg and OMNI Rating of Perceived Exertion Scales in Adolescent Girls.

ERIC Educational Resources Information Center

Pfeiffer, Karin A.; Pivarnik, James M.; Womack, Christopher J.; Reeves, Mathew J.; Malina, Robert M.

2002-01-01

Investigated the reliability and validity of the Borg and OMNI rating of perceived exertion (RPE) scales in adolescent girls during treadmill exercise. Girls were randomly assigned to one of the RPE scales during various treadmill exercise conditions. Results indicated that the OMNI cycle pictorial scale was reliable and valid for use with…

Reliability and validity of the Outcome Expectations for Exercise Scale-2.

PubMed

Resnick, Barbara

2005-10-01

Development of a reliable and valid measure of outcome expectations for exercise for older adults will help establish the relationship between outcome expectations and exercise and facilitate the development of interventions to increase physical activity in older adults. The purpose of this study was to test the reliability and validity of the Outcome Expectations for Exercise-2 Scale (OEE-2), a 13-item measure with two subscales: positive OEE (POEE) and negative OEE (NOEE). The OEE-2 scale was given to 161 residents in a continuing-care retirement community. There was some evidence of validity based on confirmatory factor analysis, Rasch-analysis INFIT and OUTFIT statistics, and convergent validity and test criterion relationships. There was some evidence for reliability of the OEE-2 based on alpha coefficients, person- and item-separation reliability indexes, and R(2)values. Based on analyses, suggested revisions are provided for future use of the OEE-2. Although ongoing reliability and validity testing are needed, the OEE-2 scale can be used to identify older adults with low outcome expectations for exercise, and interventions can then be implemented to strengthen these expectations and improve exercise behavior.

Validity and reliability of a low-cost digital dynamometer for measuring isometric strength of lower limb.

PubMed

Romero-Franco, Natalia; Jiménez-Reyes, Pedro; Montaño-Munuera, Juan A

2017-11-01

Lower limb isometric strength is a key parameter to monitor the training process or recognise muscle weakness and injury risk. However, valid and reliable methods to evaluate it often require high-cost tools. The aim of this study was to analyse the concurrent validity and reliability of a low-cost digital dynamometer for measuring isometric strength in lower limb. Eleven physically active and healthy participants performed maximal isometric strength for: flexion and extension of ankle, flexion and extension of knee, flexion, extension, adduction, abduction, internal and external rotation of hip. Data obtained by the digital dynamometer were compared with the isokinetic dynamometer to examine its concurrent validity. Data obtained by the digital dynamometer from 2 different evaluators and 2 different sessions were compared to examine its inter-rater and intra-rater reliability. Intra-class correlation (ICC) for validity was excellent in every movement (ICC > 0.9). Intra and inter-tester reliability was excellent for all the movements assessed (ICC > 0.75). The low-cost digital dynamometer demonstrated strong concurrent validity and excellent intra and inter-tester reliability for assessing isometric strength in the main lower limb movements.

A comprehensive review of the psychometric properties of the Drug Abuse Screening Test.

PubMed

Yudko, Errol; Lozhkina, Olga; Fouts, Adriana

2007-03-01

This article reviews the reliability and the validity of the (10-, 20-, and 28-item) Drug Abuse Screening Test (DAST). The reliability and the validity of the adolescent version of the DAST are also reviewed. An extensive literature review was conducted using the Medline and Psychinfo databases from the years 1982 to 2005. All articles that addressed the reliability and the validity of the DAST were examined. Publications in which the DAST was used as a screening tool but had no data on its psychometric properties were not included. Descriptive information about each version of the test, as well as discussion of the empirical literature that has explored measures of the reliability and the validity of the DAST, has been included. The DAST tended to have moderate to high levels of test-retest, interitem, and item-total reliabilities. The DAST also tended to have moderate to high levels of validity, sensitivity, and specificity. In general, all versions of the DAST yield satisfactory measures of reliability and validity for use as clinical or research tools. Furthermore, these tests are easy to administer and have been used in a variety of populations.

Evaluating the validity and reliability of the V-scale instrument (Turkish version) used to determine nurses' attitudes towards vital sign monitoring.

PubMed

Ertuğ, Nurcan

2018-06-01

The aim of this study was to determine the validity and reliability of the Turkish version of the V-scale, which measures nurses' attitudes towards vital signs monitoring in the detection of clinical deterioration. This validity and reliability study was conducted at a tertiary hospital in Ankara, Turkey, in 2016. A total of 169 ward nurses participated in the study. Exploratory factor analysis, Cronbach's alpha coefficient, and the intraclass correlation coefficient were used to determine the validity and reliability of the scale. A 5-factor, 16-item scale explained 60.823% of the total variance according to the validity analysis. Our version matched the original scale in terms of the number of items and factor structure. Cronbach's alpha coefficient of the Turkish version of the V-scale was 0.764. The test-retest reliability results were 0.855 for the overall intraclass correlation coefficient, and the t-test result was P > 0.05. The V-scale is a reliable and valid instrument to measure Turkish nurses' attitudes towards vital signs monitoring in the detection of clinical deterioration. © 2018 John Wiley & Sons Australia, Ltd.

Reliability and validity of the self-report version of the apathy evaluation scale in first-episode Psychosis: Concordance with the clinical version at baseline and 12 months follow-up.

PubMed

Faerden, Ann; Lyngstad, Siv Hege; Simonsen, Carmen; Ringen, Petter Andreas; Papsuev, Oleg; Dieset, Ingrid; Andreassen, Ole A; Agartz, Ingrid; Marder, Stephen R; Melle, Ingrid

2018-05-31

Negative symptoms have traditionally been assessed based on clinicians' observations. The subjective experience of negative symptoms in people with psychosis may bring new insight. The Apathy Evaluation Scale (AES) is commonly used to study apathy in psychosis and has corresponding self-rated (AES-S) and clinician-rated (AES-C) versions. The aim of the present study was to determine the validity and reliability of the AES-S by investigating its concordance with the AES-C. Eighty-four first-episode (FEP) patients completed the shortened 12-item AES-S and AES-C at baseline (T1) and 12 months (T2). Concordance was studied by degree of correlation, comparison of mean scores, and change and difference between diagnostic groups. The Positive and Negative Symptom Scale (PANSS) was used to study convergent and discriminative properties. High concordance was found between AES-S and AES-C at both T1 and T2 regarding mean values, change from T1 to T2, and the proportion with high levels of apathy. Both versions indicated high levels of apathy in FEP, while associations with PANSS negative symptoms were weaker for AES-S than AES-C. Controlling for depression did not significantly alter results. We concluded that self-rated apathy in FEP patients is in concordance with clinician ratings, but in need of further study. Copyright © 2018. Published by Elsevier B.V.

Comparing Thermal Process Validation Methods for Salmonella Inactivation on Almond Kernels.

PubMed

Jeong, Sanghyup; Marks, Bradley P; James, Michael K

2017-01-01

Ongoing regulatory changes are increasing the need for reliable process validation methods for pathogen reduction processes involving low-moisture products; however, the reliability of various validation methods has not been evaluated. Therefore, the objective was to quantify accuracy and repeatability of four validation methods (two biologically based and two based on time-temperature models) for thermal pasteurization of almonds. Almond kernels were inoculated with Salmonella Enteritidis phage type 30 or Enterococcus faecium (NRRL B-2354) at ~10 8 CFU/g, equilibrated to 0.24, 0.45, 0.58, or 0.78 water activity (a w ), and then heated in a pilot-scale, moist-air impingement oven (dry bulb 121, 149, or 177°C; dew point <33.0, 69.4, 81.6, or 90.6°C; v air = 2.7 m/s) to a target lethality of ~4 log. Almond surface temperatures were measured in two ways, and those temperatures were used to calculate Salmonella inactivation using a traditional (D, z) model and a modified model accounting for process humidity. Among the process validation methods, both methods based on time-temperature models had better repeatability, with replication errors approximately half those of the surrogate ( E. faecium ). Additionally, the modified model yielded the lowest root mean squared error in predicting Salmonella inactivation (1.1 to 1.5 log CFU/g); in contrast, E. faecium yielded a root mean squared error of 1.2 to 1.6 log CFU/g, and the traditional model yielded an unacceptably high error (3.4 to 4.4 log CFU/g). Importantly, the surrogate and modified model both yielded lethality predictions that were statistically equivalent (α = 0.05) to actual Salmonella lethality. The results demonstrate the importance of methodology, a w , and process humidity when validating thermal pasteurization processes for low-moisture foods, which should help processors select and interpret validation methods to ensure product safety.

The work role functioning questionnaire 2.0 (Dutch version): examination of its reliability, validity and responsiveness in the general working population.

PubMed

Abma, Femke I; van der Klink, Jac J L; Bültmann, Ute

2013-03-01

The promotion of a sustainable, healthy and productive working life attracts more and more attention. Recently the Work Role Functioning Questionnaire (WRFQ) has been cross-culturally translated and adapted to Dutch. This questionnaire aims to measure the health-related work functioning of workers with health problems. The aim of this study is to evaluate the reliability, validity (including five new items) and responsiveness of the WRFQ 2.0 in the working population. A longitudinal study was conducted among workers. The reliability (internal consistency, test-retest reliability, measurement error), validity (structural validity-factor analysis, construct validity by means of hypotheses testing) and responsiveness of the WRFQ 2.0 were evaluated. A total of N = 553 workers completed the survey. The final WRFQ 2.0 has four subscales and showed very good internal consistency, moderate test-retest reliability, good construct validity and moderate responsiveness in the working population. The WRFQ was able to distinguish between groups with different levels of mental health, physical health, fatigue and need for recovery. A moderate correlation was found between WRFQ and related constructs respectively work ability and work productivity. A weak relationship was found with general self-rated health, work engagement and work involvement. The WRFQ 2.0 is a reliable and valid instrument to measure health-related work functioning in the working population. Further validation in larger samples is recommended, especially for test-retest reliability, responsiveness and the questionnaire's ability to predict the future course of health-related work functioning.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET).

PubMed

Koehler, Ryan J; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Bramen, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J; Nicandri, Gregg T

2013-06-01

Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens. Cross-sectional study; Level of evidence, 3. Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated. Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01). The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.

A systematic review of reliability and objective criterion-related validity of physical activity questionnaires.

PubMed

Helmerhorst, Hendrik J F; Brage, Søren; Warren, Janet; Besson, Herve; Ekelund, Ulf

2012-08-31

Physical inactivity is one of the four leading risk factors for global mortality. Accurate measurement of physical activity (PA) and in particular by physical activity questionnaires (PAQs) remains a challenge. The aim of this paper is to provide an updated systematic review of the reliability and validity characteristics of existing and more recently developed PAQs and to quantitatively compare the performance between existing and newly developed PAQs.A literature search of electronic databases was performed for studies assessing reliability and validity data of PAQs using an objective criterion measurement of PA between January 1997 and December 2011. Articles meeting the inclusion criteria were screened and data were extracted to provide a systematic overview of measurement properties. Due to differences in reported outcomes and criterion methods a quantitative meta-analysis was not possible.In total, 31 studies testing 34 newly developed PAQs, and 65 studies examining 96 existing PAQs were included. Very few PAQs showed good results on both reliability and validity. Median reliability correlation coefficients were 0.62-0.71 for existing, and 0.74-0.76 for new PAQs. Median validity coefficients ranged from 0.30-0.39 for existing, and from 0.25-0.41 for new PAQs.Although the majority of PAQs appear to have acceptable reliability, the validity is moderate at best. Newly developed PAQs do not appear to perform substantially better than existing PAQs in terms of reliability and validity. Future PAQ studies should include measures of absolute validity and the error structure of the instrument.

Reliability and validity of the test of incremental respiratory endurance measures of inspiratory muscle performance in COPD

PubMed Central

Formiga, Magno F; Roach, Kathryn E; Vital, Isabel; Urdaneta, Gisel; Balestrini, Kira; Calderon-Candelario, Rafael A

2018-01-01

Purpose The Test of Incremental Respiratory Endurance (TIRE) provides a comprehensive assessment of inspiratory muscle performance by measuring maximal inspiratory pressure (MIP) over time. The integration of MIP over inspiratory duration (ID) provides the sustained maximal inspiratory pressure (SMIP). Evidence on the reliability and validity of these measurements in COPD is not currently available. Therefore, we assessed the reliability, responsiveness and construct validity of the TIRE measures of inspiratory muscle performance in subjects with COPD. Patients and methods Test–retest reliability, known-groups and convergent validity assessments were implemented simultaneously in 81 male subjects with mild to very severe COPD. TIRE measures were obtained using the portable PrO2 device, following standard guidelines. Results All TIRE measures were found to be highly reliable, with SMIP demonstrating the strongest test–retest reliability with a nearly perfect intraclass correlation coefficient (ICC) of 0.99, while MIP and ID clustered closely together behind SMIP with ICC values of about 0.97. Our findings also demonstrated known-groups validity of all TIRE measures, with SMIP and ID yielding larger effect sizes when compared to MIP in distinguishing between subjects of different COPD status. Finally, our analyses confirmed convergent validity for both SMIP and ID, but not MIP. Conclusion The TIRE measures of MIP, SMIP and ID have excellent test–retest reliability and demonstrated known-groups validity in subjects with COPD. SMIP and ID also demonstrated evidence of moderate convergent validity and appear to be more stable measures in this patient population than the traditional MIP. PMID:29805255

Validity and Reliability of the Upper Extremity Work Demands Scale.

PubMed

Jacobs, Nora W; Berduszek, Redmar J; Dijkstra, Pieter U; van der Sluis, Corry K

2017-12-01

Purpose To evaluate validity and reliability of the upper extremity work demands (UEWD) scale. Methods Participants from different levels of physical work demands, based on the Dictionary of Occupational Titles categories, were included. A historical database of 74 workers was added for factor analysis. Criterion validity was evaluated by comparing observed and self-reported UEWD scores. To assess structural validity, a factor analysis was executed. For reliability, the difference between two self-reported UEWD scores, the smallest detectable change (SDC), test-retest reliability and internal consistency were determined. Results Fifty-four participants were observed at work and 51 of them filled in the UEWD twice with a mean interval of 16.6 days (SD 3.3, range = 10-25 days). Criterion validity of the UEWD scale was moderate (r = .44, p = .001). Factor analysis revealed that 'force and posture' and 'repetition' subscales could be distinguished with Cronbach's alpha of .79 and .84, respectively. Reliability was good; there was no significant difference between repeated measurements. An SDC of 5.0 was found. Test-retest reliability was good (intraclass correlation coefficient for agreement = .84) and all item-total correlations were >.30. There were two pairs of highly related items. Conclusion Reliability of the UEWD scale was good, but criterion validity was moderate. Based on current results, a modified UEWD scale (2 items removed, 1 item reworded, divided into 2 subscales) was proposed. Since observation appeared to be an inappropriate gold standard, we advise to investigate other types of validity, such as construct validity, in further research.

Braden scale (ALB) for assessing pressure ulcer risk in hospital patients: A validity and reliability study.

PubMed

Chen, Hong-Lin; Cao, Ying-Juan; Zhang, Wei; Wang, Jing; Huai, Bao-Sha

2017-02-01

The inter-rater reliability of Braden Scale is not so good. We modified the Braden(ALB) scale by defining nutrition subscale based on serum albumin, then assessed it's the validity and reliability in hospital patients. We designed a retrospective study for validity analysis, and a prospective study for reliability analysis. Receiver operating curve (ROC) and area under the curve (AUC) were used to evaluate the predictive validity. Intra-class correlation coefficient (ICC) was used to investigate the inter-rater reliability. Two thousand five hundred twenty-five patients were included for validity analysis, 76 patients (3.0%) developed pressure ulcer. Positive correlation was found between serum albumin and nutrition score in Braden scale (Spearman's coefficient 0.2203, P<0.0001). The AUCs for Braden scale and Braden(ALB) scale predicting pressure ulcer risk were 0.813 (95% CI 0.797-0.828; P<0.0001), and 0.859 (95% CI 0.845-0.872; P<0.0001), respectively. The Braden(ALB) scale was even more valid than the Braden scale (z=1.860, P=0.0628). In different age subgroups, the Braden(ALB) scale seems also more valid than the original Braden scale, but no statistically significant differences were found (P>0.05). The inter-rater reliability study showed the ICC-value for nutrition increased 45.9%, and increased 4.3% for total score. The Braden(ALB) scale has similar validity compared with the original Braden scale for in hospital patients. However, the inter-rater reliability was significantly increased. Copyright © 2016 Elsevier Inc. All rights reserved.

A systematic review of reliability and objective criterion-related validity of physical activity questionnaires

PubMed Central

2012-01-01

Physical inactivity is one of the four leading risk factors for global mortality. Accurate measurement of physical activity (PA) and in particular by physical activity questionnaires (PAQs) remains a challenge. The aim of this paper is to provide an updated systematic review of the reliability and validity characteristics of existing and more recently developed PAQs and to quantitatively compare the performance between existing and newly developed PAQs. A literature search of electronic databases was performed for studies assessing reliability and validity data of PAQs using an objective criterion measurement of PA between January 1997 and December 2011. Articles meeting the inclusion criteria were screened and data were extracted to provide a systematic overview of measurement properties. Due to differences in reported outcomes and criterion methods a quantitative meta-analysis was not possible. In total, 31 studies testing 34 newly developed PAQs, and 65 studies examining 96 existing PAQs were included. Very few PAQs showed good results on both reliability and validity. Median reliability correlation coefficients were 0.62–0.71 for existing, and 0.74–0.76 for new PAQs. Median validity coefficients ranged from 0.30–0.39 for existing, and from 0.25–0.41 for new PAQs. Although the majority of PAQs appear to have acceptable reliability, the validity is moderate at best. Newly developed PAQs do not appear to perform substantially better than existing PAQs in terms of reliability and validity. Future PAQ studies should include measures of absolute validity and the error structure of the instrument. PMID:22938557

Development and validation of a medical chart review checklist for symptom management performance of oncologists in the routine care of patients with advanced cancer.

PubMed

Blum, David; Rosa, Daniel; deWolf-Linder, Susanne; Hayoz, Stefanie; Ribi, Karin; Koeberle, Dieter; Strasser, Florian

2014-12-01

Oncologists perform a range of pharmacological and nonpharmacological interventions to manage the symptoms of outpatients with advanced cancer. The aim of this study was to develop and test a symptom management performance checklist (SyMPeC) to review medical charts. First, the content of the checklist was determined by consensus of an interprofessional team. The SyMPeC was tested using the data set of the SAKK 96/06 E-MOSAIC (Electronical Monitoring of Symptoms and Syndromes Associated with Cancer) trial, which included six consecutive visits from 247 patients. In a test data set (half of the data) of medical charts, two people extracted and quantified the definitions of the parameters (content validity). To assess the inter-rater reliability, three independent researchers used the SyMPeC on a random sample (10% of the test data set), and Fleiss's kappa was calculated. To test external validity, the interventions retrieved by the SyMPeC chart review were compared with nurse-led assessment of patient-perceived oncologists' palliative interventions. Five categories of symptoms were included: pain, fatigue, anorexia/nausea, dyspnea, and depression/anxiety. Interventions were categorized as symptom specific or symptom unspecific. In the test data set of 123 patients, 402 unspecific and 299 symptom-specific pharmacological interventions were detected. Nonpharmacological interventions (n = 242) were mostly symptom unspecific. Fleiss's kappa for symptom and intervention detections was K = 0.7 and K = 0.86, respectively. In 1003 of 1167 visits (86%), there was a match between SyMPeC and nurse-led assessment. Seventy-nine percent (195 of 247) of patients had no or one mismatch. Chart review by SyMPeC seems reliable to detect symptom management interventions by oncologists in outpatient clinics. Nonpharmacological interventions were less symptom specific. A template for documentation is needed for standardization. Copyright © 2014 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

The Reliability and Validity of the Thoracolumbar Injury Classification System in Pediatric Spine Trauma.

PubMed

Savage, Jason W; Moore, Timothy A; Arnold, Paul M; Thakur, Nikhil; Hsu, Wellington K; Patel, Alpesh A; McCarthy, Kathryn; Schroeder, Gregory D; Vaccaro, Alexander R; Dimar, John R; Anderson, Paul A

2015-09-15

The thoracolumbar injury classification system (TLICS) was evaluated in 20 consecutive pediatric spine trauma cases. The purpose of this study was to determine the reliability and validity of the TLICS in pediatric spine trauma. The TLICS was developed to improve the categorization and management of thoracolumbar trauma. TLICS has been shown to have good reliability and validity in the adult population. The clinical and radiographical findings of 20 pediatric thoracolumbar fractures were prospectively presented to 20 surgeons with disparate levels of training and experience with spinal trauma. These injuries were consecutively scored using the TLICS. Cohen unweighted κ coefficients and Spearman rank order correlation values were calculated for the key parameters (injury morphology, status of posterior ligamentous complex, neurological status, TLICS total score, and proposed management) to assess the inter-rater reliabilities. Five surgeons scored the same cases 3 months later to assess the intra-rater reliability. The actual management of each case was then compared with the treatment recommended by the TLICS algorithm to assess validity. The inter-rater κ statistics of all subgroups (injury morphology, status of the posterior ligamentous complex, neurological status, TLICS total score, and proposed treatment) were within the range of moderate to substantial reproducibility (0.524-0.958). All subgroups had excellent intra-rater reliability (0.748-1.000). The various indices for validity were calculated (80.3% correct, 0.836 sensitivity, 0.785 specificity, 0.676 positive predictive value, 0.899 negative predictive value). Overall, TLICS demonstrated good validity. The TLICS has good reliability and validity when used in the pediatric population. The inter-rater reliability of predicting management and indices for validity are lower than those in adults with thoracolumbar fractures, which is likely due to differences in the way children are treated for certain types of injuries. TLICS can be used to reliably categorize thoracolumbar injuries in the pediatric population; however, modifications may be needed to better guide treatment in this specific patient population. 4.

Predictors of validity and reliability of a physical activity record in adolescents

PubMed Central

2013-01-01

Background Poor to moderate validity of self-reported physical activity instruments is commonly observed in young people in low- and middle-income countries. However, the reasons for such low validity have not been examined in detail. We tested the validity of a self-administered daily physical activity record in adolescents and assessed if personal characteristics or the convenience level of reporting physical activity modified the validity estimates. Methods The study comprised a total of 302 adolescents from an urban and rural area in Ecuador. Validity was evaluated by comparing the record with accelerometer recordings for seven consecutive days. Test-retest reliability was examined by comparing registrations from two records administered three weeks apart. Time spent on sedentary (SED), low (LPA), moderate (MPA) and vigorous (VPA) intensity physical activity was estimated. Bland Altman plots were used to evaluate measurement agreement. We assessed if age, sex, urban or rural setting, anthropometry and convenience of completing the record explained differences in validity estimates using a linear mixed model. Results Although the record provided higher estimates for SED and VPA and lower estimates for LPA and MPA compared to the accelerometer, it showed an overall fair measurement agreement for validity. There was modest reliability for assessing physical activity in each intensity level. Validity was associated with adolescents’ personal characteristics: sex (SED: P = 0.007; LPA: P = 0.001; VPA: P = 0.009) and setting (LPA: P = 0.000; MPA: P = 0.047). Reliability was associated with the convenience of completing the physical activity record for LPA (low convenience: P = 0.014; high convenience: P = 0.045). Conclusions The physical activity record provided acceptable estimates for reliability and validity on a group level. Sex and setting were associated with validity estimates, whereas convenience to fill out the record was associated with better reliability estimates for LPA. This tendency of improved reliability estimates for adolescents reporting higher convenience merits further consideration. PMID:24289296

Development and Psychometric Evaluation of the Index of Dental Anxiety and Fear (IDAF-4C[superscript +])

ERIC Educational Resources Information Center

Armfield, Jason M.

2010-01-01

The measurement of dental fear is important due to its high prevalence and appreciable individual, clinical, and public health consequences. However, existing measures of dental anxiety and fear (DAF) have theoretical or practical limitations. This study describes the development and subsequent assessment of the reliability and validity of test…

Testing the Self-Efficacy Questionnaire with Korean Children in Institutionalized Care

ERIC Educational Resources Information Center

Kim, Youngmi; Kim, Kyeongmo; Lee, Shinhye

2017-01-01

Purpose: We tested the reliability and validity of the Self-Efficacy Questionnaire for Children (SEQ-C) in a sample of children living in orphanages in South Korea. Methods: Our study sample consisted of 334 children aged 13-18 obtained using a convenience sampling method. We conducted a confirmatory factor analysis to identify the factor…

Measuring acuity of the approximate number system reliably and validly: the evaluation of an adaptive test procedure

PubMed Central

Lindskog, Marcus; Winman, Anders; Juslin, Peter; Poom, Leo

2013-01-01

Two studies investigated the reliability and predictive validity of commonly used measures and models of Approximate Number System acuity (ANS). Study 1 investigated reliability by both an empirical approach and a simulation of maximum obtainable reliability under ideal conditions. Results showed that common measures of the Weber fraction (w) are reliable only when using a substantial number of trials, even under ideal conditions. Study 2 compared different purported measures of ANS acuity as for convergent and predictive validity in a within-subjects design and evaluated an adaptive test using the ZEST algorithm. Results showed that the adaptive measure can reduce the number of trials needed to reach acceptable reliability. Only direct tests with non-symbolic numerosity discriminations of stimuli presented simultaneously were related to arithmetic fluency. This correlation remained when controlling for general cognitive ability and perceptual speed. Further, the purported indirect measure of ANS acuity in terms of the Numeric Distance Effect (NDE) was not reliable and showed no sign of predictive validity. The non-symbolic NDE for reaction time was significantly related to direct w estimates in a direction contrary to the expected. Easier stimuli were found to be more reliable, but only harder (7:8 ratio) stimuli contributed to predictive validity. PMID:23964256

Development and validation of a prognostic nomogram for colorectal cancer after radical resection based on individual patient data from three large-scale phase III trials

PubMed Central

Akiyoshi, Takashi; Maeda, Hiromichi; Kashiwabara, Kosuke; Kanda, Mitsuro; Mayanagi, Shuhei; Aoyama, Toru; Hamada, Chikuma; Sadahiro, Sotaro; Fukunaga, Yosuke; Ueno, Masashi; Sakamoto, Junichi; Saji, Shigetoyo; Yoshikawa, Takaki

2017-01-01

Background Few prediction models have so far been developed and assessed for the prognosis of patients who undergo curative resection for colorectal cancer (CRC). Materials and Methods We prepared a clinical dataset including 5,530 patients who participated in three major randomized controlled trials as a training dataset and 2,263 consecutive patients who were treated at a cancer-specialized hospital as a validation dataset. All subjects underwent radical resection for CRC which was histologically diagnosed to be adenocarcinoma. The main outcomes that were predicted were the overall survival (OS) and disease free survival (DFS). The identification of the variables in this nomogram was based on a Cox regression analysis and the model performance was evaluated by Harrell's c-index. The calibration plot and its slope were also studied. For the external validation assessment, risk group stratification was employed. Results The multivariate Cox model identified variables; sex, age, pathological T and N factor, tumor location, size, lymphnode dissection, postoperative complications and adjuvant chemotherapy. The c-index was 0.72 (95% confidence interval [CI] 0.66-0.77) for the OS and 0.74 (95% CI 0.69-0.78) for the DFS. The proposed stratification in the risk groups demonstrated a significant distinction between the Kaplan–Meier curves for OS and DFS in the external validation dataset. Conclusions We established a clinically reliable nomogram to predict the OS and DFS in patients with CRC using large scale and reliable independent patient data from phase III randomized controlled trials. The external validity was also confirmed on the practical dataset. PMID:29228760

[Validation of a Spanish version of the Childhood Asthma Control Test (Sc-ACT) for use in Spain].

PubMed

Pérez-Yarza, E G; Castro-Rodriguez, J A; Villa Asensi, J R; Garde Garde, J; Hidalgo Bermejo, F J

2015-08-01

The Childhood Asthma Control Test (c-ACT) is a validated tool for determining pediatric asthma control. However, it is not validated in the Spanish language in Spain. We evaluated the psychometric properties of the Spanish version of the Childhood Asthma Control Test (Sc-ACT) for assessing asthma control in children ages 4 to11. This national, multicentre, prospective study was conducted in Spain with asthmatic children and their caregivers. Patients were assessed at 3 visits (Baseline, 2 Weeks, and 4 Months). Clinical variables included: symptoms, exacerbations, FEV1, asthma classification, PAQLQ and PACQLQ questionnaire scores, and asthma control as perceived by physicians, patients and caregivers. The Sc-ACT feasibility, validity, reliability, and sensitivity to change were assessed. A total of 394 children were included; mean (SD) time to complete the Sc-ACT was 5.3 (4.4) minutes. Sc-ACT score was correlated with asthma control as perceived by physician (-0.52), patient (-0.53), and caregiver (-0.51) and with the PAQLQ (0.56) and PACQLQ (0.55) scores. Sc-ACT was found to be significantly related to intensity and frequency of asthma symptoms. Cronbach alpha coefficient α was 0.81 and intraclass correlation coefficient was ≥0.85 for all of the items. The global effect size of Sc-ACT was 0.55. The cutoff point scores of 21 or higher indicated a good asthma control and their MCID was 4 points. The Spanish version of the c-ACT was found to be a reliable and valid questionnaire for evaluating asthma control in Spanish-speaking children ages 4 to 11 in Spain. Copyright © 2014 Asociación Española de Pediatría. Published by Elsevier España, S.L.U. All rights reserved.

Development and validation of a new instrument to measure health-related quality of life in patients with psoriatic arthritis: the VITACORA-19.

PubMed

Torre-Alonso, Juan Carlos; Gratacós, Jordi; Rey-Rey, José Santos; Valdazo de Diego, Juan Pablo; Urriticoechea-Arana, Ana; Daudén, Esteban; Moreno, Mireia; Zarco-Montejo, Pedro; Collantes-Estévez, Eduardo; Fernández-López, Juan Antonio

2014-10-01

To develop/validate an instrument to measure health-related quality of life (HRQoL) in patients with psoriatic arthritis (PsA), for use in clinical studies. An item pool of 35 items was generated following standardized procedures. Item reduction was performed using clinimetric and psychometric approaches after administration to 66 patients with PsA. The resulting instrument, the VITACORA-19, consists of 19 items. Its validity content, internal consistency, test-retest reliability, known groups/convergent validity, and sensitivity to change were tested in a longitudinal and multicenter study conducted in 10 hospitals in Spain, with 323 patients who also completed the EuroQol 5-dimensional questionnaire (EQ-5D) and a health status transition item. There were 3 study groups: group A (n = 209, patients with PsA), group B (n = 71, patients with arthritis without psoriatic aspect, patients with arthrosis, and patients with dermatitis), and group C (n = 43, healthy controls). The questionnaire was considered easy/very easy to answer by 94.7% of the patients with PsA. The factorial analysis clearly identified only 1 factor. Cronbach's alpha coefficient and interclass correlation coefficients exceeded 0.90. Statistically significant differences (p < 0.001) were observed between groups: subjects from group C had better HRQoL, followed by group B, and finally group A had the worst HRQoL. The VITACORA-19 scores showed significant correlations (p < 0.001) to PsA disease activity, EQ-5D, and perceived health state, scoring the patients with better health state higher. The minimum important difference was established as an 8-point change in the global score. The Spanish-developed VITACORA-19, designed to measure HRQoL in patients with PsA, has good validity, reliability, and sensitivity to change.

Dutch validation of the low anterior resection syndrome score.

PubMed

Hupkens, B J P; Breukink, S O; Olde Reuver Of Briel, C; Tanis, P J; de Noo, M E; van Duijvendijk, P; van Westreenen, H L; Dekker, J W T; Chen, T Y T; Juul, T

2018-04-21

The aim of this study was to validate the Dutch translation of the low anterior resection syndrome (LARS) score in a population of Dutch rectal cancer patients. Patients who underwent surgery for rectal cancer received the LARS score questionnaire, a single quality of life (QoL) category question and the European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30 questionnaire. A subgroup of patients received the LARS score twice to assess the test-retest reliability. A total of 165 patients were included in the analysis, identified in six Dutch centres. The response rate was 62.0%. The percentage of patients who reported 'major LARS' was 59.4%. There was a high proportion of patients with a perfect or moderate fit between the QoL category question and the LARS score, showing a good convergent validity. The LARS score was able to discriminate between patients with or without neoadjuvant radiotherapy (P = 0.003), between total and partial mesorectal excision (P = 0.008) and between age groups (P = 0.039). There was a statistically significant association between a higher LARS score and an impaired function on the global QoL subscale and the physical, role, emotional and social functioning subscales of the EORTC QLQ-C30 questionnaire. The test-retest reliability of the LARS score was good, with an interclass correlation coefficient of 0.79. The good psychometric properties of the Dutch version of the LARS score are comparable overall to the earlier validations in other countries. Therefore, the Dutch translation can be considered to be a valid tool for assessing LARS in Dutch rectal cancer patients. Colorectal Disease © 2018 The Association of Coloproctology of Great Britain and Ireland.

RELIABILITY AND VALIDITY OF SUBJECTIVE ASSESSMENT OF LUMBAR LORDOSIS IN CONVENTIONAL RADIOGRAPHY.

PubMed

Ruhinda, E; Byanyima, R K; Mugerwa, H

2014-10-01

Reliability and validity studies of different lumbar curvature analysis and measurement techniques have been documented however there is limited literature on the reliability and validity of subjective visual analysis. Radiological assessment of lumbar lordotic curve aids in early diagnosis of conditions even before neurologic changes set in. To ascertain the level of reliability and validity of subjective assessment of lumbar lordosis in conventional radiography. A blinded, repeated-measures diagnostic test was carried out on lumbar spine x-ray radiographs. Radiology Department at Joint Clinical Research Centre (JCRC), Mengo-Kampala-Uganda. Seventy (70) lateral lumbar x-ray films were used for this study and were obtained from the archive of JCRC radiology department at Butikiro house, Mengo-Kampala. Poor observer agreement, both inter- and intra-observer, with kappa values of 0.16 was found. Inter-observer agreement was poorer than intra-observer agreement. Kappa values significantly rose when the lumbar lordosis was clustered into four categories without grading each abnormality. The results confirm that subjective assessment of lumbar lordosis has low reliability and validity. Film quality has limited influence on the observer reliability. This study further shows that fewer scale categories of lordosis abnormalities produce better observer reliability.

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

Reliability and validity of the Brief Pain Inventory in individuals with chronic obstructive pulmonary disease.

PubMed

Chen, Y-W; HajGhanbari, B; Road, J D; Coxson, H O; Camp, P G; Reid, W D

2018-06-08

Pain is prevalent in chronic obstructive pulmonary disease (COPD) and the Brief Pain Inventory (BPI) appears to be a feasible questionnaire to assess this symptom. However, the reliability and validity of the BPI have not been determined in individuals with COPD. This study aimed to determine the internal consistency, test-retest reliability and validity (construct, convergent, divergent and discriminant) of the BPI in individuals with COPD. In order to examine the test-retest reliability, individuals with COPD were recruited from pulmonary rehabilitation programmes to complete the BPI twice 1 week apart. In order to investigate validity, de-identified data was retrieved from two previous studies, including forced expiratory volume in 1-s, age, sex and data from four questionnaires: the BPI, short-form McGill Pain Questionnaire (SF-MPQ), 36-Item Short Form Survey (SF-36) and Community Health Activities Model Program for Seniors (CHAMPS) questionnaire. In total, 123 participants were included in the analyses (eligible data were retrieved from 86 participants and additional 37 participants were recruited). The BPI demonstrated excellent internal consistency and test-retest reliability. It also showed convergent validity with the SF-MPQ and divergent validity with the SF-36. The factor analysis yielded two factors of the BPI, which demonstrated that the two domains of the BPI measure the intended constructs. The BPI can also discriminate pain levels among COPD patients with varied levels of quality of life (SF-36) and physical activity (CHAMPS). The BPI is a reliable and valid pain questionnaire that can be used to evaluate pain in COPD. This study formally established the reliability and validity of the BPI in individuals with COPD, which have not been determined in this patient group. The results of this study provide strong evidence that assessment results from this pain questionnaire are reliable and valid. © 2018 European Pain Federation - EFIC®.

Validity and reliability of Chinese version of Adult Carer Quality of Life questionnaire (AC-QoL) in family caregivers of stroke survivors

PubMed Central

Li, Yingshuang; Ding, Chunge

2017-01-01

The Adult Carer Quality of Life questionnaire (AC-QoL) is a reliable and valid instrument used to assess the quality of life (QoL) of adult family caregivers. We explored the psychometric properties and tested the reliability and validity of a Chinese version of the AC-QoL with reliability and validity testing in 409 Chinese stroke caregivers. We used item-total correlation and extreme group comparison to do item analysis. To evaluate its reliability, we used a test-retest reliability approach, intraclass correlation coefficient (ICC), together with Cronbach’s alpha and model-based internal consistency index; to evaluate its validity, we used scale content validity, confirmatory factor analysis (CFA) and exploratory factor analysis (EFA) via principal component analysis with varimax rotation. We found that the CFA did not in fact confirm the original factor model and our EFA yielded a 31-item measure with a five-factor model. In conclusions, although some items performed differently in our analysis of the original English language version and our Chinese language version, our translated AC-QoL is a reliable and valid tool which can be used to assess the quality of life of stroke caregivers in mainland China. Chinese version AC-QoL is a comprehensive and good measurement to understand caregivers and has the potential to be a screening tool to assess QoL of caregiver. PMID:29131845

Reliability and Validity of a Questionnaire for Physical Activity Assessment in South American Children and Adolescents: The SAYCARE Study.

PubMed

Nascimento-Ferreira, Marcus Vinícius; De Moraes, Augusto César Ferreira; Toazza-Oliveira, Paulo Vinícius; Forjaz, Claudia L M; Aristizabal, Juan Carlos; Santaliesra-Pasías, Alba M; Lepera, Candela; Nascimento-Junior, Walter Viana; Skapino, Estela; Delgado, Carlos Alberto; Moreno, Luis Alberto; Carvalho, Heráclito Barbosa

2018-03-01

The objective of this article is to test the reliability and validity of the new and innovative physical activity (PA) questionnaire. Subsamples from the South American Youth/Child Cardiovascular and Environment Study (SAYCARE) study were included to examine its reliability (children: n = 161; adolescents: n = 177) and validity (children: n = 82; adolescents: n = 60). The questionnaire consists of three dimensions of PA (leisure, active commuting, and school) performed during the last week. To assess its validity, the subjects wore accelerometers for at least 3 days and 8 h/d (at least one weekend day). The reliability was analyzed by correlation coefficients. In addition, Bland-Altman analysis and a multilevel regression were applied to estimate the measurement bias, limits of agreement, and influence of contextual variables. In children, the questionnaire showed consistent reliability (ρ = 0.56) and moderate validity (ρ = 0.46), and the contextual variable variance explained 43.0% with -22.9 min/d bias. In adolescents, the reliability was higher (ρ = 0.76) and the validity was almost excellent (ρ = 0.88), with 66.7% of the variance explained by city level with 16.0 min/d PA bias. The SAYCARE PA questionnaire shows acceptable (in children) to strong (in adolescents) reliability and strong validity in the measurement of PA in the pediatric population from low- to middle-income countries. © 2018 The Obesity Society.

A systematic review of publications assessing reliability and validity of the Behavioral Risk Factor Surveillance System (BRFSS), 2004–2011

PubMed Central

2013-01-01

Background In recent years response rates on telephone surveys have been declining. Rates for the behavioral risk factor surveillance system (BRFSS) have also declined, prompting the use of new methods of weighting and the inclusion of cell phone sampling frames. A number of scholars and researchers have conducted studies of the reliability and validity of the BRFSS estimates in the context of these changes. As the BRFSS makes changes in its methods of sampling and weighting, a review of reliability and validity studies of the BRFSS is needed. Methods In order to assess the reliability and validity of prevalence estimates taken from the BRFSS, scholarship published from 2004–2011 dealing with tests of reliability and validity of BRFSS measures was compiled and presented by topics of health risk behavior. Assessments of the quality of each publication were undertaken using a categorical rubric. Higher rankings were achieved by authors who conducted reliability tests using repeated test/retest measures, or who conducted tests using multiple samples. A similar rubric was used to rank validity assessments. Validity tests which compared the BRFSS to physical measures were ranked higher than those comparing the BRFSS to other self-reported data. Literature which undertook more sophisticated statistical comparisons was also ranked higher. Results Overall findings indicated that BRFSS prevalence rates were comparable to other national surveys which rely on self-reports, although specific differences are noted for some categories of response. BRFSS prevalence rates were less similar to surveys which utilize physical measures in addition to self-reported data. There is very little research on reliability and validity for some health topics, but a great deal of information supporting the validity of the BRFSS data for others. Conclusions Limitations of the examination of the BRFSS were due to question differences among surveys used as comparisons, as well as mode of data collection differences. As the BRFSS moves to incorporating cell phone data and changing weighting methods, a review of reliability and validity research indicated that past BRFSS landline only data were reliable and valid as measured against other surveys. New analyses and comparisons of BRFSS data which include the new methodologies and cell phone data will be needed to ascertain the impact of these changes on estimates in the future. PMID:23522349

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation

PubMed Central

2014-01-01

Background A balance test provides important information such as the standard to judge an individual’s functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Methods Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). Results The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. Conclusion The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment. PMID:24912769

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation.

PubMed

Park, Dae-Sung; Lee, GyuChang

2014-06-10

A balance test provides important information such as the standard to judge an individual's functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment.

Reliability and validity of the de Morton Mobility Index in individuals with sub-acute stroke.

PubMed

Braun, Tobias; Marks, Detlef; Thiel, Christian; Grüneberg, Christian

2018-02-04

To establish the validity and reliability of the de Morton Mobility Index (DEMMI) in patients with sub-acute stroke. This cross-sectional study was performed in a neurological rehabilitation hospital. We assessed unidimensionality, construct validity, internal consistency reliability, inter-rater reliability, minimal detectable change and possible floor and ceiling effects of the DEMMI in adult patients with sub-acute stroke. The study included a total sample of 121 patients with sub-acute stroke. We analysed validity (n = 109) and reliability (n = 51) in two sub-samples. Rasch analysis indicated unidimensionality with an overall fit to the model (chi-square = 12.37, p = 0.577). All hypotheses on construct validity were confirmed. Internal consistency reliability (Cronbach's alpha = 0.94) and inter-rater reliability (intraclass correlation coefficient = 0.95; 95% confidence interval: 0.92-0.97) were excellent. The minimal detectable change with 90% confidence was 13 points. No floor or ceiling effects were evident. These results indicate unidimensionality, sufficient internal consistency reliability, inter-rater reliability, and construct validity of the DEMMI in patients with a sub-acute stroke. Advantages of the DEMMI in clinical application are the short administration time, no need for special equipment and interval level data. The de Morton Mobility Index, therefore, may be a useful performance-based bedside test to measure mobility in individuals with a sub-acute stroke across the whole mobility spectrum. Implications for Rehabilitation The de Morton Mobility Index (DEMMI) is an unidimensional measurement instrument of mobility in individuals with sub-acute stroke. The DEMMI has excellent internal consistency and inter-rater reliability, and sufficient construct validity. The minimal detectable change of the DEMMI with 90% confidence in stroke rehabilitation is 13 points. The lack of any floor or ceiling effects on hospital admission indicates applicability across the whole mobility spectrum of patients with sub-acute stroke.

International Psychometric Validation of an EORTC Quality of Life Module Measuring Cancer Related Fatigue (EORTC QLQ-FA12).

PubMed

Weis, Joachim; Tomaszewski, Krzysztof A; Hammerlid, Eva; Ignacio Arraras, Juan; Conroy, Thierry; Lanceley, Anne; Schmidt, Heike; Wirtz, Markus; Singer, Susanne; Pinto, Monica; Alm El-Din, Mohamed; Compter, Inge; Holzner, Bernhard; Hofmeister, Dirk; Chie, Wei-Chu; Czeladzki, Marek; Harle, Amelie; Jones, Louise; Ritter, Sabrina; Flechtner, Hans-Henning; Bottomley, Andrew

2017-05-01

The European Organisation for Research and Treatment of Cancer (EORTC) Group has developed a new multidimensional instrument measuring cancer-related fatigue to be used in conjunction with the quality of life core questionnaire (EORTC QLQ-C30). The module EORTC QLQ-FA13 assesses physical, cognitive, and emotional aspects of cancer-related fatigue. The methodology follows the EORTC guidelines for phase IV validation of modules. This paper focuses on the results of the psychometric validation of the factorial structure of the module. For validation and cross-validation confirmatory factor analysis (maximum likelihood estimation), intraclass correlation and Cronbach alpha for internal consistency were employed. The study involved an international multicenter collaboration of 11 European and non-European countries. A total of 946 patients with various tumor diagnoses were enrolled. Based on the confirmatory factor analysis, we could approve the three-dimensional structure of the module. Removing one item and reassigning the factorial mapping of another item resulted in the EORTC QLQ-FA12. For the revised scale, we found evidence supporting good local (indicator reliability ≥ 0.60, factor reliability ≥ 0.82) and global model fit (GFI t1|t2 = 0.965/0.957, CFI t1|t2 = 0.976/0.972, RMSEA t1|t2 = 0.060/0.069) for both measurement points. For each scale, test-retest reliability proved to be very good (intraclass correlation: R t1-t2 = 0.905-0.921) and internal consistency proved to be good to high (Cronbach alpha = .79-.90). Based on the former phase III module, the multidimensional structure was revised as a phase IV module (EORTC FA12) with an improved scale structure. For a comprehensive validation of the EORTC FA12, further aspects of convergent and divergent validity as well as sensitivity to change should be determined. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Preliminary validation and reliability of the Short Form Chronic Respiratory Disease Questionnaire in a lung cancer population.

PubMed

Charalambous, A; Molassiotis, A

2017-01-01

The Short Form Chronic Respiratory Questionnaire (SF-CRQ) is frequently used in patients with obstructive pulmonary disease and it has demonstrated excellent psychometric properties. Since there is no psychometric information for its use with lung cancer patients, this study explored its validity and reliability in this population. Forty-six patients were assessed at two time points (with a 4-week interval) using the SF-CRQ, the modified Borg Scale, five numerical rating scales related to Perceived Severity of Breathlessness, and the Hospital Anxiety and Depression Scale. Internal consistency reliability was investigated by Cronbach's alpha reliability coefficient, test-retest reliability by Spearman-Brown reliability coefficient (P), content validity as well as convergent validity by Pearson's correlation coefficient between the SF-CRQ, and the conceptual similar scales mentioned above were explored. A principal component factor analysis was performed. The internal consistency was high [α = 0.88 (baseline) and 0.91 (after 1 month)]. The SF-CRQ had good stability with test-retest reliability ranging from r = 0.64 to 0.78, P < 0.001. Factor analysis suggests a single construct in this population. The preliminary data analyses supported the convergent, content, and construct validity of the SF-CRQ providing promising evidence that this can be a valid and reliable instrument for the assessment of quality of life related to breathlessness in lung cancer patients. © 2015 John Wiley & Sons Ltd.

Manual and automatic locomotion scoring systems in dairy cows: a review.

PubMed

Schlageter-Tello, Andrés; Bokkers, Eddie A M; Koerkamp, Peter W G Groot; Van Hertem, Tom; Viazzi, Stefano; Romanini, Carlos E B; Halachmi, Ilan; Bahr, Claudia; Berckmans, Daniël; Lokhorst, Kees

2014-09-01

The objective of this review was to describe, compare and evaluate agreement, reliability, and validity of manual and automatic locomotion scoring systems (MLSSs and ALSSs, respectively) used in dairy cattle lameness research. There are many different types of MLSSs and ALSSs. Twenty-five MLSSs were found in 244 articles. MLSSs use different types of scale (ordinal or continuous) and different gait and posture traits need to be observed. The most used MLSS (used in 28% of the references) is based on asymmetric gait, reluctance to bear weight, and arched back, and is scored on a five-level scale. Fifteen ALSSs were found that could be categorized according to three approaches: (a) the kinetic approach measures forces involved in locomotion, (b) the kinematic approach measures time and distance of variables associated to limb movement and some specific posture variables, and (c) the indirect approach uses behavioural variables or production variables as indicators for impaired locomotion. Agreement and reliability estimates were scarcely reported in articles related to MLSSs. When reported, inappropriate statistical methods such as PABAK and Pearson and Spearman correlation coefficients were commonly used. Some of the most frequently used MLSSs were poorly evaluated for agreement and reliability. Agreement and reliability estimates for the original four-, five- or nine-level MLSS, expressed in percentage of agreement, kappa and weighted kappa, showed large ranges among and sometimes also within articles. After the transformation into a two-level scale, agreement and reliability estimates showed acceptable estimates (percentage of agreement ≥ 75%; kappa and weighted kappa ≥ 0.6), but still estimates showed a large variation between articles. Agreement and reliability estimates for ALSSs were not reported in any article. Several ALSSs use MLSSs as a reference for model calibration and validation. However, varying agreement and reliability estimates of MLSSs make a clear definition of a lameness case difficult, and thus affect the validity of ALSSs. MLSSs and ALSSs showed limited validity for hoof lesion detection and pain assessment. The utilization of MLSSs and ALSSs should aim to the prevention and efficient management of conditions that induce impaired locomotion. Long-term studies comparing MLSSs and ALSSs while applying various strategies to detect and control unfavourable conditions leading to impaired locomotion are required to determine the usefulness of MLSSs and ALSSs for securing optimal production and animal welfare in practice. Copyright © 2014 Elsevier B.V. All rights reserved.

Measuring grandparenthood stress and reward: Developing a scale based on perceptions by grandparents with adolescent grandchildren in Hong Kong.

PubMed

Wei-Qun, Lou Vivian; Chi, Iris

2008-12-01

To develop a Grandparent Stress and Reward Scale (GSRS) for grandparents with adolescent grandchildren in a Chinese context. Twenty-three grandparents with adolescent grandchildren were given in-depth interviews on perceived grandparenthood stress and reward to develop the GSRS. The GSRS was then tested on 107 older adults (mean age, 75.8 years) whose youngest grandchildren were aged 12 or older, living in the community, and were recruited from elderly service agencies. Face-to-face interviews were conducted with a standardized questionnaire which included the GSRS, Life Satisfaction Scale for Chinese Elders (LSS-C), a single-item measure on grandparenthood stress, and demographic measures. The GSRS has satisfactory structure validity. It measures three aspects of reward (self-esteem and life satisfaction, life-long learning opportunity, and grandchildren support), and two aspects of stress (relationship-oriented stress and grandchildren-oriented stress). GSRS was correlated with LSS-C and perceived grandparenthood stress as theoretically expected, which supported its criteria-related validity. It also had satisfactory reliability based on the internal consistency coefficient. The GSRS was a valid and reliable measure that assesses meaning given to grandparents' perception on reward and stress in relations with adolescent grandchildren in a Chinese context. The underlying construct of the scale suggested that the meaning given to grandparenthood in the Chinese context was still influenced by the Confucian tradition.

Intra- and inter-tester reliability and validity of normal finger size measurement using the Japanese ring gauge system.

PubMed

Suzuki, T; Sato, Y; Sotome, S; Arai, H; Arai, A; Yoshida, H

2017-06-01

This study was designed to investigate the reliability and validity of measurements of finger diameters with a ring gauge. A reliability study enrolled two independent samples (50 participants and seven examiners in Study I; 26 participants and 26 examiners in Study II). The sizes of each participant's little fingers were measured twice with a ring gauge by each examiner. To investigate the validity of the measurements, five hand therapists compared the finger size and hand volume of 30 participants with the ring gauge and with a figure-of-eight technique (Study III). The intra-class correlation coefficient for intra-observer reliability ranged from 0.97 to 0.99 in Study I, and 0.90 to 0.97 in Study II. The intra-class correlation coefficient for inter-observer reliability was 0.95 in Study I and 0.94 in Study II. The validity study showed a Pearson product moment correlation coefficient of 0.75. The ring gauge showed high reliability and validity for measurement of finger size. III, diagnostic.

Posttraumatic maladaptive beliefs scale: evolution of the personal beliefs and reactions scale.

PubMed

Vogt, Dawne S; Shipherd, Jillian C; Resick, Patricia A

2012-09-01

The posttraumatic maladaptive beliefs scale (PMBS) was developed to measure maladaptive beliefs about current life circumstances that may occur following trauma exposure. This scale assesses maladaptive beliefs within three domains: (a) threat of harm, (b) self-worth and judgment, and (c) reliability and trustworthiness of others. Items for the PMBS were drawn from a larger preexisting measure that assesses a wide range of personal beliefs and reactions associated with trauma exposure. The construct validity of the PMBS was assessed in two independent samples of interpersonal trauma survivors. This article provides data to support the reliability and validity of the PMBS as an instrument to assess general, rather than trauma-specific, maladaptive beliefs that have relevance for functioning in the aftermath of a traumatic event. Moreover, the measure is sensitive to changes that occur in treatment, and the length of the measure (15 items) is practical for use in clinical settings.

Measuring subjective resilience despite adversity due to family, peers and teachers.

PubMed

Alonso-Tapia, Jesús; Nieto, Carmen; Ruíz, Miguel A

2013-01-01

The objective of this study is to develop and validate a scale of subjective resilience for students 12-17 years old. Items covered adverse situations due to parents', peers' and teachers' actions. The validation process included the analysis on the generalizability of the factor structure and of relationships of resilience scores with different kinds of protective and vulnerability factors -goal orientations and learning-oriented classroom motivational climate (CMC)-. A total of 471 students answered four questionnaires. Confirmatory factor analyses, reliability analysis and correlation and regression analyses were carried out. Results showed: (a) that factor structure was well defined; (b) that resilience scale had good reliability; (c) that scores correlated as expected with protective-vulnerability factors such as goal orientations and CMC defined by teachers' teaching-patterns, and (d) that students' attribution of perceived change in resilience to teachers' work depended on the degree in which CMC was learning oriented. Theoretical and practical implications are discussed.

The validation of Huffaz Intelligence Test (HIT)

NASA Astrophysics Data System (ADS)

Rahim, Mohd Azrin Mohammad; Ahmad, Tahir; Awang, Siti Rahmah; Safar, Ajmain

2017-08-01

In general, a hafiz who can memorize the Quran has many specialties especially in respect to their academic performances. In this study, the theory of multiple intelligences introduced by Howard Gardner is embedded in a developed psychometric instrument, namely Huffaz Intelligence Test (HIT). This paper presents the validation and the reliability of HIT of some tahfiz students in Malaysia Islamic schools. A pilot study was conducted involving 87 huffaz who were randomly selected to answer the items in HIT. The analysis method used includes Partial Least Square (PLS) on reliability, convergence and discriminant validation. The study has validated nine intelligences. The findings also indicated that the composite reliabilities for the nine types of intelligences are greater than 0.8. Thus, the HIT is a valid and reliable instrument to measure the multiple intelligences among huffaz.

Exploring the reliability and validity of the social-moral awareness test.

PubMed

Livesey, Alexandra; Dodd, Karen; Pote, Helen; Marlow, Elizabeth

2012-11-01

The aim of the study was to explore the validity of the social-moral awareness test (SMAT) a measure designed for assessing socio-moral rule knowledge and reasoning in people with learning disabilities. Comparisons between Theory of Mind and socio-moral reasoning allowed the exploration of construct validity of the tool. Factor structure, reliability and discriminant validity were also assessed. Seventy-one participants with mild-moderate learning disabilities completed the two scales of the SMAT and two False Belief Tasks for Theory of Mind. Reliability of the SMAT was very good, and the scales were shown to be uni-dimensional in factor structure. There was a significant positive relationship between Theory of Mind and both SMAT scales. There is early evidence of the construct validity and reliability of the SMAT. Further assessment of the validity of the SMAT will be required. © 2012 Blackwell Publishing Ltd.

Reliability and Validity: A Sine Qua Non for Fair Assessment of Undergraduate Technical and Vocational Education Projects in Nigerian Universities

ERIC Educational Resources Information Center

John, A. C.

2015-01-01

The aim of the study was to examine the importance of reliability and validity as necessary foundation for fair assessment. The concepts of reliability, validity, fair assessment and their relationships were analysed. Qualities of fair assessment were discussed. A number of recommendations were made to make assessors be more cautious in award of…

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

Cultural adaptation and validation of a peninsular Spanish version of the MSTCQ© (Multiple Sclerosis Treatment Concerns Questionnaire).

PubMed

Muntéis Olivas, E; Navarro Mascarell, G; Meca Lallana, J; Maestre Martínez, A; Pérez Sempere, Á; Gracia Gil, J; Pato Pato, A

Although subcutaneous treatments for multiple sclerosis (MS) have been shown to be effective, adverse reactions and pain may adversely affect treatment satisfaction and adherence. This study presents an adapted and validated Spanish version of the Multiple Sclerosis Treatment Concerns Questionnaire © (MSTCQ), which evaluates satisfaction with the injection device (ID) across 4 domains: injection system (A), side effects (B) (flu-like symptoms, reactions, and satisfaction), experience with treatment (C) and benefits (D). Two study phases: 1) Cultural adaptation process with input from experts (n=6) and patients (n=30). 2) Validation obtained by means of an observational, cross-sectional, multi-centre study evaluating 143 adult MS patients using an ID. Tools employed: MSTCQ © , Patient-Reported Indices for Multiple Sclerosis (PRIMUS © ), and Treatment Satisfaction Questionnaire for Medication (TSQM © ). Psychometric properties: Feasibility (percentage of valid cases and floor/ceiling effects); Reliability (Cronbach α) and test-retest correlation (n=41, intraclass correlation coefficient, ICC); and construct validity (factor analysis of domains A and B) and convergent validity (Spearman rank-order correlation for MSTCQ © vs TSQM © ). Mean age (SD) was 41.94 (10.47) years, 63% of the group were women, and 88.11% presented relapsing-remitting MS. Mean (SD) EDSS score was 2.68 (1.82) points. MSTCQ © completion was high (0%-2.80% missing data). Internal consistency was high at α=0.89 for the total score (A+B) and α=0.76, 0.89, and 0.92 for domains A, B, and C, respectively. The version demonstrated excellent test-retest reliability for the total (ICC=0.98) and for domains A, B, and C: ICC=0.82, 0.97, and 0.89, respectively. Factor analysis corroborated the internal structure of the original questionnaire. The association between total and domain scores on both the MSTCQ © and the TSQM © was moderately strong (Rho=0.42-0.74) and significant (P<.05 and P<.01). The Spanish version of MSTCQ © demonstrates appropriate psychometric properties. Copyright © 2014 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

Reliability and validity of the Incontinence Quiz-Turkish version.

PubMed

Kara, Kerime C; Çıtak Karakaya, İlkim; Tunalı, Nur; Karakaya, Mehmet G

2018-01-01

The aim of this study was to investigate the reliability and validity of the Turkish version of the Incontinence Quiz, which was developed by Branch et al. (1994), to assess women's knowledge of and attitudes toward urinary incontinence. Comprehensibility of the Turkish version of the 14-item Incontinence Quiz, which was prepared following translation-back translation procedures, was tested on a pilot group of eight women, and its internal reliability, test-retest reliability and construct validity were assessed in 150 women who attended the gynecology clinics of three hospitals in İçel, Turkey. Physical and sociodemographic characteristics and presence of incontinence complaints were also recorded. Data were analyzed at the 0.05 alpha level, using SPSS version 22. The scale had good reliability and validity. The internal reliability coefficient (Cronbach α) was 0.80, test-retest correlation coefficients were 0.83-0.94; and with regard to construct validity, Kaiser-Meyer-Olkin coefficient was 0.76 and Barlett sphericity test was 562.777 (P = 0.000). Turkish version of the Incontinence Quiz had a four-factor structure, with Eigenvalues ranging from 1.17 to 4.08. The Incontinence Quiz-Turkish version is a highly comprehensible, reliable and valid scale, which may be used to assess Turkish-speaking women's knowledge of and attitudes toward urinary incontinence. © 2017 Japan Society of Obstetrics and Gynecology.

The validity and reliability of a dynamic neuromuscular stabilization-heel sliding test for core stability.

PubMed

Cha, Young Joo; Lee, Jae Jin; Kim, Do Hyun; You, Joshua Sung H

2017-10-23

Core stabilization plays an important role in the regulation of postural stability. To overcome shortcomings associated with pain and severe core instability during conventional core stabilization tests, we recently developed the dynamic neuromuscular stabilization-based heel sliding (DNS-HS) test. The purpose of this study was to establish the criterion validity and test-retest reliability of the novel DNS-HS test. Twenty young adults with core instability completed both the bilateral straight leg lowering test (BSLLT) and DNS-HS test for the criterion validity study and repeated the DNS-HS test for the test-retest reliability study. Criterion validity was determined by comparing hip joint angle data that were obtained from BSLLT and DNS-HS measures. The test-retest reliability was determined by comparing hip joint angle data. Criterion validity was (ICC2,3) = 0.700 (p< 0.05), suggesting a good relationship between the two core stability measures. Test-retest reliability was (ICC3,3) = 0.953 (p< 0.05), indicating excellent consistency between the repeated DNS-HS measurements. Criterion validity data demonstrated a good relationship between the gold standard BSLLT and DNS-HS core stability measures. Test-retest reliability data suggests that DNS-HS core stability was a reliable test for core stability. Clinically, the DNS-HS test is useful to objectively quantify core instability and allow early detection and evaluation.

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

The assessment of fatigue: Psychometric qualities and norms for the Checklist individual strength.

PubMed

Worm-Smeitink, M; Gielissen, M; Bloot, L; van Laarhoven, H W M; van Engelen, B G M; van Riel, P; Bleijenberg, G; Nikolaus, S; Knoop, H

2017-07-01

The Checklist Individual Strength (CIS) measures four dimensions of fatigue: Fatigue severity, concentration problems, reduced motivation and activity. On the fatigue severity subscale, a cut-off score of 35 is used. This study 1) investigated the psychometric qualities of the CIS; 2) validated the cut-off score for severe fatigue and 3) provided norms. Representatives of the Dutch general population (n=2288) completed the CIS. The factor structure was investigated using an exploratory factor analysis. Internal consistency and test-retest reliability were determined. Concurrent validity was assessed in two additional samples by correlating the CIS with other fatigue scales (Chalder Fatigue Questionnaire, MOS Short form-36 Vitality subscale, EORTC QLQ-C30 fatigue subscale). To validate the fatigue severity cut-off score, a Receiver Operating Characteristics analysis was performed with patients referred to a chronic fatigue treatment centre (n=5243) and a healthy group (n=1906). Norm scores for CIS subscales were calculated for the general population, patients with chronic fatigue syndrome (CFS; n=1407) and eight groups with other medical conditions (n=1411). The original four-factor structure of the CIS was replicated. Internal consistency (α=0.84-0.95) and test-retest reliability (r=0.74-0.86) of the subscales were high. Correlations with other fatigue scales were moderate to high. The 35 points cut-off score for severe fatigue is appropriate, but, given the 17% false positive rate, should be adjusted to 40 for research in CFS. The CIS is a valid and reliable tool for the assessment of fatigue, with a validated cut-off score for severe fatigue that can be used in clinical practice. Copyright © 2017. Published by Elsevier Inc.

Identifying correlates of self-stigma in adults who stutter: Further establishing the construct validity of the Self-Stigma of Stuttering Scale (4S).

PubMed

Boyle, Michael P

2015-03-01

This study was set up to further establish the construct validity of the Self-Stigma of Stuttering Scale (4S) by demonstrating its associations with other established scales and replicating its original factor structure and reliability estimates. Web surveys were completed by 354 adults who stutter recruited from Board Certified Specialists in Fluency Disorders, and adult chapters of the National Stuttering Association. Participants completed a series of psychometrically validated scales measuring self-stigma, hope, empowerment, quality of life, social support, anxiety, depression, and self-rated speech disruption. Higher subscale and total stigma scores on the 4S were associated with significantly lower levels of hope, empowerment, quality of life, and social support, and significantly higher levels of anxiety, depression, and self-rated speech disruption. The original factor structure of the 4S was replicated, and reliability estimates of the subscales ranged from adequate to excellent. The findings of this study support the construct validity of the 4S and its use by clinicians and researchers intending to measure the construct of self-stigma in adults who stutter. Readers should be able to: (a) distinguish between the various components of self-stigma; (b) describe how the various components of the self-stigma model relate to hope, empowerment, quality of life, and social support, self-rated speech disruption, anxiety, and depression; (c) summarize the psychometric properties of the Self-Stigma of Stuttering Scale (4S) in terms of reliability, factor structure, and construct validity; (d) discuss how the 4S could be used in research and clinical practice. Copyright © 2015 Elsevier Inc. All rights reserved.

Promoting the Quality of Health Research-based News: Introduction of a Tool

PubMed Central

Ashoorkhani, Mahnaz; Majdzadeh, Reza; Nedjat, Saharnaz; Gholami, Jaleh

2017-01-01

Introduction: While disseminating health research findings to the public, it is very important to present appropriate and accurate information to give the target audience a correct understanding of the subject matter. The objective of this study was to design and psychometrically evaluate a checklist for health journalists to help them prepare news of appropriate accuracy and authenticity. Methods: The study consisted of two phases, checklist design and psychometrics. Literature review and expert opinion were used to extract the items of the checklist in the first phase. In the second phase, to assess content and face validity, the judgment of 38 persons (epidemiologists with a tool production history, editors-in-chief, and health journalists) was used to check the items’ understandability, nonambiguity, relevancy, and clarity. Reliability was assessed by the test–retest method using intra-cluster correlation (ICC) indices in the two phases. Cronbach's alpha was used to assess internal validity of the checklist. Results: Based on the participants’ opinions, the items were reduced from 20 to 14 in number. The items were categorized into the following three domains: (a) items assessing the source of news and its validity, (b) items addressing the presentation of complete and accurate information on research findings, and (c) items which if adhered to lead to the target audiences’ better understanding. The checklist was approved for content and face validity. The reliability of the checklist was assessed in the last stage; the ICC was 1 for 12 items and above 0.8 for the other two. Internal consistency (Cronbach's alpha) was 0.98. Discussion and Conclusions: The resultant indices of the study indicate that the checklist has appropriate validity and reliability. Hence, it can be used by health journalists to develop health research-based news. PMID:29184638

Development and validation of a music performance anxiety inventory for gifted adolescent musicians.

PubMed

Osborne, Margaret S; Kenny, Dianna T

2005-01-01

Music performance anxiety (MPA) is a distressing experience for musicians of all ages, yet the empirical investigation of MPA in adolescents has received little attention to date. No measures specifically targeting MPA in adolescents have been empirically validated. This article presents findings of an initial study into the psychometric properties and validation of the Music Performance Anxiety Inventory for Adolescents (MPAI-A), a new self-report measure of MPA for this group. Data from 381 elite young musicians aged 12-19 years was used to investigate the factor structure, internal reliability, construct and divergent validity of the MPAI-A. Cronbach's alpha for the full measure was .91. Factor analysis identified three factors, which together accounted for 53% of the variance. Construct validity was demonstrated by significant positive relationships with social phobia (measured using the Social Phobia Anxiety Inventory [Beidel, D. C., Turner, S. M., & Morris, T. L. (1995). A new inventory to assess childhood social anxiety and phobia: The Social Phobia and Anxiety Inventory for Children. Psychological Assessment, 7(1), 73-79; Beidel, D. C., Turner, S. M., & Morris, T. L. (1998). Social Phobia and Anxiety Inventory for Children (SPAI-C). North Tonawanda, NY: Multi-Health Systems Inc.]) and trait anxiety (measured using the State Trait Anxiety Inventory [Spielberger, C. D. (1983). State-Trait Anxiety Inventory STAI (Form Y). Palo Alto, CA: Consulting Psychologists Press, Inc.]). The MPAI-A demonstrated convergent validity by a moderate to strong positive correlation with an adult measure of MPA. Discriminant validity was established by a weaker positive relationship with depression, and no relationship with externalizing behavior problems. It is hoped that the MPAI-A, as the first empirically validated measure of adolescent musicians' performance anxiety, will enhance and promote phenomenological and treatment research in this area.

Sexual Orientation Self-Concept Ambiguity: Scale Adaptation and Validation.

PubMed

Talley, Amelia E; Stevens, Jordan E

2017-07-01

The current article describes the adaptation of a measure of sexual orientation self-concept ambiguity (SSA) from an existing measure of general self-concept clarity. Latent "trait" scores of SSA reflect the extent to which a person's beliefs about their own sexual orientation are perceived as inconsistent, unreliable, or incongruent. Sexual minority and heterosexual women ( n = 348), ages 18 to 30, completed a cross-sectional survey. Categorical confirmatory factor analysis guided the selection of items to form a 10-item, self-report measure of SSA. In the current report, we also examine (a) reliability of the 10-item scale score, (b) measurement invariance based on respondents' sexual identity status and age group, and (c) correlations with preexisting surveys that purport to measure similar constructs and theoretical correlates. Evidence for internal reliability, measurement invariance (based on respondent sex), and convergent validity was also investigated in an independent, validation sample. The lowest SSA scores were reported by women who self-ascribed an exclusively heterosexual or exclusively lesbian/gay sexual identity, whereas those who reported a bisexual, mostly lesbian/gay, or mostly heterosexual identity, reported relatively higher SSA scores.

Development and validation of a tailored measure of body image for pregnant women.

PubMed

Watson, Brittany; Fuller-Tyszkiewicz, Matthew; Broadbent, Jaclyn; Skouteris, Helen

2017-11-01

This study developed and validated a quantitative measure of body image specifically designed for pregnancy-the Body Image in Pregnancy Scale (BIPS). Scale development was guided by qualitative data from a series of studies exploring the meaning of women's body image experiences during pregnancy, and previously established body image measures. Exploratory factor analysis for a sample of pregnant women (n = 251) indicated good fit for a 36-item scale with seven factors: preoccupation with physical appearance, dissatisfaction with physical strength, dissatisfaction with facial features, sexual attractiveness, prioritizing physical appearance over body functioning, appearance-related behavioral avoidance, and dissatisfaction with body parts. BIPS subscale scores demonstrated good internal reliability, test-retest reliability, and both incremental and convergent validity with measures of body image, self-esteem, and depressive symptomatology. Although the pregnancy-focused wording of BIPS items prevents its use for comparisons with nonpregnant populations, further testing of changes in body image throughout pregnancy is an identified area for further research with this measure. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Linguistic validation of stigmatisation degree, self-esteem and knowledge questionnaire among asthma patients using Rasch analysis.

PubMed

Ahmad, Sohail; Ismail, Ahmad Izuanuddin; Khan, Tahir Mehmood; Akram, Waqas; Mohd Zim, Mohd Arif; Ismail, Nahlah Elkudssiah

2017-04-01

The stigmatisation degree, self-esteem and knowledge either directly or indirectly influence the control and self-management of asthma. To date, there is no valid and reliable instrument that can assess these key issues collectively. The main aim of this study was to test the reliability and validity of the newly devised and translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" among adult asthma patients using the Rasch measurement model. This cross-sectional study recruited thirty adult asthma patients from two respiratory specialist clinics in Selangor, Malaysia. The newly devised self-administered questionnaire was adapted from relevant publications and translated into the Malay language using international standard translation guidelines. Content and face validation was done. The data were extracted and analysed for real item reliability and construct validation using the Rasch model. The translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" showed high real item reliability values of 0.90, 0.86 and 0.89 for stigmatisation degree, self-esteem, and knowledge of asthma, respectively. Furthermore, all values of point measure correlation (PTMEA Corr) analysis were within the acceptable specified range of the Rasch model. Infit/outfit mean square values and Z standard (ZSTD) values of each item verified the construct validity and suggested retaining all the items in the questionnaire. The reliability analyses and output tables of item measures for construct validation proved the translated Malaysian version of "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" as a valid and highly reliable questionnaire.

Content validity and reliability of test of gross motor development in Chilean children

PubMed Central

Cano-Cappellacci, Marcelo; Leyton, Fernanda Aleitte; Carreño, Joshua Durán

2016-01-01

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries. PMID:26815160

Comment on Hall et al. (2017), "How to Choose Between Measures of Tinnitus Loudness for Clinical Research? A Report on the Reliability and Validity of an Investigator-Administered Test and a Patient-Reported Measure Using Baseline Data Collected in a Phase IIa Drug Trial".

PubMed

Sabour, Siamak

2018-03-08

The purpose of this letter, in response to Hall, Mehta, and Fackrell (2017), is to provide important knowledge about methodology and statistical issues in assessing the reliability and validity of an audiologist-administered tinnitus loudness matching test and a patient-reported tinnitus loudness rating. The author uses reference textbooks and published articles regarding scientific assessment of the validity and reliability of a clinical test to discuss the statistical test and the methodological approach in assessing validity and reliability in clinical research. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess reliability and validity. The qualitative variables of sensitivity, specificity, positive predictive value, negative predictive value, false positive and false negative rates, likelihood ratio positive and likelihood ratio negative, as well as odds ratio (i.e., ratio of true to false results), are the most appropriate estimates to evaluate validity of a test compared to a gold standard. In the case of quantitative variables, depending on distribution of the variable, Pearson r or Spearman rho can be applied. Diagnostic accuracy (validity) and diagnostic precision (reliability or agreement) are two completely different methodological issues. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess validity.

[Turkish validity and reliability study of fear of pain questionnaire-III].

PubMed

Ünver, Seher; Turan, Fatma Nesrin

2018-01-01

This study aimed to develop a Turkish version of the Fear of Pain Questionnaire-III developed by McNeil and Rainwater (1998) and examine its validity and reliability indicators. The study was conducted with 459 university students studying in the nursing department. The Turkish translation of the scale was conducted by language experts and the original scale owner. Expert opinions were taken for language validity, and the Lawshe's content validity ratio formula was used to calculate the content validity. Exploratory factor analysis was used to assess the construct validity. The factors were rotated using the Varimax rotation (orthogonal) method. For reliability indicators of the questionnaire, the internal consistency coefficient and test re-test reliability were utilized. Explanatory factor analyses using the three-factor model (explaining 50.5% of the total variance) revealed that the item factor loads varied were above the limit value of 0.30 which indicated that the questionnaire had good construct validity. The Cronbach's alpha value for the total questionnaire was 0.938, and test re-test value was 0.846 for the total scale. The Turkish version of the Fear of Pain Questionnaire-III had sufficiently high reliability and validity to be used as a tool in evaluating the fear of pain among the young Turkish population.

Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale

PubMed Central

Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe

2018-01-01

Introduction Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. Objective To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. Method The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. Results The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Conclusion Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results. PMID:29736104

Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale.

PubMed

Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe

2018-04-01

Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results.

Validity and Reliability Testing of an e-learning Questionnaire for Chemistry Instruction

NASA Astrophysics Data System (ADS)

Guspatni, G.; Kurniawati, Y.

2018-04-01

The aim of this paper is to examine validity and reliability of a questionnaire used to evaluate e-learning implementation in chemistry instruction. 48 questionnaires were filled in by students who had studied chemistry through e-learning system. The questionnaire consisted of 20 indicators evaluating students’ perception on using e-learning. Parametric testing was done as data were assumed to follow normal distribution. Item validity of the questionnaire was examined through item-total correlation using Pearson’s formula while its reliability was assessed with Cronbach’s alpha formula. Moreover, convergent validity was assessed to see whether indicators building a factor had theoretically the same underlying construct. The result of validity testing revealed 19 valid indicators while the result of reliability testing revealed Cronbach’s alpha value of .886. The result of factor analysis showed that questionnaire consisted of five factors, and each of them had indicators building the same construct. This article shows the importance of factor analysis to get a construct valid questionnaire before it is used as research instrument.

Assessment of the Validity of the Research Diagnostic Criteria for Temporomandibular Disorders: Overview and Methodology

PubMed Central

Schiffman, Eric L.; Truelove, Edmond L.; Ohrbach, Richard; Anderson, Gary C.; John, Mike T.; List, Thomas; Look, John O.

2011-01-01

AIMS The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. An overview is presented, including Axis I and II methodology and descriptive statistics for the study participant sample. This paper details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. Validity testing for the Axis II biobehavioral instruments was based on previously validated reference standards. METHODS The Axis I reference standards were based on the consensus of 2 criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion exam reliability was also assessed within study sites. RESULTS Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas ≥ 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion exam agreement with reference standards was excellent (k ≥ 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). CONCLUSION The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods. PMID:20213028

The Strengths and Difficulties Questionnaire: psychometric properties of the parent and teacher version in children aged 4-7.

PubMed

Stone, Lisanne L; Janssens, Jan M A M; Vermulst, Ad A; Van Der Maten, Marloes; Engels, Rutger C M E; Otten, Roy

2015-01-01

The Strengths and Difficulties Questionnaire is one of the most employed screening instruments. Although there is a large research body investigating its psychometric properties, reliability and validity are not yet fully tested using modern techniques. Therefore, we investigate reliability, construct validity, measurement invariance, and predictive validity of the parent and teacher version in children aged 4-7. Besides, we intend to replicate previous studies by investigating test-retest reliability and criterion validity. In a Dutch community sample 2,238 teachers and 1,513 parents filled out questionnaires regarding problem behaviors and parenting, while 1,831 children reported on sociometric measures at T1. These children were followed-up during three consecutive years. Reliability was examined using Cronbach's alpha and McDonald's omega, construct validity was examined by Confirmatory Factor Analysis, and predictive validity was examined by calculating developmental profiles and linking these to measures of inadequate parenting, parenting stress and social preference. Further, mean scores and percentiles were examined in order to establish norms. Omega was consistently higher than alpha regarding reliability. The original five-factor structure was replicated, and measurement invariance was established on a configural level. Further, higher SDQ scores were associated with future indices of higher inadequate parenting, higher parenting stress and lower social preference. Finally, previous results on test-retest reliability and criterion validity were replicated. This study is the first to show SDQ scores are predictively valid, attesting to the feasibility of the SDQ as a screening instrument. Future research into predictive validity of the SDQ is warranted.

Validity and reliability of the Myotest accelerometric system for the assessment of vertical jump height.

PubMed

Casartelli, Nicola; Müller, Roland; Maffiuletti, Nicola A

2010-11-01

The aim of the present study was to verify the validity and reliability of the Myotest accelerometric system (Myotest SA, Sion, Switzerland) for the assessment of vertical jump height. Forty-four male basketball players (age range: 9-25 years) performed series of squat, countermovement and repeated jumps during 2 identical test sessions separated by 2-15 days. Flight height was simultaneously quantified with the Myotest system and validated photoelectric cells (Optojump). Two calculation methods were used to estimate the jump height from Myotest recordings: flight time (Myotest-T) and vertical takeoff velocity (Myotest-V). Concurrent validity was investigated comparing Myotest-T and Myotest-V to the criterion method (Optojump), and test-retest reliability was also examined. As regards validity, Myotest-T overestimated jumping height compared to Optojump (p < 0.001) with a systematic bias of approximately 7 cm, even though random errors were low (2.7 cm) and intraclass correlation coefficients (ICCs) where high (>0.98), that is, excellent validity. Myotest-V overestimated jumping height compared to Optojump (p < 0.001), with high random errors (>12 cm), high limits of agreement ratios (>36%), and low ICCs (<0.75), that is, poor validity. As regards reliability, Myotest-T showed high ICCs (range: 0.92-0.96), whereas Myotest-V showed low ICCs (range: 0.56-0.89), and high random errors (>9 cm). In conclusion, Myotest-T is a valid and reliable method for the assessment of vertical jump height, and its use is legitimate for field-based evaluations, whereas Myotest-V is neither valid nor reliable.

Validity and Reliability of Farsi Version of Youth Sport Environment Questionnaire

PubMed Central

Eshghi, Mohammad Ali; Kordi, Ramin; Memari, Amir Hossein; Ghaziasgar, Ahmad; Mansournia, Mohammad-Ali; Zamani Sani, Seyed Hojjat

2015-01-01

The Youth Sport Environment Questionnaire (YSEQ) had been developed from Group Environment Questionnaire, a well-known measure of team cohesion. The aim of this study was to adapt and examine the reliability and validity of the Farsi version of the YSEQ. This version was completed by 455 athletes aged 13–17 years. Results of confirmatory factor analysis indicated that two-factor solution showed a good fit to the data. The results also revealed that the Farsi YSEQ showed high internal consistency, test-retest reliability, and good concurrent validity. This study indicated that the Farsi version of the YSEQ is a valid and reliable measure to assess team cohesion in sport setting. PMID:26464900

Validation of a Novel Scoring System for Changes in Skeletal Manifestations of Hypophosphatasia in Newborns, Infants, and Children: The Radiographic Global Impression of Change Scale.

PubMed

Whyte, Michael P; Fujita, Kenji P; Moseley, Scott; Thompson, David D; McAlister, William H

2018-05-01

Hypophosphatasia (HPP) is the heritable metabolic disease characterized by impaired skeletal mineralization due to low activity of the tissue-nonspecific isoenzyme of alkaline phosphatase. Although HPP during growth often manifests with distinctive radiographic skeletal features, no validated method was available to quantify them, including changes over time. We created the Radiographic Global Impression of Change (RGI-C) scale to assess changes in the skeletal burden of pediatric HPP. Site-specific pairs of radiographs of newborns, infants, and children with HPP from three clinical studies of asfotase alfa, an enzyme replacement therapy for HPP, were obtained at baseline and during treatment. Each pair was scored by three pediatric radiologists ("raters"), with nine raters across the three studies. Intrarater and interrater agreement was determined by weighted Kappa coefficients. Interrater reliability was assessed using intraclass correlation coefficients (ICCs) and by two-way random effects analysis of variance (ANOVA) and a mixed-model repeated measures ANOVA. Pearson correlation coefficients evaluated relationships of the RGI-C to the Rickets Severity Scale (RSS), Pediatric Outcomes Data Collection Instrument Global Function Parent Normative Score, Childhood Health Assessment Questionnaire Disability Index, 6-Minute Walk Test percent predicted, and Z-score for height in patients aged 6 to 12 years at baseline. Eighty-nine percent (8/9) of raters showed substantial or almost perfect intrarater agreement of sequential RGI-C scores (weighted Kappa coefficients, 0.72 to 0.93) and moderate or substantial interrater agreement (weighted Kappa coefficients, 0.53 to 0.71) in patients aged 0 to 12 years at baseline. Moderate-to-good interrater reliability was observed (ICC, 0.57 to 0.65). RGI-C scores were significantly (p ≤ 0.0065) correlated with the RSS and with measures of global function, disability, endurance, and growth in the patients aged 6 to 12 years at baseline. Thus, the RGI-C is valid and reliable for detecting clinically important changes in skeletal manifestations of severe HPP in newborns, infants, and children, including during asfotase alfa treatment. © 2018 The Authors. Journal of Bone and Mineral Research Published by Wiley Periodicals Inc. © 2018 The Authors. Journal of Bone and Mineral Research Published by Wiley Periodicals Inc.

Validity and reliability of the modified Chinese version of the Older People's Quality of Life Questionnaire (OPQOL) in older people living alone in China.

PubMed

Chen, Yu; Hicks, Allan; While, Alison E

2014-12-01

This study aimed to test the validity and reliability of a modified Chinese version of the OPQOL among older people living alone in China. China has an ageing population with an increasing number of older people living alone who may have a poorer quality of life (QoL) in the light of the traditional culture of collectivism and filial piety. An appropriate instrument is important to assess their QoL. The Older People's Quality of Life Questionnaire (OPQOL) was developed directly from the views of older people and has been validated in England. There has been no psychometric evaluation of the scale in China. The OPQOL was translated and modified prior to being administered to a stratified random cluster sample of 521 older people living alone. Validity was assessed through convergent validity, discriminant validity and construct validity. Reliability was assessed through internal consistency and test-retest reliability. Exploratory factor analysis indicated eight factors accounting for 63.77% of the variance. The convergent validity was supported by moderate correlations with functional ability, social support and loneliness with Spearman's rho of -0.50, 0.49 and -0.53, respectively. The discriminant validity was confirmed by differentiating QoL scores between the depressed and non-depressed groups. The Cronbach's α coefficient was 0.90 for the total scale and over 0.70 for most of its dimensions. The 2-week test-retest reliability ranged from 0.53 to 0.87. The modified Chinese version of the Older People's Quality of Life has acceptable validity and reliability as a useful instrument to measure the QoL of older people living alone in China. © 2013 John Wiley & Sons Ltd.

The Vocal Cord Dysfunction Questionnaire: Validity and Reliability of the Persian Version.

PubMed

Ghaemi, Hamide; Khoddami, Seyyedeh Maryam; Soleymani, Zahra; Zandieh, Fariborz; Jalaie, Shohreh; Ahanchian, Hamid; Khadivi, Ehsan

2017-12-25

The aim of this study was to develop, validate, and assess the reliability of the Persian version of Vocal Cord Dysfunction Questionnaire (VCDQ P ). The study design was cross-sectional or cultural survey. Forty-four patients with vocal fold dysfunction (VFD) and 40 healthy volunteers were recruited for the study. To assess the content validity, the prefinal questions were given to 15 experts to comment on its essential. Ten patients with VFD rated the importance of VCDQ P in detecting face validity. Eighteen of the patients with VFD completed the VCDQ 1 week later for test-retest reliability. To detect absolute reliability, standard error of measurement and smallest detected change were calculated. Concurrent validity was assessed by completing the Persian Chronic Obstructive Pulmonary Disease (COPD) Assessment Test (CAT) by 34 patients with VFD. Discriminant validity was measured from 34 participants. The VCDQ was further validated by administering the questionnaire to 40 healthy volunteers. Validation of the VCDQ as a treatment outcome tool was conducted in 18 patients with VFD using pre- and posttreatment scores. The internal consistency was confirmed (Cronbach α = 0.78). The test-retest reliability was excellent (intraclass correlation coefficient = 0.97). The standard error of measurement and smallest detected change values were acceptable (0.39 and 1.08, respectively). There was a significant correlation between the VCDQ P and the CAT total scores (P < 0.05). Discriminative validity was significantly different. The VCDQ scores in patients with VFD before and after treatment was significantly different (P < 0.001). The VCDQ was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-administered questionnaire in Persian-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Validation of cystatin C-based equations for evaluating residual renal function in patients on continuous ambulatory peritoneal dialysis.

PubMed

Zhong, Hui; Zhang, Wei; Qin, Min; Gou, ZhongPing; Feng, Ping

2017-06-01

Residual renal function needs to be assessed frequently in patients on continuous ambulatory peritoneal dialysis (CAPD). A commonly used method is to measure creatinine (Cr) and urea clearance in urine collected over 24 h, but collection can be cumbersome and difficult to manage. A faster, simpler alternative is to measure levels of cystatin C (CysC) in serum, but the accuracy and reliability of this method is controversial. Our study aims to validate published CysC-based equations for estimating residual renal function in patients on CAPD. Residual renal function was measured by calculating average clearance of urea and Cr in 24-h urine as well as by applying CysC- or Cr-based equations published by Hoek and Yang. We then compared the performance of the equations against the 24-h urine results. In our sample of 255 patients ages 47.9 ± 15.6 years, the serum CysC level was 6.43 ± 1.13 mg/L. Serum CysC level was not significantly associated with age, gender, height, weight, body mass index, hemoglobin, intact parathyroid hormone, normalized protein catabolic rate or the presence of diabetes. In contrast, serum CysC levels did correlate with peritoneal clearance of CysC and with levels of prealbumin and high-sensitivity C-reactive protein. Residual renal function was 2.56 ± 2.07 mL/min/1.73 m 2 based on 24-h urine sampling, compared with estimates (mL/min/1.73 m 2 ) of 2.98 ± 0.66 for Hoek's equation, 2.03 ± 0.97 for Yang's CysC-based equation and 2.70 ± 1.30 for Yang's Cr-based equation. Accuracies within 30%/50% of measured residual renal function for the three equations were 29.02/48.24, 34.90/56.86 and 31.37/54.90. The three equations for estimating residual renal function showed similar limits of agreement and differed significantly from the measured value. Published CysC-based equations do not appear to be particularly reliable for patients on CAPD. Further development and validation of CysC-based equations should take into account peritoneal clearance of CysC and other relevant factors. © The Author 2016. Published by Oxford University Press on behalf of ERA-EDTA. All rights reserved.

Reliability and validity of Kano Test for Social Nicotine Dependence (KTSND), and development of its revised scale assessing the psychosocial acceptability of smoking among university students.

PubMed

Kitada, Masako; Musashi, Manabu; Kano, Masato

2011-08-01

To examine reliability and validity of Kano Test for Social Nicotine Dependence (KTSND), a scale assessing the psychosocial acceptability of smoking, and to develop a new version when validity or reliability of KTSND was not acceptable. We carried out a self-administered cross-sectional survey on undergraduate university students. The participants completed the KTSND, and supplemented three questions on the attitudes toward tobacco control policies and smoking states. Using daily smokers, we examined the relationship between the KTSND and Fagerström Test for Nicotine Dependence (FTND). In each study, we examined test-retest reliability and construct validity, discriminant and convergent validity, and factor validity. Although the KTSND had high internal consistency (Cronbach's a 0.82) and high test-retest reliability (r=0.72), the results of factor analysis were unacceptable; we expected three factors to be extracted, however, only two factors of "Overestimate of smoking usefulness" and "Allege smoking as a taste and/or culture" were extracted. Using the Kano's Test for Assessing Acceptability of Smoking (KTAAS), the new version of KTSND in which a question was replaced with another one, the third factor of "Neglect of harm of tobacco smoking" was extracted adding to the above-mentioned two. KTAAS had also both high internal consistency (Cronbach's alpha 0.82) and test-retest reliability (r=0.66). Overall, the KTSND and the KTAAS score differed according to smoking states, and the nonsmokers' scores were the lowest. The KTSND was a popular questionnaire in Japan, however, its validity assessed using factor analysis was not acceptable, while KTAAS had sufficient reliability and validity, and might assess the cognition and attitude affirming or accepting tobacco smoking among university students.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET)

PubMed Central

Koehler, Ryan J.; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J.; Nicandri, Gregg T.

2014-01-01

Background Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. Hypothesis The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability, when used to assess the technical ability of surgeons performing diagnostic knee arthroscopy on cadaveric specimens. Study Design Cross-sectional study; Level of evidence, 3 Methods Content validity was determined by a group of seven experts using a Delphi process. Intra-articular performance of a right and left diagnostic knee arthroscopy was recorded for twenty-eight residents and two sports medicine fellowship trained attending surgeons. Subject performance was assessed by two blinded raters using the ASSET. Concurrent criterion-oriented validity, inter-rater reliability, and test-retest reliability were evaluated. Results Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in total ASSET score (p<0.05) between novice, intermediate, and advanced experience groups were identified. Inter-rater reliability: The ASSET scores assigned by each rater were strongly correlated (r=0.91, p <0.01) and the intra-class correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: there was a significant correlation between ASSET scores for both procedures attempted by each individual (r = 0.79, p<0.01). Conclusion The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopy in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live OR and other simulated environments. PMID:23548808

Reliability and Validity of a Nepalese Version of the Oral Health Impact Profile for Edentulous Subjects.

PubMed

Shrestha, Bidhan; Niraula, Surya Raj; Parajuli, Prakash K; Suwal, Pramita; Singh, Raj Kumar

2018-06-01

To assess the reliability and to validate the translated Nepalese version of the Oral Health Impact Profile (OHIP-EDENT-N) in Nepalese edentulous subjects. The international guidelines for translation and cross-cultural adaption of OHIP-EDENT were followed, and a Nepalese version of the questionnaire was adapted for this study. Eighty-eight completely edentulous subjects were then selected for the study and completed their responses for the questionnaire. The reliability of the OHIP-EDENT-N was evaluated using internal consistency. Validity was assessed as construct and convergent validity. Construct validity was determined using exploratory factor analysis (EFA). The correlation between OHIP-EDENT-N subscale scores and the global question was investigated to test the convergent validity. Cronbach's alpha for the total score of OHIP-EDENT-N was 0.78. Construct validity was assessed by factor analysis: 70.196% of the variance was accountable to five factors extracted from the factor analysis. Factor loadings above 0.40 were noted for all items. In terms of convergent validity, significant correlations could be established between OHIP-EDENT-N and global questions. This study has been able to establish the reliability and validity of the OHIP-EDENT-N, and OHIP-EDENT-N can be a considered a reliable tool to assess the oral health related quality of life in the Nepalese edentulous population. © 2016 by the American College of Prosthodontists.

Assessing accident phobia in mild traumatic brain injury: The Accident Fear Questionnaire.

PubMed

Sutherland, Jessica; Middleton, Jason; Ornstein, Tisha J; Lawson, Kerry; Vickers, Kristin

2016-08-01

Despite a documented prevalence of accident phobia in almost 40% of motor vehicle accident (MVA) survivors, the onset of accident phobia after traumatic brain injury (TBI) remains poorly understood. There is currently a body of knowledge about posttraumatic stress disorder (PTSD) in patients with TBI, but less is known about accident phobia following TBI, particularly in cases of mild TBI (mTBI). Accident phobia can impede safe return to driving or motor vehicle travel, inhibiting return to daily functioning. In addition, pain complaints have been found to correlate positively with postinjury anxiety disorders. The present study sought to determine the reliability and validity of the Accident Fear Questionnaire (AFQ), a measure used to assess accident phobia, in 72 patients with mTBI using secondary data analysis and the subsequent development of accident phobia postinjury. Furthermore, we sought to examine the impact of pain, anxiety, and depression complaints on the AFQ. Results reveal convergent validity and reliability in mTBI populations. Additionally, pain, anxiety, and depression measures were significantly correlated with scores on the AFQ. Psychometrically, the phobia avoidance subscale of the AFQ is a reliable measure for use with mTBI populations, although some limitations were found. In particular, the accident profile (AP) subscale was not found to be reliable or valid and could be eliminated from the AFQ. Collectively, the present study contributes to the small body of published literature evaluating accident phobia in patients with mTBI and the impact of pain on the development of postinjury anxiety disorders. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Perceived experiences of atheist discrimination: Instrument development and evaluation.

PubMed

Brewster, Melanie E; Hammer, Joseph; Sawyer, Jacob S; Eklund, Austin; Palamar, Joseph

2016-10-01

The present 2 studies describe the development and initial psychometric evaluation of a new instrument, the Measure of Atheist Discrimination Experiences (MADE), which may be used to examine the minority stress experiences of atheist people. Items were created from prior literature, revised by a panel of expert researchers, and assessed psychometrically. In Study 1 (N = 1,341 atheist-identified people), an exploratory factor analysis with 665 participants suggested the presence of 5 related dimensions of perceived discrimination. However, bifactor modeling via confirmatory factor analysis and model-based reliability estimates with data from the remaining 676 participants affirmed the presence of a strong "general" factor of discrimination and mixed to poor support for substantive subdimensions. In Study 2 (N = 1,057 atheist-identified people), another confirmatory factor analysis and model-based reliability estimates strongly supported the bifactor model from Study 1 (i.e., 1 strong "general" discrimination factor) and poor support for subdimensions. Across both studies, the MADE general factor score demonstrated evidence of good reliability (i.e., Cronbach's alphas of .94 and .95; omega hierarchical coefficients of .90 and .92), convergent validity (i.e., with stigma consciousness, β = .56; with awareness of public devaluation, β = .37), and preliminary evidence for concurrent validity (i.e., with loneliness β = .18; with psychological distress β = .27). Reliability and validity evidence for the MADE subscale scores was not sufficient to warrant future use of the subscales. Limitations and implications for future research and clinical work with atheist individuals are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Reliability and Validity of the Japanese Version of the Kinesthetic and Visual Imagery Questionnaire (KVIQ)

PubMed Central

Nakano, Hideki; Kodama, Takayuki; Ukai, Kazumasa; Kawahara, Satoru; Horikawa, Shiori; Murata, Shin

2018-01-01

In this study, we aimed to (1) translate the English version of the Kinesthetic and Visual Imagery Questionnaire (KVIQ), which assesses motor imagery ability, into Japanese, and (2) investigate the reliability and validity of the Japanese KVIQ. We enrolled 28 healthy adults in this study. We used Cronbach’s alpha coefficients to assess reliability reflected by the internal consistency. Additionally, we assessed validity reflected by the criterion-related validity between the Japanese KVIQ and the Japanese version of the Movement Imagery Questionnaire-Revised (MIQ-R) with Spearman’s rank correlation coefficients. The Cronbach’s alpha coefficients for the KVIQ-20 were 0.88 (Visual) and 0.91 (Kinesthetic), which indicates high reliability. There was a significant positive correlation between the Japanese KVIQ-20 (Total) and the Japanese MIQ-R (Total) (r = 0.86, p < 0.01). Our results suggest that the Japanese KVIQ is an assessment that is a reliable and valid index of motor imagery ability. PMID:29724042

Reliability and Validity of the Japanese Version of the Kinesthetic and Visual Imagery Questionnaire (KVIQ).

PubMed

Nakano, Hideki; Kodama, Takayuki; Ukai, Kazumasa; Kawahara, Satoru; Horikawa, Shiori; Murata, Shin

2018-05-02

In this study, we aimed to (1) translate the English version of the Kinesthetic and Visual Imagery Questionnaire (KVIQ), which assesses motor imagery ability, into Japanese, and (2) investigate the reliability and validity of the Japanese KVIQ. We enrolled 28 healthy adults in this study. We used Cronbach’s alpha coefficients to assess reliability reflected by the internal consistency. Additionally, we assessed validity reflected by the criterion-related validity between the Japanese KVIQ and the Japanese version of the Movement Imagery Questionnaire-Revised (MIQ-R) with Spearman’s rank correlation coefficients. The Cronbach’s alpha coefficients for the KVIQ-20 were 0.88 (Visual) and 0.91 (Kinesthetic), which indicates high reliability. There was a significant positive correlation between the Japanese KVIQ-20 (Total) and the Japanese MIQ-R (Total) (r = 0.86, p < 0.01). Our results suggest that the Japanese KVIQ is an assessment that is a reliable and valid index of motor imagery ability.

Reliability and validity of the AutoCAD software method in lumbar lordosis measurement

PubMed Central

Letafatkar, Amir; Amirsasan, Ramin; Abdolvahabi, Zahra; Hadadnezhad, Malihe

2011-01-01

Objective The aim of this study was to determine the reliability and validity of the AutoCAD software method in lumbar lordosis measurement. Methods Fifty healthy volunteers with a mean age of 23 ± 1.80 years were enrolled. A lumbar lateral radiograph was taken on all participants, and the lordosis was measured according to the Cobb method. Afterward, the lumbar lordosis degree was measured via AutoCAD software and flexible ruler methods. The current study is accomplished in 2 parts: intratester and intertester evaluations of reliability as well as the validity of the flexible ruler and software methods. Results Based on the intraclass correlation coefficient, AutoCAD's reliability and validity in measuring lumbar lordosis were 0.984 and 0.962, respectively. Conclusions AutoCAD showed to be a reliable and valid method to measure lordosis. It is suggested that this method may replace those that are costly and involve health risks, such as radiography, in evaluating lumbar lordosis. PMID:22654681

Reliability and validity of the AutoCAD software method in lumbar lordosis measurement.

PubMed

Letafatkar, Amir; Amirsasan, Ramin; Abdolvahabi, Zahra; Hadadnezhad, Malihe

2011-12-01

The aim of this study was to determine the reliability and validity of the AutoCAD software method in lumbar lordosis measurement. Fifty healthy volunteers with a mean age of 23 ± 1.80 years were enrolled. A lumbar lateral radiograph was taken on all participants, and the lordosis was measured according to the Cobb method. Afterward, the lumbar lordosis degree was measured via AutoCAD software and flexible ruler methods. The current study is accomplished in 2 parts: intratester and intertester evaluations of reliability as well as the validity of the flexible ruler and software methods. Based on the intraclass correlation coefficient, AutoCAD's reliability and validity in measuring lumbar lordosis were 0.984 and 0.962, respectively. AutoCAD showed to be a reliable and valid method to measure lordosis. It is suggested that this method may replace those that are costly and involve health risks, such as radiography, in evaluating lumbar lordosis.

The Experiences in Close Relationship Scale (ECR)-short form: reliability, validity, and factor structure.

PubMed

Wei, Meifen; Russell, Daniel W; Mallinckrodt, Brent; Vogel, David L

2007-04-01

We developed a 12-item, short form of the Experiences in Close Relationship Scale (ECR; Brennan, Clark, & Shaver, 1998) across 6 studies. In Study 1, we examined the reliability and factor structure of the measure. In Studies 2 and 3, we cross-validated the reliability, factor structure, and validity of the short form measure; whereas in Study 4, we examined test-retest reliability over a 1-month period. In Studies 5 and 6, we further assessed the reliability, factor structure, and validity of the short version of the ECR when administered as a stand-alone instrument. Confirmatory factor analyses indicated that 2 factors, labeled Anxiety and Avoidance, provided a good fit to the data after removing the influence of response sets. We found validity to be equivalent for the short and the original versions of the ECR across studies. Finally, the results were comparable when we embedded the short form within the original version of the ECR and when we administered it as a stand-alone measure.

Reliability and validity of the Korean version of the Short Musculoskeletal Function Assessment questionnaire for patients with musculoskeletal disorder.

PubMed

Jung, Kyoung-Sim; Jung, Jin-Hwa; In, Tae-Sung; Cho, Hwi-Young

2016-09-01

[Purpose] The purpose of this study was to establish the reliability and validity of the Short Musculoskeletal Function Assessment questionnaire, which was translated into Korean, for patients with musculoskeletal disorder. [Subjects and Methods] Fifty-five subjects (26 males and 29 females) with musculoskeletal diseases participated in the study. The Short Musculoskeletal Function Assessment questionnaire focuses on a limited range of physical functions and includes a dysfunction index and a bother index. Reliability was determined using the intraclass correlation coefficient, and validity was examined by correlating short musculoskeletal function assessment scores with the 36-item Short-Form Health Survey (SF-36) score. [Results] The reliability was 0.97 for the dysfunction index and 0.94 for the bother index. Validity was established by comparison with Korean version of the SF-36. [Conclusion] This study demonstrated that the Korean version of the Short Musculoskeletal Function Assessment questionnaire is a reliable and valid instrument for the assessment of musculoskeletal disorders.

Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

PubMed

Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

2018-02-01

Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

Psychometric Properties of the Death Anxiety Scale-Extended among Patients with End-Stage Renal Disease.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Koocher, Gerald P; Yaghoobzadeh, Ameneh; Haghdoost, Ali Akbar; Mar Win, Ma Thin; Soleimani, Mohammad Ali

2017-01-01

This study aimed to evaluate the validity and reliability of the Persian version of Death Anxiety Scale-Extended (DAS-E). A total of 507 patients with end-stage renal disease completed the DAS-E. The factor structure of the scale was evaluated using exploratory factor analysis with an oblique rotation and confirmatory factor analysis. The content and construct validity of the DAS-E were assessed. Average variance extracted, maximum shared squared variance, and average shared squared variance were estimated to assess discriminant and convergent validity. Reliability was assessed using Cronbach's alpha coefficient (α = .839 and .831), composite reliability (CR = .845 and .832), Theta (θ = .893 and .867), and McDonald Omega (Ω = .796 and .743). The analysis indicated a two-factor solution. Reliability and discriminant validity of the factors was established. Findings revealed that the present scale was a valid and reliable instrument that can be used in assessment of death anxiety in Iranian patients with end-stage renal disease.

Reliability and validity of the Safe Routes to school parent and student surveys.

PubMed

McDonald, Noreen C; Dwelley, Amanda E; Combs, Tabitha S; Evenson, Kelly R; Winters, Richard H

2011-06-08

The purpose of this study is to assess the reliability and validity of the U.S. National Center for Safe Routes to School's in-class student travel tallies and written parent surveys. Over 65,000 tallies and 374,000 parent surveys have been completed, but no published studies have examined their measurement properties. Students and parents from two Charlotte, NC (USA) elementary schools participated. Tallies were conducted on two consecutive days using a hand-raising protocol; on day two students were also asked to recall the previous days' travel. The recall from day two was compared with day one to assess 24-hour test-retest reliability. Convergent validity was assessed by comparing parent-reports of students' travel mode with student-reports of travel mode. Two-week test-retest reliability of the parent survey was assessed by comparing within-parent responses. Reliability and validity were assessed using kappa statistics. A total of 542 students participated in the in-class student travel tally reliability assessment and 262 parent-student dyads participated in the validity assessment. Reliability was high for travel to and from school (kappa > 0.8); convergent validity was lower but still high (kappa > 0.75). There were no differences by student grade level. Two-week test-retest reliability of the parent survey (n=112) ranged from moderate to very high for objective questions on travel mode and travel times (kappa range: 0.62-0.97) but was substantially lower for subjective assessments of barriers to walking to school (kappa range: 0.31-0.76). The student in-class student travel tally exhibited high reliability and validity at all elementary grades. The parent survey had high reliability on questions related to student travel mode, but lower reliability for attitudinal questions identifying barriers to walking to school. Parent survey design should be improved so that responses clearly indicate issues that influence parental decision making in regards to their children's mode of travel to school. © 2011 McDonald et al; licensee BioMed Central Ltd.

Measuring verbal and non-verbal communication in aphasia: reliability, validity, and sensitivity to change of the Scenario Test.

PubMed

van der Meulen, Ineke; van de Sandt-Koenderman, W Mieke E; Duivenvoorden, Hugo J; Ribbers, Gerard M

2010-01-01

This study explores the psychometric qualities of the Scenario Test, a new test to assess daily-life communication in severe aphasia. The test is innovative in that it: (1) examines the effectiveness of verbal and non-verbal communication; and (2) assesses patients' communication in an interactive setting, with a supportive communication partner. To determine the reliability, validity, and sensitivity to change of the Scenario Test and discuss its clinical value. The Scenario Test was administered to 122 persons with aphasia after stroke and to 25 non-aphasic controls. Analyses were performed for the entire group of persons with aphasia, as well as for a subgroup of persons unable to communicate verbally (n = 43). Reliability (internal consistency, test-retest reliability, inter-judge, and intra-judge reliability) and validity (internal validity, convergent validity, known-groups validity) and sensitivity to change were examined using standard psychometric methods. The Scenario Test showed high levels of reliability. Internal consistency (Cronbach's alpha = 0.96; item-rest correlations = 0.58-0.82) and test-retest reliability (ICC = 0.98) were high. Agreement between judges in total scores was good, as indicated by the high inter- and intra-judge reliability (ICC = 0.86-1.00). Agreement in scores on the individual items was also good (square-weighted kappa values 0.61-0.92). The test demonstrated good levels of validity. A principal component analysis for categorical data identified two dimensions, interpreted as general communication and communicative creativity. Correlations with three other instruments measuring communication in aphasia, that is, Spontaneous Speech interview from the Aachen Aphasia Test (AAT), Amsterdam-Nijmegen Everyday Language Test (ANELT), and Communicative Effectiveness Index (CETI), were moderate to strong (0.50-0.85) suggesting good convergent validity. Group differences were observed between persons with aphasia and non-aphasic controls, as well as between persons with aphasia unable to use speech to convey information and those able to communicate verbally; this indicates good known-groups validity. The test was sensitive to changes in performance, measured over a period of 6 months. The data support the reliability and validity of the Scenario Test as an instrument for examining daily-life communication in aphasia. The test focuses on multimodal communication; its psychometric qualities enable future studies on the effect of Alternative and Augmentative Communication (AAC) training in aphasia.

Validity and Reliability in Social Science Research

ERIC Educational Resources Information Center

Drost, Ellen A.

2011-01-01

In this paper, the author aims to provide novice researchers with an understanding of the general problem of validity in social science research and to acquaint them with approaches to developing strong support for the validity of their research. She provides insight into these two important concepts, namely (1) validity; and (2) reliability, and…

[Reliability and validity of the Chinese version on Comprehensive Scores for Financial Toxicity based on the patient-reported outcome measures].

PubMed

Yu, H H; Bi, X; Liu, Y Y

2017-08-10

Objective: To evaluate the reliability and validity of the Chinese version on comprehensive scores for financial toxicity (COST), based on the patient-reported outcome measures. Methods: A total of 118 cancer patients were face-to-face interviewed by well-trained investigators. Cronbach's α and Pearson correlation coefficient were used to evaluate reliability. Content validity index (CVI) and exploratory factor analysis (EFA) were used to evaluate the content validity and construct validity, respectively. Results: The Cronbach's α coefficient appeared as 0.889 for the whole questionnaire, with the results of test-retest were between 0.77 and 0.98. Scale-content validity index (S-CVI) appeared as 0.82, with item-content validity index (I-CVI) between 0.83 and 1.00. Two components were extracted from the Exploratory factor analysis, with cumulative rate as 68.04% and loading>0.60 on every item. Conclusion: The Chinese version of COST scale showed high reliability and good validity, thus can be applied to assess the financial situation in cancer patients.

Reliability and Construct Validity of the Dutch Psychopathy Checklist: Youth Version--Findings from a Sample of Male Adolescents in a Juvenile Justice Treatment Institution

ERIC Educational Resources Information Center

Das, Jacqueline; de Ruiter, Corine; Doreleijers, Theo; Hillege, Sanne

2009-01-01

The present study examines the reliability and construct validity of the Dutch version of the Psychopathy Check List: Youth Version (PCL:YV) in a sample of male adolescents admitted to a secure juvenile justice treatment institution (N = 98). Hare's four-factor model is used to examine reliability and validity of the separate dimensions of…

Understanding Interrater Reliability and Validity of Risk Assessment Tools Used to Predict Adverse Clinical Events.

PubMed

Siedlecki, Sandra L; Albert, Nancy M

This article will describe how to assess interrater reliability and validity of risk assessment tools, using easy-to-follow formulas, and to provide calculations that demonstrate principles discussed. Clinical nurse specialists should be able to identify risk assessment tools that provide high-quality interrater reliability and the highest validity for predicting true events of importance to clinical settings. Making best practice recommendations for assessment tool use is critical to high-quality patient care and safe practices that impact patient outcomes and nursing resources. Optimal risk assessment tool selection requires knowledge about interrater reliability and tool validity. The clinical nurse specialist will understand the reliability and validity issues associated with risk assessment tools, and be able to evaluate tools using basic calculations. Risk assessment tools are developed to objectively predict quality and safety events and ultimately reduce the risk of event occurrence through preventive interventions. To ensure high-quality tool use, clinical nurse specialists must critically assess tool properties. The better the tool's ability to predict adverse events, the more likely that event risk is mediated. Interrater reliability and validity assessment is relatively an easy skill to master and will result in better decisions when selecting or making recommendations for risk assessment tool use.

Linguistic validation and reliability properties are weak investigated of most dementia-specific quality of life measurements-a systematic review.

PubMed

Dichter, Martin Nikolaus; Schwab, Christian G G; Meyer, Gabriele; Bartholomeyczik, Sabine; Halek, Margareta

2016-02-01

For people with dementia, the concept of quality of life (Qol) reflects the disease's impact on the whole person. Thus, Qol is an increasingly used outcome measure in dementia research. This systematic review was performed to identify available dementia-specific Qol measurements and to assess the quality of linguistic validations and reliability studies of these measurements (PROSPERO 2013: CRD42014008725). The MEDLINE, CINAHL, EMBASE, PsycINFO, and Cochrane Methodology Register databases were systematically searched without any date restrictions. Forward and backward citation tracking were performed on the basis of selected articles. A total of 70 articles addressing 19 dementia-specific Qol measurements were identified; nine measurements were adapted to nonorigin countries. The quality of the linguistic validations varied from insufficient to good. Internal consistency was the most frequently tested reliability property. Most of the reliability studies lacked internal validity. Qol measurements for dementia are insufficiently linguistic validated and not well tested for reliability. None of the identified measurements can be recommended without further research. The application of international guidelines and quality criteria is strongly recommended for the performance of linguistic validations and reliability studies of dementia-specific Qol measurements. Copyright © 2016 Elsevier Inc. All rights reserved.

Reliability and validity analysis of the open-source Chinese Foot and Ankle Outcome Score (FAOS).

PubMed

Ling, Samuel K K; Chan, Vincent; Ho, Karen; Ling, Fona; Lui, T H

2017-12-21

Develop the first reliable and validated open-source outcome scoring system in the Chinese language for foot and ankle problems. Translation of the English FAOS into Chinese following regular protocols. First, two forward-translations were created separately, these were then combined into a preliminary version by an expert committee, and was subsequently back-translated into English. The process was repeated until the original and back translations were congruent. This version was then field tested on actual patients who provided feedback for modification. The final Chinese FAOS version was then tested for reliability and validity. Reliability analysis was performed on 20 subjects while validity analysis was performed on 50 subjects. Tools used to validate the Chinese FAOS were the SF36 and Pain Numeric Rating Scale (NRS). Internal consistency between the FAOS subgroups was measured using Cronbach's alpha. Spearman's correlation was calculated between each subgroup in the FAOS, SF36 and NRS. The Chinese FAOS passed both reliability and validity testing; meaning it is reliable, internally consistent and correlates positively with the SF36 and the NRS. The Chinese FAOS is a free, open-source scoring system that can be used to provide a relatively standardised outcome measure for foot and ankle studies. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Persian Version of the "Life Satisfaction Scale": Construct Validity and Test-Re-Test Reliability among Iranian Older Adults.

PubMed

Moghadam, Manije; Salavati, Mahyar; Sahaf, Robab; Rassouli, Maryam; Moghadam, Mojgan; Kamrani, Ahmad Ali Akbari

2018-03-01

After forward-backward translation, the LSS was administered to 334 Persian speaking, cognitively healthy elderly aged 60 years and over recruited through convenience sampling. To analyze the validity of the model's constructs and the relationships between the constructs, a confirmatory factor analysis followed by PLS analysis was performed. The Construct validity was further investigated by calculating the correlations between the LSS and the "Short Form Health Survey" (SF-36) subscales measuring similar and dissimilar constructs. The LSS was re-administered to 50 participants a month later to assess the reliability. For the eight-factor model of the life satisfaction construct, adequate goodness of fit between the hypothesized model and the model derived from the sample data was attained (positive and statistically significant beta coefficients, good R-squares and acceptable GoF). Construct validity was supported by convergent and discriminant validity, and correlations between the LSS and SF-36 subscales. Minimum Intraclass Correlation Coefficient level of 0.60 was exceeded by all subscales. Minimum level of reliability indices (Cronbach's α, composite reliability and indicator reliability) was exceeded by all subscales. The Persian-version of the Life Satisfaction Scale is a reliable and valid instrument, with psychometric properties which are consistent with the original version.

Evaluative frailty index for physical activity (EFIP): a reliable and valid instrument to measure changes in level of frailty.

PubMed

de Vries, Nienke M; Staal, J Bart; Olde Rikkert, Marcel G M; Nijhuis-van der Sanden, Maria W G

2013-04-01

Physical activity is assumed to be important in the prevention and treatment of frailty. It is unclear, however, to what extent frailty can be influenced because instruments designed to assess frailty have not been validated as evaluative outcome instruments in clinical practice. The aims of this study were: (1) to develop a frailty index (i.e., the evaluative frailty index for physical activity [EFIP]) based on the method of deficit accumulation and (2) to test the clinimetric properties of the EFIP. The content of the EFIP was determined using a written Delphi procedure. Intrarater reliability, interrater reliability, and construct validity were determined in an observational study (n=24). Intrarater reliability and interrater reliability were calculated using Cohen kappa and intraclass correlation coefficients (ICCs). Construct validity was determined by correlating the score on the EFIP with those on the timed "up & go" test (TUG), the performance-oriented mobility assessment (POMA), and the Cumulative Illness Rating Scale for Geriatrics (CIRS-G). Fifty items were included in the EFIP. Interrater reliability (Cohen kappa=0.72, ICC=.96) and intrarater reliability (Cohen kappa=0.77 and 0.80, ICC=.93 and .98) were good. As expected, a fair to moderate correlation with the TUG, POMA, and CIRS-G was found (.61, -.70, and .66, respectively). Reliability and validity of the EFIP have been tested in a small sample. These and other clinimetric properties, such as responsiveness, will be assessed or reassessed in a larger study population. The EFIP is a reliable and valid instrument to evaluate the effect of physical activity on frailty in research and in clinical practice.

VALIDITY AND RELIABILITY OF THE SPIRITUAL COPING STRATEGIES SCALE ARABIC VERSION IN SAUDI PATIENTS UNDERGOING HAEMODIALYSIS.

PubMed

Cruz, Jonas P; Baldacchino, Donia R; Alquwez, Nahed

2016-06-01

Patients often resort to religious and spiritual activities to cope with physical and mental challenges. The effect of spiritual coping on overall health, adaptation and health-related quality of life among patients undergoing haemodialysis (HD) is well documented. Thus, it is essential to establish a valid and reliable instrument that can assess both the religious and non-religious coping methods in patients undergoing HD. This study aimed to assess the validity and reliability of the Spiritual Coping Strategies Scale Arabic version (SCS-A) in Saudi patients undergoing HD. A convenience sample of 60 Saudi patients undergoing HD was recruited for this descriptive, cross-sectional study. Data were collected between May and June 2015. Forward-backward translation was used to formulate the SCS-A. The SCS-A, Muslim Religiosity Scale and the Quality of Life Index Dialysis Version III were used to procure the data. Internal consistency reliability, stability reliability, factor analysis and construct validity tests were performed. Analyses were set at the 0.05 level of significance. The SCS-A showed an acceptable internal consistency and strong stability reliability over time. The EFA produced two factors (non-religious and religious coping). Satisfactory construct validity was established by the convergent and divergent validity and known-groups method. The SCS-A is a reliable and valid tool that can be used to measure the religious and non-religious coping strategies of patients undergoing HD in Saudi Arabia and other Muslim and Arabic-speaking countries. © 2016 European Dialysis and Transplant Nurses Association/European Renal Care Association.